2024-05-08T18:40:01.528 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T18:40:01.528 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697938 --verbose --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}} --owner scheduled_ivancich@teuthology --name ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi -- /home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697938/orig.config.yaml 2024-05-08T18:40:01.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T18:40:01.650 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697938 branch: wip-upgrade-arrow-15 description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}} email: ivancich@redhat.com first_in_suite: false job_id: '7697938' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-upgrade-arrow-15 ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: d8e5981c6605c876b5b6ba50848d5d2454dc9bd0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d8e5981c6605c876b5b6ba50848d5d2454dc9bd0 rgw: ec-data-pool: false frontend: beast selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-upgrade-arrow-15 sha1: d8e5981c6605c876b5b6ba50848d5d2454dc9bd0 owner: scheduled_ivancich@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 831 sha1: d8e5981c6605c876b5b6ba50848d5d2454dc9bd0 sleep_before_teardown: 0 subset: 1/50 suite: rgw suite_branch: wip-upgrade-arrow-15 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d8e5981c6605c876b5b6ba50848d5d2454dc9bd0 targets: smithi042.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKD5O6Pe6cpnNxjd3G21auPflEkahkFX3Ea3sP2pmO29wLeYsnc1kNkynjvQIadQKDV7IhQAn5N0Nx3mrVR+Lvk= smithi132.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCgb0cOKXM4ZPx3uhO2Z5XiLjokewFtlAXEgs14mr3X6gM7h0wbRO0rc5Hszpwt4A/R44KxDSq0dWeJFbw1darE= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_17:44:56 tube: smithi user: ivancich verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T18:40:01.650 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/qa; will attempt to use it 2024-05-08T18:40:01.651 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/qa/tasks 2024-05-08T18:40:01.651 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T18:40:01.653 INFO:teuthology.task.internal:Checking packages... 2024-05-08T18:40:01.679 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd8e5981c6605c876b5b6ba50848d5d2454dc9bd0' 2024-05-08T18:40:01.680 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T18:40:01.680 INFO:teuthology.packaging:ref: None 2024-05-08T18:40:01.680 INFO:teuthology.packaging:tag: None 2024-05-08T18:40:01.680 INFO:teuthology.packaging:branch: wip-upgrade-arrow-15 2024-05-08T18:40:01.680 INFO:teuthology.packaging:sha1: d8e5981c6605c876b5b6ba50848d5d2454dc9bd0 2024-05-08T18:40:01.680 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-upgrade-arrow-15 2024-05-08T18:40:01.913 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3463.gd8e5981c 2024-05-08T18:40:01.915 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T18:40:01.924 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T18:40:01.924 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T18:40:01.936 INFO:teuthology.task.internal:Saving configuration 2024-05-08T18:40:01.948 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T18:40:01.956 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T18:40:01.980 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697938', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 18:35:17.926746', 'locked_by': 'scheduled_ivancich@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKD5O6Pe6cpnNxjd3G21auPflEkahkFX3Ea3sP2pmO29wLeYsnc1kNkynjvQIadQKDV7IhQAn5N0Nx3mrVR+Lvk='} 2024-05-08T18:40:02.001 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697938', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 18:35:17.928268', 'locked_by': 'scheduled_ivancich@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCgb0cOKXM4ZPx3uhO2Z5XiLjokewFtlAXEgs14mr3X6gM7h0wbRO0rc5Hszpwt4A/R44KxDSq0dWeJFbw1darE='} 2024-05-08T18:40:02.001 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T18:40:02.009 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-05-08T18:40:02.009 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-05-08T18:40:02.009 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T18:40:02.081 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f26c76dd0d0>, signals=[15]) 2024-05-08T18:40:02.081 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T18:40:02.088 INFO:teuthology.task.internal:Opening connections... 2024-05-08T18:40:02.088 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi042.front.sepia.ceph.com 2024-05-08T18:40:02.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:40:02.165 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi132.front.sepia.ceph.com 2024-05-08T18:40:02.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:40:02.240 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T18:40:02.247 DEBUG:teuthology.orchestra.run.smithi042:> uname -m 2024-05-08T18:40:02.265 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2024-05-08T18:40:02.266 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2024-05-08T18:40:02.323 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream" 2024-05-08T18:40:02.323 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9" 2024-05-08T18:40:02.323 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2024-05-08T18:40:02.323 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2024-05-08T18:40:02.323 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9" 2024-05-08T18:40:02.323 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9" 2024-05-08T18:40:02.323 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T18:40:02.323 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2024-05-08T18:40:02.324 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon" 2024-05-08T18:40:02.324 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T18:40:02.324 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/" 2024-05-08T18:40:02.324 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T18:40:02.324 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T18:40:02.324 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T18:40:02.325 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2024-05-08T18:40:02.346 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2024-05-08T18:40:02.364 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2024-05-08T18:40:02.364 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-05-08T18:40:02.421 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2024-05-08T18:40:02.421 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="9" 2024-05-08T18:40:02.421 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2024-05-08T18:40:02.421 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2024-05-08T18:40:02.422 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="9" 2024-05-08T18:40:02.422 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el9" 2024-05-08T18:40:02.422 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T18:40:02.422 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2024-05-08T18:40:02.422 INFO:teuthology.orchestra.run.smithi132.stdout:LOGO="fedora-logo-icon" 2024-05-08T18:40:02.422 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T18:40:02.422 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2024-05-08T18:40:02.422 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T18:40:02.422 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T18:40:02.422 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T18:40:02.422 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-05-08T18:40:02.462 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T18:40:02.472 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T18:40:02.478 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T18:40:02.478 DEBUG:teuthology.orchestra.run.smithi042:> test '!' -e /home/ubuntu/cephtest 2024-05-08T18:40:02.481 DEBUG:teuthology.orchestra.run.smithi132:> test '!' -e /home/ubuntu/cephtest 2024-05-08T18:40:02.497 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T18:40:02.504 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T18:40:02.504 DEBUG:teuthology.orchestra.run.smithi042:> test -z $(ls -A /var/lib/ceph) 2024-05-08T18:40:02.538 DEBUG:teuthology.orchestra.run.smithi132:> test -z $(ls -A /var/lib/ceph) 2024-05-08T18:40:02.627 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T18:40:02.682 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T18:40:02.696 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-08T18:40:02.696 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-08T18:40:02.696 DEBUG:teuthology.orchestra.run.smithi042:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T18:40:02.697 DEBUG:teuthology.orchestra.run.smithi132:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T18:40:02.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:40:02.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:40:02.715 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-05-08T18:40:02.715 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2024-05-08T18:40:02.772 INFO:teuthology.orchestra.run.smithi132.stdout:5.14.0-437.el9.x86_64 2024-05-08T18:40:02.772 INFO:teuthology.task.kernel:Running kernel on smithi132: 5.14.0-437.el9.x86_64 2024-05-08T18:40:02.772 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum install -y kernel 2024-05-08T18:40:02.773 INFO:teuthology.orchestra.run.smithi042.stdout:5.14.0-437.el9.x86_64 2024-05-08T18:40:02.774 INFO:teuthology.task.kernel:Running kernel on smithi042: 5.14.0-437.el9.x86_64 2024-05-08T18:40:02.774 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum install -y kernel 2024-05-08T18:40:05.240 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 9.6 MB/s | 8.1 MB 00:00 2024-05-08T18:40:06.284 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.1 MB 00:01 2024-05-08T18:40:08.144 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-05-08T18:40:10.282 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 4.9 MB/s | 19 MB 00:03 2024-05-08T18:40:12.519 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 6.2 MB 00:00 2024-05-08T18:40:14.403 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-05-08T18:40:14.541 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-05-08T18:40:15.580 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 20 MB/s | 21 MB 00:01 2024-05-08T18:40:16.250 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-05-08T18:40:17.738 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-05-08T18:40:20.696 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-05-08T18:40:22.703 INFO:teuthology.orchestra.run.smithi132.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-08T18:40:22.703 INFO:teuthology.orchestra.run.smithi132.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-08T18:40:22.789 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:40:22.796 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:40:22.796 INFO:teuthology.orchestra.run.smithi132.stdout: Package Architecture Version Repository Size 2024-05-08T18:40:22.796 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:40:22.797 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-05-08T18:40:22.797 INFO:teuthology.orchestra.run.smithi132.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-08T18:40:22.797 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-05-08T18:40:22.797 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-08T18:40:22.797 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-08T18:40:22.797 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-08T18:40:22.797 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:40:22.797 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-05-08T18:40:22.797 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:40:22.797 INFO:teuthology.orchestra.run.smithi132.stdout:Install 4 Packages 2024-05-08T18:40:22.797 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:40:22.798 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 78 M 2024-05-08T18:40:22.798 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 123 M 2024-05-08T18:40:22.798 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-05-08T18:40:23.027 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-05-08T18:40:23.082 INFO:teuthology.orchestra.run.smithi132.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 1.9 MB/s | 484 kB 00:00 2024-05-08T18:40:25.125 INFO:teuthology.orchestra.run.smithi042.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-08T18:40:25.126 INFO:teuthology.orchestra.run.smithi042.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-08T18:40:25.216 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:40:25.226 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:40:25.226 INFO:teuthology.orchestra.run.smithi042.stdout: Package Architecture Version Repository Size 2024-05-08T18:40:25.226 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:40:25.226 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-05-08T18:40:25.226 INFO:teuthology.orchestra.run.smithi042.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-08T18:40:25.226 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-05-08T18:40:25.226 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-08T18:40:25.226 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-08T18:40:25.226 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-08T18:40:25.226 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:40:25.227 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-05-08T18:40:25.227 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:40:25.227 INFO:teuthology.orchestra.run.smithi042.stdout:Install 4 Packages 2024-05-08T18:40:25.227 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:40:25.228 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 78 M 2024-05-08T18:40:25.228 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 123 M 2024-05-08T18:40:25.228 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-05-08T18:40:25.832 INFO:teuthology.orchestra.run.smithi132.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 5.1 MB/s | 15 MB 00:02 2024-05-08T18:40:26.379 INFO:teuthology.orchestra.run.smithi042.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 467 kB/s | 484 kB 00:01 2024-05-08T18:40:27.021 INFO:teuthology.orchestra.run.smithi042.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 9.2 MB/s | 15 MB 00:01 2024-05-08T18:40:27.821 INFO:teuthology.orchestra.run.smithi042.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 14 MB/s | 34 MB 00:02 2024-05-08T18:40:28.690 INFO:teuthology.orchestra.run.smithi132.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 5.8 MB/s | 34 MB 00:05 2024-05-08T18:40:28.804 INFO:teuthology.orchestra.run.smithi042.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 12 MB/s | 28 MB 00:02 2024-05-08T18:40:28.804 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:40:28.805 INFO:teuthology.orchestra.run.smithi042.stdout:Total 22 MB/s | 78 MB 00:03 2024-05-08T18:40:28.957 INFO:teuthology.orchestra.run.smithi132.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 4.8 MB/s | 28 MB 00:05 2024-05-08T18:40:28.957 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:40:28.957 INFO:teuthology.orchestra.run.smithi132.stdout:Total 13 MB/s | 78 MB 00:06 2024-05-08T18:40:29.508 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-05-08T18:40:29.638 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-05-08T18:40:29.893 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-05-08T18:40:29.893 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-05-08T18:40:29.971 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-05-08T18:40:29.971 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-05-08T18:40:30.853 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-05-08T18:40:30.854 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-05-08T18:40:30.901 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-05-08T18:40:30.902 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-05-08T18:40:33.302 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-05-08T18:40:33.399 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-05-08T18:40:34.030 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-08T18:40:34.114 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T18:40:34.242 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-08T18:40:34.325 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T18:40:36.918 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T18:40:36.986 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T18:40:37.055 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T18:40:37.123 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T18:40:42.135 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T18:40:42.167 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T18:40:42.183 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:40:42.217 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:40:46.989 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:40:47.279 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:41:16.319 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:41:16.357 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:41:16.654 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:41:16.655 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-08T18:41:16.655 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T18:41:16.655 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T18:41:17.491 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:41:17.491 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:41:17.491 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-05-08T18:41:17.491 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-08T18:41:17.491 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-08T18:41:17.491 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-08T18:41:17.491 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-08T18:41:17.491 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:41:17.491 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:41:17.830 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T18:41:17.905 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T18:41:17.906 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T18:41:17.906 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-08T18:41:17.906 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T18:41:17.906 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T18:41:17.906 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-05-08T18:41:17.906 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi132.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T18:41:17.906 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T18:41:17.955 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T18:41:17.955 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T18:41:17.956 DEBUG:teuthology.orchestra.run.smithi132:> sudo rpm -qi grub2-tools 2024-05-08T18:41:17.986 INFO:teuthology.orchestra.run.smithi132.stdout:Name : grub2-tools 2024-05-08T18:41:17.986 INFO:teuthology.orchestra.run.smithi132.stdout:Epoch : 1 2024-05-08T18:41:17.986 INFO:teuthology.orchestra.run.smithi132.stdout:Version : 2.06 2024-05-08T18:41:17.986 INFO:teuthology.orchestra.run.smithi132.stdout:Release : 68.el9 2024-05-08T18:41:17.986 INFO:teuthology.orchestra.run.smithi132.stdout:Architecture: x86_64 2024-05-08T18:41:17.986 INFO:teuthology.orchestra.run.smithi132.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-08T18:41:17.987 INFO:teuthology.orchestra.run.smithi132.stdout:Group : Unspecified 2024-05-08T18:41:17.987 INFO:teuthology.orchestra.run.smithi132.stdout:Size : 8264254 2024-05-08T18:41:17.987 INFO:teuthology.orchestra.run.smithi132.stdout:License : GPLv3+ 2024-05-08T18:41:17.987 INFO:teuthology.orchestra.run.smithi132.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-08T18:41:17.987 INFO:teuthology.orchestra.run.smithi132.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-08T18:41:17.987 INFO:teuthology.orchestra.run.smithi132.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-08T18:41:17.987 INFO:teuthology.orchestra.run.smithi132.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-08T18:41:17.987 INFO:teuthology.orchestra.run.smithi132.stdout:Packager : builder@centos.org 2024-05-08T18:41:17.987 INFO:teuthology.orchestra.run.smithi132.stdout:Vendor : CentOS 2024-05-08T18:41:17.987 INFO:teuthology.orchestra.run.smithi132.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T18:41:17.987 INFO:teuthology.orchestra.run.smithi132.stdout:Summary : Support tools for GRUB. 2024-05-08T18:41:17.987 INFO:teuthology.orchestra.run.smithi132.stdout:Description : 2024-05-08T18:41:17.987 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:41:17.987 INFO:teuthology.orchestra.run.smithi132.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T18:41:17.987 INFO:teuthology.orchestra.run.smithi132.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T18:41:17.988 INFO:teuthology.orchestra.run.smithi132.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T18:41:17.988 INFO:teuthology.orchestra.run.smithi132.stdout:hardware devices. 2024-05-08T18:41:17.988 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:41:17.988 INFO:teuthology.orchestra.run.smithi132.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T18:41:17.989 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T18:41:17.989 INFO:teuthology.task.kernel:Updating grub on smithi132 to boot 5.14.0-444.el9.x86_64 2024-05-08T18:41:17.989 DEBUG:teuthology.orchestra.run.smithi132:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T18:41:18.432 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:41:18.472 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:41:18.585 INFO:teuthology.orchestra.run.smithi132.stderr:Generating grub configuration file ... 2024-05-08T18:41:18.792 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:41:18.792 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-08T18:41:18.792 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T18:41:18.792 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T18:41:19.642 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T18:41:19.643 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:41:19.643 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-05-08T18:41:19.643 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-08T18:41:19.643 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-08T18:41:19.643 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-08T18:41:19.643 INFO:teuthology.orchestra.run.smithi042.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-08T18:41:19.643 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:41:19.643 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:41:20.006 INFO:teuthology.orchestra.run.smithi132.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-08T18:41:20.013 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T18:41:20.032 INFO:teuthology.orchestra.run.smithi132.stderr:done 2024-05-08T18:41:20.034 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2024-05-08T18:41:20.050 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.7o6co0nHhi 2024-05-08T18:41:20.050 DEBUG:teuthology.orchestra.run.smithi132:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.7o6co0nHhi 2024-05-08T18:41:20.105 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T18:41:20.105 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T18:41:20.106 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-08T18:41:20.106 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T18:41:20.106 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T18:41:20.106 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-08T18:41:20.106 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi042.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T18:41:20.106 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T18:41:20.126 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.7o6co0nHhi 2024-05-08T18:41:20.157 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T18:41:20.158 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T18:41:20.158 DEBUG:teuthology.orchestra.run.smithi042:> sudo rpm -qi grub2-tools 2024-05-08T18:41:20.200 INFO:teuthology.orchestra.run.smithi042.stdout:Name : grub2-tools 2024-05-08T18:41:20.200 INFO:teuthology.orchestra.run.smithi042.stdout:Epoch : 1 2024-05-08T18:41:20.200 INFO:teuthology.orchestra.run.smithi042.stdout:Version : 2.06 2024-05-08T18:41:20.200 INFO:teuthology.orchestra.run.smithi042.stdout:Release : 68.el9 2024-05-08T18:41:20.200 INFO:teuthology.orchestra.run.smithi042.stdout:Architecture: x86_64 2024-05-08T18:41:20.200 INFO:teuthology.orchestra.run.smithi042.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-08T18:41:20.200 INFO:teuthology.orchestra.run.smithi042.stdout:Group : Unspecified 2024-05-08T18:41:20.200 INFO:teuthology.orchestra.run.smithi042.stdout:Size : 8264254 2024-05-08T18:41:20.200 INFO:teuthology.orchestra.run.smithi042.stdout:License : GPLv3+ 2024-05-08T18:41:20.200 INFO:teuthology.orchestra.run.smithi042.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-08T18:41:20.201 INFO:teuthology.orchestra.run.smithi042.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-08T18:41:20.201 INFO:teuthology.orchestra.run.smithi042.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-08T18:41:20.201 INFO:teuthology.orchestra.run.smithi042.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-08T18:41:20.201 INFO:teuthology.orchestra.run.smithi042.stdout:Packager : builder@centos.org 2024-05-08T18:41:20.201 INFO:teuthology.orchestra.run.smithi042.stdout:Vendor : CentOS 2024-05-08T18:41:20.201 INFO:teuthology.orchestra.run.smithi042.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T18:41:20.202 INFO:teuthology.orchestra.run.smithi042.stdout:Summary : Support tools for GRUB. 2024-05-08T18:41:20.202 INFO:teuthology.orchestra.run.smithi042.stdout:Description : 2024-05-08T18:41:20.202 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:41:20.202 INFO:teuthology.orchestra.run.smithi042.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T18:41:20.202 INFO:teuthology.orchestra.run.smithi042.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T18:41:20.202 INFO:teuthology.orchestra.run.smithi042.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T18:41:20.202 INFO:teuthology.orchestra.run.smithi042.stdout:hardware devices. 2024-05-08T18:41:20.202 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:41:20.202 INFO:teuthology.orchestra.run.smithi042.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T18:41:20.203 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T18:41:20.203 INFO:teuthology.task.kernel:Updating grub on smithi042 to boot 5.14.0-444.el9.x86_64 2024-05-08T18:41:20.203 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T18:41:20.267 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.7o6co0nHhi is 6KB 2024-05-08T18:41:20.316 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.7o6co0nHhi 2024-05-08T18:41:20.330 DEBUG:teuthology.orchestra.run.smithi132:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T18:41:20.391 INFO:teuthology.orchestra.run.smithi132.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-08T18:41:20.391 INFO:teuthology.orchestra.run.smithi132.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-08T18:41:20.392 INFO:teuthology.orchestra.run.smithi132.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-08T18:41:20.392 INFO:teuthology.orchestra.run.smithi132.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-08T18:41:20.393 DEBUG:teuthology.orchestra.run.smithi132:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-08T18:41:20.540 DEBUG:teuthology.orchestra.run.smithi132:> sudo shutdown -r now 2024-05-08T18:41:20.859 INFO:teuthology.orchestra.run.smithi042.stderr:Generating grub configuration file ... 2024-05-08T18:41:22.272 INFO:teuthology.orchestra.run.smithi042.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-08T18:41:22.301 INFO:teuthology.orchestra.run.smithi042.stderr:done 2024-05-08T18:41:22.303 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-05-08T18:41:22.363 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.4wNMGxycME 2024-05-08T18:41:22.364 DEBUG:teuthology.orchestra.run.smithi042:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4wNMGxycME 2024-05-08T18:41:22.436 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.4wNMGxycME 2024-05-08T18:41:22.587 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.4wNMGxycME is 6KB 2024-05-08T18:41:22.634 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.4wNMGxycME 2024-05-08T18:41:22.649 DEBUG:teuthology.orchestra.run.smithi042:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T18:41:22.717 INFO:teuthology.orchestra.run.smithi042.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-08T18:41:22.717 INFO:teuthology.orchestra.run.smithi042.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-08T18:41:22.717 INFO:teuthology.orchestra.run.smithi042.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-08T18:41:22.717 INFO:teuthology.orchestra.run.smithi042.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-08T18:41:22.719 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-08T18:41:22.873 DEBUG:teuthology.orchestra.run.smithi042:> sudo shutdown -r now 2024-05-08T18:41:22.955 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-05-08T18:41:50.570 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-05-08T18:41:50.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-05-08T18:41:50.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:41:52.878 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-08T18:41:52.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-05-08T18:41:52.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:42:50.630 DEBUG:teuthology.orchestra.remote:timed out 2024-05-08T18:42:52.882 DEBUG:teuthology.orchestra.remote:timed out 2024-05-08T18:42:59.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-05-08T18:42:59.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:43:00.040 DEBUG:teuthology.orchestra.run.smithi132:> true 2024-05-08T18:43:00.465 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-05-08T18:43:00.465 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-444.el9.x86_64"... 2024-05-08T18:43:00.465 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2024-05-08T18:43:00.479 INFO:teuthology.orchestra.run.smithi132.stdout:5.14.0-444.el9.x86_64 2024-05-08T18:43:00.480 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-08T18:43:00.480 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T18:43:00.480 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T18:43:01.481 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-05-08T18:43:01.481 DEBUG:teuthology.orchestra.run.smithi132:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T18:43:01.550 INFO:teuthology.orchestra.run.smithi132.stdout:ttyS1 2024-05-08T18:43:01.592 DEBUG:teuthology.parallel:result is None 2024-05-08T18:43:01.883 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-05-08T18:43:01.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:43:02.229 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-05-08T18:43:02.627 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-05-08T18:43:02.627 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-444.el9.x86_64"... 2024-05-08T18:43:02.627 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-05-08T18:43:02.643 INFO:teuthology.orchestra.run.smithi042.stdout:5.14.0-444.el9.x86_64 2024-05-08T18:43:02.643 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-08T18:43:02.643 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T18:43:02.643 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T18:43:03.644 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-08T18:43:03.644 DEBUG:teuthology.orchestra.run.smithi042:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T18:43:03.738 INFO:teuthology.orchestra.run.smithi042.stdout:ttyS1 2024-05-08T18:43:03.769 DEBUG:teuthology.parallel:result is None 2024-05-08T18:43:03.769 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T18:43:03.776 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T18:43:03.777 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T18:43:03.779 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T18:43:03.794 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T18:43:03.801 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T18:43:03.807 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T18:43:03.807 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T18:43:03.834 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T18:43:03.857 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T18:43:03.864 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T18:43:03.864 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T18:43:03.891 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T18:43:03.925 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:43:03.936 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:43:04.066 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:43:04.076 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T18:43:04.078 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T18:43:04.085 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T18:43:04.085 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T18:43:04.088 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T18:43:04.112 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T18:43:04.121 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T18:43:04.121 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T18:43:04.154 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T18:43:04.171 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T18:43:04.250 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T18:43:04.301 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T18:43:04.383 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T18:43:04.424 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-08T18:43:04.424 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T18:43:04.489 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T18:43:04.531 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T18:43:04.581 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T18:43:04.667 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T18:43:04.713 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T18:43:04.713 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T18:43:04.781 DEBUG:teuthology.orchestra.run.smithi042:> sudo service rsyslog restart 2024-05-08T18:43:04.783 DEBUG:teuthology.orchestra.run.smithi132:> sudo service rsyslog restart 2024-05-08T18:43:04.833 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T18:43:04.875 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T18:43:05.283 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T18:43:05.300 INFO:teuthology.task.internal:Starting timer... 2024-05-08T18:43:05.300 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T18:43:05.320 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T18:43:05.337 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-08T18:43:05.338 DEBUG:teuthology.orchestra.run.smithi042:> sudo service auditd rotate 2024-05-08T18:43:05.431 INFO:teuthology.orchestra.run.smithi042.stdout:Rotating logs: 2024-05-08T18:43:05.434 DEBUG:teuthology.orchestra.run.smithi132:> sudo service auditd rotate 2024-05-08T18:43:05.533 INFO:teuthology.orchestra.run.smithi132.stdout:Rotating logs: 2024-05-08T18:43:05.538 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T18:43:05.538 DEBUG:teuthology.orchestra.run.smithi042:> /usr/sbin/getenforce 2024-05-08T18:43:05.569 INFO:teuthology.orchestra.run.smithi042.stdout:Permissive 2024-05-08T18:43:05.569 DEBUG:teuthology.orchestra.run.smithi132:> /usr/sbin/getenforce 2024-05-08T18:43:05.605 INFO:teuthology.orchestra.run.smithi132.stdout:Permissive 2024-05-08T18:43:05.607 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi042.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi132.front.sepia.ceph.com': 'permissive'} 2024-05-08T18:43:05.607 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T18:43:05.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:43:05.638 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T18:43:05.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:43:05.702 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T18:43:05.702 DEBUG:teuthology.orchestra.run.smithi042:> sudo /usr/sbin/setenforce permissive 2024-05-08T18:43:05.728 DEBUG:teuthology.orchestra.run.smithi132:> sudo /usr/sbin/setenforce permissive 2024-05-08T18:43:06.067 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T18:43:06.077 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-08T18:43:06.085 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-08T18:43:06.212 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T18:43:06.228 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T18:43:06.229 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi042.front.sepia.ceph.com,smithi132.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T18:47:12.961 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi042.front.sepia.ceph.com'), Remote(name='ubuntu@smithi132.front.sepia.ceph.com')] 2024-05-08T18:47:12.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-05-08T18:47:12.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:47:13.046 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-05-08T18:47:13.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-05-08T18:47:13.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-05-08T18:47:13.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:47:13.210 DEBUG:teuthology.orchestra.run.smithi132:> true 2024-05-08T18:47:13.290 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-05-08T18:47:13.291 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T18:47:13.305 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T18:47:13.305 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T18:47:13.305 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T18:47:13.308 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T18:47:13.308 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T18:47:13.337 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T18:47:13.352 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T18:47:13.360 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T18:47:13.375 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T18:47:13.378 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: ntpd: command not found 2024-05-08T18:47:13.390 INFO:teuthology.orchestra.run.smithi042.stdout:506 Cannot talk to daemon 2024-05-08T18:47:13.399 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: ntpd: command not found 2024-05-08T18:47:13.405 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T18:47:13.410 INFO:teuthology.orchestra.run.smithi132.stdout:506 Cannot talk to daemon 2024-05-08T18:47:13.419 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T18:47:13.425 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T18:47:13.438 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T18:47:13.476 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-05-08T18:47:13.480 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T18:47:13.480 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-05-08T18:47:13.480 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T18:47:13.480 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T18:47:13.480 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T18:47:13.480 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T18:47:13.500 INFO:teuthology.orchestra.run.smithi132.stderr:bash: line 1: ntpq: command not found 2024-05-08T18:47:13.504 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T18:47:13.504 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2024-05-08T18:47:13.505 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T18:47:13.505 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T18:47:13.505 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T18:47:13.505 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T18:47:13.505 INFO:teuthology.run_tasks:Running task install... 2024-05-08T18:47:13.514 DEBUG:teuthology.task.install:project ceph 2024-05-08T18:47:13.514 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd8e5981c6605c876b5b6ba50848d5d2454dc9bd0'}} 2024-05-08T18:47:13.514 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'd8e5981c6605c876b5b6ba50848d5d2454dc9bd0'} 2024-05-08T18:47:13.514 INFO:teuthology.task.install:Using flavor: default 2024-05-08T18:47:13.520 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T18:47:13.520 INFO:teuthology.task.install:extra packages: [] 2024-05-08T18:47:13.520 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd8e5981c6605c876b5b6ba50848d5d2454dc9bd0', 'tag': None, 'wait_for_package': False} 2024-05-08T18:47:13.521 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d8e5981c6605c876b5b6ba50848d5d2454dc9bd0 2024-05-08T18:47:13.523 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd8e5981c6605c876b5b6ba50848d5d2454dc9bd0', 'tag': None, 'wait_for_package': False} 2024-05-08T18:47:13.523 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d8e5981c6605c876b5b6ba50848d5d2454dc9bd0 2024-05-08T18:47:13.669 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-upgrade-arrow-15/d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/centos/9/flavors/default/ 2024-05-08T18:47:13.669 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3463.gd8e5981c 2024-05-08T18:47:13.747 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-upgrade-arrow-15/d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/centos/9/flavors/default/ 2024-05-08T18:47:13.748 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3463.gd8e5981c 2024-05-08T18:47:13.965 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-upgrade-arrow-15/d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-upgrade-arrow-15/d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-upgrade-arrow-15/d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T18:47:13.966 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T18:47:13.966 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T18:47:13.993 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-08T18:47:13.993 DEBUG:teuthology.orchestra.run.smithi132:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T18:47:14.047 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-upgrade-arrow-15/d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-upgrade-arrow-15/d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-upgrade-arrow-15/d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T18:47:14.049 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-08T18:47:14.049 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T18:47:14.060 DEBUG:teuthology.orchestra.run.smithi132:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T18:47:14.078 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-08T18:47:14.078 DEBUG:teuthology.orchestra.run.smithi042:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T18:47:14.135 DEBUG:teuthology.orchestra.run.smithi132:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T18:47:14.147 DEBUG:teuthology.orchestra.run.smithi042:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T18:47:14.200 INFO:teuthology.orchestra.run.smithi132.stdout:check_obsoletes = 1 2024-05-08T18:47:14.202 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum clean all 2024-05-08T18:47:14.225 DEBUG:teuthology.orchestra.run.smithi042:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T18:47:14.291 INFO:teuthology.orchestra.run.smithi042.stdout:check_obsoletes = 1 2024-05-08T18:47:14.292 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum clean all 2024-05-08T18:47:14.429 INFO:teuthology.orchestra.run.smithi132.stdout:54 files removed 2024-05-08T18:47:14.456 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-radosgw 2024-05-08T18:47:14.540 INFO:teuthology.orchestra.run.smithi042.stdout:54 files removed 2024-05-08T18:47:14.567 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-radosgw 2024-05-08T18:47:15.786 INFO:teuthology.orchestra.run.smithi132.stdout:ceph packages for x86_64 79 kB/s | 84 kB 00:01 2024-05-08T18:47:15.840 INFO:teuthology.orchestra.run.smithi042.stdout:ceph packages for x86_64 85 kB/s | 84 kB 00:00 2024-05-08T18:47:16.553 INFO:teuthology.orchestra.run.smithi132.stdout:ceph noarch packages 16 kB/s | 12 kB 00:00 2024-05-08T18:47:16.665 INFO:teuthology.orchestra.run.smithi042.stdout:ceph noarch packages 15 kB/s | 12 kB 00:00 2024-05-08T18:47:17.420 INFO:teuthology.orchestra.run.smithi132.stdout:ceph source packages 2.3 kB/s | 1.9 kB 00:00 2024-05-08T18:47:17.517 INFO:teuthology.orchestra.run.smithi042.stdout:ceph source packages 2.4 kB/s | 1.9 kB 00:00 2024-05-08T18:47:18.066 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.1 MB 00:00 2024-05-08T18:47:21.454 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - BaseOS 2.0 MB/s | 8.1 MB 00:03 2024-05-08T18:47:25.646 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 19 MB 00:03 2024-05-08T18:47:30.430 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 6.2 MB 00:01 2024-05-08T18:47:32.006 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 16 kB 00:00 2024-05-08T18:47:32.467 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 1.4 MB/s | 19 MB 00:13 2024-05-08T18:47:33.866 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-05-08T18:47:37.384 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 6.2 MB 00:01 2024-05-08T18:47:38.877 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 16 kB 00:00 2024-05-08T18:47:39.050 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-05-08T18:47:41.400 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:47:41.411 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:47:41.411 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-05-08T18:47:41.411 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:47:41.411 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-05-08T18:47:41.411 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 11 M 2024-05-08T18:47:41.412 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrading: 2024-05-08T18:47:41.412 INFO:teuthology.orchestra.run.smithi132.stdout: librados2 x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 3.4 M 2024-05-08T18:47:41.412 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1 x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 3.1 M 2024-05-08T18:47:41.412 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-05-08T18:47:41.412 INFO:teuthology.orchestra.run.smithi132.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T18:47:41.412 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 5.4 M 2024-05-08T18:47:41.412 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 21 M 2024-05-08T18:47:41.412 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 25 k 2024-05-08T18:47:41.412 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T18:47:41.412 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T18:47:41.412 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T18:47:41.412 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2 x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 747 k 2024-05-08T18:47:41.413 INFO:teuthology.orchestra.run.smithi132.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T18:47:41.413 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T18:47:41.413 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T18:47:41.413 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1 x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 500 k 2024-05-08T18:47:41.413 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T18:47:41.413 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2 x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 5.4 M 2024-05-08T18:47:41.413 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T18:47:41.413 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T18:47:41.413 INFO:teuthology.orchestra.run.smithi132.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T18:47:41.413 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 45 k 2024-05-08T18:47:41.413 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 135 k 2024-05-08T18:47:41.413 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 161 k 2024-05-08T18:47:41.413 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T18:47:41.414 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 321 k 2024-05-08T18:47:41.414 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 298 k 2024-05-08T18:47:41.414 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 99 k 2024-05-08T18:47:41.414 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T18:47:41.414 INFO:teuthology.orchestra.run.smithi132.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T18:47:41.414 INFO:teuthology.orchestra.run.smithi132.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T18:47:41.414 INFO:teuthology.orchestra.run.smithi132.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T18:47:41.414 INFO:teuthology.orchestra.run.smithi132.stdout:Installing weak dependencies: 2024-05-08T18:47:41.414 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T18:47:41.414 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:47:41.414 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-05-08T18:47:41.414 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:47:41.414 INFO:teuthology.orchestra.run.smithi132.stdout:Install 30 Packages 2024-05-08T18:47:41.415 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrade 2 Packages 2024-05-08T18:47:41.415 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:47:41.415 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 60 M 2024-05-08T18:47:41.415 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-05-08T18:47:43.484 INFO:teuthology.orchestra.run.smithi132.stdout:(1/32): ceph-base-19.0.0-3463.gd8e5981c.el9.x86 3.1 MB/s | 5.4 MB 00:01 2024-05-08T18:47:43.576 INFO:teuthology.orchestra.run.smithi132.stdout:(2/32): ceph-selinux-19.0.0-3463.gd8e5981c.el9. 275 kB/s | 25 kB 00:00 2024-05-08T18:47:43.760 INFO:teuthology.orchestra.run.smithi132.stdout:(3/32): libcephfs2-19.0.0-3463.gd8e5981c.el9.x8 4.0 MB/s | 747 kB 00:00 2024-05-08T18:47:43.944 INFO:teuthology.orchestra.run.smithi132.stdout:(4/32): ceph-radosgw-19.0.0-3463.gd8e5981c.el9. 4.8 MB/s | 11 MB 00:02 2024-05-08T18:47:43.977 INFO:teuthology.orchestra.run.smithi132.stdout:(5/32): libradosstriper1-19.0.0-3463.gd8e5981c. 2.3 MB/s | 500 kB 00:00 2024-05-08T18:47:44.219 INFO:teuthology.orchestra.run.smithi132.stdout:(6/32): ceph-common-19.0.0-3463.gd8e5981c.el9.x 8.5 MB/s | 21 MB 00:02 2024-05-08T18:47:44.244 INFO:teuthology.orchestra.run.smithi132.stdout:(7/32): python3-ceph-argparse-19.0.0-3463.gd8e5 169 kB/s | 45 kB 00:00 2024-05-08T18:47:44.345 INFO:teuthology.orchestra.run.smithi132.stdout:(8/32): python3-ceph-common-19.0.0-3463.gd8e598 1.1 MB/s | 135 kB 00:00 2024-05-08T18:47:44.370 INFO:teuthology.orchestra.run.smithi132.stdout:(9/32): python3-cephfs-19.0.0-3463.gd8e5981c.el 1.3 MB/s | 161 kB 00:00 2024-05-08T18:47:44.481 INFO:teuthology.orchestra.run.smithi132.stdout:(10/32): python3-rados-19.0.0-3463.gd8e5981c.el 2.3 MB/s | 321 kB 00:00 2024-05-08T18:47:44.554 INFO:teuthology.orchestra.run.smithi132.stdout:(11/32): python3-rbd-19.0.0-3463.gd8e5981c.el9. 1.6 MB/s | 298 kB 00:00 2024-05-08T18:47:44.604 INFO:teuthology.orchestra.run.smithi132.stdout:(12/32): python3-rgw-19.0.0-3463.gd8e5981c.el9. 806 kB/s | 99 kB 00:00 2024-05-08T18:47:44.805 INFO:teuthology.orchestra.run.smithi132.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 427 kB/s | 107 kB 00:00 2024-05-08T18:47:44.846 INFO:teuthology.orchestra.run.smithi132.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 662 kB/s | 160 kB 00:00 2024-05-08T18:47:44.872 INFO:teuthology.orchestra.run.smithi132.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 674 kB/s | 45 kB 00:00 2024-05-08T18:47:44.955 INFO:teuthology.orchestra.run.smithi132.stdout:(16/32): librgw2-19.0.0-3463.gd8e5981c.el9.x86_ 5.3 MB/s | 5.4 MB 00:01 2024-05-08T18:47:44.997 INFO:teuthology.orchestra.run.smithi132.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-05-08T18:47:45.065 INFO:teuthology.orchestra.run.smithi132.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-05-08T18:47:45.081 INFO:teuthology.orchestra.run.smithi132.stdout:(19/32): python3-prettytable-0.7.2-27.el9.noarc 336 kB/s | 42 kB 00:00 2024-05-08T18:47:45.107 INFO:teuthology.orchestra.run.smithi132.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-05-08T18:47:45.124 INFO:teuthology.orchestra.run.smithi132.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 609 kB/s | 36 kB 00:00 2024-05-08T18:47:45.157 INFO:teuthology.orchestra.run.smithi132.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 627 kB/s | 47 kB 00:00 2024-05-08T18:47:45.291 INFO:teuthology.orchestra.run.smithi132.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 195 kB/s | 26 kB 00:00 2024-05-08T18:47:45.366 INFO:teuthology.orchestra.run.smithi132.stdout:(24/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.2 MB/s | 309 kB 00:00 2024-05-08T18:47:45.392 INFO:teuthology.orchestra.run.smithi132.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 485 kB/s | 49 kB 00:00 2024-05-08T18:47:45.475 INFO:teuthology.orchestra.run.smithi132.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 619 kB/s | 67 kB 00:00 2024-05-08T18:47:45.551 INFO:teuthology.orchestra.run.smithi132.stdout:(27/32): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-05-08T18:47:45.561 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 3.2 MB/s | 21 MB 00:06 2024-05-08T18:47:45.576 INFO:teuthology.orchestra.run.smithi132.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-05-08T18:47:45.651 INFO:teuthology.orchestra.run.smithi132.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-05-08T18:47:45.677 INFO:teuthology.orchestra.run.smithi132.stdout:(30/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.9 MB/s | 839 kB 00:00 2024-05-08T18:47:46.210 INFO:teuthology.orchestra.run.smithi132.stdout:(31/32): librbd1-19.0.0-3463.gd8e5981c.el9.x86_ 5.6 MB/s | 3.1 MB 00:00 2024-05-08T18:47:46.410 INFO:teuthology.orchestra.run.smithi132.stdout:(32/32): librados2-19.0.0-3463.gd8e5981c.el9.x8 4.1 MB/s | 3.4 MB 00:00 2024-05-08T18:47:46.412 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:47:46.413 INFO:teuthology.orchestra.run.smithi132.stdout:Total 12 MB/s | 60 MB 00:04 2024-05-08T18:47:46.519 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-05-08T18:47:46.555 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-05-08T18:47:46.555 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-05-08T18:47:47.194 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-05-08T18:47:47.195 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-05-08T18:47:48.621 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-05-08T18:47:48.712 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-05-08T18:47:48.759 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-05-08T18:47:48.802 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-05-08T18:47:48.830 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-08T18:47:48.856 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-08T18:47:49.041 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-08T18:47:49.099 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-08T18:47:49.502 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-05-08T18:47:49.551 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librados2-2:19.0.0-3463.gd8e5981c.el9.x86_64 7/34 2024-05-08T18:47:49.644 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:19.0.0-3463.gd8e5981c.el9.x86_64 7/34 2024-05-08T18:47:49.736 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rados-2:19.0.0-3463.gd8e5981c.el9.x86_64 8/34 2024-05-08T18:47:49.761 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs2-2:19.0.0-3463.gd8e5981c.el9.x86_64 9/34 2024-05-08T18:47:49.824 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephfs2-2:19.0.0-3463.gd8e5981c.el9.x86_64 9/34 2024-05-08T18:47:49.853 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-05-08T18:47:49.897 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-argparse-2:19.0.0-3463.gd8e5981c.el9. 11/34 2024-05-08T18:47:49.967 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cephfs-2:19.0.0-3463.gd8e5981c.el9.x86_64 12/34 2024-05-08T18:47:49.988 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libradosstriper1-2:19.0.0-3463.gd8e5981c.el9.x86_6 13/34 2024-05-08T18:47:50.044 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3463.gd8e5981c.el9.x86_6 13/34 2024-05-08T18:47:50.079 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-05-08T18:47:50.190 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-05-08T18:47:50.229 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-05-08T18:47:50.272 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-05-08T18:47:50.303 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-05-08T18:47:50.333 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-05-08T18:47:50.365 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-05-08T18:47:50.683 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-05-08T18:47:50.728 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librbd1-2:19.0.0-3463.gd8e5981c.el9.x86_64 22/34 2024-05-08T18:47:50.819 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:19.0.0-3463.gd8e5981c.el9.x86_64 22/34 2024-05-08T18:47:50.837 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-05-08T18:47:50.850 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 23/34 2024-05-08T18:47:50.886 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-05-08T18:47:51.384 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-05-08T18:47:51.414 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librgw2-2:19.0.0-3463.gd8e5981c.el9.x86_64 26/34 2024-05-08T18:47:51.477 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librgw2-2:19.0.0-3463.gd8e5981c.el9.x86_64 26/34 2024-05-08T18:47:51.546 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 27/34 2024-05-08T18:47:51.584 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-common-2:19.0.0-3463.gd8e5981c.el9.x8 28/34 2024-05-08T18:47:53.263 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:47:53.270 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:47:53.271 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-05-08T18:47:53.271 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:47:53.271 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-05-08T18:47:53.271 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 11 M 2024-05-08T18:47:53.271 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrading: 2024-05-08T18:47:53.271 INFO:teuthology.orchestra.run.smithi042.stdout: librados2 x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 3.4 M 2024-05-08T18:47:53.271 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1 x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 3.1 M 2024-05-08T18:47:53.271 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-05-08T18:47:53.271 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T18:47:53.271 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 5.4 M 2024-05-08T18:47:53.271 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 21 M 2024-05-08T18:47:53.271 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 25 k 2024-05-08T18:47:53.272 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T18:47:53.272 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T18:47:53.272 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T18:47:53.272 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2 x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 747 k 2024-05-08T18:47:53.272 INFO:teuthology.orchestra.run.smithi042.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T18:47:53.272 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T18:47:53.272 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T18:47:53.272 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1 x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 500 k 2024-05-08T18:47:53.272 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T18:47:53.272 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2 x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 5.4 M 2024-05-08T18:47:53.272 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T18:47:53.272 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T18:47:53.272 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T18:47:53.273 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 45 k 2024-05-08T18:47:53.273 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 135 k 2024-05-08T18:47:53.273 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 161 k 2024-05-08T18:47:53.273 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T18:47:53.273 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 321 k 2024-05-08T18:47:53.273 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 298 k 2024-05-08T18:47:53.273 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 99 k 2024-05-08T18:47:53.273 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T18:47:53.273 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T18:47:53.273 INFO:teuthology.orchestra.run.smithi042.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T18:47:53.273 INFO:teuthology.orchestra.run.smithi042.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T18:47:53.273 INFO:teuthology.orchestra.run.smithi042.stdout:Installing weak dependencies: 2024-05-08T18:47:53.273 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T18:47:53.274 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:47:53.274 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-05-08T18:47:53.274 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:47:53.274 INFO:teuthology.orchestra.run.smithi042.stdout:Install 30 Packages 2024-05-08T18:47:53.274 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrade 2 Packages 2024-05-08T18:47:53.274 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:47:53.274 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 60 M 2024-05-08T18:47:53.274 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-05-08T18:47:53.889 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 29/34 2024-05-08T18:47:53.931 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 29/34 2024-05-08T18:47:54.313 INFO:teuthology.orchestra.run.smithi042.stdout:(1/32): ceph-radosgw-19.0.0-3463.gd8e5981c.el9. 13 MB/s | 11 MB 00:00 2024-05-08T18:47:54.364 INFO:teuthology.orchestra.run.smithi042.stdout:(2/32): ceph-selinux-19.0.0-3463.gd8e5981c.el9. 503 kB/s | 25 kB 00:00 2024-05-08T18:47:54.456 INFO:teuthology.orchestra.run.smithi042.stdout:(3/32): libcephfs2-19.0.0-3463.gd8e5981c.el9.x8 8.0 MB/s | 747 kB 00:00 2024-05-08T18:47:54.514 INFO:teuthology.orchestra.run.smithi042.stdout:(4/32): libradosstriper1-19.0.0-3463.gd8e5981c. 8.4 MB/s | 500 kB 00:00 2024-05-08T18:47:54.516 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 29/34 2024-05-08T18:47:54.552 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-base-2:19.0.0-3463.gd8e5981c.el9.x86_64 30/34 2024-05-08T18:47:54.644 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-base-2:19.0.0-3463.gd8e5981c.el9.x86_64 30/34 2024-05-08T18:47:54.645 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T18:47:54.645 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T18:47:54.645 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:47:54.695 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-selinux-2:19.0.0-3463.gd8e5981c.el9.x86_64 31/34 2024-05-08T18:47:54.873 INFO:teuthology.orchestra.run.smithi042.stdout:(5/32): librgw2-19.0.0-3463.gd8e5981c.el9.x86_6 15 MB/s | 5.4 MB 00:00 2024-05-08T18:47:54.940 INFO:teuthology.orchestra.run.smithi042.stdout:(6/32): ceph-base-19.0.0-3463.gd8e5981c.el9.x86 3.7 MB/s | 5.4 MB 00:01 2024-05-08T18:47:54.957 INFO:teuthology.orchestra.run.smithi042.stdout:(7/32): python3-ceph-argparse-19.0.0-3463.gd8e5 540 kB/s | 45 kB 00:00 2024-05-08T18:47:54.999 INFO:teuthology.orchestra.run.smithi042.stdout:(8/32): python3-ceph-common-19.0.0-3463.gd8e598 2.3 MB/s | 135 kB 00:00 2024-05-08T18:47:55.024 INFO:teuthology.orchestra.run.smithi042.stdout:(9/32): python3-cephfs-19.0.0-3463.gd8e5981c.el 2.4 MB/s | 161 kB 00:00 2024-05-08T18:47:55.074 INFO:teuthology.orchestra.run.smithi042.stdout:(10/32): python3-rbd-19.0.0-3463.gd8e5981c.el9. 5.8 MB/s | 298 kB 00:00 2024-05-08T18:47:55.100 INFO:teuthology.orchestra.run.smithi042.stdout:(11/32): python3-rados-19.0.0-3463.gd8e5981c.el 3.1 MB/s | 321 kB 00:00 2024-05-08T18:47:55.125 INFO:teuthology.orchestra.run.smithi042.stdout:(12/32): python3-rgw-19.0.0-3463.gd8e5981c.el9. 1.9 MB/s | 99 kB 00:00 2024-05-08T18:47:55.275 INFO:teuthology.orchestra.run.smithi042.stdout:(13/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-05-08T18:47:55.301 INFO:teuthology.orchestra.run.smithi042.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 533 kB/s | 107 kB 00:00 2024-05-08T18:47:55.334 INFO:teuthology.orchestra.run.smithi042.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 771 kB/s | 45 kB 00:00 2024-05-08T18:47:55.418 INFO:teuthology.orchestra.run.smithi042.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-05-08T18:47:55.443 INFO:teuthology.orchestra.run.smithi042.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-05-08T18:47:55.469 INFO:teuthology.orchestra.run.smithi042.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 840 kB/s | 42 kB 00:00 2024-05-08T18:47:55.494 INFO:teuthology.orchestra.run.smithi042.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-05-08T18:47:55.519 INFO:teuthology.orchestra.run.smithi042.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 714 kB/s | 36 kB 00:00 2024-05-08T18:47:55.545 INFO:teuthology.orchestra.run.smithi042.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-05-08T18:47:55.728 INFO:teuthology.orchestra.run.smithi042.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.4 MB/s | 309 kB 00:00 2024-05-08T18:47:55.770 INFO:teuthology.orchestra.run.smithi042.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 626 kB/s | 26 kB 00:00 2024-05-08T18:47:55.813 INFO:teuthology.orchestra.run.smithi042.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-05-08T18:47:55.863 INFO:teuthology.orchestra.run.smithi042.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-05-08T18:47:56.105 INFO:teuthology.orchestra.run.smithi042.stdout:(26/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.4 MB/s | 839 kB 00:00 2024-05-08T18:47:56.313 INFO:teuthology.orchestra.run.smithi042.stdout:(27/32): ceph-common-19.0.0-3463.gd8e5981c.el9. 7.5 MB/s | 21 MB 00:02 2024-05-08T18:47:56.338 INFO:teuthology.orchestra.run.smithi042.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 821 kB/s | 192 kB 00:00 2024-05-08T18:47:56.489 INFO:teuthology.orchestra.run.smithi042.stdout:(29/32): libarrow-9.0.0-11.el9.x86_64.rpm 4.7 MB/s | 4.4 MB 00:00 2024-05-08T18:47:56.781 INFO:teuthology.orchestra.run.smithi042.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 3.4 MB/s | 1.6 MB 00:00 2024-05-08T18:47:56.923 INFO:teuthology.orchestra.run.smithi042.stdout:(31/32): librbd1-19.0.0-3463.gd8e5981c.el9.x86_ 7.3 MB/s | 3.1 MB 00:00 2024-05-08T18:47:57.398 INFO:teuthology.orchestra.run.smithi042.stdout:(32/32): librados2-19.0.0-3463.gd8e5981c.el9.x8 3.2 MB/s | 3.4 MB 00:01 2024-05-08T18:47:57.401 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:47:57.401 INFO:teuthology.orchestra.run.smithi042.stdout:Total 15 MB/s | 60 MB 00:04 2024-05-08T18:47:57.506 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-05-08T18:47:57.547 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-05-08T18:47:57.547 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-05-08T18:47:58.203 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-05-08T18:47:58.203 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-05-08T18:47:59.624 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-05-08T18:47:59.703 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-05-08T18:47:59.737 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-05-08T18:47:59.762 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-05-08T18:47:59.785 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-08T18:47:59.812 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-08T18:48:00.005 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-08T18:48:00.058 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-08T18:48:00.460 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-05-08T18:48:00.523 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librados2-2:19.0.0-3463.gd8e5981c.el9.x86_64 7/34 2024-05-08T18:48:00.615 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:19.0.0-3463.gd8e5981c.el9.x86_64 7/34 2024-05-08T18:48:00.705 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rados-2:19.0.0-3463.gd8e5981c.el9.x86_64 8/34 2024-05-08T18:48:00.732 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs2-2:19.0.0-3463.gd8e5981c.el9.x86_64 9/34 2024-05-08T18:48:00.795 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephfs2-2:19.0.0-3463.gd8e5981c.el9.x86_64 9/34 2024-05-08T18:48:00.824 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-05-08T18:48:00.868 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-argparse-2:19.0.0-3463.gd8e5981c.el9. 11/34 2024-05-08T18:48:00.938 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cephfs-2:19.0.0-3463.gd8e5981c.el9.x86_64 12/34 2024-05-08T18:48:00.959 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libradosstriper1-2:19.0.0-3463.gd8e5981c.el9.x86_6 13/34 2024-05-08T18:48:01.024 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3463.gd8e5981c.el9.x86_6 13/34 2024-05-08T18:48:01.058 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-05-08T18:48:01.170 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-05-08T18:48:01.201 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-05-08T18:48:01.242 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-05-08T18:48:01.274 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-05-08T18:48:01.303 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-05-08T18:48:01.344 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-05-08T18:48:01.674 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-05-08T18:48:01.716 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librbd1-2:19.0.0-3463.gd8e5981c.el9.x86_64 22/34 2024-05-08T18:48:01.807 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:19.0.0-3463.gd8e5981c.el9.x86_64 22/34 2024-05-08T18:48:01.837 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 23/34 2024-05-08T18:48:01.874 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-05-08T18:48:02.386 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-05-08T18:48:02.418 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librgw2-2:19.0.0-3463.gd8e5981c.el9.x86_64 26/34 2024-05-08T18:48:02.481 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librgw2-2:19.0.0-3463.gd8e5981c.el9.x86_64 26/34 2024-05-08T18:48:02.561 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 27/34 2024-05-08T18:48:02.587 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-common-2:19.0.0-3463.gd8e5981c.el9.x8 28/34 2024-05-08T18:48:04.266 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3463.gd8e5981c.el9.x86_64 31/34 2024-05-08T18:48:04.266 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /sys 2024-05-08T18:48:04.267 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /proc 2024-05-08T18:48:04.267 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /mnt 2024-05-08T18:48:04.267 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /var/tmp 2024-05-08T18:48:04.267 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /home 2024-05-08T18:48:04.267 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /root 2024-05-08T18:48:04.267 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /tmp 2024-05-08T18:48:04.267 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:05.045 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 29/34 2024-05-08T18:48:05.135 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 29/34 2024-05-08T18:48:05.265 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-radosgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 32/34 2024-05-08T18:48:05.291 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 32/34 2024-05-08T18:48:05.291 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:48:05.291 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T18:48:05.292 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T18:48:05.292 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T18:48:05.292 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:05.293 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-08T18:48:05.393 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-08T18:48:05.394 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T18:48:05.726 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 29/34 2024-05-08T18:48:05.763 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-base-2:19.0.0-3463.gd8e5981c.el9.x86_64 30/34 2024-05-08T18:48:05.866 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-base-2:19.0.0-3463.gd8e5981c.el9.x86_64 30/34 2024-05-08T18:48:05.866 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T18:48:05.866 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T18:48:05.867 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:05.898 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-selinux-2:19.0.0-3463.gd8e5981c.el9.x86_64 31/34 2024-05-08T18:48:06.483 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T18:48:06.483 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-base-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/34 2024-05-08T18:48:06.483 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 2/34 2024-05-08T18:48:06.484 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-radosgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 3/34 2024-05-08T18:48:06.484 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-selinux-2:19.0.0-3463.gd8e5981c.el9.x86_64 4/34 2024-05-08T18:48:06.484 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs2-2:19.0.0-3463.gd8e5981c.el9.x86_64 5/34 2024-05-08T18:48:06.484 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libradosstriper1-2:19.0.0-3463.gd8e5981c.el9.x86_6 6/34 2024-05-08T18:48:06.484 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librgw2-2:19.0.0-3463.gd8e5981c.el9.x86_64 7/34 2024-05-08T18:48:06.484 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3463.gd8e5981c.el9. 8/34 2024-05-08T18:48:06.484 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-common-2:19.0.0-3463.gd8e5981c.el9.x8 9/34 2024-05-08T18:48:06.484 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cephfs-2:19.0.0-3463.gd8e5981c.el9.x86_64 10/34 2024-05-08T18:48:06.484 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rados-2:19.0.0-3463.gd8e5981c.el9.x86_64 11/34 2024-05-08T18:48:06.484 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 12/34 2024-05-08T18:48:06.484 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 13/34 2024-05-08T18:48:06.484 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-05-08T18:48:06.484 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-05-08T18:48:06.484 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-05-08T18:48:06.485 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-05-08T18:48:06.485 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-05-08T18:48:06.485 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-05-08T18:48:06.485 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-05-08T18:48:06.485 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-05-08T18:48:06.485 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-05-08T18:48:06.485 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-05-08T18:48:06.485 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-05-08T18:48:06.485 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-05-08T18:48:06.485 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-05-08T18:48:06.486 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-05-08T18:48:06.486 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-05-08T18:48:06.486 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-05-08T18:48:06.486 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-05-08T18:48:06.487 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:19.0.0-3463.gd8e5981c.el9.x86_64 31/34 2024-05-08T18:48:06.487 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-05-08T18:48:06.487 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:19.0.0-3463.gd8e5981c.el9.x86_64 33/34 2024-05-08T18:48:07.386 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T18:48:07.387 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:07.387 INFO:teuthology.orchestra.run.smithi132.stdout:Upgraded: 2024-05-08T18:48:07.387 INFO:teuthology.orchestra.run.smithi132.stdout: librados2-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:07.387 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:07.387 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-05-08T18:48:07.387 INFO:teuthology.orchestra.run.smithi132.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T18:48:07.387 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:07.388 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:07.388 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:07.388 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:07.388 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T18:48:07.388 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T18:48:07.388 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T18:48:07.388 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:07.388 INFO:teuthology.orchestra.run.smithi132.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T18:48:07.388 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T18:48:07.388 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T18:48:07.388 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:07.388 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T18:48:07.388 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:07.388 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T18:48:07.388 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T18:48:07.389 INFO:teuthology.orchestra.run.smithi132.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T18:48:07.389 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:07.389 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:07.389 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:07.389 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T18:48:07.389 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:07.389 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:07.389 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:07.389 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T18:48:07.389 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T18:48:07.389 INFO:teuthology.orchestra.run.smithi132.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T18:48:07.389 INFO:teuthology.orchestra.run.smithi132.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T18:48:07.389 INFO:teuthology.orchestra.run.smithi132.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T18:48:07.389 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:07.390 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:48:07.709 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-test 2024-05-08T18:48:08.286 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:00:29 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:48:08.407 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:48:08.408 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:48:08.408 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-05-08T18:48:08.408 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:48:08.408 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-05-08T18:48:08.408 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 49 M 2024-05-08T18:48:08.408 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-05-08T18:48:08.408 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 163 k 2024-05-08T18:48:08.409 INFO:teuthology.orchestra.run.smithi132.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T18:48:08.409 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T18:48:08.409 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:08.409 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-05-08T18:48:08.409 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:48:08.409 INFO:teuthology.orchestra.run.smithi132.stdout:Install 4 Packages 2024-05-08T18:48:08.409 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:08.410 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 50 M 2024-05-08T18:48:08.410 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 211 M 2024-05-08T18:48:08.410 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-05-08T18:48:08.591 INFO:teuthology.orchestra.run.smithi132.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 2.2 MB/s | 305 kB 00:00 2024-05-08T18:48:08.691 INFO:teuthology.orchestra.run.smithi132.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 642 kB/s | 64 kB 00:00 2024-05-08T18:48:08.716 INFO:teuthology.orchestra.run.smithi132.stdout:(3/4): libcephsqlite-19.0.0-3463.gd8e5981c.el9. 623 kB/s | 163 kB 00:00 2024-05-08T18:48:11.066 INFO:teuthology.orchestra.run.smithi132.stdout:(4/4): ceph-test-19.0.0-3463.gd8e5981c.el9.x86_ 19 MB/s | 49 MB 00:02 2024-05-08T18:48:11.068 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:48:11.069 INFO:teuthology.orchestra.run.smithi132.stdout:Total 19 MB/s | 50 MB 00:02 2024-05-08T18:48:11.095 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-05-08T18:48:11.115 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-05-08T18:48:11.116 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-05-08T18:48:11.485 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-05-08T18:48:11.486 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-05-08T18:48:12.010 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-05-08T18:48:12.093 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-08T18:48:12.132 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-08T18:48:12.160 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephsqlite-2:19.0.0-3463.gd8e5981c.el9.x86_64 3/4 2024-05-08T18:48:16.006 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3463.gd8e5981c.el9.x86_64 31/34 2024-05-08T18:48:16.006 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /sys 2024-05-08T18:48:16.006 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /proc 2024-05-08T18:48:16.006 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /mnt 2024-05-08T18:48:16.006 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /var/tmp 2024-05-08T18:48:16.006 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /home 2024-05-08T18:48:16.006 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /root 2024-05-08T18:48:16.006 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /tmp 2024-05-08T18:48:16.006 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:16.876 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3463.gd8e5981c.el9.x86_64 3/4 2024-05-08T18:48:16.958 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-test-2:19.0.0-3463.gd8e5981c.el9.x86_64 4/4 2024-05-08T18:48:17.036 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-radosgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 32/34 2024-05-08T18:48:17.062 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 32/34 2024-05-08T18:48:17.062 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:48:17.062 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T18:48:17.062 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T18:48:17.063 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T18:48:17.063 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:17.065 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-08T18:48:17.155 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-08T18:48:17.156 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T18:48:18.321 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T18:48:18.321 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-base-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/34 2024-05-08T18:48:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 2/34 2024-05-08T18:48:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-radosgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 3/34 2024-05-08T18:48:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-selinux-2:19.0.0-3463.gd8e5981c.el9.x86_64 4/34 2024-05-08T18:48:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs2-2:19.0.0-3463.gd8e5981c.el9.x86_64 5/34 2024-05-08T18:48:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libradosstriper1-2:19.0.0-3463.gd8e5981c.el9.x86_6 6/34 2024-05-08T18:48:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librgw2-2:19.0.0-3463.gd8e5981c.el9.x86_64 7/34 2024-05-08T18:48:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3463.gd8e5981c.el9. 8/34 2024-05-08T18:48:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-common-2:19.0.0-3463.gd8e5981c.el9.x8 9/34 2024-05-08T18:48:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cephfs-2:19.0.0-3463.gd8e5981c.el9.x86_64 10/34 2024-05-08T18:48:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rados-2:19.0.0-3463.gd8e5981c.el9.x86_64 11/34 2024-05-08T18:48:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 12/34 2024-05-08T18:48:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 13/34 2024-05-08T18:48:18.322 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-05-08T18:48:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-05-08T18:48:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-05-08T18:48:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-05-08T18:48:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-05-08T18:48:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-05-08T18:48:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-05-08T18:48:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-05-08T18:48:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-05-08T18:48:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-05-08T18:48:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-05-08T18:48:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-05-08T18:48:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-05-08T18:48:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-05-08T18:48:18.323 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-05-08T18:48:18.324 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-05-08T18:48:18.324 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-05-08T18:48:18.324 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:19.0.0-3463.gd8e5981c.el9.x86_64 31/34 2024-05-08T18:48:18.324 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-05-08T18:48:18.324 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:19.0.0-3463.gd8e5981c.el9.x86_64 33/34 2024-05-08T18:48:19.207 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T18:48:19.207 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:19.207 INFO:teuthology.orchestra.run.smithi042.stdout:Upgraded: 2024-05-08T18:48:19.207 INFO:teuthology.orchestra.run.smithi042.stdout: librados2-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:19.207 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:19.207 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-05-08T18:48:19.207 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T18:48:19.207 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:19.207 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:19.207 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:19.207 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:19.208 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T18:48:19.208 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T18:48:19.208 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T18:48:19.208 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:19.208 INFO:teuthology.orchestra.run.smithi042.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T18:48:19.208 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T18:48:19.208 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T18:48:19.208 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:19.208 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T18:48:19.208 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:19.208 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T18:48:19.208 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T18:48:19.208 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T18:48:19.208 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:19.209 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:19.209 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:19.209 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T18:48:19.209 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:19.209 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:19.209 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:19.209 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T18:48:19.209 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T18:48:19.209 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T18:48:19.209 INFO:teuthology.orchestra.run.smithi042.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T18:48:19.209 INFO:teuthology.orchestra.run.smithi042.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T18:48:19.209 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:19.209 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:48:19.379 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-test-2:19.0.0-3463.gd8e5981c.el9.x86_64 4/4 2024-05-08T18:48:19.379 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-test-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/4 2024-05-08T18:48:19.379 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephsqlite-2:19.0.0-3463.gd8e5981c.el9.x86_64 2/4 2024-05-08T18:48:19.379 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-08T18:48:19.557 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-test 2024-05-08T18:48:19.664 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-08T18:48:19.664 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:19.664 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-05-08T18:48:19.664 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:19.664 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:19.664 INFO:teuthology.orchestra.run.smithi132.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T18:48:19.664 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T18:48:19.664 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:19.664 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:48:19.946 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph 2024-05-08T18:48:20.145 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:00:30 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:48:20.271 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:48:20.272 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:48:20.272 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-05-08T18:48:20.272 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:48:20.272 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-05-08T18:48:20.272 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 49 M 2024-05-08T18:48:20.272 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-05-08T18:48:20.272 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 163 k 2024-05-08T18:48:20.272 INFO:teuthology.orchestra.run.smithi042.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T18:48:20.272 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T18:48:20.272 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:20.272 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-05-08T18:48:20.273 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:48:20.273 INFO:teuthology.orchestra.run.smithi042.stdout:Install 4 Packages 2024-05-08T18:48:20.273 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:20.273 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 50 M 2024-05-08T18:48:20.273 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 211 M 2024-05-08T18:48:20.274 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-05-08T18:48:20.535 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:00:41 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:48:20.667 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:48:20.670 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:48:20.670 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-05-08T18:48:20.670 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:48:20.670 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-05-08T18:48:20.670 INFO:teuthology.orchestra.run.smithi132.stdout: ceph x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 6.6 k 2024-05-08T18:48:20.670 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-05-08T18:48:20.670 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 2.4 M 2024-05-08T18:48:20.670 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 1.5 M 2024-05-08T18:48:20.670 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 274 k 2024-05-08T18:48:20.671 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 4.7 M 2024-05-08T18:48:20.671 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 17 M 2024-05-08T18:48:20.671 INFO:teuthology.orchestra.run.smithi132.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T18:48:20.671 INFO:teuthology.orchestra.run.smithi132.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T18:48:20.671 INFO:teuthology.orchestra.run.smithi132.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T18:48:20.671 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T18:48:20.671 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T18:48:20.671 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T18:48:20.671 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T18:48:20.671 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T18:48:20.671 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T18:48:20.671 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T18:48:20.671 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-collections 2024-05-08T18:48:20.671 INFO:teuthology.orchestra.run.smithi132.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-05-08T18:48:20.672 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T18:48:20.672 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T18:48:20.672 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T18:48:20.672 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T18:48:20.672 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T18:48:20.672 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T18:48:20.672 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T18:48:20.672 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T18:48:20.672 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T18:48:20.672 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T18:48:20.672 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T18:48:20.672 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T18:48:20.672 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T18:48:20.673 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T18:48:20.673 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T18:48:20.673 INFO:teuthology.orchestra.run.smithi132.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T18:48:20.673 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T18:48:20.673 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T18:48:20.673 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T18:48:20.673 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:20.673 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-05-08T18:48:20.673 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:48:20.673 INFO:teuthology.orchestra.run.smithi132.stdout:Install 36 Packages 2024-05-08T18:48:20.673 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:20.674 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 30 M 2024-05-08T18:48:20.674 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 108 M 2024-05-08T18:48:20.674 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-05-08T18:48:20.777 INFO:teuthology.orchestra.run.smithi042.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.3 MB/s | 305 kB 00:00 2024-05-08T18:48:20.827 INFO:teuthology.orchestra.run.smithi042.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-05-08T18:48:21.053 INFO:teuthology.orchestra.run.smithi042.stdout:(3/4): libcephsqlite-19.0.0-3463.gd8e5981c.el9. 323 kB/s | 163 kB 00:00 2024-05-08T18:48:21.220 INFO:teuthology.orchestra.run.smithi132.stdout:(1/36): ceph-19.0.0-3463.gd8e5981c.el9.x86_64.r 19 kB/s | 6.6 kB 00:00 2024-05-08T18:48:21.829 INFO:teuthology.orchestra.run.smithi132.stdout:(2/36): ceph-mgr-19.0.0-3463.gd8e5981c.el9.x86_ 1.6 MB/s | 1.5 MB 00:00 2024-05-08T18:48:22.146 INFO:teuthology.orchestra.run.smithi132.stdout:(3/36): ceph-mds-19.0.0-3463.gd8e5981c.el9.x86_ 1.9 MB/s | 2.4 MB 00:01 2024-05-08T18:48:22.330 INFO:teuthology.orchestra.run.smithi132.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3463.gd8e5 1.5 MB/s | 274 kB 00:00 2024-05-08T18:48:22.522 INFO:teuthology.orchestra.run.smithi132.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-05-08T18:48:22.805 INFO:teuthology.orchestra.run.smithi132.stdout:(6/36): python3-cryptography-36.0.1-4.el9.x86_6 4.3 MB/s | 1.2 MB 00:00 2024-05-08T18:48:22.955 INFO:teuthology.orchestra.run.smithi132.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 710 kB/s | 106 kB 00:00 2024-05-08T18:48:23.031 INFO:teuthology.orchestra.run.smithi132.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 1.8 MB/s | 135 kB 00:00 2024-05-08T18:48:23.131 INFO:teuthology.orchestra.run.smithi132.stdout:(9/36): python3-requests-2.25.1-8.el9.noarch.rp 1.2 MB/s | 125 kB 00:00 2024-05-08T18:48:23.223 INFO:teuthology.orchestra.run.smithi132.stdout:(10/36): python3-urllib3-1.26.5-5.el9.noarch.rp 2.3 MB/s | 215 kB 00:00 2024-05-08T18:48:23.290 INFO:teuthology.orchestra.run.smithi132.stdout:(11/36): ceph-mon-19.0.0-3463.gd8e5981c.el9.x86 2.3 MB/s | 4.7 MB 00:02 2024-05-08T18:48:24.290 INFO:teuthology.orchestra.run.smithi132.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 177 kB/s | 188 kB 00:01 2024-05-08T18:48:24.323 INFO:teuthology.orchestra.run.smithi132.stdout:(13/36): python3-mako-1.1.4-6.el9.noarch.rpm 167 kB/s | 172 kB 00:01 2024-05-08T18:48:24.494 INFO:teuthology.orchestra.run.smithi042.stdout:(4/4): ceph-test-19.0.0-3463.gd8e5981c.el9.x86_ 12 MB/s | 49 MB 00:03 2024-05-08T18:48:24.497 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:48:24.497 INFO:teuthology.orchestra.run.smithi042.stdout:Total 12 MB/s | 50 MB 00:04 2024-05-08T18:48:24.526 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-05-08T18:48:24.548 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-05-08T18:48:24.548 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-05-08T18:48:24.616 INFO:teuthology.orchestra.run.smithi132.stdout:(14/36): ceph-osd-19.0.0-3463.gd8e5981c.el9.x86 6.0 MB/s | 17 MB 00:02 2024-05-08T18:48:24.939 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-05-08T18:48:24.939 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-05-08T18:48:25.157 INFO:teuthology.orchestra.run.smithi132.stdout:(15/36): python3-markupsafe-1.1.1-12.el9.x86_64 40 kB/s | 35 kB 00:00 2024-05-08T18:48:25.183 INFO:teuthology.orchestra.run.smithi132.stdout:(16/36): python3-pytz-2021.1-5.el9.noarch.rpm 59 kB/s | 51 kB 00:00 2024-05-08T18:48:25.316 INFO:teuthology.orchestra.run.smithi132.stdout:(17/36): python3-toml-0.10.2-6.el9.noarch.rpm 59 kB/s | 42 kB 00:00 2024-05-08T18:48:25.425 INFO:teuthology.orchestra.run.smithi132.stdout:(18/36): luarocks-3.9.2-1.el9.noarch.rpm 626 kB/s | 151 kB 00:00 2024-05-08T18:48:25.484 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-05-08T18:48:25.492 INFO:teuthology.orchestra.run.smithi132.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 248 kB/s | 43 kB 00:00 2024-05-08T18:48:25.550 INFO:teuthology.orchestra.run.smithi132.stdout:(20/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-05-08T18:48:25.576 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-08T18:48:25.617 INFO:teuthology.orchestra.run.smithi132.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 162 kB/s | 11 kB 00:00 2024-05-08T18:48:25.620 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-08T18:48:25.647 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephsqlite-2:19.0.0-3463.gd8e5981c.el9.x86_64 3/4 2024-05-08T18:48:25.676 INFO:teuthology.orchestra.run.smithi132.stdout:(22/36): python3-jaraco-classes-3.2.1-5.el9.noa 303 kB/s | 18 kB 00:00 2024-05-08T18:48:25.710 INFO:teuthology.orchestra.run.smithi132.stdout:(23/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.6 MB/s | 358 kB 00:00 2024-05-08T18:48:25.726 INFO:teuthology.orchestra.run.smithi132.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-05-08T18:48:25.760 INFO:teuthology.orchestra.run.smithi132.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 388 kB/s | 19 kB 00:00 2024-05-08T18:48:25.777 INFO:teuthology.orchestra.run.smithi132.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-05-08T18:48:25.811 INFO:teuthology.orchestra.run.smithi132.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 925 kB/s | 46 kB 00:00 2024-05-08T18:48:25.827 INFO:teuthology.orchestra.run.smithi132.stdout:(28/36): lua-devel-5.4.4-4.el9.x86_64.rpm 33 kB/s | 22 kB 00:00 2024-05-08T18:48:25.845 INFO:teuthology.orchestra.run.smithi132.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2024-05-08T18:48:25.878 INFO:teuthology.orchestra.run.smithi132.stdout:(30/36): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-05-08T18:48:25.912 INFO:teuthology.orchestra.run.smithi132.stdout:(31/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-05-08T18:48:25.946 INFO:teuthology.orchestra.run.smithi132.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 531 kB/s | 36 kB 00:00 2024-05-08T18:48:25.979 INFO:teuthology.orchestra.run.smithi132.stdout:(33/36): python3-webob-1.8.7-6.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2024-05-08T18:48:26.005 INFO:teuthology.orchestra.run.smithi132.stdout:(34/36): python3-portend-3.1.0-2.el9.noarch.rpm 93 kB/s | 16 kB 00:00 2024-05-08T18:48:26.030 INFO:teuthology.orchestra.run.smithi132.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-05-08T18:48:26.055 INFO:teuthology.orchestra.run.smithi132.stdout:(36/36): python3-zc-lockfile-2.0-10.el9.noarch. 265 kB/s | 20 kB 00:00 2024-05-08T18:48:26.058 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:48:26.058 INFO:teuthology.orchestra.run.smithi132.stdout:Total 5.6 MB/s | 30 MB 00:05 2024-05-08T18:48:26.200 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-05-08T18:48:26.238 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-05-08T18:48:26.238 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-05-08T18:48:26.669 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-05-08T18:48:26.670 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-05-08T18:48:27.935 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-05-08T18:48:28.008 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-05-08T18:48:28.041 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-05-08T18:48:28.068 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-05-08T18:48:28.141 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-05-08T18:48:28.184 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-05-08T18:48:28.217 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-05-08T18:48:28.310 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-05-08T18:48:28.398 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-05-08T18:48:28.445 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-05-08T18:48:28.480 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-05-08T18:48:28.510 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-05-08T18:48:28.536 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-05-08T18:48:28.570 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-05-08T18:48:28.610 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-05-08T18:48:28.645 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-05-08T18:48:28.680 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-05-08T18:48:28.718 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-05-08T18:48:28.792 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-05-08T18:48:28.932 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-05-08T18:48:29.011 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-05-08T18:48:29.072 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-05-08T18:48:29.110 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-05-08T18:48:29.168 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-05-08T18:48:29.232 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-05-08T18:48:29.429 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-05-08T18:48:29.481 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-05-08T18:48:29.561 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-05-08T18:48:29.658 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-05-08T18:48:29.697 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-05-08T18:48:29.826 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-05-08T18:48:29.986 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3463.gd8e5981c.el9. 31/36 2024-05-08T18:48:30.016 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-2:19.0.0-3463.gd8e5981c.el9.x86_64 32/36 2024-05-08T18:48:30.042 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3463.gd8e5981c.el9.x86_64 32/36 2024-05-08T18:48:30.043 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:48:30.043 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T18:48:30.043 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T18:48:30.043 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T18:48:30.043 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:30.579 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3463.gd8e5981c.el9.x86_64 3/4 2024-05-08T18:48:30.656 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-test-2:19.0.0-3463.gd8e5981c.el9.x86_64 4/4 2024-05-08T18:48:31.500 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-osd-2:19.0.0-3463.gd8e5981c.el9.x86_64 33/36 2024-05-08T18:48:31.527 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-osd-2:19.0.0-3463.gd8e5981c.el9.x86_64 33/36 2024-05-08T18:48:31.528 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:48:31.528 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T18:48:31.528 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T18:48:31.528 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T18:48:31.528 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:31.984 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mon-2:19.0.0-3463.gd8e5981c.el9.x86_64 34/36 2024-05-08T18:48:32.008 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mon-2:19.0.0-3463.gd8e5981c.el9.x86_64 34/36 2024-05-08T18:48:32.009 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:48:32.009 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T18:48:32.009 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T18:48:32.009 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T18:48:32.009 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:32.235 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mds-2:19.0.0-3463.gd8e5981c.el9.x86_64 35/36 2024-05-08T18:48:32.258 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mds-2:19.0.0-3463.gd8e5981c.el9.x86_64 35/36 2024-05-08T18:48:32.258 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:48:32.259 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T18:48:32.259 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T18:48:32.259 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T18:48:32.259 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:32.324 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-2:19.0.0-3463.gd8e5981c.el9.x86_64 36/36 2024-05-08T18:48:33.100 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-test-2:19.0.0-3463.gd8e5981c.el9.x86_64 4/4 2024-05-08T18:48:33.101 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-test-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/4 2024-05-08T18:48:33.101 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephsqlite-2:19.0.0-3463.gd8e5981c.el9.x86_64 2/4 2024-05-08T18:48:33.101 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-08T18:48:33.360 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-08T18:48:33.360 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:33.360 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-05-08T18:48:33.360 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:33.360 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:33.360 INFO:teuthology.orchestra.run.smithi042.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T18:48:33.360 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T18:48:33.360 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:33.360 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:48:33.638 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph 2024-05-08T18:48:34.169 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-2:19.0.0-3463.gd8e5981c.el9.x86_64 36/36 2024-05-08T18:48:34.169 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/36 2024-05-08T18:48:34.169 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mds-2:19.0.0-3463.gd8e5981c.el9.x86_64 2/36 2024-05-08T18:48:34.170 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-2:19.0.0-3463.gd8e5981c.el9.x86_64 3/36 2024-05-08T18:48:34.170 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mon-2:19.0.0-3463.gd8e5981c.el9.x86_64 4/36 2024-05-08T18:48:34.170 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-osd-2:19.0.0-3463.gd8e5981c.el9.x86_64 5/36 2024-05-08T18:48:34.170 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3463.gd8e5981c.el9. 6/36 2024-05-08T18:48:34.170 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-05-08T18:48:34.170 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-05-08T18:48:34.170 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-05-08T18:48:34.170 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-05-08T18:48:34.170 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-05-08T18:48:34.170 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-05-08T18:48:34.170 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-05-08T18:48:34.170 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-05-08T18:48:34.170 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-05-08T18:48:34.171 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-05-08T18:48:34.171 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-05-08T18:48:34.171 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-05-08T18:48:34.171 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-05-08T18:48:34.171 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-05-08T18:48:34.171 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-05-08T18:48:34.171 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-05-08T18:48:34.171 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-05-08T18:48:34.171 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-05-08T18:48:34.171 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-05-08T18:48:34.171 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-05-08T18:48:34.171 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-05-08T18:48:34.171 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-05-08T18:48:34.172 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-05-08T18:48:34.172 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-05-08T18:48:34.173 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-05-08T18:48:34.173 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-05-08T18:48:34.173 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-05-08T18:48:34.173 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-05-08T18:48:34.173 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-05-08T18:48:34.221 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:00:44 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:48:34.350 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:48:34.353 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:48:34.353 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-05-08T18:48:34.353 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:48:34.353 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-05-08T18:48:34.353 INFO:teuthology.orchestra.run.smithi042.stdout: ceph x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 6.6 k 2024-05-08T18:48:34.353 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-05-08T18:48:34.353 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 2.4 M 2024-05-08T18:48:34.353 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 1.5 M 2024-05-08T18:48:34.353 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 274 k 2024-05-08T18:48:34.354 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 4.7 M 2024-05-08T18:48:34.354 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 17 M 2024-05-08T18:48:34.354 INFO:teuthology.orchestra.run.smithi042.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T18:48:34.354 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T18:48:34.354 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T18:48:34.354 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T18:48:34.354 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T18:48:34.354 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T18:48:34.354 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T18:48:34.354 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T18:48:34.354 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T18:48:34.354 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T18:48:34.354 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections 2024-05-08T18:48:34.354 INFO:teuthology.orchestra.run.smithi042.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-05-08T18:48:34.355 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T18:48:34.355 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T18:48:34.355 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T18:48:34.355 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T18:48:34.355 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T18:48:34.355 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T18:48:34.355 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T18:48:34.355 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T18:48:34.355 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T18:48:34.355 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T18:48:34.355 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T18:48:34.355 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T18:48:34.355 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T18:48:34.355 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T18:48:34.356 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T18:48:34.356 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T18:48:34.356 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T18:48:34.356 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T18:48:34.356 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T18:48:34.356 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:34.356 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-05-08T18:48:34.356 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:48:34.356 INFO:teuthology.orchestra.run.smithi042.stdout:Install 36 Packages 2024-05-08T18:48:34.356 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:34.357 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 30 M 2024-05-08T18:48:34.357 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 108 M 2024-05-08T18:48:34.357 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-05-08T18:48:34.890 INFO:teuthology.orchestra.run.smithi042.stdout:(1/36): ceph-19.0.0-3463.gd8e5981c.el9.x86_64.r 28 kB/s | 6.6 kB 00:00 2024-05-08T18:48:35.049 INFO:teuthology.orchestra.run.smithi042.stdout:(2/36): ceph-mds-19.0.0-3463.gd8e5981c.el9.x86_ 6.0 MB/s | 2.4 MB 00:00 2024-05-08T18:48:35.079 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-05-08T18:48:35.080 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:35.080 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-05-08T18:48:35.080 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:35.080 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:35.080 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:35.080 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:48:35.080 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:35.081 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:35.081 INFO:teuthology.orchestra.run.smithi132.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T18:48:35.081 INFO:teuthology.orchestra.run.smithi132.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T18:48:35.081 INFO:teuthology.orchestra.run.smithi132.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T18:48:35.081 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T18:48:35.081 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T18:48:35.081 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T18:48:35.081 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T18:48:35.081 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T18:48:35.081 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T18:48:35.081 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T18:48:35.082 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T18:48:35.082 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T18:48:35.082 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T18:48:35.082 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T18:48:35.082 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T18:48:35.082 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T18:48:35.082 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T18:48:35.082 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T18:48:35.082 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T18:48:35.083 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T18:48:35.083 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T18:48:35.083 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T18:48:35.083 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T18:48:35.083 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T18:48:35.083 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T18:48:35.083 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T18:48:35.083 INFO:teuthology.orchestra.run.smithi132.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T18:48:35.083 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T18:48:35.083 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T18:48:35.083 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T18:48:35.083 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:35.083 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:48:35.182 INFO:teuthology.orchestra.run.smithi042.stdout:(3/36): ceph-mgr-19.0.0-3463.gd8e5981c.el9.x86_ 2.9 MB/s | 1.5 MB 00:00 2024-05-08T18:48:35.266 INFO:teuthology.orchestra.run.smithi042.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3463.gd8e5 3.2 MB/s | 274 kB 00:00 2024-05-08T18:48:35.349 INFO:teuthology.orchestra.run.smithi042.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-05-08T18:48:35.432 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-base 2024-05-08T18:48:35.466 INFO:teuthology.orchestra.run.smithi042.stdout:(6/36): python3-cryptography-36.0.1-4.el9.x86_6 11 MB/s | 1.2 MB 00:00 2024-05-08T18:48:35.533 INFO:teuthology.orchestra.run.smithi042.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-05-08T18:48:35.600 INFO:teuthology.orchestra.run.smithi042.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 2.0 MB/s | 135 kB 00:00 2024-05-08T18:48:35.667 INFO:teuthology.orchestra.run.smithi042.stdout:(9/36): python3-requests-2.25.1-8.el9.noarch.rp 1.8 MB/s | 125 kB 00:00 2024-05-08T18:48:35.742 INFO:teuthology.orchestra.run.smithi042.stdout:(10/36): python3-urllib3-1.26.5-5.el9.noarch.rp 2.8 MB/s | 215 kB 00:00 2024-05-08T18:48:35.901 INFO:teuthology.orchestra.run.smithi042.stdout:(11/36): ceph-osd-19.0.0-3463.gd8e5981c.el9.x86 20 MB/s | 17 MB 00:00 2024-05-08T18:48:35.960 INFO:teuthology.orchestra.run.smithi042.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 869 kB/s | 188 kB 00:00 2024-05-08T18:48:36.001 INFO:teuthology.orchestra.run.smithi042.stdout:(13/36): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-05-08T18:48:36.007 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:00:57 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:48:36.027 INFO:teuthology.orchestra.run.smithi042.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 520 kB/s | 35 kB 00:00 2024-05-08T18:48:36.087 INFO:teuthology.orchestra.run.smithi132.stdout:Package ceph-base-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:48:36.110 INFO:teuthology.orchestra.run.smithi042.stdout:(15/36): python3-pytz-2021.1-5.el9.noarch.rpm 469 kB/s | 51 kB 00:00 2024-05-08T18:48:36.129 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:48:36.130 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2024-05-08T18:48:36.130 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:48:36.136 INFO:teuthology.orchestra.run.smithi042.stdout:(16/36): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-05-08T18:48:36.190 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install cephadm 2024-05-08T18:48:36.378 INFO:teuthology.orchestra.run.smithi042.stdout:(17/36): ceph-mon-19.0.0-3463.gd8e5981c.el9.x86 3.2 MB/s | 4.7 MB 00:01 2024-05-08T18:48:36.403 INFO:teuthology.orchestra.run.smithi042.stdout:(18/36): lua-devel-5.4.4-4.el9.x86_64.rpm 76 kB/s | 22 kB 00:00 2024-05-08T18:48:36.756 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:00:57 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:48:36.861 INFO:teuthology.orchestra.run.smithi042.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 208 kB/s | 151 kB 00:00 2024-05-08T18:48:36.879 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:48:36.879 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:48:36.879 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-05-08T18:48:36.880 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:48:36.880 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-05-08T18:48:36.880 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 763 k 2024-05-08T18:48:36.880 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:36.880 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-05-08T18:48:36.880 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:48:36.880 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package 2024-05-08T18:48:36.880 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:36.880 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 763 k 2024-05-08T18:48:36.880 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 770 k 2024-05-08T18:48:36.881 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-05-08T18:48:36.904 INFO:teuthology.orchestra.run.smithi042.stdout:(20/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 83 kB/s | 43 kB 00:00 2024-05-08T18:48:37.006 INFO:teuthology.orchestra.run.smithi042.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 107 kB/s | 11 kB 00:00 2024-05-08T18:48:37.113 INFO:teuthology.orchestra.run.smithi042.stdout:(22/36): python3-jaraco-classes-3.2.1-5.el9.noa 163 kB/s | 18 kB 00:00 2024-05-08T18:48:37.138 INFO:teuthology.orchestra.run.smithi042.stdout:(23/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 234 kB/s | 172 kB 00:00 2024-05-08T18:48:37.215 INFO:teuthology.orchestra.run.smithi042.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 231 kB/s | 23 kB 00:00 2024-05-08T18:48:37.238 INFO:teuthology.orchestra.run.smithi042.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 194 kB/s | 19 kB 00:00 2024-05-08T18:48:37.314 INFO:teuthology.orchestra.run.smithi042.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 196 kB/s | 20 kB 00:00 2024-05-08T18:48:37.339 INFO:teuthology.orchestra.run.smithi042.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 461 kB/s | 46 kB 00:00 2024-05-08T18:48:37.423 INFO:teuthology.orchestra.run.smithi042.stdout:(28/36): python3-cherrypy-18.6.1-2.el9.noarch.r 639 kB/s | 358 kB 00:00 2024-05-08T18:48:37.498 INFO:teuthology.orchestra.run.smithi042.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 429 kB/s | 79 kB 00:00 2024-05-08T18:48:37.531 INFO:teuthology.orchestra.run.smithi042.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 151 kB/s | 16 kB 00:00 2024-05-08T18:48:37.648 INFO:teuthology.orchestra.run.smithi042.stdout:(31/36): python3-tempora-5.0.0-2.el9.noarch.rpm 306 kB/s | 36 kB 00:00 2024-05-08T18:48:37.682 INFO:teuthology.orchestra.run.smithi042.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 489 kB/s | 90 kB 00:00 2024-05-08T18:48:37.791 INFO:teuthology.orchestra.run.smithi042.stdout:(33/36): python3-pecan-1.4.2-3.el9.noarch.rpm 603 kB/s | 272 kB 00:00 2024-05-08T18:48:37.900 INFO:teuthology.orchestra.run.smithi042.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 184 kB/s | 20 kB 00:00 2024-05-08T18:48:38.008 INFO:teuthology.orchestra.run.smithi042.stdout:(35/36): python3-webob-1.8.7-6.el9.noarch.rpm 640 kB/s | 230 kB 00:00 2024-05-08T18:48:38.258 INFO:teuthology.orchestra.run.smithi042.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 742 kB/s | 427 kB 00:00 2024-05-08T18:48:38.264 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:48:38.264 INFO:teuthology.orchestra.run.smithi042.stdout:Total 7.7 MB/s | 30 MB 00:03 2024-05-08T18:48:38.303 INFO:teuthology.orchestra.run.smithi132.stdout:cephadm-19.0.0-3463.gd8e5981c.el9.noarch.rpm 537 kB/s | 763 kB 00:01 2024-05-08T18:48:38.303 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:48:38.304 INFO:teuthology.orchestra.run.smithi132.stdout:Total 536 kB/s | 763 kB 00:01 2024-05-08T18:48:38.304 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-05-08T18:48:38.311 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-05-08T18:48:38.311 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-05-08T18:48:38.317 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-05-08T18:48:38.317 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-05-08T18:48:38.395 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-05-08T18:48:38.414 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-05-08T18:48:38.458 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-05-08T18:48:38.458 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-05-08T18:48:38.865 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 1/1 2024-05-08T18:48:38.907 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-05-08T18:48:38.907 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-05-08T18:48:38.949 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 1/1 2024-05-08T18:48:39.289 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 1/1 2024-05-08T18:48:39.539 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 1/1 2024-05-08T18:48:39.540 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:39.540 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-05-08T18:48:39.540 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:48:39.540 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:39.540 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:48:39.731 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-immutable-object-cache 2024-05-08T18:48:40.212 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-05-08T18:48:40.269 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-05-08T18:48:40.302 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-05-08T18:48:40.308 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:01 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:48:40.330 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-05-08T18:48:40.406 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-05-08T18:48:40.434 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:48:40.435 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:48:40.435 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repo Size 2024-05-08T18:48:40.435 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:48:40.435 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-05-08T18:48:40.435 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 145 k 2024-05-08T18:48:40.435 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:40.435 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-05-08T18:48:40.435 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:48:40.435 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package 2024-05-08T18:48:40.435 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:40.436 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 145 k 2024-05-08T18:48:40.436 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 435 k 2024-05-08T18:48:40.436 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-05-08T18:48:40.446 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-05-08T18:48:40.479 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-05-08T18:48:40.575 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-05-08T18:48:40.660 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-05-08T18:48:40.685 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-immutable-object-cache-19.0.0-3463.gd8e598 582 kB/s | 145 kB 00:00 2024-05-08T18:48:40.686 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:48:40.687 INFO:teuthology.orchestra.run.smithi132.stdout:Total 579 kB/s | 145 kB 00:00 2024-05-08T18:48:40.687 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-05-08T18:48:40.694 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-05-08T18:48:40.694 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-05-08T18:48:40.708 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-05-08T18:48:40.742 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-05-08T18:48:40.751 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-05-08T18:48:40.752 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-05-08T18:48:40.772 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-05-08T18:48:40.806 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-05-08T18:48:40.840 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-05-08T18:48:40.881 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-05-08T18:48:40.898 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-05-08T18:48:40.924 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-05-08T18:48:40.958 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-05-08T18:48:40.978 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3463.gd8e5981c. 1/1 2024-05-08T18:48:40.996 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-05-08T18:48:41.003 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3463.gd8e5981c. 1/1 2024-05-08T18:48:41.003 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:48:41.004 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T18:48:41.004 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:41.073 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-05-08T18:48:41.249 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-05-08T18:48:41.333 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-05-08T18:48:41.392 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-05-08T18:48:41.430 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-05-08T18:48:41.489 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-05-08T18:48:41.553 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-05-08T18:48:41.759 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-05-08T18:48:41.810 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-05-08T18:48:41.838 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3463.gd8e5981c. 1/1 2024-05-08T18:48:41.838 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:41.839 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-05-08T18:48:41.839 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:41.839 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:41.839 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:48:41.890 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-05-08T18:48:41.979 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-05-08T18:48:42.017 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-05-08T18:48:42.057 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-mgr 2024-05-08T18:48:42.158 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-05-08T18:48:42.338 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3463.gd8e5981c.el9. 31/36 2024-05-08T18:48:42.369 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-2:19.0.0-3463.gd8e5981c.el9.x86_64 32/36 2024-05-08T18:48:42.395 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3463.gd8e5981c.el9.x86_64 32/36 2024-05-08T18:48:42.395 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:48:42.395 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T18:48:42.395 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T18:48:42.396 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T18:48:42.396 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:42.631 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:03 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:48:42.715 INFO:teuthology.orchestra.run.smithi132.stdout:Package ceph-mgr-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:48:42.758 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:48:42.759 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2024-05-08T18:48:42.759 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:48:42.825 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-mgr-dashboard 2024-05-08T18:48:43.395 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:04 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:48:43.519 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:48:43.521 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:48:43.521 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-05-08T18:48:43.521 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:48:43.522 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-05-08T18:48:43.522 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 3.5 M 2024-05-08T18:48:43.522 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-05-08T18:48:43.522 INFO:teuthology.orchestra.run.smithi132.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T18:48:43.522 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 34 k 2024-05-08T18:48:43.522 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 16 k 2024-05-08T18:48:43.522 INFO:teuthology.orchestra.run.smithi132.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T18:48:43.522 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T18:48:43.523 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T18:48:43.523 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T18:48:43.523 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T18:48:43.523 INFO:teuthology.orchestra.run.smithi132.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T18:48:43.523 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T18:48:43.523 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T18:48:43.523 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:43.524 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-05-08T18:48:43.524 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:48:43.524 INFO:teuthology.orchestra.run.smithi132.stdout:Install 12 Packages 2024-05-08T18:48:43.524 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:43.524 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 8.6 M 2024-05-08T18:48:43.524 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 104 M 2024-05-08T18:48:43.525 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-05-08T18:48:43.928 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-osd-2:19.0.0-3463.gd8e5981c.el9.x86_64 33/36 2024-05-08T18:48:43.957 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-osd-2:19.0.0-3463.gd8e5981c.el9.x86_64 33/36 2024-05-08T18:48:43.957 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:48:43.957 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T18:48:43.957 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T18:48:43.957 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T18:48:43.957 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:44.209 INFO:teuthology.orchestra.run.smithi132.stdout:(1/12): ceph-grafana-dashboards-19.0.0-3463.gd8 82 kB/s | 34 kB 00:00 2024-05-08T18:48:44.251 INFO:teuthology.orchestra.run.smithi132.stdout:(2/12): ceph-prometheus-alerts-19.0.0-3463.gd8e 36 kB/s | 16 kB 00:00 2024-05-08T18:48:44.421 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mon-2:19.0.0-3463.gd8e5981c.el9.x86_64 34/36 2024-05-08T18:48:44.447 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mon-2:19.0.0-3463.gd8e5981c.el9.x86_64 34/36 2024-05-08T18:48:44.447 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:48:44.447 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T18:48:44.447 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T18:48:44.447 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T18:48:44.447 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:44.501 INFO:teuthology.orchestra.run.smithi132.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.1 MB/s | 269 kB 00:00 2024-05-08T18:48:44.609 INFO:teuthology.orchestra.run.smithi132.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 2.5 MB/s | 1.0 MB 00:00 2024-05-08T18:48:44.680 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mds-2:19.0.0-3463.gd8e5981c.el9.x86_64 35/36 2024-05-08T18:48:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mds-2:19.0.0-3463.gd8e5981c.el9.x86_64 35/36 2024-05-08T18:48:44.706 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:48:44.706 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T18:48:44.706 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T18:48:44.706 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T18:48:44.706 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:44.751 INFO:teuthology.orchestra.run.smithi132.stdout:(5/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.4 MB/s | 863 kB 00:00 2024-05-08T18:48:44.772 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-2:19.0.0-3463.gd8e5981c.el9.x86_64 36/36 2024-05-08T18:48:44.960 INFO:teuthology.orchestra.run.smithi132.stdout:(6/12): ceph-mgr-dashboard-19.0.0-3463.gd8e5981 3.0 MB/s | 3.5 MB 00:01 2024-05-08T18:48:45.160 INFO:teuthology.orchestra.run.smithi132.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 48 kB/s | 19 kB 00:00 2024-05-08T18:48:45.336 INFO:teuthology.orchestra.run.smithi132.stdout:(8/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 755 kB/s | 548 kB 00:00 2024-05-08T18:48:45.452 INFO:teuthology.orchestra.run.smithi132.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 264 kB/s | 31 kB 00:00 2024-05-08T18:48:45.486 INFO:teuthology.orchestra.run.smithi132.stdout:(10/12): python3-grpcio-tools-1.46.7-10.el9.x86 445 kB/s | 144 kB 00:00 2024-05-08T18:48:45.628 INFO:teuthology.orchestra.run.smithi132.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.1 MB/s | 188 kB 00:00 2024-05-08T18:48:45.904 INFO:teuthology.orchestra.run.smithi132.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 2.2 MB/s | 2.0 MB 00:00 2024-05-08T18:48:45.907 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:48:45.907 INFO:teuthology.orchestra.run.smithi132.stdout:Total 3.6 MB/s | 8.6 MB 00:02 2024-05-08T18:48:45.956 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-05-08T18:48:45.973 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-05-08T18:48:45.973 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-05-08T18:48:46.163 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-05-08T18:48:46.163 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-05-08T18:48:46.631 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-2:19.0.0-3463.gd8e5981c.el9.x86_64 36/36 2024-05-08T18:48:46.631 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/36 2024-05-08T18:48:46.631 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mds-2:19.0.0-3463.gd8e5981c.el9.x86_64 2/36 2024-05-08T18:48:46.631 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-2:19.0.0-3463.gd8e5981c.el9.x86_64 3/36 2024-05-08T18:48:46.631 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mon-2:19.0.0-3463.gd8e5981c.el9.x86_64 4/36 2024-05-08T18:48:46.631 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-osd-2:19.0.0-3463.gd8e5981c.el9.x86_64 5/36 2024-05-08T18:48:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3463.gd8e5981c.el9. 6/36 2024-05-08T18:48:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-05-08T18:48:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-05-08T18:48:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-05-08T18:48:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-05-08T18:48:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-05-08T18:48:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-05-08T18:48:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-05-08T18:48:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-05-08T18:48:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-05-08T18:48:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-05-08T18:48:46.632 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-05-08T18:48:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-05-08T18:48:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-05-08T18:48:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-05-08T18:48:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-05-08T18:48:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-05-08T18:48:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-05-08T18:48:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-05-08T18:48:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-05-08T18:48:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-05-08T18:48:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-05-08T18:48:46.633 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-05-08T18:48:46.634 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-05-08T18:48:46.634 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-05-08T18:48:46.634 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-05-08T18:48:46.634 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-05-08T18:48:46.634 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-05-08T18:48:46.634 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-05-08T18:48:46.634 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-05-08T18:48:46.752 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-05-08T18:48:46.820 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-05-08T18:48:46.864 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-05-08T18:48:46.911 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-05-08T18:48:46.958 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-05-08T18:48:47.069 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-05-08T18:48:47.191 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-05-08T18:48:47.286 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-05-08T18:48:47.338 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-05-08T18:48:47.375 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-05-08T18:48:47.407 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3463.gd8e5981c.el9 10/12 2024-05-08T18:48:47.669 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-05-08T18:48:47.669 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:47.669 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-05-08T18:48:47.669 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:48:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T18:48:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T18:48:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T18:48:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T18:48:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T18:48:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T18:48:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T18:48:47.670 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T18:48:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T18:48:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T18:48:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T18:48:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T18:48:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T18:48:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T18:48:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T18:48:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T18:48:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T18:48:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T18:48:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T18:48:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T18:48:47.671 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T18:48:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T18:48:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T18:48:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T18:48:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T18:48:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T18:48:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T18:48:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T18:48:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T18:48:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T18:48:47.672 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:47.672 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:48:48.034 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-base 2024-05-08T18:48:48.451 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3463.gd8e5981c.el 11/12 2024-05-08T18:48:48.482 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3463.gd8e5981c.el9.noa 12/12 2024-05-08T18:48:48.659 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:00:58 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:48:48.742 INFO:teuthology.orchestra.run.smithi042.stdout:Package ceph-base-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:48:48.787 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:48:48.788 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-05-08T18:48:48.789 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:48:48.859 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install cephadm 2024-05-08T18:48:49.451 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:00:59 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:48:49.580 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:48:49.580 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:48:49.581 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-05-08T18:48:49.581 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:48:49.581 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-05-08T18:48:49.581 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 763 k 2024-05-08T18:48:49.581 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:49.581 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-05-08T18:48:49.582 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:48:49.582 INFO:teuthology.orchestra.run.smithi042.stdout:Install 1 Package 2024-05-08T18:48:49.582 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:49.582 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 763 k 2024-05-08T18:48:49.582 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 770 k 2024-05-08T18:48:49.582 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-05-08T18:48:49.737 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3463.gd8e5981c.el9.noa 12/12 2024-05-08T18:48:49.738 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3463.gd8e5981c.el 1/12 2024-05-08T18:48:49.738 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3463.gd8e5981c.el9.noa 2/12 2024-05-08T18:48:49.738 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3463.gd8e5981c.el9 3/12 2024-05-08T18:48:49.738 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-05-08T18:48:49.738 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-05-08T18:48:49.738 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-05-08T18:48:49.738 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-05-08T18:48:49.738 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-05-08T18:48:49.738 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-05-08T18:48:49.738 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-05-08T18:48:49.738 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-05-08T18:48:50.071 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-05-08T18:48:50.072 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:50.072 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-05-08T18:48:50.072 INFO:teuthology.orchestra.run.smithi132.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T18:48:50.072 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:48:50.072 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:48:50.072 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:48:50.072 INFO:teuthology.orchestra.run.smithi132.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T18:48:50.072 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T18:48:50.072 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T18:48:50.072 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T18:48:50.072 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T18:48:50.072 INFO:teuthology.orchestra.run.smithi132.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T18:48:50.072 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T18:48:50.073 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T18:48:50.073 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:50.073 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:48:50.298 INFO:teuthology.orchestra.run.smithi042.stdout:cephadm-19.0.0-3463.gd8e5981c.el9.noarch.rpm 1.0 MB/s | 763 kB 00:00 2024-05-08T18:48:50.299 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:48:50.299 INFO:teuthology.orchestra.run.smithi042.stdout:Total 1.0 MB/s | 763 kB 00:00 2024-05-08T18:48:50.299 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-05-08T18:48:50.305 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-05-08T18:48:50.305 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-05-08T18:48:50.311 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-08T18:48:50.311 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-05-08T18:48:50.311 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-05-08T18:48:50.389 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-05-08T18:48:50.850 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 1/1 2024-05-08T18:48:50.891 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:11 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:48:50.946 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 1/1 2024-05-08T18:48:51.023 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:48:51.025 INFO:teuthology.orchestra.run.smithi132.stdout:======================================================================================= 2024-05-08T18:48:51.025 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-05-08T18:48:51.025 INFO:teuthology.orchestra.run.smithi132.stdout:======================================================================================= 2024-05-08T18:48:51.025 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-05-08T18:48:51.025 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 7.4 M 2024-05-08T18:48:51.025 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-05-08T18:48:51.025 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T18:48:51.025 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T18:48:51.026 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T18:48:51.026 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T18:48:51.026 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T18:48:51.026 INFO:teuthology.orchestra.run.smithi132.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T18:48:51.026 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T18:48:51.026 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T18:48:51.026 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T18:48:51.026 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T18:48:51.026 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T18:48:51.026 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:51.026 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-05-08T18:48:51.026 INFO:teuthology.orchestra.run.smithi132.stdout:======================================================================================= 2024-05-08T18:48:51.026 INFO:teuthology.orchestra.run.smithi132.stdout:Install 12 Packages 2024-05-08T18:48:51.026 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:48:51.027 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 38 M 2024-05-08T18:48:51.027 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 209 M 2024-05-08T18:48:51.027 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-05-08T18:48:51.292 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 1/1 2024-05-08T18:48:51.295 INFO:teuthology.orchestra.run.smithi132.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-05-08T18:48:51.379 INFO:teuthology.orchestra.run.smithi132.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 803 kB 00:00 2024-05-08T18:48:51.404 INFO:teuthology.orchestra.run.smithi132.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 304 kB/s | 33 kB 00:00 2024-05-08T18:48:51.454 INFO:teuthology.orchestra.run.smithi132.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 363 kB/s | 18 kB 00:00 2024-05-08T18:48:51.513 INFO:teuthology.orchestra.run.smithi132.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 600 kB/s | 35 kB 00:00 2024-05-08T18:48:51.517 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 1/1 2024-05-08T18:48:51.517 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:51.517 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-05-08T18:48:51.517 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:48:51.517 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:51.517 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:48:51.716 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-immutable-object-cache 2024-05-08T18:48:51.997 INFO:teuthology.orchestra.run.smithi132.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.8 MB/s | 3.0 MB 00:00 2024-05-08T18:48:52.089 INFO:teuthology.orchestra.run.smithi132.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 2.6 MB/s | 244 kB 00:00 2024-05-08T18:48:52.273 INFO:teuthology.orchestra.run.smithi132.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 6.2 MB/s | 4.7 MB 00:00 2024-05-08T18:48:52.306 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:02 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:48:52.431 INFO:teuthology.orchestra.run.smithi132.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.5 MB/s | 250 kB 00:00 2024-05-08T18:48:52.437 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:48:52.438 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:48:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repo Size 2024-05-08T18:48:52.438 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:48:52.438 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-05-08T18:48:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 145 k 2024-05-08T18:48:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:52.438 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-05-08T18:48:52.438 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:48:52.438 INFO:teuthology.orchestra.run.smithi042.stdout:Install 1 Package 2024-05-08T18:48:52.438 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:52.439 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 145 k 2024-05-08T18:48:52.439 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 435 k 2024-05-08T18:48:52.439 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-05-08T18:48:52.673 INFO:teuthology.orchestra.run.smithi132.stdout:(10/12): ceph-mgr-diskprediction-local-19.0.0-3 4.8 MB/s | 7.4 MB 00:01 2024-05-08T18:48:53.080 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-immutable-object-cache-19.0.0-3463.gd8e598 226 kB/s | 145 kB 00:00 2024-05-08T18:48:53.081 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:48:53.081 INFO:teuthology.orchestra.run.smithi042.stdout:Total 225 kB/s | 145 kB 00:00 2024-05-08T18:48:53.082 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-05-08T18:48:53.091 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-05-08T18:48:53.091 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-05-08T18:48:53.154 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-05-08T18:48:53.154 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-05-08T18:48:53.304 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-05-08T18:48:53.373 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3463.gd8e5981c. 1/1 2024-05-08T18:48:53.400 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3463.gd8e5981c. 1/1 2024-05-08T18:48:53.400 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:48:53.400 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T18:48:53.400 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:53.690 INFO:teuthology.orchestra.run.smithi132.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.2 MB/s | 5.1 MB 00:01 2024-05-08T18:48:54.305 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3463.gd8e5981c. 1/1 2024-05-08T18:48:54.305 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:54.305 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-05-08T18:48:54.305 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:48:54.305 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:54.306 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:48:54.540 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-mgr 2024-05-08T18:48:55.123 INFO:teuthology.orchestra.run.smithi132.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.0 MB/s | 16 MB 00:02 2024-05-08T18:48:55.125 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:48:55.125 INFO:teuthology.orchestra.run.smithi132.stdout:Total 9.3 MB/s | 38 MB 00:04 2024-05-08T18:48:55.148 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:05 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:48:55.231 INFO:teuthology.orchestra.run.smithi042.stdout:Package ceph-mgr-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:48:55.277 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:48:55.278 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-05-08T18:48:55.278 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:48:55.355 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-mgr-dashboard 2024-05-08T18:48:55.484 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-05-08T18:48:55.510 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-05-08T18:48:55.510 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-05-08T18:48:55.942 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:05 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:48:55.946 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-05-08T18:48:55.946 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-05-08T18:48:56.070 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:48:56.072 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:48:56.072 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-05-08T18:48:56.072 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:48:56.072 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-05-08T18:48:56.072 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 3.5 M 2024-05-08T18:48:56.072 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-05-08T18:48:56.072 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T18:48:56.072 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 34 k 2024-05-08T18:48:56.072 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 16 k 2024-05-08T18:48:56.072 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T18:48:56.072 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T18:48:56.072 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T18:48:56.073 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T18:48:56.073 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T18:48:56.073 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T18:48:56.073 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T18:48:56.073 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T18:48:56.073 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:56.073 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-05-08T18:48:56.073 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:48:56.073 INFO:teuthology.orchestra.run.smithi042.stdout:Install 12 Packages 2024-05-08T18:48:56.073 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:48:56.074 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 8.6 M 2024-05-08T18:48:56.074 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 104 M 2024-05-08T18:48:56.074 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-05-08T18:48:56.738 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-05-08T18:48:56.760 INFO:teuthology.orchestra.run.smithi042.stdout:(1/12): ceph-grafana-dashboards-19.0.0-3463.gd8 161 kB/s | 34 kB 00:00 2024-05-08T18:48:56.785 INFO:teuthology.orchestra.run.smithi042.stdout:(2/12): ceph-prometheus-alerts-19.0.0-3463.gd8e 69 kB/s | 16 kB 00:00 2024-05-08T18:48:56.811 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-08T18:48:56.854 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-08T18:48:56.963 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-08T18:48:56.985 INFO:teuthology.orchestra.run.smithi042.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.3 MB/s | 269 kB 00:00 2024-05-08T18:48:57.006 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-08T18:48:57.183 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-08T18:48:57.213 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-08T18:48:57.227 INFO:teuthology.orchestra.run.smithi042.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 2.2 MB/s | 1.0 MB 00:00 2024-05-08T18:48:57.290 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-08T18:48:57.478 INFO:teuthology.orchestra.run.smithi042.stdout:(5/12): protobuf-compiler-3.14.0-13.el9.x86_64. 1.7 MB/s | 863 kB 00:00 2024-05-08T18:48:57.719 INFO:teuthology.orchestra.run.smithi042.stdout:(6/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.1 MB/s | 548 kB 00:00 2024-05-08T18:48:57.745 INFO:teuthology.orchestra.run.smithi042.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 73 kB/s | 19 kB 00:00 2024-05-08T18:48:57.928 INFO:teuthology.orchestra.run.smithi042.stdout:(8/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 9.8 MB/s | 2.0 MB 00:00 2024-05-08T18:48:57.956 INFO:teuthology.orchestra.run.smithi042.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 685 kB/s | 144 kB 00:00 2024-05-08T18:48:57.992 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-08T18:48:58.039 INFO:teuthology.orchestra.run.smithi042.stdout:(10/12): ceph-mgr-dashboard-19.0.0-3463.gd8e598 2.4 MB/s | 3.5 MB 00:01 2024-05-08T18:48:58.065 INFO:teuthology.orchestra.run.smithi042.stdout:(11/12): python3-repoze-lru-0.7-16.el9.noarch.r 226 kB/s | 31 kB 00:00 2024-05-08T18:48:58.090 INFO:teuthology.orchestra.run.smithi042.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.4 MB/s | 188 kB 00:00 2024-05-08T18:48:58.094 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:48:58.094 INFO:teuthology.orchestra.run.smithi042.stdout:Total 4.3 MB/s | 8.6 MB 00:02 2024-05-08T18:48:58.101 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-08T18:48:58.147 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-05-08T18:48:58.166 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-05-08T18:48:58.166 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-05-08T18:48:58.351 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-05-08T18:48:58.351 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-05-08T18:48:58.957 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-05-08T18:48:59.033 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-05-08T18:48:59.068 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-05-08T18:48:59.116 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-05-08T18:48:59.145 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-05-08T18:48:59.255 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-05-08T18:48:59.342 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-08T18:48:59.385 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-05-08T18:48:59.493 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-05-08T18:48:59.542 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-05-08T18:48:59.570 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-05-08T18:48:59.602 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3463.gd8e5981c.el9 10/12 2024-05-08T18:49:00.373 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-08T18:49:00.405 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3463.gd8e59 12/12 2024-05-08T18:49:00.706 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3463.gd8e5981c.el 11/12 2024-05-08T18:49:00.743 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3463.gd8e5981c.el9.noa 12/12 2024-05-08T18:49:02.053 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3463.gd8e5981c.el9.noa 12/12 2024-05-08T18:49:02.053 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3463.gd8e5981c.el 1/12 2024-05-08T18:49:02.053 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3463.gd8e5981c.el9.noa 2/12 2024-05-08T18:49:02.053 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3463.gd8e5981c.el9 3/12 2024-05-08T18:49:02.054 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-05-08T18:49:02.054 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-05-08T18:49:02.054 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-05-08T18:49:02.054 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-05-08T18:49:02.054 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-05-08T18:49:02.054 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-05-08T18:49:02.054 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-05-08T18:49:02.054 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-05-08T18:49:02.354 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-05-08T18:49:02.354 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:02.354 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-05-08T18:49:02.354 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T18:49:02.354 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:49:02.355 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:49:02.355 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:49:02.355 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T18:49:02.355 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T18:49:02.355 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T18:49:02.355 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T18:49:02.355 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T18:49:02.355 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T18:49:02.355 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T18:49:02.355 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T18:49:02.355 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:02.355 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:49:02.618 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-08T18:49:02.993 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3463.gd8e59 12/12 2024-05-08T18:49:02.993 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3463.gd8e59 1/12 2024-05-08T18:49:02.993 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-08T18:49:02.993 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-08T18:49:02.993 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-08T18:49:02.993 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-08T18:49:02.993 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-08T18:49:02.993 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-08T18:49:02.993 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-08T18:49:02.993 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-08T18:49:02.994 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-08T18:49:02.994 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-08T18:49:03.218 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:13 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:49:03.350 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:49:03.351 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================= 2024-05-08T18:49:03.351 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-05-08T18:49:03.352 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================= 2024-05-08T18:49:03.352 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-05-08T18:49:03.352 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 7.4 M 2024-05-08T18:49:03.352 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-05-08T18:49:03.352 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T18:49:03.352 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T18:49:03.352 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T18:49:03.352 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T18:49:03.352 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T18:49:03.352 INFO:teuthology.orchestra.run.smithi042.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T18:49:03.352 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T18:49:03.352 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T18:49:03.352 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T18:49:03.353 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T18:49:03.353 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T18:49:03.353 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:03.353 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-05-08T18:49:03.353 INFO:teuthology.orchestra.run.smithi042.stdout:======================================================================================= 2024-05-08T18:49:03.353 INFO:teuthology.orchestra.run.smithi042.stdout:Install 12 Packages 2024-05-08T18:49:03.353 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:03.354 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 38 M 2024-05-08T18:49:03.354 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 209 M 2024-05-08T18:49:03.354 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-05-08T18:49:03.380 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-08T18:49:03.380 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:03.380 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-05-08T18:49:03.380 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:49:03.380 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T18:49:03.380 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T18:49:03.380 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T18:49:03.380 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T18:49:03.381 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T18:49:03.381 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T18:49:03.381 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T18:49:03.381 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T18:49:03.381 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T18:49:03.381 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T18:49:03.381 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T18:49:03.381 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:03.381 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:49:03.674 INFO:teuthology.orchestra.run.smithi042.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 195 kB 00:00 2024-05-08T18:49:03.755 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-mgr-rook 2024-05-08T18:49:03.815 INFO:teuthology.orchestra.run.smithi042.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 803 kB 00:00 2024-05-08T18:49:03.841 INFO:teuthology.orchestra.run.smithi042.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 196 kB/s | 33 kB 00:00 2024-05-08T18:49:03.941 INFO:teuthology.orchestra.run.smithi042.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 182 kB/s | 18 kB 00:00 2024-05-08T18:49:03.983 INFO:teuthology.orchestra.run.smithi042.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 845 kB/s | 35 kB 00:00 2024-05-08T18:49:04.092 INFO:teuthology.orchestra.run.smithi042.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-05-08T18:49:04.142 INFO:teuthology.orchestra.run.smithi042.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-05-08T18:49:04.217 INFO:teuthology.orchestra.run.smithi042.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2024-05-08T18:49:04.332 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:25 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:49:04.334 INFO:teuthology.orchestra.run.smithi042.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.1 MB/s | 250 kB 00:00 2024-05-08T18:49:04.409 INFO:teuthology.orchestra.run.smithi042.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 5.1 MB 00:00 2024-05-08T18:49:04.454 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:49:04.455 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:04.455 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-05-08T18:49:04.455 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:04.456 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-05-08T18:49:04.456 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 49 k 2024-05-08T18:49:04.456 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-05-08T18:49:04.456 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T18:49:04.456 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T18:49:04.456 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T18:49:04.456 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T18:49:04.456 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T18:49:04.456 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T18:49:04.456 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T18:49:04.456 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T18:49:04.456 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T18:49:04.456 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T18:49:04.456 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T18:49:04.457 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T18:49:04.457 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:04.457 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-05-08T18:49:04.457 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:04.457 INFO:teuthology.orchestra.run.smithi132.stdout:Install 13 Packages 2024-05-08T18:49:04.457 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:04.457 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 2.2 M 2024-05-08T18:49:04.457 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 26 M 2024-05-08T18:49:04.458 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-05-08T18:49:04.560 INFO:teuthology.orchestra.run.smithi042.stdout:(11/12): ceph-mgr-diskprediction-local-19.0.0-3 7.2 MB/s | 7.4 MB 00:01 2024-05-08T18:49:04.889 INFO:teuthology.orchestra.run.smithi132.stdout:(1/13): ceph-mgr-rook-19.0.0-3463.gd8e5981c.el9 269 kB/s | 49 kB 00:00 2024-05-08T18:49:04.926 INFO:teuthology.orchestra.run.smithi042.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-05-08T18:49:04.927 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:49:04.928 INFO:teuthology.orchestra.run.smithi042.stdout:Total 24 MB/s | 38 MB 00:01 2024-05-08T18:49:04.972 INFO:teuthology.orchestra.run.smithi132.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 96 kB/s | 26 kB 00:00 2024-05-08T18:49:04.989 INFO:teuthology.orchestra.run.smithi132.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 67 kB/s | 19 kB 00:00 2024-05-08T18:49:05.295 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-05-08T18:49:05.314 INFO:teuthology.orchestra.run.smithi132.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 464 kB/s | 159 kB 00:00 2024-05-08T18:49:05.323 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-05-08T18:49:05.323 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-05-08T18:49:05.398 INFO:teuthology.orchestra.run.smithi132.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 436 kB/s | 222 kB 00:00 2024-05-08T18:49:05.448 INFO:teuthology.orchestra.run.smithi132.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 402 kB/s | 54 kB 00:00 2024-05-08T18:49:05.498 INFO:teuthology.orchestra.run.smithi132.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 547 kB/s | 279 kB 00:00 2024-05-08T18:49:05.524 INFO:teuthology.orchestra.run.smithi132.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 199 kB/s | 15 kB 00:00 2024-05-08T18:49:05.549 INFO:teuthology.orchestra.run.smithi132.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 213 kB/s | 32 kB 00:00 2024-05-08T18:49:05.574 INFO:teuthology.orchestra.run.smithi132.stdout:(10/13): python3-google-auth-2.29.0-1.el9.noarc 2.7 MB/s | 206 kB 00:00 2024-05-08T18:49:05.608 INFO:teuthology.orchestra.run.smithi132.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.6 MB/s | 90 kB 00:00 2024-05-08T18:49:05.633 INFO:teuthology.orchestra.run.smithi132.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 706 kB/s | 59 kB 00:00 2024-05-08T18:49:05.667 INFO:teuthology.orchestra.run.smithi132.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-05-08T18:49:05.667 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:49:05.667 INFO:teuthology.orchestra.run.smithi132.stdout:Total 1.8 MB/s | 2.2 MB 00:01 2024-05-08T18:49:05.735 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-05-08T18:49:05.750 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-05-08T18:49:05.750 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-05-08T18:49:05.785 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-05-08T18:49:05.785 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-05-08T18:49:05.836 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-05-08T18:49:05.837 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-05-08T18:49:06.338 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-05-08T18:49:06.515 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-08T18:49:06.567 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-05-08T18:49:06.576 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-08T18:49:06.638 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-08T18:49:06.640 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-08T18:49:06.675 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-08T18:49:06.677 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-08T18:49:06.718 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-08T18:49:06.787 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-08T18:49:06.820 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-08T18:49:06.834 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-08T18:49:06.931 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-08T18:49:07.019 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-08T18:49:07.058 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-08T18:49:07.062 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-08T18:49:07.143 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-08T18:49:07.791 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-08T18:49:07.835 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-08T18:49:07.851 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-08T18:49:07.884 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-08T18:49:07.937 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-08T18:49:07.951 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-08T18:49:07.962 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-rook-2:19.0.0-3463.gd8e5981c.el9.noarch 13/13 2024-05-08T18:49:08.623 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3463.gd8e5981c.el9.noarch 13/13 2024-05-08T18:49:08.623 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3463.gd8e5981c.el9.noarch 1/13 2024-05-08T18:49:08.623 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-08T18:49:08.624 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-08T18:49:08.624 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-08T18:49:08.624 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-08T18:49:08.624 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-08T18:49:08.624 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-08T18:49:08.624 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-08T18:49:08.624 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-08T18:49:08.624 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-08T18:49:08.624 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-08T18:49:08.624 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-08T18:49:08.943 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-08T18:49:08.943 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:08.944 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-05-08T18:49:08.944 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:49:08.944 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T18:49:08.944 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T18:49:08.944 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T18:49:08.944 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T18:49:08.944 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T18:49:08.944 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T18:49:08.944 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T18:49:08.944 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T18:49:08.944 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T18:49:08.944 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T18:49:08.944 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T18:49:08.944 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T18:49:08.945 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:08.945 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:49:09.184 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-mgr-cephadm 2024-05-08T18:49:09.266 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-08T18:49:09.762 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:30 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:49:09.886 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:49:09.887 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:09.887 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-05-08T18:49:09.887 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:09.887 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-05-08T18:49:09.887 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 142 k 2024-05-08T18:49:09.887 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-05-08T18:49:09.887 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T18:49:09.888 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T18:49:09.888 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T18:49:09.888 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T18:49:09.888 INFO:teuthology.orchestra.run.smithi132.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T18:49:09.888 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:09.888 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-05-08T18:49:09.888 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:09.888 INFO:teuthology.orchestra.run.smithi132.stdout:Install 6 Packages 2024-05-08T18:49:09.888 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:09.889 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 7.0 M 2024-05-08T18:49:09.889 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 33 M 2024-05-08T18:49:09.889 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-05-08T18:49:10.210 INFO:teuthology.orchestra.run.smithi132.stdout:(1/6): ceph-mgr-cephadm-19.0.0-3463.gd8e5981c.e 633 kB/s | 142 kB 00:00 2024-05-08T18:49:10.353 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-08T18:49:10.383 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3463.gd8e59 12/12 2024-05-08T18:49:10.486 INFO:teuthology.orchestra.run.smithi132.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 496 kB/s | 248 kB 00:00 2024-05-08T18:49:10.811 INFO:teuthology.orchestra.run.smithi132.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 913 kB/s | 548 kB 00:00 2024-05-08T18:49:10.836 INFO:teuthology.orchestra.run.smithi132.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 165 kB/s | 58 kB 00:00 2024-05-08T18:49:10.911 INFO:teuthology.orchestra.run.smithi132.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 510 kB/s | 51 kB 00:00 2024-05-08T18:49:11.770 INFO:teuthology.orchestra.run.smithi132.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.3 MB/s | 6.0 MB 00:01 2024-05-08T18:49:11.770 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:49:11.770 INFO:teuthology.orchestra.run.smithi132.stdout:Total 3.7 MB/s | 7.0 MB 00:01 2024-05-08T18:49:11.844 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-05-08T18:49:11.855 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-05-08T18:49:11.855 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-05-08T18:49:11.952 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-05-08T18:49:11.955 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-05-08T18:49:12.267 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-05-08T18:49:12.444 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-08T18:49:12.488 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-08T18:49:12.831 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3463.gd8e59 12/12 2024-05-08T18:49:12.831 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3463.gd8e59 1/12 2024-05-08T18:49:12.831 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-08T18:49:12.831 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-08T18:49:12.831 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-08T18:49:12.832 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-08T18:49:12.832 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-08T18:49:12.832 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-08T18:49:12.832 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-08T18:49:12.832 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-08T18:49:12.832 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-08T18:49:12.832 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-08T18:49:13.008 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-08T18:49:13.100 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-08T18:49:13.163 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-08T18:49:13.192 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 6/6 2024-05-08T18:49:13.239 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-08T18:49:13.239 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:13.240 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-05-08T18:49:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:49:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T18:49:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T18:49:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T18:49:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T18:49:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T18:49:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T18:49:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T18:49:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T18:49:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T18:49:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T18:49:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T18:49:13.240 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:13.240 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:49:13.614 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-mgr-rook 2024-05-08T18:49:13.940 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 6/6 2024-05-08T18:49:13.940 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 1/6 2024-05-08T18:49:13.941 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-08T18:49:13.941 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-08T18:49:13.941 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-08T18:49:13.941 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-08T18:49:14.209 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-08T18:49:14.209 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:14.209 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-05-08T18:49:14.209 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:49:14.209 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T18:49:14.209 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T18:49:14.210 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T18:49:14.210 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T18:49:14.210 INFO:teuthology.orchestra.run.smithi132.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T18:49:14.210 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:14.210 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:49:14.213 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:24 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:49:14.342 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:49:14.343 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:14.343 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-05-08T18:49:14.343 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:14.343 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-05-08T18:49:14.343 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 49 k 2024-05-08T18:49:14.343 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-05-08T18:49:14.343 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T18:49:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T18:49:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T18:49:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T18:49:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T18:49:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T18:49:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T18:49:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T18:49:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T18:49:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T18:49:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T18:49:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T18:49:14.344 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:14.344 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-05-08T18:49:14.345 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:14.345 INFO:teuthology.orchestra.run.smithi042.stdout:Install 13 Packages 2024-05-08T18:49:14.345 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:14.345 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 2.2 M 2024-05-08T18:49:14.346 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 26 M 2024-05-08T18:49:14.346 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-05-08T18:49:14.463 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-fuse 2024-05-08T18:49:14.625 INFO:teuthology.orchestra.run.smithi042.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 135 kB/s | 26 kB 00:00 2024-05-08T18:49:14.650 INFO:teuthology.orchestra.run.smithi042.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 89 kB/s | 19 kB 00:00 2024-05-08T18:49:14.867 INFO:teuthology.orchestra.run.smithi042.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 732 kB/s | 159 kB 00:00 2024-05-08T18:49:15.020 INFO:teuthology.orchestra.run.smithi042.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 809 kB/s | 222 kB 00:00 2024-05-08T18:49:15.020 INFO:teuthology.orchestra.run.smithi042.stdout:(5/13): ceph-mgr-rook-19.0.0-3463.gd8e5981c.el9 99 kB/s | 49 kB 00:00 2024-05-08T18:49:15.020 INFO:teuthology.orchestra.run.smithi042.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 914 kB/s | 54 kB 00:00 2024-05-08T18:49:15.020 INFO:teuthology.orchestra.run.smithi042.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.8 MB/s | 279 kB 00:00 2024-05-08T18:49:15.034 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:36 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:49:15.119 INFO:teuthology.orchestra.run.smithi042.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 175 kB/s | 32 kB 00:00 2024-05-08T18:49:15.152 INFO:teuthology.orchestra.run.smithi042.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 78 kB/s | 15 kB 00:00 2024-05-08T18:49:15.155 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:49:15.156 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:15.156 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-05-08T18:49:15.156 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:15.156 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-05-08T18:49:15.156 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 891 k 2024-05-08T18:49:15.156 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-05-08T18:49:15.156 INFO:teuthology.orchestra.run.smithi132.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T18:49:15.157 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:15.157 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-05-08T18:49:15.157 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:15.157 INFO:teuthology.orchestra.run.smithi132.stdout:Install 2 Packages 2024-05-08T18:49:15.157 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:15.157 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 971 k 2024-05-08T18:49:15.157 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 2.8 M 2024-05-08T18:49:15.158 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-05-08T18:49:15.327 INFO:teuthology.orchestra.run.smithi042.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 337 kB/s | 59 kB 00:00 2024-05-08T18:49:15.353 INFO:teuthology.orchestra.run.smithi042.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 615 kB/s | 206 kB 00:00 2024-05-08T18:49:15.478 INFO:teuthology.orchestra.run.smithi042.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 598 kB/s | 90 kB 00:00 2024-05-08T18:49:15.747 INFO:teuthology.orchestra.run.smithi132.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 154 kB/s | 80 kB 00:00 2024-05-08T18:49:16.003 INFO:teuthology.orchestra.run.smithi042.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.2 MB/s | 1.0 MB 00:00 2024-05-08T18:49:16.004 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:49:16.004 INFO:teuthology.orchestra.run.smithi042.stdout:Total 1.3 MB/s | 2.2 MB 00:01 2024-05-08T18:49:16.078 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-05-08T18:49:16.095 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-05-08T18:49:16.095 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-05-08T18:49:16.192 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-05-08T18:49:16.194 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-05-08T18:49:16.605 INFO:teuthology.orchestra.run.smithi132.stdout:(2/2): ceph-fuse-19.0.0-3463.gd8e5981c.el9.x86_ 645 kB/s | 891 kB 00:01 2024-05-08T18:49:16.606 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:49:16.606 INFO:teuthology.orchestra.run.smithi132.stdout:Total 670 kB/s | 971 kB 00:01 2024-05-08T18:49:16.620 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-05-08T18:49:16.644 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-05-08T18:49:16.644 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-05-08T18:49:16.728 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-05-08T18:49:16.729 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-05-08T18:49:16.833 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-05-08T18:49:16.921 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-05-08T18:49:17.018 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-08T18:49:17.065 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-08T18:49:17.082 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-08T18:49:17.129 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 2/2 2024-05-08T18:49:17.146 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-08T18:49:17.181 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-08T18:49:17.223 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-08T18:49:17.329 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-08T18:49:17.440 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-08T18:49:17.500 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-08T18:49:17.797 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 2/2 2024-05-08T18:49:17.798 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/2 2024-05-08T18:49:18.051 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-08T18:49:18.051 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:18.051 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-05-08T18:49:18.052 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-08T18:49:18.052 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:18.052 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:49:18.269 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-08T18:49:18.327 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-volume 2024-05-08T18:49:18.330 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-08T18:49:18.364 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-08T18:49:18.412 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-08T18:49:18.441 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-rook-2:19.0.0-3463.gd8e5981c.el9.noarch 13/13 2024-05-08T18:49:18.911 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:39 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:49:19.035 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:49:19.036 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:19.036 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-05-08T18:49:19.036 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:19.036 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-05-08T18:49:19.036 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 273 k 2024-05-08T18:49:19.036 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-05-08T18:49:19.036 INFO:teuthology.orchestra.run.smithi132.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T18:49:19.037 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:19.037 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-05-08T18:49:19.037 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:19.037 INFO:teuthology.orchestra.run.smithi132.stdout:Install 2 Packages 2024-05-08T18:49:19.037 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:19.037 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 350 k 2024-05-08T18:49:19.037 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 1.5 M 2024-05-08T18:49:19.037 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-05-08T18:49:19.210 INFO:teuthology.orchestra.run.smithi132.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 603 kB/s | 77 kB 00:00 2024-05-08T18:49:19.307 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3463.gd8e5981c.el9.noarch 13/13 2024-05-08T18:49:19.307 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3463.gd8e5981c.el9.noarch 1/13 2024-05-08T18:49:19.307 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-08T18:49:19.307 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-08T18:49:19.307 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-08T18:49:19.308 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-08T18:49:19.308 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-08T18:49:19.308 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-08T18:49:19.308 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-08T18:49:19.308 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-08T18:49:19.308 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-08T18:49:19.308 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-08T18:49:19.308 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-08T18:49:19.636 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-08T18:49:19.636 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:19.636 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-05-08T18:49:19.636 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:49:19.636 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T18:49:19.636 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T18:49:19.636 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T18:49:19.636 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T18:49:19.637 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T18:49:19.637 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T18:49:19.637 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T18:49:19.637 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T18:49:19.637 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T18:49:19.637 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T18:49:19.637 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T18:49:19.637 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T18:49:19.637 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:19.637 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:49:19.685 INFO:teuthology.orchestra.run.smithi132.stdout:(2/2): ceph-volume-19.0.0-3463.gd8e5981c.el9.no 452 kB/s | 273 kB 00:00 2024-05-08T18:49:19.686 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:49:19.686 INFO:teuthology.orchestra.run.smithi132.stdout:Total 539 kB/s | 350 kB 00:00 2024-05-08T18:49:19.698 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-05-08T18:49:19.708 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-05-08T18:49:19.708 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-05-08T18:49:19.739 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-05-08T18:49:19.739 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-05-08T18:49:19.880 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-05-08T18:49:19.889 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-mgr-cephadm 2024-05-08T18:49:20.068 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-05-08T18:49:20.113 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-volume-2:19.0.0-3463.gd8e5981c.el9.noarch 2/2 2024-05-08T18:49:20.129 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-volume-2:19.0.0-3463.gd8e5981c.el9.noarch 2/2 2024-05-08T18:49:20.129 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:49:20.129 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T18:49:20.129 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:20.479 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:30 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:49:20.604 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:49:20.605 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:20.605 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-05-08T18:49:20.605 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:20.605 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-05-08T18:49:20.605 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 142 k 2024-05-08T18:49:20.606 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-05-08T18:49:20.606 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T18:49:20.606 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T18:49:20.606 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T18:49:20.606 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T18:49:20.606 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T18:49:20.606 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:20.606 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-05-08T18:49:20.606 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:20.606 INFO:teuthology.orchestra.run.smithi042.stdout:Install 6 Packages 2024-05-08T18:49:20.606 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:20.607 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 7.0 M 2024-05-08T18:49:20.607 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 33 M 2024-05-08T18:49:20.607 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-05-08T18:49:20.807 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-volume-2:19.0.0-3463.gd8e5981c.el9.noarch 1/2 2024-05-08T18:49:21.151 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-05-08T18:49:21.151 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:21.151 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-05-08T18:49:21.151 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:49:21.151 INFO:teuthology.orchestra.run.smithi132.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T18:49:21.152 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:21.152 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:49:21.197 INFO:teuthology.orchestra.run.smithi042.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 2.0 MB/s | 248 kB 00:00 2024-05-08T18:49:21.444 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install librados-devel 2024-05-08T18:49:21.464 INFO:teuthology.orchestra.run.smithi042.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.2 MB/s | 548 kB 00:00 2024-05-08T18:49:21.514 INFO:teuthology.orchestra.run.smithi042.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-05-08T18:49:21.564 INFO:teuthology.orchestra.run.smithi042.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 1.0 MB/s | 51 kB 00:00 2024-05-08T18:49:21.681 INFO:teuthology.orchestra.run.smithi042.stdout:(5/6): python3-babel-2.9.1-2.el9.noarch.rpm 9.9 MB/s | 6.0 MB 00:00 2024-05-08T18:49:21.739 INFO:teuthology.orchestra.run.smithi042.stdout:(6/6): ceph-mgr-cephadm-19.0.0-3463.gd8e5981c.e 214 kB/s | 142 kB 00:00 2024-05-08T18:49:21.741 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:49:21.742 INFO:teuthology.orchestra.run.smithi042.stdout:Total 6.2 MB/s | 7.0 MB 00:01 2024-05-08T18:49:21.815 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-05-08T18:49:21.828 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-05-08T18:49:21.828 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-05-08T18:49:21.931 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-05-08T18:49:21.931 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-05-08T18:49:22.030 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:43 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:49:22.162 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:49:22.162 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:22.162 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repo Size 2024-05-08T18:49:22.163 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:22.163 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-05-08T18:49:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 127 k 2024-05-08T18:49:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:22.163 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-05-08T18:49:22.163 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:22.163 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package 2024-05-08T18:49:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:22.164 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 127 k 2024-05-08T18:49:22.164 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 456 k 2024-05-08T18:49:22.164 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-05-08T18:49:22.265 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-05-08T18:49:22.442 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-08T18:49:22.501 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-08T18:49:22.738 INFO:teuthology.orchestra.run.smithi132.stdout:librados-devel-19.0.0-3463.gd8e5981c.el9.x86_64 220 kB/s | 127 kB 00:00 2024-05-08T18:49:22.739 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:49:22.739 INFO:teuthology.orchestra.run.smithi132.stdout:Total 220 kB/s | 127 kB 00:00 2024-05-08T18:49:22.739 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-05-08T18:49:22.745 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-05-08T18:49:22.745 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-05-08T18:49:22.810 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-05-08T18:49:22.811 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-05-08T18:49:22.994 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-05-08T18:49:23.054 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-08T18:49:23.094 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librados-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:23.138 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-08T18:49:23.210 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-08T18:49:23.237 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 6/6 2024-05-08T18:49:23.539 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:23.799 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:23.799 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:23.799 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-05-08T18:49:23.799 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:49:23.799 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:23.799 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:49:24.001 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 6/6 2024-05-08T18:49:24.002 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 1/6 2024-05-08T18:49:24.002 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-08T18:49:24.002 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-08T18:49:24.002 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-08T18:49:24.002 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-08T18:49:24.056 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install libcephfs2 2024-05-08T18:49:24.276 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-08T18:49:24.277 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:24.277 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-05-08T18:49:24.277 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:49:24.277 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T18:49:24.277 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T18:49:24.277 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T18:49:24.277 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T18:49:24.277 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T18:49:24.277 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:24.277 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:49:24.525 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-fuse 2024-05-08T18:49:24.639 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:45 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:49:24.722 INFO:teuthology.orchestra.run.smithi132.stdout:Package libcephfs2-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:49:24.766 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:49:24.767 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2024-05-08T18:49:24.767 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:49:24.837 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install libcephfs-devel 2024-05-08T18:49:25.116 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:35 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:49:25.244 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:49:25.245 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:25.245 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-05-08T18:49:25.245 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:25.246 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-05-08T18:49:25.246 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 891 k 2024-05-08T18:49:25.246 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-05-08T18:49:25.246 INFO:teuthology.orchestra.run.smithi042.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T18:49:25.246 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:25.246 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-05-08T18:49:25.246 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:25.246 INFO:teuthology.orchestra.run.smithi042.stdout:Install 2 Packages 2024-05-08T18:49:25.246 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:25.246 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 971 k 2024-05-08T18:49:25.246 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 2.8 M 2024-05-08T18:49:25.246 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-05-08T18:49:25.408 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:46 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:49:25.532 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:49:25.532 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:25.532 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repo Size 2024-05-08T18:49:25.532 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:25.532 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-05-08T18:49:25.533 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 32 k 2024-05-08T18:49:25.533 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:25.533 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-05-08T18:49:25.533 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:25.533 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package 2024-05-08T18:49:25.533 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:25.533 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 32 k 2024-05-08T18:49:25.533 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 142 k 2024-05-08T18:49:25.534 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-05-08T18:49:26.034 INFO:teuthology.orchestra.run.smithi132.stdout:libcephfs-devel-19.0.0-3463.gd8e5981c.el9.x86_6 63 kB/s | 32 kB 00:00 2024-05-08T18:49:26.035 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:49:26.035 INFO:teuthology.orchestra.run.smithi132.stdout:Total 63 kB/s | 32 kB 00:00 2024-05-08T18:49:26.035 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-05-08T18:49:26.038 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-05-08T18:49:26.038 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-05-08T18:49:26.052 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-05-08T18:49:26.052 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-05-08T18:49:26.134 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-05-08T18:49:26.150 INFO:teuthology.orchestra.run.smithi042.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 105 kB/s | 80 kB 00:00 2024-05-08T18:49:26.248 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:26.267 INFO:teuthology.orchestra.run.smithi042.stdout:(2/2): ceph-fuse-19.0.0-3463.gd8e5981c.el9.x86_ 1.0 MB/s | 891 kB 00:00 2024-05-08T18:49:26.268 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:49:26.268 INFO:teuthology.orchestra.run.smithi042.stdout:Total 949 kB/s | 971 kB 00:01 2024-05-08T18:49:26.283 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-05-08T18:49:26.309 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-05-08T18:49:26.309 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-05-08T18:49:26.403 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-05-08T18:49:26.403 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-05-08T18:49:26.602 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-05-08T18:49:26.633 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:26.757 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-08T18:49:26.836 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 2/2 2024-05-08T18:49:26.855 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:26.856 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:26.856 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-05-08T18:49:26.856 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:49:26.856 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:26.856 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:49:27.044 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install librados2 2024-05-08T18:49:27.506 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 2/2 2024-05-08T18:49:27.507 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/2 2024-05-08T18:49:27.620 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:48 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:49:27.701 INFO:teuthology.orchestra.run.smithi132.stdout:Package librados2-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:49:27.743 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:49:27.744 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2024-05-08T18:49:27.744 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:49:27.760 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-08T18:49:27.760 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:27.760 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-05-08T18:49:27.760 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-08T18:49:27.760 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:27.760 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:49:27.810 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install librbd1 2024-05-08T18:49:28.082 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-volume 2024-05-08T18:49:28.379 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:49 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:49:28.459 INFO:teuthology.orchestra.run.smithi132.stdout:Package librbd1-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:49:28.500 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:49:28.501 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2024-05-08T18:49:28.501 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:49:28.567 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install python3-rados 2024-05-08T18:49:28.680 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:38 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:49:28.809 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:49:28.810 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:28.810 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-05-08T18:49:28.810 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:28.810 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-05-08T18:49:28.810 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume noarch 2:19.0.0-3463.gd8e5981c.el9 ceph-noarch 273 k 2024-05-08T18:49:28.810 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-05-08T18:49:28.810 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T18:49:28.810 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:28.810 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-05-08T18:49:28.810 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:28.811 INFO:teuthology.orchestra.run.smithi042.stdout:Install 2 Packages 2024-05-08T18:49:28.811 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:28.811 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 350 k 2024-05-08T18:49:28.811 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 1.5 M 2024-05-08T18:49:28.811 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-05-08T18:49:29.136 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:50 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:49:29.218 INFO:teuthology.orchestra.run.smithi132.stdout:Package python3-rados-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:49:29.259 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:49:29.260 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2024-05-08T18:49:29.260 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:49:29.322 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install python3-rgw 2024-05-08T18:49:29.331 INFO:teuthology.orchestra.run.smithi042.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 163 kB/s | 77 kB 00:00 2024-05-08T18:49:29.606 INFO:teuthology.orchestra.run.smithi042.stdout:(2/2): ceph-volume-19.0.0-3463.gd8e5981c.el9.no 365 kB/s | 273 kB 00:00 2024-05-08T18:49:29.606 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:49:29.607 INFO:teuthology.orchestra.run.smithi042.stdout:Total 440 kB/s | 350 kB 00:00 2024-05-08T18:49:29.620 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-05-08T18:49:29.630 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-05-08T18:49:29.631 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-05-08T18:49:29.672 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-05-08T18:49:29.673 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-05-08T18:49:29.825 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-05-08T18:49:29.896 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:50 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:49:29.976 INFO:teuthology.orchestra.run.smithi132.stdout:Package python3-rgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:49:30.019 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:49:30.020 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2024-05-08T18:49:30.020 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:49:30.021 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-05-08T18:49:30.058 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-volume-2:19.0.0-3463.gd8e5981c.el9.noarch 2/2 2024-05-08T18:49:30.075 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-volume-2:19.0.0-3463.gd8e5981c.el9.noarch 2/2 2024-05-08T18:49:30.075 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:49:30.076 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T18:49:30.076 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:30.085 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install python3-cephfs 2024-05-08T18:49:30.651 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:51 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:49:30.733 INFO:teuthology.orchestra.run.smithi132.stdout:Package python3-cephfs-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:49:30.775 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:49:30.776 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2024-05-08T18:49:30.776 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:49:30.792 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-volume-2:19.0.0-3463.gd8e5981c.el9.noarch 1/2 2024-05-08T18:49:30.843 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install python3-rbd 2024-05-08T18:49:31.084 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-05-08T18:49:31.085 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:31.085 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-05-08T18:49:31.085 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume-2:19.0.0-3463.gd8e5981c.el9.noarch 2024-05-08T18:49:31.085 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T18:49:31.085 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:31.085 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:49:31.406 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install librados-devel 2024-05-08T18:49:31.413 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:52 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:49:31.495 INFO:teuthology.orchestra.run.smithi132.stdout:Package python3-rbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:49:31.537 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:49:31.538 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2024-05-08T18:49:31.538 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:49:31.597 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install rbd-fuse 2024-05-08T18:49:32.003 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:42 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:49:32.132 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:49:32.133 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:32.133 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repo Size 2024-05-08T18:49:32.133 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:32.133 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-05-08T18:49:32.133 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 127 k 2024-05-08T18:49:32.133 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:32.133 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-05-08T18:49:32.133 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:32.134 INFO:teuthology.orchestra.run.smithi042.stdout:Install 1 Package 2024-05-08T18:49:32.134 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:32.134 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 127 k 2024-05-08T18:49:32.134 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 456 k 2024-05-08T18:49:32.134 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-05-08T18:49:32.167 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:53 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:49:32.288 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:49:32.289 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:32.289 INFO:teuthology.orchestra.run.smithi132.stdout: Package Architecture Version Repository Size 2024-05-08T18:49:32.289 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:32.289 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-05-08T18:49:32.289 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 85 k 2024-05-08T18:49:32.289 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:32.289 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-05-08T18:49:32.289 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:32.289 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package 2024-05-08T18:49:32.289 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:32.290 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 85 k 2024-05-08T18:49:32.290 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 231 k 2024-05-08T18:49:32.290 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-05-08T18:49:32.847 INFO:teuthology.orchestra.run.smithi042.stdout:librados-devel-19.0.0-3463.gd8e5981c.el9.x86_64 178 kB/s | 127 kB 00:00 2024-05-08T18:49:32.848 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:49:32.849 INFO:teuthology.orchestra.run.smithi042.stdout:Total 177 kB/s | 127 kB 00:00 2024-05-08T18:49:32.849 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-05-08T18:49:32.859 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-05-08T18:49:32.859 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-05-08T18:49:32.939 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-05-08T18:49:32.940 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-05-08T18:49:32.995 INFO:teuthology.orchestra.run.smithi132.stdout:rbd-fuse-19.0.0-3463.gd8e5981c.el9.x86_64.rpm 121 kB/s | 85 kB 00:00 2024-05-08T18:49:32.996 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:49:32.996 INFO:teuthology.orchestra.run.smithi132.stdout:Total 121 kB/s | 85 kB 00:00 2024-05-08T18:49:32.996 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-05-08T18:49:33.003 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-05-08T18:49:33.003 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-05-08T18:49:33.066 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-05-08T18:49:33.066 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-05-08T18:49:33.104 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-05-08T18:49:33.199 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librados-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:33.211 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-05-08T18:49:33.318 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:33.628 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:33.664 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:33.875 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:33.875 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:33.875 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-05-08T18:49:33.875 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:49:33.875 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:33.875 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:49:33.939 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:33.939 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:33.939 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-05-08T18:49:33.939 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:49:33.939 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:33.939 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:49:34.143 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install libcephfs2 2024-05-08T18:49:34.232 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install rbd-mirror 2024-05-08T18:49:34.745 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:44 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:49:34.809 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:01:55 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:49:34.829 INFO:teuthology.orchestra.run.smithi042.stdout:Package libcephfs2-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:49:34.876 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:49:34.877 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-05-08T18:49:34.877 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:49:34.935 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:49:34.936 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:34.936 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repo Size 2024-05-08T18:49:34.936 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:34.936 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-05-08T18:49:34.936 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 3.1 M 2024-05-08T18:49:34.936 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:34.936 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-05-08T18:49:34.936 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:34.936 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package 2024-05-08T18:49:34.936 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:34.937 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 3.1 M 2024-05-08T18:49:34.937 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 13 M 2024-05-08T18:49:34.937 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-05-08T18:49:34.946 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install libcephfs-devel 2024-05-08T18:49:35.545 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:45 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:49:35.673 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:49:35.673 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:35.673 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repo Size 2024-05-08T18:49:35.674 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:35.674 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-05-08T18:49:35.674 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 32 k 2024-05-08T18:49:35.674 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:35.674 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-05-08T18:49:35.674 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:35.674 INFO:teuthology.orchestra.run.smithi042.stdout:Install 1 Package 2024-05-08T18:49:35.674 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:35.675 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 32 k 2024-05-08T18:49:35.675 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 142 k 2024-05-08T18:49:35.675 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-05-08T18:49:36.026 INFO:teuthology.orchestra.run.smithi042.stdout:libcephfs-devel-19.0.0-3463.gd8e5981c.el9.x86_6 90 kB/s | 32 kB 00:00 2024-05-08T18:49:36.026 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:49:36.027 INFO:teuthology.orchestra.run.smithi042.stdout:Total 90 kB/s | 32 kB 00:00 2024-05-08T18:49:36.027 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-05-08T18:49:36.031 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-05-08T18:49:36.031 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-05-08T18:49:36.051 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-05-08T18:49:36.051 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-05-08T18:49:36.132 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-05-08T18:49:36.351 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:36.778 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:36.907 INFO:teuthology.orchestra.run.smithi132.stdout:rbd-mirror-19.0.0-3463.gd8e5981c.el9.x86_64.rpm 1.6 MB/s | 3.1 MB 00:01 2024-05-08T18:49:36.907 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:49:36.908 INFO:teuthology.orchestra.run.smithi132.stdout:Total 1.6 MB/s | 3.1 MB 00:01 2024-05-08T18:49:36.908 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-05-08T18:49:36.919 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-05-08T18:49:36.919 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-05-08T18:49:37.003 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-05-08T18:49:37.003 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-05-08T18:49:37.008 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:37.008 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:37.008 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-05-08T18:49:37.008 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:49:37.008 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:37.008 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:49:37.175 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install librados2 2024-05-08T18:49:37.436 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-05-08T18:49:37.491 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-mirror-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:37.516 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:37.516 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:49:37.516 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T18:49:37.516 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T18:49:37.516 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T18:49:37.516 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:37.770 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:47 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:49:37.854 INFO:teuthology.orchestra.run.smithi042.stdout:Package librados2-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:49:37.897 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:49:37.898 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-05-08T18:49:37.898 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:49:37.971 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install librbd1 2024-05-08T18:49:38.566 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:48 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:49:38.649 INFO:teuthology.orchestra.run.smithi042.stdout:Package librbd1-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:49:38.664 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-mirror-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:38.664 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:38.664 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-05-08T18:49:38.664 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:49:38.664 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:38.665 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:49:38.693 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:49:38.694 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-05-08T18:49:38.694 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:49:38.762 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install python3-rados 2024-05-08T18:49:38.877 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install rbd-nbd 2024-05-08T18:49:39.362 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:49 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:49:39.446 INFO:teuthology.orchestra.run.smithi042.stdout:Package python3-rados-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:49:39.452 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:02:00 ago on Wed 08 May 2024 06:47:39 PM UTC. 2024-05-08T18:49:39.489 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:49:39.490 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-05-08T18:49:39.491 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:49:39.563 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install python3-rgw 2024-05-08T18:49:39.574 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T18:49:39.574 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:39.575 INFO:teuthology.orchestra.run.smithi132.stdout: Package Architecture Version Repository Size 2024-05-08T18:49:39.575 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:39.575 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-05-08T18:49:39.575 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 171 k 2024-05-08T18:49:39.575 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:39.575 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-05-08T18:49:39.575 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T18:49:39.575 INFO:teuthology.orchestra.run.smithi132.stdout:Install 1 Package 2024-05-08T18:49:39.575 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:39.576 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 171 k 2024-05-08T18:49:39.576 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 494 k 2024-05-08T18:49:39.576 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-05-08T18:49:40.158 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:50 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:49:40.242 INFO:teuthology.orchestra.run.smithi042.stdout:Package python3-rgw-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:49:40.286 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:49:40.287 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-05-08T18:49:40.288 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:49:40.353 INFO:teuthology.orchestra.run.smithi132.stdout:rbd-nbd-19.0.0-3463.gd8e5981c.el9.x86_64.rpm 220 kB/s | 171 kB 00:00 2024-05-08T18:49:40.353 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:49:40.354 INFO:teuthology.orchestra.run.smithi132.stdout:Total 219 kB/s | 171 kB 00:00 2024-05-08T18:49:40.354 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-05-08T18:49:40.362 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-05-08T18:49:40.362 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-05-08T18:49:40.366 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install python3-cephfs 2024-05-08T18:49:40.427 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-05-08T18:49:40.427 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-05-08T18:49:40.580 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-05-08T18:49:40.684 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-nbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:40.957 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:50 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:49:41.041 INFO:teuthology.orchestra.run.smithi042.stdout:Package python3-cephfs-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:49:41.083 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:41.086 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:49:41.087 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-05-08T18:49:41.087 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:49:41.144 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install python3-rbd 2024-05-08T18:49:41.338 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-nbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:41.338 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:41.338 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-05-08T18:49:41.338 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:49:41.338 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:41.338 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T18:49:41.566 DEBUG:teuthology.parallel:result is None 2024-05-08T18:49:41.741 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:51 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:49:41.825 INFO:teuthology.orchestra.run.smithi042.stdout:Package python3-rbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 is already installed. 2024-05-08T18:49:41.869 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:49:41.870 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2024-05-08T18:49:41.870 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:49:41.954 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install rbd-fuse 2024-05-08T18:49:42.545 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:52 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:49:42.672 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:49:42.672 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:42.672 INFO:teuthology.orchestra.run.smithi042.stdout: Package Architecture Version Repository Size 2024-05-08T18:49:42.672 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:42.672 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-05-08T18:49:42.673 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 85 k 2024-05-08T18:49:42.673 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:42.673 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-05-08T18:49:42.673 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:42.673 INFO:teuthology.orchestra.run.smithi042.stdout:Install 1 Package 2024-05-08T18:49:42.673 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:42.673 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 85 k 2024-05-08T18:49:42.674 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 231 k 2024-05-08T18:49:42.674 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-05-08T18:49:43.046 INFO:teuthology.orchestra.run.smithi042.stdout:rbd-fuse-19.0.0-3463.gd8e5981c.el9.x86_64.rpm 229 kB/s | 85 kB 00:00 2024-05-08T18:49:43.047 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:49:43.047 INFO:teuthology.orchestra.run.smithi042.stdout:Total 228 kB/s | 85 kB 00:00 2024-05-08T18:49:43.047 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-05-08T18:49:43.055 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-05-08T18:49:43.055 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-05-08T18:49:43.122 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-05-08T18:49:43.122 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-05-08T18:49:43.299 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-05-08T18:49:43.407 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:43.796 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:44.042 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:44.042 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:44.042 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-05-08T18:49:44.042 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:49:44.042 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:44.042 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:49:44.264 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install rbd-mirror 2024-05-08T18:49:44.863 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:54 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:49:44.992 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:49:44.992 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:44.993 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repo Size 2024-05-08T18:49:44.993 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:44.993 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-05-08T18:49:44.993 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 3.1 M 2024-05-08T18:49:44.993 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:44.993 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-05-08T18:49:44.993 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:44.993 INFO:teuthology.orchestra.run.smithi042.stdout:Install 1 Package 2024-05-08T18:49:44.993 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:44.994 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 3.1 M 2024-05-08T18:49:44.994 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 13 M 2024-05-08T18:49:44.994 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-05-08T18:49:45.699 INFO:teuthology.orchestra.run.smithi042.stdout:rbd-mirror-19.0.0-3463.gd8e5981c.el9.x86_64.rpm 4.4 MB/s | 3.1 MB 00:00 2024-05-08T18:49:45.700 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:49:45.700 INFO:teuthology.orchestra.run.smithi042.stdout:Total 4.4 MB/s | 3.1 MB 00:00 2024-05-08T18:49:45.700 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-05-08T18:49:45.712 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-05-08T18:49:45.712 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-05-08T18:49:45.799 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-05-08T18:49:45.800 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-05-08T18:49:46.248 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-05-08T18:49:46.316 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-mirror-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:46.344 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:46.344 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T18:49:46.344 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T18:49:46.344 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T18:49:46.344 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T18:49:46.344 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-mirror-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:47.434 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:47.435 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-05-08T18:49:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:49:47.435 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:47.435 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:49:47.696 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install rbd-nbd 2024-05-08T18:49:48.294 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:01:58 ago on Wed 08 May 2024 06:47:50 PM UTC. 2024-05-08T18:49:48.422 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-05-08T18:49:48.422 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:48.422 INFO:teuthology.orchestra.run.smithi042.stdout: Package Architecture Version Repository Size 2024-05-08T18:49:48.422 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:48.422 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-05-08T18:49:48.422 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd x86_64 2:19.0.0-3463.gd8e5981c.el9 ceph 171 k 2024-05-08T18:49:48.423 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:48.423 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-05-08T18:49:48.423 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-05-08T18:49:48.423 INFO:teuthology.orchestra.run.smithi042.stdout:Install 1 Package 2024-05-08T18:49:48.423 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:48.423 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 171 k 2024-05-08T18:49:48.423 INFO:teuthology.orchestra.run.smithi042.stdout:Installed size: 494 k 2024-05-08T18:49:48.424 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-05-08T18:49:48.786 INFO:teuthology.orchestra.run.smithi042.stdout:rbd-nbd-19.0.0-3463.gd8e5981c.el9.x86_64.rpm 471 kB/s | 171 kB 00:00 2024-05-08T18:49:48.787 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-05-08T18:49:48.787 INFO:teuthology.orchestra.run.smithi042.stdout:Total 469 kB/s | 171 kB 00:00 2024-05-08T18:49:48.787 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-05-08T18:49:48.796 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-05-08T18:49:48.796 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-05-08T18:49:48.864 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-05-08T18:49:48.864 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-05-08T18:49:49.024 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-05-08T18:49:49.121 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-nbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:49.545 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:49.823 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-nbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 1/1 2024-05-08T18:49:49.823 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:49.824 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-05-08T18:49:49.824 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd-2:19.0.0-3463.gd8e5981c.el9.x86_64 2024-05-08T18:49:49.824 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:49.824 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-05-08T18:49:50.083 DEBUG:teuthology.parallel:result is None 2024-05-08T18:49:50.083 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d8e5981c6605c876b5b6ba50848d5d2454dc9bd0 2024-05-08T18:49:50.223 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T18:49:50.245 INFO:teuthology.orchestra.run.smithi042.stdout:19.0.0-3463.gd8e5981c.el9 2024-05-08T18:49:50.245 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3463.gd8e5981c.el9 2024-05-08T18:49:50.246 INFO:teuthology.task.install:The correct ceph version 19.0.0-3463.gd8e5981c is installed. 2024-05-08T18:49:50.247 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d8e5981c6605c876b5b6ba50848d5d2454dc9bd0 2024-05-08T18:49:50.385 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T18:49:50.412 INFO:teuthology.orchestra.run.smithi132.stdout:19.0.0-3463.gd8e5981c.el9 2024-05-08T18:49:50.412 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3463.gd8e5981c.el9 2024-05-08T18:49:50.412 INFO:teuthology.task.install:The correct ceph version 19.0.0-3463.gd8e5981c is installed. 2024-05-08T18:49:50.414 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T18:49:50.414 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-08T18:49:50.414 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T18:49:50.440 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T18:49:50.441 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T18:49:50.482 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T18:49:50.482 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-08T18:49:50.483 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T18:49:50.508 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T18:49:50.574 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T18:49:50.574 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T18:49:50.602 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T18:49:50.669 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T18:49:50.669 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-08T18:49:50.669 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T18:49:50.695 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T18:49:50.761 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T18:49:50.761 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T18:49:50.788 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T18:49:50.855 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T18:49:50.855 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-08T18:49:50.856 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T18:49:50.881 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T18:49:50.947 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T18:49:50.947 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T18:49:50.971 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T18:49:51.037 INFO:teuthology.run_tasks:Running task ceph... 2024-05-08T18:49:51.126 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-08T18:49:51.126 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 777 /var/log/ceph 2024-05-08T18:49:51.129 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 777 /var/log/ceph 2024-05-08T18:49:51.153 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-08T18:49:51.154 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T18:49:51.195 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T18:49:51.228 INFO:tasks.ceph:Creating extra log directories... 2024-05-08T18:49:51.228 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T18:49:51.261 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T18:49:51.301 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-08T18:49:51.301 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-08T18:49:51.301 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697938', 'branch': 'wip-upgrade-arrow-15', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}}', 'email': 'ivancich@redhat.com', 'first_in_suite': False, 'job_id': '7697938', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-upgrade-arrow-15'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'd8e5981c6605c876b5b6ba50848d5d2454dc9bd0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd8e5981c6605c876b5b6ba50848d5d2454dc9bd0'}}, 'rgw': {'ec-data-pool': False, 'frontend': 'beast'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-upgrade-arrow-15', 'sha1': 'd8e5981c6605c876b5b6ba50848d5d2454dc9bd0'}}, 'owner': 'scheduled_ivancich@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 831, 'sha1': 'd8e5981c6605c876b5b6ba50848d5d2454dc9bd0', 'sleep_before_teardown': 0, 'subset': '1/50', 'suite': 'rgw', 'suite_branch': 'wip-upgrade-arrow-15', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d8e5981c6605c876b5b6ba50848d5d2454dc9bd0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd8e5981c6605c876b5b6ba50848d5d2454dc9bd0', 'targets': {'smithi042.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKD5O6Pe6cpnNxjd3G21auPflEkahkFX3Ea3sP2pmO29wLeYsnc1kNkynjvQIadQKDV7IhQAn5N0Nx3mrVR+Lvk=', 'smithi132.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCgb0cOKXM4ZPx3uhO2Z5XiLjokewFtlAXEgs14mr3X6gM7h0wbRO0rc5Hszpwt4A/R44KxDSq0dWeJFbw1darE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'd8e5981c6605c876b5b6ba50848d5d2454dc9bd0', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-08_17:44:56', 'tube': 'smithi', 'user': 'ivancich', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-08T18:49:51.301 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T18:49:51.327 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T18:49:51.349 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T18:49:51.383 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T18:49:51.414 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-08T18:49:51.414 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T18:49:51.462 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T18:49:51.462 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_1 2024-05-08T18:49:51.519 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T18:49:51.519 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:49:51.519 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-08T18:49:51.519 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:49:51.519 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T18:49:51.519 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-05-08 18:49:46.591898050 +0000 2024-05-08T18:49:51.519 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-05-08 18:46:54.165234761 +0000 2024-05-08T18:49:51.519 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-05-08 18:46:54.165234761 +0000 2024-05-08T18:49:51.519 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-05-08 18:46:54.165234761 +0000 2024-05-08T18:49:51.520 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T18:49:51.582 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-05-08T18:49:51.582 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-05-08T18:49:51.582 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 9.7177e-05 s, 5.3 MB/s 2024-05-08T18:49:51.583 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T18:49:51.640 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_2 2024-05-08T18:49:51.696 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T18:49:51.696 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:49:51.696 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-08T18:49:51.696 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:49:51.696 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T18:49:51.697 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-05-08 18:49:46.591898050 +0000 2024-05-08T18:49:51.697 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-05-08 18:46:54.509232024 +0000 2024-05-08T18:49:51.697 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-05-08 18:46:54.509232024 +0000 2024-05-08T18:49:51.697 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-05-08 18:46:54.509232024 +0000 2024-05-08T18:49:51.697 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T18:49:51.760 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-05-08T18:49:51.760 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-05-08T18:49:51.760 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 9.9649e-05 s, 5.1 MB/s 2024-05-08T18:49:51.762 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T18:49:51.818 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_3 2024-05-08T18:49:51.874 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T18:49:51.875 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:49:51.875 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-08T18:49:51.875 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:49:51.875 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T18:49:51.875 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-05-08 18:49:46.592898042 +0000 2024-05-08T18:49:51.875 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-05-08 18:46:54.851229303 +0000 2024-05-08T18:49:51.875 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-05-08 18:46:54.851229303 +0000 2024-05-08T18:49:51.875 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-05-08 18:46:54.851229303 +0000 2024-05-08T18:49:51.875 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T18:49:51.938 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-05-08T18:49:51.938 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-05-08T18:49:51.938 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000100004 s, 5.1 MB/s 2024-05-08T18:49:51.939 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T18:49:51.996 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_4 2024-05-08T18:49:52.052 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T18:49:52.052 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:49:52.052 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-05-08T18:49:52.053 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:49:52.053 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T18:49:52.053 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-05-08 18:49:46.592898042 +0000 2024-05-08T18:49:52.053 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-05-08 18:46:55.203226503 +0000 2024-05-08T18:49:52.053 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-05-08 18:46:55.203226503 +0000 2024-05-08T18:49:52.053 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-05-08 18:46:55.203226503 +0000 2024-05-08T18:49:52.053 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T18:49:52.118 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-05-08T18:49:52.118 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-05-08T18:49:52.118 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.00010055 s, 5.1 MB/s 2024-05-08T18:49:52.119 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T18:49:52.176 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-05-08T18:49:52.176 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T18:49:52.177 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T18:49:52.194 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T18:49:52.194 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_1 2024-05-08T18:49:52.250 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T18:49:52.250 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:49:52.250 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-05-08T18:49:52.250 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:49:52.250 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T18:49:52.250 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-05-08 18:49:37.781645938 +0000 2024-05-08T18:49:52.250 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-05-08 18:46:47.470940991 +0000 2024-05-08T18:49:52.250 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-05-08 18:46:47.470940991 +0000 2024-05-08T18:49:52.250 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-05-08 18:46:47.470940991 +0000 2024-05-08T18:49:52.251 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T18:49:52.313 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-05-08T18:49:52.314 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-05-08T18:49:52.314 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000280833 s, 1.8 MB/s 2024-05-08T18:49:52.315 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T18:49:52.371 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_2 2024-05-08T18:49:52.427 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T18:49:52.428 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:49:52.428 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-05-08T18:49:52.428 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:49:52.428 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T18:49:52.428 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-05-08 18:49:37.782645912 +0000 2024-05-08T18:49:52.428 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-05-08 18:46:47.803932167 +0000 2024-05-08T18:49:52.428 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-05-08 18:46:47.803932167 +0000 2024-05-08T18:49:52.428 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-05-08 18:46:47.803932167 +0000 2024-05-08T18:49:52.428 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T18:49:52.491 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-05-08T18:49:52.491 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-05-08T18:49:52.491 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000213167 s, 2.4 MB/s 2024-05-08T18:49:52.493 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T18:49:52.549 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_3 2024-05-08T18:49:52.604 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T18:49:52.604 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:49:52.604 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-05-08T18:49:52.604 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:49:52.604 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T18:49:52.604 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-05-08 18:49:37.782645912 +0000 2024-05-08T18:49:52.604 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-05-08 18:46:48.149922999 +0000 2024-05-08T18:49:52.605 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-05-08 18:46:48.149922999 +0000 2024-05-08T18:49:52.605 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-05-08 18:46:48.149922999 +0000 2024-05-08T18:49:52.605 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T18:49:52.667 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-05-08T18:49:52.668 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-05-08T18:49:52.668 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000184464 s, 2.8 MB/s 2024-05-08T18:49:52.669 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T18:49:52.725 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_4 2024-05-08T18:49:52.780 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T18:49:52.780 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:49:52.780 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-05-08T18:49:52.780 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:49:52.780 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T18:49:52.780 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-05-08 18:49:37.783645886 +0000 2024-05-08T18:49:52.780 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-05-08 18:46:48.482914174 +0000 2024-05-08T18:49:52.780 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-05-08 18:46:48.482914174 +0000 2024-05-08T18:49:52.781 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-05-08 18:46:48.482914174 +0000 2024-05-08T18:49:52.781 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T18:49:52.843 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-05-08T18:49:52.843 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-05-08T18:49:52.843 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000172188 s, 3.0 MB/s 2024-05-08T18:49:52.844 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T18:49:52.900 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-08T18:49:52.900 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-05-08T18:49:52.900 INFO:tasks.ceph:Generating config... 2024-05-08T18:49:52.901 INFO:tasks.ceph:[client] debug ms = 1 2024-05-08T18:49:52.901 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-05-08T18:49:52.901 INFO:tasks.ceph:[client] debug rgw = 20 2024-05-08T18:49:52.901 INFO:tasks.ceph:[client] setgroup = ceph 2024-05-08T18:49:52.901 INFO:tasks.ceph:[client] setuser = ceph 2024-05-08T18:49:52.901 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-08T18:49:52.902 INFO:tasks.ceph:[osd] debug objclass = 20 2024-05-08T18:49:52.902 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-08T18:49:52.902 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-08T18:49:52.902 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-08T18:49:52.902 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-08T18:49:52.902 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-08T18:49:52.902 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-08T18:49:52.902 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-08T18:49:52.902 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-08T18:49:52.902 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-08T18:49:52.902 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-08T18:49:52.902 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-08T18:49:52.903 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-08T18:49:52.903 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-08T18:49:52.903 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-08T18:49:52.903 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-08T18:49:52.903 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-08T18:49:52.903 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-08T18:49:52.903 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-08T18:49:52.903 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-08T18:49:52.904 INFO:tasks.ceph:Setting up mon.a... 2024-05-08T18:49:52.904 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-08T18:49:52.957 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.keyring 2024-05-08T18:49:52.960 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-08T18:49:53.005 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T18:49:53.030 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.42')] 2024-05-08T18:49:53.031 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.42'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-05-08T18:49:53.031 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-08T18:49:53.032 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T18:49:53.087 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.42 --print /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:49:53.168 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:49:53.168 INFO:teuthology.orchestra.run.smithi042.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:49:53.169 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:49:53.169 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: generated fsid 772ec65a-301b-4446-89ae-86d9bcfb0a5c 2024-05-08T18:49:53.169 INFO:teuthology.orchestra.run.smithi042.stdout:setting min_mon_release = quincy 2024-05-08T18:49:53.169 INFO:teuthology.orchestra.run.smithi042.stdout:epoch 0 2024-05-08T18:49:53.169 INFO:teuthology.orchestra.run.smithi042.stdout:fsid 772ec65a-301b-4446-89ae-86d9bcfb0a5c 2024-05-08T18:49:53.170 INFO:teuthology.orchestra.run.smithi042.stdout:last_changed 2024-05-08T18:49:53.171167+0000 2024-05-08T18:49:53.170 INFO:teuthology.orchestra.run.smithi042.stdout:created 2024-05-08T18:49:53.171167+0000 2024-05-08T18:49:53.170 INFO:teuthology.orchestra.run.smithi042.stdout:min_mon_release 17 (quincy) 2024-05-08T18:49:53.170 INFO:teuthology.orchestra.run.smithi042.stdout:election_strategy: 1 2024-05-08T18:49:53.170 INFO:teuthology.orchestra.run.smithi042.stdout:0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2024-05-08T18:49:53.170 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-05-08T18:49:53.171 DEBUG:teuthology.orchestra.run.smithi042:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T18:49:53.226 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 772ec65a-301b-4446-89ae-86d9bcfb0a5c... 2024-05-08T18:49:53.227 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T18:49:53.269 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T18:49:53.311 INFO:teuthology.orchestra.run.smithi042.stdout:[global] 2024-05-08T18:49:53.311 INFO:teuthology.orchestra.run.smithi042.stdout: chdir = "" 2024-05-08T18:49:53.311 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T18:49:53.311 INFO:teuthology.orchestra.run.smithi042.stdout: auth supported = cephx 2024-05-08T18:49:53.311 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.312 INFO:teuthology.orchestra.run.smithi042.stdout: filestore xattr use omap = true 2024-05-08T18:49:53.312 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.312 INFO:teuthology.orchestra.run.smithi042.stdout: mon clock drift allowed = 1.000 2024-05-08T18:49:53.312 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.312 INFO:teuthology.orchestra.run.smithi042.stdout: osd crush chooseleaf type = 0 2024-05-08T18:49:53.312 INFO:teuthology.orchestra.run.smithi042.stdout: auth debug = true 2024-05-08T18:49:53.312 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.312 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on old message = true 2024-05-08T18:49:53.312 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on bug = true 2024-05-08T18:49:53.312 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.312 INFO:teuthology.orchestra.run.smithi042.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T18:49:53.312 INFO:teuthology.orchestra.run.smithi042.stdout: mon pg warn max object skew = 0 2024-05-08T18:49:53.313 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.313 INFO:teuthology.orchestra.run.smithi042.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T18:49:53.313 INFO:teuthology.orchestra.run.smithi042.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T18:49:53.313 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.313 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default size = 2 2024-05-08T18:49:53.313 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.313 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow primary affinity = true 2024-05-08T18:49:53.313 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow pg remap = true 2024-05-08T18:49:53.313 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on legacy crush tunables = false 2024-05-08T18:49:53.313 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on crush straw calc version zero = false 2024-05-08T18:49:53.313 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on no sortbitwise = false 2024-05-08T18:49:53.314 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on osd down out interval zero = false 2024-05-08T18:49:53.314 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on too few osds = false 2024-05-08T18:49:53.314 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T18:49:53.314 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T18:49:53.314 INFO:teuthology.orchestra.run.smithi042.stdout: mon_allow_pool_size_one = true 2024-05-08T18:49:53.314 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.314 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T18:49:53.314 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.314 INFO:teuthology.orchestra.run.smithi042.stdout: osd default data pool replay window = 5 2024-05-08T18:49:53.314 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.314 INFO:teuthology.orchestra.run.smithi042.stdout: mon allow pool delete = true 2024-05-08T18:49:53.314 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.314 INFO:teuthology.orchestra.run.smithi042.stdout: mon cluster log file level = debug 2024-05-08T18:49:53.315 INFO:teuthology.orchestra.run.smithi042.stdout: debug asserts on shutdown = true 2024-05-08T18:49:53.315 INFO:teuthology.orchestra.run.smithi042.stdout: mon health detail to clog = false 2024-05-08T18:49:53.315 INFO:teuthology.orchestra.run.smithi042.stdout: mon host = 172.21.15.42 2024-05-08T18:49:53.315 INFO:teuthology.orchestra.run.smithi042.stdout: fsid = 772ec65a-301b-4446-89ae-86d9bcfb0a5c 2024-05-08T18:49:53.318 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.318 INFO:teuthology.orchestra.run.smithi042.stdout:[osd] 2024-05-08T18:49:53.318 INFO:teuthology.orchestra.run.smithi042.stdout: osd journal size = 100 2024-05-08T18:49:53.318 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.318 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub load threshold = 5.0 2024-05-08T18:49:53.318 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub max interval = 600 2024-05-08T18:49:53.318 INFO:teuthology.orchestra.run.smithi042.stdout: osd mclock profile = high_recovery_ops 2024-05-08T18:49:53.318 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: osd recover clone overlap = true 2024-05-08T18:49:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: osd recovery max chunk = 1048576 2024-05-08T18:49:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug shutdown = true 2024-05-08T18:49:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug op order = true 2024-05-08T18:49:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug verify stray on activate = true 2024-05-08T18:49:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug trim objects = true 2024-05-08T18:49:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: osd open classes on start = true 2024-05-08T18:49:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug pg log writeout = true 2024-05-08T18:49:53.319 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.320 INFO:teuthology.orchestra.run.smithi042.stdout: osd deep scrub update digest min age = 30 2024-05-08T18:49:53.320 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.320 INFO:teuthology.orchestra.run.smithi042.stdout: osd map max advance = 10 2024-05-08T18:49:53.320 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.320 INFO:teuthology.orchestra.run.smithi042.stdout: journal zero on create = true 2024-05-08T18:49:53.320 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.320 INFO:teuthology.orchestra.run.smithi042.stdout: filestore ondisk finisher threads = 3 2024-05-08T18:49:53.320 INFO:teuthology.orchestra.run.smithi042.stdout: filestore apply finisher threads = 3 2024-05-08T18:49:53.320 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.320 INFO:teuthology.orchestra.run.smithi042.stdout: bdev debug aio = true 2024-05-08T18:49:53.320 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug misdirected ops = true 2024-05-08T18:49:53.320 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-05-08T18:49:53.320 INFO:teuthology.orchestra.run.smithi042.stdout: debug objclass = 20 2024-05-08T18:49:53.321 INFO:teuthology.orchestra.run.smithi042.stdout: bdev async discard = True 2024-05-08T18:49:53.321 INFO:teuthology.orchestra.run.smithi042.stdout: bdev enable discard = True 2024-05-08T18:49:53.321 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore allocator = bitmap 2024-05-08T18:49:53.321 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore block size = 96636764160 2024-05-08T18:49:53.321 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore fsck on mount = True 2024-05-08T18:49:53.321 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluefs = 1/20 2024-05-08T18:49:53.321 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluestore = 1/20 2024-05-08T18:49:53.321 INFO:teuthology.orchestra.run.smithi042.stdout: debug osd = 20 2024-05-08T18:49:53.321 INFO:teuthology.orchestra.run.smithi042.stdout: debug rocksdb = 4/10 2024-05-08T18:49:53.321 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T18:49:53.322 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd full ratio = 0.9 2024-05-08T18:49:53.322 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd nearfull ratio = 0.8 2024-05-08T18:49:53.322 INFO:teuthology.orchestra.run.smithi042.stdout: osd failsafe full ratio = 0.95 2024-05-08T18:49:53.322 INFO:teuthology.orchestra.run.smithi042.stdout: osd objectstore = bluestore 2024-05-08T18:49:53.322 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.322 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr] 2024-05-08T18:49:53.322 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-05-08T18:49:53.322 INFO:teuthology.orchestra.run.smithi042.stdout: debug mgr = 20 2024-05-08T18:49:53.322 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-05-08T18:49:53.322 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-05-08T18:49:53.323 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-05-08T18:49:53.323 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-05-08T18:49:53.323 INFO:teuthology.orchestra.run.smithi042.stdout: mgr/telemetry/nag = false 2024-05-08T18:49:53.323 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.323 INFO:teuthology.orchestra.run.smithi042.stdout:[mon] 2024-05-08T18:49:53.323 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-05-08T18:49:53.323 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-05-08T18:49:53.323 INFO:teuthology.orchestra.run.smithi042.stdout: debug paxos = 20 2024-05-08T18:49:53.323 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-05-08T18:49:53.323 INFO:teuthology.orchestra.run.smithi042.stdout: mon data avail warn = 5 2024-05-08T18:49:53.323 INFO:teuthology.orchestra.run.smithi042.stdout: mon mgr mkfs grace = 240 2024-05-08T18:49:53.323 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-05-08T18:49:53.323 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd reporter subtree level = osd 2024-05-08T18:49:53.323 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd prime pg temp = true 2024-05-08T18:49:53.324 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-05-08T18:49:53.324 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.324 INFO:teuthology.orchestra.run.smithi042.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T18:49:53.324 INFO:teuthology.orchestra.run.smithi042.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T18:49:53.324 INFO:teuthology.orchestra.run.smithi042.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T18:49:53.324 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.324 INFO:teuthology.orchestra.run.smithi042.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T18:49:53.324 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T18:49:53.324 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T18:49:53.324 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.325 INFO:teuthology.orchestra.run.smithi042.stdout: # 1m isn't quite enough 2024-05-08T18:49:53.325 INFO:teuthology.orchestra.run.smithi042.stdout: mon_down_mkfs_grace = 2m 2024-05-08T18:49:53.325 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.325 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_filestore_osds = false 2024-05-08T18:49:53.325 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:49:53.325 INFO:teuthology.orchestra.run.smithi042.stdout:[client] 2024-05-08T18:49:53.325 INFO:teuthology.orchestra.run.smithi042.stdout: rgw cache enabled = true 2024-05-08T18:49:53.325 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable ops log = true 2024-05-08T18:49:53.325 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable usage log = true 2024-05-08T18:49:53.325 INFO:teuthology.orchestra.run.smithi042.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T18:49:53.326 INFO:teuthology.orchestra.run.smithi042.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T18:49:53.326 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-05-08T18:49:53.326 INFO:teuthology.orchestra.run.smithi042.stdout: rgw gc obj min wait = 15 2024-05-08T18:49:53.326 INFO:teuthology.orchestra.run.smithi042.stdout: debug rgw = 20 2024-05-08T18:49:53.326 INFO:teuthology.orchestra.run.smithi042.stdout: setgroup = ceph 2024-05-08T18:49:53.326 INFO:teuthology.orchestra.run.smithi042.stdout: setuser = ceph 2024-05-08T18:49:53.326 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.a] 2024-05-08T18:49:53.328 INFO:teuthology.orchestra.run.smithi132.stdout:[global] 2024-05-08T18:49:53.328 INFO:teuthology.orchestra.run.smithi132.stdout: chdir = "" 2024-05-08T18:49:53.328 INFO:teuthology.orchestra.run.smithi132.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T18:49:53.328 INFO:teuthology.orchestra.run.smithi132.stdout: auth supported = cephx 2024-05-08T18:49:53.328 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.328 INFO:teuthology.orchestra.run.smithi132.stdout: filestore xattr use omap = true 2024-05-08T18:49:53.329 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.329 INFO:teuthology.orchestra.run.smithi132.stdout: mon clock drift allowed = 1.000 2024-05-08T18:49:53.329 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.329 INFO:teuthology.orchestra.run.smithi132.stdout: osd crush chooseleaf type = 0 2024-05-08T18:49:53.329 INFO:teuthology.orchestra.run.smithi132.stdout: auth debug = true 2024-05-08T18:49:53.329 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.329 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on old message = true 2024-05-08T18:49:53.329 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on bug = true 2024-05-08T18:49:53.329 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.329 INFO:teuthology.orchestra.run.smithi132.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T18:49:53.329 INFO:teuthology.orchestra.run.smithi132.stdout: mon pg warn max object skew = 0 2024-05-08T18:49:53.329 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.330 INFO:teuthology.orchestra.run.smithi132.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T18:49:53.330 INFO:teuthology.orchestra.run.smithi132.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T18:49:53.330 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.330 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default size = 2 2024-05-08T18:49:53.330 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.330 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow primary affinity = true 2024-05-08T18:49:53.330 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow pg remap = true 2024-05-08T18:49:53.330 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on legacy crush tunables = false 2024-05-08T18:49:53.330 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on crush straw calc version zero = false 2024-05-08T18:49:53.331 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on no sortbitwise = false 2024-05-08T18:49:53.331 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on osd down out interval zero = false 2024-05-08T18:49:53.331 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on too few osds = false 2024-05-08T18:49:53.331 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T18:49:53.331 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T18:49:53.331 INFO:teuthology.orchestra.run.smithi132.stdout: mon_allow_pool_size_one = true 2024-05-08T18:49:53.331 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.331 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T18:49:53.331 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.331 INFO:teuthology.orchestra.run.smithi132.stdout: osd default data pool replay window = 5 2024-05-08T18:49:53.331 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.332 INFO:teuthology.orchestra.run.smithi132.stdout: mon allow pool delete = true 2024-05-08T18:49:53.332 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.332 INFO:teuthology.orchestra.run.smithi132.stdout: mon cluster log file level = debug 2024-05-08T18:49:53.332 INFO:teuthology.orchestra.run.smithi132.stdout: debug asserts on shutdown = true 2024-05-08T18:49:53.332 INFO:teuthology.orchestra.run.smithi132.stdout: mon health detail to clog = false 2024-05-08T18:49:53.332 INFO:teuthology.orchestra.run.smithi132.stdout: mon host = 172.21.15.42 2024-05-08T18:49:53.332 INFO:teuthology.orchestra.run.smithi132.stdout: fsid = 772ec65a-301b-4446-89ae-86d9bcfb0a5c 2024-05-08T18:49:53.332 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.332 INFO:teuthology.orchestra.run.smithi132.stdout:[osd] 2024-05-08T18:49:53.332 INFO:teuthology.orchestra.run.smithi132.stdout: osd journal size = 100 2024-05-08T18:49:53.332 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.332 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub load threshold = 5.0 2024-05-08T18:49:53.333 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub max interval = 600 2024-05-08T18:49:53.333 INFO:teuthology.orchestra.run.smithi132.stdout: osd mclock profile = high_recovery_ops 2024-05-08T18:49:53.333 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.333 INFO:teuthology.orchestra.run.smithi132.stdout: osd recover clone overlap = true 2024-05-08T18:49:53.333 INFO:teuthology.orchestra.run.smithi132.stdout: osd recovery max chunk = 1048576 2024-05-08T18:49:53.333 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.333 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug shutdown = true 2024-05-08T18:49:53.333 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug op order = true 2024-05-08T18:49:53.333 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug verify stray on activate = true 2024-05-08T18:49:53.333 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug trim objects = true 2024-05-08T18:49:53.333 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.333 INFO:teuthology.orchestra.run.smithi132.stdout: osd open classes on start = true 2024-05-08T18:49:53.334 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug pg log writeout = true 2024-05-08T18:49:53.334 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.334 INFO:teuthology.orchestra.run.smithi132.stdout: osd deep scrub update digest min age = 30 2024-05-08T18:49:53.334 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.334 INFO:teuthology.orchestra.run.smithi132.stdout: osd map max advance = 10 2024-05-08T18:49:53.334 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.334 INFO:teuthology.orchestra.run.smithi132.stdout: journal zero on create = true 2024-05-08T18:49:53.334 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.334 INFO:teuthology.orchestra.run.smithi132.stdout: filestore ondisk finisher threads = 3 2024-05-08T18:49:53.334 INFO:teuthology.orchestra.run.smithi132.stdout: filestore apply finisher threads = 3 2024-05-08T18:49:53.334 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.334 INFO:teuthology.orchestra.run.smithi132.stdout: bdev debug aio = true 2024-05-08T18:49:53.335 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug misdirected ops = true 2024-05-08T18:49:53.335 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-05-08T18:49:53.335 INFO:teuthology.orchestra.run.smithi132.stdout: debug objclass = 20 2024-05-08T18:49:53.335 INFO:teuthology.orchestra.run.smithi132.stdout: bdev async discard = True 2024-05-08T18:49:53.335 INFO:teuthology.orchestra.run.smithi132.stdout: bdev enable discard = True 2024-05-08T18:49:53.335 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore allocator = bitmap 2024-05-08T18:49:53.335 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore block size = 96636764160 2024-05-08T18:49:53.335 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore fsck on mount = True 2024-05-08T18:49:53.335 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluefs = 1/20 2024-05-08T18:49:53.335 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluestore = 1/20 2024-05-08T18:49:53.335 INFO:teuthology.orchestra.run.smithi132.stdout: debug osd = 20 2024-05-08T18:49:53.336 INFO:teuthology.orchestra.run.smithi132.stdout: debug rocksdb = 4/10 2024-05-08T18:49:53.336 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T18:49:53.336 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd full ratio = 0.9 2024-05-08T18:49:53.336 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd nearfull ratio = 0.8 2024-05-08T18:49:53.336 INFO:teuthology.orchestra.run.smithi132.stdout: osd failsafe full ratio = 0.95 2024-05-08T18:49:53.336 INFO:teuthology.orchestra.run.smithi132.stdout: osd objectstore = bluestore 2024-05-08T18:49:53.336 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.336 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr] 2024-05-08T18:49:53.336 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-05-08T18:49:53.337 INFO:teuthology.orchestra.run.smithi132.stdout: debug mgr = 20 2024-05-08T18:49:53.337 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2024-05-08T18:49:53.337 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2024-05-08T18:49:53.337 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2024-05-08T18:49:53.337 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2024-05-08T18:49:53.337 INFO:teuthology.orchestra.run.smithi132.stdout: mgr/telemetry/nag = false 2024-05-08T18:49:53.337 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.337 INFO:teuthology.orchestra.run.smithi132.stdout:[mon] 2024-05-08T18:49:53.337 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-05-08T18:49:53.337 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2024-05-08T18:49:53.337 INFO:teuthology.orchestra.run.smithi132.stdout: debug paxos = 20 2024-05-08T18:49:53.337 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2024-05-08T18:49:53.337 INFO:teuthology.orchestra.run.smithi132.stdout: mon data avail warn = 5 2024-05-08T18:49:53.337 INFO:teuthology.orchestra.run.smithi132.stdout: mon mgr mkfs grace = 240 2024-05-08T18:49:53.337 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2024-05-08T18:49:53.338 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd reporter subtree level = osd 2024-05-08T18:49:53.338 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd prime pg temp = true 2024-05-08T18:49:53.338 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2024-05-08T18:49:53.338 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.338 INFO:teuthology.orchestra.run.smithi132.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T18:49:53.338 INFO:teuthology.orchestra.run.smithi132.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T18:49:53.338 INFO:teuthology.orchestra.run.smithi132.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T18:49:53.338 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.338 INFO:teuthology.orchestra.run.smithi132.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T18:49:53.338 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T18:49:53.338 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T18:49:53.338 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.338 INFO:teuthology.orchestra.run.smithi132.stdout: # 1m isn't quite enough 2024-05-08T18:49:53.338 INFO:teuthology.orchestra.run.smithi132.stdout: mon_down_mkfs_grace = 2m 2024-05-08T18:49:53.338 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.339 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_filestore_osds = false 2024-05-08T18:49:53.339 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T18:49:53.339 INFO:teuthology.orchestra.run.smithi132.stdout:[client] 2024-05-08T18:49:53.339 INFO:teuthology.orchestra.run.smithi132.stdout: rgw cache enabled = true 2024-05-08T18:49:53.339 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable ops log = true 2024-05-08T18:49:53.339 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable usage log = true 2024-05-08T18:49:53.339 INFO:teuthology.orchestra.run.smithi132.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T18:49:53.339 INFO:teuthology.orchestra.run.smithi132.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T18:49:53.339 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-05-08T18:49:53.339 INFO:teuthology.orchestra.run.smithi132.stdout: rgw gc obj min wait = 15 2024-05-08T18:49:53.340 INFO:teuthology.orchestra.run.smithi132.stdout: debug rgw = 20 2024-05-08T18:49:53.340 INFO:teuthology.orchestra.run.smithi132.stdout: setgroup = ceph 2024-05-08T18:49:53.340 INFO:teuthology.orchestra.run.smithi132.stdout: setuser = ceph 2024-05-08T18:49:53.340 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.a] 2024-05-08T18:49:53.340 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-08T18:49:53.340 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-08T18:49:53.423 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-08T18:49:53.424 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-08T18:49:53.424 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-08T18:49:53.440 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-08T18:49:53.440 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-08T18:49:53.495 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi042.front.sepia.ceph.com 2024-05-08T18:49:53.495 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-08T18:49:53.495 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T18:49:53.495 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T18:49:53.571 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-08T18:49:53.571 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:49:53.627 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi132.front.sepia.ceph.com 2024-05-08T18:49:53.627 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T18:49:53.627 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T18:49:53.628 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T18:49:53.663 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T18:49:53.663 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:49:53.719 INFO:tasks.ceph:Setting up mon nodes... 2024-05-08T18:49:53.719 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-08T18:49:53.719 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T18:49:53.814 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T18:49:53.816 INFO:tasks.ceph:Setting up mds nodes... 2024-05-08T18:49:53.816 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-08T18:49:53.817 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-08T18:49:53.857 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-08T18:49:53.869 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-08T18:49:53.869 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-05-08T18:49:53.869 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-08T18:49:53.895 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-05-08T18:49:53.895 INFO:tasks.ceph:role: osd.0 2024-05-08T18:49:53.895 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com 2024-05-08T18:49:53.895 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T18:49:53.961 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:49:53.961 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:49:53.961 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:49:53.961 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T18:49:53.961 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:49:53.961 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:49:53.961 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:49:53.961 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T18:49:53.962 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:49:53.962 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:49:53.994 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-05-08T18:49:53.996 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-05-08T18:49:53.996 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-08T18:49:54.072 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-08T18:49:54.142 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:49:54.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:49:54.238+0000 7fd92b2b3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-08T18:49:54.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:49:54.238+0000 7fd92b2b3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-08T18:49:54.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:49:54.238+0000 7fd92b2b3640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T18:49:54.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:49:54.238+0000 7fd92b2b3640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T18:49:54.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:49:54.238+0000 7fd92b2b3640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T18:49:54.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:49:54.238+0000 7fd92b2b3640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-08T18:49:57.094 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-08T18:49:57.125 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-08T18:49:57.156 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-08T18:49:57.156 INFO:tasks.ceph:role: osd.1 2024-05-08T18:49:57.156 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com 2024-05-08T18:49:57.156 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T18:49:57.232 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:49:57.232 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:49:57.232 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:49:57.232 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T18:49:57.232 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:49:57.232 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:49:57.232 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:49:57.232 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T18:49:57.232 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:49:57.232 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:49:57.748 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-05-08T18:49:57.750 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-05-08T18:49:57.750 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-05-08T18:49:57.893 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-08T18:49:57.928 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-08T18:49:57.996 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-08T18:49:57.996 INFO:tasks.ceph:role: osd.2 2024-05-08T18:49:57.996 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com 2024-05-08T18:49:57.996 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T18:49:58.071 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:49:58.071 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:49:58.071 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:49:58.071 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T18:49:58.071 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:49:58.071 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:49:58.072 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:49:58.072 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T18:49:58.072 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:49:58.072 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:49:58.528 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-05-08T18:49:58.530 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-05-08T18:49:58.530 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-05-08T18:49:58.623 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-08T18:49:58.655 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-08T18:49:58.722 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-08T18:49:58.722 INFO:tasks.ceph:role: osd.3 2024-05-08T18:49:58.722 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com 2024-05-08T18:49:58.722 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T18:49:58.795 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:49:58.795 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:49:58.795 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:49:58.796 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T18:49:58.796 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:49:58.796 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:49:58.796 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:49:58.796 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T18:49:58.796 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:49:58.796 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:49:59.288 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-05-08T18:49:59.290 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-05-08T18:49:59.290 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-05-08T18:49:59.439 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-08T18:49:59.473 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:49:59.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:49:59.605+0000 7f9304c2e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-08T18:49:59.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:49:59.608+0000 7f9304c2e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-08T18:49:59.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:49:59.608+0000 7f9304c2e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T18:49:59.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:49:59.608+0000 7f9304c2e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T18:49:59.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:49:59.609+0000 7f9304c2e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T18:49:59.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:49:59.617+0000 7f9304c2e640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-08T18:50:02.470 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-08T18:50:02.501 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:50:02.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:02.593+0000 7f33fc623640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-08T18:50:02.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:02.594+0000 7f33fc623640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-08T18:50:02.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:02.594+0000 7f33fc623640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T18:50:02.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:02.594+0000 7f33fc623640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T18:50:02.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:02.594+0000 7f33fc623640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T18:50:02.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:02.594+0000 7f33fc623640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-08T18:50:05.446 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-08T18:50:05.476 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:50:05.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:05.566+0000 7fc61b80e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-08T18:50:05.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:05.567+0000 7fc61b80e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-08T18:50:05.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:05.567+0000 7fc61b80e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T18:50:05.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:05.567+0000 7fc61b80e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T18:50:05.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:05.567+0000 7fc61b80e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T18:50:05.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:05.567+0000 7fc61b80e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-08T18:50:08.419 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-08T18:50:08.443 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-08T18:50:08.444 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-08T18:50:08.444 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-08T18:50:08.476 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T18:50:08.476 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-08T18:50:08.509 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T18:50:08.509 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-08T18:50:08.574 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T18:50:08.574 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-08T18:50:08.639 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T18:50:08.639 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-08T18:50:08.703 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T18:50:08.703 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-08T18:50:08.758 INFO:tasks.ceph:Adding keys to all mons... 2024-05-08T18:50:08.758 DEBUG:teuthology.orchestra.run.smithi042:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T18:50:08.787 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.0] 2024-05-08T18:50:08.788 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBSyTtmgoFNDhAA/N3FxaJ8DzsZwICIMCb16A== 2024-05-08T18:50:08.788 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr.x] 2024-05-08T18:50:08.788 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBRyTtmKNmkMBAArYU9M8XxF0x2YHuIKXqAFA== 2024-05-08T18:50:08.788 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.1] 2024-05-08T18:50:08.788 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBXyTtm2ncdJBAAw3tU63BOfvxbranJe49SuQ== 2024-05-08T18:50:08.788 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.2] 2024-05-08T18:50:08.788 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBayTtm4RloIxAAGz1jE9Zq9sg1VCyhcLDkWA== 2024-05-08T18:50:08.788 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.3] 2024-05-08T18:50:08.788 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBdyTtmC3LZIRAAM6QsM6sMLaMmb5+zoX6KIA== 2024-05-08T18:50:08.788 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-05-08T18:50:08.788 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBRyTtmMx82MxAA3dToQh5LYzO6+eE37CR+9w== 2024-05-08T18:50:08.789 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:50:08.887 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T18:50:08.941 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:50:08.993 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:50:09.046 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:50:09.097 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T18:50:09.152 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-08T18:50:09.153 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-08T18:50:09.178 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T18:50:09.274 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-08T18:50:09.300 DEBUG:teuthology.orchestra.run.smithi042:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:50:09.356 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-08T18:50:09.356 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-08T18:50:09.356 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-08T18:50:09.399 INFO:tasks.ceph.mon.a:Started 2024-05-08T18:50:09.399 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-08T18:50:09.399 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-08T18:50:09.399 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-08T18:50:09.401 INFO:tasks.ceph.mgr.x:Started 2024-05-08T18:50:09.402 INFO:tasks.ceph:Setting crush tunables to default 2024-05-08T18:50:09.402 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd crush tunables default 2024-05-08T18:50:09.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.503+0000 7f27994ca640 1 Processor -- start 2024-05-08T18:50:09.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.503+0000 7f27994ca640 1 -- start start 2024-05-08T18:50:09.503 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.503+0000 7f27994ca640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f279412f560 0x7f2794093430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:09.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.503+0000 7f27994ca640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f279406f290 con 0x7f279412f940 2024-05-08T18:50:09.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.503+0000 7f27994ca640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f279412fdd0 con 0x7f279412f560 2024-05-08T18:50:09.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.503+0000 7f2792ffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f279412f560 0x7f2794093430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:09.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.503+0000 7f278bfff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f279412f940 0x7f279412bfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:37518/0 (socket says 172.21.15.42:37518) 2024-05-08T18:50:09.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.503+0000 7f278bfff640 1 -- 172.21.15.42:0/2009993551 learned_addr learned my addr 172.21.15.42:0/2009993551 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:50:09.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.503+0000 7f2792ffd640 1 -- 172.21.15.42:0/2009993551 >> v1:172.21.15.42:6789/0 conn(0x7f279412f940 legacy=0x7f279412bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:09.504 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.503+0000 7f2792ffd640 1 -- 172.21.15.42:0/2009993551 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2794130400 con 0x7f279412f560 2024-05-08T18:50:09.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.505+0000 7f2792ffd640 1 --2- 172.21.15.42:0/2009993551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f279412f560 0x7f2794093430 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2784009720 tx=0x7f278402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2d4452050c133b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:09.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.505+0000 7f27927fc640 1 -- 172.21.15.42:0/2009993551 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2784035020 con 0x7f279412f560 2024-05-08T18:50:09.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.505+0000 7f27927fc640 1 -- 172.21.15.42:0/2009993551 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2784031760 con 0x7f279412f560 2024-05-08T18:50:09.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.505+0000 7f27927fc640 1 -- 172.21.15.42:0/2009993551 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2784031a60 con 0x7f279412f560 2024-05-08T18:50:09.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.506+0000 7f27994ca640 1 -- 172.21.15.42:0/2009993551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f279412f560 msgr2=0x7f2794093430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:09.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.506+0000 7f27994ca640 1 --2- 172.21.15.42:0/2009993551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f279412f560 0x7f2794093430 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2784009720 tx=0x7f278402b8d0 comp rx=0 tx=0).stop 2024-05-08T18:50:09.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.506+0000 7f27994ca640 1 -- 172.21.15.42:0/2009993551 shutdown_connections 2024-05-08T18:50:09.506 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.506+0000 7f27994ca640 1 --2- 172.21.15.42:0/2009993551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f279412f560 0x7f2794093430 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:09.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.506+0000 7f27994ca640 1 -- 172.21.15.42:0/2009993551 >> 172.21.15.42:0/2009993551 conn(0x7f27940a1c00 msgr2=0x7f27940a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:09.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.506+0000 7f27994ca640 1 -- 172.21.15.42:0/2009993551 shutdown_connections 2024-05-08T18:50:09.507 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.506+0000 7f27994ca640 1 -- 172.21.15.42:0/2009993551 wait complete. 2024-05-08T18:50:09.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.507+0000 7f27994ca640 1 Processor -- start 2024-05-08T18:50:09.508 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.507+0000 7f27994ca640 1 -- start start 2024-05-08T18:50:09.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.507+0000 7f27994ca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f279412f560 0x7f27941c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:09.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.507+0000 7f27994ca640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f279412c870 con 0x7f279412f560 2024-05-08T18:50:09.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.507+0000 7f2792ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f279412f560 0x7f27941c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:09.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.507+0000 7f2792ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f279412f560 0x7f27941c46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38348/0 (socket says 172.21.15.42:38348) 2024-05-08T18:50:09.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.507+0000 7f2792ffd640 1 -- 172.21.15.42:0/2437006197 learned_addr learned my addr 172.21.15.42:0/2437006197 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:09.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.508+0000 7f2792ffd640 1 -- 172.21.15.42:0/2437006197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2794093810 con 0x7f279412f560 2024-05-08T18:50:09.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.508+0000 7f2792ffd640 1 --2- 172.21.15.42:0/2437006197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f279412f560 0x7f27941c46d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2784009720 tx=0x7f27840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:09.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.508+0000 7f278b7fe640 1 -- 172.21.15.42:0/2437006197 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f278403b980 con 0x7f279412f560 2024-05-08T18:50:09.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.508+0000 7f278b7fe640 1 -- 172.21.15.42:0/2437006197 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f278403bb40 con 0x7f279412f560 2024-05-08T18:50:09.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.508+0000 7f27994ca640 1 -- 172.21.15.42:0/2437006197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2794073fb0 con 0x7f279412f560 2024-05-08T18:50:09.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.508+0000 7f278b7fe640 1 -- 172.21.15.42:0/2437006197 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f278403be60 con 0x7f279412f560 2024-05-08T18:50:09.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.508+0000 7f27994ca640 1 -- 172.21.15.42:0/2437006197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2794095890 con 0x7f279412f560 2024-05-08T18:50:09.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.508+0000 7f278b7fe640 1 -- 172.21.15.42:0/2437006197 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f278404c060 con 0x7f279412f560 2024-05-08T18:50:09.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.508+0000 7f278b7fe640 1 -- 172.21.15.42:0/2437006197 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f27840455d0 con 0x7f279412f560 2024-05-08T18:50:09.510 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.509+0000 7f27994ca640 1 -- 172.21.15.42:0/2437006197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2794074180 con 0x7f279412f560 2024-05-08T18:50:09.511 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.511+0000 7f278b7fe640 1 -- 172.21.15.42:0/2437006197 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f2784040070 con 0x7f279412f560 2024-05-08T18:50:09.577 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.577+0000 7f27994ca640 1 -- 172.21.15.42:0/2437006197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f279412c670 con 0x7f279412f560 2024-05-08T18:50:09.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.578+0000 7f278b7fe640 1 -- 172.21.15.42:0/2437006197 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f278404e920 con 0x7f279412f560 2024-05-08T18:50:09.578 INFO:teuthology.orchestra.run.smithi042.stderr:adjusted tunables profile to default 2024-05-08T18:50:09.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.579+0000 7f27994ca640 1 -- 172.21.15.42:0/2437006197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f279412f560 msgr2=0x7f27941c46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:09.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.579+0000 7f27994ca640 1 --2- 172.21.15.42:0/2437006197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f279412f560 0x7f27941c46d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f2784009720 tx=0x7f27840046c0 comp rx=0 tx=0).stop 2024-05-08T18:50:09.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.579+0000 7f27994ca640 1 -- 172.21.15.42:0/2437006197 shutdown_connections 2024-05-08T18:50:09.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.579+0000 7f27994ca640 1 --2- 172.21.15.42:0/2437006197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f279412f560 0x7f27941c46d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:09.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.579+0000 7f27994ca640 1 -- 172.21.15.42:0/2437006197 >> 172.21.15.42:0/2437006197 conn(0x7f27940a1c00 msgr2=0x7f2794129370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:09.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.580+0000 7f27994ca640 1 -- 172.21.15.42:0/2437006197 shutdown_connections 2024-05-08T18:50:09.580 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:09.580+0000 7f27994ca640 1 -- 172.21.15.42:0/2437006197 wait complete. 2024-05-08T18:50:09.590 INFO:tasks.ceph:check_enable_crimson: False 2024-05-08T18:50:09.590 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-08T18:50:09.590 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-05-08T18:50:09.590 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-08T18:50:09.615 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T18:50:09.615 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-08T18:50:09.642 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T18:50:09.642 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-08T18:50:09.710 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T18:50:09.710 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-08T18:50:09.775 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 0977d23d-95b7-40ad-9731-d8830f6eed5b 0 2024-05-08T18:50:09.792 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:09.793+0000 7f1657613040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T18:50:09.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.891+0000 7f58376d9640 1 Processor -- start 2024-05-08T18:50:09.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.891+0000 7f58376d9640 1 -- start start 2024-05-08T18:50:09.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.891+0000 7f58376d9640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f58301186d0 0x7f583011aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:09.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.891+0000 7f58376d9640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f583011b0f0 con 0x7f5830114a40 2024-05-08T18:50:09.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.891+0000 7f58376d9640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f583011c2d0 con 0x7f58301186d0 2024-05-08T18:50:09.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.891+0000 7f5834c74640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f58301186d0 0x7f583011aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:09.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.892+0000 7f5834c74640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f58301186d0 0x7f583011aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:39012/0 (socket says 172.21.15.132:39012) 2024-05-08T18:50:09.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.892+0000 7f5834c74640 1 -- 172.21.15.132:0/3838335251 learned_addr learned my addr 172.21.15.132:0/3838335251 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:09.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.892+0000 7f5834c74640 1 -- 172.21.15.132:0/3838335251 >> v1:172.21.15.42:6789/0 conn(0x7f5830114a40 legacy=0x7f5830114e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:09.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.892+0000 7f5834c74640 1 -- 172.21.15.132:0/3838335251 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f583011c480 con 0x7f58301186d0 2024-05-08T18:50:09.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.893+0000 7f5834c74640 1 --2- 172.21.15.132:0/3838335251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58301186d0 0x7f583011aac0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f58200097f0 tx=0x7f582002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94973b5e57503fb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:09.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.893+0000 7f5827fff640 1 -- 172.21.15.132:0/3838335251 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5820035020 con 0x7f58301186d0 2024-05-08T18:50:09.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.893+0000 7f5827fff640 1 -- 172.21.15.132:0/3838335251 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58200317a0 con 0x7f58301186d0 2024-05-08T18:50:09.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.893+0000 7f5827fff640 1 -- 172.21.15.132:0/3838335251 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5820031aa0 con 0x7f58301186d0 2024-05-08T18:50:09.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.893+0000 7f58376d9640 1 -- 172.21.15.132:0/3838335251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58301186d0 msgr2=0x7f583011aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:09.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.893+0000 7f58376d9640 1 --2- 172.21.15.132:0/3838335251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58301186d0 0x7f583011aac0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f58200097f0 tx=0x7f582002b910 comp rx=0 tx=0).stop 2024-05-08T18:50:09.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.893+0000 7f58376d9640 1 -- 172.21.15.132:0/3838335251 shutdown_connections 2024-05-08T18:50:09.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.893+0000 7f58376d9640 1 --2- 172.21.15.132:0/3838335251 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f58301186d0 0x7f583011aac0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:09.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.893+0000 7f58376d9640 1 -- 172.21.15.132:0/3838335251 >> 172.21.15.132:0/3838335251 conn(0x7f58300713e0 msgr2=0x7f5830073800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:09.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.893+0000 7f58376d9640 1 -- 172.21.15.132:0/3838335251 shutdown_connections 2024-05-08T18:50:09.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.893+0000 7f58376d9640 1 -- 172.21.15.132:0/3838335251 wait complete. 2024-05-08T18:50:09.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.894+0000 7f58376d9640 1 Processor -- start 2024-05-08T18:50:09.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.894+0000 7f58376d9640 1 -- start start 2024-05-08T18:50:09.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.894+0000 7f58376d9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5830114a40 0x7f58301a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:09.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.894+0000 7f58376d9640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f583011b7e0 con 0x7f5830114a40 2024-05-08T18:50:09.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.894+0000 7f5835475640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5830114a40 0x7f58301a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:09.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.894+0000 7f5835475640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5830114a40 0x7f58301a63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:39014/0 (socket says 172.21.15.132:39014) 2024-05-08T18:50:09.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.894+0000 7f5835475640 1 -- 172.21.15.132:0/2103602310 learned_addr learned my addr 172.21.15.132:0/2103602310 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:09.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.895+0000 7f5835475640 1 -- 172.21.15.132:0/2103602310 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58301a6930 con 0x7f5830114a40 2024-05-08T18:50:09.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.895+0000 7f5835475640 1 --2- 172.21.15.132:0/2103602310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5830114a40 0x7f58301a63f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f582c00c380 tx=0x7f582c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:09.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.895+0000 7f5825ffb640 1 -- 172.21.15.132:0/2103602310 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582c005150 con 0x7f5830114a40 2024-05-08T18:50:09.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.895+0000 7f5825ffb640 1 -- 172.21.15.132:0/2103602310 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f582c0052f0 con 0x7f5830114a40 2024-05-08T18:50:09.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.895+0000 7f58376d9640 1 -- 172.21.15.132:0/2103602310 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58301a6bc0 con 0x7f5830114a40 2024-05-08T18:50:09.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.895+0000 7f5825ffb640 1 -- 172.21.15.132:0/2103602310 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582c007030 con 0x7f5830114a40 2024-05-08T18:50:09.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.895+0000 7f5825ffb640 1 -- 172.21.15.132:0/2103602310 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f582c019020 con 0x7f5830114a40 2024-05-08T18:50:09.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.895+0000 7f58376d9640 1 -- 172.21.15.132:0/2103602310 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58301a7090 con 0x7f5830114a40 2024-05-08T18:50:09.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.896+0000 7f5825ffb640 1 -- 172.21.15.132:0/2103602310 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f582c007560 con 0x7f5830114a40 2024-05-08T18:50:09.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.896+0000 7f58376d9640 1 -- 172.21.15.132:0/2103602310 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5830050f90 con 0x7f5830114a40 2024-05-08T18:50:09.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.899+0000 7f5825ffb640 1 -- 172.21.15.132:0/2103602310 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f582c020070 con 0x7f5830114a40 2024-05-08T18:50:09.950 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:09.951+0000 7f1657613040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T18:50:09.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.971+0000 7f58376d9640 1 -- 172.21.15.132:0/2103602310 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0977d23d-95b7-40ad-9731-d8830f6eed5b", "id": 0} v 0) -- 0x7f58301186d0 con 0x7f5830114a40 2024-05-08T18:50:09.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.972+0000 7f5825ffb640 1 -- 172.21.15.132:0/2103602310 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0977d23d-95b7-40ad-9731-d8830f6eed5b", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f582c003b60 con 0x7f5830114a40 2024-05-08T18:50:09.972 INFO:teuthology.orchestra.run.smithi132.stdout:0 2024-05-08T18:50:09.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.973+0000 7f58376d9640 1 -- 172.21.15.132:0/2103602310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5830114a40 msgr2=0x7f58301a63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:09.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.973+0000 7f58376d9640 1 --2- 172.21.15.132:0/2103602310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5830114a40 0x7f58301a63f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f582c00c380 tx=0x7f582c00c840 comp rx=0 tx=0).stop 2024-05-08T18:50:09.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.973+0000 7f58376d9640 1 -- 172.21.15.132:0/2103602310 shutdown_connections 2024-05-08T18:50:09.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.973+0000 7f58376d9640 1 --2- 172.21.15.132:0/2103602310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5830114a40 0x7f58301a63f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:09.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.973+0000 7f58376d9640 1 -- 172.21.15.132:0/2103602310 >> 172.21.15.132:0/2103602310 conn(0x7f58300713e0 msgr2=0x7f5830119630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:09.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.973+0000 7f58376d9640 1 -- 172.21.15.132:0/2103602310 shutdown_connections 2024-05-08T18:50:09.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:09.973+0000 7f58376d9640 1 -- 172.21.15.132:0/2103602310 wait complete. 2024-05-08T18:50:09.983 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new cb3d63fc-91ce-46e0-8917-0552f4753541 1 2024-05-08T18:50:10.008 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:10.008+0000 7f1657613040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T18:50:10.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.081+0000 7f689df5e640 1 Processor -- start 2024-05-08T18:50:10.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.081+0000 7f689df5e640 1 -- start start 2024-05-08T18:50:10.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.082+0000 7f689df5e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6898115a20 0x7f6898115e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:10.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.082+0000 7f689df5e640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68981163d0 con 0x7f689806cc00 2024-05-08T18:50:10.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.082+0000 7f689df5e640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f689806d7c0 con 0x7f6898115a20 2024-05-08T18:50:10.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.082+0000 7f68977fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6898115a20 0x7f6898115e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:10.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.082+0000 7f688ffff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f689806cc00 0x7f689806d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:36252/0 (socket says 172.21.15.132:36252) 2024-05-08T18:50:10.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.082+0000 7f688ffff640 1 -- 172.21.15.132:0/1870329041 learned_addr learned my addr 172.21.15.132:0/1870329041 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:50:10.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.082+0000 7f6896ffd640 1 -- 172.21.15.132:0/1870329041 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1683038109 0 0) 0x7f68981163d0 con 0x7f689806cc00 2024-05-08T18:50:10.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.082+0000 7f6896ffd640 1 -- 172.21.15.132:0/1870329041 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6884003520 con 0x7f689806cc00 2024-05-08T18:50:10.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.082+0000 7f68977fe640 1 -- 172.21.15.132:0/1870329041 >> v1:172.21.15.42:6789/0 conn(0x7f689806cc00 legacy=0x7f689806d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:10.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.083+0000 7f68977fe640 1 -- 172.21.15.132:0/1870329041 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689806d970 con 0x7f6898115a20 2024-05-08T18:50:10.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.083+0000 7f68977fe640 1 --2- 172.21.15.132:0/1870329041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6898115a20 0x7f6898115e00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6888009720 tx=0x7f688802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f8e286b5ddeecf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:10.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.083+0000 7f6896ffd640 1 -- 172.21.15.132:0/1870329041 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68880316d0 con 0x7f6898115a20 2024-05-08T18:50:10.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.083+0000 7f6896ffd640 1 -- 172.21.15.132:0/1870329041 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6888037070 con 0x7f6898115a20 2024-05-08T18:50:10.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.084+0000 7f6896ffd640 1 -- 172.21.15.132:0/1870329041 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68880319c0 con 0x7f6898115a20 2024-05-08T18:50:10.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.084+0000 7f689df5e640 1 -- 172.21.15.132:0/1870329041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6898115a20 msgr2=0x7f6898115e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:10.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.084+0000 7f689df5e640 1 --2- 172.21.15.132:0/1870329041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6898115a20 0x7f6898115e00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6888009720 tx=0x7f688802b840 comp rx=0 tx=0).stop 2024-05-08T18:50:10.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.084+0000 7f689df5e640 1 -- 172.21.15.132:0/1870329041 shutdown_connections 2024-05-08T18:50:10.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.084+0000 7f689df5e640 1 --2- 172.21.15.132:0/1870329041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6898115a20 0x7f6898115e00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:10.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.084+0000 7f689df5e640 1 -- 172.21.15.132:0/1870329041 >> 172.21.15.132:0/1870329041 conn(0x7f6898071390 msgr2=0x7f68980737b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:10.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.084+0000 7f689df5e640 1 -- 172.21.15.132:0/1870329041 shutdown_connections 2024-05-08T18:50:10.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.084+0000 7f689df5e640 1 -- 172.21.15.132:0/1870329041 wait complete. 2024-05-08T18:50:10.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.085+0000 7f689df5e640 1 Processor -- start 2024-05-08T18:50:10.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.085+0000 7f689df5e640 1 -- start start 2024-05-08T18:50:10.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.085+0000 7f689df5e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f689806cc00 0x7f68981ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:10.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.085+0000 7f689df5e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f689811cd00 con 0x7f689806cc00 2024-05-08T18:50:10.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.085+0000 7f68977fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f689806cc00 0x7f68981ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:10.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.085+0000 7f68977fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f689806cc00 0x7f68981ad280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:39032/0 (socket says 172.21.15.132:39032) 2024-05-08T18:50:10.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.085+0000 7f68977fe640 1 -- 172.21.15.132:0/695514060 learned_addr learned my addr 172.21.15.132:0/695514060 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:10.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.086+0000 7f68977fe640 1 -- 172.21.15.132:0/695514060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68981ad850 con 0x7f689806cc00 2024-05-08T18:50:10.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.086+0000 7f68977fe640 1 --2- 172.21.15.132:0/695514060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f689806cc00 0x7f68981ad280 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6888009720 tx=0x7f68880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:10.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.086+0000 7f6894ff9640 1 -- 172.21.15.132:0/695514060 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6888032560 con 0x7f689806cc00 2024-05-08T18:50:10.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.086+0000 7f6894ff9640 1 -- 172.21.15.132:0/695514060 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6888032700 con 0x7f689806cc00 2024-05-08T18:50:10.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.086+0000 7f689df5e640 1 -- 172.21.15.132:0/695514060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68981ada80 con 0x7f689806cc00 2024-05-08T18:50:10.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.086+0000 7f6894ff9640 1 -- 172.21.15.132:0/695514060 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6888032a00 con 0x7f689806cc00 2024-05-08T18:50:10.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.086+0000 7f689df5e640 1 -- 172.21.15.132:0/695514060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68981a7390 con 0x7f689806cc00 2024-05-08T18:50:10.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.086+0000 7f6894ff9640 1 -- 172.21.15.132:0/695514060 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f688804c060 con 0x7f689806cc00 2024-05-08T18:50:10.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.086+0000 7f6894ff9640 1 -- 172.21.15.132:0/695514060 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f688802f050 con 0x7f689806cc00 2024-05-08T18:50:10.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.087+0000 7f689df5e640 1 -- 172.21.15.132:0/695514060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6898050f90 con 0x7f689806cc00 2024-05-08T18:50:10.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.089+0000 7f6894ff9640 1 -- 172.21.15.132:0/695514060 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f6888040070 con 0x7f689806cc00 2024-05-08T18:50:10.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.162+0000 7f689df5e640 1 -- 172.21.15.132:0/695514060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cb3d63fc-91ce-46e0-8917-0552f4753541", "id": 1} v 0) -- 0x7f6898115a20 con 0x7f689806cc00 2024-05-08T18:50:10.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.163+0000 7f6894ff9640 1 -- 172.21.15.132:0/695514060 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cb3d63fc-91ce-46e0-8917-0552f4753541", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f68880060f0 con 0x7f689806cc00 2024-05-08T18:50:10.163 INFO:teuthology.orchestra.run.smithi132.stdout:1 2024-05-08T18:50:10.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.164+0000 7f689df5e640 1 -- 172.21.15.132:0/695514060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f689806cc00 msgr2=0x7f68981ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:10.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.164+0000 7f689df5e640 1 --2- 172.21.15.132:0/695514060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f689806cc00 0x7f68981ad280 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6888009720 tx=0x7f68880046c0 comp rx=0 tx=0).stop 2024-05-08T18:50:10.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.164+0000 7f689df5e640 1 -- 172.21.15.132:0/695514060 shutdown_connections 2024-05-08T18:50:10.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.164+0000 7f689df5e640 1 --2- 172.21.15.132:0/695514060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f689806cc00 0x7f68981ad280 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:10.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.164+0000 7f689df5e640 1 -- 172.21.15.132:0/695514060 >> 172.21.15.132:0/695514060 conn(0x7f6898071390 msgr2=0x7f6898072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:10.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.164+0000 7f689df5e640 1 -- 172.21.15.132:0/695514060 shutdown_connections 2024-05-08T18:50:10.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.164+0000 7f689df5e640 1 -- 172.21.15.132:0/695514060 wait complete. 2024-05-08T18:50:10.174 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new c3d3af18-54c3-492d-a4f1-72075b0fd6da 2 2024-05-08T18:50:10.266 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:10.267+0000 7f1657613040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T18:50:10.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.313+0000 7f6af0517640 1 Processor -- start 2024-05-08T18:50:10.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.314+0000 7f6af0517640 1 -- start start 2024-05-08T18:50:10.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.314+0000 7f6af0517640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6ae8116b70 0x7f6ae8116f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:10.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.314+0000 7f6af0517640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ae81175e0 con 0x7f6ae810ef90 2024-05-08T18:50:10.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.314+0000 7f6af0517640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f6ae810fb50 con 0x7f6ae8116b70 2024-05-08T18:50:10.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.314+0000 7f6aee2b3640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6ae8116b70 0x7f6ae8116f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:10.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.314+0000 7f6aedab2640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f6ae810ef90 0x7f6ae810f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:36268/0 (socket says 172.21.15.132:36268) 2024-05-08T18:50:10.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.314+0000 7f6aedab2640 1 -- 172.21.15.132:0/1395149188 learned_addr learned my addr 172.21.15.132:0/1395149188 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:50:10.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.315+0000 7f6aed2b1640 1 -- 172.21.15.132:0/1395149188 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 591706162 0 0) 0x7f6ae81175e0 con 0x7f6ae810ef90 2024-05-08T18:50:10.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.315+0000 7f6aed2b1640 1 -- 172.21.15.132:0/1395149188 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ad4003520 con 0x7f6ae810ef90 2024-05-08T18:50:10.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.315+0000 7f6aee2b3640 1 -- 172.21.15.132:0/1395149188 >> v1:172.21.15.42:6789/0 conn(0x7f6ae810ef90 legacy=0x7f6ae810f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:10.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.315+0000 7f6aee2b3640 1 -- 172.21.15.132:0/1395149188 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae810fd00 con 0x7f6ae8116b70 2024-05-08T18:50:10.316 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:10.315+0000 7f1657613040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T18:50:10.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.315+0000 7f6aee2b3640 1 --2- 172.21.15.132:0/1395149188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ae8116b70 0x7f6ae8116f50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009720 tx=0x7f6ae402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89623f95fcf27bd3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:10.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.316+0000 7f6aed2b1640 1 -- 172.21.15.132:0/1395149188 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ae40316d0 con 0x7f6ae8116b70 2024-05-08T18:50:10.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.316+0000 7f6aed2b1640 1 -- 172.21.15.132:0/1395149188 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae4037070 con 0x7f6ae8116b70 2024-05-08T18:50:10.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.316+0000 7f6aed2b1640 1 -- 172.21.15.132:0/1395149188 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ae40319c0 con 0x7f6ae8116b70 2024-05-08T18:50:10.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.316+0000 7f6af0517640 1 -- 172.21.15.132:0/1395149188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ae8116b70 msgr2=0x7f6ae8116f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:10.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.316+0000 7f6af0517640 1 --2- 172.21.15.132:0/1395149188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ae8116b70 0x7f6ae8116f50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009720 tx=0x7f6ae402b840 comp rx=0 tx=0).stop 2024-05-08T18:50:10.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.316+0000 7f6af0517640 1 -- 172.21.15.132:0/1395149188 shutdown_connections 2024-05-08T18:50:10.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.316+0000 7f6af0517640 1 --2- 172.21.15.132:0/1395149188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ae8116b70 0x7f6ae8116f50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:10.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.316+0000 7f6af0517640 1 -- 172.21.15.132:0/1395149188 >> 172.21.15.132:0/1395149188 conn(0x7f6ae8070b30 msgr2=0x7f6ae8072f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:10.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.316+0000 7f6af0517640 1 -- 172.21.15.132:0/1395149188 shutdown_connections 2024-05-08T18:50:10.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.316+0000 7f6af0517640 1 -- 172.21.15.132:0/1395149188 wait complete. 2024-05-08T18:50:10.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.317+0000 7f6af0517640 1 Processor -- start 2024-05-08T18:50:10.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.317+0000 7f6af0517640 1 -- start start 2024-05-08T18:50:10.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.317+0000 7f6af0517640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ae810ef90 0x7f6ae81ab140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:10.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.317+0000 7f6af0517640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae811cdb0 con 0x7f6ae810ef90 2024-05-08T18:50:10.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.317+0000 7f6aee2b3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ae810ef90 0x7f6ae81ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:10.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.318+0000 7f6aee2b3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ae810ef90 0x7f6ae81ab140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:39050/0 (socket says 172.21.15.132:39050) 2024-05-08T18:50:10.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.318+0000 7f6aee2b3640 1 -- 172.21.15.132:0/424489537 learned_addr learned my addr 172.21.15.132:0/424489537 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:10.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.318+0000 7f6aee2b3640 1 -- 172.21.15.132:0/424489537 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae81ab710 con 0x7f6ae810ef90 2024-05-08T18:50:10.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.318+0000 7f6aee2b3640 1 --2- 172.21.15.132:0/424489537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ae810ef90 0x7f6ae81ab140 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4034040 tx=0x7f6ae40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:10.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.318+0000 7f6adeffd640 1 -- 172.21.15.132:0/424489537 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ae4032560 con 0x7f6ae810ef90 2024-05-08T18:50:10.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.318+0000 7f6adeffd640 1 -- 172.21.15.132:0/424489537 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ae4032700 con 0x7f6ae810ef90 2024-05-08T18:50:10.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.318+0000 7f6adeffd640 1 -- 172.21.15.132:0/424489537 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ae4032a20 con 0x7f6ae810ef90 2024-05-08T18:50:10.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.318+0000 7f6af0517640 1 -- 172.21.15.132:0/424489537 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae81ab940 con 0x7f6ae810ef90 2024-05-08T18:50:10.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.318+0000 7f6af0517640 1 -- 172.21.15.132:0/424489537 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae81a5250 con 0x7f6ae810ef90 2024-05-08T18:50:10.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.319+0000 7f6adeffd640 1 -- 172.21.15.132:0/424489537 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6ae404c060 con 0x7f6ae810ef90 2024-05-08T18:50:10.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.319+0000 7f6adeffd640 1 -- 172.21.15.132:0/424489537 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f6ae402f050 con 0x7f6ae810ef90 2024-05-08T18:50:10.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.320+0000 7f6af0517640 1 -- 172.21.15.132:0/424489537 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae8050f90 con 0x7f6ae810ef90 2024-05-08T18:50:10.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.322+0000 7f6adeffd640 1 -- 172.21.15.132:0/424489537 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f6ae4040070 con 0x7f6ae810ef90 2024-05-08T18:50:10.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.407+0000 7f6af0517640 1 -- 172.21.15.132:0/424489537 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c3d3af18-54c3-492d-a4f1-72075b0fd6da", "id": 2} v 0) -- 0x7f6ae8116b70 con 0x7f6ae810ef90 2024-05-08T18:50:10.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.408+0000 7f6adeffd640 1 -- 172.21.15.132:0/424489537 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c3d3af18-54c3-492d-a4f1-72075b0fd6da", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f6ae4006510 con 0x7f6ae810ef90 2024-05-08T18:50:10.408 INFO:teuthology.orchestra.run.smithi132.stdout:2 2024-05-08T18:50:10.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.409+0000 7f6af0517640 1 -- 172.21.15.132:0/424489537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ae810ef90 msgr2=0x7f6ae81ab140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:10.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.409+0000 7f6af0517640 1 --2- 172.21.15.132:0/424489537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ae810ef90 0x7f6ae81ab140 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4034040 tx=0x7f6ae40046c0 comp rx=0 tx=0).stop 2024-05-08T18:50:10.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.409+0000 7f6af0517640 1 -- 172.21.15.132:0/424489537 shutdown_connections 2024-05-08T18:50:10.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.409+0000 7f6af0517640 1 --2- 172.21.15.132:0/424489537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ae810ef90 0x7f6ae81ab140 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:10.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.409+0000 7f6af0517640 1 -- 172.21.15.132:0/424489537 >> 172.21.15.132:0/424489537 conn(0x7f6ae8070b30 msgr2=0x7f6ae8112990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:10.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.409+0000 7f6af0517640 1 -- 172.21.15.132:0/424489537 shutdown_connections 2024-05-08T18:50:10.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.409+0000 7f6af0517640 1 -- 172.21.15.132:0/424489537 wait complete. 2024-05-08T18:50:10.419 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 07166424-d9c6-44be-b49f-173ad316b7c3 3 2024-05-08T18:50:10.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.517+0000 7f0c05187640 1 Processor -- start 2024-05-08T18:50:10.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.517+0000 7f0c05187640 1 -- start start 2024-05-08T18:50:10.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.517+0000 7f0c05187640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0c00119920 0x7f0c0011bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:10.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.517+0000 7f0c05187640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c0011c250 con 0x7f0c00110ca0 2024-05-08T18:50:10.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.517+0000 7f0c05187640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f0c0011d450 con 0x7f0c00119920 2024-05-08T18:50:10.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.518+0000 7f0bfe59c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0c00119920 0x7f0c0011bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:10.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.518+0000 7f0bfed9d640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f0c00110ca0 0x7f0c00111080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:59770/0 (socket says 172.21.15.132:59770) 2024-05-08T18:50:10.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.518+0000 7f0bfed9d640 1 -- 172.21.15.132:0/3429530690 learned_addr learned my addr 172.21.15.132:0/3429530690 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:50:10.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.518+0000 7f0bfe59c640 1 -- 172.21.15.132:0/3429530690 >> v1:172.21.15.42:6789/0 conn(0x7f0c00110ca0 legacy=0x7f0c00111080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:10.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.518+0000 7f0bfe59c640 1 -- 172.21.15.132:0/3429530690 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c0011d600 con 0x7f0c00119920 2024-05-08T18:50:10.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.519+0000 7f0bfe59c640 1 --2- 172.21.15.132:0/3429530690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c00119920 0x7f0c0011bd10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009720 tx=0x7f0be802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb4c67b61d2f359 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:10.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.519+0000 7f0bfdd9b640 1 -- 172.21.15.132:0/3429530690 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be80316d0 con 0x7f0c00119920 2024-05-08T18:50:10.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.519+0000 7f0bfdd9b640 1 -- 172.21.15.132:0/3429530690 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be8037070 con 0x7f0c00119920 2024-05-08T18:50:10.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.519+0000 7f0bfdd9b640 1 -- 172.21.15.132:0/3429530690 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be80319c0 con 0x7f0c00119920 2024-05-08T18:50:10.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.519+0000 7f0c05187640 1 -- 172.21.15.132:0/3429530690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c00119920 msgr2=0x7f0c0011bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:10.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.519+0000 7f0c05187640 1 --2- 172.21.15.132:0/3429530690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c00119920 0x7f0c0011bd10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0be8009720 tx=0x7f0be802b840 comp rx=0 tx=0).stop 2024-05-08T18:50:10.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.519+0000 7f0c05187640 1 -- 172.21.15.132:0/3429530690 shutdown_connections 2024-05-08T18:50:10.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.519+0000 7f0c05187640 1 --2- 172.21.15.132:0/3429530690 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c00119920 0x7f0c0011bd10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:10.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.520+0000 7f0c05187640 1 -- 172.21.15.132:0/3429530690 >> 172.21.15.132:0/3429530690 conn(0x7f0c00072190 msgr2=0x7f0c0010edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:10.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.520+0000 7f0c05187640 1 -- 172.21.15.132:0/3429530690 shutdown_connections 2024-05-08T18:50:10.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.520+0000 7f0c05187640 1 -- 172.21.15.132:0/3429530690 wait complete. 2024-05-08T18:50:10.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.520+0000 7f0c05187640 1 Processor -- start 2024-05-08T18:50:10.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.521+0000 7f0c05187640 1 -- start start 2024-05-08T18:50:10.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.521+0000 7f0c05187640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c00110ca0 0x7f0c001ab450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:10.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.521+0000 7f0c05187640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0011c900 con 0x7f0c00110ca0 2024-05-08T18:50:10.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.521+0000 7f0bfed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c00110ca0 0x7f0c001ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:10.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.521+0000 7f0bfed9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c00110ca0 0x7f0c001ab450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:47714/0 (socket says 172.21.15.132:47714) 2024-05-08T18:50:10.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.521+0000 7f0bfed9d640 1 -- 172.21.15.132:0/730234551 learned_addr learned my addr 172.21.15.132:0/730234551 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:10.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.522+0000 7f0bfed9d640 1 -- 172.21.15.132:0/730234551 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c001aba20 con 0x7f0c00110ca0 2024-05-08T18:50:10.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.522+0000 7f0bfed9d640 1 --2- 172.21.15.132:0/730234551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c00110ca0 0x7f0c001ab450 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000c4a0 tx=0x7f0bf000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:10.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.522+0000 7f0bf77fe640 1 -- 172.21.15.132:0/730234551 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bf0017070 con 0x7f0c00110ca0 2024-05-08T18:50:10.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.522+0000 7f0bf77fe640 1 -- 172.21.15.132:0/730234551 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf0005c10 con 0x7f0c00110ca0 2024-05-08T18:50:10.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.522+0000 7f0bf77fe640 1 -- 172.21.15.132:0/730234551 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bf0007070 con 0x7f0c00110ca0 2024-05-08T18:50:10.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.522+0000 7f0c05187640 1 -- 172.21.15.132:0/730234551 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c001abcb0 con 0x7f0c00110ca0 2024-05-08T18:50:10.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.522+0000 7f0c05187640 1 -- 172.21.15.132:0/730234551 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c001a56c0 con 0x7f0c00110ca0 2024-05-08T18:50:10.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.522+0000 7f0bf77fe640 1 -- 172.21.15.132:0/730234551 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0bf001a070 con 0x7f0c00110ca0 2024-05-08T18:50:10.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.522+0000 7f0bf77fe640 1 -- 172.21.15.132:0/730234551 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f0bf001c440 con 0x7f0c00110ca0 2024-05-08T18:50:10.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.523+0000 7f0c05187640 1 -- 172.21.15.132:0/730234551 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c00050f90 con 0x7f0c00110ca0 2024-05-08T18:50:10.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.526+0000 7f0bf77fe640 1 -- 172.21.15.132:0/730234551 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0bf001cb50 con 0x7f0c00110ca0 2024-05-08T18:50:10.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.596+0000 7f0c05187640 1 -- 172.21.15.132:0/730234551 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd new", "uuid": "07166424-d9c6-44be-b49f-173ad316b7c3", "id": 3} v 0) -- 0x7f0c001abee0 con 0x7f0c00110ca0 2024-05-08T18:50:10.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.597+0000 7f0bf77fe640 1 -- 172.21.15.132:0/730234551 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "07166424-d9c6-44be-b49f-173ad316b7c3", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f0bf001ce10 con 0x7f0c00110ca0 2024-05-08T18:50:10.597 INFO:teuthology.orchestra.run.smithi132.stdout:3 2024-05-08T18:50:10.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.598+0000 7f0c05187640 1 -- 172.21.15.132:0/730234551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c00110ca0 msgr2=0x7f0c001ab450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:10.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.598+0000 7f0c05187640 1 --2- 172.21.15.132:0/730234551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c00110ca0 0x7f0c001ab450 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000c4a0 tx=0x7f0bf000c960 comp rx=0 tx=0).stop 2024-05-08T18:50:10.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.598+0000 7f0c05187640 1 -- 172.21.15.132:0/730234551 shutdown_connections 2024-05-08T18:50:10.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.598+0000 7f0c05187640 1 --2- 172.21.15.132:0/730234551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0c00110ca0 0x7f0c001ab450 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:10.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.598+0000 7f0c05187640 1 -- 172.21.15.132:0/730234551 >> 172.21.15.132:0/730234551 conn(0x7f0c00072190 msgr2=0x7f0c00117ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:10.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.598+0000 7f0c05187640 1 -- 172.21.15.132:0/730234551 shutdown_connections 2024-05-08T18:50:10.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:10.598+0000 7f0c05187640 1 -- 172.21.15.132:0/730234551 wait complete. 2024-05-08T18:50:10.608 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-08T18:50:10.608 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-08T18:50:10.611 INFO:tasks.ceph.osd.0:Started 2024-05-08T18:50:10.611 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-08T18:50:10.611 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-08T18:50:10.614 INFO:tasks.ceph.osd.1:Started 2024-05-08T18:50:10.614 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-08T18:50:10.614 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-08T18:50:10.616 INFO:tasks.ceph.osd.2:Started 2024-05-08T18:50:10.616 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-08T18:50:10.616 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-08T18:50:10.618 INFO:tasks.ceph.osd.3:Started 2024-05-08T18:50:10.619 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:50:10.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.734+0000 7f22fff81640 1 Processor -- start 2024-05-08T18:50:10.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.734+0000 7f22fff81640 1 -- start start 2024-05-08T18:50:10.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.734+0000 7f22fff81640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f22f812c7f0 0x7f22f812cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:10.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.735+0000 7f22fff81640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22f80a23e0 con 0x7f22f8070850 2024-05-08T18:50:10.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.735+0000 7f22fff81640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f22f8072fc0 con 0x7f22f812c7f0 2024-05-08T18:50:10.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.735+0000 7f22fdd1d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f22f812c7f0 0x7f22f812cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:10.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.735+0000 7f22fd51c640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f22f8070850 0x7f22f8070ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:37538/0 (socket says 172.21.15.42:37538) 2024-05-08T18:50:10.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.735+0000 7f22fd51c640 1 -- 172.21.15.42:0/3612206629 learned_addr learned my addr 172.21.15.42:0/3612206629 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:50:10.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.735+0000 7f22fdd1d640 1 -- 172.21.15.42:0/3612206629 >> v1:172.21.15.42:6789/0 conn(0x7f22f8070850 legacy=0x7f22f8070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:10.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.735+0000 7f22fdd1d640 1 -- 172.21.15.42:0/3612206629 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f8071f80 con 0x7f22f812c7f0 2024-05-08T18:50:10.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.736+0000 7f22fdd1d640 1 --2- 172.21.15.42:0/3612206629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22f812c7f0 0x7f22f812cbd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009720 tx=0x7f22f402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260c2ebd3b70e3f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:10.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.736+0000 7f22fcd1b640 1 -- 172.21.15.42:0/3612206629 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22f40316d0 con 0x7f22f812c7f0 2024-05-08T18:50:10.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.736+0000 7f22fcd1b640 1 -- 172.21.15.42:0/3612206629 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22f4037070 con 0x7f22f812c7f0 2024-05-08T18:50:10.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.736+0000 7f22fcd1b640 1 -- 172.21.15.42:0/3612206629 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22f40319c0 con 0x7f22f812c7f0 2024-05-08T18:50:10.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.736+0000 7f22fff81640 1 -- 172.21.15.42:0/3612206629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22f812c7f0 msgr2=0x7f22f812cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:10.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.736+0000 7f22fff81640 1 --2- 172.21.15.42:0/3612206629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22f812c7f0 0x7f22f812cbd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f22f4009720 tx=0x7f22f402b840 comp rx=0 tx=0).stop 2024-05-08T18:50:10.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.736+0000 7f22fff81640 1 -- 172.21.15.42:0/3612206629 shutdown_connections 2024-05-08T18:50:10.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.736+0000 7f22fff81640 1 --2- 172.21.15.42:0/3612206629 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22f812c7f0 0x7f22f812cbd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:10.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.736+0000 7f22fff81640 1 -- 172.21.15.42:0/3612206629 >> 172.21.15.42:0/3612206629 conn(0x7f22f809ff90 msgr2=0x7f22f80a1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:10.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.737+0000 7f22fff81640 1 -- 172.21.15.42:0/3612206629 shutdown_connections 2024-05-08T18:50:10.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.737+0000 7f22fff81640 1 -- 172.21.15.42:0/3612206629 wait complete. 2024-05-08T18:50:10.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.737+0000 7f22fff81640 1 Processor -- start 2024-05-08T18:50:10.738 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.737+0000 7f22fff81640 1 -- start start 2024-05-08T18:50:10.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.738+0000 7f22fff81640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22f8070850 0x7f22f811a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:10.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.738+0000 7f22fff81640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f22f8071530 con 0x7f22f8070850 2024-05-08T18:50:10.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.738+0000 7f22fdd1d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22f8070850 0x7f22f811a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:10.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.738+0000 7f22fdd1d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22f8070850 0x7f22f811a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38368/0 (socket says 172.21.15.42:38368) 2024-05-08T18:50:10.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.738+0000 7f22fdd1d640 1 -- 172.21.15.42:0/3497649557 learned_addr learned my addr 172.21.15.42:0/3497649557 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:10.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.738+0000 7f22fdd1d640 1 -- 172.21.15.42:0/3497649557 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f811c050 con 0x7f22f8070850 2024-05-08T18:50:10.740 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.738+0000 7f22fdd1d640 1 --2- 172.21.15.42:0/3497649557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22f8070850 0x7f22f811a080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f22f4034040 tx=0x7f22f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:10.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.739+0000 7f22ee7fc640 1 -- 172.21.15.42:0/3497649557 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22f4032770 con 0x7f22f8070850 2024-05-08T18:50:10.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.739+0000 7f22ee7fc640 1 -- 172.21.15.42:0/3497649557 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22f4032910 con 0x7f22f8070850 2024-05-08T18:50:10.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.739+0000 7f22ee7fc640 1 -- 172.21.15.42:0/3497649557 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22f4032c30 con 0x7f22f8070850 2024-05-08T18:50:10.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.739+0000 7f22fff81640 1 -- 172.21.15.42:0/3497649557 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f812c080 con 0x7f22f8070850 2024-05-08T18:50:10.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.739+0000 7f22fff81640 1 -- 172.21.15.42:0/3497649557 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f811d450 con 0x7f22f8070850 2024-05-08T18:50:10.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.739+0000 7f22ee7fc640 1 -- 172.21.15.42:0/3497649557 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f22f404c060 con 0x7f22f8070850 2024-05-08T18:50:10.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.739+0000 7f22ee7fc640 1 -- 172.21.15.42:0/3497649557 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f22f402f050 con 0x7f22f8070850 2024-05-08T18:50:10.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.740+0000 7f22fff81640 1 -- 172.21.15.42:0/3497649557 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22f811c840 con 0x7f22f8070850 2024-05-08T18:50:10.741 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.742+0000 7f22ee7fc640 1 -- 172.21.15.42:0/3497649557 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f22f4064e50 con 0x7f22f8070850 2024-05-08T18:50:10.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.804+0000 7f22fff81640 1 -- 172.21.15.42:0/3497649557 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22f8064010 con 0x7f22f8070850 2024-05-08T18:50:10.804 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.804+0000 7f22ee7fc640 1 -- 172.21.15.42:0/3497649557 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f22f4053070 con 0x7f22f8070850 2024-05-08T18:50:10.804 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:50:10.804 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":6,"fsid":"772ec65a-301b-4446-89ae-86d9bcfb0a5c","created":"2024-05-08T18:50:09.489497+0000","modified":"2024-05-08T18:50:10.598140+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T18:50:10.598140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0977d23d-95b7-40ad-9731-d8830f6eed5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cb3d63fc-91ce-46e0-8917-0552f4753541","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c3d3af18-54c3-492d-a4f1-72075b0fd6da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"07166424-d9c6-44be-b49f-173ad316b7c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:50:10.805 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.805+0000 7f22fff81640 1 -- 172.21.15.42:0/3497649557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22f8070850 msgr2=0x7f22f811a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:10.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.805+0000 7f22fff81640 1 --2- 172.21.15.42:0/3497649557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22f8070850 0x7f22f811a080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f22f4034040 tx=0x7f22f40046c0 comp rx=0 tx=0).stop 2024-05-08T18:50:10.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.805+0000 7f22fff81640 1 -- 172.21.15.42:0/3497649557 shutdown_connections 2024-05-08T18:50:10.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.805+0000 7f22fff81640 1 --2- 172.21.15.42:0/3497649557 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22f8070850 0x7f22f811a080 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:10.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.805+0000 7f22fff81640 1 -- 172.21.15.42:0/3497649557 >> 172.21.15.42:0/3497649557 conn(0x7f22f809ff90 msgr2=0x7f22f81b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:10.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.805+0000 7f22fff81640 1 -- 172.21.15.42:0/3497649557 shutdown_connections 2024-05-08T18:50:10.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:10.805+0000 7f22fff81640 1 -- 172.21.15.42:0/3497649557 wait complete. 2024-05-08T18:50:10.816 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-08T18:50:10.816 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-08T18:50:11.074 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:11.075+0000 7f1657613040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T18:50:11.162 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:11.162+0000 7f1657613040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T18:50:11.204 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:11.205+0000 7f1657613040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T18:50:11.213 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-08T18:50:11.214+0000 7f64b1203640 -1 Falling back to public interface 2024-05-08T18:50:11.217 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-05-08T18:50:11.218+0000 7fa182a13640 -1 Falling back to public interface 2024-05-08T18:50:11.218 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T18:50:11.218 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-05-08T18:50:11.219+0000 7f08c2a0e640 -1 Falling back to public interface 2024-05-08T18:50:11.222 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-05-08T18:50:11.223+0000 7f9bf3a1e640 -1 Falling back to public interface 2024-05-08T18:50:11.314 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.314+0000 7f0f2b6ca640 1 Processor -- start 2024-05-08T18:50:11.314 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.314+0000 7f0f2b6ca640 1 -- start start 2024-05-08T18:50:11.316 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.315+0000 7f0f2b6ca640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0f24128d40 0x7f0f241314f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:11.316 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.315+0000 7f0f2b6ca640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f24123310 con 0x7f0f24070310 2024-05-08T18:50:11.316 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.315+0000 7f0f2b6ca640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f0f24073ed0 con 0x7f0f24128d40 2024-05-08T18:50:11.316 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.315+0000 7f0f28c65640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0f24128d40 0x7f0f241314f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:11.316 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.315+0000 7f0f29466640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f0f24070310 0x7f0f241292c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:37540/0 (socket says 172.21.15.42:37540) 2024-05-08T18:50:11.316 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.315+0000 7f0f29466640 1 -- 172.21.15.42:0/4064794408 learned_addr learned my addr 172.21.15.42:0/4064794408 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:50:11.316 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.315+0000 7f0f28c65640 1 -- 172.21.15.42:0/4064794408 >> v1:172.21.15.42:6789/0 conn(0x7f0f24070310 legacy=0x7f0f241292c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:11.316 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.315+0000 7f0f1bfff640 1 -- 172.21.15.42:0/4064794408 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3010742021 0 0) 0x7f0f20001110 con 0x7f0f24070310 2024-05-08T18:50:11.317 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.315+0000 7f0f28c65640 1 -- 172.21.15.42:0/4064794408 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f241299d0 con 0x7f0f24128d40 2024-05-08T18:50:11.317 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.316+0000 7f0f28c65640 1 --2- 172.21.15.42:0/4064794408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f24128d40 0x7f0f241314f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0f14009720 tx=0x7f0f1402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384fdcb72508709b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:11.317 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.316+0000 7f0f1bfff640 1 -- 172.21.15.42:0/4064794408 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f14035020 con 0x7f0f24128d40 2024-05-08T18:50:11.317 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.316+0000 7f0f1bfff640 1 -- 172.21.15.42:0/4064794408 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f14031760 con 0x7f0f24128d40 2024-05-08T18:50:11.317 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.316+0000 7f0f1bfff640 1 -- 172.21.15.42:0/4064794408 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f14031a60 con 0x7f0f24128d40 2024-05-08T18:50:11.319 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.317+0000 7f0f2b6ca640 1 -- 172.21.15.42:0/4064794408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f24128d40 msgr2=0x7f0f241314f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:11.320 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.317+0000 7f0f2b6ca640 1 --2- 172.21.15.42:0/4064794408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f24128d40 0x7f0f241314f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0f14009720 tx=0x7f0f1402b8d0 comp rx=0 tx=0).stop 2024-05-08T18:50:11.320 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.317+0000 7f0f2b6ca640 1 -- 172.21.15.42:0/4064794408 shutdown_connections 2024-05-08T18:50:11.320 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.317+0000 7f0f2b6ca640 1 --2- 172.21.15.42:0/4064794408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f24128d40 0x7f0f241314f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:11.320 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.317+0000 7f0f2b6ca640 1 -- 172.21.15.42:0/4064794408 >> 172.21.15.42:0/4064794408 conn(0x7f0f2409d620 msgr2=0x7f0f2409da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:11.320 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.317+0000 7f0f2b6ca640 1 -- 172.21.15.42:0/4064794408 shutdown_connections 2024-05-08T18:50:11.320 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.317+0000 7f0f2b6ca640 1 -- 172.21.15.42:0/4064794408 wait complete. 2024-05-08T18:50:11.320 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.318+0000 7f0f2b6ca640 1 Processor -- start 2024-05-08T18:50:11.320 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.318+0000 7f0f2b6ca640 1 -- start start 2024-05-08T18:50:11.320 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.318+0000 7f0f2b6ca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f24070310 0x7f0f24121ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:11.320 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.318+0000 7f0f2b6ca640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f0f24131bb0 con 0x7f0f24070310 2024-05-08T18:50:11.320 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.318+0000 7f0f29466640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f24070310 0x7f0f24121ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:11.320 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.318+0000 7f0f29466640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f24070310 0x7f0f24121ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:38394/0 (socket says 172.21.15.42:38394) 2024-05-08T18:50:11.320 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.318+0000 7f0f29466640 1 -- 172.21.15.42:0/528593401 learned_addr learned my addr 172.21.15.42:0/528593401 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:11.321 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.318+0000 7f0f29466640 1 -- 172.21.15.42:0/528593401 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f241306a0 con 0x7f0f24070310 2024-05-08T18:50:11.321 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.318+0000 7f0f29466640 1 --2- 172.21.15.42:0/528593401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f24070310 0x7f0f24121ce0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0f2000c700 tx=0x7f0f2000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:11.321 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.319+0000 7f0f19ffb640 1 -- 172.21.15.42:0/528593401 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f20018070 con 0x7f0f24070310 2024-05-08T18:50:11.321 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.319+0000 7f0f19ffb640 1 -- 172.21.15.42:0/528593401 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f200070d0 con 0x7f0f24070310 2024-05-08T18:50:11.321 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.319+0000 7f0f2b6ca640 1 -- 172.21.15.42:0/528593401 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f241311c0 con 0x7f0f24070310 2024-05-08T18:50:11.321 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.319+0000 7f0f19ffb640 1 -- 172.21.15.42:0/528593401 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f200073f0 con 0x7f0f24070310 2024-05-08T18:50:11.321 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.319+0000 7f0f2b6ca640 1 -- 172.21.15.42:0/528593401 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f241188b0 con 0x7f0f24070310 2024-05-08T18:50:11.321 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.319+0000 7f0f19ffb640 1 -- 172.21.15.42:0/528593401 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0f2001b070 con 0x7f0f24070310 2024-05-08T18:50:11.321 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.319+0000 7f0f19ffb640 1 -- 172.21.15.42:0/528593401 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f0f2001c3b0 con 0x7f0f24070310 2024-05-08T18:50:11.321 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.320+0000 7f0f2b6ca640 1 -- 172.21.15.42:0/528593401 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f24126280 con 0x7f0f24070310 2024-05-08T18:50:11.322 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.322+0000 7f0f19ffb640 1 -- 172.21.15.42:0/528593401 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0f24126280 con 0x7f0f24070310 2024-05-08T18:50:11.372 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:11.373+0000 7f1657613040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T18:50:11.383 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.384+0000 7f0f2b6ca640 1 -- 172.21.15.42:0/528593401 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f24064010 con 0x7f0f24070310 2024-05-08T18:50:11.384 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.384+0000 7f0f19ffb640 1 -- 172.21.15.42:0/528593401 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f0f20022070 con 0x7f0f24070310 2024-05-08T18:50:11.384 INFO:teuthology.misc.health.smithi042.stdout: 2024-05-08T18:50:11.384 INFO:teuthology.misc.health.smithi042.stdout:{"epoch":6,"fsid":"772ec65a-301b-4446-89ae-86d9bcfb0a5c","created":"2024-05-08T18:50:09.489497+0000","modified":"2024-05-08T18:50:10.598140+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T18:50:10.598140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0977d23d-95b7-40ad-9731-d8830f6eed5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cb3d63fc-91ce-46e0-8917-0552f4753541","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c3d3af18-54c3-492d-a4f1-72075b0fd6da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"07166424-d9c6-44be-b49f-173ad316b7c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:50:11.385 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.385+0000 7f0f2b6ca640 1 -- 172.21.15.42:0/528593401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f24070310 msgr2=0x7f0f24121ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:11.385 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.385+0000 7f0f2b6ca640 1 --2- 172.21.15.42:0/528593401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f24070310 0x7f0f24121ce0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0f2000c700 tx=0x7f0f2000cbc0 comp rx=0 tx=0).stop 2024-05-08T18:50:11.385 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.385+0000 7f0f2b6ca640 1 -- 172.21.15.42:0/528593401 shutdown_connections 2024-05-08T18:50:11.385 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.385+0000 7f0f2b6ca640 1 --2- 172.21.15.42:0/528593401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0f24070310 0x7f0f24121ce0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:11.386 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.385+0000 7f0f2b6ca640 1 -- 172.21.15.42:0/528593401 >> 172.21.15.42:0/528593401 conn(0x7f0f2409d620 msgr2=0x7f0f2406f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:11.386 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.385+0000 7f0f2b6ca640 1 -- 172.21.15.42:0/528593401 shutdown_connections 2024-05-08T18:50:11.386 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:11.385+0000 7f0f2b6ca640 1 -- 172.21.15.42:0/528593401 wait complete. 2024-05-08T18:50:11.394 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-05-08T18:50:11.419 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:11.419+0000 7f1657613040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T18:50:11.470 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:11.471+0000 7f1657613040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T18:50:11.583 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:11.584+0000 7f1657613040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T18:50:11.959 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:11.959+0000 7f1657613040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T18:50:12.098 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:12.099+0000 7f1657613040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-08T18:50:12.358 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:12.359+0000 7f1657613040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T18:50:12.410 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:12.411+0000 7f1657613040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T18:50:12.526 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:12.526+0000 7f1657613040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T18:50:12.823 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:12.823+0000 7f1657613040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T18:50:12.871 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:12.872+0000 7f1657613040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T18:50:13.028 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:13.029+0000 7f1657613040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T18:50:13.163 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:13.164+0000 7f1657613040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T18:50:13.213 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:13.214+0000 7f1657613040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T18:50:13.281 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:13.282+0000 7f1657613040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T18:50:13.326 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:13.327+0000 7f1657613040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T18:50:13.805 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:13.805+0000 7f1657613040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T18:50:13.918 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:13.919+0000 7f1657613040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T18:50:14.635 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-08T18:50:14.635+0000 7f64b1203640 -1 osd.0 0 log_to_monitors true 2024-05-08T18:50:14.746 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-05-08T18:50:14.746+0000 7f08c2a0e640 -1 osd.2 0 log_to_monitors true 2024-05-08T18:50:14.752 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-05-08T18:50:14.753+0000 7fa182a13640 -1 osd.1 0 log_to_monitors true 2024-05-08T18:50:14.766 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-05-08T18:50:14.767+0000 7f9bf3a1e640 -1 osd.3 0 log_to_monitors true 2024-05-08T18:50:14.928 INFO:tasks.ceph.mgr.x.smithi132.stderr:2024-05-08T18:50:14.928+0000 7f15f6d45640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-05-08T18:50:16.727 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-08T18:50:16.727+0000 7f64ad199640 -1 osd.0 0 waiting for initial osdmap 2024-05-08T18:50:16.746 INFO:tasks.ceph.osd.0.smithi042.stderr:2024-05-08T18:50:16.747+0000 7f64a4fb9640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:50:17.637 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-05-08T18:50:17.638+0000 7f08be354640 -1 osd.2 0 waiting for initial osdmap 2024-05-08T18:50:17.645 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-05-08T18:50:17.646+0000 7fa17e3ff640 -1 osd.1 0 waiting for initial osdmap 2024-05-08T18:50:17.648 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-05-08T18:50:17.649+0000 7f9bef2e8640 -1 osd.3 0 waiting for initial osdmap 2024-05-08T18:50:17.655 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-05-08T18:50:17.656+0000 7f08b6174640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:50:17.663 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-05-08T18:50:17.664+0000 7f9be7119640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:50:17.669 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-05-08T18:50:17.670+0000 7fa17621f640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:50:17.798 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T18:50:17.904 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.905+0000 7f2dced06640 1 Processor -- start 2024-05-08T18:50:17.904 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.905+0000 7f2dced06640 1 -- start start 2024-05-08T18:50:17.905 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.905+0000 7f2dced06640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2dc8132810 0x7f2dc8134c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:17.905 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.905+0000 7f2dced06640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dc8072000 con 0x7f2dc8070640 2024-05-08T18:50:17.905 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.905+0000 7f2dced06640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f2dc8072670 con 0x7f2dc8132810 2024-05-08T18:50:17.905 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.905+0000 7f2dc7fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2dc8132810 0x7f2dc8134c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:17.905 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.905+0000 7f2dccaa2640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f2dc8070640 0x7f2dc8070a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:33006/0 (socket says 172.21.15.42:33006) 2024-05-08T18:50:17.905 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.905+0000 7f2dccaa2640 1 -- 172.21.15.42:0/1485069644 learned_addr learned my addr 172.21.15.42:0/1485069644 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:50:17.905 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.906+0000 7f2dc7fff640 1 -- 172.21.15.42:0/1485069644 >> v1:172.21.15.42:6789/0 conn(0x7f2dc8070640 legacy=0x7f2dc8070a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:17.905 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.906+0000 7f2dc7fff640 1 -- 172.21.15.42:0/1485069644 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc8073530 con 0x7f2dc8132810 2024-05-08T18:50:17.907 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.906+0000 7f2dc7fff640 1 --2- 172.21.15.42:0/1485069644 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dc8132810 0x7f2dc8134c00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009720 tx=0x7f2db002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4243ad26c92c0b32 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:17.907 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.906+0000 7f2dc77fe640 1 -- 172.21.15.42:0/1485069644 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db00316d0 con 0x7f2dc8132810 2024-05-08T18:50:17.907 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.906+0000 7f2dc77fe640 1 -- 172.21.15.42:0/1485069644 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db0037070 con 0x7f2dc8132810 2024-05-08T18:50:17.907 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.906+0000 7f2dc77fe640 1 -- 172.21.15.42:0/1485069644 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db00319c0 con 0x7f2dc8132810 2024-05-08T18:50:17.907 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.907+0000 7f2dced06640 1 -- 172.21.15.42:0/1485069644 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dc8132810 msgr2=0x7f2dc8134c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:17.907 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.907+0000 7f2dced06640 1 --2- 172.21.15.42:0/1485069644 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dc8132810 0x7f2dc8134c00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009720 tx=0x7f2db002b840 comp rx=0 tx=0).stop 2024-05-08T18:50:17.907 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.907+0000 7f2dced06640 1 -- 172.21.15.42:0/1485069644 shutdown_connections 2024-05-08T18:50:17.907 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.907+0000 7f2dced06640 1 --2- 172.21.15.42:0/1485069644 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dc8132810 0x7f2dc8134c00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:17.907 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.907+0000 7f2dced06640 1 -- 172.21.15.42:0/1485069644 >> 172.21.15.42:0/1485069644 conn(0x7f2dc80a1e50 msgr2=0x7f2dc80a2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:17.907 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.907+0000 7f2dced06640 1 -- 172.21.15.42:0/1485069644 shutdown_connections 2024-05-08T18:50:17.907 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.907+0000 7f2dced06640 1 -- 172.21.15.42:0/1485069644 wait complete. 2024-05-08T18:50:17.908 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.908+0000 7f2dced06640 1 Processor -- start 2024-05-08T18:50:17.908 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.908+0000 7f2dced06640 1 -- start start 2024-05-08T18:50:17.910 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.909+0000 7f2dced06640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dc8070640 0x7f2dc812bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:17.910 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.909+0000 7f2dced06640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc8072de0 con 0x7f2dc8070640 2024-05-08T18:50:17.910 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.909+0000 7f2dccaa2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dc8070640 0x7f2dc812bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:17.910 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.909+0000 7f2dccaa2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dc8070640 0x7f2dc812bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46234/0 (socket says 172.21.15.42:46234) 2024-05-08T18:50:17.910 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.909+0000 7f2dccaa2640 1 -- 172.21.15.42:0/2750132150 learned_addr learned my addr 172.21.15.42:0/2750132150 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:17.910 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.909+0000 7f2dccaa2640 1 -- 172.21.15.42:0/2750132150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc811eb60 con 0x7f2dc8070640 2024-05-08T18:50:17.910 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.909+0000 7f2dccaa2640 1 --2- 172.21.15.42:0/2750132150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dc8070640 0x7f2dc812bc00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2db800c4a0 tx=0x7f2db800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:17.910 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.909+0000 7f2dc57fa640 1 -- 172.21.15.42:0/2750132150 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db8017070 con 0x7f2dc8070640 2024-05-08T18:50:17.910 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.909+0000 7f2dc57fa640 1 -- 172.21.15.42:0/2750132150 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db8005c10 con 0x7f2dc8070640 2024-05-08T18:50:17.910 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.909+0000 7f2dced06640 1 -- 172.21.15.42:0/2750132150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc811e350 con 0x7f2dc8070640 2024-05-08T18:50:17.911 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.909+0000 7f2dc57fa640 1 -- 172.21.15.42:0/2750132150 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db8007070 con 0x7f2dc8070640 2024-05-08T18:50:17.911 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.909+0000 7f2dced06640 1 -- 172.21.15.42:0/2750132150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc812c140 con 0x7f2dc8070640 2024-05-08T18:50:17.911 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.910+0000 7f2dc57fa640 1 -- 172.21.15.42:0/2750132150 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) ==== 49355+0+0 (secure 0 0 0) 0x7f2db801a070 con 0x7f2dc8070640 2024-05-08T18:50:17.911 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.910+0000 7f2dced06640 1 -- 172.21.15.42:0/2750132150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dc8064010 con 0x7f2dc8070640 2024-05-08T18:50:17.911 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.911+0000 7f2dc57fa640 1 --2- 172.21.15.42:0/2750132150 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2da803d220 0x7f2da803f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:17.911 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.911+0000 7f2dc57fa640 1 -- 172.21.15.42:0/2750132150 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 2743+0+0 (secure 0 0 0) 0x7f2db80501e0 con 0x7f2dc8070640 2024-05-08T18:50:17.911 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.911+0000 7f2dc7fff640 1 --2- 172.21.15.42:0/2750132150 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2da803d220 0x7f2da803f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:17.911 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.911+0000 7f2dc7fff640 1 --2- 172.21.15.42:0/2750132150 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2da803d220 0x7f2da803f6e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2db0036000 tx=0x7f2db0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:17.914 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:17.916+0000 7f2dc57fa640 1 -- 172.21.15.42:0/2750132150 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f2db8019cd0 con 0x7f2dc8070640 2024-05-08T18:50:18.108 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:18.109+0000 7f2dced06640 1 -- 172.21.15.42:0/2750132150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2dc8132080 con 0x7f2dc8070640 2024-05-08T18:50:18.109 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:18.110+0000 7f2dc57fa640 1 -- 172.21.15.42:0/2750132150 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) ==== 74+0+6080 (secure 0 0 0) 0x7f2db801ac40 con 0x7f2dc8070640 2024-05-08T18:50:18.109 INFO:teuthology.misc.health.smithi042.stdout: 2024-05-08T18:50:18.109 INFO:teuthology.misc.health.smithi042.stdout:{"epoch":9,"fsid":"772ec65a-301b-4446-89ae-86d9bcfb0a5c","created":"2024-05-08T18:50:09.489497+0000","modified":"2024-05-08T18:50:17.729597+0000","last_up_change":"2024-05-08T18:50:17.729597+0000","last_in_change":"2024-05-08T18:50:10.598140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0977d23d-95b7-40ad-9731-d8830f6eed5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1521799280},{"type":"v1","addr":"172.21.15.42:6801","nonce":1521799280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1521799280},{"type":"v1","addr":"172.21.15.42:6803","nonce":1521799280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1521799280},{"type":"v1","addr":"172.21.15.42:6807","nonce":1521799280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1521799280},{"type":"v1","addr":"172.21.15.42:6805","nonce":1521799280}]},"public_addr":"172.21.15.42:6801/1521799280","cluster_addr":"172.21.15.42:6803/1521799280","heartbeat_back_addr":"172.21.15.42:6807/1521799280","heartbeat_front_addr":"172.21.15.42:6805/1521799280","state":["exists","up"]},{"osd":1,"uuid":"cb3d63fc-91ce-46e0-8917-0552f4753541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3697320277},{"type":"v1","addr":"172.21.15.132:6801","nonce":3697320277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3697320277},{"type":"v1","addr":"172.21.15.132:6803","nonce":3697320277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3697320277},{"type":"v1","addr":"172.21.15.132:6807","nonce":3697320277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3697320277},{"type":"v1","addr":"172.21.15.132:6805","nonce":3697320277}]},"public_addr":"172.21.15.132:6801/3697320277","cluster_addr":"172.21.15.132:6803/3697320277","heartbeat_back_addr":"172.21.15.132:6807/3697320277","heartbeat_front_addr":"172.21.15.132:6805/3697320277","state":["exists","up"]},{"osd":2,"uuid":"c3d3af18-54c3-492d-a4f1-72075b0fd6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":1108348591},{"type":"v1","addr":"172.21.15.132:6809","nonce":1108348591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":1108348591},{"type":"v1","addr":"172.21.15.132:6811","nonce":1108348591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":1108348591},{"type":"v1","addr":"172.21.15.132:6815","nonce":1108348591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":1108348591},{"type":"v1","addr":"172.21.15.132:6813","nonce":1108348591}]},"public_addr":"172.21.15.132:6809/1108348591","cluster_addr":"172.21.15.132:6811/1108348591","heartbeat_back_addr":"172.21.15.132:6815/1108348591","heartbeat_front_addr":"172.21.15.132:6813/1108348591","state":["exists","up"]},{"osd":3,"uuid":"07166424-d9c6-44be-b49f-173ad316b7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":17827703},{"type":"v1","addr":"172.21.15.132:6817","nonce":17827703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":17827703},{"type":"v1","addr":"172.21.15.132:6819","nonce":17827703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":17827703},{"type":"v1","addr":"172.21.15.132:6823","nonce":17827703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":17827703},{"type":"v1","addr":"172.21.15.132:6821","nonce":17827703}]},"public_addr":"172.21.15.132:6817/17827703","cluster_addr":"172.21.15.132:6819/17827703","heartbeat_back_addr":"172.21.15.132:6823/17827703","heartbeat_front_addr":"172.21.15.132:6821/17827703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:50:18.111 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:18.112+0000 7f2dced06640 1 -- 172.21.15.42:0/2750132150 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2da803d220 msgr2=0x7f2da803f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:18.111 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:18.112+0000 7f2dced06640 1 --2- 172.21.15.42:0/2750132150 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2da803d220 0x7f2da803f6e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2db0036000 tx=0x7f2db0008030 comp rx=0 tx=0).stop 2024-05-08T18:50:18.111 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:18.112+0000 7f2dced06640 1 -- 172.21.15.42:0/2750132150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dc8070640 msgr2=0x7f2dc812bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:18.111 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:18.112+0000 7f2dced06640 1 --2- 172.21.15.42:0/2750132150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dc8070640 0x7f2dc812bc00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2db800c4a0 tx=0x7f2db800c960 comp rx=0 tx=0).stop 2024-05-08T18:50:18.111 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:18.112+0000 7f2dced06640 1 -- 172.21.15.42:0/2750132150 shutdown_connections 2024-05-08T18:50:18.111 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:18.112+0000 7f2dced06640 1 --2- 172.21.15.42:0/2750132150 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2da803d220 0x7f2da803f6e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:18.111 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:18.112+0000 7f2dced06640 1 --2- 172.21.15.42:0/2750132150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2dc8070640 0x7f2dc812bc00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:18.111 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:18.112+0000 7f2dced06640 1 -- 172.21.15.42:0/2750132150 >> 172.21.15.42:0/2750132150 conn(0x7f2dc80a1e50 msgr2=0x7f2dc812d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:18.111 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:18.112+0000 7f2dced06640 1 -- 172.21.15.42:0/2750132150 shutdown_connections 2024-05-08T18:50:18.111 INFO:teuthology.misc.health.smithi042.stderr:2024-05-08T18:50:18.112+0000 7f2dced06640 1 -- 172.21.15.42:0/2750132150 wait complete. 2024-05-08T18:50:18.120 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-05-08T18:50:18.121 INFO:tasks.ceph:Creating RBD pool 2024-05-08T18:50:18.121 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd pool create rbd 8 2024-05-08T18:50:18.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.225+0000 7f5f021d7640 1 Processor -- start 2024-05-08T18:50:18.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.225+0000 7f5f021d7640 1 -- start start 2024-05-08T18:50:18.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.225+0000 7f5f021d7640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5efc12c5f0 0x7f5efc12c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:18.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.225+0000 7f5f021d7640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5efc12c1a0 con 0x7f5efc128b70 2024-05-08T18:50:18.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.225+0000 7f5f021d7640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f5efc06f770 con 0x7f5efc12c5f0 2024-05-08T18:50:18.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.226+0000 7f5efb7fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5efc12c5f0 0x7f5efc12c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:18.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.226+0000 7f5efb7fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5efc12c5f0 0x7f5efc12c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46248/0 (socket says 172.21.15.42:46248) 2024-05-08T18:50:18.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.226+0000 7f5efaffd640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f5efc128b70 0x7f5efc128fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:33020/0 (socket says 172.21.15.42:33020) 2024-05-08T18:50:18.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.226+0000 7f5efb7fe640 1 -- 172.21.15.42:0/4276153033 learned_addr learned my addr 172.21.15.42:0/4276153033 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:18.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.226+0000 7f5efb7fe640 1 -- 172.21.15.42:0/4276153033 >> v1:172.21.15.42:6789/0 conn(0x7f5efc128b70 legacy=0x7f5efc128fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:18.225 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.226+0000 7f5efb7fe640 1 -- 172.21.15.42:0/4276153033 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5efc08fc20 con 0x7f5efc12c5f0 2024-05-08T18:50:18.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.227+0000 7f5efb7fe640 1 --2- 172.21.15.42:0/4276153033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5efc12c5f0 0x7f5efc12c9d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00ba90 tx=0x7f5eec02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84863bfbff819e53 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:18.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.227+0000 7f5efa7fc640 1 -- 172.21.15.42:0/4276153033 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5eec03b070 con 0x7f5efc12c5f0 2024-05-08T18:50:18.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.227+0000 7f5efa7fc640 1 -- 172.21.15.42:0/4276153033 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eec02edc0 con 0x7f5efc12c5f0 2024-05-08T18:50:18.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.227+0000 7f5efa7fc640 1 -- 172.21.15.42:0/4276153033 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5eec036590 con 0x7f5efc12c5f0 2024-05-08T18:50:18.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.227+0000 7f5f021d7640 1 -- 172.21.15.42:0/4276153033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5efc12c5f0 msgr2=0x7f5efc12c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:18.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.227+0000 7f5f021d7640 1 --2- 172.21.15.42:0/4276153033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5efc12c5f0 0x7f5efc12c9d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00ba90 tx=0x7f5eec02e0e0 comp rx=0 tx=0).stop 2024-05-08T18:50:18.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.227+0000 7f5f021d7640 1 -- 172.21.15.42:0/4276153033 shutdown_connections 2024-05-08T18:50:18.227 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.227+0000 7f5f021d7640 1 --2- 172.21.15.42:0/4276153033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5efc12c5f0 0x7f5efc12c9d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:18.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.227+0000 7f5f021d7640 1 -- 172.21.15.42:0/4276153033 >> 172.21.15.42:0/4276153033 conn(0x7f5efc09c5a0 msgr2=0x7f5efc09c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:18.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.227+0000 7f5f021d7640 1 -- 172.21.15.42:0/4276153033 shutdown_connections 2024-05-08T18:50:18.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.227+0000 7f5f021d7640 1 -- 172.21.15.42:0/4276153033 wait complete. 2024-05-08T18:50:18.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.228+0000 7f5f021d7640 1 Processor -- start 2024-05-08T18:50:18.228 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.228+0000 7f5f021d7640 1 -- start start 2024-05-08T18:50:18.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.229+0000 7f5f021d7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5efc128b70 0x7f5efc0703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:18.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.229+0000 7f5f021d7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5efc06fe20 con 0x7f5efc128b70 2024-05-08T18:50:18.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.229+0000 7f5efb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5efc128b70 0x7f5efc0703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:18.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.229+0000 7f5efb7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5efc128b70 0x7f5efc0703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46258/0 (socket says 172.21.15.42:46258) 2024-05-08T18:50:18.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.229+0000 7f5efb7fe640 1 -- 172.21.15.42:0/499960537 learned_addr learned my addr 172.21.15.42:0/499960537 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:18.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.229+0000 7f5efb7fe640 1 -- 172.21.15.42:0/499960537 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5efc071d80 con 0x7f5efc128b70 2024-05-08T18:50:18.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.229+0000 7f5efb7fe640 1 --2- 172.21.15.42:0/499960537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5efc128b70 0x7f5efc0703f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5eec000c00 tx=0x7f5eec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:18.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.229+0000 7f5ee3fff640 1 -- 172.21.15.42:0/499960537 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5eec045070 con 0x7f5efc128b70 2024-05-08T18:50:18.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.229+0000 7f5ee3fff640 1 -- 172.21.15.42:0/499960537 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eec0405b0 con 0x7f5efc128b70 2024-05-08T18:50:18.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.229+0000 7f5f021d7640 1 -- 172.21.15.42:0/499960537 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5efc071900 con 0x7f5efc128b70 2024-05-08T18:50:18.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.229+0000 7f5ee3fff640 1 -- 172.21.15.42:0/499960537 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5eec03b040 con 0x7f5efc128b70 2024-05-08T18:50:18.230 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.229+0000 7f5f021d7640 1 -- 172.21.15.42:0/499960537 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5efc0738d0 con 0x7f5efc128b70 2024-05-08T18:50:18.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.230+0000 7f5ee3fff640 1 -- 172.21.15.42:0/499960537 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) ==== 49355+0+0 (secure 0 0 0) 0x7f5eec048070 con 0x7f5efc128b70 2024-05-08T18:50:18.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.230+0000 7f5f021d7640 1 -- 172.21.15.42:0/499960537 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5efc064010 con 0x7f5efc128b70 2024-05-08T18:50:18.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.231+0000 7f5ee3fff640 1 --2- 172.21.15.42:0/499960537 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ee803d220 0x7f5ee803f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:18.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.231+0000 7f5ee3fff640 1 -- 172.21.15.42:0/499960537 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 2743+0+0 (secure 0 0 0) 0x7f5eec0759d0 con 0x7f5efc128b70 2024-05-08T18:50:18.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.231+0000 7f5efaffd640 1 --2- 172.21.15.42:0/499960537 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ee803d220 0x7f5ee803f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:18.231 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.231+0000 7f5efaffd640 1 --2- 172.21.15.42:0/499960537 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ee803d220 0x7f5ee803f6e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00015f0 tx=0x7f5ef0007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:18.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.236+0000 7f5ee3fff640 1 -- 172.21.15.42:0/499960537 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5eec049dc0 con 0x7f5efc128b70 2024-05-08T18:50:18.430 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.431+0000 7f5f021d7640 1 -- 172.21.15.42:0/499960537 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f5efc072c50 con 0x7f5efc128b70 2024-05-08T18:50:18.729 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.730+0000 7f5ee3fff640 1 -- 172.21.15.42:0/499960537 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v10) ==== 109+0+0 (secure 0 0 0) 0x7f5eec052c70 con 0x7f5efc128b70 2024-05-08T18:50:18.729 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'rbd' created 2024-05-08T18:50:18.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.733+0000 7f5f021d7640 1 -- 172.21.15.42:0/499960537 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ee803d220 msgr2=0x7f5ee803f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:18.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.733+0000 7f5f021d7640 1 --2- 172.21.15.42:0/499960537 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ee803d220 0x7f5ee803f6e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00015f0 tx=0x7f5ef0007a40 comp rx=0 tx=0).stop 2024-05-08T18:50:18.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.733+0000 7f5f021d7640 1 -- 172.21.15.42:0/499960537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5efc128b70 msgr2=0x7f5efc0703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:18.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.733+0000 7f5f021d7640 1 --2- 172.21.15.42:0/499960537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5efc128b70 0x7f5efc0703f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5eec000c00 tx=0x7f5eec0046c0 comp rx=0 tx=0).stop 2024-05-08T18:50:18.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.733+0000 7f5f021d7640 1 -- 172.21.15.42:0/499960537 shutdown_connections 2024-05-08T18:50:18.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.733+0000 7f5f021d7640 1 --2- 172.21.15.42:0/499960537 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ee803d220 0x7f5ee803f6e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:18.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.733+0000 7f5f021d7640 1 --2- 172.21.15.42:0/499960537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5efc128b70 0x7f5efc0703f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:18.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.733+0000 7f5f021d7640 1 -- 172.21.15.42:0/499960537 >> 172.21.15.42:0/499960537 conn(0x7f5efc09c5a0 msgr2=0x7f5efc09a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:18.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.733+0000 7f5f021d7640 1 -- 172.21.15.42:0/499960537 shutdown_connections 2024-05-08T18:50:18.733 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.733+0000 7f5f021d7640 1 -- 172.21.15.42:0/499960537 wait complete. 2024-05-08T18:50:18.744 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-05-08T18:50:18.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.850+0000 7fc0ec99d640 1 Processor -- start 2024-05-08T18:50:18.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.850+0000 7fc0ec99d640 1 -- start start 2024-05-08T18:50:18.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.851+0000 7fc0ec99d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc0e8132440 0x7fc0e8134830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:18.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.851+0000 7fc0ec99d640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0e809b0a0 con 0x7fc0e812f130 2024-05-08T18:50:18.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.851+0000 7fc0ec99d640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fc0e809b7c0 con 0x7fc0e8132440 2024-05-08T18:50:18.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.851+0000 7fc0e77fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fc0e812f130 0x7fc0e812f7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:33022/0 (socket says 172.21.15.42:33022) 2024-05-08T18:50:18.850 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.851+0000 7fc0e77fe640 1 -- 172.21.15.42:0/246696908 learned_addr learned my addr 172.21.15.42:0/246696908 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:50:18.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.851+0000 7fc0e6ffd640 1 --2- 172.21.15.42:0/246696908 >> v2:172.21.15.42:3300/0 conn(0x7fc0e8132440 0x7fc0e8134830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:18.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.851+0000 7fc0e6ffd640 1 -- 172.21.15.42:0/246696908 >> v1:172.21.15.42:6789/0 conn(0x7fc0e812f130 legacy=0x7fc0e812f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:18.851 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.851+0000 7fc0e6ffd640 1 -- 172.21.15.42:0/246696908 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e809a460 con 0x7fc0e8132440 2024-05-08T18:50:18.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.852+0000 7fc0e6ffd640 1 --2- 172.21.15.42:0/246696908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0e8132440 0x7fc0e8134830 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc009720 tx=0x7fc0dc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2407177f8b13b19c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:18.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.852+0000 7fc0e67fc640 1 -- 172.21.15.42:0/246696908 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0dc035020 con 0x7fc0e8132440 2024-05-08T18:50:18.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.852+0000 7fc0e67fc640 1 -- 172.21.15.42:0/246696908 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0dc031760 con 0x7fc0e8132440 2024-05-08T18:50:18.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.852+0000 7fc0e67fc640 1 -- 172.21.15.42:0/246696908 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0dc031a60 con 0x7fc0e8132440 2024-05-08T18:50:18.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.853+0000 7fc0ec99d640 1 -- 172.21.15.42:0/246696908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0e8132440 msgr2=0x7fc0e8134830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:18.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.853+0000 7fc0ec99d640 1 --2- 172.21.15.42:0/246696908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0e8132440 0x7fc0e8134830 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc009720 tx=0x7fc0dc02b8d0 comp rx=0 tx=0).stop 2024-05-08T18:50:18.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.853+0000 7fc0ec99d640 1 -- 172.21.15.42:0/246696908 shutdown_connections 2024-05-08T18:50:18.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.853+0000 7fc0ec99d640 1 --2- 172.21.15.42:0/246696908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0e8132440 0x7fc0e8134830 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:18.852 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.853+0000 7fc0ec99d640 1 -- 172.21.15.42:0/246696908 >> 172.21.15.42:0/246696908 conn(0x7fc0e809e540 msgr2=0x7fc0e809e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:18.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.853+0000 7fc0ec99d640 1 -- 172.21.15.42:0/246696908 shutdown_connections 2024-05-08T18:50:18.853 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.853+0000 7fc0ec99d640 1 -- 172.21.15.42:0/246696908 wait complete. 2024-05-08T18:50:18.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.854+0000 7fc0ec99d640 1 Processor -- start 2024-05-08T18:50:18.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.854+0000 7fc0ec99d640 1 -- start start 2024-05-08T18:50:18.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.854+0000 7fc0ec99d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0e812f130 0x7fc0e811ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:18.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.854+0000 7fc0ec99d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e8130070 con 0x7fc0e812f130 2024-05-08T18:50:18.854 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.854+0000 7fc0e77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0e812f130 0x7fc0e811ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:18.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.854+0000 7fc0e77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0e812f130 0x7fc0e811ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46272/0 (socket says 172.21.15.42:46272) 2024-05-08T18:50:18.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.854+0000 7fc0e77fe640 1 -- 172.21.15.42:0/2405668180 learned_addr learned my addr 172.21.15.42:0/2405668180 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:18.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.854+0000 7fc0e77fe640 1 -- 172.21.15.42:0/2405668180 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e8131d50 con 0x7fc0e812f130 2024-05-08T18:50:18.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.855+0000 7fc0e77fe640 1 --2- 172.21.15.42:0/2405668180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0e812f130 0x7fc0e811ddd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc0d800c480 tx=0x7fc0d800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:18.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.855+0000 7fc0cffff640 1 -- 172.21.15.42:0/2405668180 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0d8017070 con 0x7fc0e812f130 2024-05-08T18:50:18.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.855+0000 7fc0cffff640 1 -- 172.21.15.42:0/2405668180 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d8005c10 con 0x7fc0e812f130 2024-05-08T18:50:18.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.855+0000 7fc0ec99d640 1 -- 172.21.15.42:0/2405668180 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0e8120af0 con 0x7fc0e812f130 2024-05-08T18:50:18.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.855+0000 7fc0cffff640 1 -- 172.21.15.42:0/2405668180 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0d80070d0 con 0x7fc0e812f130 2024-05-08T18:50:18.855 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.855+0000 7fc0ec99d640 1 -- 172.21.15.42:0/2405668180 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0e811e310 con 0x7fc0e812f130 2024-05-08T18:50:18.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.856+0000 7fc0cffff640 1 -- 172.21.15.42:0/2405668180 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) ==== 49355+0+0 (secure 0 0 0) 0x7fc0d801a070 con 0x7fc0e812f130 2024-05-08T18:50:18.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.856+0000 7fc0ec99d640 1 -- 172.21.15.42:0/2405668180 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0e811efc0 con 0x7fc0e812f130 2024-05-08T18:50:18.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.856+0000 7fc0cffff640 1 --2- 172.21.15.42:0/2405668180 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc0d403d220 0x7fc0d403f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:18.856 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.856+0000 7fc0cffff640 1 -- 172.21.15.42:0/2405668180 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 3460+0+0 (secure 0 0 0) 0x7fc0d8050450 con 0x7fc0e812f130 2024-05-08T18:50:18.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.856+0000 7fc0e6ffd640 1 --2- 172.21.15.42:0/2405668180 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc0d403d220 0x7fc0d403f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:18.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.857+0000 7fc0e6ffd640 1 --2- 172.21.15.42:0/2405668180 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc0d403d220 0x7fc0d403f6e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc036000 tx=0x7fc0dc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:18.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:18.861+0000 7fc0cffff640 1 -- 172.21.15.42:0/2405668180 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc0e809b0a0 con 0x7fc0e812f130 2024-05-08T18:50:19.049 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.050+0000 7fc0ec99d640 1 -- 172.21.15.42:0/2405668180 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7fc0e8064010 con 0x7fc0e812f130 2024-05-08T18:50:19.730 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.731+0000 7fc0cffff640 1 -- 172.21.15.42:0/2405668180 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v11) ==== 173+0+0 (secure 0 0 0) 0x7fc0d8010c90 con 0x7fc0e812f130 2024-05-08T18:50:19.730 INFO:teuthology.orchestra.run.smithi042.stderr:enabled application 'rbd' on pool 'rbd' 2024-05-08T18:50:19.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.735+0000 7fc0ec99d640 1 -- 172.21.15.42:0/2405668180 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc0d403d220 msgr2=0x7fc0d403f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:19.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.735+0000 7fc0ec99d640 1 --2- 172.21.15.42:0/2405668180 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc0d403d220 0x7fc0d403f6e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc036000 tx=0x7fc0dc008030 comp rx=0 tx=0).stop 2024-05-08T18:50:19.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.735+0000 7fc0ec99d640 1 -- 172.21.15.42:0/2405668180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0e812f130 msgr2=0x7fc0e811ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:19.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.735+0000 7fc0ec99d640 1 --2- 172.21.15.42:0/2405668180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0e812f130 0x7fc0e811ddd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc0d800c480 tx=0x7fc0d800c940 comp rx=0 tx=0).stop 2024-05-08T18:50:19.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.735+0000 7fc0ec99d640 1 -- 172.21.15.42:0/2405668180 shutdown_connections 2024-05-08T18:50:19.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.735+0000 7fc0ec99d640 1 --2- 172.21.15.42:0/2405668180 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc0d403d220 0x7fc0d403f6e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:19.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.735+0000 7fc0ec99d640 1 --2- 172.21.15.42:0/2405668180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0e812f130 0x7fc0e811ddd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:19.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.735+0000 7fc0ec99d640 1 -- 172.21.15.42:0/2405668180 >> 172.21.15.42:0/2405668180 conn(0x7fc0e809e540 msgr2=0x7fc0e8130b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:19.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.735+0000 7fc0ec99d640 1 -- 172.21.15.42:0/2405668180 shutdown_connections 2024-05-08T18:50:19.735 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.735+0000 7fc0ec99d640 1 -- 172.21.15.42:0/2405668180 wait complete. 2024-05-08T18:50:19.749 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-08T18:50:19.749 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-08T18:50:19.749 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-08T18:50:19.749 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-08T18:50:19.750 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-08T18:50:19.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.862+0000 7fe535ad4640 1 Processor -- start 2024-05-08T18:50:19.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.862+0000 7fe535ad4640 1 -- start start 2024-05-08T18:50:19.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.863+0000 7fe535ad4640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe53012c7f0 0x7fe53012cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:19.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.863+0000 7fe535ad4640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5300a23e0 con 0x7fe530070850 2024-05-08T18:50:19.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.863+0000 7fe535ad4640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fe530072fc0 con 0x7fe53012c7f0 2024-05-08T18:50:19.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.863+0000 7fe52f7fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe53012c7f0 0x7fe53012cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:19.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.863+0000 7fe52effd640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe530070850 0x7fe530070ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:33026/0 (socket says 172.21.15.42:33026) 2024-05-08T18:50:19.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.863+0000 7fe52effd640 1 -- 172.21.15.42:0/2609987276 learned_addr learned my addr 172.21.15.42:0/2609987276 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:50:19.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.863+0000 7fe52f7fe640 1 -- 172.21.15.42:0/2609987276 >> v1:172.21.15.42:6789/0 conn(0x7fe530070850 legacy=0x7fe530070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:19.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.863+0000 7fe52f7fe640 1 -- 172.21.15.42:0/2609987276 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe530071f80 con 0x7fe53012c7f0 2024-05-08T18:50:19.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.863+0000 7fe52e7fc640 1 -- 172.21.15.42:0/2609987276 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4269205561 0 0) 0x7fe5300a23e0 con 0x7fe530070850 2024-05-08T18:50:19.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.864+0000 7fe52f7fe640 1 --2- 172.21.15.42:0/2609987276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe53012c7f0 0x7fe53012cbd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe520009720 tx=0x7fe52002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503a10d8e769429e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:19.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.864+0000 7fe52e7fc640 1 -- 172.21.15.42:0/2609987276 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5200316d0 con 0x7fe53012c7f0 2024-05-08T18:50:19.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.864+0000 7fe52e7fc640 1 -- 172.21.15.42:0/2609987276 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe520037070 con 0x7fe53012c7f0 2024-05-08T18:50:19.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.864+0000 7fe52e7fc640 1 -- 172.21.15.42:0/2609987276 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5200319c0 con 0x7fe53012c7f0 2024-05-08T18:50:19.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.865+0000 7fe535ad4640 1 -- 172.21.15.42:0/2609987276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe53012c7f0 msgr2=0x7fe53012cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:19.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.865+0000 7fe535ad4640 1 --2- 172.21.15.42:0/2609987276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe53012c7f0 0x7fe53012cbd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe520009720 tx=0x7fe52002b840 comp rx=0 tx=0).stop 2024-05-08T18:50:19.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.865+0000 7fe535ad4640 1 -- 172.21.15.42:0/2609987276 shutdown_connections 2024-05-08T18:50:19.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.865+0000 7fe535ad4640 1 --2- 172.21.15.42:0/2609987276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe53012c7f0 0x7fe53012cbd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:19.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.865+0000 7fe535ad4640 1 -- 172.21.15.42:0/2609987276 >> 172.21.15.42:0/2609987276 conn(0x7fe53009ff90 msgr2=0x7fe5300a1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:19.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.865+0000 7fe535ad4640 1 -- 172.21.15.42:0/2609987276 shutdown_connections 2024-05-08T18:50:19.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.865+0000 7fe535ad4640 1 -- 172.21.15.42:0/2609987276 wait complete. 2024-05-08T18:50:19.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.866+0000 7fe535ad4640 1 Processor -- start 2024-05-08T18:50:19.865 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.866+0000 7fe535ad4640 1 -- start start 2024-05-08T18:50:19.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.866+0000 7fe535ad4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe530070850 0x7fe5301c0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:19.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.866+0000 7fe535ad4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe530071530 con 0x7fe530070850 2024-05-08T18:50:19.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.866+0000 7fe52f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe530070850 0x7fe5301c0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:19.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.866+0000 7fe52f7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe530070850 0x7fe5301c0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46290/0 (socket says 172.21.15.42:46290) 2024-05-08T18:50:19.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.866+0000 7fe52f7fe640 1 -- 172.21.15.42:0/3298392328 learned_addr learned my addr 172.21.15.42:0/3298392328 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:19.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.867+0000 7fe52f7fe640 1 -- 172.21.15.42:0/3298392328 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe53011bea0 con 0x7fe530070850 2024-05-08T18:50:19.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.867+0000 7fe52f7fe640 1 --2- 172.21.15.42:0/3298392328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe530070850 0x7fe5301c0d60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe52002b880 tx=0x7fe5200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:19.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.867+0000 7fe517fff640 1 -- 172.21.15.42:0/3298392328 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe520004030 con 0x7fe530070850 2024-05-08T18:50:19.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.867+0000 7fe517fff640 1 -- 172.21.15.42:0/3298392328 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5200041d0 con 0x7fe530070850 2024-05-08T18:50:19.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.867+0000 7fe535ad4640 1 -- 172.21.15.42:0/3298392328 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe53011db80 con 0x7fe530070850 2024-05-08T18:50:19.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.867+0000 7fe517fff640 1 -- 172.21.15.42:0/3298392328 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe520032640 con 0x7fe530070850 2024-05-08T18:50:19.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.867+0000 7fe535ad4640 1 -- 172.21.15.42:0/3298392328 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5301c12a0 con 0x7fe530070850 2024-05-08T18:50:19.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.868+0000 7fe517fff640 1 -- 172.21.15.42:0/3298392328 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) ==== 49355+0+0 (secure 0 0 0) 0x7fe5200327e0 con 0x7fe530070850 2024-05-08T18:50:19.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.868+0000 7fe535ad4640 1 -- 172.21.15.42:0/3298392328 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe530064010 con 0x7fe530070850 2024-05-08T18:50:19.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.868+0000 7fe517fff640 1 --2- 172.21.15.42:0/3298392328 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe51c03d220 0x7fe51c03f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:19.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.868+0000 7fe517fff640 1 -- 172.21.15.42:0/3298392328 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 3482+0+0 (secure 0 0 0) 0x7fe52002f050 con 0x7fe530070850 2024-05-08T18:50:19.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.868+0000 7fe52effd640 1 --2- 172.21.15.42:0/3298392328 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe51c03d220 0x7fe51c03f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:19.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.869+0000 7fe52effd640 1 --2- 172.21.15.42:0/3298392328 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe51c03d220 0x7fe51c03f6e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe524000c00 tx=0x7fe524007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:19.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:19.873+0000 7fe517fff640 1 -- 172.21.15.42:0/3298392328 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fe520041070 con 0x7fe530070850 2024-05-08T18:50:20.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.115+0000 7fe535ad4640 1 -- 172.21.15.42:0/3298392328 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fe5300a2930 con 0x7fe530070850 2024-05-08T18:50:20.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.117+0000 7fe517fff640 1 -- 172.21.15.42:0/3298392328 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) ==== 74+0+95402 (secure 0 0 0) 0x7fe520003610 con 0x7fe530070850 2024-05-08T18:50:20.117 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:50:20.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.119+0000 7fe535ad4640 1 -- 172.21.15.42:0/3298392328 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe51c03d220 msgr2=0x7fe51c03f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.119+0000 7fe535ad4640 1 --2- 172.21.15.42:0/3298392328 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe51c03d220 0x7fe51c03f6e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe524000c00 tx=0x7fe524007910 comp rx=0 tx=0).stop 2024-05-08T18:50:20.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.119+0000 7fe535ad4640 1 -- 172.21.15.42:0/3298392328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe530070850 msgr2=0x7fe5301c0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.119+0000 7fe535ad4640 1 --2- 172.21.15.42:0/3298392328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe530070850 0x7fe5301c0d60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe52002b880 tx=0x7fe5200046c0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.119+0000 7fe535ad4640 1 -- 172.21.15.42:0/3298392328 shutdown_connections 2024-05-08T18:50:20.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.119+0000 7fe535ad4640 1 --2- 172.21.15.42:0/3298392328 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe51c03d220 0x7fe51c03f6e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.119+0000 7fe535ad4640 1 --2- 172.21.15.42:0/3298392328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe530070850 0x7fe5301c0d60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.119+0000 7fe535ad4640 1 -- 172.21.15.42:0/3298392328 >> 172.21.15.42:0/3298392328 conn(0x7fe53009ff90 msgr2=0x7fe5301b7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:20.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.119+0000 7fe535ad4640 1 -- 172.21.15.42:0/3298392328 shutdown_connections 2024-05-08T18:50:20.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.119+0000 7fe535ad4640 1 -- 172.21.15.42:0/3298392328 wait complete. 2024-05-08T18:50:20.129 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":4,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2104266563},{"type":"v1","addr":"172.21.15.132:6825","nonce":2104266563}]},"active_addr":"172.21.15.132:6825/2104266563","active_change":"2024-05-08T18:50:13.922164+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":93063830}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":1750165252}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":1441278879}]}]} 2024-05-08T18:50:20.131 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-08T18:50:20.131 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-08T18:50:20.131 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:50:20.233 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.234+0000 7f8c97142640 1 Processor -- start 2024-05-08T18:50:20.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.234+0000 7f8c97142640 1 -- start start 2024-05-08T18:50:20.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.234+0000 7f8c97142640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8c90129560 0x7f8c901313d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:20.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.234+0000 7f8c97142640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c90072dc0 con 0x7f8c9006fe20 2024-05-08T18:50:20.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.234+0000 7f8c97142640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f8c901299f0 con 0x7f8c90129560 2024-05-08T18:50:20.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.234+0000 7f8c87fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8c90129560 0x7f8c901313d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:20.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.234+0000 7f8c94ede640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f8c9006fe20 0x7f8c90128e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:33032/0 (socket says 172.21.15.42:33032) 2024-05-08T18:50:20.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.234+0000 7f8c94ede640 1 -- 172.21.15.42:0/3341069580 learned_addr learned my addr 172.21.15.42:0/3341069580 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:50:20.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.235+0000 7f8c87fff640 1 -- 172.21.15.42:0/3341069580 >> v1:172.21.15.42:6789/0 conn(0x7f8c9006fe20 legacy=0x7f8c90128e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.234 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.235+0000 7f8c87fff640 1 -- 172.21.15.42:0/3341069580 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c90128ad0 con 0x7f8c90129560 2024-05-08T18:50:20.235 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.235+0000 7f8c87fff640 1 --2- 172.21.15.42:0/3341069580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c90129560 0x7f8c901313d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009720 tx=0x7f8c8002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906eed5d03899394 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:20.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.236+0000 7f8c877fe640 1 -- 172.21.15.42:0/3341069580 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c800316d0 con 0x7f8c90129560 2024-05-08T18:50:20.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.236+0000 7f8c877fe640 1 -- 172.21.15.42:0/3341069580 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c80037070 con 0x7f8c90129560 2024-05-08T18:50:20.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.236+0000 7f8c877fe640 1 -- 172.21.15.42:0/3341069580 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c800319c0 con 0x7f8c90129560 2024-05-08T18:50:20.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.236+0000 7f8c97142640 1 -- 172.21.15.42:0/3341069580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c90129560 msgr2=0x7f8c901313d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.236+0000 7f8c97142640 1 --2- 172.21.15.42:0/3341069580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c90129560 0x7f8c901313d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009720 tx=0x7f8c8002b840 comp rx=0 tx=0).stop 2024-05-08T18:50:20.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.236+0000 7f8c97142640 1 -- 172.21.15.42:0/3341069580 shutdown_connections 2024-05-08T18:50:20.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.236+0000 7f8c97142640 1 --2- 172.21.15.42:0/3341069580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c90129560 0x7f8c901313d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.236+0000 7f8c97142640 1 -- 172.21.15.42:0/3341069580 >> 172.21.15.42:0/3341069580 conn(0x7f8c9009a910 msgr2=0x7f8c9006e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:20.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.236+0000 7f8c97142640 1 -- 172.21.15.42:0/3341069580 shutdown_connections 2024-05-08T18:50:20.236 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.236+0000 7f8c97142640 1 -- 172.21.15.42:0/3341069580 wait complete. 2024-05-08T18:50:20.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.237+0000 7f8c97142640 1 Processor -- start 2024-05-08T18:50:20.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.237+0000 7f8c97142640 1 -- start start 2024-05-08T18:50:20.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.238+0000 7f8c97142640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c9006fe20 0x7f8c9012fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:20.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.238+0000 7f8c97142640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f8c90070690 con 0x7f8c9006fe20 2024-05-08T18:50:20.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.238+0000 7f8c94ede640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c9006fe20 0x7f8c9012fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:20.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.238+0000 7f8c94ede640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c9006fe20 0x7f8c9012fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46294/0 (socket says 172.21.15.42:46294) 2024-05-08T18:50:20.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.238+0000 7f8c94ede640 1 -- 172.21.15.42:0/296018840 learned_addr learned my addr 172.21.15.42:0/296018840 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:20.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.238+0000 7f8c94ede640 1 -- 172.21.15.42:0/296018840 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c90122a50 con 0x7f8c9006fe20 2024-05-08T18:50:20.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.238+0000 7f8c94ede640 1 --2- 172.21.15.42:0/296018840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c9006fe20 0x7f8c9012fa20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00c4a0 tx=0x7f8c8c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:20.238 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.238+0000 7f8c857fa640 1 -- 172.21.15.42:0/296018840 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c8c017070 con 0x7f8c9006fe20 2024-05-08T18:50:20.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.238+0000 7f8c857fa640 1 -- 172.21.15.42:0/296018840 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c8c005c10 con 0x7f8c9006fe20 2024-05-08T18:50:20.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.238+0000 7f8c97142640 1 -- 172.21.15.42:0/296018840 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c9012eda0 con 0x7f8c9006fe20 2024-05-08T18:50:20.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.238+0000 7f8c857fa640 1 -- 172.21.15.42:0/296018840 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c8c007070 con 0x7f8c9006fe20 2024-05-08T18:50:20.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.238+0000 7f8c97142640 1 -- 172.21.15.42:0/296018840 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c90132b00 con 0x7f8c9006fe20 2024-05-08T18:50:20.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.239+0000 7f8c97142640 1 -- 172.21.15.42:0/296018840 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c90064010 con 0x7f8c9006fe20 2024-05-08T18:50:20.239 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.239+0000 7f8c857fa640 1 -- 172.21.15.42:0/296018840 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) ==== 49355+0+0 (secure 0 0 0) 0x7f8c8c01a070 con 0x7f8c9006fe20 2024-05-08T18:50:20.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.239+0000 7f8c857fa640 1 --2- 172.21.15.42:0/296018840 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c7c03d220 0x7f8c7c03f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:20.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.240+0000 7f8c857fa640 1 -- 172.21.15.42:0/296018840 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 3482+0+0 (secure 0 0 0) 0x7f8c8c050430 con 0x7f8c9006fe20 2024-05-08T18:50:20.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.240+0000 7f8c87fff640 1 --2- 172.21.15.42:0/296018840 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c7c03d220 0x7f8c7c03f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:20.240 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.240+0000 7f8c87fff640 1 --2- 172.21.15.42:0/296018840 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c7c03d220 0x7f8c7c03f6e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8c80036000 tx=0x7f8c80008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:20.243 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.244+0000 7f8c857fa640 1 -- 172.21.15.42:0/296018840 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8c8c01ac60 con 0x7f8c9006fe20 2024-05-08T18:50:20.434 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.435+0000 7f8c97142640 1 -- 172.21.15.42:0/296018840 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c901311b0 con 0x7f8c9006fe20 2024-05-08T18:50:20.435 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.436+0000 7f8c857fa640 1 -- 172.21.15.42:0/296018840 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+9757 (secure 0 0 0) 0x7f8c8c019cd0 con 0x7f8c9006fe20 2024-05-08T18:50:20.435 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:50:20.435 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":11,"fsid":"772ec65a-301b-4446-89ae-86d9bcfb0a5c","created":"2024-05-08T18:50:09.489497+0000","modified":"2024-05-08T18:50:19.731302+0000","last_up_change":"2024-05-08T18:50:17.729597+0000","last_in_change":"2024-05-08T18:50:10.598140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T18:50:17.942051+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T18:50:18.435323+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0977d23d-95b7-40ad-9731-d8830f6eed5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1521799280},{"type":"v1","addr":"172.21.15.42:6801","nonce":1521799280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1521799280},{"type":"v1","addr":"172.21.15.42:6803","nonce":1521799280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1521799280},{"type":"v1","addr":"172.21.15.42:6807","nonce":1521799280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1521799280},{"type":"v1","addr":"172.21.15.42:6805","nonce":1521799280}]},"public_addr":"172.21.15.42:6801/1521799280","cluster_addr":"172.21.15.42:6803/1521799280","heartbeat_back_addr":"172.21.15.42:6807/1521799280","heartbeat_front_addr":"172.21.15.42:6805/1521799280","state":["exists","up"]},{"osd":1,"uuid":"cb3d63fc-91ce-46e0-8917-0552f4753541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3697320277},{"type":"v1","addr":"172.21.15.132:6801","nonce":3697320277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3697320277},{"type":"v1","addr":"172.21.15.132:6803","nonce":3697320277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3697320277},{"type":"v1","addr":"172.21.15.132:6807","nonce":3697320277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3697320277},{"type":"v1","addr":"172.21.15.132:6805","nonce":3697320277}]},"public_addr":"172.21.15.132:6801/3697320277","cluster_addr":"172.21.15.132:6803/3697320277","heartbeat_back_addr":"172.21.15.132:6807/3697320277","heartbeat_front_addr":"172.21.15.132:6805/3697320277","state":["exists","up"]},{"osd":2,"uuid":"c3d3af18-54c3-492d-a4f1-72075b0fd6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":1108348591},{"type":"v1","addr":"172.21.15.132:6809","nonce":1108348591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":1108348591},{"type":"v1","addr":"172.21.15.132:6811","nonce":1108348591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":1108348591},{"type":"v1","addr":"172.21.15.132:6815","nonce":1108348591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":1108348591},{"type":"v1","addr":"172.21.15.132:6813","nonce":1108348591}]},"public_addr":"172.21.15.132:6809/1108348591","cluster_addr":"172.21.15.132:6811/1108348591","heartbeat_back_addr":"172.21.15.132:6815/1108348591","heartbeat_front_addr":"172.21.15.132:6813/1108348591","state":["exists","up"]},{"osd":3,"uuid":"07166424-d9c6-44be-b49f-173ad316b7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":17827703},{"type":"v1","addr":"172.21.15.132:6817","nonce":17827703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":17827703},{"type":"v1","addr":"172.21.15.132:6819","nonce":17827703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":17827703},{"type":"v1","addr":"172.21.15.132:6823","nonce":17827703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":17827703},{"type":"v1","addr":"172.21.15.132:6821","nonce":17827703}]},"public_addr":"172.21.15.132:6817/17827703","cluster_addr":"172.21.15.132:6819/17827703","heartbeat_back_addr":"172.21.15.132:6823/17827703","heartbeat_front_addr":"172.21.15.132:6821/17827703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:50:15.606047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:50:15.744620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:50:15.774231+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:50:15.779858+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:50:20.437 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.438+0000 7f8c97142640 1 -- 172.21.15.42:0/296018840 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c7c03d220 msgr2=0x7f8c7c03f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.438+0000 7f8c97142640 1 --2- 172.21.15.42:0/296018840 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c7c03d220 0x7f8c7c03f6e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8c80036000 tx=0x7f8c80008030 comp rx=0 tx=0).stop 2024-05-08T18:50:20.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.438+0000 7f8c97142640 1 -- 172.21.15.42:0/296018840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c9006fe20 msgr2=0x7f8c9012fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.438+0000 7f8c97142640 1 --2- 172.21.15.42:0/296018840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c9006fe20 0x7f8c9012fa20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00c4a0 tx=0x7f8c8c00c960 comp rx=0 tx=0).stop 2024-05-08T18:50:20.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.438+0000 7f8c97142640 1 -- 172.21.15.42:0/296018840 shutdown_connections 2024-05-08T18:50:20.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.438+0000 7f8c97142640 1 --2- 172.21.15.42:0/296018840 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c7c03d220 0x7f8c7c03f6e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.438+0000 7f8c97142640 1 --2- 172.21.15.42:0/296018840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c9006fe20 0x7f8c9012fa20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.438+0000 7f8c97142640 1 -- 172.21.15.42:0/296018840 >> 172.21.15.42:0/296018840 conn(0x7f8c9009a910 msgr2=0x7f8c90129e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:20.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.438+0000 7f8c97142640 1 -- 172.21.15.42:0/296018840 shutdown_connections 2024-05-08T18:50:20.438 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.439+0000 7f8c97142640 1 -- 172.21.15.42:0/296018840 wait complete. 2024-05-08T18:50:20.448 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-08T18:50:20.449 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:50:20.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.552+0000 7f12e50ae640 1 Processor -- start 2024-05-08T18:50:20.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.552+0000 7f12e50ae640 1 -- start start 2024-05-08T18:50:20.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.552+0000 7f12e50ae640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f12e0130520 0x7f12e0132910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:20.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.552+0000 7f12e50ae640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12e012d590 con 0x7f12e012d1b0 2024-05-08T18:50:20.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.552+0000 7f12e50ae640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f12e0114de0 con 0x7f12e0130520 2024-05-08T18:50:20.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.552+0000 7f12ded9d640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f12e012d1b0 0x7f12e012d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:33042/0 (socket says 172.21.15.42:33042) 2024-05-08T18:50:20.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.552+0000 7f12ded9d640 1 -- 172.21.15.42:0/1453884353 learned_addr learned my addr 172.21.15.42:0/1453884353 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:50:20.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.552+0000 7f12d7fff640 1 --2- 172.21.15.42:0/1453884353 >> v2:172.21.15.42:3300/0 conn(0x7f12e0130520 0x7f12e0132910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:20.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.553+0000 7f12de59c640 1 -- 172.21.15.42:0/1453884353 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2080249414 0 0) 0x7f12e012d590 con 0x7f12e012d1b0 2024-05-08T18:50:20.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.553+0000 7f12de59c640 1 -- 172.21.15.42:0/1453884353 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12cc003520 con 0x7f12e012d1b0 2024-05-08T18:50:20.552 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.553+0000 7f12d7fff640 1 -- 172.21.15.42:0/1453884353 >> v1:172.21.15.42:6789/0 conn(0x7f12e012d1b0 legacy=0x7f12e012d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.553 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.553+0000 7f12d7fff640 1 -- 172.21.15.42:0/1453884353 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e0113c30 con 0x7f12e0130520 2024-05-08T18:50:20.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.554+0000 7f12d7fff640 1 --2- 172.21.15.42:0/1453884353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12e0130520 0x7f12e0132910 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009720 tx=0x7f12c802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57eb598658d91529 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:20.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.554+0000 7f12de59c640 1 -- 172.21.15.42:0/1453884353 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12c80316d0 con 0x7f12e0130520 2024-05-08T18:50:20.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.554+0000 7f12de59c640 1 -- 172.21.15.42:0/1453884353 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12c8037070 con 0x7f12e0130520 2024-05-08T18:50:20.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.554+0000 7f12de59c640 1 -- 172.21.15.42:0/1453884353 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12c80319c0 con 0x7f12e0130520 2024-05-08T18:50:20.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.554+0000 7f12e50ae640 1 -- 172.21.15.42:0/1453884353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12e0130520 msgr2=0x7f12e0132910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.554+0000 7f12e50ae640 1 --2- 172.21.15.42:0/1453884353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12e0130520 0x7f12e0132910 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009720 tx=0x7f12c802b840 comp rx=0 tx=0).stop 2024-05-08T18:50:20.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.554+0000 7f12e50ae640 1 -- 172.21.15.42:0/1453884353 shutdown_connections 2024-05-08T18:50:20.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.554+0000 7f12e50ae640 1 --2- 172.21.15.42:0/1453884353 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12e0130520 0x7f12e0132910 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.554+0000 7f12e50ae640 1 -- 172.21.15.42:0/1453884353 >> 172.21.15.42:0/1453884353 conn(0x7f12e009a910 msgr2=0x7f12e006e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:20.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.554+0000 7f12e50ae640 1 -- 172.21.15.42:0/1453884353 shutdown_connections 2024-05-08T18:50:20.554 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.554+0000 7f12e50ae640 1 -- 172.21.15.42:0/1453884353 wait complete. 2024-05-08T18:50:20.556 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.555+0000 7f12e50ae640 1 Processor -- start 2024-05-08T18:50:20.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.555+0000 7f12e50ae640 1 -- start start 2024-05-08T18:50:20.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.556+0000 7f12e50ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12e012d1b0 0x7f12e00717f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:20.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.556+0000 7f12e50ae640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f12e0132fd0 con 0x7f12e012d1b0 2024-05-08T18:50:20.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.556+0000 7f12ded9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12e012d1b0 0x7f12e00717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:20.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.556+0000 7f12ded9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12e012d1b0 0x7f12e00717f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46322/0 (socket says 172.21.15.42:46322) 2024-05-08T18:50:20.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.556+0000 7f12ded9d640 1 -- 172.21.15.42:0/3015943036 learned_addr learned my addr 172.21.15.42:0/3015943036 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:20.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.556+0000 7f12ded9d640 1 -- 172.21.15.42:0/3015943036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e0132920 con 0x7f12e012d1b0 2024-05-08T18:50:20.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.556+0000 7f12ded9d640 1 --2- 172.21.15.42:0/3015943036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12e012d1b0 0x7f12e00717f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f12d000c390 tx=0x7f12d000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:20.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.556+0000 7f12d77fe640 1 -- 172.21.15.42:0/3015943036 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12d0017070 con 0x7f12e012d1b0 2024-05-08T18:50:20.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.556+0000 7f12d77fe640 1 -- 172.21.15.42:0/3015943036 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12d0005c10 con 0x7f12e012d1b0 2024-05-08T18:50:20.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.556+0000 7f12e50ae640 1 -- 172.21.15.42:0/3015943036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12e0128850 con 0x7f12e012d1b0 2024-05-08T18:50:20.557 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.557+0000 7f12d77fe640 1 -- 172.21.15.42:0/3015943036 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12d00070d0 con 0x7f12e012d1b0 2024-05-08T18:50:20.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.557+0000 7f12e50ae640 1 -- 172.21.15.42:0/3015943036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12e0128ef0 con 0x7f12e012d1b0 2024-05-08T18:50:20.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.557+0000 7f12d77fe640 1 -- 172.21.15.42:0/3015943036 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) ==== 49355+0+0 (secure 0 0 0) 0x7f12d001a070 con 0x7f12e012d1b0 2024-05-08T18:50:20.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.557+0000 7f12e50ae640 1 -- 172.21.15.42:0/3015943036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12e0064010 con 0x7f12e012d1b0 2024-05-08T18:50:20.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.558+0000 7f12d77fe640 1 --2- 172.21.15.42:0/3015943036 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f12c003d220 0x7f12c003f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:20.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.558+0000 7f12d77fe640 1 -- 172.21.15.42:0/3015943036 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 3482+0+0 (secure 0 0 0) 0x7f12d0050590 con 0x7f12e012d1b0 2024-05-08T18:50:20.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.558+0000 7f12d7fff640 1 --2- 172.21.15.42:0/3015943036 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f12c003d220 0x7f12c003f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:20.558 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.558+0000 7f12d7fff640 1 --2- 172.21.15.42:0/3015943036 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f12c003d220 0x7f12c003f6e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f12c8036000 tx=0x7f12c8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:20.561 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.562+0000 7f12d77fe640 1 -- 172.21.15.42:0/3015943036 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f12e0132920 con 0x7f12e012d1b0 2024-05-08T18:50:20.754 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.755+0000 7f12e50ae640 1 -- 172.21.15.42:0/3015943036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12e0075170 con 0x7f12e012d1b0 2024-05-08T18:50:20.755 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.756+0000 7f12d77fe640 1 -- 172.21.15.42:0/3015943036 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+9731 (secure 0 0 0) 0x7f12d001add0 con 0x7f12e012d1b0 2024-05-08T18:50:20.755 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:50:20.755 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":12,"fsid":"772ec65a-301b-4446-89ae-86d9bcfb0a5c","created":"2024-05-08T18:50:09.489497+0000","modified":"2024-05-08T18:50:20.732089+0000","last_up_change":"2024-05-08T18:50:17.729597+0000","last_in_change":"2024-05-08T18:50:10.598140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T18:50:17.942051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T18:50:18.435323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0977d23d-95b7-40ad-9731-d8830f6eed5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1521799280},{"type":"v1","addr":"172.21.15.42:6801","nonce":1521799280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1521799280},{"type":"v1","addr":"172.21.15.42:6803","nonce":1521799280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1521799280},{"type":"v1","addr":"172.21.15.42:6807","nonce":1521799280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1521799280},{"type":"v1","addr":"172.21.15.42:6805","nonce":1521799280}]},"public_addr":"172.21.15.42:6801/1521799280","cluster_addr":"172.21.15.42:6803/1521799280","heartbeat_back_addr":"172.21.15.42:6807/1521799280","heartbeat_front_addr":"172.21.15.42:6805/1521799280","state":["exists","up"]},{"osd":1,"uuid":"cb3d63fc-91ce-46e0-8917-0552f4753541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3697320277},{"type":"v1","addr":"172.21.15.132:6801","nonce":3697320277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3697320277},{"type":"v1","addr":"172.21.15.132:6803","nonce":3697320277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3697320277},{"type":"v1","addr":"172.21.15.132:6807","nonce":3697320277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3697320277},{"type":"v1","addr":"172.21.15.132:6805","nonce":3697320277}]},"public_addr":"172.21.15.132:6801/3697320277","cluster_addr":"172.21.15.132:6803/3697320277","heartbeat_back_addr":"172.21.15.132:6807/3697320277","heartbeat_front_addr":"172.21.15.132:6805/3697320277","state":["exists","up"]},{"osd":2,"uuid":"c3d3af18-54c3-492d-a4f1-72075b0fd6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":1108348591},{"type":"v1","addr":"172.21.15.132:6809","nonce":1108348591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":1108348591},{"type":"v1","addr":"172.21.15.132:6811","nonce":1108348591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":1108348591},{"type":"v1","addr":"172.21.15.132:6815","nonce":1108348591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":1108348591},{"type":"v1","addr":"172.21.15.132:6813","nonce":1108348591}]},"public_addr":"172.21.15.132:6809/1108348591","cluster_addr":"172.21.15.132:6811/1108348591","heartbeat_back_addr":"172.21.15.132:6815/1108348591","heartbeat_front_addr":"172.21.15.132:6813/1108348591","state":["exists","up"]},{"osd":3,"uuid":"07166424-d9c6-44be-b49f-173ad316b7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":17827703},{"type":"v1","addr":"172.21.15.132:6817","nonce":17827703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":17827703},{"type":"v1","addr":"172.21.15.132:6819","nonce":17827703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":17827703},{"type":"v1","addr":"172.21.15.132:6823","nonce":17827703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":17827703},{"type":"v1","addr":"172.21.15.132:6821","nonce":17827703}]},"public_addr":"172.21.15.132:6817/17827703","cluster_addr":"172.21.15.132:6819/17827703","heartbeat_back_addr":"172.21.15.132:6823/17827703","heartbeat_front_addr":"172.21.15.132:6821/17827703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:50:15.606047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:50:15.744620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:50:15.774231+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:50:15.779858+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:50:20.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.758+0000 7f12e50ae640 1 -- 172.21.15.42:0/3015943036 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f12c003d220 msgr2=0x7f12c003f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.758+0000 7f12e50ae640 1 --2- 172.21.15.42:0/3015943036 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f12c003d220 0x7f12c003f6e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f12c8036000 tx=0x7f12c8008030 comp rx=0 tx=0).stop 2024-05-08T18:50:20.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.758+0000 7f12e50ae640 1 -- 172.21.15.42:0/3015943036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12e012d1b0 msgr2=0x7f12e00717f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.758+0000 7f12e50ae640 1 --2- 172.21.15.42:0/3015943036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12e012d1b0 0x7f12e00717f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f12d000c390 tx=0x7f12d000c850 comp rx=0 tx=0).stop 2024-05-08T18:50:20.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.758+0000 7f12e50ae640 1 -- 172.21.15.42:0/3015943036 shutdown_connections 2024-05-08T18:50:20.757 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.758+0000 7f12e50ae640 1 --2- 172.21.15.42:0/3015943036 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f12c003d220 0x7f12c003f6e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.758+0000 7f12e50ae640 1 --2- 172.21.15.42:0/3015943036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f12e012d1b0 0x7f12e00717f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.758+0000 7f12e50ae640 1 -- 172.21.15.42:0/3015943036 >> 172.21.15.42:0/3015943036 conn(0x7f12e009a910 msgr2=0x7f12e012ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:20.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.758+0000 7f12e50ae640 1 -- 172.21.15.42:0/3015943036 shutdown_connections 2024-05-08T18:50:20.758 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.758+0000 7f12e50ae640 1 -- 172.21.15.42:0/3015943036 wait complete. 2024-05-08T18:50:20.768 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-08T18:50:20.769 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-08T18:50:20.769 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-08T18:50:20.769 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-08T18:50:20.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.878+0000 7f30b0880640 1 Processor -- start 2024-05-08T18:50:20.877 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.878+0000 7f53f412d640 1 Processor -- start 2024-05-08T18:50:20.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.878+0000 7fbc01035640 1 Processor -- start 2024-05-08T18:50:20.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.878+0000 7f30b0880640 1 -- start start 2024-05-08T18:50:20.878 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.878+0000 7fbc01035640 1 -- start start 2024-05-08T18:50:20.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.878+0000 7f478f00d640 1 Processor -- start 2024-05-08T18:50:20.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.878+0000 7f53f412d640 1 -- start start 2024-05-08T18:50:20.879 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.879+0000 7f478f00d640 1 -- start start 2024-05-08T18:50:20.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.879+0000 7fbc01035640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbbfc06fe20 0x7fbbfc128e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:20.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.879+0000 7fbc01035640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbfc072dc0 con 0x7fbbfc129390 2024-05-08T18:50:20.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.879+0000 7fbc01035640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fbbfc128ad0 con 0x7fbbfc06fe20 2024-05-08T18:50:20.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.879+0000 7f53f412d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f53ec12cbd0 0x7f53ec070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:20.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.879+0000 7f30b0880640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f30ac12c4e0 0x7f30ac131cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:20.880 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.879+0000 7f30b0880640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30ac0719e0 con 0x7f30ac06fe20 2024-05-08T18:50:20.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.879+0000 7f30b0880640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f30ac12b9a0 con 0x7f30ac12c4e0 2024-05-08T18:50:20.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.879+0000 7f53f412d640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53ec12d020 con 0x7f53ec12c7f0 2024-05-08T18:50:20.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.879+0000 7f53f412d640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f53ec072fc0 con 0x7f53ec12cbd0 2024-05-08T18:50:20.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.879+0000 7f478f00d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4788070000 0x7f47880703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:20.881 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.879+0000 7fbbfa59c640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fbbfc129390 0x7fbbfc12c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:33050/0 (socket says 172.21.15.42:33050) 2024-05-08T18:50:20.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.879+0000 7f53f1ec9640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f53ec12c7f0 0x7f53ec070850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:33056/0 (socket says 172.21.15.42:33056) 2024-05-08T18:50:20.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.879+0000 7f53f1ec9640 1 -- 172.21.15.42:0/815520574 learned_addr learned my addr 172.21.15.42:0/815520574 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:50:20.882 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.879+0000 7f30a9d9b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f30ac12c4e0 0x7f30ac131cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:20.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.879+0000 7f53f16c8640 1 --2- 172.21.15.42:0/815520574 >> v2:172.21.15.42:3300/0 conn(0x7f53ec12cbd0 0x7f53ec070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:20.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.879+0000 7fbbfa59c640 1 -- 172.21.15.42:0/2685350231 learned_addr learned my addr 172.21.15.42:0/2685350231 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:50:20.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.879+0000 7f478f00d640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4788073410 con 0x7f478806c370 2024-05-08T18:50:20.883 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.879+0000 7f478f00d640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f47880731e0 con 0x7f4788070000 2024-05-08T18:50:20.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.879+0000 7f30a9d9b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f30ac12c4e0 0x7f30ac131cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46336/0 (socket says 172.21.15.42:46336) 2024-05-08T18:50:20.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.879+0000 7f30a9d9b640 1 -- 172.21.15.42:0/963847943 learned_addr learned my addr 172.21.15.42:0/963847943 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:20.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.879+0000 7f4787fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f478806c370 0x7f4788130760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:33080/0 (socket says 172.21.15.42:33080) 2024-05-08T18:50:20.884 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.880+0000 7f4787fff640 1 -- 172.21.15.42:0/3452051221 learned_addr learned my addr 172.21.15.42:0/3452051221 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:50:20.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.880+0000 7f30a9d9b640 1 -- 172.21.15.42:0/963847943 >> v1:172.21.15.42:6789/0 conn(0x7f30ac06fe20 legacy=0x7f30ac12bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T18:50:20.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.880+0000 7f30a9d9b640 1 -- 172.21.15.42:0/963847943 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ac072330 con 0x7f30ac12c4e0 2024-05-08T18:50:20.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.880+0000 7fbbfad9d640 1 --2- 172.21.15.42:0/2685350231 >> v2:172.21.15.42:3300/0 conn(0x7fbbfc06fe20 0x7fbbfc128e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:20.885 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.880+0000 7f478cda9640 1 --2- 172.21.15.42:0/3452051221 >> v2:172.21.15.42:3300/0 conn(0x7f4788070000 0x7f47880703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:20.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.880+0000 7f53f16c8640 1 -- 172.21.15.42:0/815520574 >> v1:172.21.15.42:6789/0 conn(0x7f53ec12c7f0 legacy=0x7f53ec070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.880+0000 7f53f16c8640 1 -- 172.21.15.42:0/815520574 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ec0a23e0 con 0x7f53ec12cbd0 2024-05-08T18:50:20.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.880+0000 7fbbf9d9b640 1 -- 172.21.15.42:0/2685350231 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1591795143 0 0) 0x7fbbfc072dc0 con 0x7fbbfc129390 2024-05-08T18:50:20.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.880+0000 7fbbf9d9b640 1 -- 172.21.15.42:0/2685350231 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbe8003520 con 0x7fbbfc129390 2024-05-08T18:50:20.886 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.880+0000 7f47877fe640 1 -- 172.21.15.42:0/3452051221 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1103869827 0 0) 0x7f4788073410 con 0x7f478806c370 2024-05-08T18:50:20.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.880+0000 7fbbfad9d640 1 -- 172.21.15.42:0/2685350231 >> v1:172.21.15.42:6789/0 conn(0x7fbbfc129390 legacy=0x7fbbfc12c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.880+0000 7fbbfad9d640 1 -- 172.21.15.42:0/2685350231 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbfc0739e0 con 0x7fbbfc06fe20 2024-05-08T18:50:20.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.880+0000 7f47877fe640 1 -- 172.21.15.42:0/3452051221 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4778003520 con 0x7f478806c370 2024-05-08T18:50:20.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.880+0000 7f478cda9640 1 -- 172.21.15.42:0/3452051221 >> v1:172.21.15.42:6789/0 conn(0x7f478806c370 legacy=0x7f4788130760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.887 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.880+0000 7f478cda9640 1 -- 172.21.15.42:0/3452051221 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4788072550 con 0x7f4788070000 2024-05-08T18:50:20.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.881+0000 7f30a9d9b640 1 --2- 172.21.15.42:0/963847943 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30ac12c4e0 0x7f30ac131cb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f30a00097f0 tx=0x7f30a002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51b68d0e0930cf8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:20.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.881+0000 7f53f16c8640 1 --2- 172.21.15.42:0/815520574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ec12cbd0 0x7f53ec070f60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009720 tx=0x7f53dc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7f23011faaa657 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:20.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.881+0000 7f30a959a640 1 -- 172.21.15.42:0/963847943 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30a002e070 con 0x7f30ac12c4e0 2024-05-08T18:50:20.888 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.881+0000 7f30a959a640 1 -- 172.21.15.42:0/963847943 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a0037070 con 0x7f30ac12c4e0 2024-05-08T18:50:20.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.881+0000 7f478cda9640 1 --2- 172.21.15.42:0/3452051221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4788070000 0x7f47880703e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f477c009750 tx=0x7f477c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b161f60c67422e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:20.889 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.881+0000 7f30a959a640 1 -- 172.21.15.42:0/963847943 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30a0031730 con 0x7f30ac12c4e0 2024-05-08T18:50:20.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.881+0000 7f53f0ec7640 1 -- 172.21.15.42:0/815520574 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53dc0316d0 con 0x7f53ec12cbd0 2024-05-08T18:50:20.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.881+0000 7f53f0ec7640 1 -- 172.21.15.42:0/815520574 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53dc037070 con 0x7f53ec12cbd0 2024-05-08T18:50:20.890 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.881+0000 7f53f0ec7640 1 -- 172.21.15.42:0/815520574 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53dc0319c0 con 0x7f53ec12cbd0 2024-05-08T18:50:20.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.881+0000 7f47877fe640 1 -- 172.21.15.42:0/3452051221 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f477c0316d0 con 0x7f4788070000 2024-05-08T18:50:20.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.881+0000 7fbbfad9d640 1 --2- 172.21.15.42:0/2685350231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbfc06fe20 0x7fbbfc128e50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009720 tx=0x7fbbec02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3288d72221a54cf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:20.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.881+0000 7f47877fe640 1 -- 172.21.15.42:0/3452051221 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f477c037070 con 0x7f4788070000 2024-05-08T18:50:20.891 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.881+0000 7f47877fe640 1 -- 172.21.15.42:0/3452051221 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f477c0319a0 con 0x7f4788070000 2024-05-08T18:50:20.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.881+0000 7fbbf9d9b640 1 -- 172.21.15.42:0/2685350231 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbec0316d0 con 0x7fbbfc06fe20 2024-05-08T18:50:20.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.882+0000 7fbbf9d9b640 1 -- 172.21.15.42:0/2685350231 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbec037070 con 0x7fbbfc06fe20 2024-05-08T18:50:20.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.882+0000 7f30b0880640 1 -- 172.21.15.42:0/963847943 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30ac12c4e0 msgr2=0x7f30ac131cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.892 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.882+0000 7f30b0880640 1 --2- 172.21.15.42:0/963847943 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30ac12c4e0 0x7f30ac131cb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f30a00097f0 tx=0x7f30a002b880 comp rx=0 tx=0).stop 2024-05-08T18:50:20.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.882+0000 7fbbf9d9b640 1 -- 172.21.15.42:0/2685350231 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbec0319c0 con 0x7fbbfc06fe20 2024-05-08T18:50:20.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.882+0000 7f30b0880640 1 -- 172.21.15.42:0/963847943 shutdown_connections 2024-05-08T18:50:20.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.882+0000 7f30b0880640 1 --2- 172.21.15.42:0/963847943 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30ac12c4e0 0x7f30ac131cb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.882+0000 7f30b0880640 1 -- 172.21.15.42:0/963847943 >> 172.21.15.42:0/963847943 conn(0x7f30ac09a910 msgr2=0x7f30ac06e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:20.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.882+0000 7f53f412d640 1 -- 172.21.15.42:0/815520574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ec12cbd0 msgr2=0x7f53ec070f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.893 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.882+0000 7f53f412d640 1 --2- 172.21.15.42:0/815520574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ec12cbd0 0x7f53ec070f60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f53dc009720 tx=0x7f53dc02b840 comp rx=0 tx=0).stop 2024-05-08T18:50:20.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.882+0000 7f30b0880640 1 -- 172.21.15.42:0/963847943 shutdown_connections 2024-05-08T18:50:20.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.882+0000 7f53f412d640 1 -- 172.21.15.42:0/815520574 shutdown_connections 2024-05-08T18:50:20.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.882+0000 7f53f412d640 1 --2- 172.21.15.42:0/815520574 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ec12cbd0 0x7f53ec070f60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.894 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.882+0000 7f53f412d640 1 -- 172.21.15.42:0/815520574 >> 172.21.15.42:0/815520574 conn(0x7f53ec09ff90 msgr2=0x7f53ec0a1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:20.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.882+0000 7f478f00d640 1 -- 172.21.15.42:0/3452051221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4788070000 msgr2=0x7f47880703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.882+0000 7f53f412d640 1 -- 172.21.15.42:0/815520574 shutdown_connections 2024-05-08T18:50:20.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.882+0000 7f478f00d640 1 --2- 172.21.15.42:0/3452051221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4788070000 0x7f47880703e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f477c009750 tx=0x7f477c02b840 comp rx=0 tx=0).stop 2024-05-08T18:50:20.895 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.882+0000 7f53f412d640 1 -- 172.21.15.42:0/815520574 wait complete. 2024-05-08T18:50:20.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.883+0000 7f478f00d640 1 -- 172.21.15.42:0/3452051221 shutdown_connections 2024-05-08T18:50:20.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.883+0000 7f478f00d640 1 --2- 172.21.15.42:0/3452051221 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4788070000 0x7f47880703e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.883+0000 7f478f00d640 1 -- 172.21.15.42:0/3452051221 >> 172.21.15.42:0/3452051221 conn(0x7f478809a910 msgr2=0x7f478806e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:20.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.883+0000 7f478f00d640 1 -- 172.21.15.42:0/3452051221 shutdown_connections 2024-05-08T18:50:20.896 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.883+0000 7f478f00d640 1 -- 172.21.15.42:0/3452051221 wait complete. 2024-05-08T18:50:20.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.882+0000 7f30b0880640 1 -- 172.21.15.42:0/963847943 wait complete. 2024-05-08T18:50:20.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.883+0000 7fbc01035640 1 -- 172.21.15.42:0/2685350231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbfc06fe20 msgr2=0x7fbbfc128e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.897 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.883+0000 7fbc01035640 1 --2- 172.21.15.42:0/2685350231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbfc06fe20 0x7fbbfc128e50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbbec009720 tx=0x7fbbec02b840 comp rx=0 tx=0).stop 2024-05-08T18:50:20.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.883+0000 7fbc01035640 1 -- 172.21.15.42:0/2685350231 shutdown_connections 2024-05-08T18:50:20.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.883+0000 7fbc01035640 1 --2- 172.21.15.42:0/2685350231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbfc06fe20 0x7fbbfc128e50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.883+0000 7fbc01035640 1 -- 172.21.15.42:0/2685350231 >> 172.21.15.42:0/2685350231 conn(0x7fbbfc09a910 msgr2=0x7fbbfc06e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:20.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.883+0000 7fbc01035640 1 -- 172.21.15.42:0/2685350231 shutdown_connections 2024-05-08T18:50:20.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.883+0000 7fbc01035640 1 -- 172.21.15.42:0/2685350231 wait complete. 2024-05-08T18:50:20.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.884+0000 7f30b0880640 1 Processor -- start 2024-05-08T18:50:20.898 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.884+0000 7f30b0880640 1 -- start start 2024-05-08T18:50:20.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.884+0000 7f53f412d640 1 Processor -- start 2024-05-08T18:50:20.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.884+0000 7f53f412d640 1 -- start start 2024-05-08T18:50:20.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.884+0000 7f478f00d640 1 Processor -- start 2024-05-08T18:50:20.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.884+0000 7f478f00d640 1 -- start start 2024-05-08T18:50:20.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.884+0000 7f30b0880640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30ac06fe20 0x7f30ac127000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:20.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.884+0000 7f30b0880640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac073290 con 0x7f30ac06fe20 2024-05-08T18:50:20.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.884+0000 7f53f412d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ec12c7f0 0x7f53ec11ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:20.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.884+0000 7f53f412d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f53ec072870 con 0x7f53ec12c7f0 2024-05-08T18:50:20.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.884+0000 7f30aa59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30ac06fe20 0x7f30ac127000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:20.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.884+0000 7f30aa59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30ac06fe20 0x7f30ac127000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46354/0 (socket says 172.21.15.42:46354) 2024-05-08T18:50:20.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.884+0000 7f30aa59c640 1 -- 172.21.15.42:0/4212250095 learned_addr learned my addr 172.21.15.42:0/4212250095 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:20.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.884+0000 7f53f1ec9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ec12c7f0 0x7f53ec11ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:20.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.885+0000 7f53f1ec9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ec12c7f0 0x7f53ec11ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46362/0 (socket says 172.21.15.42:46362) 2024-05-08T18:50:20.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.885+0000 7f53f1ec9640 1 -- 172.21.15.42:0/3259655156 learned_addr learned my addr 172.21.15.42:0/3259655156 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.885+0000 7f30aa59c640 1 -- 172.21.15.42:0/4212250095 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ac113ee0 con 0x7f30ac06fe20 2024-05-08T18:50:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.885+0000 7fbc01035640 1 Processor -- start 2024-05-08T18:50:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.885+0000 7f478f00d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f478806c370 0x7f4788116410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:20.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.885+0000 7f53f1ec9640 1 -- 172.21.15.42:0/3259655156 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ec12b9d0 con 0x7f53ec12c7f0 2024-05-08T18:50:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.885+0000 7f478cda9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f478806c370 0x7f4788116410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.885+0000 7f478cda9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f478806c370 0x7f4788116410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46374/0 (socket says 172.21.15.42:46374) 2024-05-08T18:50:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.885+0000 7f478cda9640 1 -- 172.21.15.42:0/118200862 learned_addr learned my addr 172.21.15.42:0/118200862 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.885+0000 7f478f00d640 1 -- 172.21.15.42:0/118200862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f4788070cb0 con 0x7f478806c370 2024-05-08T18:50:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.885+0000 7fbc01035640 1 -- start start 2024-05-08T18:50:20.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.885+0000 7fbc01035640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbfc06fe20 0x7fbbfc121650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:20.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.885+0000 7fbc01035640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc1299a0 con 0x7fbbfc06fe20 2024-05-08T18:50:20.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.885+0000 7f30aa59c640 1 --2- 172.21.15.42:0/4212250095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30ac06fe20 0x7f30ac127000 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f309c00c390 tx=0x7f309c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:20.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.885+0000 7f53f1ec9640 1 --2- 172.21.15.42:0/3259655156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ec12c7f0 0x7f53ec11ace0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f53e800c380 tx=0x7f53e800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:20.904 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.885+0000 7fbbfad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbfc06fe20 0x7fbbfc121650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:20.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.885+0000 7fbbfad9d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbfc06fe20 0x7fbbfc121650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46384/0 (socket says 172.21.15.42:46384) 2024-05-08T18:50:20.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.885+0000 7fbbfad9d640 1 -- 172.21.15.42:0/4177303850 learned_addr learned my addr 172.21.15.42:0/4177303850 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:20.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.885+0000 7f309affd640 1 -- 172.21.15.42:0/4212250095 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f309c017070 con 0x7f30ac06fe20 2024-05-08T18:50:20.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.885+0000 7f309affd640 1 -- 172.21.15.42:0/4212250095 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c005410 con 0x7f30ac06fe20 2024-05-08T18:50:20.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.886+0000 7f478cda9640 1 -- 172.21.15.42:0/118200862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4788119680 con 0x7f478806c370 2024-05-08T18:50:20.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.886+0000 7f309affd640 1 -- 172.21.15.42:0/4212250095 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f309c003760 con 0x7f30ac06fe20 2024-05-08T18:50:20.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.886+0000 7f30b0880640 1 -- 172.21.15.42:0/4212250095 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30ac114640 con 0x7f30ac06fe20 2024-05-08T18:50:20.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.886+0000 7fbbfad9d640 1 -- 172.21.15.42:0/4177303850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbfc12b3a0 con 0x7fbbfc06fe20 2024-05-08T18:50:20.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.886+0000 7f30b0880640 1 -- 172.21.15.42:0/4212250095 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30ac127540 con 0x7f30ac06fe20 2024-05-08T18:50:20.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.886+0000 7f478cda9640 1 --2- 172.21.15.42:0/118200862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f478806c370 0x7f4788116410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f477c034040 tx=0x7f477c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:20.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.886+0000 7fbbfad9d640 1 --2- 172.21.15.42:0/4177303850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbfc06fe20 0x7fbbfc121650 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbbec034040 tx=0x7fbbec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:20.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.886+0000 7f53e27fc640 1 -- 172.21.15.42:0/3259655156 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53e8005c10 con 0x7f53ec12c7f0 2024-05-08T18:50:20.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.886+0000 7f53f412d640 1 -- 172.21.15.42:0/3259655156 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53ec11e060 con 0x7f53ec12c7f0 2024-05-08T18:50:20.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.886+0000 7f53f412d640 1 -- 172.21.15.42:0/3259655156 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53ec11d9d0 con 0x7f53ec12c7f0 2024-05-08T18:50:20.908 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.887+0000 7f30b0880640 1 -- 172.21.15.42:0/4212250095 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f30ac1281f0 con 0x7f30ac06fe20 2024-05-08T18:50:20.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.887+0000 7f53f412d640 1 -- 172.21.15.42:0/3259655156 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f53ec0a1a40 con 0x7f53ec12c7f0 2024-05-08T18:50:20.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.888+0000 7f53e27fc640 1 -- 172.21.15.42:0/3259655156 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53ec0a1a40 con 0x7f53ec12c7f0 2024-05-08T18:50:20.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.888+0000 7f53e27fc640 1 -- 172.21.15.42:0/3259655156 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53e80047e0 con 0x7f53ec12c7f0 2024-05-08T18:50:20.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.888+0000 7f47857fa640 1 -- 172.21.15.42:0/118200862 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f477c031970 con 0x7f478806c370 2024-05-08T18:50:20.909 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.888+0000 7fbbf37fe640 1 -- 172.21.15.42:0/4177303850 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbec032560 con 0x7fbbfc06fe20 2024-05-08T18:50:20.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.888+0000 7f478f00d640 1 -- 172.21.15.42:0/118200862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4788117c40 con 0x7f478806c370 2024-05-08T18:50:20.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.888+0000 7f478f00d640 1 -- 172.21.15.42:0/118200862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4788125f20 con 0x7f478806c370 2024-05-08T18:50:20.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.888+0000 7fbc01035640 1 -- 172.21.15.42:0/4177303850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbfc12b160 con 0x7fbbfc06fe20 2024-05-08T18:50:20.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.888+0000 7fbc01035640 1 -- 172.21.15.42:0/4177303850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbfc12bdf0 con 0x7fbbfc06fe20 2024-05-08T18:50:20.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.889+0000 7f309affd640 1 -- 172.21.15.42:0/4212250095 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) ==== 49355+0+0 (secure 0 0 0) 0x7f309c01a070 con 0x7f30ac06fe20 2024-05-08T18:50:20.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.889+0000 7f478f00d640 1 -- 172.21.15.42:0/118200862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4788064010 con 0x7f478806c370 2024-05-08T18:50:20.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.889+0000 7f309affd640 1 --2- 172.21.15.42:0/4212250095 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f308c03d1d0 0x7f308c03f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:20.911 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.889+0000 7fbc01035640 1 -- 172.21.15.42:0/4177303850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbbfc064010 con 0x7fbbfc06fe20 2024-05-08T18:50:20.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.890+0000 7f30a9d9b640 1 --2- 172.21.15.42:0/4212250095 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f308c03d1d0 0x7f308c03f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:20.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.890+0000 7f30a9d9b640 1 --2- 172.21.15.42:0/4212250095 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f308c03d1d0 0x7f308c03f690 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f30a0036000 tx=0x7f30a0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:20.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.891+0000 7f309affd640 1 -- 172.21.15.42:0/4212250095 <== mon.0 v2:172.21.15.42:3300/0 5 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f309c04edf0 con 0x7f30ac06fe20 2024-05-08T18:50:20.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.892+0000 7fbbf37fe640 1 -- 172.21.15.42:0/4177303850 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbfc064010 con 0x7fbbfc06fe20 2024-05-08T18:50:20.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.892+0000 7fbbf37fe640 1 -- 172.21.15.42:0/4177303850 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbec005990 con 0x7fbbfc06fe20 2024-05-08T18:50:20.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.892+0000 7f47857fa640 1 -- 172.21.15.42:0/118200862 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4788064010 con 0x7f478806c370 2024-05-08T18:50:20.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.892+0000 7f47857fa640 1 -- 172.21.15.42:0/118200862 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f477c005990 con 0x7f478806c370 2024-05-08T18:50:20.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.892+0000 7f309affd640 1 -- 172.21.15.42:0/4212250095 <== mon.0 v2:172.21.15.42:3300/0 6 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f309c051d00 con 0x7f30ac06fe20 2024-05-08T18:50:20.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.892+0000 7f309affd640 1 --2- 172.21.15.42:0/4212250095 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f308c042800 0x7f308c044c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:20.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.892+0000 7f309affd640 1 -- 172.21.15.42:0/4212250095 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f309c020ec0 con 0x7f308c042800 2024-05-08T18:50:20.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.892+0000 7f30aad9d640 1 --2- 172.21.15.42:0/4212250095 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f308c042800 0x7f308c044c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:20.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.893+0000 7f53e27fc640 1 -- 172.21.15.42:0/3259655156 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f53e801a020 con 0x7f53ec12c7f0 2024-05-08T18:50:20.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.893+0000 7f47857fa640 1 -- 172.21.15.42:0/118200862 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f477c005b30 con 0x7f478806c370 2024-05-08T18:50:20.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.893+0000 7f30aad9d640 1 --2- 172.21.15.42:0/4212250095 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f308c042800 0x7f308c044c40 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:20.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.893+0000 7f309affd640 1 -- 172.21.15.42:0/4212250095 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f309c003900 con 0x7f30ac06fe20 2024-05-08T18:50:20.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.893+0000 7f53e27fc640 1 --2- 172.21.15.42:0/3259655156 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f53d003d2e0 0x7f53d003f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:20.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.893+0000 7f53e27fc640 1 -- 172.21.15.42:0/3259655156 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f53e8051460 con 0x7f53ec12c7f0 2024-05-08T18:50:20.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.893+0000 7f53e27fc640 1 --2- 172.21.15.42:0/3259655156 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f53d0042a60 0x7f53d0044ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:20.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.893+0000 7f53f16c8640 1 --2- 172.21.15.42:0/3259655156 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f53d003d2e0 0x7f53d003f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:20.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.893+0000 7f47857fa640 1 --2- 172.21.15.42:0/118200862 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f476c03d2b0 0x7f476c03f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:20.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.893+0000 7f53e27fc640 1 -- 172.21.15.42:0/3259655156 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53e8019e50 con 0x7f53d0042a60 2024-05-08T18:50:20.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.893+0000 7fbbf37fe640 1 -- 172.21.15.42:0/4177303850 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fbbec04c060 con 0x7fbbfc06fe20 2024-05-08T18:50:20.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.894+0000 7f53e27fc640 1 -- 172.21.15.42:0/3259655156 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f53e8051850 con 0x7f53ec12c7f0 2024-05-08T18:50:20.917 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.894+0000 7f47857fa640 1 -- 172.21.15.42:0/118200862 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f477c02f050 con 0x7f478806c370 2024-05-08T18:50:20.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.894+0000 7f53f26ca640 1 --2- 172.21.15.42:0/3259655156 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f53d0042a60 0x7f53d0044ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:20.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.894+0000 7f309affd640 1 -- 172.21.15.42:0/4212250095 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f309c020ec0 con 0x7f308c042800 2024-05-08T18:50:20.918 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.894+0000 7fbbf37fe640 1 --2- 172.21.15.42:0/4177303850 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbbdc03d2e0 0x7fbbdc03f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:20.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.894+0000 7f4787fff640 1 --2- 172.21.15.42:0/118200862 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f476c03d2b0 0x7f476c03f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:20.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.894+0000 7f47857fa640 1 --2- 172.21.15.42:0/118200862 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x7f476c042ae0 0x7f476c044f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:20.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.894+0000 7f47857fa640 1 -- 172.21.15.42:0/118200862 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f476c0455f0 con 0x7f476c042ae0 2024-05-08T18:50:20.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.894+0000 7f47857fa640 1 -- 172.21.15.42:0/118200862 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f477c073f80 con 0x7f478806c370 2024-05-08T18:50:20.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.894+0000 7fbbf37fe640 1 -- 172.21.15.42:0/4177303850 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7fbbec02f050 con 0x7fbbfc06fe20 2024-05-08T18:50:20.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.894+0000 7fbbf37fe640 1 --2- 172.21.15.42:0/4177303850 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x7fbbdc042a60 0x7fbbdc044ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:20.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.894+0000 7fbbfa59c640 1 --2- 172.21.15.42:0/4177303850 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbbdc03d2e0 0x7fbbdc03f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:20.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.894+0000 7fbbf37fe640 1 -- 172.21.15.42:0/4177303850 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbbec039e50 con 0x7fbbdc042a60 2024-05-08T18:50:20.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.894+0000 7fbbf37fe640 1 -- 172.21.15.42:0/4177303850 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7fbbec072c90 con 0x7fbbfc06fe20 2024-05-08T18:50:20.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.894+0000 7f53f16c8640 1 --2- 172.21.15.42:0/3259655156 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f53d003d2e0 0x7f53d003f7a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f53dc036000 tx=0x7f53dc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:20.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.894+0000 7f478d5aa640 1 --2- 172.21.15.42:0/118200862 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x7f476c042ae0 0x7f476c044f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:20.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.894+0000 7f53f26ca640 1 --2- 172.21.15.42:0/3259655156 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f53d0042a60 0x7f53d0044ea0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:20.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.894+0000 7f4787fff640 1 --2- 172.21.15.42:0/118200862 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f476c03d2b0 0x7f476c03f770 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4774001610 tx=0x7f4774007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:20.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.894+0000 7fbbfb59e640 1 --2- 172.21.15.42:0/4177303850 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x7fbbdc042a60 0x7fbbdc044ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:20.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.895+0000 7f478d5aa640 1 --2- 172.21.15.42:0/118200862 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x7f476c042ae0 0x7f476c044f20 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:20.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.895+0000 7fbbfa59c640 1 --2- 172.21.15.42:0/4177303850 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbbdc03d2e0 0x7fbbdc03f7a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40011e0 tx=0x7fbbe4007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:20.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.895+0000 7fbbfb59e640 1 --2- 172.21.15.42:0/4177303850 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x7fbbdc042a60 0x7fbbdc044ea0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:20.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.895+0000 7f53e27fc640 1 -- 172.21.15.42:0/3259655156 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f53e8019e50 con 0x7f53d0042a60 2024-05-08T18:50:20.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.895+0000 7f47857fa640 1 -- 172.21.15.42:0/118200862 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f476c0455f0 con 0x7f476c042ae0 2024-05-08T18:50:20.923 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.896+0000 7fbbf37fe640 1 -- 172.21.15.42:0/4177303850 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbbec039e50 con 0x7fbbdc042a60 2024-05-08T18:50:20.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.909+0000 7f30b0880640 1 -- 172.21.15.42:0/4212250095 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f30ac064010 con 0x7f308c042800 2024-05-08T18:50:20.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.909+0000 7f309affd640 1 -- 172.21.15.42:0/4212250095 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f30ac064010 con 0x7f308c042800 2024-05-08T18:50:20.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.909+0000 7f30b0880640 1 -- 172.21.15.42:0/4212250095 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f308c042800 msgr2=0x7f308c044c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.909+0000 7f30b0880640 1 --2- 172.21.15.42:0/4212250095 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f308c042800 0x7f308c044c40 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.925 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.909+0000 7f30b0880640 1 -- 172.21.15.42:0/4212250095 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f308c03d1d0 msgr2=0x7f308c03f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.909+0000 7f30b0880640 1 --2- 172.21.15.42:0/4212250095 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f308c03d1d0 0x7f308c03f690 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f30a0036000 tx=0x7f30a0008030 comp rx=0 tx=0).stop 2024-05-08T18:50:20.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.909+0000 7f30b0880640 1 -- 172.21.15.42:0/4212250095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30ac06fe20 msgr2=0x7f30ac127000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.909+0000 7f30b0880640 1 --2- 172.21.15.42:0/4212250095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30ac06fe20 0x7f30ac127000 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f309c00c390 tx=0x7f309c00c850 comp rx=0 tx=0).stop 2024-05-08T18:50:20.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.909+0000 7f30b0880640 1 -- 172.21.15.42:0/4212250095 shutdown_connections 2024-05-08T18:50:20.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.909+0000 7f30b0880640 1 --2- 172.21.15.42:0/4212250095 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f308c042800 0x7f308c044c40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.909+0000 7f30b0880640 1 --2- 172.21.15.42:0/4212250095 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f308c03d1d0 0x7f308c03f690 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.909+0000 7f30b0880640 1 --2- 172.21.15.42:0/4212250095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30ac06fe20 0x7f30ac127000 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.926 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.909+0000 7f30b0880640 1 -- 172.21.15.42:0/4212250095 >> 172.21.15.42:0/4212250095 conn(0x7f30ac09a910 msgr2=0x7f30ac129e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:20.929 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.910+0000 7f30b0880640 1 -- 172.21.15.42:0/4212250095 shutdown_connections 2024-05-08T18:50:20.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.910+0000 7f30b0880640 1 -- 172.21.15.42:0/4212250095 wait complete. 2024-05-08T18:50:20.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.910+0000 7f53f412d640 1 -- 172.21.15.42:0/3259655156 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f53ec071420 con 0x7f53d0042a60 2024-05-08T18:50:20.930 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.910+0000 7f53e27fc640 1 -- 172.21.15.42:0/3259655156 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f53ec071420 con 0x7f53d0042a60 2024-05-08T18:50:20.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.911+0000 7f53f412d640 1 -- 172.21.15.42:0/3259655156 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f53d0042a60 msgr2=0x7f53d0044ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.911+0000 7f53f412d640 1 --2- 172.21.15.42:0/3259655156 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f53d0042a60 0x7f53d0044ea0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.911+0000 7f53f412d640 1 -- 172.21.15.42:0/3259655156 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f53d003d2e0 msgr2=0x7f53d003f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.911+0000 7f53f412d640 1 --2- 172.21.15.42:0/3259655156 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f53d003d2e0 0x7f53d003f7a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f53dc036000 tx=0x7f53dc008030 comp rx=0 tx=0).stop 2024-05-08T18:50:20.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.911+0000 7f53f412d640 1 -- 172.21.15.42:0/3259655156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ec12c7f0 msgr2=0x7f53ec11ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.911+0000 7f53f412d640 1 --2- 172.21.15.42:0/3259655156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ec12c7f0 0x7f53ec11ace0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f53e800c380 tx=0x7f53e800c840 comp rx=0 tx=0).stop 2024-05-08T18:50:20.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.911+0000 7f53f412d640 1 -- 172.21.15.42:0/3259655156 shutdown_connections 2024-05-08T18:50:20.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.911+0000 7f53f412d640 1 --2- 172.21.15.42:0/3259655156 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f53d0042a60 0x7f53d0044ea0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.911+0000 7f53f412d640 1 --2- 172.21.15.42:0/3259655156 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f53d003d2e0 0x7f53d003f7a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.911+0000 7f53f412d640 1 --2- 172.21.15.42:0/3259655156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f53ec12c7f0 0x7f53ec11ace0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.932 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.911+0000 7f53f412d640 1 -- 172.21.15.42:0/3259655156 >> 172.21.15.42:0/3259655156 conn(0x7f53ec09ff90 msgr2=0x7f53ec06e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:20.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.911+0000 7f53f412d640 1 -- 172.21.15.42:0/3259655156 shutdown_connections 2024-05-08T18:50:20.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.911+0000 7f53f412d640 1 -- 172.21.15.42:0/3259655156 wait complete. 2024-05-08T18:50:20.933 INFO:teuthology.orchestra.run.smithi042.stdout:38654705667 2024-05-08T18:50:20.934 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T18:50:20.935 INFO:teuthology.orchestra.run.smithi042.stdout:38654705668 2024-05-08T18:50:20.935 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T18:50:20.935 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.929+0000 7f478f00d640 1 -- 172.21.15.42:0/118200862 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f478809bdb0 con 0x7f476c042ae0 2024-05-08T18:50:20.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.929+0000 7fbc01035640 1 -- 172.21.15.42:0/4177303850 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbbfc129390 con 0x7fbbdc042a60 2024-05-08T18:50:20.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7f47857fa640 1 -- 172.21.15.42:0/118200862 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f478809bdb0 con 0x7f476c042ae0 2024-05-08T18:50:20.936 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7fbbf37fe640 1 -- 172.21.15.42:0/4177303850 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbbfc129390 con 0x7fbbdc042a60 2024-05-08T18:50:20.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7f478f00d640 1 -- 172.21.15.42:0/118200862 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x7f476c042ae0 msgr2=0x7f476c044f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7f478f00d640 1 --2- 172.21.15.42:0/118200862 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x7f476c042ae0 0x7f476c044f20 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7f478f00d640 1 -- 172.21.15.42:0/118200862 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f476c03d2b0 msgr2=0x7f476c03f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7f478f00d640 1 --2- 172.21.15.42:0/118200862 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f476c03d2b0 0x7f476c03f770 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4774001610 tx=0x7f4774007970 comp rx=0 tx=0).stop 2024-05-08T18:50:20.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7f478f00d640 1 -- 172.21.15.42:0/118200862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f478806c370 msgr2=0x7f4788116410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.937 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7f478f00d640 1 --2- 172.21.15.42:0/118200862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f478806c370 0x7f4788116410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f477c034040 tx=0x7f477c0046c0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7fbc01035640 1 -- 172.21.15.42:0/4177303850 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x7fbbdc042a60 msgr2=0x7fbbdc044ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7fbc01035640 1 --2- 172.21.15.42:0/4177303850 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x7fbbdc042a60 0x7fbbdc044ea0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7f478f00d640 1 -- 172.21.15.42:0/118200862 shutdown_connections 2024-05-08T18:50:20.938 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7f478f00d640 1 --2- 172.21.15.42:0/118200862 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x7f476c042ae0 0x7f476c044f20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7f478f00d640 1 --2- 172.21.15.42:0/118200862 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f476c03d2b0 0x7f476c03f770 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7f478f00d640 1 --2- 172.21.15.42:0/118200862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f478806c370 0x7f4788116410 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7f478f00d640 1 -- 172.21.15.42:0/118200862 >> 172.21.15.42:0/118200862 conn(0x7f478809a910 msgr2=0x7f478809b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:20.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7fbc01035640 1 -- 172.21.15.42:0/4177303850 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbbdc03d2e0 msgr2=0x7fbbdc03f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7fbc01035640 1 --2- 172.21.15.42:0/4177303850 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbbdc03d2e0 0x7fbbdc03f7a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40011e0 tx=0x7fbbe4007910 comp rx=0 tx=0).stop 2024-05-08T18:50:20.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7fbc01035640 1 -- 172.21.15.42:0/4177303850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbfc06fe20 msgr2=0x7fbbfc121650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:20.939 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7fbc01035640 1 --2- 172.21.15.42:0/4177303850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbfc06fe20 0x7fbbfc121650 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbbec034040 tx=0x7fbbec0046c0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7f478f00d640 1 -- 172.21.15.42:0/118200862 shutdown_connections 2024-05-08T18:50:20.940 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7f478f00d640 1 -- 172.21.15.42:0/118200862 wait complete. 2024-05-08T18:50:20.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7fbc01035640 1 -- 172.21.15.42:0/4177303850 shutdown_connections 2024-05-08T18:50:20.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7fbc01035640 1 --2- 172.21.15.42:0/4177303850 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x7fbbdc042a60 0x7fbbdc044ea0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7fbc01035640 1 --2- 172.21.15.42:0/4177303850 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbbdc03d2e0 0x7fbbdc03f7a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7fbc01035640 1 --2- 172.21.15.42:0/4177303850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbfc06fe20 0x7fbbfc121650 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:20.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.930+0000 7fbc01035640 1 -- 172.21.15.42:0/4177303850 >> 172.21.15.42:0/4177303850 conn(0x7fbbfc09a910 msgr2=0x7fbbfc0706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:20.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.931+0000 7fbc01035640 1 -- 172.21.15.42:0/4177303850 shutdown_connections 2024-05-08T18:50:20.941 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:20.931+0000 7fbc01035640 1 -- 172.21.15.42:0/4177303850 wait complete. 2024-05-08T18:50:20.944 INFO:teuthology.orchestra.run.smithi042.stdout:38654705667 2024-05-08T18:50:20.944 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T18:50:20.945 INFO:teuthology.orchestra.run.smithi042.stdout:38654705667 2024-05-08T18:50:20.946 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T18:50:21.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.052+0000 7f59e2850640 1 Processor -- start 2024-05-08T18:50:21.051 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.052+0000 7f59e2850640 1 -- start start 2024-05-08T18:50:21.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.052+0000 7f59e2850640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f59dc12c7f0 0x7f59dc12cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:21.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.052+0000 7f59e2850640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59dc0a23e0 con 0x7f59dc070850 2024-05-08T18:50:21.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.052+0000 7f59e2850640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f59dc072fc0 con 0x7f59dc12c7f0 2024-05-08T18:50:21.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.053+0000 7f59dbfff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f59dc12c7f0 0x7f59dc12cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:21.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.053+0000 7f59db7fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f59dc070850 0x7f59dc070ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:33090/0 (socket says 172.21.15.42:33090) 2024-05-08T18:50:21.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.053+0000 7f59db7fe640 1 -- 172.21.15.42:0/2716451639 learned_addr learned my addr 172.21.15.42:0/2716451639 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:50:21.052 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.053+0000 7f59dbfff640 1 -- 172.21.15.42:0/2716451639 >> v1:172.21.15.42:6789/0 conn(0x7f59dc070850 legacy=0x7f59dc070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:21.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.053+0000 7f59daffd640 1 -- 172.21.15.42:0/2716451639 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 684430610 0 0) 0x7f59dc0a23e0 con 0x7f59dc070850 2024-05-08T18:50:21.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.053+0000 7f59dbfff640 1 -- 172.21.15.42:0/2716451639 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59dc071f80 con 0x7f59dc12c7f0 2024-05-08T18:50:21.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.054+0000 7f59dbfff640 1 --2- 172.21.15.42:0/2716451639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59dc12c7f0 0x7f59dc12cbd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f59cc009720 tx=0x7f59cc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3fbbd5958ac4e2e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:21.053 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.054+0000 7f59daffd640 1 -- 172.21.15.42:0/2716451639 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59cc0316d0 con 0x7f59dc12c7f0 2024-05-08T18:50:21.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.054+0000 7f59daffd640 1 -- 172.21.15.42:0/2716451639 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59cc037070 con 0x7f59dc12c7f0 2024-05-08T18:50:21.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.054+0000 7f59daffd640 1 -- 172.21.15.42:0/2716451639 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59cc0319c0 con 0x7f59dc12c7f0 2024-05-08T18:50:21.054 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.055+0000 7f59e2850640 1 -- 172.21.15.42:0/2716451639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59dc12c7f0 msgr2=0x7f59dc12cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:21.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.055+0000 7f59e2850640 1 --2- 172.21.15.42:0/2716451639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59dc12c7f0 0x7f59dc12cbd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f59cc009720 tx=0x7f59cc02b840 comp rx=0 tx=0).stop 2024-05-08T18:50:21.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.055+0000 7f59e2850640 1 -- 172.21.15.42:0/2716451639 shutdown_connections 2024-05-08T18:50:21.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.055+0000 7f59e2850640 1 --2- 172.21.15.42:0/2716451639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59dc12c7f0 0x7f59dc12cbd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:21.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.055+0000 7f59e2850640 1 -- 172.21.15.42:0/2716451639 >> 172.21.15.42:0/2716451639 conn(0x7f59dc09ff90 msgr2=0x7f59dc0a1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:21.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.055+0000 7f59e2850640 1 -- 172.21.15.42:0/2716451639 shutdown_connections 2024-05-08T18:50:21.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.055+0000 7f59e2850640 1 -- 172.21.15.42:0/2716451639 wait complete. 2024-05-08T18:50:21.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.056+0000 7f59e2850640 1 Processor -- start 2024-05-08T18:50:21.055 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.057+0000 7f59e2850640 1 -- start start 2024-05-08T18:50:21.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.057+0000 7f59e2850640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59dc070850 0x7f59dc1c0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:21.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.057+0000 7f59e2850640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc071530 con 0x7f59dc070850 2024-05-08T18:50:21.056 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.057+0000 7f59dbfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59dc070850 0x7f59dc1c0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:21.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.058+0000 7f59dbfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59dc070850 0x7f59dc1c0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46400/0 (socket says 172.21.15.42:46400) 2024-05-08T18:50:21.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.058+0000 7f59dbfff640 1 -- 172.21.15.42:0/2867634940 learned_addr learned my addr 172.21.15.42:0/2867634940 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:21.057 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.058+0000 7f59dbfff640 1 -- 172.21.15.42:0/2867634940 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59dc11bea0 con 0x7f59dc070850 2024-05-08T18:50:21.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.058+0000 7f59dbfff640 1 --2- 172.21.15.42:0/2867634940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59dc070850 0x7f59dc1c0d60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f59cc02b880 tx=0x7f59cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:21.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.058+0000 7f59d8ff9640 1 -- 172.21.15.42:0/2867634940 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59cc004030 con 0x7f59dc070850 2024-05-08T18:50:21.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.058+0000 7f59d8ff9640 1 -- 172.21.15.42:0/2867634940 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59cc0041d0 con 0x7f59dc070850 2024-05-08T18:50:21.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.058+0000 7f59e2850640 1 -- 172.21.15.42:0/2867634940 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59dc11db80 con 0x7f59dc070850 2024-05-08T18:50:21.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.058+0000 7f59d8ff9640 1 -- 172.21.15.42:0/2867634940 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59cc032640 con 0x7f59dc070850 2024-05-08T18:50:21.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.059+0000 7f59e2850640 1 -- 172.21.15.42:0/2867634940 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59dc1c12a0 con 0x7f59dc070850 2024-05-08T18:50:21.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.060+0000 7f59e2850640 1 -- 172.21.15.42:0/2867634940 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59dc064010 con 0x7f59dc070850 2024-05-08T18:50:21.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.060+0000 7f59d8ff9640 1 -- 172.21.15.42:0/2867634940 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f59cc0327e0 con 0x7f59dc070850 2024-05-08T18:50:21.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.060+0000 7f59d8ff9640 1 --2- 172.21.15.42:0/2867634940 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f59c803d2b0 0x7f59c803f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:21.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.060+0000 7f59d8ff9640 1 -- 172.21.15.42:0/2867634940 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f59cc02f050 con 0x7f59dc070850 2024-05-08T18:50:21.059 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.060+0000 7f59db7fe640 1 --2- 172.21.15.42:0/2867634940 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f59c803d2b0 0x7f59c803f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:21.060 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.061+0000 7f59db7fe640 1 --2- 172.21.15.42:0/2867634940 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f59c803d2b0 0x7f59c803f770 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f59d0000c00 tx=0x7f59d0007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:21.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.069+0000 7f59d8ff9640 1 -- 172.21.15.42:0/2867634940 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f59cc041070 con 0x7f59dc070850 2024-05-08T18:50:21.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.094+0000 7f9d33f3d640 1 Processor -- start 2024-05-08T18:50:21.093 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.094+0000 7f9d33f3d640 1 -- start start 2024-05-08T18:50:21.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.094+0000 7f9d33f3d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9d2c12c7f0 0x7f9d2c12cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:21.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.094+0000 7f9d33f3d640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d2c0a23e0 con 0x7f9d2c070850 2024-05-08T18:50:21.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.094+0000 7f9d33f3d640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f9d2c072fc0 con 0x7f9d2c12c7f0 2024-05-08T18:50:21.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.095+0000 7f9d31cd9640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9d2c12c7f0 0x7f9d2c12cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:21.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.095+0000 7f9d31cd9640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9d2c12c7f0 0x7f9d2c12cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46402/0 (socket says 172.21.15.42:46402) 2024-05-08T18:50:21.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.095+0000 7f9d31cd9640 1 -- 172.21.15.42:0/1736083884 learned_addr learned my addr 172.21.15.42:0/1736083884 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:21.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.095+0000 7f9d31cd9640 1 -- 172.21.15.42:0/1736083884 >> v1:172.21.15.42:6789/0 conn(0x7f9d2c070850 legacy=0x7f9d2c070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:21.094 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.095+0000 7f9d31cd9640 1 -- 172.21.15.42:0/1736083884 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2c071f80 con 0x7f9d2c12c7f0 2024-05-08T18:50:21.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.096+0000 7fa75aaec640 1 Processor -- start 2024-05-08T18:50:21.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.096+0000 7f9d31cd9640 1 --2- 172.21.15.42:0/1736083884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d2c12c7f0 0x7f9d2c12cbd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9d280097f0 tx=0x7f9d2802b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b898421245d55b63 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:21.095 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.096+0000 7fa75aaec640 1 -- start start 2024-05-08T18:50:21.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.096+0000 7f9d30cd7640 1 -- 172.21.15.42:0/1736083884 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d28037070 con 0x7f9d2c12c7f0 2024-05-08T18:50:21.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.096+0000 7f9d30cd7640 1 -- 172.21.15.42:0/1736083884 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d28030640 con 0x7f9d2c12c7f0 2024-05-08T18:50:21.096 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.096+0000 7f9d30cd7640 1 -- 172.21.15.42:0/1736083884 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d28030940 con 0x7f9d2c12c7f0 2024-05-08T18:50:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.097+0000 7fa75aaec640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa754098700 0x7fa754138f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.097+0000 7fa75aaec640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa75406df40 con 0x7fa754097c10 2024-05-08T18:50:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.097+0000 7fa75aaec640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fa754073a50 con 0x7fa754098700 2024-05-08T18:50:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.097+0000 7f793e466640 1 Processor -- start 2024-05-08T18:50:21.097 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.097+0000 7fa753fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa754098700 0x7fa754138f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.097+0000 7fa758888640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fa754097c10 0x7fa754097ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:33122/0 (socket says 172.21.15.42:33122) 2024-05-08T18:50:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.097+0000 7fa758888640 1 -- 172.21.15.42:0/3145168787 learned_addr learned my addr 172.21.15.42:0/3145168787 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:50:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.097+0000 7f793e466640 1 -- start start 2024-05-08T18:50:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.097+0000 7fa7537fe640 1 -- 172.21.15.42:0/3145168787 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1935005544 0 0) 0x7fa75406df40 con 0x7fa754097c10 2024-05-08T18:50:21.098 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.097+0000 7fa7537fe640 1 -- 172.21.15.42:0/3145168787 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa744003520 con 0x7fa754097c10 2024-05-08T18:50:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.097+0000 7f9d33f3d640 1 -- 172.21.15.42:0/1736083884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d2c12c7f0 msgr2=0x7f9d2c12cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.097+0000 7f9d33f3d640 1 --2- 172.21.15.42:0/1736083884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d2c12c7f0 0x7f9d2c12cbd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9d280097f0 tx=0x7f9d2802b760 comp rx=0 tx=0).stop 2024-05-08T18:50:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.097+0000 7fa753fff640 1 -- 172.21.15.42:0/3145168787 >> v1:172.21.15.42:6789/0 conn(0x7fa754097c10 legacy=0x7fa754097ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:21.099 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.097+0000 7fa753fff640 1 -- 172.21.15.42:0/3145168787 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75408b330 con 0x7fa754098700 2024-05-08T18:50:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.097+0000 7f9d33f3d640 1 -- 172.21.15.42:0/1736083884 shutdown_connections 2024-05-08T18:50:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.097+0000 7f9d33f3d640 1 --2- 172.21.15.42:0/1736083884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d2c12c7f0 0x7f9d2c12cbd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.097+0000 7f9d33f3d640 1 -- 172.21.15.42:0/1736083884 >> 172.21.15.42:0/1736083884 conn(0x7f9d2c09ff90 msgr2=0x7f9d2c0a1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.098+0000 7f793e466640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7938132890 0x7f7938134c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.098+0000 7f793e466640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7938071bb0 con 0x7f793812fa90 2024-05-08T18:50:21.100 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.098+0000 7f793e466640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f793806eca0 con 0x7f7938132890 2024-05-08T18:50:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.098+0000 7f9d33f3d640 1 -- 172.21.15.42:0/1736083884 shutdown_connections 2024-05-08T18:50:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.098+0000 7f79377fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7938132890 0x7f7938134c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.098+0000 7f79377fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7938132890 0x7f7938134c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46428/0 (socket says 172.21.15.42:46428) 2024-05-08T18:50:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.098+0000 7f79377fe640 1 -- 172.21.15.42:0/1742883468 learned_addr learned my addr 172.21.15.42:0/1742883468 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.098+0000 7f7937fff640 1 --1- 172.21.15.42:0/1742883468 >> v1:172.21.15.42:6789/0 conn(0x7f793812fa90 0x7f793812fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:33138/0 (socket says 172.21.15.42:33138) 2024-05-08T18:50:21.101 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.098+0000 7f9d33f3d640 1 -- 172.21.15.42:0/1736083884 wait complete. 2024-05-08T18:50:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.098+0000 7f79377fe640 1 -- 172.21.15.42:0/1742883468 >> v1:172.21.15.42:6789/0 conn(0x7f793812fa90 legacy=0x7f793812fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.098+0000 7f79377fe640 1 -- 172.21.15.42:0/1742883468 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7938071ff0 con 0x7f7938132890 2024-05-08T18:50:21.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.098+0000 7f7936ffd640 1 -- 172.21.15.42:0/1742883468 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4030000247 0 0) 0x7f7938071bb0 con 0x7f793812fa90 2024-05-08T18:50:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.099+0000 7fa753fff640 1 --2- 172.21.15.42:0/3145168787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa754098700 0x7fa754138f30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa740009720 tx=0x7fa74002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3052cc08565808d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.099+0000 7fa7537fe640 1 -- 172.21.15.42:0/3145168787 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7400316d0 con 0x7fa754098700 2024-05-08T18:50:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.099+0000 7fa7537fe640 1 -- 172.21.15.42:0/3145168787 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa740037070 con 0x7fa754098700 2024-05-08T18:50:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.099+0000 7fa7537fe640 1 -- 172.21.15.42:0/3145168787 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7400319c0 con 0x7fa754098700 2024-05-08T18:50:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.099+0000 7f79377fe640 1 --2- 172.21.15.42:0/1742883468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7938132890 0x7f7938134c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f79240097f0 tx=0x7f792402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac17210214964e4a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:21.103 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.099+0000 7f9d33f3d640 1 Processor -- start 2024-05-08T18:50:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.099+0000 7f7936ffd640 1 -- 172.21.15.42:0/1742883468 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7924035020 con 0x7f7938132890 2024-05-08T18:50:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.099+0000 7f7936ffd640 1 -- 172.21.15.42:0/1742883468 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79240317a0 con 0x7f7938132890 2024-05-08T18:50:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.099+0000 7f9d33f3d640 1 -- start start 2024-05-08T18:50:21.104 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.099+0000 7f7936ffd640 1 -- 172.21.15.42:0/1742883468 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7924035020 con 0x7f7938132890 2024-05-08T18:50:21.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.100+0000 7fa75aaec640 1 -- 172.21.15.42:0/3145168787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa754098700 msgr2=0x7fa754138f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:21.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.100+0000 7fa75aaec640 1 --2- 172.21.15.42:0/3145168787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa754098700 0x7fa754138f30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa740009720 tx=0x7fa74002b840 comp rx=0 tx=0).stop 2024-05-08T18:50:21.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.100+0000 7f793e466640 1 -- 172.21.15.42:0/1742883468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7938132890 msgr2=0x7f7938134c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:21.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.100+0000 7f793e466640 1 --2- 172.21.15.42:0/1742883468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7938132890 0x7f7938134c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f79240097f0 tx=0x7f792402b910 comp rx=0 tx=0).stop 2024-05-08T18:50:21.105 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.100+0000 7f9d33f3d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d2c070850 0x7f9d2c1c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:21.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.100+0000 7fa75aaec640 1 -- 172.21.15.42:0/3145168787 shutdown_connections 2024-05-08T18:50:21.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.100+0000 7fa75aaec640 1 --2- 172.21.15.42:0/3145168787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa754098700 0x7fa754138f30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:21.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.100+0000 7fa75aaec640 1 -- 172.21.15.42:0/3145168787 >> 172.21.15.42:0/3145168787 conn(0x7fa75409e9b0 msgr2=0x7fa75409edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:21.106 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.100+0000 7f9d33f3d640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c071530 con 0x7f9d2c070850 2024-05-08T18:50:21.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.100+0000 7f793e466640 1 -- 172.21.15.42:0/1742883468 shutdown_connections 2024-05-08T18:50:21.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.100+0000 7f793e466640 1 --2- 172.21.15.42:0/1742883468 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7938132890 0x7f7938134c80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:21.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.100+0000 7f793e466640 1 -- 172.21.15.42:0/1742883468 >> 172.21.15.42:0/1742883468 conn(0x7f793809eaf0 msgr2=0x7f793809ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:21.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.100+0000 7f793e466640 1 -- 172.21.15.42:0/1742883468 shutdown_connections 2024-05-08T18:50:21.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.100+0000 7fa75aaec640 1 -- 172.21.15.42:0/3145168787 shutdown_connections 2024-05-08T18:50:21.107 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.100+0000 7fa75aaec640 1 -- 172.21.15.42:0/3145168787 wait complete. 2024-05-08T18:50:21.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.100+0000 7f9d31cd9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d2c070850 0x7f9d2c1c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:21.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.100+0000 7f9d31cd9640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d2c070850 0x7f9d2c1c45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46444/0 (socket says 172.21.15.42:46444) 2024-05-08T18:50:21.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.100+0000 7f9d31cd9640 1 -- 172.21.15.42:0/463354281 learned_addr learned my addr 172.21.15.42:0/463354281 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:21.108 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.100+0000 7f793e466640 1 -- 172.21.15.42:0/1742883468 wait complete. 2024-05-08T18:50:21.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.101+0000 7f9d31cd9640 1 -- 172.21.15.42:0/463354281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2c11e9c0 con 0x7f9d2c070850 2024-05-08T18:50:21.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.101+0000 7f9d31cd9640 1 --2- 172.21.15.42:0/463354281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d2c070850 0x7f9d2c1c45e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9d2802b7a0 tx=0x7f9d280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:21.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.101+0000 7f9d227fc640 1 -- 172.21.15.42:0/463354281 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d28042070 con 0x7f9d2c070850 2024-05-08T18:50:21.109 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.101+0000 7fa75aaec640 1 Processor -- start 2024-05-08T18:50:21.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.101+0000 7f9d227fc640 1 -- 172.21.15.42:0/463354281 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d280327c0 con 0x7f9d2c070850 2024-05-08T18:50:21.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.101+0000 7f9d227fc640 1 -- 172.21.15.42:0/463354281 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d28037040 con 0x7f9d2c070850 2024-05-08T18:50:21.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.101+0000 7f9d33f3d640 1 -- 172.21.15.42:0/463354281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d2c11f190 con 0x7f9d2c070850 2024-05-08T18:50:21.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.101+0000 7fa75aaec640 1 -- start start 2024-05-08T18:50:21.110 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.101+0000 7f9d33f3d640 1 -- 172.21.15.42:0/463354281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d2c11f830 con 0x7f9d2c070850 2024-05-08T18:50:21.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.102+0000 7f793e466640 1 Processor -- start 2024-05-08T18:50:21.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.102+0000 7f793e466640 1 -- start start 2024-05-08T18:50:21.111 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.102+0000 7fa75aaec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa754097c10 0x7fa754123890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:21.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.102+0000 7fa75aaec640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa754139470 con 0x7fa754097c10 2024-05-08T18:50:21.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.102+0000 7fa758888640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa754097c10 0x7fa754123890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:21.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.102+0000 7fa758888640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa754097c10 0x7fa754123890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46456/0 (socket says 172.21.15.42:46456) 2024-05-08T18:50:21.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.102+0000 7fa758888640 1 -- 172.21.15.42:0/745688552 learned_addr learned my addr 172.21.15.42:0/745688552 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:21.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.102+0000 7f793e466640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f793812fa90 0x7f793811bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:21.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.102+0000 7f793e466640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f79381351c0 con 0x7f793812fa90 2024-05-08T18:50:21.112 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.103+0000 7f7937fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f793812fa90 0x7f793811bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:21.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.103+0000 7fa758888640 1 -- 172.21.15.42:0/745688552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa754073490 con 0x7fa754097c10 2024-05-08T18:50:21.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.103+0000 7f7937fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f793812fa90 0x7f793811bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:46470/0 (socket says 172.21.15.42:46470) 2024-05-08T18:50:21.113 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.103+0000 7f9d227fc640 1 -- 172.21.15.42:0/463354281 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9d28045070 con 0x7f9d2c070850 2024-05-08T18:50:21.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.103+0000 7f7937fff640 1 -- 172.21.15.42:0/257098712 learned_addr learned my addr 172.21.15.42:0/257098712 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:21.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.103+0000 7f9d33f3d640 1 -- 172.21.15.42:0/463354281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d2c064010 con 0x7f9d2c070850 2024-05-08T18:50:21.114 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.103+0000 7fa758888640 1 --2- 172.21.15.42:0/745688552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa754097c10 0x7fa754123890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa74800c480 tx=0x7fa74800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:21.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.103+0000 7f9d227fc640 1 --2- 172.21.15.42:0/463354281 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9d1003d2b0 0x7f9d1003f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:21.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.103+0000 7f9d227fc640 1 -- 172.21.15.42:0/463354281 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f9d280730e0 con 0x7f9d2c070850 2024-05-08T18:50:21.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.103+0000 7f7937fff640 1 -- 172.21.15.42:0/257098712 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793811d300 con 0x7f793812fa90 2024-05-08T18:50:21.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.103+0000 7fa7517fa640 1 -- 172.21.15.42:0/745688552 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa748017070 con 0x7fa754097c10 2024-05-08T18:50:21.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.103+0000 7fa7517fa640 1 -- 172.21.15.42:0/745688552 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa748005c10 con 0x7fa754097c10 2024-05-08T18:50:21.115 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.103+0000 7fa7517fa640 1 -- 172.21.15.42:0/745688552 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa748007070 con 0x7fa754097c10 2024-05-08T18:50:21.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.103+0000 7fa75aaec640 1 -- 172.21.15.42:0/745688552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa75408e350 con 0x7fa754097c10 2024-05-08T18:50:21.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.103+0000 7fa75aaec640 1 -- 172.21.15.42:0/745688552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa754123dd0 con 0x7fa754097c10 2024-05-08T18:50:21.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.103+0000 7f7937fff640 1 --2- 172.21.15.42:0/257098712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f793812fa90 0x7f793811bb20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f792800c420 tx=0x7f792800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:21.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.103+0000 7f9d314d8640 1 --2- 172.21.15.42:0/463354281 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9d1003d2b0 0x7f9d1003f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:21.116 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.104+0000 7f9d314d8640 1 --2- 172.21.15.42:0/463354281 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9d1003d2b0 0x7f9d1003f770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0017c0 tx=0x7f9d1c0079d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:21.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.105+0000 7fa75aaec640 1 -- 172.21.15.42:0/745688552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa754125760 con 0x7fa754097c10 2024-05-08T18:50:21.117 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.108+0000 7f9d227fc640 1 -- 172.21.15.42:0/463354281 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9d2c11f830 con 0x7f9d2c070850 2024-05-08T18:50:21.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.109+0000 7f7934ff9640 1 -- 172.21.15.42:0/257098712 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7928018070 con 0x7f793812fa90 2024-05-08T18:50:21.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.109+0000 7f7934ff9640 1 -- 172.21.15.42:0/257098712 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79280074d0 con 0x7f793812fa90 2024-05-08T18:50:21.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.109+0000 7f793e466640 1 -- 172.21.15.42:0/257098712 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f793811d9e0 con 0x7f793812fa90 2024-05-08T18:50:21.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.109+0000 7f7934ff9640 1 -- 172.21.15.42:0/257098712 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7928004950 con 0x7f793812fa90 2024-05-08T18:50:21.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.109+0000 7f793e466640 1 -- 172.21.15.42:0/257098712 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f793811c060 con 0x7f793812fa90 2024-05-08T18:50:21.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.110+0000 7fa7517fa640 1 -- 172.21.15.42:0/745688552 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa74801a070 con 0x7fa754097c10 2024-05-08T18:50:21.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.110+0000 7fa7517fa640 1 --2- 172.21.15.42:0/745688552 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa73803d350 0x7fa73803f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:21.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.110+0000 7fa7517fa640 1 -- 172.21.15.42:0/745688552 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7fa748050af0 con 0x7fa754097c10 2024-05-08T18:50:21.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.110+0000 7f793e466640 1 -- 172.21.15.42:0/257098712 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7938064010 con 0x7f793812fa90 2024-05-08T18:50:21.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.110+0000 7fa753fff640 1 --2- 172.21.15.42:0/745688552 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa73803d350 0x7fa73803f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:21.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.111+0000 7fa753fff640 1 --2- 172.21.15.42:0/745688552 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa73803d350 0x7fa73803f810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa740009720 tx=0x7fa740008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:21.119 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.114+0000 7fa7517fa640 1 -- 172.21.15.42:0/745688552 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa748021020 con 0x7fa754097c10 2024-05-08T18:50:21.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.115+0000 7f7934ff9640 1 -- 172.21.15.42:0/257098712 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f792801b070 con 0x7f793812fa90 2024-05-08T18:50:21.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.115+0000 7f7934ff9640 1 --2- 172.21.15.42:0/257098712 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f792003d2b0 0x7f792003f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:21.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.115+0000 7f7934ff9640 1 -- 172.21.15.42:0/257098712 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f7928050be0 con 0x7f793812fa90 2024-05-08T18:50:21.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.116+0000 7f79377fe640 1 --2- 172.21.15.42:0/257098712 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f792003d2b0 0x7f792003f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:21.120 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.116+0000 7f79377fe640 1 --2- 172.21.15.42:0/257098712 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f792003d2b0 0x7f792003f770 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7924036000 tx=0x7f7924008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:21.122 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.123+0000 7f7934ff9640 1 -- 172.21.15.42:0/257098712 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7928022020 con 0x7f793812fa90 2024-05-08T18:50:21.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.266+0000 7f59e2850640 1 -- 172.21.15.42:0/2867634940 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f59dc0a2930 con 0x7f59dc070850 2024-05-08T18:50:21.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.267+0000 7f59d8ff9640 1 -- 172.21.15.42:0/2867634940 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f59cc003610 con 0x7f59dc070850 2024-05-08T18:50:21.266 INFO:teuthology.orchestra.run.smithi042.stdout:38654705666 2024-05-08T18:50:21.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.269+0000 7f59e2850640 1 -- 172.21.15.42:0/2867634940 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f59c803d2b0 msgr2=0x7f59c803f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:21.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.269+0000 7f59e2850640 1 --2- 172.21.15.42:0/2867634940 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f59c803d2b0 0x7f59c803f770 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f59d0000c00 tx=0x7f59d0007910 comp rx=0 tx=0).stop 2024-05-08T18:50:21.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.270+0000 7f59e2850640 1 -- 172.21.15.42:0/2867634940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59dc070850 msgr2=0x7f59dc1c0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:21.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.270+0000 7f59e2850640 1 --2- 172.21.15.42:0/2867634940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59dc070850 0x7f59dc1c0d60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f59cc02b880 tx=0x7f59cc0046c0 comp rx=0 tx=0).stop 2024-05-08T18:50:21.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.270+0000 7f59e2850640 1 -- 172.21.15.42:0/2867634940 shutdown_connections 2024-05-08T18:50:21.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.270+0000 7f59e2850640 1 --2- 172.21.15.42:0/2867634940 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f59c803d2b0 0x7f59c803f770 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:21.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.270+0000 7f59e2850640 1 --2- 172.21.15.42:0/2867634940 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59dc070850 0x7f59dc1c0d60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:21.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.270+0000 7f59e2850640 1 -- 172.21.15.42:0/2867634940 >> 172.21.15.42:0/2867634940 conn(0x7f59dc09ff90 msgr2=0x7f59dc1b7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:21.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.270+0000 7f59e2850640 1 -- 172.21.15.42:0/2867634940 shutdown_connections 2024-05-08T18:50:21.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.270+0000 7f59e2850640 1 -- 172.21.15.42:0/2867634940 wait complete. 2024-05-08T18:50:21.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.0 2024-05-08T18:50:21.301 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.302+0000 7f9d33f3d640 1 -- 172.21.15.42:0/463354281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9d2c0a2930 con 0x7f9d2c070850 2024-05-08T18:50:21.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.303+0000 7f9d227fc640 1 -- 172.21.15.42:0/463354281 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9d28032ac0 con 0x7f9d2c070850 2024-05-08T18:50:21.302 INFO:teuthology.orchestra.run.smithi042.stdout:38654705666 2024-05-08T18:50:21.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.305+0000 7f9d33f3d640 1 -- 172.21.15.42:0/463354281 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9d1003d2b0 msgr2=0x7f9d1003f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:21.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.305+0000 7f9d33f3d640 1 --2- 172.21.15.42:0/463354281 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9d1003d2b0 0x7f9d1003f770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0017c0 tx=0x7f9d1c0079d0 comp rx=0 tx=0).stop 2024-05-08T18:50:21.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.305+0000 7f9d33f3d640 1 -- 172.21.15.42:0/463354281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d2c070850 msgr2=0x7f9d2c1c45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:21.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.305+0000 7f9d33f3d640 1 --2- 172.21.15.42:0/463354281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d2c070850 0x7f9d2c1c45e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9d2802b7a0 tx=0x7f9d280046c0 comp rx=0 tx=0).stop 2024-05-08T18:50:21.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.305+0000 7f9d33f3d640 1 -- 172.21.15.42:0/463354281 shutdown_connections 2024-05-08T18:50:21.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.305+0000 7f9d33f3d640 1 --2- 172.21.15.42:0/463354281 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9d1003d2b0 0x7f9d1003f770 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:21.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.305+0000 7f9d33f3d640 1 --2- 172.21.15.42:0/463354281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d2c070850 0x7f9d2c1c45e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:21.304 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.305+0000 7f9d33f3d640 1 -- 172.21.15.42:0/463354281 >> 172.21.15.42:0/463354281 conn(0x7f9d2c09ff90 msgr2=0x7f9d2c129a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:21.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.305+0000 7f9d33f3d640 1 -- 172.21.15.42:0/463354281 shutdown_connections 2024-05-08T18:50:21.305 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.305+0000 7f9d33f3d640 1 -- 172.21.15.42:0/463354281 wait complete. 2024-05-08T18:50:21.309 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.311+0000 7fa75aaec640 1 -- 172.21.15.42:0/745688552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa7541265d0 con 0x7fa754097c10 2024-05-08T18:50:21.310 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.311+0000 7fa7517fa640 1 -- 172.21.15.42:0/745688552 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa748011c70 con 0x7fa754097c10 2024-05-08T18:50:21.310 INFO:teuthology.orchestra.run.smithi042.stdout:38654705666 2024-05-08T18:50:21.312 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.313+0000 7fa75aaec640 1 -- 172.21.15.42:0/745688552 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa73803d350 msgr2=0x7fa73803f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.313+0000 7fa75aaec640 1 --2- 172.21.15.42:0/745688552 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa73803d350 0x7fa73803f810 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa740009720 tx=0x7fa740008030 comp rx=0 tx=0).stop 2024-05-08T18:50:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.313+0000 7fa75aaec640 1 -- 172.21.15.42:0/745688552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa754097c10 msgr2=0x7fa754123890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.313+0000 7fa75aaec640 1 --2- 172.21.15.42:0/745688552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa754097c10 0x7fa754123890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa74800c480 tx=0x7fa74800c940 comp rx=0 tx=0).stop 2024-05-08T18:50:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.313+0000 7fa75aaec640 1 -- 172.21.15.42:0/745688552 shutdown_connections 2024-05-08T18:50:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.313+0000 7fa75aaec640 1 --2- 172.21.15.42:0/745688552 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa73803d350 0x7fa73803f810 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.313+0000 7fa75aaec640 1 --2- 172.21.15.42:0/745688552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa754097c10 0x7fa754123890 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.313+0000 7fa75aaec640 1 -- 172.21.15.42:0/745688552 >> 172.21.15.42:0/745688552 conn(0x7fa75409e9b0 msgr2=0x7fa754138d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.313+0000 7fa75aaec640 1 -- 172.21.15.42:0/745688552 shutdown_connections 2024-05-08T18:50:21.313 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.313+0000 7fa75aaec640 1 -- 172.21.15.42:0/745688552 wait complete. 2024-05-08T18:50:21.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.1 2024-05-08T18:50:21.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.3 2024-05-08T18:50:21.327 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.328+0000 7f793e466640 1 -- 172.21.15.42:0/257098712 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7938134c90 con 0x7f793812fa90 2024-05-08T18:50:21.328 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.329+0000 7f7934ff9640 1 -- 172.21.15.42:0/257098712 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7928010300 con 0x7f793812fa90 2024-05-08T18:50:21.328 INFO:teuthology.orchestra.run.smithi042.stdout:38654705667 2024-05-08T18:50:21.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.331+0000 7f793e466640 1 -- 172.21.15.42:0/257098712 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f792003d2b0 msgr2=0x7f792003f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:21.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.331+0000 7f793e466640 1 --2- 172.21.15.42:0/257098712 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f792003d2b0 0x7f792003f770 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7924036000 tx=0x7f7924008030 comp rx=0 tx=0).stop 2024-05-08T18:50:21.330 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.331+0000 7f793e466640 1 -- 172.21.15.42:0/257098712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f793812fa90 msgr2=0x7f793811bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:21.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.331+0000 7f793e466640 1 --2- 172.21.15.42:0/257098712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f793812fa90 0x7f793811bb20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f792800c420 tx=0x7f792800c8e0 comp rx=0 tx=0).stop 2024-05-08T18:50:21.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.331+0000 7f793e466640 1 -- 172.21.15.42:0/257098712 shutdown_connections 2024-05-08T18:50:21.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.331+0000 7f793e466640 1 --2- 172.21.15.42:0/257098712 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f792003d2b0 0x7f792003f770 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:21.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.331+0000 7f793e466640 1 --2- 172.21.15.42:0/257098712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f793812fa90 0x7f793811bb20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:21.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.331+0000 7f793e466640 1 -- 172.21.15.42:0/257098712 >> 172.21.15.42:0/257098712 conn(0x7f793809eaf0 msgr2=0x7f79381320a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:21.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.331+0000 7f793e466640 1 -- 172.21.15.42:0/257098712 shutdown_connections 2024-05-08T18:50:21.331 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:21.331+0000 7f793e466640 1 -- 172.21.15.42:0/257098712 wait complete. 2024-05-08T18:50:21.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.2 2024-05-08T18:50:22.285 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T18:50:22.316 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T18:50:22.324 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T18:50:22.341 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T18:50:22.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.406+0000 7f5e78f5c640 1 Processor -- start 2024-05-08T18:50:22.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.406+0000 7f5e78f5c640 1 -- start start 2024-05-08T18:50:22.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.407+0000 7f5e78f5c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5e7412cbd0 0x7f5e74070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:22.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.407+0000 7f5e78f5c640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e7412d020 con 0x7f5e7412c7f0 2024-05-08T18:50:22.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.407+0000 7f5e78f5c640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f5e74072fc0 con 0x7f5e7412cbd0 2024-05-08T18:50:22.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.407+0000 7f5e71d9b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5e7412cbd0 0x7f5e74070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:22.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.407+0000 7f5e7259c640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f5e7412c7f0 0x7f5e74070850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:36058/0 (socket says 172.21.15.42:36058) 2024-05-08T18:50:22.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.407+0000 7f5e7259c640 1 -- 172.21.15.42:0/834676672 learned_addr learned my addr 172.21.15.42:0/834676672 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:50:22.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.407+0000 7f5e71d9b640 1 -- 172.21.15.42:0/834676672 >> v1:172.21.15.42:6789/0 conn(0x7f5e7412c7f0 legacy=0x7f5e74070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:22.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.407+0000 7f5e71d9b640 1 -- 172.21.15.42:0/834676672 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e740a23e0 con 0x7f5e7412cbd0 2024-05-08T18:50:22.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.408+0000 7f5e71d9b640 1 --2- 172.21.15.42:0/834676672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7412cbd0 0x7f5e74070f60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009720 tx=0x7f5e6802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a042b4fa75fd80f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:22.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.408+0000 7f5e7159a640 1 -- 172.21.15.42:0/834676672 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e680316d0 con 0x7f5e7412cbd0 2024-05-08T18:50:22.407 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.408+0000 7f5e7159a640 1 -- 172.21.15.42:0/834676672 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e68037070 con 0x7f5e7412cbd0 2024-05-08T18:50:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.408+0000 7f5e7159a640 1 -- 172.21.15.42:0/834676672 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e680319c0 con 0x7f5e7412cbd0 2024-05-08T18:50:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.409+0000 7f5e78f5c640 1 -- 172.21.15.42:0/834676672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7412cbd0 msgr2=0x7f5e74070f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.409+0000 7f5e78f5c640 1 --2- 172.21.15.42:0/834676672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7412cbd0 0x7f5e74070f60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009720 tx=0x7f5e6802b840 comp rx=0 tx=0).stop 2024-05-08T18:50:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.409+0000 7f5e78f5c640 1 -- 172.21.15.42:0/834676672 shutdown_connections 2024-05-08T18:50:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.409+0000 7f5e78f5c640 1 --2- 172.21.15.42:0/834676672 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7412cbd0 0x7f5e74070f60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.409+0000 7f5e78f5c640 1 -- 172.21.15.42:0/834676672 >> 172.21.15.42:0/834676672 conn(0x7f5e7409ff90 msgr2=0x7f5e740a1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.409+0000 7f5e78f5c640 1 -- 172.21.15.42:0/834676672 shutdown_connections 2024-05-08T18:50:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.409+0000 7f5e78f5c640 1 -- 172.21.15.42:0/834676672 wait complete. 2024-05-08T18:50:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.410+0000 7f5e78f5c640 1 Processor -- start 2024-05-08T18:50:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.410+0000 7f5e78f5c640 1 -- start start 2024-05-08T18:50:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.411+0000 7f5e78f5c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7412c7f0 0x7f5e7411ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.411+0000 7f5e78f5c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f5e74072870 con 0x7f5e7412c7f0 2024-05-08T18:50:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.411+0000 7f5e7259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7412c7f0 0x7f5e7411ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.411+0000 7f5e7259c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7412c7f0 0x7f5e7411ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58150/0 (socket says 172.21.15.42:58150) 2024-05-08T18:50:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.411+0000 7f5e7259c640 1 -- 172.21.15.42:0/2499729866 learned_addr learned my addr 172.21.15.42:0/2499729866 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.411+0000 7f5e7259c640 1 -- 172.21.15.42:0/2499729866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e7412b9d0 con 0x7f5e7412c7f0 2024-05-08T18:50:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.412+0000 7f5e7259c640 1 --2- 172.21.15.42:0/2499729866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7412c7f0 0x7f5e7411ace0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400c4a0 tx=0x7f5e6400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.412+0000 7f5e62ffd640 1 -- 172.21.15.42:0/2499729866 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e64017070 con 0x7f5e7412c7f0 2024-05-08T18:50:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.412+0000 7f5e62ffd640 1 -- 172.21.15.42:0/2499729866 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e64005c10 con 0x7f5e7412c7f0 2024-05-08T18:50:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.412+0000 7f5e78f5c640 1 -- 172.21.15.42:0/2499729866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e7411e060 con 0x7f5e7412c7f0 2024-05-08T18:50:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.412+0000 7f5e62ffd640 1 -- 172.21.15.42:0/2499729866 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e64007070 con 0x7f5e7412c7f0 2024-05-08T18:50:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.412+0000 7f5e78f5c640 1 -- 172.21.15.42:0/2499729866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e7411d9d0 con 0x7f5e7412c7f0 2024-05-08T18:50:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.413+0000 7f5e62ffd640 1 -- 172.21.15.42:0/2499729866 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5e6401a070 con 0x7f5e7412c7f0 2024-05-08T18:50:22.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.414+0000 7f5e78f5c640 1 -- 172.21.15.42:0/2499729866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e740a1a40 con 0x7f5e7412c7f0 2024-05-08T18:50:22.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.414+0000 7f5e62ffd640 1 --2- 172.21.15.42:0/2499729866 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5e5403d2e0 0x7f5e5403f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:22.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.414+0000 7f5e62ffd640 1 -- 172.21.15.42:0/2499729866 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f5e640505d0 con 0x7f5e7412c7f0 2024-05-08T18:50:22.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.414+0000 7f5e71d9b640 1 --2- 172.21.15.42:0/2499729866 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5e5403d2e0 0x7f5e5403f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:22.413 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.415+0000 7f5e71d9b640 1 --2- 172.21.15.42:0/2499729866 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5e5403d2e0 0x7f5e5403f7a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5e68036000 tx=0x7f5e68008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:22.418 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.419+0000 7f5e62ffd640 1 -- 172.21.15.42:0/2499729866 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f5e740a1a40 con 0x7f5e7412c7f0 2024-05-08T18:50:22.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.447+0000 7ffbb382e640 1 Processor -- start 2024-05-08T18:50:22.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.447+0000 7f7dc43c0640 1 Processor -- start 2024-05-08T18:50:22.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.447+0000 7f7dc43c0640 1 -- start start 2024-05-08T18:50:22.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.447+0000 7ffbb382e640 1 -- start start 2024-05-08T18:50:22.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.448+0000 7f7dc43c0640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7dbc12cbd0 0x7f7dbc070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:22.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.448+0000 7ffbb382e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ffbac09bb50 0x7ffbac131360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:22.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.448+0000 7f7dc43c0640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dbc12d020 con 0x7f7dbc12c7f0 2024-05-08T18:50:22.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.448+0000 7f7dc43c0640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f7dbc072fc0 con 0x7f7dbc12cbd0 2024-05-08T18:50:22.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.448+0000 7f7dc195b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7dbc12cbd0 0x7f7dbc070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:22.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.448+0000 7f7dc195b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7dbc12cbd0 0x7f7dbc070f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58156/0 (socket says 172.21.15.42:58156) 2024-05-08T18:50:22.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.448+0000 7f7dc195b640 1 -- 172.21.15.42:0/4208259304 learned_addr learned my addr 172.21.15.42:0/4208259304 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:22.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.448+0000 7ffbb382e640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbac098ee0 con 0x7ffbac0983f0 2024-05-08T18:50:22.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.448+0000 7ffbb382e640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7ffbac09e5e0 con 0x7ffbac09bb50 2024-05-08T18:50:22.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.448+0000 7ffbb0dc9640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ffbac09bb50 0x7ffbac131360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:22.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.448+0000 7ffbb15ca640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ffbac0983f0 0x7ffbac0987d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:36082/0 (socket says 172.21.15.42:36082) 2024-05-08T18:50:22.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.448+0000 7ffbb15ca640 1 -- 172.21.15.42:0/3696600302 learned_addr learned my addr 172.21.15.42:0/3696600302 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:50:22.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.448+0000 7f7dc195b640 1 -- 172.21.15.42:0/4208259304 >> v1:172.21.15.42:6789/0 conn(0x7f7dbc12c7f0 legacy=0x7f7dbc070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:22.450 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.449+0000 7f7dc195b640 1 -- 172.21.15.42:0/4208259304 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dbc0a23e0 con 0x7f7dbc12cbd0 2024-05-08T18:50:22.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.449+0000 7ffbb0dc9640 1 -- 172.21.15.42:0/3696600302 >> v1:172.21.15.42:6789/0 conn(0x7ffbac0983f0 legacy=0x7ffbac0987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:22.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.449+0000 7ffbb0dc9640 1 -- 172.21.15.42:0/3696600302 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbac073b30 con 0x7ffbac09bb50 2024-05-08T18:50:22.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.449+0000 7f7dc195b640 1 --2- 172.21.15.42:0/4208259304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7dbc12cbd0 0x7f7dbc070f60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7db80097f0 tx=0x7f7db802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b722093d5c743d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:22.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.449+0000 7ffbb0dc9640 1 --2- 172.21.15.42:0/3696600302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbac09bb50 0x7ffbac131360 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c009720 tx=0x7ffb9c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113330d4aac92e38 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:22.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.450+0000 7f7dc115a640 1 -- 172.21.15.42:0/4208259304 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db8035020 con 0x7f7dbc12cbd0 2024-05-08T18:50:22.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.450+0000 7f7dc115a640 1 -- 172.21.15.42:0/4208259304 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db80317a0 con 0x7f7dbc12cbd0 2024-05-08T18:50:22.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.450+0000 7ffba3fff640 1 -- 172.21.15.42:0/3696600302 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb9c035020 con 0x7ffbac09bb50 2024-05-08T18:50:22.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.450+0000 7f7dc115a640 1 -- 172.21.15.42:0/4208259304 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db8031aa0 con 0x7f7dbc12cbd0 2024-05-08T18:50:22.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.450+0000 7ffba3fff640 1 -- 172.21.15.42:0/3696600302 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb9c031760 con 0x7ffbac09bb50 2024-05-08T18:50:22.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.450+0000 7ffba3fff640 1 -- 172.21.15.42:0/3696600302 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb9c031a60 con 0x7ffbac09bb50 2024-05-08T18:50:22.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.450+0000 7f7dc43c0640 1 -- 172.21.15.42:0/4208259304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7dbc12cbd0 msgr2=0x7f7dbc070f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:22.453 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.450+0000 7f7dc43c0640 1 --2- 172.21.15.42:0/4208259304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7dbc12cbd0 0x7f7dbc070f60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7db80097f0 tx=0x7f7db802b910 comp rx=0 tx=0).stop 2024-05-08T18:50:22.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.450+0000 7ffbb382e640 1 -- 172.21.15.42:0/3696600302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbac09bb50 msgr2=0x7ffbac131360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:22.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.451+0000 7ffbb382e640 1 --2- 172.21.15.42:0/3696600302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbac09bb50 0x7ffbac131360 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c009720 tx=0x7ffb9c02b8d0 comp rx=0 tx=0).stop 2024-05-08T18:50:22.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.451+0000 7f7dc43c0640 1 -- 172.21.15.42:0/4208259304 shutdown_connections 2024-05-08T18:50:22.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.451+0000 7f7dc43c0640 1 --2- 172.21.15.42:0/4208259304 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7dbc12cbd0 0x7f7dbc070f60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:22.454 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.451+0000 7f7dc43c0640 1 -- 172.21.15.42:0/4208259304 >> 172.21.15.42:0/4208259304 conn(0x7f7dbc09ff90 msgr2=0x7f7dbc0a1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:22.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.451+0000 7ffbb382e640 1 -- 172.21.15.42:0/3696600302 shutdown_connections 2024-05-08T18:50:22.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.451+0000 7ffbb382e640 1 --2- 172.21.15.42:0/3696600302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbac09bb50 0x7ffbac131360 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:22.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.451+0000 7ffbb382e640 1 -- 172.21.15.42:0/3696600302 >> 172.21.15.42:0/3696600302 conn(0x7ffbac09ed90 msgr2=0x7ffbac09b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:22.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.451+0000 7f7dc43c0640 1 -- 172.21.15.42:0/4208259304 shutdown_connections 2024-05-08T18:50:22.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.451+0000 7f7dc43c0640 1 -- 172.21.15.42:0/4208259304 wait complete. 2024-05-08T18:50:22.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.451+0000 7ffbb382e640 1 -- 172.21.15.42:0/3696600302 shutdown_connections 2024-05-08T18:50:22.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.451+0000 7ffbb382e640 1 -- 172.21.15.42:0/3696600302 wait complete. 2024-05-08T18:50:22.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.452+0000 7ffbb382e640 1 Processor -- start 2024-05-08T18:50:22.456 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.452+0000 7f7dc43c0640 1 Processor -- start 2024-05-08T18:50:22.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.452+0000 7ffbb382e640 1 -- start start 2024-05-08T18:50:22.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.452+0000 7f7dc43c0640 1 -- start start 2024-05-08T18:50:22.457 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.452+0000 7ffbb382e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbac0983f0 0x7ffbac12ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:22.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.452+0000 7ffbb382e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ffbac0720b0 con 0x7ffbac0983f0 2024-05-08T18:50:22.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.452+0000 7f7dc43c0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7dbc12c7f0 0x7f7dbc11ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:22.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.452+0000 7f7dc43c0640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc072870 con 0x7f7dbc12c7f0 2024-05-08T18:50:22.458 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.452+0000 7ffbb15ca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbac0983f0 0x7ffbac12ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:22.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.452+0000 7f7dc215c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7dbc12c7f0 0x7f7dbc11ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:22.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.452+0000 7ffbb15ca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbac0983f0 0x7ffbac12ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58174/0 (socket says 172.21.15.42:58174) 2024-05-08T18:50:22.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.452+0000 7ffbb15ca640 1 -- 172.21.15.42:0/1996579709 learned_addr learned my addr 172.21.15.42:0/1996579709 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:22.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.452+0000 7f7dc215c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7dbc12c7f0 0x7f7dbc11ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58186/0 (socket says 172.21.15.42:58186) 2024-05-08T18:50:22.459 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.452+0000 7f7dc215c640 1 -- 172.21.15.42:0/2125856405 learned_addr learned my addr 172.21.15.42:0/2125856405 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:22.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.453+0000 7ffbb15ca640 1 -- 172.21.15.42:0/1996579709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbac098150 con 0x7ffbac0983f0 2024-05-08T18:50:22.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.453+0000 7f7dc215c640 1 -- 172.21.15.42:0/2125856405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dbc12b9d0 con 0x7f7dbc12c7f0 2024-05-08T18:50:22.460 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.453+0000 7ffbb15ca640 1 --2- 172.21.15.42:0/1996579709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbac0983f0 0x7ffbac12ddb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffba800c380 tx=0x7ffba800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:22.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.453+0000 7f7dc215c640 1 --2- 172.21.15.42:0/2125856405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7dbc12c7f0 0x7f7dbc11ace0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7dac00c450 tx=0x7f7dac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:22.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.453+0000 7ffba1ffb640 1 -- 172.21.15.42:0/1996579709 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffba8005c10 con 0x7ffbac0983f0 2024-05-08T18:50:22.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.453+0000 7ffbb382e640 1 -- 172.21.15.42:0/1996579709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbac08b060 con 0x7ffbac0983f0 2024-05-08T18:50:22.461 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.453+0000 7ffba1ffb640 1 -- 172.21.15.42:0/1996579709 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffba8005db0 con 0x7ffbac0983f0 2024-05-08T18:50:22.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.453+0000 7f7db2ffd640 1 -- 172.21.15.42:0/2125856405 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dac017070 con 0x7f7dbc12c7f0 2024-05-08T18:50:22.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.453+0000 7f7db2ffd640 1 -- 172.21.15.42:0/2125856405 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dac005220 con 0x7f7dbc12c7f0 2024-05-08T18:50:22.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.453+0000 7f7dc43c0640 1 -- 172.21.15.42:0/2125856405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dbc11e060 con 0x7f7dbc12c7f0 2024-05-08T18:50:22.462 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.453+0000 7f7db2ffd640 1 -- 172.21.15.42:0/2125856405 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dac0035f0 con 0x7f7dbc12c7f0 2024-05-08T18:50:22.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.453+0000 7ffba1ffb640 1 -- 172.21.15.42:0/1996579709 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffba8004930 con 0x7ffbac0983f0 2024-05-08T18:50:22.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.454+0000 7ffbb382e640 1 -- 172.21.15.42:0/1996579709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbac130a70 con 0x7ffbac0983f0 2024-05-08T18:50:22.463 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.454+0000 7f7dc43c0640 1 -- 172.21.15.42:0/2125856405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dbc11d9d0 con 0x7f7dbc12c7f0 2024-05-08T18:50:22.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.455+0000 7ffbb382e640 1 -- 172.21.15.42:0/1996579709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbac12f700 con 0x7ffbac0983f0 2024-05-08T18:50:22.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.455+0000 7ffba1ffb640 1 -- 172.21.15.42:0/1996579709 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ffba801a020 con 0x7ffbac0983f0 2024-05-08T18:50:22.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.455+0000 7f7db2ffd640 1 -- 172.21.15.42:0/2125856405 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f7dac01a070 con 0x7f7dbc12c7f0 2024-05-08T18:50:22.464 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.455+0000 7f7db2ffd640 1 --2- 172.21.15.42:0/2125856405 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7da003d290 0x7f7da003f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:22.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.455+0000 7ffba1ffb640 1 --2- 172.21.15.42:0/1996579709 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ffb9003d260 0x7ffb9003f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:22.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.455+0000 7f7db2ffd640 1 -- 172.21.15.42:0/2125856405 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f7dac054120 con 0x7f7dbc12c7f0 2024-05-08T18:50:22.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.455+0000 7ffba1ffb640 1 -- 172.21.15.42:0/1996579709 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7ffba8050b50 con 0x7ffbac0983f0 2024-05-08T18:50:22.465 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.456+0000 7f7dc195b640 1 --2- 172.21.15.42:0/2125856405 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7da003d290 0x7f7da003f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:22.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.456+0000 7ffbb0dc9640 1 --2- 172.21.15.42:0/1996579709 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ffb9003d260 0x7ffb9003f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:22.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.456+0000 7f7dc43c0640 1 -- 172.21.15.42:0/2125856405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dbc0a1a40 con 0x7f7dbc12c7f0 2024-05-08T18:50:22.466 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.456+0000 7f7dc195b640 1 --2- 172.21.15.42:0/2125856405 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7da003d290 0x7f7da003f750 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7db8036000 tx=0x7f7db8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:22.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.456+0000 7ffbb0dc9640 1 --2- 172.21.15.42:0/1996579709 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ffb9003d260 0x7ffb9003f720 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c036000 tx=0x7ffb9c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:22.467 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.464+0000 7ffba1ffb640 1 -- 172.21.15.42:0/1996579709 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ffba8004dc0 con 0x7ffbac0983f0 2024-05-08T18:50:22.472 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.473+0000 7f7db2ffd640 1 -- 172.21.15.42:0/2125856405 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7dbc0a1a40 con 0x7f7dbc12c7f0 2024-05-08T18:50:22.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.494+0000 7ff1a9c74640 1 Processor -- start 2024-05-08T18:50:22.493 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.494+0000 7ff1a9c74640 1 -- start start 2024-05-08T18:50:22.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.494+0000 7ff1a9c74640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff1a412cbd0 0x7ff1a4070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:22.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.494+0000 7ff1a9c74640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a412d020 con 0x7ff1a412c7f0 2024-05-08T18:50:22.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.494+0000 7ff1a9c74640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7ff1a4072fc0 con 0x7ff1a412cbd0 2024-05-08T18:50:22.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.495+0000 7ff1a2ffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff1a412cbd0 0x7ff1a4070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:22.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.495+0000 7ff1a37fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ff1a412c7f0 0x7ff1a4070850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:36096/0 (socket says 172.21.15.42:36096) 2024-05-08T18:50:22.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.495+0000 7ff1a37fe640 1 -- 172.21.15.42:0/4028015880 learned_addr learned my addr 172.21.15.42:0/4028015880 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:50:22.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.495+0000 7ff1a2ffd640 1 -- 172.21.15.42:0/4028015880 >> v1:172.21.15.42:6789/0 conn(0x7ff1a412c7f0 legacy=0x7ff1a4070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:22.494 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.495+0000 7ff1a2ffd640 1 -- 172.21.15.42:0/4028015880 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a40a23e0 con 0x7ff1a412cbd0 2024-05-08T18:50:22.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.496+0000 7ff1a2ffd640 1 --2- 172.21.15.42:0/4028015880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1a412cbd0 0x7ff1a4070f60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff198009720 tx=0x7ff19802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cc70ffa8eba29db server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:22.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.496+0000 7ff1a27fc640 1 -- 172.21.15.42:0/4028015880 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1980316d0 con 0x7ff1a412cbd0 2024-05-08T18:50:22.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.496+0000 7ff1a27fc640 1 -- 172.21.15.42:0/4028015880 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff198037070 con 0x7ff1a412cbd0 2024-05-08T18:50:22.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.496+0000 7ff1a27fc640 1 -- 172.21.15.42:0/4028015880 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1980319c0 con 0x7ff1a412cbd0 2024-05-08T18:50:22.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.497+0000 7ff1a9c74640 1 -- 172.21.15.42:0/4028015880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1a412cbd0 msgr2=0x7ff1a4070f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:22.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.497+0000 7ff1a9c74640 1 --2- 172.21.15.42:0/4028015880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1a412cbd0 0x7ff1a4070f60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff198009720 tx=0x7ff19802b840 comp rx=0 tx=0).stop 2024-05-08T18:50:22.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.497+0000 7ff1a9c74640 1 -- 172.21.15.42:0/4028015880 shutdown_connections 2024-05-08T18:50:22.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.497+0000 7ff1a9c74640 1 --2- 172.21.15.42:0/4028015880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1a412cbd0 0x7ff1a4070f60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:22.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.497+0000 7ff1a9c74640 1 -- 172.21.15.42:0/4028015880 >> 172.21.15.42:0/4028015880 conn(0x7ff1a409ff90 msgr2=0x7ff1a40a1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:22.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.497+0000 7ff1a9c74640 1 -- 172.21.15.42:0/4028015880 shutdown_connections 2024-05-08T18:50:22.496 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.497+0000 7ff1a9c74640 1 -- 172.21.15.42:0/4028015880 wait complete. 2024-05-08T18:50:22.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.498+0000 7ff1a9c74640 1 Processor -- start 2024-05-08T18:50:22.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.498+0000 7ff1a9c74640 1 -- start start 2024-05-08T18:50:22.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.498+0000 7ff1a9c74640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1a412c7f0 0x7ff1a411ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:22.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.498+0000 7ff1a9c74640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a4072870 con 0x7ff1a412c7f0 2024-05-08T18:50:22.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.498+0000 7ff1a37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1a412c7f0 0x7ff1a411ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:22.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.498+0000 7ff1a37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1a412c7f0 0x7ff1a411ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58198/0 (socket says 172.21.15.42:58198) 2024-05-08T18:50:22.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.498+0000 7ff1a37fe640 1 -- 172.21.15.42:0/1079006922 learned_addr learned my addr 172.21.15.42:0/1079006922 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:22.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.499+0000 7ff1a37fe640 1 -- 172.21.15.42:0/1079006922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a412b9d0 con 0x7ff1a412c7f0 2024-05-08T18:50:22.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.499+0000 7ff1a37fe640 1 --2- 172.21.15.42:0/1079006922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1a412c7f0 0x7ff1a411ace0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff19400c4a0 tx=0x7ff19400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:22.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.499+0000 7ff18bfff640 1 -- 172.21.15.42:0/1079006922 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff194017070 con 0x7ff1a412c7f0 2024-05-08T18:50:22.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.499+0000 7ff18bfff640 1 -- 172.21.15.42:0/1079006922 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff194005c10 con 0x7ff1a412c7f0 2024-05-08T18:50:22.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.499+0000 7ff18bfff640 1 -- 172.21.15.42:0/1079006922 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff194007070 con 0x7ff1a412c7f0 2024-05-08T18:50:22.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.499+0000 7ff1a9c74640 1 -- 172.21.15.42:0/1079006922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a411e060 con 0x7ff1a412c7f0 2024-05-08T18:50:22.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.499+0000 7ff1a9c74640 1 -- 172.21.15.42:0/1079006922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a411d9d0 con 0x7ff1a412c7f0 2024-05-08T18:50:22.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.500+0000 7ff1a9c74640 1 -- 172.21.15.42:0/1079006922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a40a1a40 con 0x7ff1a412c7f0 2024-05-08T18:50:22.499 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.500+0000 7ff18bfff640 1 -- 172.21.15.42:0/1079006922 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff19401a070 con 0x7ff1a412c7f0 2024-05-08T18:50:22.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.501+0000 7ff18bfff640 1 --2- 172.21.15.42:0/1079006922 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff19003d2e0 0x7ff19003f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:22.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.501+0000 7ff18bfff640 1 -- 172.21.15.42:0/1079006922 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7ff1940505e0 con 0x7ff1a412c7f0 2024-05-08T18:50:22.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.501+0000 7ff1a2ffd640 1 --2- 172.21.15.42:0/1079006922 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff19003d2e0 0x7ff19003f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:22.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.502+0000 7ff1a2ffd640 1 --2- 172.21.15.42:0/1079006922 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff19003d2e0 0x7ff19003f7a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff198036000 tx=0x7ff198008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:22.509 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.510+0000 7ff18bfff640 1 -- 172.21.15.42:0/1079006922 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7ff1a40a1a40 con 0x7ff1a412c7f0 2024-05-08T18:50:22.621 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.623+0000 7f5e78f5c640 1 -- 172.21.15.42:0/2499729866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5e7411c7c0 con 0x7f5e7412c7f0 2024-05-08T18:50:22.622 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.623+0000 7f5e62ffd640 1 -- 172.21.15.42:0/2499729866 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5e64011c80 con 0x7f5e7412c7f0 2024-05-08T18:50:22.623 INFO:teuthology.orchestra.run.smithi042.stdout:38654705667 2024-05-08T18:50:22.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.625+0000 7f5e78f5c640 1 -- 172.21.15.42:0/2499729866 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5e5403d2e0 msgr2=0x7f5e5403f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:22.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.625+0000 7f5e78f5c640 1 --2- 172.21.15.42:0/2499729866 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5e5403d2e0 0x7f5e5403f7a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5e68036000 tx=0x7f5e68008030 comp rx=0 tx=0).stop 2024-05-08T18:50:22.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.625+0000 7f5e78f5c640 1 -- 172.21.15.42:0/2499729866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7412c7f0 msgr2=0x7f5e7411ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:22.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.625+0000 7f5e78f5c640 1 --2- 172.21.15.42:0/2499729866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7412c7f0 0x7f5e7411ace0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400c4a0 tx=0x7f5e6400c960 comp rx=0 tx=0).stop 2024-05-08T18:50:22.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.625+0000 7f5e78f5c640 1 -- 172.21.15.42:0/2499729866 shutdown_connections 2024-05-08T18:50:22.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.625+0000 7f5e78f5c640 1 --2- 172.21.15.42:0/2499729866 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5e5403d2e0 0x7f5e5403f7a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:22.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.625+0000 7f5e78f5c640 1 --2- 172.21.15.42:0/2499729866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e7412c7f0 0x7f5e7411ace0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:22.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.625+0000 7f5e78f5c640 1 -- 172.21.15.42:0/2499729866 >> 172.21.15.42:0/2499729866 conn(0x7f5e7409ff90 msgr2=0x7f5e7406e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:22.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.625+0000 7f5e78f5c640 1 -- 172.21.15.42:0/2499729866 shutdown_connections 2024-05-08T18:50:22.625 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.625+0000 7f5e78f5c640 1 -- 172.21.15.42:0/2499729866 wait complete. 2024-05-08T18:50:22.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.0 2024-05-08T18:50:22.636 DEBUG:teuthology.parallel:result is None 2024-05-08T18:50:22.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.663+0000 7ffbb382e640 1 -- 172.21.15.42:0/1996579709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ffbac064010 con 0x7ffbac0983f0 2024-05-08T18:50:22.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.663+0000 7ffba1ffb640 1 -- 172.21.15.42:0/1996579709 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffba8004dc0 con 0x7ffbac0983f0 2024-05-08T18:50:22.662 INFO:teuthology.orchestra.run.smithi042.stdout:38654705667 2024-05-08T18:50:22.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.665+0000 7ffbb382e640 1 -- 172.21.15.42:0/1996579709 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ffb9003d260 msgr2=0x7ffb9003f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:22.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.665+0000 7ffbb382e640 1 --2- 172.21.15.42:0/1996579709 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ffb9003d260 0x7ffb9003f720 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c036000 tx=0x7ffb9c008030 comp rx=0 tx=0).stop 2024-05-08T18:50:22.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.665+0000 7ffbb382e640 1 -- 172.21.15.42:0/1996579709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbac0983f0 msgr2=0x7ffbac12ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:22.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.665+0000 7ffbb382e640 1 --2- 172.21.15.42:0/1996579709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbac0983f0 0x7ffbac12ddb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffba800c380 tx=0x7ffba800c840 comp rx=0 tx=0).stop 2024-05-08T18:50:22.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.665+0000 7ffbb382e640 1 -- 172.21.15.42:0/1996579709 shutdown_connections 2024-05-08T18:50:22.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.665+0000 7ffbb382e640 1 --2- 172.21.15.42:0/1996579709 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ffb9003d260 0x7ffb9003f720 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:22.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.665+0000 7ffbb382e640 1 --2- 172.21.15.42:0/1996579709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffbac0983f0 0x7ffbac12ddb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:22.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.665+0000 7ffbb382e640 1 -- 172.21.15.42:0/1996579709 >> 172.21.15.42:0/1996579709 conn(0x7ffbac09ed90 msgr2=0x7ffbac126850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:22.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.665+0000 7ffbb382e640 1 -- 172.21.15.42:0/1996579709 shutdown_connections 2024-05-08T18:50:22.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.665+0000 7ffbb382e640 1 -- 172.21.15.42:0/1996579709 wait complete. 2024-05-08T18:50:22.669 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.670+0000 7f7dc43c0640 1 -- 172.21.15.42:0/2125856405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7dbc11c7c0 con 0x7f7dbc12c7f0 2024-05-08T18:50:22.670 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.671+0000 7f7db2ffd640 1 -- 172.21.15.42:0/2125856405 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7dac01be20 con 0x7f7dbc12c7f0 2024-05-08T18:50:22.670 INFO:teuthology.orchestra.run.smithi042.stdout:38654705667 2024-05-08T18:50:22.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.673+0000 7f7dc43c0640 1 -- 172.21.15.42:0/2125856405 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7da003d290 msgr2=0x7f7da003f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:22.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.673+0000 7f7dc43c0640 1 --2- 172.21.15.42:0/2125856405 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7da003d290 0x7f7da003f750 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7db8036000 tx=0x7f7db8008030 comp rx=0 tx=0).stop 2024-05-08T18:50:22.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.673+0000 7f7dc43c0640 1 -- 172.21.15.42:0/2125856405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7dbc12c7f0 msgr2=0x7f7dbc11ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:22.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.673+0000 7f7dc43c0640 1 --2- 172.21.15.42:0/2125856405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7dbc12c7f0 0x7f7dbc11ace0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7dac00c450 tx=0x7f7dac00c910 comp rx=0 tx=0).stop 2024-05-08T18:50:22.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.673+0000 7f7dc43c0640 1 -- 172.21.15.42:0/2125856405 shutdown_connections 2024-05-08T18:50:22.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.673+0000 7f7dc43c0640 1 --2- 172.21.15.42:0/2125856405 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7da003d290 0x7f7da003f750 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:22.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.673+0000 7f7dc43c0640 1 --2- 172.21.15.42:0/2125856405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7dbc12c7f0 0x7f7dbc11ace0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:22.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.673+0000 7f7dc43c0640 1 -- 172.21.15.42:0/2125856405 >> 172.21.15.42:0/2125856405 conn(0x7f7dbc09ff90 msgr2=0x7f7dbc06e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:22.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.673+0000 7f7dc43c0640 1 -- 172.21.15.42:0/2125856405 shutdown_connections 2024-05-08T18:50:22.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.673+0000 7f7dc43c0640 1 -- 172.21.15.42:0/2125856405 wait complete. 2024-05-08T18:50:22.676 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.1 2024-05-08T18:50:22.676 DEBUG:teuthology.parallel:result is None 2024-05-08T18:50:22.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.3 2024-05-08T18:50:22.683 DEBUG:teuthology.parallel:result is None 2024-05-08T18:50:22.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.706+0000 7ff1a9c74640 1 -- 172.21.15.42:0/1079006922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff1a411c7c0 con 0x7ff1a412c7f0 2024-05-08T18:50:22.706 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.707+0000 7ff18bfff640 1 -- 172.21.15.42:0/1079006922 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff19401ac60 con 0x7ff1a412c7f0 2024-05-08T18:50:22.706 INFO:teuthology.orchestra.run.smithi042.stdout:38654705668 2024-05-08T18:50:22.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.709+0000 7ff1a9c74640 1 -- 172.21.15.42:0/1079006922 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff19003d2e0 msgr2=0x7ff19003f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:22.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.709+0000 7ff1a9c74640 1 --2- 172.21.15.42:0/1079006922 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff19003d2e0 0x7ff19003f7a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff198036000 tx=0x7ff198008030 comp rx=0 tx=0).stop 2024-05-08T18:50:22.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.709+0000 7ff1a9c74640 1 -- 172.21.15.42:0/1079006922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1a412c7f0 msgr2=0x7ff1a411ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:22.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.709+0000 7ff1a9c74640 1 --2- 172.21.15.42:0/1079006922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1a412c7f0 0x7ff1a411ace0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff19400c4a0 tx=0x7ff19400c960 comp rx=0 tx=0).stop 2024-05-08T18:50:22.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.709+0000 7ff1a9c74640 1 -- 172.21.15.42:0/1079006922 shutdown_connections 2024-05-08T18:50:22.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.709+0000 7ff1a9c74640 1 --2- 172.21.15.42:0/1079006922 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff19003d2e0 0x7ff19003f7a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:22.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.709+0000 7ff1a9c74640 1 --2- 172.21.15.42:0/1079006922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1a412c7f0 0x7ff1a411ace0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:22.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.709+0000 7ff1a9c74640 1 -- 172.21.15.42:0/1079006922 >> 172.21.15.42:0/1079006922 conn(0x7ff1a409ff90 msgr2=0x7ff1a406e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:22.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.709+0000 7ff1a9c74640 1 -- 172.21.15.42:0/1079006922 shutdown_connections 2024-05-08T18:50:22.709 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.709+0000 7ff1a9c74640 1 -- 172.21.15.42:0/1079006922 wait complete. 2024-05-08T18:50:22.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.2 2024-05-08T18:50:22.719 DEBUG:teuthology.parallel:result is None 2024-05-08T18:50:22.719 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T18:50:22.719 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:50:22.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.864+0000 7fadffea4640 1 Processor -- start 2024-05-08T18:50:22.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.864+0000 7fadffea4640 1 -- start start 2024-05-08T18:50:22.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.864+0000 7fadffea4640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fadf80969c0 0x7fadf8134ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:22.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.864+0000 7fadffea4640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadf8097a60 con 0x7fadf806c370 2024-05-08T18:50:22.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.864+0000 7fadffea4640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fadf8097e90 con 0x7fadf80969c0 2024-05-08T18:50:22.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.864+0000 7fadfd43f640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fadf80969c0 0x7fadf8134ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:22.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.864+0000 7fadfdc40640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fadf806c370 0x7fadf80962b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:36110/0 (socket says 172.21.15.42:36110) 2024-05-08T18:50:22.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.864+0000 7fadfdc40640 1 -- 172.21.15.42:0/801358199 learned_addr learned my addr 172.21.15.42:0/801358199 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:50:22.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.865+0000 7fadfd43f640 1 -- 172.21.15.42:0/801358199 >> v1:172.21.15.42:6789/0 conn(0x7fadf806c370 legacy=0x7fadf80962b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:22.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.865+0000 7fadfcc3e640 1 -- 172.21.15.42:0/801358199 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 223565987 0 0) 0x7fadf8097a60 con 0x7fadf806c370 2024-05-08T18:50:22.864 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.865+0000 7fadfd43f640 1 -- 172.21.15.42:0/801358199 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf8097750 con 0x7fadf80969c0 2024-05-08T18:50:22.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.865+0000 7fadfd43f640 1 --2- 172.21.15.42:0/801358199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf80969c0 0x7fadf8134ef0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fadec009720 tx=0x7fadec02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a930c926df0f6c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:22.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.865+0000 7fadfcc3e640 1 -- 172.21.15.42:0/801358199 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadec0316d0 con 0x7fadf80969c0 2024-05-08T18:50:22.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.866+0000 7fadfcc3e640 1 -- 172.21.15.42:0/801358199 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadec037070 con 0x7fadf80969c0 2024-05-08T18:50:22.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.866+0000 7fadfcc3e640 1 -- 172.21.15.42:0/801358199 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadec0319c0 con 0x7fadf80969c0 2024-05-08T18:50:22.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.866+0000 7fadffea4640 1 -- 172.21.15.42:0/801358199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf80969c0 msgr2=0x7fadf8134ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:22.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.866+0000 7fadffea4640 1 --2- 172.21.15.42:0/801358199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf80969c0 0x7fadf8134ef0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fadec009720 tx=0x7fadec02b840 comp rx=0 tx=0).stop 2024-05-08T18:50:22.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.866+0000 7fadffea4640 1 -- 172.21.15.42:0/801358199 shutdown_connections 2024-05-08T18:50:22.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.866+0000 7fadffea4640 1 --2- 172.21.15.42:0/801358199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf80969c0 0x7fadf8134ef0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:22.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.866+0000 7fadffea4640 1 -- 172.21.15.42:0/801358199 >> 172.21.15.42:0/801358199 conn(0x7fadf809e360 msgr2=0x7fadf809a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:22.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.866+0000 7fadffea4640 1 -- 172.21.15.42:0/801358199 shutdown_connections 2024-05-08T18:50:22.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.866+0000 7fadffea4640 1 -- 172.21.15.42:0/801358199 wait complete. 2024-05-08T18:50:22.866 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.867+0000 7fadffea4640 1 Processor -- start 2024-05-08T18:50:22.867 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.867+0000 7fadffea4640 1 -- start start 2024-05-08T18:50:22.868 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.867+0000 7fadffea4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf806c370 0x7fadf81339e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.867+0000 7fadffea4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fadf8097330 con 0x7fadf806c370 2024-05-08T18:50:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.867+0000 7fadfdc40640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf806c370 0x7fadf81339e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.868+0000 7fadfdc40640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf806c370 0x7fadf81339e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58214/0 (socket says 172.21.15.42:58214) 2024-05-08T18:50:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.868+0000 7fadfdc40640 1 -- 172.21.15.42:0/3517182884 learned_addr learned my addr 172.21.15.42:0/3517182884 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.868+0000 7fadfdc40640 1 -- 172.21.15.42:0/3517182884 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf8125b60 con 0x7fadf806c370 2024-05-08T18:50:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.868+0000 7fadfdc40640 1 --2- 172.21.15.42:0/3517182884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf806c370 0x7fadf81339e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fade800c6d0 tx=0x7fade800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.868+0000 7fadf67fc640 1 -- 172.21.15.42:0/3517182884 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade8005c50 con 0x7fadf806c370 2024-05-08T18:50:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.868+0000 7fadf67fc640 1 -- 172.21.15.42:0/3517182884 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade8005e10 con 0x7fadf806c370 2024-05-08T18:50:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.868+0000 7fadffea4640 1 -- 172.21.15.42:0/3517182884 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf81256c0 con 0x7fadf806c370 2024-05-08T18:50:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.868+0000 7fadf67fc640 1 -- 172.21.15.42:0/3517182884 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade800a7d0 con 0x7fadf806c370 2024-05-08T18:50:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.868+0000 7fadffea4640 1 -- 172.21.15.42:0/3517182884 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf8133f20 con 0x7fadf806c370 2024-05-08T18:50:22.869 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.869+0000 7fadffea4640 1 -- 172.21.15.42:0/3517182884 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadf8127280 con 0x7fadf806c370 2024-05-08T18:50:22.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.869+0000 7fadf67fc640 1 -- 172.21.15.42:0/3517182884 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fade800a970 con 0x7fadf806c370 2024-05-08T18:50:22.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.869+0000 7fadf67fc640 1 --2- 172.21.15.42:0/3517182884 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fade403d2b0 0x7fade403f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:22.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.869+0000 7fadf67fc640 1 -- 172.21.15.42:0/3517182884 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7fade8051180 con 0x7fadf806c370 2024-05-08T18:50:22.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.870+0000 7fadfd43f640 1 --2- 172.21.15.42:0/3517182884 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fade403d2b0 0x7fade403f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:22.870 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.870+0000 7fadfd43f640 1 --2- 172.21.15.42:0/3517182884 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fade403d2b0 0x7fade403f770 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fadec036000 tx=0x7fadec008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:22.872 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:22.874+0000 7fadf67fc640 1 -- 172.21.15.42:0/3517182884 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fade8019300 con 0x7fadf806c370 2024-05-08T18:50:23.063 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.064+0000 7fadffea4640 1 -- 172.21.15.42:0/3517182884 --> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fadf8064010 con 0x7fade403d2b0 2024-05-08T18:50:23.064 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.065+0000 7fadf67fc640 1 -- 172.21.15.42:0/3517182884 <== mgr.4102 v2:172.21.15.132:6824/2104266563 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31844 (secure 0 0 0) 0x7fadf8064010 con 0x7fade403d2b0 2024-05-08T18:50:23.065 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:50:23.065 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-08T18:50:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.067+0000 7fadffea4640 1 -- 172.21.15.42:0/3517182884 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fade403d2b0 msgr2=0x7fade403f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.067+0000 7fadffea4640 1 --2- 172.21.15.42:0/3517182884 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fade403d2b0 0x7fade403f770 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fadec036000 tx=0x7fadec008030 comp rx=0 tx=0).stop 2024-05-08T18:50:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.067+0000 7fadffea4640 1 -- 172.21.15.42:0/3517182884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf806c370 msgr2=0x7fadf81339e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.067+0000 7fadffea4640 1 --2- 172.21.15.42:0/3517182884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf806c370 0x7fadf81339e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fade800c6d0 tx=0x7fade800cb90 comp rx=0 tx=0).stop 2024-05-08T18:50:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.068+0000 7fadffea4640 1 -- 172.21.15.42:0/3517182884 shutdown_connections 2024-05-08T18:50:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.068+0000 7fadffea4640 1 --2- 172.21.15.42:0/3517182884 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fade403d2b0 0x7fade403f770 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.068+0000 7fadffea4640 1 --2- 172.21.15.42:0/3517182884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf806c370 0x7fadf81339e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.068+0000 7fadffea4640 1 -- 172.21.15.42:0/3517182884 >> 172.21.15.42:0/3517182884 conn(0x7fadf809e360 msgr2=0x7fadf80927b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.068+0000 7fadffea4640 1 -- 172.21.15.42:0/3517182884 shutdown_connections 2024-05-08T18:50:23.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.068+0000 7fadffea4640 1 -- 172.21.15.42:0/3517182884 wait complete. 2024-05-08T18:50:23.077 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-05-08T18:50:21.927206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118320,"kb_used_data":1552,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377369040,"statfs":{"total":386547056640,"available":386425896960,"internally_reserved":0,"allocated":1589248,"data_stored":1291770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T18:50:20.734576+0000","last_change":"2024-05-08T18:50:19.739345+0000","last_active":"2024-05-08T18:50:20.734576+0000","last_peered":"2024-05-08T18:50:20.734576+0000","last_clean":"2024-05-08T18:50:20.734576+0000","last_became_active":"2024-05-08T18:50:19.738971+0000","last_became_peered":"2024-05-08T18:50:19.738971+0000","last_unstale":"2024-05-08T18:50:20.734576+0000","last_undegraded":"2024-05-08T18:50:20.734576+0000","last_fullsized":"2024-05-08T18:50:20.734576+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:52:49.278410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T18:50:19.741577+0000","last_change":"2024-05-08T18:50:19.740832+0000","last_active":"2024-05-08T18:50:19.741577+0000","last_peered":"2024-05-08T18:50:19.741577+0000","last_clean":"2024-05-08T18:50:19.741577+0000","last_became_active":"2024-05-08T18:50:19.740355+0000","last_became_peered":"2024-05-08T18:50:19.740355+0000","last_unstale":"2024-05-08T18:50:19.741577+0000","last_undegraded":"2024-05-08T18:50:19.741577+0000","last_fullsized":"2024-05-08T18:50:19.741577+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:25.138337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T18:50:20.734544+0000","last_change":"2024-05-08T18:50:19.739473+0000","last_active":"2024-05-08T18:50:20.734544+0000","last_peered":"2024-05-08T18:50:20.734544+0000","last_clean":"2024-05-08T18:50:20.734544+0000","last_became_active":"2024-05-08T18:50:19.739124+0000","last_became_peered":"2024-05-08T18:50:19.739124+0000","last_unstale":"2024-05-08T18:50:20.734544+0000","last_undegraded":"2024-05-08T18:50:20.734544+0000","last_fullsized":"2024-05-08T18:50:20.734544+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:22.202213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T18:50:19.741842+0000","last_change":"2024-05-08T18:50:19.741144+0000","last_active":"2024-05-08T18:50:19.741842+0000","last_peered":"2024-05-08T18:50:19.741842+0000","last_clean":"2024-05-08T18:50:19.741842+0000","last_became_active":"2024-05-08T18:50:19.740835+0000","last_became_peered":"2024-05-08T18:50:19.740835+0000","last_unstale":"2024-05-08T18:50:19.741842+0000","last_undegraded":"2024-05-08T18:50:19.741842+0000","last_fullsized":"2024-05-08T18:50:19.741842+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:29.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T18:50:20.734564+0000","last_change":"2024-05-08T18:50:19.739898+0000","last_active":"2024-05-08T18:50:20.734564+0000","last_peered":"2024-05-08T18:50:20.734564+0000","last_clean":"2024-05-08T18:50:20.734564+0000","last_became_active":"2024-05-08T18:50:19.739620+0000","last_became_peered":"2024-05-08T18:50:19.739620+0000","last_unstale":"2024-05-08T18:50:20.734564+0000","last_undegraded":"2024-05-08T18:50:20.734564+0000","last_fullsized":"2024-05-08T18:50:20.734564+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:58.286521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T18:50:19.740593+0000","last_change":"2024-05-08T18:50:19.739149+0000","last_active":"2024-05-08T18:50:19.740593+0000","last_peered":"2024-05-08T18:50:19.740593+0000","last_clean":"2024-05-08T18:50:19.740593+0000","last_became_active":"2024-05-08T18:50:19.738788+0000","last_became_peered":"2024-05-08T18:50:19.738788+0000","last_unstale":"2024-05-08T18:50:19.740593+0000","last_undegraded":"2024-05-08T18:50:19.740593+0000","last_fullsized":"2024-05-08T18:50:19.740593+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:25.138337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T18:50:20.734541+0000","last_change":"2024-05-08T18:50:19.739194+0000","last_active":"2024-05-08T18:50:20.734541+0000","last_peered":"2024-05-08T18:50:20.734541+0000","last_clean":"2024-05-08T18:50:20.734541+0000","last_became_active":"2024-05-08T18:50:19.738872+0000","last_became_peered":"2024-05-08T18:50:19.738872+0000","last_unstale":"2024-05-08T18:50:20.734541+0000","last_undegraded":"2024-05-08T18:50:20.734541+0000","last_fullsized":"2024-05-08T18:50:20.734541+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:28:20.859312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T18:50:20.734559+0000","last_change":"2024-05-08T18:50:19.740266+0000","last_active":"2024-05-08T18:50:20.734559+0000","last_peered":"2024-05-08T18:50:20.734559+0000","last_clean":"2024-05-08T18:50:20.734559+0000","last_became_active":"2024-05-08T18:50:19.739403+0000","last_became_peered":"2024-05-08T18:50:19.739403+0000","last_unstale":"2024-05-08T18:50:20.734559+0000","last_undegraded":"2024-05-08T18:50:20.734559+0000","last_fullsized":"2024-05-08T18:50:20.734559+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:59:48.671095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":99,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T18:50:20.127784+0000","last_change":"2024-05-08T18:50:19.740594+0000","last_active":"2024-05-08T18:50:20.127784+0000","last_peered":"2024-05-08T18:50:20.127784+0000","last_clean":"2024-05-08T18:50:20.127784+0000","last_became_active":"2024-05-08T18:50:19.739986+0000","last_became_peered":"2024-05-08T18:50:19.739986+0000","last_unstale":"2024-05-08T18:50:20.127784+0000","last_undegraded":"2024-05-08T18:50:20.127784+0000","last_fullsized":"2024-05-08T18:50:20.127784+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:29.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":106496,"data_stored":31051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":692224,"data_stored":617029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":692224,"data_stored":617029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35436,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336404,"statfs":{"total":96636764160,"available":96600477696,"internally_reserved":0,"allocated":98304,"data_stored":26661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:50:23.078 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:50:23.180 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.181+0000 7fa0c0476640 1 Processor -- start 2024-05-08T18:50:23.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.181+0000 7fa0c0476640 1 -- start start 2024-05-08T18:50:23.181 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.182+0000 7fa0c0476640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa0b812cbd0 0x7fa0b8070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:23.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.182+0000 7fa0c0476640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0b812d020 con 0x7fa0b812c7f0 2024-05-08T18:50:23.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.182+0000 7fa0c0476640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fa0b8072fc0 con 0x7fa0b812cbd0 2024-05-08T18:50:23.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.182+0000 7fa0bda11640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa0b812cbd0 0x7fa0b8070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:23.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.182+0000 7fa0be212640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fa0b812c7f0 0x7fa0b8070850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:36120/0 (socket says 172.21.15.42:36120) 2024-05-08T18:50:23.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.182+0000 7fa0be212640 1 -- 172.21.15.42:0/318733855 learned_addr learned my addr 172.21.15.42:0/318733855 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:50:23.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.182+0000 7fa0bda11640 1 -- 172.21.15.42:0/318733855 >> v1:172.21.15.42:6789/0 conn(0x7fa0b812c7f0 legacy=0x7fa0b8070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:23.182 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.182+0000 7fa0bda11640 1 -- 172.21.15.42:0/318733855 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b80a23e0 con 0x7fa0b812cbd0 2024-05-08T18:50:23.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.183+0000 7fa0bda11640 1 --2- 172.21.15.42:0/318733855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0b812cbd0 0x7fa0b8070f60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8009720 tx=0x7fa0a802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8677a90c1dd9ae server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.183+0000 7fa0bd210640 1 -- 172.21.15.42:0/318733855 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0a80316d0 con 0x7fa0b812cbd0 2024-05-08T18:50:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.183+0000 7fa0bd210640 1 -- 172.21.15.42:0/318733855 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0a8037070 con 0x7fa0b812cbd0 2024-05-08T18:50:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.183+0000 7fa0bd210640 1 -- 172.21.15.42:0/318733855 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0a80319c0 con 0x7fa0b812cbd0 2024-05-08T18:50:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.184+0000 7fa0c0476640 1 -- 172.21.15.42:0/318733855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0b812cbd0 msgr2=0x7fa0b8070f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.184+0000 7fa0c0476640 1 --2- 172.21.15.42:0/318733855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0b812cbd0 0x7fa0b8070f60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8009720 tx=0x7fa0a802b840 comp rx=0 tx=0).stop 2024-05-08T18:50:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.184+0000 7fa0c0476640 1 -- 172.21.15.42:0/318733855 shutdown_connections 2024-05-08T18:50:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.184+0000 7fa0c0476640 1 --2- 172.21.15.42:0/318733855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0b812cbd0 0x7fa0b8070f60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.184+0000 7fa0c0476640 1 -- 172.21.15.42:0/318733855 >> 172.21.15.42:0/318733855 conn(0x7fa0b809ff90 msgr2=0x7fa0b80a1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.184+0000 7fa0c0476640 1 -- 172.21.15.42:0/318733855 shutdown_connections 2024-05-08T18:50:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.184+0000 7fa0c0476640 1 -- 172.21.15.42:0/318733855 wait complete. 2024-05-08T18:50:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.185+0000 7fa0c0476640 1 Processor -- start 2024-05-08T18:50:23.184 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.185+0000 7fa0c0476640 1 -- start start 2024-05-08T18:50:23.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.185+0000 7fa0c0476640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0b812c7f0 0x7fa0b81c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:23.186 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.185+0000 7fa0c0476640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b8072870 con 0x7fa0b812c7f0 2024-05-08T18:50:23.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.185+0000 7fa0be212640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0b812c7f0 0x7fa0b81c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:23.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.185+0000 7fa0be212640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0b812c7f0 0x7fa0b81c45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58240/0 (socket says 172.21.15.42:58240) 2024-05-08T18:50:23.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.185+0000 7fa0be212640 1 -- 172.21.15.42:0/1482900518 learned_addr learned my addr 172.21.15.42:0/1482900518 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:23.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.186+0000 7fa0be212640 1 -- 172.21.15.42:0/1482900518 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b811d760 con 0x7fa0b812c7f0 2024-05-08T18:50:23.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.186+0000 7fa0be212640 1 --2- 172.21.15.42:0/1482900518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0b812c7f0 0x7fa0b81c45e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400c380 tx=0x7fa0b400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:23.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.186+0000 7fa0aeffd640 1 -- 172.21.15.42:0/1482900518 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0b4005c10 con 0x7fa0b812c7f0 2024-05-08T18:50:23.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.186+0000 7fa0aeffd640 1 -- 172.21.15.42:0/1482900518 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b4005db0 con 0x7fa0b812c7f0 2024-05-08T18:50:23.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.186+0000 7fa0aeffd640 1 -- 172.21.15.42:0/1482900518 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0b4004930 con 0x7fa0b812c7f0 2024-05-08T18:50:23.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.186+0000 7fa0c0476640 1 -- 172.21.15.42:0/1482900518 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b811d9f0 con 0x7fa0b812c7f0 2024-05-08T18:50:23.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.186+0000 7fa0c0476640 1 -- 172.21.15.42:0/1482900518 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b81c4d00 con 0x7fa0b812c7f0 2024-05-08T18:50:23.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.187+0000 7fa0aeffd640 1 -- 172.21.15.42:0/1482900518 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa0b401a020 con 0x7fa0b812c7f0 2024-05-08T18:50:23.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.187+0000 7fa0c0476640 1 -- 172.21.15.42:0/1482900518 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b8064010 con 0x7fa0b812c7f0 2024-05-08T18:50:23.187 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.187+0000 7fa0aeffd640 1 --2- 172.21.15.42:0/1482900518 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa09c03d290 0x7fa09c03f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:23.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.187+0000 7fa0aeffd640 1 -- 172.21.15.42:0/1482900518 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7fa0b4050b50 con 0x7fa0b812c7f0 2024-05-08T18:50:23.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.187+0000 7fa0bda11640 1 --2- 172.21.15.42:0/1482900518 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa09c03d290 0x7fa09c03f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:23.188 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.188+0000 7fa0bda11640 1 --2- 172.21.15.42:0/1482900518 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa09c03d290 0x7fa09c03f750 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8036000 tx=0x7fa0a8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:23.190 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.192+0000 7fa0aeffd640 1 -- 172.21.15.42:0/1482900518 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fa0b4004dc0 con 0x7fa0b812c7f0 2024-05-08T18:50:23.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.379+0000 7fa0c0476640 1 -- 172.21.15.42:0/1482900518 --> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa0b80a2930 con 0x7fa09c03d290 2024-05-08T18:50:23.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.381+0000 7fa0aeffd640 1 -- 172.21.15.42:0/1482900518 <== mgr.4102 v2:172.21.15.132:6824/2104266563 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31844 (secure 0 0 0) 0x7fa0b80a2930 con 0x7fa09c03d290 2024-05-08T18:50:23.380 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:50:23.380 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-08T18:50:23.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.383+0000 7fa0c0476640 1 -- 172.21.15.42:0/1482900518 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa09c03d290 msgr2=0x7fa09c03f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:23.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.383+0000 7fa0c0476640 1 --2- 172.21.15.42:0/1482900518 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa09c03d290 0x7fa09c03f750 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8036000 tx=0x7fa0a8008030 comp rx=0 tx=0).stop 2024-05-08T18:50:23.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.383+0000 7fa0c0476640 1 -- 172.21.15.42:0/1482900518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0b812c7f0 msgr2=0x7fa0b81c45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:23.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.383+0000 7fa0c0476640 1 --2- 172.21.15.42:0/1482900518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0b812c7f0 0x7fa0b81c45e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa0b400c380 tx=0x7fa0b400c840 comp rx=0 tx=0).stop 2024-05-08T18:50:23.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.383+0000 7fa0c0476640 1 -- 172.21.15.42:0/1482900518 shutdown_connections 2024-05-08T18:50:23.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.383+0000 7fa0c0476640 1 --2- 172.21.15.42:0/1482900518 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa09c03d290 0x7fa09c03f750 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:23.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.383+0000 7fa0c0476640 1 --2- 172.21.15.42:0/1482900518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa0b812c7f0 0x7fa0b81c45e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:23.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.383+0000 7fa0c0476640 1 -- 172.21.15.42:0/1482900518 >> 172.21.15.42:0/1482900518 conn(0x7fa0b809ff90 msgr2=0x7fa0b806e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:23.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.383+0000 7fa0c0476640 1 -- 172.21.15.42:0/1482900518 shutdown_connections 2024-05-08T18:50:23.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.383+0000 7fa0c0476640 1 -- 172.21.15.42:0/1482900518 wait complete. 2024-05-08T18:50:23.393 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-05-08T18:50:21.927206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118320,"kb_used_data":1552,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377369040,"statfs":{"total":386547056640,"available":386425896960,"internally_reserved":0,"allocated":1589248,"data_stored":1291770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T18:50:20.734576+0000","last_change":"2024-05-08T18:50:19.739345+0000","last_active":"2024-05-08T18:50:20.734576+0000","last_peered":"2024-05-08T18:50:20.734576+0000","last_clean":"2024-05-08T18:50:20.734576+0000","last_became_active":"2024-05-08T18:50:19.738971+0000","last_became_peered":"2024-05-08T18:50:19.738971+0000","last_unstale":"2024-05-08T18:50:20.734576+0000","last_undegraded":"2024-05-08T18:50:20.734576+0000","last_fullsized":"2024-05-08T18:50:20.734576+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:52:49.278410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T18:50:19.741577+0000","last_change":"2024-05-08T18:50:19.740832+0000","last_active":"2024-05-08T18:50:19.741577+0000","last_peered":"2024-05-08T18:50:19.741577+0000","last_clean":"2024-05-08T18:50:19.741577+0000","last_became_active":"2024-05-08T18:50:19.740355+0000","last_became_peered":"2024-05-08T18:50:19.740355+0000","last_unstale":"2024-05-08T18:50:19.741577+0000","last_undegraded":"2024-05-08T18:50:19.741577+0000","last_fullsized":"2024-05-08T18:50:19.741577+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:25.138337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T18:50:20.734544+0000","last_change":"2024-05-08T18:50:19.739473+0000","last_active":"2024-05-08T18:50:20.734544+0000","last_peered":"2024-05-08T18:50:20.734544+0000","last_clean":"2024-05-08T18:50:20.734544+0000","last_became_active":"2024-05-08T18:50:19.739124+0000","last_became_peered":"2024-05-08T18:50:19.739124+0000","last_unstale":"2024-05-08T18:50:20.734544+0000","last_undegraded":"2024-05-08T18:50:20.734544+0000","last_fullsized":"2024-05-08T18:50:20.734544+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:22.202213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T18:50:19.741842+0000","last_change":"2024-05-08T18:50:19.741144+0000","last_active":"2024-05-08T18:50:19.741842+0000","last_peered":"2024-05-08T18:50:19.741842+0000","last_clean":"2024-05-08T18:50:19.741842+0000","last_became_active":"2024-05-08T18:50:19.740835+0000","last_became_peered":"2024-05-08T18:50:19.740835+0000","last_unstale":"2024-05-08T18:50:19.741842+0000","last_undegraded":"2024-05-08T18:50:19.741842+0000","last_fullsized":"2024-05-08T18:50:19.741842+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:29.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T18:50:20.734564+0000","last_change":"2024-05-08T18:50:19.739898+0000","last_active":"2024-05-08T18:50:20.734564+0000","last_peered":"2024-05-08T18:50:20.734564+0000","last_clean":"2024-05-08T18:50:20.734564+0000","last_became_active":"2024-05-08T18:50:19.739620+0000","last_became_peered":"2024-05-08T18:50:19.739620+0000","last_unstale":"2024-05-08T18:50:20.734564+0000","last_undegraded":"2024-05-08T18:50:20.734564+0000","last_fullsized":"2024-05-08T18:50:20.734564+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:58.286521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T18:50:19.740593+0000","last_change":"2024-05-08T18:50:19.739149+0000","last_active":"2024-05-08T18:50:19.740593+0000","last_peered":"2024-05-08T18:50:19.740593+0000","last_clean":"2024-05-08T18:50:19.740593+0000","last_became_active":"2024-05-08T18:50:19.738788+0000","last_became_peered":"2024-05-08T18:50:19.738788+0000","last_unstale":"2024-05-08T18:50:19.740593+0000","last_undegraded":"2024-05-08T18:50:19.740593+0000","last_fullsized":"2024-05-08T18:50:19.740593+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:25.138337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T18:50:20.734541+0000","last_change":"2024-05-08T18:50:19.739194+0000","last_active":"2024-05-08T18:50:20.734541+0000","last_peered":"2024-05-08T18:50:20.734541+0000","last_clean":"2024-05-08T18:50:20.734541+0000","last_became_active":"2024-05-08T18:50:19.738872+0000","last_became_peered":"2024-05-08T18:50:19.738872+0000","last_unstale":"2024-05-08T18:50:20.734541+0000","last_undegraded":"2024-05-08T18:50:20.734541+0000","last_fullsized":"2024-05-08T18:50:20.734541+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:28:20.859312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T18:50:20.734559+0000","last_change":"2024-05-08T18:50:19.740266+0000","last_active":"2024-05-08T18:50:20.734559+0000","last_peered":"2024-05-08T18:50:20.734559+0000","last_clean":"2024-05-08T18:50:20.734559+0000","last_became_active":"2024-05-08T18:50:19.739403+0000","last_became_peered":"2024-05-08T18:50:19.739403+0000","last_unstale":"2024-05-08T18:50:20.734559+0000","last_undegraded":"2024-05-08T18:50:20.734559+0000","last_fullsized":"2024-05-08T18:50:20.734559+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:59:48.671095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":99,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T18:50:20.127784+0000","last_change":"2024-05-08T18:50:19.740594+0000","last_active":"2024-05-08T18:50:20.127784+0000","last_peered":"2024-05-08T18:50:20.127784+0000","last_clean":"2024-05-08T18:50:20.127784+0000","last_became_active":"2024-05-08T18:50:19.739986+0000","last_became_peered":"2024-05-08T18:50:19.739986+0000","last_unstale":"2024-05-08T18:50:20.127784+0000","last_undegraded":"2024-05-08T18:50:20.127784+0000","last_fullsized":"2024-05-08T18:50:20.127784+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:09:29.398722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":106496,"data_stored":31051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":692224,"data_stored":617029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":692224,"data_stored":617029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35436,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336404,"statfs":{"total":96636764160,"available":96600477696,"internally_reserved":0,"allocated":98304,"data_stored":26661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:50:23.394 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T18:50:23.394 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-08T18:50:23.394 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-08T18:50:23.394 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-08T18:50:23.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.496+0000 7fd6a07c7640 1 Processor -- start 2024-05-08T18:50:23.495 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.496+0000 7fd6a07c7640 1 -- start start 2024-05-08T18:50:23.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.497+0000 7fd6a07c7640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd69812cbd0 0x7fd698070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:23.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.497+0000 7fd6a07c7640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd69812d020 con 0x7fd69812c7f0 2024-05-08T18:50:23.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.497+0000 7fd6a07c7640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fd698072fc0 con 0x7fd69812cbd0 2024-05-08T18:50:23.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.497+0000 7fd69dd62640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd69812cbd0 0x7fd698070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:23.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.497+0000 7fd69e563640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd69812c7f0 0x7fd698070850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:36130/0 (socket says 172.21.15.42:36130) 2024-05-08T18:50:23.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.497+0000 7fd69e563640 1 -- 172.21.15.42:0/2037644256 learned_addr learned my addr 172.21.15.42:0/2037644256 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:50:23.497 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.497+0000 7fd69dd62640 1 -- 172.21.15.42:0/2037644256 >> v1:172.21.15.42:6789/0 conn(0x7fd69812c7f0 legacy=0x7fd698070850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:23.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.497+0000 7fd69dd62640 1 -- 172.21.15.42:0/2037644256 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6980a23e0 con 0x7fd69812cbd0 2024-05-08T18:50:23.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.498+0000 7fd69dd62640 1 --2- 172.21.15.42:0/2037644256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd69812cbd0 0x7fd698070f60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd688009720 tx=0x7fd68802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6fe94d28bc174d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:23.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.498+0000 7fd69d561640 1 -- 172.21.15.42:0/2037644256 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6880316d0 con 0x7fd69812cbd0 2024-05-08T18:50:23.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.498+0000 7fd69d561640 1 -- 172.21.15.42:0/2037644256 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd688037070 con 0x7fd69812cbd0 2024-05-08T18:50:23.498 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.498+0000 7fd69d561640 1 -- 172.21.15.42:0/2037644256 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6880319c0 con 0x7fd69812cbd0 2024-05-08T18:50:23.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.499+0000 7fd6a07c7640 1 -- 172.21.15.42:0/2037644256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd69812cbd0 msgr2=0x7fd698070f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:23.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.499+0000 7fd6a07c7640 1 --2- 172.21.15.42:0/2037644256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd69812cbd0 0x7fd698070f60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd688009720 tx=0x7fd68802b840 comp rx=0 tx=0).stop 2024-05-08T18:50:23.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.499+0000 7fd6a07c7640 1 -- 172.21.15.42:0/2037644256 shutdown_connections 2024-05-08T18:50:23.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.499+0000 7fd6a07c7640 1 --2- 172.21.15.42:0/2037644256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd69812cbd0 0x7fd698070f60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:23.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.499+0000 7fd6a07c7640 1 -- 172.21.15.42:0/2037644256 >> 172.21.15.42:0/2037644256 conn(0x7fd69809ff90 msgr2=0x7fd6980a1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:23.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.499+0000 7fd6a07c7640 1 -- 172.21.15.42:0/2037644256 shutdown_connections 2024-05-08T18:50:23.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.499+0000 7fd6a07c7640 1 -- 172.21.15.42:0/2037644256 wait complete. 2024-05-08T18:50:23.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.500+0000 7fd6a07c7640 1 Processor -- start 2024-05-08T18:50:23.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.500+0000 7fd6a07c7640 1 -- start start 2024-05-08T18:50:23.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.500+0000 7fd6a07c7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd69812c7f0 0x7fd6981c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:23.500 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.500+0000 7fd6a07c7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd698072870 con 0x7fd69812c7f0 2024-05-08T18:50:23.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.500+0000 7fd69e563640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd69812c7f0 0x7fd6981c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:23.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.500+0000 7fd69e563640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd69812c7f0 0x7fd6981c45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58250/0 (socket says 172.21.15.42:58250) 2024-05-08T18:50:23.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.500+0000 7fd69e563640 1 -- 172.21.15.42:0/3520055547 learned_addr learned my addr 172.21.15.42:0/3520055547 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:50:23.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.500+0000 7fd69e563640 1 -- 172.21.15.42:0/3520055547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69811d760 con 0x7fd69812c7f0 2024-05-08T18:50:23.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.500+0000 7fd69e563640 1 --2- 172.21.15.42:0/3520055547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd69812c7f0 0x7fd6981c45e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd69400c4a0 tx=0x7fd69400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:23.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.501+0000 7fd68effd640 1 -- 172.21.15.42:0/3520055547 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd694017070 con 0x7fd69812c7f0 2024-05-08T18:50:23.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.501+0000 7fd68effd640 1 -- 172.21.15.42:0/3520055547 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd694005c10 con 0x7fd69812c7f0 2024-05-08T18:50:23.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.501+0000 7fd6a07c7640 1 -- 172.21.15.42:0/3520055547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd69811da50 con 0x7fd69812c7f0 2024-05-08T18:50:23.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.501+0000 7fd68effd640 1 -- 172.21.15.42:0/3520055547 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd694007070 con 0x7fd69812c7f0 2024-05-08T18:50:23.501 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.501+0000 7fd6a07c7640 1 -- 172.21.15.42:0/3520055547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6981c4d00 con 0x7fd69812c7f0 2024-05-08T18:50:23.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.502+0000 7fd68effd640 1 -- 172.21.15.42:0/3520055547 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd69401a070 con 0x7fd69812c7f0 2024-05-08T18:50:23.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.502+0000 7fd68effd640 1 --2- 172.21.15.42:0/3520055547 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd67c03d2e0 0x7fd67c03f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:23.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.502+0000 7fd6a07c7640 1 -- 172.21.15.42:0/3520055547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd698064010 con 0x7fd69812c7f0 2024-05-08T18:50:23.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.502+0000 7fd68effd640 1 -- 172.21.15.42:0/3520055547 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7fd694050630 con 0x7fd69812c7f0 2024-05-08T18:50:23.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.502+0000 7fd69dd62640 1 --2- 172.21.15.42:0/3520055547 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd67c03d2e0 0x7fd67c03f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:23.502 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.503+0000 7fd69dd62640 1 --2- 172.21.15.42:0/3520055547 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd67c03d2e0 0x7fd67c03f7a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd688036000 tx=0x7fd688008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:23.505 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.506+0000 7fd68effd640 1 -- 172.21.15.42:0/3520055547 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd694011c80 con 0x7fd69812c7f0 2024-05-08T18:50:23.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.734+0000 7fd6a07c7640 1 -- 172.21.15.42:0/3520055547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd6980a2930 con 0x7fd69812c7f0 2024-05-08T18:50:23.734 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.735+0000 7fd68effd640 1 -- 172.21.15.42:0/3520055547 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd69400bcc0 con 0x7fd69812c7f0 2024-05-08T18:50:23.734 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:50:23.735 INFO:teuthology.orchestra.run.smithi042.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-08T18:50:23.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.737+0000 7fd6a07c7640 1 -- 172.21.15.42:0/3520055547 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd67c03d2e0 msgr2=0x7fd67c03f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:23.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.737+0000 7fd6a07c7640 1 --2- 172.21.15.42:0/3520055547 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd67c03d2e0 0x7fd67c03f7a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd688036000 tx=0x7fd688008030 comp rx=0 tx=0).stop 2024-05-08T18:50:23.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.737+0000 7fd6a07c7640 1 -- 172.21.15.42:0/3520055547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd69812c7f0 msgr2=0x7fd6981c45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:23.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.737+0000 7fd6a07c7640 1 --2- 172.21.15.42:0/3520055547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd69812c7f0 0x7fd6981c45e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd69400c4a0 tx=0x7fd69400c960 comp rx=0 tx=0).stop 2024-05-08T18:50:23.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.737+0000 7fd6a07c7640 1 -- 172.21.15.42:0/3520055547 shutdown_connections 2024-05-08T18:50:23.736 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.737+0000 7fd6a07c7640 1 --2- 172.21.15.42:0/3520055547 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd67c03d2e0 0x7fd67c03f7a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:23.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.737+0000 7fd6a07c7640 1 --2- 172.21.15.42:0/3520055547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd69812c7f0 0x7fd6981c45e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:23.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.737+0000 7fd6a07c7640 1 -- 172.21.15.42:0/3520055547 >> 172.21.15.42:0/3520055547 conn(0x7fd69809ff90 msgr2=0x7fd69806e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:23.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.737+0000 7fd6a07c7640 1 -- 172.21.15.42:0/3520055547 shutdown_connections 2024-05-08T18:50:23.737 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:50:23.737+0000 7fd6a07c7640 1 -- 172.21.15.42:0/3520055547 wait complete. 2024-05-08T18:50:23.747 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-08T18:50:23.748 INFO:teuthology.run_tasks:Running task rgw... 2024-05-08T18:50:23.763 DEBUG:tasks.rgw:config is {'client.0': None} 2024-05-08T18:50:23.763 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-05-08T18:50:23.764 INFO:tasks.rgw:Creating data pools 2024-05-08T18:50:23.764 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-05-08T18:50:23.764 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-05-08T18:50:23.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.876+0000 7f11678c3640 1 Processor -- start 2024-05-08T18:50:23.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.876+0000 7f11678c3640 1 -- start start 2024-05-08T18:50:23.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.876+0000 7f11678c3640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f116011bdb0 0x7f116011e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:23.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.876+0000 7f11678c3640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f116010fae0 con 0x7f116010ee40 2024-05-08T18:50:23.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.876+0000 7f11678c3640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f116011f6f0 con 0x7f116011bdb0 2024-05-08T18:50:23.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.877+0000 7f1164e5e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f116011bdb0 0x7f116011e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:23.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.877+0000 7f1164e5e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f116011bdb0 0x7f116011e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:58176/0 (socket says 172.21.15.132:58176) 2024-05-08T18:50:23.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.877+0000 7f116565f640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f116010ee40 0x7f116010f220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:33990/0 (socket says 172.21.15.132:33990) 2024-05-08T18:50:23.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.877+0000 7f1164e5e640 1 -- 172.21.15.132:0/3863735651 learned_addr learned my addr 172.21.15.132:0/3863735651 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:23.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.877+0000 7f1164e5e640 1 -- 172.21.15.132:0/3863735651 >> v1:172.21.15.42:6789/0 conn(0x7f116010ee40 legacy=0x7f116010f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:23.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.877+0000 7f1164e5e640 1 -- 172.21.15.132:0/3863735651 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f116011f870 con 0x7f116011bdb0 2024-05-08T18:50:23.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.878+0000 7f1164e5e640 1 --2- 172.21.15.132:0/3863735651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f116011bdb0 0x7f116011e1a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f11500097f0 tx=0x7f115002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654a0c602bbe63e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:23.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.878+0000 7f1157fff640 1 -- 172.21.15.132:0/3863735651 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1150035020 con 0x7f116011bdb0 2024-05-08T18:50:23.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.878+0000 7f1157fff640 1 -- 172.21.15.132:0/3863735651 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11500317a0 con 0x7f116011bdb0 2024-05-08T18:50:23.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.878+0000 7f1157fff640 1 -- 172.21.15.132:0/3863735651 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1150031aa0 con 0x7f116011bdb0 2024-05-08T18:50:23.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.879+0000 7f11678c3640 1 -- 172.21.15.132:0/3863735651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f116011bdb0 msgr2=0x7f116011e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:23.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.879+0000 7f11678c3640 1 --2- 172.21.15.132:0/3863735651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f116011bdb0 0x7f116011e1a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f11500097f0 tx=0x7f115002b910 comp rx=0 tx=0).stop 2024-05-08T18:50:23.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.879+0000 7f11678c3640 1 -- 172.21.15.132:0/3863735651 shutdown_connections 2024-05-08T18:50:23.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.879+0000 7f11678c3640 1 --2- 172.21.15.132:0/3863735651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f116011bdb0 0x7f116011e1a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:23.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.879+0000 7f11678c3640 1 -- 172.21.15.132:0/3863735651 >> 172.21.15.132:0/3863735651 conn(0x7f11600705a0 msgr2=0x7f11600729c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:23.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.879+0000 7f11678c3640 1 -- 172.21.15.132:0/3863735651 shutdown_connections 2024-05-08T18:50:23.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.879+0000 7f11678c3640 1 -- 172.21.15.132:0/3863735651 wait complete. 2024-05-08T18:50:23.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.879+0000 7f11678c3640 1 Processor -- start 2024-05-08T18:50:23.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.879+0000 7f11678c3640 1 -- start start 2024-05-08T18:50:23.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.880+0000 7f11678c3640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f116010ee40 0x7f11601a7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:23.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.880+0000 7f11678c3640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f116011ec00 con 0x7f116010ee40 2024-05-08T18:50:23.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.880+0000 7f116565f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f116010ee40 0x7f11601a7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:23.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.880+0000 7f116565f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f116010ee40 0x7f11601a7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:58192/0 (socket says 172.21.15.132:58192) 2024-05-08T18:50:23.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.880+0000 7f116565f640 1 -- 172.21.15.132:0/2016660699 learned_addr learned my addr 172.21.15.132:0/2016660699 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:23.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.880+0000 7f116565f640 1 -- 172.21.15.132:0/2016660699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11601a7ec0 con 0x7f116010ee40 2024-05-08T18:50:23.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.880+0000 7f116565f640 1 --2- 172.21.15.132:0/2016660699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f116010ee40 0x7f11601a7980 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f115c00c340 tx=0x7f115c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:23.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.880+0000 7f1155ffb640 1 -- 172.21.15.132:0/2016660699 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f115c007410 con 0x7f116010ee40 2024-05-08T18:50:23.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.880+0000 7f1155ffb640 1 -- 172.21.15.132:0/2016660699 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f115c0075b0 con 0x7f116010ee40 2024-05-08T18:50:23.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.880+0000 7f11678c3640 1 -- 172.21.15.132:0/2016660699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11601a8150 con 0x7f116010ee40 2024-05-08T18:50:23.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.881+0000 7f1155ffb640 1 -- 172.21.15.132:0/2016660699 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f115c0047e0 con 0x7f116010ee40 2024-05-08T18:50:23.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.881+0000 7f11678c3640 1 -- 172.21.15.132:0/2016660699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11601ac080 con 0x7f116010ee40 2024-05-08T18:50:23.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.882+0000 7f1155ffb640 1 -- 172.21.15.132:0/2016660699 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f115c01a020 con 0x7f116010ee40 2024-05-08T18:50:23.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.882+0000 7f11678c3640 1 -- 172.21.15.132:0/2016660699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1160050f90 con 0x7f116010ee40 2024-05-08T18:50:23.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.882+0000 7f1155ffb640 1 --2- 172.21.15.132:0/2016660699 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f114403d2b0 0x7f114403f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:23.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.882+0000 7f1155ffb640 1 -- 172.21.15.132:0/2016660699 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f115c050b50 con 0x7f116010ee40 2024-05-08T18:50:23.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.882+0000 7f1164e5e640 1 --2- 172.21.15.132:0/2016660699 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f114403d2b0 0x7f114403f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:23.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.882+0000 7f1164e5e640 1 --2- 172.21.15.132:0/2016660699 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f114403d2b0 0x7f114403f770 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1150036000 tx=0x7f1150008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:23.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:23.887+0000 7f1155ffb640 1 -- 172.21.15.132:0/2016660699 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f115c012e40 con 0x7f116010ee40 2024-05-08T18:50:24.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:24.068+0000 7f11678c3640 1 -- 172.21.15.132:0/2016660699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f116011bdb0 con 0x7f116010ee40 2024-05-08T18:50:24.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:24.998+0000 7f1155ffb640 1 -- 172.21.15.132:0/2016660699 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.data' created v13) ==== 167+0+0 (secure 0 0 0) 0x7f115c0113a0 con 0x7f116010ee40 2024-05-08T18:50:24.998 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'default.rgw.buckets.data' created 2024-05-08T18:50:25.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.002+0000 7f11678c3640 1 -- 172.21.15.132:0/2016660699 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f114403d2b0 msgr2=0x7f114403f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:25.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.002+0000 7f11678c3640 1 --2- 172.21.15.132:0/2016660699 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f114403d2b0 0x7f114403f770 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1150036000 tx=0x7f1150008030 comp rx=0 tx=0).stop 2024-05-08T18:50:25.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.002+0000 7f11678c3640 1 -- 172.21.15.132:0/2016660699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f116010ee40 msgr2=0x7f11601a7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:25.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.002+0000 7f11678c3640 1 --2- 172.21.15.132:0/2016660699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f116010ee40 0x7f11601a7980 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f115c00c340 tx=0x7f115c001e70 comp rx=0 tx=0).stop 2024-05-08T18:50:25.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.003+0000 7f11678c3640 1 -- 172.21.15.132:0/2016660699 shutdown_connections 2024-05-08T18:50:25.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.003+0000 7f11678c3640 1 --2- 172.21.15.132:0/2016660699 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f114403d2b0 0x7f114403f770 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:25.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.003+0000 7f11678c3640 1 --2- 172.21.15.132:0/2016660699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f116010ee40 0x7f11601a7980 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:25.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.003+0000 7f11678c3640 1 -- 172.21.15.132:0/2016660699 >> 172.21.15.132:0/2016660699 conn(0x7f11600705a0 msgr2=0x7f116011ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:25.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.003+0000 7f11678c3640 1 -- 172.21.15.132:0/2016660699 shutdown_connections 2024-05-08T18:50:25.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.004+0000 7f11678c3640 1 -- 172.21.15.132:0/2016660699 wait complete. 2024-05-08T18:50:25.021 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-05-08T18:50:25.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.126+0000 7f2080706640 1 Processor -- start 2024-05-08T18:50:25.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.126+0000 7f2080706640 1 -- start start 2024-05-08T18:50:25.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.126+0000 7f2080706640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f20781199c0 0x7f207811bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:25.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.126+0000 7f2080706640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f207811c2f0 con 0x7f207810f020 2024-05-08T18:50:25.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.126+0000 7f2080706640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f207811d4d0 con 0x7f20781199c0 2024-05-08T18:50:25.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.126+0000 7f207dca1640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f20781199c0 0x7f207811bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:25.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.126+0000 7f207e4a2640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f207810f020 0x7f207810f400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:34000/0 (socket says 172.21.15.132:34000) 2024-05-08T18:50:25.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.126+0000 7f207dca1640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f20781199c0 0x7f207811bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:58194/0 (socket says 172.21.15.132:58194) 2024-05-08T18:50:25.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.126+0000 7f207e4a2640 1 -- 172.21.15.132:0/1016218005 learned_addr learned my addr 172.21.15.132:0/1016218005 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:50:25.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.127+0000 7f207dca1640 1 -- 172.21.15.132:0/1016218005 >> v1:172.21.15.42:6789/0 conn(0x7f207810f020 legacy=0x7f207810f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:25.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.127+0000 7f207dca1640 1 -- 172.21.15.132:0/1016218005 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f207811d680 con 0x7f20781199c0 2024-05-08T18:50:25.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.128+0000 7f207dca1640 1 --2- 172.21.15.132:0/1016218005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20781199c0 0x7f207811bdb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2074009d90 tx=0x7f207402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b1ec3eb7527783a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:25.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.128+0000 7f207d4a0640 1 -- 172.21.15.132:0/1016218005 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2074039070 con 0x7f20781199c0 2024-05-08T18:50:25.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.128+0000 7f207d4a0640 1 -- 172.21.15.132:0/1016218005 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f207402cb10 con 0x7f20781199c0 2024-05-08T18:50:25.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.128+0000 7f207d4a0640 1 -- 172.21.15.132:0/1016218005 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f207402ce10 con 0x7f20781199c0 2024-05-08T18:50:25.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.128+0000 7f2080706640 1 -- 172.21.15.132:0/1016218005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20781199c0 msgr2=0x7f207811bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:25.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.128+0000 7f2080706640 1 --2- 172.21.15.132:0/1016218005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20781199c0 0x7f207811bdb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2074009d90 tx=0x7f207402beb0 comp rx=0 tx=0).stop 2024-05-08T18:50:25.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.128+0000 7f2080706640 1 -- 172.21.15.132:0/1016218005 shutdown_connections 2024-05-08T18:50:25.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.128+0000 7f2080706640 1 --2- 172.21.15.132:0/1016218005 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20781199c0 0x7f207811bdb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:25.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.128+0000 7f2080706640 1 -- 172.21.15.132:0/1016218005 >> 172.21.15.132:0/1016218005 conn(0x7f20780705a0 msgr2=0x7f20780729c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:25.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.129+0000 7f2080706640 1 -- 172.21.15.132:0/1016218005 shutdown_connections 2024-05-08T18:50:25.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.129+0000 7f2080706640 1 -- 172.21.15.132:0/1016218005 wait complete. 2024-05-08T18:50:25.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.129+0000 7f2080706640 1 Processor -- start 2024-05-08T18:50:25.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.129+0000 7f2080706640 1 -- start start 2024-05-08T18:50:25.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.129+0000 7f2080706640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f207810f020 0x7f20781a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:25.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.129+0000 7f2080706640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f207811c9e0 con 0x7f207810f020 2024-05-08T18:50:25.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.130+0000 7f207e4a2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f207810f020 0x7f20781a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:25.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.130+0000 7f207e4a2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f207810f020 0x7f20781a5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:58208/0 (socket says 172.21.15.132:58208) 2024-05-08T18:50:25.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.130+0000 7f207e4a2640 1 -- 172.21.15.132:0/3863713144 learned_addr learned my addr 172.21.15.132:0/3863713144 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:25.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.130+0000 7f207e4a2640 1 -- 172.21.15.132:0/3863713144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20781a5f40 con 0x7f207810f020 2024-05-08T18:50:25.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.130+0000 7f207e4a2640 1 --2- 172.21.15.132:0/3863713144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f207810f020 0x7f20781a5970 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f206800c340 tx=0x7f2068001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:25.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.130+0000 7f206effd640 1 -- 172.21.15.132:0/3863713144 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2068005c10 con 0x7f207810f020 2024-05-08T18:50:25.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.130+0000 7f206effd640 1 -- 172.21.15.132:0/3863713144 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2068005db0 con 0x7f207810f020 2024-05-08T18:50:25.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.130+0000 7f2080706640 1 -- 172.21.15.132:0/3863713144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20781a61d0 con 0x7f207810f020 2024-05-08T18:50:25.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.130+0000 7f206effd640 1 -- 172.21.15.132:0/3863713144 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2068004930 con 0x7f207810f020 2024-05-08T18:50:25.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.131+0000 7f2080706640 1 -- 172.21.15.132:0/3863713144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20781aa200 con 0x7f207810f020 2024-05-08T18:50:25.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.131+0000 7f2080706640 1 -- 172.21.15.132:0/3863713144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2078050f90 con 0x7f207810f020 2024-05-08T18:50:25.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.132+0000 7f206effd640 1 -- 172.21.15.132:0/3863713144 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f206801a020 con 0x7f207810f020 2024-05-08T18:50:25.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.132+0000 7f206effd640 1 --2- 172.21.15.132:0/3863713144 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f205c03d2b0 0x7f205c03f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:25.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.132+0000 7f206effd640 1 -- 172.21.15.132:0/3863713144 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3845+0+0 (secure 0 0 0) 0x7f2068050cd0 con 0x7f207810f020 2024-05-08T18:50:25.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.132+0000 7f207dca1640 1 --2- 172.21.15.132:0/3863713144 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f205c03d2b0 0x7f205c03f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:25.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.132+0000 7f207dca1640 1 --2- 172.21.15.132:0/3863713144 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f205c03d2b0 0x7f205c03f770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2074036000 tx=0x7f2074030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:25.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.137+0000 7f206effd640 1 -- 172.21.15.132:0/3863713144 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f20680075f0 con 0x7f207810f020 2024-05-08T18:50:25.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:25.319+0000 7f2080706640 1 -- 172.21.15.132:0/3863713144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f20781a6400 con 0x7f207810f020 2024-05-08T18:50:26.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.001+0000 7f206effd640 1 -- 172.21.15.132:0/3863713144 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v14) ==== 185+0+0 (secure 0 0 0) 0x7f20680070d0 con 0x7f207810f020 2024-05-08T18:50:26.000 INFO:teuthology.orchestra.run.smithi132.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-05-08T18:50:26.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.005+0000 7f2080706640 1 -- 172.21.15.132:0/3863713144 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f205c03d2b0 msgr2=0x7f205c03f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:26.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.005+0000 7f2080706640 1 --2- 172.21.15.132:0/3863713144 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f205c03d2b0 0x7f205c03f770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2074036000 tx=0x7f2074030000 comp rx=0 tx=0).stop 2024-05-08T18:50:26.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.005+0000 7f2080706640 1 -- 172.21.15.132:0/3863713144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f207810f020 msgr2=0x7f20781a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:26.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.005+0000 7f2080706640 1 --2- 172.21.15.132:0/3863713144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f207810f020 0x7f20781a5970 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f206800c340 tx=0x7f2068001e70 comp rx=0 tx=0).stop 2024-05-08T18:50:26.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.005+0000 7f2080706640 1 -- 172.21.15.132:0/3863713144 shutdown_connections 2024-05-08T18:50:26.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.005+0000 7f2080706640 1 --2- 172.21.15.132:0/3863713144 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f205c03d2b0 0x7f205c03f770 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:26.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.005+0000 7f2080706640 1 --2- 172.21.15.132:0/3863713144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f207810f020 0x7f20781a5970 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:26.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.005+0000 7f2080706640 1 -- 172.21.15.132:0/3863713144 >> 172.21.15.132:0/3863713144 conn(0x7f20780705a0 msgr2=0x7f2078072920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:26.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.005+0000 7f2080706640 1 -- 172.21.15.132:0/3863713144 shutdown_connections 2024-05-08T18:50:26.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.005+0000 7f2080706640 1 -- 172.21.15.132:0/3863713144 wait complete. 2024-05-08T18:50:26.025 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-05-08T18:50:26.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.128+0000 7f17fd57e640 1 Processor -- start 2024-05-08T18:50:26.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.128+0000 7f17fd57e640 1 -- start start 2024-05-08T18:50:26.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.128+0000 7f17fd57e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f17f8115210 0x7f17f81155f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:26.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.128+0000 7f17fd57e640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17f8115cb0 con 0x7f17f810f640 2024-05-08T18:50:26.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.128+0000 7f17fd57e640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f17f8110200 con 0x7f17f8115210 2024-05-08T18:50:26.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.129+0000 7f17f6ffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f17f8115210 0x7f17f81155f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:26.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.129+0000 7f17f67fc640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f17f810f640 0x7f17f810faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:34014/0 (socket says 172.21.15.132:34014) 2024-05-08T18:50:26.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.129+0000 7f17f67fc640 1 -- 172.21.15.132:0/1813177530 learned_addr learned my addr 172.21.15.132:0/1813177530 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:50:26.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.129+0000 7f17f6ffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f17f8115210 0x7f17f81155f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:58214/0 (socket says 172.21.15.132:58214) 2024-05-08T18:50:26.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.129+0000 7f17f6ffd640 1 -- 172.21.15.132:0/1813177530 >> v1:172.21.15.42:6789/0 conn(0x7f17f810f640 legacy=0x7f17f810faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:26.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.129+0000 7f17f6ffd640 1 -- 172.21.15.132:0/1813177530 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f81103b0 con 0x7f17f8115210 2024-05-08T18:50:26.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.130+0000 7f17f6ffd640 1 --2- 172.21.15.132:0/1813177530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17f8115210 0x7f17f81155f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f17e800b9c0 tx=0x7f17e802ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee764d4f77febc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:26.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.130+0000 7f17f5ffb640 1 -- 172.21.15.132:0/1813177530 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17e8034070 con 0x7f17f8115210 2024-05-08T18:50:26.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.130+0000 7f17f5ffb640 1 -- 172.21.15.132:0/1813177530 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e802ead0 con 0x7f17f8115210 2024-05-08T18:50:26.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.130+0000 7f17f5ffb640 1 -- 172.21.15.132:0/1813177530 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17e802edd0 con 0x7f17f8115210 2024-05-08T18:50:26.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.131+0000 7f17fd57e640 1 -- 172.21.15.132:0/1813177530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17f8115210 msgr2=0x7f17f81155f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:26.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.131+0000 7f17fd57e640 1 --2- 172.21.15.132:0/1813177530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17f8115210 0x7f17f81155f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f17e800b9c0 tx=0x7f17e802ddf0 comp rx=0 tx=0).stop 2024-05-08T18:50:26.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.131+0000 7f17fd57e640 1 -- 172.21.15.132:0/1813177530 shutdown_connections 2024-05-08T18:50:26.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.131+0000 7f17fd57e640 1 --2- 172.21.15.132:0/1813177530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17f8115210 0x7f17f81155f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:26.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.131+0000 7f17fd57e640 1 -- 172.21.15.132:0/1813177530 >> 172.21.15.132:0/1813177530 conn(0x7f17f80705a0 msgr2=0x7f17f80729c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:26.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.131+0000 7f17fd57e640 1 -- 172.21.15.132:0/1813177530 shutdown_connections 2024-05-08T18:50:26.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.131+0000 7f17fd57e640 1 -- 172.21.15.132:0/1813177530 wait complete. 2024-05-08T18:50:26.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.132+0000 7f17fd57e640 1 Processor -- start 2024-05-08T18:50:26.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.132+0000 7f17fd57e640 1 -- start start 2024-05-08T18:50:26.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.132+0000 7f17fd57e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17f810f640 0x7f17f81a90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:26.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.132+0000 7f17fd57e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f17f810f1d0 con 0x7f17f810f640 2024-05-08T18:50:26.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.132+0000 7f17f6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17f810f640 0x7f17f81a90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:26.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.132+0000 7f17f6ffd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17f810f640 0x7f17f81a90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:58218/0 (socket says 172.21.15.132:58218) 2024-05-08T18:50:26.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.132+0000 7f17f6ffd640 1 -- 172.21.15.132:0/2723542285 learned_addr learned my addr 172.21.15.132:0/2723542285 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:26.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.132+0000 7f17f6ffd640 1 -- 172.21.15.132:0/2723542285 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f81a96b0 con 0x7f17f810f640 2024-05-08T18:50:26.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.133+0000 7f17f6ffd640 1 --2- 172.21.15.132:0/2723542285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17f810f640 0x7f17f81a90e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f17e803a040 tx=0x7f17e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:26.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.133+0000 7f17df7fe640 1 -- 172.21.15.132:0/2723542285 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17e8047020 con 0x7f17f810f640 2024-05-08T18:50:26.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.133+0000 7f17df7fe640 1 -- 172.21.15.132:0/2723542285 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e80377f0 con 0x7f17f810f640 2024-05-08T18:50:26.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.133+0000 7f17fd57e640 1 -- 172.21.15.132:0/2723542285 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f81a98e0 con 0x7f17f810f640 2024-05-08T18:50:26.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.133+0000 7f17df7fe640 1 -- 172.21.15.132:0/2723542285 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17e8037ad0 con 0x7f17f810f640 2024-05-08T18:50:26.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.133+0000 7f17fd57e640 1 -- 172.21.15.132:0/2723542285 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f81a31f0 con 0x7f17f810f640 2024-05-08T18:50:26.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.134+0000 7f17fd57e640 1 -- 172.21.15.132:0/2723542285 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f8050f90 con 0x7f17f810f640 2024-05-08T18:50:26.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.134+0000 7f17df7fe640 1 -- 172.21.15.132:0/2723542285 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f17e804a020 con 0x7f17f810f640 2024-05-08T18:50:26.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.134+0000 7f17df7fe640 1 --2- 172.21.15.132:0/2723542285 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f17e403d2b0 0x7f17e403f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:26.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.134+0000 7f17df7fe640 1 -- 172.21.15.132:0/2723542285 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3856+0+0 (secure 0 0 0) 0x7f17e80766f0 con 0x7f17f810f640 2024-05-08T18:50:26.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.134+0000 7f17f67fc640 1 --2- 172.21.15.132:0/2723542285 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f17e403d2b0 0x7f17e403f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:26.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.135+0000 7f17f67fc640 1 --2- 172.21.15.132:0/2723542285 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f17e403d2b0 0x7f17e403f770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f17ec000f60 tx=0x7f17ec007a80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:26.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.139+0000 7f17df7fe640 1 -- 172.21.15.132:0/2723542285 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f17e8051030 con 0x7f17f810f640 2024-05-08T18:50:26.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:26.319+0000 7f17fd57e640 1 -- 172.21.15.132:0/2723542285 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f17f8115210 con 0x7f17f810f640 2024-05-08T18:50:27.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.006+0000 7f17df7fe640 1 -- 172.21.15.132:0/2723542285 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v15) ==== 169+0+0 (secure 0 0 0) 0x7f17e80403a0 con 0x7f17f810f640 2024-05-08T18:50:27.005 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'default.rgw.buckets.index' created 2024-05-08T18:50:27.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.009+0000 7f17fd57e640 1 -- 172.21.15.132:0/2723542285 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f17e403d2b0 msgr2=0x7f17e403f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:27.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.009+0000 7f17fd57e640 1 --2- 172.21.15.132:0/2723542285 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f17e403d2b0 0x7f17e403f770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f17ec000f60 tx=0x7f17ec007a80 comp rx=0 tx=0).stop 2024-05-08T18:50:27.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.009+0000 7f17fd57e640 1 -- 172.21.15.132:0/2723542285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17f810f640 msgr2=0x7f17f81a90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:27.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.009+0000 7f17fd57e640 1 --2- 172.21.15.132:0/2723542285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17f810f640 0x7f17f81a90e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f17e803a040 tx=0x7f17e80046c0 comp rx=0 tx=0).stop 2024-05-08T18:50:27.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.009+0000 7f17fd57e640 1 -- 172.21.15.132:0/2723542285 shutdown_connections 2024-05-08T18:50:27.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.009+0000 7f17fd57e640 1 --2- 172.21.15.132:0/2723542285 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f17e403d2b0 0x7f17e403f770 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:27.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.009+0000 7f17fd57e640 1 --2- 172.21.15.132:0/2723542285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17f810f640 0x7f17f81a90e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:27.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.009+0000 7f17fd57e640 1 -- 172.21.15.132:0/2723542285 >> 172.21.15.132:0/2723542285 conn(0x7f17f80705a0 msgr2=0x7f17f8111200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:27.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.010+0000 7f17fd57e640 1 -- 172.21.15.132:0/2723542285 shutdown_connections 2024-05-08T18:50:27.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.010+0000 7f17fd57e640 1 -- 172.21.15.132:0/2723542285 wait complete. 2024-05-08T18:50:27.027 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-05-08T18:50:27.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.130+0000 7f7bf03ed640 1 Processor -- start 2024-05-08T18:50:27.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.130+0000 7f7bf03ed640 1 -- start start 2024-05-08T18:50:27.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.131+0000 7f7bf03ed640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7be81199c0 0x7f7be811bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:27.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.131+0000 7f7bf03ed640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7be811c2f0 con 0x7f7be810f020 2024-05-08T18:50:27.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.131+0000 7f7bf03ed640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f7be811d4d0 con 0x7f7be81199c0 2024-05-08T18:50:27.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.131+0000 7f7bed988640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7be81199c0 0x7f7be811bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:27.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.131+0000 7f7bed988640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7be81199c0 0x7f7be811bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:58224/0 (socket says 172.21.15.132:58224) 2024-05-08T18:50:27.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.131+0000 7f7bed988640 1 -- 172.21.15.132:0/143246486 learned_addr learned my addr 172.21.15.132:0/143246486 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:27.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.131+0000 7f7bed988640 1 -- 172.21.15.132:0/143246486 >> v1:172.21.15.42:6789/0 conn(0x7f7be810f020 legacy=0x7f7be810f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:27.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.131+0000 7f7bed988640 1 -- 172.21.15.132:0/143246486 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be811d680 con 0x7f7be81199c0 2024-05-08T18:50:27.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.132+0000 7f7bed988640 1 --2- 172.21.15.132:0/143246486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7be81199c0 0x7f7be811bdb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7bd80097f0 tx=0x7f7bd802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f852c533a2da6de3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:27.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.132+0000 7f7bed187640 1 -- 172.21.15.132:0/143246486 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bd8035020 con 0x7f7be81199c0 2024-05-08T18:50:27.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.132+0000 7f7bed187640 1 -- 172.21.15.132:0/143246486 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd80317a0 con 0x7f7be81199c0 2024-05-08T18:50:27.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.132+0000 7f7bed187640 1 -- 172.21.15.132:0/143246486 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bd8031aa0 con 0x7f7be81199c0 2024-05-08T18:50:27.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.133+0000 7f7bf03ed640 1 -- 172.21.15.132:0/143246486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7be81199c0 msgr2=0x7f7be811bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:27.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.133+0000 7f7bf03ed640 1 --2- 172.21.15.132:0/143246486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7be81199c0 0x7f7be811bdb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7bd80097f0 tx=0x7f7bd802b910 comp rx=0 tx=0).stop 2024-05-08T18:50:27.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.133+0000 7f7bf03ed640 1 -- 172.21.15.132:0/143246486 shutdown_connections 2024-05-08T18:50:27.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.133+0000 7f7bf03ed640 1 --2- 172.21.15.132:0/143246486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7be81199c0 0x7f7be811bdb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:27.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.133+0000 7f7bf03ed640 1 -- 172.21.15.132:0/143246486 >> 172.21.15.132:0/143246486 conn(0x7f7be80705a0 msgr2=0x7f7be80729c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:27.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.133+0000 7f7bf03ed640 1 -- 172.21.15.132:0/143246486 shutdown_connections 2024-05-08T18:50:27.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.133+0000 7f7bf03ed640 1 -- 172.21.15.132:0/143246486 wait complete. 2024-05-08T18:50:27.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.134+0000 7f7bf03ed640 1 Processor -- start 2024-05-08T18:50:27.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.134+0000 7f7bf03ed640 1 -- start start 2024-05-08T18:50:27.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.134+0000 7f7bf03ed640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7be810f020 0x7f7be81a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:27.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.134+0000 7f7bf03ed640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f7be811c9e0 con 0x7f7be810f020 2024-05-08T18:50:27.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.134+0000 7f7bee189640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7be810f020 0x7f7be81a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:27.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.134+0000 7f7bee189640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7be810f020 0x7f7be81a5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:58232/0 (socket says 172.21.15.132:58232) 2024-05-08T18:50:27.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.134+0000 7f7bee189640 1 -- 172.21.15.132:0/1494918500 learned_addr learned my addr 172.21.15.132:0/1494918500 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:27.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.134+0000 7f7bee189640 1 -- 172.21.15.132:0/1494918500 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be81a5f40 con 0x7f7be810f020 2024-05-08T18:50:27.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.135+0000 7f7bee189640 1 --2- 172.21.15.132:0/1494918500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7be810f020 0x7f7be81a5970 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7be400c340 tx=0x7f7be4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:27.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.135+0000 7f7bdeffd640 1 -- 172.21.15.132:0/1494918500 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7be4005200 con 0x7f7be810f020 2024-05-08T18:50:27.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.135+0000 7f7bdeffd640 1 -- 172.21.15.132:0/1494918500 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be40053c0 con 0x7f7be810f020 2024-05-08T18:50:27.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.135+0000 7f7bdeffd640 1 -- 172.21.15.132:0/1494918500 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7be4007190 con 0x7f7be810f020 2024-05-08T18:50:27.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.135+0000 7f7bf03ed640 1 -- 172.21.15.132:0/1494918500 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be81a61d0 con 0x7f7be810f020 2024-05-08T18:50:27.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.135+0000 7f7bf03ed640 1 -- 172.21.15.132:0/1494918500 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be81aa200 con 0x7f7be810f020 2024-05-08T18:50:27.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.136+0000 7f7bf03ed640 1 -- 172.21.15.132:0/1494918500 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be8050f90 con 0x7f7be810f020 2024-05-08T18:50:27.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.136+0000 7f7bdeffd640 1 -- 172.21.15.132:0/1494918500 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f7be4007400 con 0x7f7be810f020 2024-05-08T18:50:27.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.136+0000 7f7bdeffd640 1 --2- 172.21.15.132:0/1494918500 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7bcc03d260 0x7f7bcc03f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:27.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.136+0000 7f7bdeffd640 1 -- 172.21.15.132:0/1494918500 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4220+0+0 (secure 0 0 0) 0x7f7be4050b10 con 0x7f7be810f020 2024-05-08T18:50:27.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.136+0000 7f7bed988640 1 --2- 172.21.15.132:0/1494918500 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7bcc03d260 0x7f7bcc03f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:27.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.137+0000 7f7bed988640 1 --2- 172.21.15.132:0/1494918500 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7bcc03d260 0x7f7bcc03f720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8036000 tx=0x7f7bd8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:27.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.142+0000 7f7bdeffd640 1 -- 172.21.15.132:0/1494918500 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f7be401a360 con 0x7f7be810f020 2024-05-08T18:50:27.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:27.325+0000 7f7bf03ed640 1 -- 172.21.15.132:0/1494918500 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7f7be81a6400 con 0x7f7be810f020 2024-05-08T18:50:28.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:28.009+0000 7f7bdeffd640 1 -- 172.21.15.132:0/1494918500 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v16) ==== 187+0+0 (secure 0 0 0) 0x7f7be40067d0 con 0x7f7be810f020 2024-05-08T18:50:28.008 INFO:teuthology.orchestra.run.smithi132.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-05-08T18:50:28.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:28.011+0000 7f7bf03ed640 1 -- 172.21.15.132:0/1494918500 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7bcc03d260 msgr2=0x7f7bcc03f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:28.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:28.011+0000 7f7bf03ed640 1 --2- 172.21.15.132:0/1494918500 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7bcc03d260 0x7f7bcc03f720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8036000 tx=0x7f7bd8008030 comp rx=0 tx=0).stop 2024-05-08T18:50:28.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:28.011+0000 7f7bf03ed640 1 -- 172.21.15.132:0/1494918500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7be810f020 msgr2=0x7f7be81a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:28.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:28.011+0000 7f7bf03ed640 1 --2- 172.21.15.132:0/1494918500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7be810f020 0x7f7be81a5970 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7be400c340 tx=0x7f7be4001e70 comp rx=0 tx=0).stop 2024-05-08T18:50:28.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:28.012+0000 7f7bf03ed640 1 -- 172.21.15.132:0/1494918500 shutdown_connections 2024-05-08T18:50:28.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:28.012+0000 7f7bf03ed640 1 --2- 172.21.15.132:0/1494918500 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7bcc03d260 0x7f7bcc03f720 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:28.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:28.012+0000 7f7bf03ed640 1 --2- 172.21.15.132:0/1494918500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7be810f020 0x7f7be81a5970 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:28.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:28.012+0000 7f7bf03ed640 1 -- 172.21.15.132:0/1494918500 >> 172.21.15.132:0/1494918500 conn(0x7f7be80705a0 msgr2=0x7f7be80728a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:28.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:28.012+0000 7f7bf03ed640 1 -- 172.21.15.132:0/1494918500 shutdown_connections 2024-05-08T18:50:28.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:28.012+0000 7f7bf03ed640 1 -- 172.21.15.132:0/1494918500 wait complete. 2024-05-08T18:50:28.040 DEBUG:tasks.rgw:Pools created 2024-05-08T18:50:28.040 INFO:tasks.rgw:Starting rgw... 2024-05-08T18:50:28.040 INFO:tasks.rgw:rgw client.0 config is {} 2024-05-08T18:50:28.040 INFO:tasks.rgw:Using beast as radosgw frontend 2024-05-08T18:50:28.040 DEBUG:teuthology.orchestra.run.smithi132:> sudo echo -n http://smithi132.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-05-08T18:50:28.068 INFO:teuthology.orchestra.run.smithi132.stdout:http://smithi132.front.sepia.ceph.com:80 2024-05-08T18:50:28.069 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-05-08T18:50:28.135 INFO:tasks.rgw.client.0:Restarting daemon 2024-05-08T18:50:28.135 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-05-08T18:50:28.178 INFO:tasks.rgw.client.0:Started 2024-05-08T18:50:28.178 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi132.front.sepia.ceph.com:80/ 2024-05-08T18:50:28.178 DEBUG:teuthology.orchestra.run.smithi132:> curl http://smithi132.front.sepia.ceph.com:80/ 2024-05-08T18:50:28.226 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T18:50:28.226 INFO:teuthology.orchestra.run.smithi132.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:50:28.226 INFO:teuthology.orchestra.run.smithi132.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:50:28.226 INFO:teuthology.orchestra.run.smithi132.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T18:50:28.227 INFO:teuthology.orchestra.run.smithi132.stderr:curl: (7) Failed to connect to smithi132.front.sepia.ceph.com port 80: Connection refused 2024-05-08T18:50:29.228 DEBUG:teuthology.orchestra.run.smithi132:> curl http://smithi132.front.sepia.ceph.com:80/ 2024-05-08T18:50:29.252 INFO:teuthology.orchestra.run.smithi132.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:50:29.252 INFO:teuthology.orchestra.run.smithi132.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:50:29.254 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T18:50:29.254 INFO:teuthology.orchestra.run.smithi132.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T18:50:29.254 INFO:teuthology.orchestra.run.smithi132.stderr:curl: (7) Failed to connect to smithi132.front.sepia.ceph.com port 80: Connection refused 2024-05-08T18:50:31.255 DEBUG:teuthology.orchestra.run.smithi132:> curl http://smithi132.front.sepia.ceph.com:80/ 2024-05-08T18:50:31.279 INFO:teuthology.orchestra.run.smithi132.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:50:31.279 INFO:teuthology.orchestra.run.smithi132.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:50:31.279 INFO:teuthology.orchestra.run.smithi132.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T18:50:31.280 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T18:50:31.281 INFO:teuthology.orchestra.run.smithi132.stderr:curl: (7) Failed to connect to smithi132.front.sepia.ceph.com port 80: Connection refused 2024-05-08T18:50:35.281 DEBUG:teuthology.orchestra.run.smithi132:> curl http://smithi132.front.sepia.ceph.com:80/ 2024-05-08T18:50:35.305 INFO:teuthology.orchestra.run.smithi132.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:50:35.305 INFO:teuthology.orchestra.run.smithi132.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:50:35.307 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T18:50:35.307 INFO:teuthology.orchestra.run.smithi132.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T18:50:35.307 INFO:teuthology.orchestra.run.smithi132.stderr:curl: (7) Failed to connect to smithi132.front.sepia.ceph.com port 80: Connection refused 2024-05-08T18:50:37.205 INFO:tasks.rgw.client.0.smithi132.stdout:2024-05-08T18:50:37.205+0000 7fb8c2d46880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-05-08T18:50:43.309 DEBUG:teuthology.orchestra.run.smithi132:> curl http://smithi132.front.sepia.ceph.com:80/ 2024-05-08T18:50:43.331 INFO:teuthology.orchestra.run.smithi132.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:50:43.331 INFO:teuthology.orchestra.run.smithi132.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:50:43.333 INFO:teuthology.orchestra.run.smithi132.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-05-08T18:50:43.334 INFO:teuthology.orchestra.run.smithi132.stdout:anonymous 2024-05-08T18:50:43.334 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-05-08T18:50:43.412 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-05-08T18:50:43.412 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-05-08T18:50:43.413 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-05-08T18:50:43.413 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-05-08T18:50:43.462 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:43.462 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:43.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.463+0000 7fb4337af800 1 Processor -- start 2024-05-08T18:50:43.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.463+0000 7fb4337af800 1 -- start start 2024-05-08T18:50:43.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.464+0000 7fb4337af800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5575f3a96cc0 0x5575f3a990b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.464+0000 7fb4337af800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5575f3a9d100 con 0x5575f3a995f0 2024-05-08T18:50:43.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.464+0000 7fb4337af800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x5575f3936e20 con 0x5575f3a96cc0 2024-05-08T18:50:43.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.464+0000 7fb4312a7640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5575f3a96cc0 0x5575f3a990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.464+0000 7fb430aa6640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x5575f3a995f0 0x5575f3a9b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46646/0 (socket says 172.21.15.132:46646) 2024-05-08T18:50:43.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.464+0000 7fb430aa6640 1 -- 172.21.15.132:0/4009553394 learned_addr learned my addr 172.21.15.132:0/4009553394 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:50:43.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.465+0000 7fb423fff640 1 -- 172.21.15.132:0/4009553394 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2656151708 0 0) 0x5575f3a9d100 con 0x5575f3a995f0 2024-05-08T18:50:43.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.465+0000 7fb423fff640 1 -- 172.21.15.132:0/4009553394 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb41c001e10 con 0x5575f3a995f0 2024-05-08T18:50:43.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.465+0000 7fb4312a7640 1 -- 172.21.15.132:0/4009553394 >> v1:172.21.15.42:6789/0 conn(0x5575f3a995f0 legacy=0x5575f3a9b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.465+0000 7fb4312a7640 1 -- 172.21.15.132:0/4009553394 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575f3a9e2e0 con 0x5575f3a96cc0 2024-05-08T18:50:43.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.467+0000 7fb4312a7640 1 --2- 172.21.15.132:0/4009553394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3a96cc0 0x5575f3a990b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb424005fd0 tx=0x7fb42401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce385ad9f2cb3509 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.467+0000 7fb423fff640 1 -- 172.21.15.132:0/4009553394 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb424052560 con 0x5575f3a96cc0 2024-05-08T18:50:43.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.467+0000 7fb423fff640 1 -- 172.21.15.132:0/4009553394 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb424052700 con 0x5575f3a96cc0 2024-05-08T18:50:43.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.467+0000 7fb423fff640 1 -- 172.21.15.132:0/4009553394 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb424052a60 con 0x5575f3a96cc0 2024-05-08T18:50:43.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.467+0000 7fb4337af800 1 -- 172.21.15.132:0/4009553394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3a96cc0 msgr2=0x5575f3a990b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.467+0000 7fb4337af800 1 --2- 172.21.15.132:0/4009553394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3a96cc0 0x5575f3a990b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb424005fd0 tx=0x7fb42401cbe0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.467+0000 7fb4337af800 1 -- 172.21.15.132:0/4009553394 shutdown_connections 2024-05-08T18:50:43.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.467+0000 7fb4337af800 1 --2- 172.21.15.132:0/4009553394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3a96cc0 0x5575f3a990b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.467+0000 7fb4337af800 1 -- 172.21.15.132:0/4009553394 >> 172.21.15.132:0/4009553394 conn(0x5575f3a90710 msgr2=0x5575f3a92b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:43.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.467+0000 7fb4337af800 1 -- 172.21.15.132:0/4009553394 shutdown_connections 2024-05-08T18:50:43.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.467+0000 7fb4337af800 1 -- 172.21.15.132:0/4009553394 wait complete. 2024-05-08T18:50:43.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.483+0000 7fb4337af800 1 Processor -- start 2024-05-08T18:50:43.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.483+0000 7fb4337af800 1 -- start start 2024-05-08T18:50:43.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.483+0000 7fb4337af800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3a96cc0 0x5575f3a96600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.483+0000 7fb4337af800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5575f39e15a0 con 0x5575f3a96cc0 2024-05-08T18:50:43.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.484+0000 7fb4312a7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3a96cc0 0x5575f3a96600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.484+0000 7fb4312a7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3a96cc0 0x5575f3a96600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59300/0 (socket says 172.21.15.132:59300) 2024-05-08T18:50:43.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.484+0000 7fb4312a7640 1 -- 172.21.15.132:0/1760722849 learned_addr learned my addr 172.21.15.132:0/1760722849 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:43.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.484+0000 7fb4312a7640 1 -- 172.21.15.132:0/1760722849 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575f3a94bc0 con 0x5575f3a96cc0 2024-05-08T18:50:43.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.484+0000 7fb4312a7640 1 --2- 172.21.15.132:0/1760722849 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3a96cc0 0x5575f3a96600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb424007000 tx=0x7fb42404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bca4334e8dce0a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.485+0000 7fb31f606640 1 -- 172.21.15.132:0/1760722849 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4240529e0 con 0x5575f3a96cc0 2024-05-08T18:50:43.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.485+0000 7fb31f606640 1 -- 172.21.15.132:0/1760722849 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb424052b80 con 0x5575f3a96cc0 2024-05-08T18:50:43.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.485+0000 7fb31f606640 1 -- 172.21.15.132:0/1760722849 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb42405c430 con 0x5575f3a96cc0 2024-05-08T18:50:43.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.485+0000 7fb4337af800 1 -- 172.21.15.132:0/1760722849 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3a96cc0 msgr2=0x5575f3a96600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.485+0000 7fb4337af800 1 --2- 172.21.15.132:0/1760722849 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3a96cc0 0x5575f3a96600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb424007000 tx=0x7fb42404c000 comp rx=0 tx=0).stop 2024-05-08T18:50:43.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.485+0000 7fb4337af800 1 -- 172.21.15.132:0/1760722849 shutdown_connections 2024-05-08T18:50:43.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.485+0000 7fb4337af800 1 --2- 172.21.15.132:0/1760722849 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3a96cc0 0x5575f3a96600 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.485+0000 7fb4337af800 1 -- 172.21.15.132:0/1760722849 >> 172.21.15.132:0/1760722849 conn(0x5575f3a90710 msgr2=0x5575f3b82cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:43.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.485+0000 7fb4337af800 1 -- 172.21.15.132:0/1760722849 shutdown_connections 2024-05-08T18:50:43.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.485+0000 7fb4337af800 1 -- 172.21.15.132:0/1760722849 wait complete. 2024-05-08T18:50:43.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.486+0000 7fb4337af800 1 Processor -- start 2024-05-08T18:50:43.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.486+0000 7fb4337af800 1 -- start start 2024-05-08T18:50:43.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.486+0000 7fb4337af800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3a96cc0 0x5575f3b95480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.486+0000 7fb4337af800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5575f3a9d570 con 0x5575f3a96cc0 2024-05-08T18:50:43.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.486+0000 7fb4312a7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3a96cc0 0x5575f3b95480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.486+0000 7fb4312a7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3a96cc0 0x5575f3b95480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59316/0 (socket says 172.21.15.132:59316) 2024-05-08T18:50:43.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.486+0000 7fb4312a7640 1 -- 172.21.15.132:0/602845928 learned_addr learned my addr 172.21.15.132:0/602845928 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:43.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.487+0000 7fb4312a7640 1 -- 172.21.15.132:0/602845928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575f3b959c0 con 0x5575f3a96cc0 2024-05-08T18:50:43.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.487+0000 7fb4312a7640 1 --2- 172.21.15.132:0/602845928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3a96cc0 0x5575f3b95480 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb424007000 tx=0x7fb424003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.487+0000 7fb31de03640 1 -- 172.21.15.132:0/602845928 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb424074070 con 0x5575f3a96cc0 2024-05-08T18:50:43.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.487+0000 7fb31de03640 1 -- 172.21.15.132:0/602845928 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42406f430 con 0x5575f3a96cc0 2024-05-08T18:50:43.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.487+0000 7fb4337af800 1 -- 172.21.15.132:0/602845928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5575f3b95c50 con 0x5575f3a96cc0 2024-05-08T18:50:43.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.487+0000 7fb31de03640 1 -- 172.21.15.132:0/602845928 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb42406f750 con 0x5575f3a96cc0 2024-05-08T18:50:43.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.487+0000 7fb4337af800 1 -- 172.21.15.132:0/602845928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575f3b98900 con 0x5575f3a96cc0 2024-05-08T18:50:43.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.488+0000 7fb31de03640 1 -- 172.21.15.132:0/602845928 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb4240663f0 con 0x5575f3a96cc0 2024-05-08T18:50:43.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.488+0000 7fb31de03640 1 --2- 172.21.15.132:0/602845928 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb31803bba0 0x7fb31803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.488+0000 7fb31de03640 1 -- 172.21.15.132:0/602845928 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fb42406c050 con 0x5575f3a96cc0 2024-05-08T18:50:43.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.488+0000 7fb430aa6640 1 --2- 172.21.15.132:0/602845928 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb31803bba0 0x7fb31803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.489+0000 7fb4337af800 1 --2- 172.21.15.132:0/602845928 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5575f3a995f0 0x5575f3b9c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.489+0000 7fb4337af800 1 -- 172.21.15.132:0/602845928 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5575f3b9cca0 con 0x5575f3a995f0 2024-05-08T18:50:43.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.489+0000 7fb431aa8640 1 --2- 172.21.15.132:0/602845928 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5575f3a995f0 0x5575f3b9c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.489+0000 7fb430aa6640 1 --2- 172.21.15.132:0/602845928 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb31803bba0 0x7fb31803e060 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb428000f60 tx=0x7fb4280010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.489+0000 7fb431aa8640 1 --2- 172.21.15.132:0/602845928 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5575f3a995f0 0x5575f3b9c720 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.489+0000 7fb431aa8640 1 -- 172.21.15.132:0/602845928 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb42c0083e0 con 0x5575f3a995f0 2024-05-08T18:50:43.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.489+0000 7fb4337af800 1 -- 172.21.15.132:0/602845928 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5575f3b99cb0 con 0x5575f3a995f0 2024-05-08T18:50:43.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.490+0000 7fb431aa8640 1 -- 172.21.15.132:0/602845928 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb42c0083e0 con 0x5575f3a995f0 2024-05-08T18:50:43.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.490+0000 7fb4337af800 1 --2- 172.21.15.132:0/602845928 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5575f3b9ef70 0x5575f3ba1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.490+0000 7fb4337af800 1 -- 172.21.15.132:0/602845928 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5575f3ba1a30 con 0x5575f3b9ef70 2024-05-08T18:50:43.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.490+0000 7fb4312a7640 1 --2- 172.21.15.132:0/602845928 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5575f3b9ef70 0x5575f3ba1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.490+0000 7fb4312a7640 1 --2- 172.21.15.132:0/602845928 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5575f3b9ef70 0x5575f3ba1360 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.490+0000 7fb4312a7640 1 -- 172.21.15.132:0/602845928 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb424064070 con 0x5575f3b9ef70 2024-05-08T18:50:43.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.490+0000 7fb4337af800 1 -- 172.21.15.132:0/602845928 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5575f3b9dde0 con 0x5575f3a995f0 2024-05-08T18:50:43.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.491+0000 7fb431aa8640 1 -- 172.21.15.132:0/602845928 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb42c0083e0 con 0x5575f3a995f0 2024-05-08T18:50:43.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.491+0000 7fb4337af800 1 -- 172.21.15.132:0/602845928 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5575f3b9e250 con 0x5575f3a995f0 2024-05-08T18:50:43.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.491+0000 7fb431aa8640 1 -- 172.21.15.132:0/602845928 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb42c0083e0 con 0x5575f3a995f0 2024-05-08T18:50:43.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.491+0000 7fb4337af800 1 Processor -- start 2024-05-08T18:50:43.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.491+0000 7fb4337af800 1 -- start start 2024-05-08T18:50:43.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.491+0000 7fb4337af800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3bb0990 0x5575f3bb0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.492+0000 7fb4337af800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5575f3987fc0 con 0x5575f3bb0990 2024-05-08T18:50:43.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.492+0000 7fb431aa8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3bb0990 0x5575f3bb0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.492+0000 7fb431aa8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3bb0990 0x5575f3bb0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59318/0 (socket says 172.21.15.132:59318) 2024-05-08T18:50:43.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.492+0000 7fb431aa8640 1 -- 172.21.15.132:0/401566882 learned_addr learned my addr 172.21.15.132:0/401566882 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:43.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.492+0000 7fb431aa8640 1 -- 172.21.15.132:0/401566882 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575f3bb12f0 con 0x5575f3bb0990 2024-05-08T18:50:43.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.493+0000 7fb431aa8640 1 --2- 172.21.15.132:0/401566882 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3bb0990 0x5575f3bb0db0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x5575f3b96530 tx=0x7fb42c00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.493+0000 7fb316ffd640 1 -- 172.21.15.132:0/401566882 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb42c007d00 con 0x5575f3bb0990 2024-05-08T18:50:43.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.493+0000 7fb316ffd640 1 -- 172.21.15.132:0/401566882 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42c01e020 con 0x5575f3bb0990 2024-05-08T18:50:43.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.493+0000 7fb4337af800 1 -- 172.21.15.132:0/401566882 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5575f3bb1d60 con 0x5575f3bb0990 2024-05-08T18:50:43.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.493+0000 7fb316ffd640 1 -- 172.21.15.132:0/401566882 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb42c019420 con 0x5575f3bb0990 2024-05-08T18:50:43.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.493+0000 7fb4337af800 1 -- 172.21.15.132:0/401566882 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575f3bb2260 con 0x5575f3bb0990 2024-05-08T18:50:43.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.494+0000 7fb316ffd640 1 -- 172.21.15.132:0/401566882 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb42c016040 con 0x5575f3bb0990 2024-05-08T18:50:43.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.494+0000 7fb316ffd640 1 --2- 172.21.15.132:0/401566882 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb30803bba0 0x7fb30803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.494+0000 7fb316ffd640 1 -- 172.21.15.132:0/401566882 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fb42c01f030 con 0x5575f3bb0990 2024-05-08T18:50:43.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.494+0000 7fb4312a7640 1 --2- 172.21.15.132:0/401566882 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb30803bba0 0x7fb30803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.494+0000 7fb4337af800 1 Processor -- start 2024-05-08T18:50:43.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.494+0000 7fb4312a7640 1 --2- 172.21.15.132:0/401566882 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb30803bba0 0x7fb30803e060 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb424051f40 tx=0x7fb424052aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.494+0000 7fb4337af800 1 -- start start 2024-05-08T18:50:43.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.495+0000 7fb4337af800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3bbdcd0 0x5575f3bbe0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.495+0000 7fb4337af800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5575f3a94e80 con 0x5575f3bbdcd0 2024-05-08T18:50:43.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.495+0000 7fb431aa8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3bbdcd0 0x5575f3bbe0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.495+0000 7fb431aa8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3bbdcd0 0x5575f3bbe0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59320/0 (socket says 172.21.15.132:59320) 2024-05-08T18:50:43.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.495+0000 7fb431aa8640 1 -- 172.21.15.132:0/3699755606 learned_addr learned my addr 172.21.15.132:0/3699755606 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:43.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.495+0000 7fb431aa8640 1 -- 172.21.15.132:0/3699755606 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575f3bbe6c0 con 0x5575f3bbdcd0 2024-05-08T18:50:43.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.496+0000 7fb431aa8640 1 --2- 172.21.15.132:0/3699755606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3bbdcd0 0x5575f3bbe0f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb42c052bf0 tx=0x7fb42c015e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fbbaf79570da07a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.496+0000 7fb314ff9640 1 -- 172.21.15.132:0/3699755606 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb42c01d040 con 0x5575f3bbdcd0 2024-05-08T18:50:43.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.496+0000 7fb314ff9640 1 -- 172.21.15.132:0/3699755606 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42c0183b0 con 0x5575f3bbdcd0 2024-05-08T18:50:43.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.496+0000 7fb314ff9640 1 -- 172.21.15.132:0/3699755606 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb42c0173b0 con 0x5575f3bbdcd0 2024-05-08T18:50:43.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.496+0000 7fb4337af800 1 -- 172.21.15.132:0/3699755606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3bbdcd0 msgr2=0x5575f3bbe0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.496+0000 7fb4337af800 1 --2- 172.21.15.132:0/3699755606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3bbdcd0 0x5575f3bbe0f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb42c052bf0 tx=0x7fb42c015e60 comp rx=0 tx=0).stop 2024-05-08T18:50:43.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.496+0000 7fb4337af800 1 -- 172.21.15.132:0/3699755606 shutdown_connections 2024-05-08T18:50:43.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.496+0000 7fb4337af800 1 --2- 172.21.15.132:0/3699755606 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3bbdcd0 0x5575f3bbe0f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.496+0000 7fb4337af800 1 -- 172.21.15.132:0/3699755606 >> 172.21.15.132:0/3699755606 conn(0x5575f3bb9fe0 msgr2=0x5575f3bb8090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:43.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.496+0000 7fb4337af800 1 -- 172.21.15.132:0/3699755606 shutdown_connections 2024-05-08T18:50:43.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.496+0000 7fb4337af800 1 -- 172.21.15.132:0/3699755606 wait complete. 2024-05-08T18:50:43.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.497+0000 7fb4337af800 1 Processor -- start 2024-05-08T18:50:43.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.497+0000 7fb4337af800 1 -- start start 2024-05-08T18:50:43.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.497+0000 7fb4337af800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3bbdcd0 0x5575f3bc51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.497+0000 7fb4337af800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5575f3bbee90 con 0x5575f3bbdcd0 2024-05-08T18:50:43.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.497+0000 7fb431aa8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3bbdcd0 0x5575f3bc51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.497+0000 7fb431aa8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3bbdcd0 0x5575f3bc51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59330/0 (socket says 172.21.15.132:59330) 2024-05-08T18:50:43.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.497+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 learned_addr learned my addr 172.21.15.132:0/1244327930 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:43.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.497+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575f3bc5730 con 0x5575f3bbdcd0 2024-05-08T18:50:43.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.498+0000 7fb431aa8640 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3bbdcd0 0x5575f3bc51f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb42c015ea0 tx=0x7fb42c052b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.498+0000 7fb306ffd640 1 -- 172.21.15.132:0/1244327930 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb42c01d040 con 0x5575f3bbdcd0 2024-05-08T18:50:43.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.498+0000 7fb306ffd640 1 -- 172.21.15.132:0/1244327930 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42c031020 con 0x5575f3bbdcd0 2024-05-08T18:50:43.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.498+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5575f3bc5730 con 0x5575f3bbdcd0 2024-05-08T18:50:43.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.498+0000 7fb306ffd640 1 -- 172.21.15.132:0/1244327930 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb42c016e60 con 0x5575f3bbdcd0 2024-05-08T18:50:43.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.498+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575f3bc5730 con 0x5575f3bbdcd0 2024-05-08T18:50:43.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.499+0000 7fb306ffd640 1 -- 172.21.15.132:0/1244327930 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb42c0153e0 con 0x5575f3bbdcd0 2024-05-08T18:50:43.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.499+0000 7fb306ffd640 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb2fc03bab0 0x7fb2fc03df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.499+0000 7fb306ffd640 1 -- 172.21.15.132:0/1244327930 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fb42c032030 con 0x5575f3bbdcd0 2024-05-08T18:50:43.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.499+0000 7fb4337af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.499+0000 7fb4312a7640 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb2fc03bab0 0x7fb2fc03df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.499+0000 7fb4337af800 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5575f3bd0940 0x5575f3bd2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.499+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd3550 con 0x5575f3bd0940 2024-05-08T18:50:43.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.499+0000 7fb430aa6640 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5575f3bd0940 0x5575f3bd2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.500+0000 7fb4312a7640 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb2fc03bab0 0x7fb2fc03df70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb424092ec0 tx=0x7fb424087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.500+0000 7fb430aa6640 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5575f3bd0940 0x5575f3bd2e00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.500+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb428009050 con 0x5575f3bd0940 2024-05-08T18:50:43.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.500+0000 7fb4337af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.500+0000 7fb4337af800 20 realm 2024-05-08T18:50:43.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.500+0000 7fb4337af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.500+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bcfe10 con 0x5575f3bd0940 2024-05-08T18:50:43.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.500+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb428009050 con 0x5575f3bd0940 2024-05-08T18:50:43.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.500+0000 7fb4337af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.500+0000 7fb4337af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:43.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.500+0000 7fb4337af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.500+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd4050 con 0x5575f3bd0940 2024-05-08T18:50:43.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.501+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb428009050 con 0x5575f3bd0940 2024-05-08T18:50:43.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.501+0000 7fb4337af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.501+0000 7fb4337af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.501+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd4920 con 0x5575f3bd0940 2024-05-08T18:50:43.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.501+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb428009050 con 0x5575f3bd0940 2024-05-08T18:50:43.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.501+0000 7fb4337af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:43.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.501+0000 7fb4337af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.501+0000 7fb4337af800 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5575f3bd5220 0x5575f3bd7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.501+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x5575f3bd5220 2024-05-08T18:50:43.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.501+0000 7fb431aa8640 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5575f3bd5220 0x5575f3bd7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.501+0000 7fb431aa8640 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5575f3bd5220 0x5575f3bd7610 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.502+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb42c04e040 con 0x5575f3bd5220 2024-05-08T18:50:43.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.502+0000 7fb4337af800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:43.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.502+0000 7fb4337af800 20 searching for the correct realm 2024-05-08T18:50:43.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.502+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd9720 con 0x5575f3bd5220 2024-05-08T18:50:43.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.502+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42c04e040 con 0x5575f3bd5220 2024-05-08T18:50:43.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.502+0000 7fb431aa8640 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb42c019040 0x7fb42c02c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.502+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x7fb42c019040 2024-05-08T18:50:43.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.502+0000 7fb4312a7640 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb42c019040 0x7fb42c02c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.503+0000 7fb4312a7640 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb42c019040 0x7fb42c02c840 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.503+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb424082040 con 0x7fb42c019040 2024-05-08T18:50:43.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.503+0000 7fb4312a7640 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb4240923c0 0x7fb42406e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.503+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x7fb4240923c0 2024-05-08T18:50:43.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.503+0000 7fb430aa6640 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb4240923c0 0x7fb42406e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.504+0000 7fb430aa6640 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb4240923c0 0x7fb42406e8d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.504+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428009050 con 0x7fb4240923c0 2024-05-08T18:50:43.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.504+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x5575f3bd0940 2024-05-08T18:50:43.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.504+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428009050 con 0x5575f3bd0940 2024-05-08T18:50:43.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.504+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x5575f3bd0940 2024-05-08T18:50:43.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.505+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428029040 con 0x5575f3bd0940 2024-05-08T18:50:43.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.505+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x7fb4240923c0 2024-05-08T18:50:43.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.505+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428029040 con 0x7fb4240923c0 2024-05-08T18:50:43.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.505+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x7fb4240923c0 2024-05-08T18:50:43.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.505+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428029040 con 0x7fb4240923c0 2024-05-08T18:50:43.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.505+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x7fb42c019040 2024-05-08T18:50:43.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.506+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb424082040 con 0x7fb42c019040 2024-05-08T18:50:43.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.506+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x5575f3bd5220 2024-05-08T18:50:43.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.506+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42c04e040 con 0x5575f3bd5220 2024-05-08T18:50:43.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.506+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x5575f3bd0940 2024-05-08T18:50:43.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.506+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428029040 con 0x5575f3bd0940 2024-05-08T18:50:43.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.506+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x7fb4240923c0 2024-05-08T18:50:43.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.506+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428029040 con 0x7fb4240923c0 2024-05-08T18:50:43.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.507+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x5575f3bd0940 2024-05-08T18:50:43.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.507+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb428029040 con 0x5575f3bd0940 2024-05-08T18:50:43.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.507+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x7fb42c019040 2024-05-08T18:50:43.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.507+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb424082040 con 0x7fb42c019040 2024-05-08T18:50:43.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.507+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x5575f3bd5220 2024-05-08T18:50:43.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.507+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v18'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb42c04e040 con 0x5575f3bd5220 2024-05-08T18:50:43.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.507+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x5575f3bd5220 2024-05-08T18:50:43.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.508+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42c04e040 con 0x5575f3bd5220 2024-05-08T18:50:43.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.508+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x7fb4240923c0 2024-05-08T18:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.508+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428029040 con 0x7fb4240923c0 2024-05-08T18:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.508+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x5575f3bd5220 2024-05-08T18:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.508+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42c04e040 con 0x5575f3bd5220 2024-05-08T18:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.508+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x5575f3bd5220 2024-05-08T18:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.508+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42c04e040 con 0x5575f3bd5220 2024-05-08T18:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.508+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x5575f3bd0940 2024-05-08T18:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.509+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428029040 con 0x5575f3bd0940 2024-05-08T18:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.509+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x5575f3bd0940 2024-05-08T18:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.509+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb428029040 con 0x5575f3bd0940 2024-05-08T18:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.509+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x7fb4240923c0 2024-05-08T18:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.509+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428029040 con 0x7fb4240923c0 2024-05-08T18:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.509+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x5575f3bd5220 2024-05-08T18:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.510+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42c06a040 con 0x5575f3bd5220 2024-05-08T18:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.510+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x7fb42c019040 2024-05-08T18:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.510+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb424082040 con 0x7fb42c019040 2024-05-08T18:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.510+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x5575f3bd0940 2024-05-08T18:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.510+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428029040 con 0x5575f3bd0940 2024-05-08T18:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.510+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x7fb4240923c0 2024-05-08T18:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.511+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428029040 con 0x7fb4240923c0 2024-05-08T18:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.511+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x5575f3bd5220 2024-05-08T18:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.511+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42c06a040 con 0x5575f3bd5220 2024-05-08T18:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.511+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x7fb4240923c0 2024-05-08T18:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.511+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428029040 con 0x7fb4240923c0 2024-05-08T18:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.511+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x7fb42c019040 2024-05-08T18:50:43.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.511+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb424082040 con 0x7fb42c019040 2024-05-08T18:50:43.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.511+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x5575f3bd5220 2024-05-08T18:50:43.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.512+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42c06a040 con 0x5575f3bd5220 2024-05-08T18:50:43.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.512+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd7d50 con 0x7fb4240923c0 2024-05-08T18:50:43.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.512+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428029040 con 0x7fb4240923c0 2024-05-08T18:50:43.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.512+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fb42803a040 con 0x5575f3bd0940 2024-05-08T18:50:43.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.512+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb428029040 con 0x5575f3bd0940 2024-05-08T18:50:43.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.513+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fb42803a040 con 0x7fb42c019040 2024-05-08T18:50:43.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.513+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb424082040 con 0x7fb42c019040 2024-05-08T18:50:43.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.513+0000 7fb4337af800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:43.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.513+0000 7fb4337af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:43.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.513+0000 7fb4337af800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:43.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.513+0000 7fb4337af800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:43.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.513+0000 7fb4337af800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:43.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.513+0000 7fb4337af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:43.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.513+0000 7fb4337af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.513+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd86f0 con 0x5575f3bd0940 2024-05-08T18:50:43.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.513+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb428029040 con 0x5575f3bd0940 2024-05-08T18:50:43.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.513+0000 7fb4337af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.513+0000 7fb4337af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.513+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd8ae0 con 0x5575f3bd0940 2024-05-08T18:50:43.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.513+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb428029040 con 0x5575f3bd0940 2024-05-08T18:50:43.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.513+0000 7fb4337af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:43.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.513+0000 7fb4337af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.513+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd8f00 con 0x5575f3bd0940 2024-05-08T18:50:43.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.514+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb428029040 con 0x5575f3bd0940 2024-05-08T18:50:43.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.514+0000 7fb4337af800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:43.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.514+0000 7fb4337af800 20 zone default found 2024-05-08T18:50:43.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.514+0000 7fb4337af800 4 Realm: () 2024-05-08T18:50:43.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.514+0000 7fb4337af800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:43.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.514+0000 7fb4337af800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:43.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.514+0000 7fb4337af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:43.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.514+0000 7fb4337af800 20 zonegroup default 2024-05-08T18:50:43.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.514+0000 7fb4337af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.514+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd9330 con 0x7fb4240923c0 2024-05-08T18:50:43.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.514+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb428029040 con 0x7fb4240923c0 2024-05-08T18:50:43.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.514+0000 7fb4337af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.514+0000 7fb4337af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.514+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bdb5d0 con 0x5575f3bd5220 2024-05-08T18:50:43.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.514+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb42c06a040 con 0x5575f3bd5220 2024-05-08T18:50:43.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.515+0000 7fb4337af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.515+0000 7fb4337af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.515+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bdb970 con 0x5575f3bd5220 2024-05-08T18:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.515+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb42c06a040 con 0x5575f3bd5220 2024-05-08T18:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.515+0000 7fb4337af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.515+0000 7fb4337af800 20 started sync module instance, tier type = 2024-05-08T18:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.515+0000 7fb4337af800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.515+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bdaa70 con 0x7fb42c019040 2024-05-08T18:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.516+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb424082040 con 0x7fb42c019040 2024-05-08T18:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.516+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93965088826816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bdb970 con 0x7fb42c019040 2024-05-08T18:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.516+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bdc330 con 0x5575f3bd0940 2024-05-08T18:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.517+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93965088826816] v25'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb424082040 con 0x7fb42c019040 2024-05-08T18:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.517+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb428029040 con 0x5575f3bd0940 2024-05-08T18:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.517+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93965088833152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bdc2a0 con 0x5575f3bd0940 2024-05-08T18:50:43.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.517+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bdd1f0 con 0x5575f3bd5220 2024-05-08T18:50:43.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.520+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93965088833152] v25'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb428029040 con 0x5575f3bd0940 2024-05-08T18:50:43.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.523+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42c06a040 con 0x5575f3bd5220 2024-05-08T18:50:43.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.523+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93965088835360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bdd1f0 con 0x5575f3bd5220 2024-05-08T18:50:43.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.523+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bddc00 con 0x7fb42c019040 2024-05-08T18:50:43.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.524+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb424082040 con 0x7fb42c019040 2024-05-08T18:50:43.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.524+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93965088835360] v25'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42c06a040 con 0x5575f3bd5220 2024-05-08T18:50:43.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.524+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93965088839504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bde4d0 con 0x7fb42c019040 2024-05-08T18:50:43.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.524+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bdcd80 con 0x5575f3bd0940 2024-05-08T18:50:43.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.526+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb428029040 con 0x5575f3bd0940 2024-05-08T18:50:43.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.526+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93965088844432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bdf360 con 0x5575f3bd0940 2024-05-08T18:50:43.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.526+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bdfe50 con 0x7fb4240923c0 2024-05-08T18:50:43.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.526+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93965088839504] v25'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb424082040 con 0x7fb42c019040 2024-05-08T18:50:43.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.528+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93965088844432] v25'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb428029040 con 0x5575f3bd0940 2024-05-08T18:50:43.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.529+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb428029040 con 0x7fb4240923c0 2024-05-08T18:50:43.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.529+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93965088848160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bdeeb0 con 0x7fb4240923c0 2024-05-08T18:50:43.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.529+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3be06f0 con 0x7fb4240923c0 2024-05-08T18:50:43.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.531+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93965088848160] v25'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb428029040 con 0x7fb4240923c0 2024-05-08T18:50:43.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.531+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb428029040 con 0x7fb4240923c0 2024-05-08T18:50:43.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.531+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93965088841760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bdeeb0 con 0x7fb4240923c0 2024-05-08T18:50:43.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.531+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3be0d10 con 0x7fb4240923c0 2024-05-08T18:50:43.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.532+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93965088841760] v25'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb428029040 con 0x7fb4240923c0 2024-05-08T18:50:43.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.532+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb428029040 con 0x7fb4240923c0 2024-05-08T18:50:43.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.532+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93965088850272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3be0d10 con 0x7fb4240923c0 2024-05-08T18:50:43.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.532+0000 7fb4337af800 20 add_watcher() i=0 2024-05-08T18:50:43.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.532+0000 7fb4337af800 20 add_watcher() i=1 2024-05-08T18:50:43.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.532+0000 7fb4337af800 20 add_watcher() i=2 2024-05-08T18:50:43.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.532+0000 7fb4337af800 20 add_watcher() i=3 2024-05-08T18:50:43.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.532+0000 7fb4337af800 20 add_watcher() i=4 2024-05-08T18:50:43.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.532+0000 7fb4337af800 20 add_watcher() i=5 2024-05-08T18:50:43.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.532+0000 7fb4337af800 20 add_watcher() i=6 2024-05-08T18:50:43.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.533+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93965088850272] v25'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb428029040 con 0x7fb4240923c0 2024-05-08T18:50:43.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.533+0000 7fb4337af800 20 add_watcher() i=7 2024-05-08T18:50:43.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.533+0000 7fb4337af800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:43.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.533+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5575f3be4180 con 0x5575f3bd0940 2024-05-08T18:50:43.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.534+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb428029040 con 0x5575f3bd0940 2024-05-08T18:50:43.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.534+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93965088865024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3be0f10 con 0x5575f3bd0940 2024-05-08T18:50:43.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.536+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93965088865024] v25'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb428029040 con 0x5575f3bd0940 2024-05-08T18:50:43.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.536+0000 7fb2e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:43.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.536+0000 7fb4337af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:43.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.536+0000 7fb4337af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:43.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.536+0000 7fb4337af800 5 note: GC not initialized 2024-05-08T18:50:43.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.536+0000 7fb2e67e4640 20 reqs_thread_entry: start 2024-05-08T18:50:43.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.537+0000 7fb4337af800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:43.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.537+0000 7fb4337af800 20 Filter name: none 2024-05-08T18:50:43.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.537+0000 7fb257fff640 20 reqs_thread_entry: start 2024-05-08T18:50:43.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.537+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3c16d80 con 0x5575f3bd5220 2024-05-08T18:50:43.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.537+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(62 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42c06a040 con 0x5575f3bd5220 2024-05-08T18:50:43.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.537+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bdb5d0 con 0x5575f3bd5220 2024-05-08T18:50:43.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.538+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(63 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42c06a040 con 0x5575f3bd5220 2024-05-08T18:50:43.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.538+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bdb5d0 con 0x5575f3bd0940 2024-05-08T18:50:43.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.538+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(64 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428029040 con 0x5575f3bd0940 2024-05-08T18:50:43.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.538+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd8ae0 con 0x5575f3bd0940 2024-05-08T18:50:43.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.538+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428043040 con 0x5575f3bd0940 2024-05-08T18:50:43.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.538+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd8ae0 con 0x7fb42c019040 2024-05-08T18:50:43.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.538+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(66 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb424082040 con 0x7fb42c019040 2024-05-08T18:50:43.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.538+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bde4d0 con 0x5575f3bd5220 2024-05-08T18:50:43.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.539+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(67 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42c06a040 con 0x5575f3bd5220 2024-05-08T18:50:43.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.539+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bde4d0 con 0x5575f3bd0940 2024-05-08T18:50:43.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.539+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428043040 con 0x5575f3bd0940 2024-05-08T18:50:43.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.539+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bde4d0 con 0x5575f3bd5220 2024-05-08T18:50:43.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.539+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(69 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42c06a040 con 0x5575f3bd5220 2024-05-08T18:50:43.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.539+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bde4d0 con 0x7fb42c019040 2024-05-08T18:50:43.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.539+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(70 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb424082040 con 0x7fb42c019040 2024-05-08T18:50:43.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.539+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bde4d0 con 0x5575f3bd5220 2024-05-08T18:50:43.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.539+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(71 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42c06a040 con 0x5575f3bd5220 2024-05-08T18:50:43.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.540+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bde4d0 con 0x5575f3bd0940 2024-05-08T18:50:43.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.540+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(72 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428043040 con 0x5575f3bd0940 2024-05-08T18:50:43.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.540+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bde4d0 con 0x7fb4240923c0 2024-05-08T18:50:43.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.540+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(73 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428043040 con 0x7fb4240923c0 2024-05-08T18:50:43.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.540+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fb428048040 con 0x7fb4240923c0 2024-05-08T18:50:43.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.541+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(74 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428043040 con 0x7fb4240923c0 2024-05-08T18:50:43.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.541+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fb428048040 con 0x5575f3bd5220 2024-05-08T18:50:43.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.541+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(75 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42c06a040 con 0x5575f3bd5220 2024-05-08T18:50:43.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.541+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fb428048040 con 0x7fb4240923c0 2024-05-08T18:50:43.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.541+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(76 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428043040 con 0x7fb4240923c0 2024-05-08T18:50:43.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.541+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fb428048040 con 0x7fb4240923c0 2024-05-08T18:50:43.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.542+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(77 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428043040 con 0x7fb4240923c0 2024-05-08T18:50:43.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.542+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fb428048040 con 0x7fb4240923c0 2024-05-08T18:50:43.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.542+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(78 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428043040 con 0x7fb4240923c0 2024-05-08T18:50:43.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.542+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fb428048040 con 0x5575f3bd5220 2024-05-08T18:50:43.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.542+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(79 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42c06a040 con 0x5575f3bd5220 2024-05-08T18:50:43.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.542+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fb428048040 con 0x7fb42c019040 2024-05-08T18:50:43.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.543+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(80 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb424082040 con 0x7fb42c019040 2024-05-08T18:50:43.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.543+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fb428048040 con 0x5575f3bd0940 2024-05-08T18:50:43.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.543+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(81 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428043040 con 0x5575f3bd0940 2024-05-08T18:50:43.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.543+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fb428048040 con 0x5575f3bd0940 2024-05-08T18:50:43.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.543+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(82 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428043040 con 0x5575f3bd0940 2024-05-08T18:50:43.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.543+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fb428048040 con 0x5575f3bd5220 2024-05-08T18:50:43.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.543+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(83 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42c06a040 con 0x5575f3bd5220 2024-05-08T18:50:43.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.543+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fb428048040 con 0x7fb42c019040 2024-05-08T18:50:43.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.544+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(84 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb424082040 con 0x7fb42c019040 2024-05-08T18:50:43.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.544+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fb428048040 con 0x7fb4240923c0 2024-05-08T18:50:43.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.544+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(85 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428043040 con 0x7fb4240923c0 2024-05-08T18:50:43.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.544+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fb428048040 con 0x5575f3bd0940 2024-05-08T18:50:43.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.544+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(86 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428043040 con 0x5575f3bd0940 2024-05-08T18:50:43.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.544+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fb428048040 con 0x7fb4240923c0 2024-05-08T18:50:43.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.544+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(87 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428043040 con 0x7fb4240923c0 2024-05-08T18:50:43.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.544+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fb428048040 con 0x5575f3bd5220 2024-05-08T18:50:43.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.545+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(88 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42c06a040 con 0x5575f3bd5220 2024-05-08T18:50:43.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.545+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fb428048040 con 0x7fb42c019040 2024-05-08T18:50:43.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.545+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(89 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb424082040 con 0x7fb42c019040 2024-05-08T18:50:43.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.545+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fb428048040 con 0x7fb4240923c0 2024-05-08T18:50:43.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.545+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(90 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428043040 con 0x7fb4240923c0 2024-05-08T18:50:43.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.545+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fb428048040 con 0x5575f3bd0940 2024-05-08T18:50:43.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.546+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(91 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb428043040 con 0x5575f3bd0940 2024-05-08T18:50:43.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.546+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fb428048040 con 0x5575f3bd5220 2024-05-08T18:50:43.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.546+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(92 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb42c06a040 con 0x5575f3bd5220 2024-05-08T18:50:43.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.546+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fb428048040 con 0x7fb42c019040 2024-05-08T18:50:43.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.546+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(93 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb424082040 con 0x7fb42c019040 2024-05-08T18:50:43.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.547+0000 7fb2e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:43.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.547+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93965088865024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bdb5d0 con 0x5575f3bd0940 2024-05-08T18:50:43.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.548+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93965088865024] v25'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb428043040 con 0x5575f3bd0940 2024-05-08T18:50:43.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.548+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93965088826816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bde4d0 con 0x7fb42c019040 2024-05-08T18:50:43.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.554+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93965088826816] v25'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb424082040 con 0x7fb42c019040 2024-05-08T18:50:43.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.554+0000 7fb4337af800 20 remove_watcher() i=0 2024-05-08T18:50:43.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.554+0000 7fb4337af800 2 removed watcher, disabling cache 2024-05-08T18:50:43.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.554+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93965088833152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd8ae0 con 0x5575f3bd0940 2024-05-08T18:50:43.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.555+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93965088833152] v25'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb428043040 con 0x5575f3bd0940 2024-05-08T18:50:43.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.555+0000 7fb4337af800 20 remove_watcher() i=1 2024-05-08T18:50:43.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.555+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93965088835360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bd8ae0 con 0x5575f3bd5220 2024-05-08T18:50:43.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.557+0000 7fb431aa8640 1 -- 172.21.15.132:0/1244327930 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93965088835360] v25'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb42c06a040 con 0x5575f3bd5220 2024-05-08T18:50:43.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.557+0000 7fb4337af800 20 remove_watcher() i=2 2024-05-08T18:50:43.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.557+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93965088839504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bde4d0 con 0x7fb42c019040 2024-05-08T18:50:43.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.558+0000 7fb4312a7640 1 -- 172.21.15.132:0/1244327930 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93965088839504] v25'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb424082040 con 0x7fb42c019040 2024-05-08T18:50:43.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.558+0000 7fb4337af800 20 remove_watcher() i=3 2024-05-08T18:50:43.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.558+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93965088844432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bde4d0 con 0x5575f3bd0940 2024-05-08T18:50:43.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.559+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.1 v2:172.21.15.132:6800/3697320277 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93965088844432] v25'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb428043040 con 0x5575f3bd0940 2024-05-08T18:50:43.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.559+0000 7fb4337af800 20 remove_watcher() i=4 2024-05-08T18:50:43.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.559+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93965088848160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bde4d0 con 0x7fb4240923c0 2024-05-08T18:50:43.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.561+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93965088848160] v25'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb428043040 con 0x7fb4240923c0 2024-05-08T18:50:43.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.561+0000 7fb4337af800 20 remove_watcher() i=5 2024-05-08T18:50:43.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.561+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93965088841760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bde4d0 con 0x7fb4240923c0 2024-05-08T18:50:43.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.562+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93965088841760] v25'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb428043040 con 0x7fb4240923c0 2024-05-08T18:50:43.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.562+0000 7fb4337af800 20 remove_watcher() i=6 2024-05-08T18:50:43.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.562+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93965088850272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5575f3bda5c0 con 0x7fb4240923c0 2024-05-08T18:50:43.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.563+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93965088850272] v25'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb428043040 con 0x7fb4240923c0 2024-05-08T18:50:43.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.563+0000 7fb4337af800 20 remove_watcher() i=7 2024-05-08T18:50:43.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.563+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb4240923c0 msgr2=0x7fb42406e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.563+0000 7fb4337af800 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb4240923c0 0x7fb42406e8d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.563+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5575f3bd0940 msgr2=0x5575f3bd2e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.563+0000 7fb4337af800 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5575f3bd0940 0x5575f3bd2e00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.563+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb42c019040 msgr2=0x7fb42c02c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.563+0000 7fb4337af800 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb42c019040 0x7fb42c02c840 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.563+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5575f3bd5220 msgr2=0x5575f3bd7610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.563+0000 7fb4337af800 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5575f3bd5220 0x5575f3bd7610 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.563+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb2fc03bab0 msgr2=0x7fb2fc03df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.563+0000 7fb4337af800 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb2fc03bab0 0x7fb2fc03df70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb424092ec0 tx=0x7fb424087000 comp rx=0 tx=0).stop 2024-05-08T18:50:43.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.563+0000 7fb430aa6640 1 -- 172.21.15.132:0/1244327930 reap_dead start 2024-05-08T18:50:43.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.563+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3bbdcd0 msgr2=0x5575f3bc51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.563+0000 7fb4337af800 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3bbdcd0 0x5575f3bc51f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb42c015ea0 tx=0x7fb42c052b50 comp rx=0 tx=0).stop 2024-05-08T18:50:43.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.563+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 shutdown_connections 2024-05-08T18:50:43.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.563+0000 7fb4337af800 1 --2- 172.21.15.132:0/1244327930 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3bbdcd0 0x5575f3bc51f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.563+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 >> 172.21.15.132:0/1244327930 conn(0x5575f3bb9fe0 msgr2=0x5575f3bb7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:43.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.563+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 shutdown_connections 2024-05-08T18:50:43.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.563+0000 7fb4337af800 1 -- 172.21.15.132:0/1244327930 wait complete. 2024-05-08T18:50:43.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 -- 172.21.15.132:0/401566882 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb30803bba0 msgr2=0x7fb30803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 --2- 172.21.15.132:0/401566882 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb30803bba0 0x7fb30803e060 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb424051f40 tx=0x7fb424052aa0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 -- 172.21.15.132:0/401566882 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3bb0990 msgr2=0x5575f3bb0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 --2- 172.21.15.132:0/401566882 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3bb0990 0x5575f3bb0db0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x5575f3b96530 tx=0x7fb42c00aec0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 -- 172.21.15.132:0/401566882 shutdown_connections 2024-05-08T18:50:43.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 --2- 172.21.15.132:0/401566882 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb30803bba0 0x7fb30803e060 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 --2- 172.21.15.132:0/401566882 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3bb0990 0x5575f3bb0db0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 -- 172.21.15.132:0/401566882 >> 172.21.15.132:0/401566882 conn(0x5575f3ba4a30 msgr2=0x5575f3ba4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:43.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 -- 172.21.15.132:0/401566882 shutdown_connections 2024-05-08T18:50:43.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 -- 172.21.15.132:0/401566882 wait complete. 2024-05-08T18:50:43.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 -- 172.21.15.132:0/602845928 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5575f3a995f0 msgr2=0x5575f3b9c720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 --2- 172.21.15.132:0/602845928 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5575f3a995f0 0x5575f3b9c720 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 -- 172.21.15.132:0/602845928 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5575f3b9ef70 msgr2=0x5575f3ba1360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 --2- 172.21.15.132:0/602845928 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5575f3b9ef70 0x5575f3ba1360 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 -- 172.21.15.132:0/602845928 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb31803bba0 msgr2=0x7fb31803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 --2- 172.21.15.132:0/602845928 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb31803bba0 0x7fb31803e060 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb428000f60 tx=0x7fb4280010a0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 -- 172.21.15.132:0/602845928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3a96cc0 msgr2=0x5575f3b95480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 --2- 172.21.15.132:0/602845928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3a96cc0 0x5575f3b95480 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb424007000 tx=0x7fb424003330 comp rx=0 tx=0).stop 2024-05-08T18:50:43.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 -- 172.21.15.132:0/602845928 shutdown_connections 2024-05-08T18:50:43.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 --2- 172.21.15.132:0/602845928 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5575f3b9ef70 0x5575f3ba1360 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 --2- 172.21.15.132:0/602845928 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5575f3a995f0 0x5575f3b9c720 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 --2- 172.21.15.132:0/602845928 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb31803bba0 0x7fb31803e060 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 --2- 172.21.15.132:0/602845928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5575f3a96cc0 0x5575f3b95480 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 -- 172.21.15.132:0/602845928 >> 172.21.15.132:0/602845928 conn(0x5575f3a90710 msgr2=0x5575f3a953e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:43.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 -- 172.21.15.132:0/602845928 shutdown_connections 2024-05-08T18:50:43.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.564+0000 7fb4337af800 1 -- 172.21.15.132:0/602845928 wait complete. 2024-05-08T18:50:43.574 INFO:teuthology.orchestra.run.smithi132.stdout:[] 2024-05-08T18:50:43.574 DEBUG:tasks.util.rgw: json result: [] 2024-05-08T18:50:43.574 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-05-08T18:50:43.574 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-05-08T18:50:43.575 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-05-08T18:50:43.618 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:43.619 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.620+0000 7f7b53f33800 1 Processor -- start 2024-05-08T18:50:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.620+0000 7f7b53f33800 1 -- start start 2024-05-08T18:50:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.620+0000 7f7b53f33800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55fb7d2a6a70 0x55fb7d33b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.620+0000 7f7b53f33800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fb7d2a6fb0 con 0x55fb7d2a7e00 2024-05-08T18:50:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.620+0000 7f7b53f33800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55fb7d1d2e20 con 0x55fb7d2a6a70 2024-05-08T18:50:43.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.620+0000 7f7b4f4ea640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55fb7d2a6a70 0x55fb7d33b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.620+0000 7f7b4f4ea640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55fb7d2a6a70 0x55fb7d33b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59338/0 (socket says 172.21.15.132:59338) 2024-05-08T18:50:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.620+0000 7f7b4fceb640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55fb7d2a7e00 0x55fb7d2a6360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46648/0 (socket says 172.21.15.132:46648) 2024-05-08T18:50:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.620+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/2989002661 learned_addr learned my addr 172.21.15.132:0/2989002661 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.621+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/2989002661 >> v1:172.21.15.42:6789/0 conn(0x55fb7d2a7e00 legacy=0x55fb7d2a6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.621+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/2989002661 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb7d2a7180 con 0x55fb7d2a6a70 2024-05-08T18:50:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.623+0000 7f7b4f4ea640 1 --2- 172.21.15.132:0/2989002661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d2a6a70 0x55fb7d33b130 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400a520 tx=0x7f7b4401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42dbe8495b6fcb47 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.623+0000 7f7b4ece9640 1 -- 172.21.15.132:0/2989002661 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b44057070 con 0x55fb7d2a6a70 2024-05-08T18:50:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.623+0000 7f7b4ece9640 1 -- 172.21.15.132:0/2989002661 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b44052570 con 0x55fb7d2a6a70 2024-05-08T18:50:43.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.623+0000 7f7b4ece9640 1 -- 172.21.15.132:0/2989002661 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b4404ae60 con 0x55fb7d2a6a70 2024-05-08T18:50:43.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.623+0000 7f7b53f33800 1 -- 172.21.15.132:0/2989002661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d2a6a70 msgr2=0x55fb7d33b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.623+0000 7f7b53f33800 1 --2- 172.21.15.132:0/2989002661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d2a6a70 0x55fb7d33b130 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400a520 tx=0x7f7b4401d010 comp rx=0 tx=0).stop 2024-05-08T18:50:43.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.623+0000 7f7b53f33800 1 -- 172.21.15.132:0/2989002661 shutdown_connections 2024-05-08T18:50:43.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.623+0000 7f7b53f33800 1 --2- 172.21.15.132:0/2989002661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d2a6a70 0x55fb7d33b130 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.623+0000 7f7b53f33800 1 -- 172.21.15.132:0/2989002661 >> 172.21.15.132:0/2989002661 conn(0x55fb7d32d830 msgr2=0x55fb7d32fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:43.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.623+0000 7f7b53f33800 1 -- 172.21.15.132:0/2989002661 shutdown_connections 2024-05-08T18:50:43.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.623+0000 7f7b53f33800 1 -- 172.21.15.132:0/2989002661 wait complete. 2024-05-08T18:50:43.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.637+0000 7f7b53f33800 1 Processor -- start 2024-05-08T18:50:43.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.637+0000 7f7b53f33800 1 -- start start 2024-05-08T18:50:43.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.637+0000 7f7b53f33800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d2a6a70 0x55fb7d425770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.637+0000 7f7b53f33800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fb7d27d5b0 con 0x55fb7d2a6a70 2024-05-08T18:50:43.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.637+0000 7f7b4fceb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d2a6a70 0x55fb7d425770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.637+0000 7f7b4fceb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d2a6a70 0x55fb7d425770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59342/0 (socket says 172.21.15.132:59342) 2024-05-08T18:50:43.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.637+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1469513166 learned_addr learned my addr 172.21.15.132:0/1469513166 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:43.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.638+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1469513166 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb7d425d40 con 0x55fb7d2a6a70 2024-05-08T18:50:43.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.638+0000 7f7b4fceb640 1 --2- 172.21.15.132:0/1469513166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d2a6a70 0x55fb7d425770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7b40001e60 tx=0x7f7b4000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e8f5bf57191277 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.638+0000 7f7a3de0b640 1 -- 172.21.15.132:0/1469513166 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b4000e5c0 con 0x55fb7d2a6a70 2024-05-08T18:50:43.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.638+0000 7f7a3de0b640 1 -- 172.21.15.132:0/1469513166 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b40006070 con 0x55fb7d2a6a70 2024-05-08T18:50:43.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.638+0000 7f7a3de0b640 1 -- 172.21.15.132:0/1469513166 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b4000e910 con 0x55fb7d2a6a70 2024-05-08T18:50:43.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.639+0000 7f7b53f33800 1 -- 172.21.15.132:0/1469513166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d2a6a70 msgr2=0x55fb7d425770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.639+0000 7f7b53f33800 1 --2- 172.21.15.132:0/1469513166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d2a6a70 0x55fb7d425770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7b40001e60 tx=0x7f7b4000b6c0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.639+0000 7f7b53f33800 1 -- 172.21.15.132:0/1469513166 shutdown_connections 2024-05-08T18:50:43.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.639+0000 7f7b53f33800 1 --2- 172.21.15.132:0/1469513166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d2a6a70 0x55fb7d425770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.639+0000 7f7b53f33800 1 -- 172.21.15.132:0/1469513166 >> 172.21.15.132:0/1469513166 conn(0x55fb7d32d830 msgr2=0x55fb7d421090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:43.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.639+0000 7f7b53f33800 1 -- 172.21.15.132:0/1469513166 shutdown_connections 2024-05-08T18:50:43.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.639+0000 7f7b53f33800 1 -- 172.21.15.132:0/1469513166 wait complete. 2024-05-08T18:50:43.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.639+0000 7f7b53f33800 1 Processor -- start 2024-05-08T18:50:43.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.639+0000 7f7b53f33800 1 -- start start 2024-05-08T18:50:43.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.639+0000 7f7b53f33800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d2a6a70 0x55fb7d42d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.639+0000 7f7b53f33800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fb7d33b970 con 0x55fb7d2a6a70 2024-05-08T18:50:43.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.639+0000 7f7b4fceb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d2a6a70 0x55fb7d42d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.640+0000 7f7b4fceb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d2a6a70 0x55fb7d42d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59352/0 (socket says 172.21.15.132:59352) 2024-05-08T18:50:43.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.640+0000 7f7b4fceb640 1 -- 172.21.15.132:0/3670522279 learned_addr learned my addr 172.21.15.132:0/3670522279 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:43.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.640+0000 7f7b4fceb640 1 -- 172.21.15.132:0/3670522279 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb7d42d830 con 0x55fb7d2a6a70 2024-05-08T18:50:43.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.640+0000 7f7b4fceb640 1 --2- 172.21.15.132:0/3670522279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d2a6a70 0x55fb7d42d2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55fb7d426500 tx=0x7f7b40000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.640+0000 7f7a37fff640 1 -- 172.21.15.132:0/3670522279 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b4000f8d0 con 0x55fb7d2a6a70 2024-05-08T18:50:43.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.640+0000 7f7a37fff640 1 -- 172.21.15.132:0/3670522279 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b4000fa70 con 0x55fb7d2a6a70 2024-05-08T18:50:43.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.640+0000 7f7b53f33800 1 -- 172.21.15.132:0/3670522279 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb7d42dac0 con 0x55fb7d2a6a70 2024-05-08T18:50:43.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.640+0000 7f7a37fff640 1 -- 172.21.15.132:0/3670522279 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b4000fdf0 con 0x55fb7d2a6a70 2024-05-08T18:50:43.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.640+0000 7f7b53f33800 1 -- 172.21.15.132:0/3670522279 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb7d430770 con 0x55fb7d2a6a70 2024-05-08T18:50:43.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.641+0000 7f7a37fff640 1 -- 172.21.15.132:0/3670522279 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f7b40017070 con 0x55fb7d2a6a70 2024-05-08T18:50:43.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.641+0000 7f7a37fff640 1 --2- 172.21.15.132:0/3670522279 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7a3803bb50 0x7f7a3803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.641+0000 7f7a37fff640 1 -- 172.21.15.132:0/3670522279 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f7b40015020 con 0x55fb7d2a6a70 2024-05-08T18:50:43.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.642+0000 7f7b4f4ea640 1 --2- 172.21.15.132:0/3670522279 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7a3803bb50 0x7f7a3803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.642+0000 7f7b53f33800 1 --2- 172.21.15.132:0/3670522279 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55fb7d2a7e00 0x55fb7d434530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.642+0000 7f7b53f33800 1 -- 172.21.15.132:0/3670522279 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d434ac0 con 0x55fb7d2a7e00 2024-05-08T18:50:43.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.642+0000 7f7b504ec640 1 --2- 172.21.15.132:0/3670522279 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55fb7d2a7e00 0x55fb7d434530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.642+0000 7f7b4f4ea640 1 --2- 172.21.15.132:0/3670522279 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7a3803bb50 0x7f7a3803e010 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400a520 tx=0x7f7b4404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.642+0000 7f7b504ec640 1 --2- 172.21.15.132:0/3670522279 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55fb7d2a7e00 0x55fb7d434530 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.642+0000 7f7b504ec640 1 -- 172.21.15.132:0/3670522279 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b4800a4a0 con 0x55fb7d2a7e00 2024-05-08T18:50:43.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.642+0000 7f7b53f33800 1 -- 172.21.15.132:0/3670522279 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d431b00 con 0x55fb7d2a7e00 2024-05-08T18:50:43.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.643+0000 7f7b504ec640 1 -- 172.21.15.132:0/3670522279 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b4800a4a0 con 0x55fb7d2a7e00 2024-05-08T18:50:43.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.643+0000 7f7b53f33800 1 --2- 172.21.15.132:0/3670522279 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55fb7d436e10 0x55fb7d439200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.643+0000 7f7b53f33800 1 -- 172.21.15.132:0/3670522279 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d4398f0 con 0x55fb7d436e10 2024-05-08T18:50:43.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.643+0000 7f7b4fceb640 1 --2- 172.21.15.132:0/3670522279 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55fb7d436e10 0x55fb7d439200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.643+0000 7f7b4fceb640 1 --2- 172.21.15.132:0/3670522279 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55fb7d436e10 0x55fb7d439200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.643+0000 7f7b4fceb640 1 -- 172.21.15.132:0/3670522279 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7b4002e070 con 0x55fb7d436e10 2024-05-08T18:50:43.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.643+0000 7f7b53f33800 1 -- 172.21.15.132:0/3670522279 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d435cb0 con 0x55fb7d2a7e00 2024-05-08T18:50:43.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.643+0000 7f7b504ec640 1 -- 172.21.15.132:0/3670522279 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b4800a4a0 con 0x55fb7d2a7e00 2024-05-08T18:50:43.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.644+0000 7f7b53f33800 1 -- 172.21.15.132:0/3670522279 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d436190 con 0x55fb7d2a7e00 2024-05-08T18:50:43.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.644+0000 7f7b504ec640 1 -- 172.21.15.132:0/3670522279 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7b4800a4a0 con 0x55fb7d2a7e00 2024-05-08T18:50:43.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.644+0000 7f7b53f33800 1 Processor -- start 2024-05-08T18:50:43.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.644+0000 7f7b53f33800 1 -- start start 2024-05-08T18:50:43.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.644+0000 7f7b53f33800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d448830 0x55fb7d448c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.644+0000 7f7b53f33800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fb7d223fc0 con 0x55fb7d448830 2024-05-08T18:50:43.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.645+0000 7f7b504ec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d448830 0x55fb7d448c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.645+0000 7f7b504ec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d448830 0x55fb7d448c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59354/0 (socket says 172.21.15.132:59354) 2024-05-08T18:50:43.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.645+0000 7f7b504ec640 1 -- 172.21.15.132:0/2567639165 learned_addr learned my addr 172.21.15.132:0/2567639165 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:43.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.645+0000 7f7b504ec640 1 -- 172.21.15.132:0/2567639165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb7d449190 con 0x55fb7d448830 2024-05-08T18:50:43.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.645+0000 7f7b504ec640 1 --2- 172.21.15.132:0/2567639165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d448830 0x55fb7d448c50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x55fb7d434ec0 tx=0x7f7b48018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.645+0000 7f7a357fa640 1 -- 172.21.15.132:0/2567639165 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b48014450 con 0x55fb7d448830 2024-05-08T18:50:43.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.645+0000 7f7a357fa640 1 -- 172.21.15.132:0/2567639165 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b48014610 con 0x55fb7d448830 2024-05-08T18:50:43.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.645+0000 7f7a357fa640 1 -- 172.21.15.132:0/2567639165 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b48014930 con 0x55fb7d448830 2024-05-08T18:50:43.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.645+0000 7f7b53f33800 1 -- 172.21.15.132:0/2567639165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb7d449c00 con 0x55fb7d448830 2024-05-08T18:50:43.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.645+0000 7f7b53f33800 1 -- 172.21.15.132:0/2567639165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb7d44a100 con 0x55fb7d448830 2024-05-08T18:50:43.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.646+0000 7f7a357fa640 1 -- 172.21.15.132:0/2567639165 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f7b48011040 con 0x55fb7d448830 2024-05-08T18:50:43.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.646+0000 7f7a357fa640 1 --2- 172.21.15.132:0/2567639165 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7a2803bb50 0x7f7a2803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.646+0000 7f7a357fa640 1 -- 172.21.15.132:0/2567639165 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f7b4801e070 con 0x55fb7d448830 2024-05-08T18:50:43.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.647+0000 7f7b4fceb640 1 --2- 172.21.15.132:0/2567639165 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7a2803bb50 0x7f7a2803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.647+0000 7f7b53f33800 1 Processor -- start 2024-05-08T18:50:43.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.647+0000 7f7b53f33800 1 -- start start 2024-05-08T18:50:43.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.647+0000 7f7b4fceb640 1 --2- 172.21.15.132:0/2567639165 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7a2803bb50 0x7f7a2803e010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x55fb7d434f60 tx=0x7f7b40051800 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.647+0000 7f7b53f33800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d455b10 0x55fb7d455f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.647+0000 7f7b53f33800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fb7d4260c0 con 0x55fb7d455b10 2024-05-08T18:50:43.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.647+0000 7f7b504ec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d455b10 0x55fb7d455f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.647+0000 7f7b504ec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d455b10 0x55fb7d455f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59364/0 (socket says 172.21.15.132:59364) 2024-05-08T18:50:43.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.647+0000 7f7b504ec640 1 -- 172.21.15.132:0/2231665950 learned_addr learned my addr 172.21.15.132:0/2231665950 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:43.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.648+0000 7f7b504ec640 1 -- 172.21.15.132:0/2231665950 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb7d456500 con 0x55fb7d455b10 2024-05-08T18:50:43.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.648+0000 7f7b504ec640 1 --2- 172.21.15.132:0/2231665950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d455b10 0x55fb7d455f30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7b48052cd0 tx=0x7f7b4802b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6435792b5477b676 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.648+0000 7f7a2effd640 1 -- 172.21.15.132:0/2231665950 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b48028070 con 0x55fb7d455b10 2024-05-08T18:50:43.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.648+0000 7f7a2effd640 1 -- 172.21.15.132:0/2231665950 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b48016e00 con 0x55fb7d455b10 2024-05-08T18:50:43.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.648+0000 7f7a2effd640 1 -- 172.21.15.132:0/2231665950 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b480165b0 con 0x55fb7d455b10 2024-05-08T18:50:43.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.648+0000 7f7b53f33800 1 -- 172.21.15.132:0/2231665950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d455b10 msgr2=0x55fb7d455f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.648+0000 7f7b53f33800 1 --2- 172.21.15.132:0/2231665950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d455b10 0x55fb7d455f30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7b48052cd0 tx=0x7f7b4802b720 comp rx=0 tx=0).stop 2024-05-08T18:50:43.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.648+0000 7f7b53f33800 1 -- 172.21.15.132:0/2231665950 shutdown_connections 2024-05-08T18:50:43.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.648+0000 7f7b53f33800 1 --2- 172.21.15.132:0/2231665950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d455b10 0x55fb7d455f30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.648+0000 7f7b53f33800 1 -- 172.21.15.132:0/2231665950 >> 172.21.15.132:0/2231665950 conn(0x55fb7d451e70 msgr2=0x55fb7d44fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:43.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.648+0000 7f7b53f33800 1 -- 172.21.15.132:0/2231665950 shutdown_connections 2024-05-08T18:50:43.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.648+0000 7f7b53f33800 1 -- 172.21.15.132:0/2231665950 wait complete. 2024-05-08T18:50:43.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.649+0000 7f7b53f33800 1 Processor -- start 2024-05-08T18:50:43.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.649+0000 7f7b53f33800 1 -- start start 2024-05-08T18:50:43.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.649+0000 7f7b53f33800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d455b10 0x55fb7d45d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.649+0000 7f7b53f33800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fb7d456c70 con 0x55fb7d455b10 2024-05-08T18:50:43.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.649+0000 7f7b504ec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d455b10 0x55fb7d45d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.649+0000 7f7b504ec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d455b10 0x55fb7d45d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59378/0 (socket says 172.21.15.132:59378) 2024-05-08T18:50:43.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.649+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 learned_addr learned my addr 172.21.15.132:0/1964129239 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:43.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.649+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb7d45d630 con 0x55fb7d455b10 2024-05-08T18:50:43.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.650+0000 7f7b504ec640 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d455b10 0x55fb7d45d0f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7b48016fd0 tx=0x7f7b48052c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.650+0000 7f7a2d7fa640 1 -- 172.21.15.132:0/1964129239 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b48031070 con 0x55fb7d455b10 2024-05-08T18:50:43.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.650+0000 7f7a2d7fa640 1 -- 172.21.15.132:0/1964129239 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b48011830 con 0x55fb7d455b10 2024-05-08T18:50:43.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.650+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb7d45d8c0 con 0x55fb7d455b10 2024-05-08T18:50:43.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.650+0000 7f7a2d7fa640 1 -- 172.21.15.132:0/1964129239 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b48044040 con 0x55fb7d455b10 2024-05-08T18:50:43.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.650+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb7d460570 con 0x55fb7d455b10 2024-05-08T18:50:43.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.651+0000 7f7a2d7fa640 1 -- 172.21.15.132:0/1964129239 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f7b48034070 con 0x55fb7d455b10 2024-05-08T18:50:43.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.651+0000 7f7a2d7fa640 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7a1803bb50 0x7f7a1803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.651+0000 7f7a2d7fa640 1 -- 172.21.15.132:0/1964129239 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f7b4800e040 con 0x55fb7d455b10 2024-05-08T18:50:43.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.651+0000 7f7b4fceb640 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7a1803bb50 0x7f7a1803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.651+0000 7f7b4fceb640 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7a1803bb50 0x7f7a1803e010 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7b40017fd0 tx=0x7f7b40019f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.651+0000 7f7b53f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.651+0000 7f7b53f33800 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55fb7d468c40 0x55fb7d46b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.651+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d46b850 con 0x55fb7d468c40 2024-05-08T18:50:43.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.651+0000 7f7b4f4ea640 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55fb7d468c40 0x55fb7d46b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.652+0000 7f7b4f4ea640 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55fb7d468c40 0x55fb7d46b100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.652+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b4405a040 con 0x55fb7d468c40 2024-05-08T18:50:43.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.652+0000 7f7b53f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.652+0000 7f7b53f33800 20 realm 2024-05-08T18:50:43.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.652+0000 7f7b53f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.652+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d46bc20 con 0x55fb7d468c40 2024-05-08T18:50:43.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.652+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b4405a040 con 0x55fb7d468c40 2024-05-08T18:50:43.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.652+0000 7f7b53f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.652+0000 7f7b53f33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:43.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.652+0000 7f7b53f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.652+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d46c4f0 con 0x55fb7d468c40 2024-05-08T18:50:43.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.652+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b4405a040 con 0x55fb7d468c40 2024-05-08T18:50:43.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.652+0000 7f7b53f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.652+0000 7f7b53f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.652+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d46c890 con 0x55fb7d468c40 2024-05-08T18:50:43.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.653+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b4405a040 con 0x55fb7d468c40 2024-05-08T18:50:43.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.653+0000 7f7b53f33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:43.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.653+0000 7f7b53f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.653+0000 7f7b53f33800 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55fb7d46d5f0 0x55fb7d46f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.653+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d46fff0 con 0x55fb7d46d5f0 2024-05-08T18:50:43.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.653+0000 7f7b504ec640 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55fb7d46d5f0 0x55fb7d46f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.653+0000 7f7b504ec640 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55fb7d46d5f0 0x55fb7d46f9e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.653+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.653+0000 7f7b53f33800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:43.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.653+0000 7f7b53f33800 20 searching for the correct realm 2024-05-08T18:50:43.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.653+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x55fb7d46d5f0 2024-05-08T18:50:43.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.654+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.654+0000 7f7b504ec640 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f7b48036070 0x7f7b48050030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.654+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x7f7b48036070 2024-05-08T18:50:43.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.654+0000 7f7b4fceb640 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f7b48036070 0x7f7b48050030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.654+0000 7f7b4fceb640 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f7b48036070 0x7f7b48050030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.654+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4002e070 con 0x7f7b48036070 2024-05-08T18:50:43.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.655+0000 7f7b4fceb640 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f7b4000f070 0x7f7b4004a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.655+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x7f7b4000f070 2024-05-08T18:50:43.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.655+0000 7f7b4f4ea640 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f7b4000f070 0x7f7b4004a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.655+0000 7f7b4f4ea640 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f7b4000f070 0x7f7b4004a740 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.656+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4405a040 con 0x7f7b4000f070 2024-05-08T18:50:43.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.656+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x55fb7d468c40 2024-05-08T18:50:43.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.656+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4405a040 con 0x55fb7d468c40 2024-05-08T18:50:43.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.656+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x55fb7d468c40 2024-05-08T18:50:43.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.656+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4405a040 con 0x55fb7d468c40 2024-05-08T18:50:43.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.656+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x7f7b4000f070 2024-05-08T18:50:43.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.656+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4405a040 con 0x7f7b4000f070 2024-05-08T18:50:43.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.656+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x7f7b4000f070 2024-05-08T18:50:43.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.657+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4405a040 con 0x7f7b4000f070 2024-05-08T18:50:43.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.657+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x7f7b48036070 2024-05-08T18:50:43.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.657+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4002e070 con 0x7f7b48036070 2024-05-08T18:50:43.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.657+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x55fb7d46d5f0 2024-05-08T18:50:43.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.657+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.657+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x55fb7d468c40 2024-05-08T18:50:43.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.657+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4405a040 con 0x55fb7d468c40 2024-05-08T18:50:43.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.657+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x7f7b4000f070 2024-05-08T18:50:43.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.658+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4405a040 con 0x7f7b4000f070 2024-05-08T18:50:43.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.658+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x55fb7d468c40 2024-05-08T18:50:43.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.658+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7b4405a040 con 0x55fb7d468c40 2024-05-08T18:50:43.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.658+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x7f7b48036070 2024-05-08T18:50:43.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.658+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7b4002e070 con 0x7f7b48036070 2024-05-08T18:50:43.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.658+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x55fb7d46d5f0 2024-05-08T18:50:43.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.658+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v18'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.658+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x55fb7d46d5f0 2024-05-08T18:50:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.659+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.659+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x7f7b4000f070 2024-05-08T18:50:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.659+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4405a040 con 0x7f7b4000f070 2024-05-08T18:50:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.659+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x55fb7d46d5f0 2024-05-08T18:50:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.659+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.659+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x55fb7d46d5f0 2024-05-08T18:50:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.659+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.659+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x55fb7d468c40 2024-05-08T18:50:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.660+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4405a040 con 0x55fb7d468c40 2024-05-08T18:50:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.660+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x55fb7d468c40 2024-05-08T18:50:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.660+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7b4405a040 con 0x55fb7d468c40 2024-05-08T18:50:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.660+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x7f7b4000f070 2024-05-08T18:50:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.660+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4407d040 con 0x7f7b4000f070 2024-05-08T18:50:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.660+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x55fb7d46d5f0 2024-05-08T18:50:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.660+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.660+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x7f7b48036070 2024-05-08T18:50:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.661+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4002e070 con 0x7f7b48036070 2024-05-08T18:50:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.661+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x55fb7d468c40 2024-05-08T18:50:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.661+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4407d040 con 0x55fb7d468c40 2024-05-08T18:50:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.661+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x7f7b4000f070 2024-05-08T18:50:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.661+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4407d040 con 0x7f7b4000f070 2024-05-08T18:50:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.661+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x55fb7d46d5f0 2024-05-08T18:50:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.662+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.662+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x7f7b4000f070 2024-05-08T18:50:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.662+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4407d040 con 0x7f7b4000f070 2024-05-08T18:50:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.662+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x7f7b48036070 2024-05-08T18:50:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.662+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4002e070 con 0x7f7b48036070 2024-05-08T18:50:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.662+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x55fb7d46d5f0 2024-05-08T18:50:43.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.662+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.662+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x7f7b4000f070 2024-05-08T18:50:43.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.663+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4407d040 con 0x7f7b4000f070 2024-05-08T18:50:43.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.663+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x55fb7d468c40 2024-05-08T18:50:43.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.663+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7b4407d040 con 0x55fb7d468c40 2024-05-08T18:50:43.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.663+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471900 con 0x7f7b48036070 2024-05-08T18:50:43.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.663+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b4002e070 con 0x7f7b48036070 2024-05-08T18:50:43.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.663+0000 7f7b53f33800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:43.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.663+0000 7f7b53f33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:43.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.663+0000 7f7b53f33800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:43.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.663+0000 7f7b53f33800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:43.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.663+0000 7f7b53f33800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:43.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.663+0000 7f7b53f33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:43.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.663+0000 7f7b53f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.663+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d470840 con 0x55fb7d468c40 2024-05-08T18:50:43.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.663+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x55fb7d468c40 2024-05-08T18:50:43.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.663+0000 7f7b53f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.663+0000 7f7b53f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.663+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d470c30 con 0x55fb7d468c40 2024-05-08T18:50:43.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.664+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b4407d040 con 0x55fb7d468c40 2024-05-08T18:50:43.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.664+0000 7f7b53f33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:43.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.664+0000 7f7b53f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.664+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d471d80 con 0x55fb7d468c40 2024-05-08T18:50:43.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.664+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7b4407d040 con 0x55fb7d468c40 2024-05-08T18:50:43.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.664+0000 7f7b53f33800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:43.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.664+0000 7f7b53f33800 20 zone default found 2024-05-08T18:50:43.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.664+0000 7f7b53f33800 4 Realm: () 2024-05-08T18:50:43.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.664+0000 7f7b53f33800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:43.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.664+0000 7f7b53f33800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:43.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.664+0000 7f7b53f33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:43.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.664+0000 7f7b53f33800 20 zonegroup default 2024-05-08T18:50:43.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.664+0000 7f7b53f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.664+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d472160 con 0x7f7b4000f070 2024-05-08T18:50:43.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.664+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x7f7b4000f070 2024-05-08T18:50:43.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.664+0000 7f7b53f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.664+0000 7f7b53f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.664+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d473f80 con 0x55fb7d46d5f0 2024-05-08T18:50:43.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.665+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.665+0000 7f7b53f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.665+0000 7f7b53f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.665+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d474350 con 0x55fb7d46d5f0 2024-05-08T18:50:43.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.665+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.665+0000 7f7b53f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.665+0000 7f7b53f33800 20 started sync module instance, tier type = 2024-05-08T18:50:43.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.665+0000 7f7b53f33800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:43.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.665+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d473420 con 0x7f7b48036070 2024-05-08T18:50:43.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.666+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b40061040 con 0x7f7b48036070 2024-05-08T18:50:43.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.666+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94538626971664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d474c60 con 0x7f7b48036070 2024-05-08T18:50:43.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.666+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d4754b0 con 0x55fb7d468c40 2024-05-08T18:50:43.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.667+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x55fb7d468c40 2024-05-08T18:50:43.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.667+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94538626977792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d475a10 con 0x55fb7d468c40 2024-05-08T18:50:43.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.667+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d476530 con 0x55fb7d46d5f0 2024-05-08T18:50:43.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.668+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94538626977792] v25'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x55fb7d468c40 2024-05-08T18:50:43.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.671+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94538626971664] v25'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b40061040 con 0x7f7b48036070 2024-05-08T18:50:43.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.671+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.671+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94538626975664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d4764f0 con 0x55fb7d46d5f0 2024-05-08T18:50:43.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.671+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d476dd0 con 0x7f7b48036070 2024-05-08T18:50:43.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.674+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94538626975664] v25'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.674+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b40061040 con 0x7f7b48036070 2024-05-08T18:50:43.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.674+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94538626984224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d4764f0 con 0x7f7b48036070 2024-05-08T18:50:43.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.674+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d477890 con 0x55fb7d468c40 2024-05-08T18:50:43.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.676+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x55fb7d468c40 2024-05-08T18:50:43.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.676+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94538626986944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d478130 con 0x55fb7d468c40 2024-05-08T18:50:43.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.676+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d478c10 con 0x7f7b4000f070 2024-05-08T18:50:43.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.677+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94538626984224] v25'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b40061040 con 0x7f7b48036070 2024-05-08T18:50:43.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.678+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x7f7b4000f070 2024-05-08T18:50:43.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.678+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94538626991904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d478c10 con 0x7f7b4000f070 2024-05-08T18:50:43.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.678+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d479620 con 0x7f7b4000f070 2024-05-08T18:50:43.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.678+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94538626986944] v25'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x55fb7d468c40 2024-05-08T18:50:43.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.679+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94538626991904] v25'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x7f7b4000f070 2024-05-08T18:50:43.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.679+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x7f7b4000f070 2024-05-08T18:50:43.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.679+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94538626981888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d479170 con 0x7f7b4000f070 2024-05-08T18:50:43.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.679+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d479ec0 con 0x7f7b4000f070 2024-05-08T18:50:43.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.680+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(58 notify.7 [create] v25'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x7f7b4000f070 2024-05-08T18:50:43.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.680+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94538626981888] v25'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x7f7b4000f070 2024-05-08T18:50:43.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.680+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94538626996288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d479c60 con 0x7f7b4000f070 2024-05-08T18:50:43.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.680+0000 7f7b53f33800 20 add_watcher() i=0 2024-05-08T18:50:43.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.680+0000 7f7b53f33800 20 add_watcher() i=1 2024-05-08T18:50:43.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.680+0000 7f7b53f33800 20 add_watcher() i=2 2024-05-08T18:50:43.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.680+0000 7f7b53f33800 20 add_watcher() i=3 2024-05-08T18:50:43.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.680+0000 7f7b53f33800 20 add_watcher() i=4 2024-05-08T18:50:43.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.680+0000 7f7b53f33800 20 add_watcher() i=5 2024-05-08T18:50:43.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.680+0000 7f7b53f33800 20 add_watcher() i=6 2024-05-08T18:50:43.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.681+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94538626996288] v25'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x7f7b4000f070 2024-05-08T18:50:43.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.681+0000 7f7b53f33800 20 add_watcher() i=7 2024-05-08T18:50:43.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.681+0000 7f7b53f33800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:43.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.681+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d47cdd0 con 0x55fb7d468c40 2024-05-08T18:50:43.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.682+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7b4407d040 con 0x55fb7d468c40 2024-05-08T18:50:43.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.682+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94538626989104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d47a110 con 0x55fb7d468c40 2024-05-08T18:50:43.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.683+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94538626989104] v25'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x55fb7d468c40 2024-05-08T18:50:43.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.683+0000 7f7a05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:43.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.683+0000 7f7b53f33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:43.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.683+0000 7f7b53f33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:43.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.683+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d47c550 con 0x55fb7d468c40 2024-05-08T18:50:43.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.684+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v25'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x55fb7d468c40 2024-05-08T18:50:43.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.684+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d485e90 con 0x7f7b4000f070 2024-05-08T18:50:43.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.685+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v25'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x7f7b4000f070 2024-05-08T18:50:43.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.685+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d486340 con 0x55fb7d46d5f0 2024-05-08T18:50:43.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.688+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v25'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.688+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d486340 con 0x55fb7d468c40 2024-05-08T18:50:43.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.690+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v25'27 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x55fb7d468c40 2024-05-08T18:50:43.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.690+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d4868b0 con 0x7f7b48036070 2024-05-08T18:50:43.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.696+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v25'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b40061040 con 0x7f7b48036070 2024-05-08T18:50:43.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.696+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487100 con 0x55fb7d46d5f0 2024-05-08T18:50:43.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.696+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v25'13 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.697+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487100 con 0x55fb7d468c40 2024-05-08T18:50:43.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.699+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v25'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x55fb7d468c40 2024-05-08T18:50:43.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.699+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x7f7b4000f070 2024-05-08T18:50:43.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.700+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v25'13 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x7f7b4000f070 2024-05-08T18:50:43.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.700+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x7f7b48036070 2024-05-08T18:50:43.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.701+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v25'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b40061040 con 0x7f7b48036070 2024-05-08T18:50:43.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.701+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x55fb7d46d5f0 2024-05-08T18:50:43.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.702+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v25'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.702+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x7f7b48036070 2024-05-08T18:50:43.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.703+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v25'21 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b40061040 con 0x7f7b48036070 2024-05-08T18:50:43.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.703+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x7f7b4000f070 2024-05-08T18:50:43.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.705+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v25'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x7f7b4000f070 2024-05-08T18:50:43.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.705+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x7f7b48036070 2024-05-08T18:50:43.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.705+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v25'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b40061040 con 0x7f7b48036070 2024-05-08T18:50:43.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.705+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x7f7b4000f070 2024-05-08T18:50:43.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.707+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v25'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x7f7b4000f070 2024-05-08T18:50:43.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.707+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x55fb7d468c40 2024-05-08T18:50:43.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.708+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v25'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x55fb7d468c40 2024-05-08T18:50:43.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.708+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x55fb7d46d5f0 2024-05-08T18:50:43.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.709+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v25'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.709+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x7f7b48036070 2024-05-08T18:50:43.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.710+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v25'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b40061040 con 0x7f7b48036070 2024-05-08T18:50:43.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.710+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x55fb7d46d5f0 2024-05-08T18:50:43.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.711+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v25'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.711+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x55fb7d468c40 2024-05-08T18:50:43.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.712+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v25'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x55fb7d468c40 2024-05-08T18:50:43.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.712+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x55fb7d468c40 2024-05-08T18:50:43.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.713+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v25'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x55fb7d468c40 2024-05-08T18:50:43.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.713+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x55fb7d46d5f0 2024-05-08T18:50:43.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.714+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v25'15 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.714+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x7f7b48036070 2024-05-08T18:50:43.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.715+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v25'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b40061040 con 0x7f7b48036070 2024-05-08T18:50:43.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.715+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x55fb7d46d5f0 2024-05-08T18:50:43.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.716+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v25'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.716+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x55fb7d46d5f0 2024-05-08T18:50:43.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.717+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v25'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.717+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x55fb7d46d5f0 2024-05-08T18:50:43.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.718+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v25'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.718+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x55fb7d46d5f0 2024-05-08T18:50:43.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.719+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v25'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.719+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x7f7b4000f070 2024-05-08T18:50:43.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.720+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v25'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x7f7b4000f070 2024-05-08T18:50:43.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.720+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x55fb7d46d5f0 2024-05-08T18:50:43.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.721+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v25'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.721+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x7f7b4000f070 2024-05-08T18:50:43.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.722+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v25'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x7f7b4000f070 2024-05-08T18:50:43.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.722+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x55fb7d46d5f0 2024-05-08T18:50:43.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.723+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v25'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.723+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x7f7b4000f070 2024-05-08T18:50:43.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.725+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v25'20 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x7f7b4000f070 2024-05-08T18:50:43.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.725+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d487560 con 0x7f7b48036070 2024-05-08T18:50:43.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.726+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v25'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7b40061040 con 0x7f7b48036070 2024-05-08T18:50:43.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.726+0000 7f7a04fe1640 20 reqs_thread_entry: start 2024-05-08T18:50:43.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.726+0000 7f7b53f33800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:43.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.726+0000 7f7b53f33800 20 Filter name: none 2024-05-08T18:50:43.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.726+0000 7f797e7fc640 20 reqs_thread_entry: start 2024-05-08T18:50:43.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.726+0000 7f7b53f33800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-05-08T18:50:43.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.726+0000 7f7b53f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.726+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d4b2530 con 0x7f7b48036070 2024-05-08T18:50:43.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.727+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f7b40061040 con 0x7f7b48036070 2024-05-08T18:50:43.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.727+0000 7f7b53f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.727+0000 7f7b53f33800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-05-08T18:50:43.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.727+0000 7f7b53f33800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T18:50:43.727 INFO:teuthology.orchestra.run.smithi132.stderr:could not remove user: unable to remove user, user does not exist 2024-05-08T18:50:43.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.727+0000 7f7a05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:43.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.727+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94538626989104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d4842a0 con 0x55fb7d468c40 2024-05-08T18:50:43.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.728+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94538626989104] v25'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x55fb7d468c40 2024-05-08T18:50:43.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.728+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94538626971664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d477c30 con 0x7f7b48036070 2024-05-08T18:50:43.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.729+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94538626971664] v25'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b40061040 con 0x7f7b48036070 2024-05-08T18:50:43.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.729+0000 7f7b53f33800 20 remove_watcher() i=0 2024-05-08T18:50:43.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.729+0000 7f7b53f33800 2 removed watcher, disabling cache 2024-05-08T18:50:43.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.729+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94538626977792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d477c30 con 0x55fb7d468c40 2024-05-08T18:50:43.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.731+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94538626977792] v25'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x55fb7d468c40 2024-05-08T18:50:43.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.731+0000 7f7b53f33800 20 remove_watcher() i=1 2024-05-08T18:50:43.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.731+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94538626975664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d475000 con 0x55fb7d46d5f0 2024-05-08T18:50:43.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.732+0000 7f7b504ec640 1 -- 172.21.15.132:0/1964129239 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94538626975664] v25'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b4803d070 con 0x55fb7d46d5f0 2024-05-08T18:50:43.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.732+0000 7f7b53f33800 20 remove_watcher() i=2 2024-05-08T18:50:43.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.732+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94538626984224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d477c30 con 0x7f7b48036070 2024-05-08T18:50:43.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.733+0000 7f7b4fceb640 1 -- 172.21.15.132:0/1964129239 <== osd.2 v2:172.21.15.132:6808/1108348591 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94538626984224] v25'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b40061040 con 0x7f7b48036070 2024-05-08T18:50:43.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.733+0000 7f7b53f33800 20 remove_watcher() i=3 2024-05-08T18:50:43.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.733+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94538626986944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d476920 con 0x55fb7d468c40 2024-05-08T18:50:43.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.734+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94538626986944] v25'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x55fb7d468c40 2024-05-08T18:50:43.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.734+0000 7f7b53f33800 20 remove_watcher() i=4 2024-05-08T18:50:43.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.734+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94538626991904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d477c30 con 0x7f7b4000f070 2024-05-08T18:50:43.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.735+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94538626991904] v25'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x7f7b4000f070 2024-05-08T18:50:43.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.735+0000 7f7b53f33800 20 remove_watcher() i=5 2024-05-08T18:50:43.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.735+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94538626981888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d4773c0 con 0x7f7b4000f070 2024-05-08T18:50:43.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.736+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94538626981888] v25'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x7f7b4000f070 2024-05-08T18:50:43.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.736+0000 7f7b53f33800 20 remove_watcher() i=6 2024-05-08T18:50:43.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.736+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94538626996288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55fb7d476000 con 0x7f7b4000f070 2024-05-08T18:50:43.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.737+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94538626996288] v25'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b4407d040 con 0x7f7b4000f070 2024-05-08T18:50:43.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.737+0000 7f7b53f33800 20 remove_watcher() i=7 2024-05-08T18:50:43.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.737+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f7b4000f070 msgr2=0x7f7b4004a740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.737+0000 7f7b53f33800 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f7b4000f070 0x7f7b4004a740 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.737+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55fb7d468c40 msgr2=0x55fb7d46b100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.737+0000 7f7b53f33800 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55fb7d468c40 0x55fb7d46b100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.737+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f7b48036070 msgr2=0x7f7b48050030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.737+0000 7f7b53f33800 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f7b48036070 0x7f7b48050030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.737+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55fb7d46d5f0 msgr2=0x55fb7d46f9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.737+0000 7f7b53f33800 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55fb7d46d5f0 0x55fb7d46f9e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.737+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7a1803bb50 msgr2=0x7f7a1803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.737+0000 7f7b53f33800 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7a1803bb50 0x7f7a1803e010 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7b40017fd0 tx=0x7f7b40019f90 comp rx=0 tx=0).stop 2024-05-08T18:50:43.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.737+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d455b10 msgr2=0x55fb7d45d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.737+0000 7f7b4f4ea640 1 -- 172.21.15.132:0/1964129239 reap_dead start 2024-05-08T18:50:43.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.737+0000 7f7b53f33800 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d455b10 0x55fb7d45d0f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7b48016fd0 tx=0x7f7b48052c60 comp rx=0 tx=0).stop 2024-05-08T18:50:43.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.737+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 shutdown_connections 2024-05-08T18:50:43.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.737+0000 7f7b53f33800 1 --2- 172.21.15.132:0/1964129239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d455b10 0x55fb7d45d0f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.737+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 >> 172.21.15.132:0/1964129239 conn(0x55fb7d451e70 msgr2=0x55fb7d44f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:43.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.737+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 shutdown_connections 2024-05-08T18:50:43.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.737+0000 7f7b53f33800 1 -- 172.21.15.132:0/1964129239 wait complete. 2024-05-08T18:50:43.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.738+0000 7f7b53f33800 1 -- 172.21.15.132:0/2567639165 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7a2803bb50 msgr2=0x7f7a2803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.738+0000 7f7b53f33800 1 --2- 172.21.15.132:0/2567639165 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7a2803bb50 0x7f7a2803e010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x55fb7d434f60 tx=0x7f7b40051800 comp rx=0 tx=0).stop 2024-05-08T18:50:43.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.738+0000 7f7b53f33800 1 -- 172.21.15.132:0/2567639165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d448830 msgr2=0x55fb7d448c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.738+0000 7f7b53f33800 1 --2- 172.21.15.132:0/2567639165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d448830 0x55fb7d448c50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x55fb7d434ec0 tx=0x7f7b48018830 comp rx=0 tx=0).stop 2024-05-08T18:50:43.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.738+0000 7f7b53f33800 1 -- 172.21.15.132:0/2567639165 shutdown_connections 2024-05-08T18:50:43.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.738+0000 7f7b53f33800 1 --2- 172.21.15.132:0/2567639165 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7a2803bb50 0x7f7a2803e010 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.738+0000 7f7b53f33800 1 --2- 172.21.15.132:0/2567639165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d448830 0x55fb7d448c50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.738+0000 7f7b53f33800 1 -- 172.21.15.132:0/2567639165 >> 172.21.15.132:0/2567639165 conn(0x55fb7d43c8d0 msgr2=0x55fb7d43ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:43.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.738+0000 7f7b53f33800 1 -- 172.21.15.132:0/2567639165 shutdown_connections 2024-05-08T18:50:43.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.738+0000 7f7b53f33800 1 -- 172.21.15.132:0/2567639165 wait complete. 2024-05-08T18:50:43.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.738+0000 7f7b53f33800 1 -- 172.21.15.132:0/3670522279 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55fb7d2a7e00 msgr2=0x55fb7d434530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.738+0000 7f7b53f33800 1 --2- 172.21.15.132:0/3670522279 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55fb7d2a7e00 0x55fb7d434530 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.738+0000 7f7b53f33800 1 -- 172.21.15.132:0/3670522279 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55fb7d436e10 msgr2=0x55fb7d439200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.738+0000 7f7b53f33800 1 --2- 172.21.15.132:0/3670522279 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55fb7d436e10 0x55fb7d439200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.739+0000 7f7b53f33800 1 -- 172.21.15.132:0/3670522279 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7a3803bb50 msgr2=0x7f7a3803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.739+0000 7f7b53f33800 1 --2- 172.21.15.132:0/3670522279 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7a3803bb50 0x7f7a3803e010 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400a520 tx=0x7f7b4404e000 comp rx=0 tx=0).stop 2024-05-08T18:50:43.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.739+0000 7f7b53f33800 1 -- 172.21.15.132:0/3670522279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d2a6a70 msgr2=0x55fb7d42d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.739+0000 7f7b53f33800 1 --2- 172.21.15.132:0/3670522279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d2a6a70 0x55fb7d42d2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55fb7d426500 tx=0x7f7b40000bc0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.739+0000 7f7b53f33800 1 -- 172.21.15.132:0/3670522279 shutdown_connections 2024-05-08T18:50:43.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.739+0000 7f7b53f33800 1 --2- 172.21.15.132:0/3670522279 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55fb7d436e10 0x55fb7d439200 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.739+0000 7f7b53f33800 1 --2- 172.21.15.132:0/3670522279 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55fb7d2a7e00 0x55fb7d434530 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.739+0000 7f7b53f33800 1 --2- 172.21.15.132:0/3670522279 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7a3803bb50 0x7f7a3803e010 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.739+0000 7f7b53f33800 1 --2- 172.21.15.132:0/3670522279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fb7d2a6a70 0x55fb7d42d2f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.739+0000 7f7b53f33800 1 -- 172.21.15.132:0/3670522279 >> 172.21.15.132:0/3670522279 conn(0x55fb7d32d830 msgr2=0x55fb7d41f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:43.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.739+0000 7f7b53f33800 1 -- 172.21.15.132:0/3670522279 shutdown_connections 2024-05-08T18:50:43.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.739+0000 7f7b53f33800 1 -- 172.21.15.132:0/3670522279 wait complete. 2024-05-08T18:50:43.746 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-08T18:50:43.747 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-05-08T18:50:43.747 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-05-08T18:50:43.747 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-05-08T18:50:43.831 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:43.831 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:43.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.833+0000 7f4b1a52d800 1 Processor -- start 2024-05-08T18:50:43.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.833+0000 7f4b1a52d800 1 -- start start 2024-05-08T18:50:43.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.833+0000 7f4b1a52d800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55bf7b24bdc0 0x55bf7b24a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.833+0000 7f4b1a52d800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bf7b24ad10 con 0x55bf7b24a860 2024-05-08T18:50:43.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.833+0000 7f4b1a52d800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55bf7b176e20 con 0x55bf7b24bdc0 2024-05-08T18:50:43.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.833+0000 7f4b16178640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55bf7b24bdc0 0x55bf7b24a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.833+0000 7f4b0d977640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55bf7b24a860 0x55bf7b2de160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46650/0 (socket says 172.21.15.132:46650) 2024-05-08T18:50:43.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.833+0000 7f4b16178640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55bf7b24bdc0 0x55bf7b24a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59382/0 (socket says 172.21.15.132:59382) 2024-05-08T18:50:43.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.833+0000 7f4b0d977640 1 -- 172.21.15.132:0/322076787 learned_addr learned my addr 172.21.15.132:0/322076787 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:50:43.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.834+0000 7f4b16178640 1 -- 172.21.15.132:0/322076787 >> v1:172.21.15.42:6789/0 conn(0x55bf7b24a860 legacy=0x55bf7b2de160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.834+0000 7f4b16178640 1 -- 172.21.15.132:0/322076787 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf7b24af30 con 0x55bf7b24bdc0 2024-05-08T18:50:43.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.835+0000 7f4b16178640 1 --2- 172.21.15.132:0/322076787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b24bdc0 0x55bf7b24a320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800a470 tx=0x7f4b0801cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a6687fe99720a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.836+0000 7f4b15977640 1 -- 172.21.15.132:0/322076787 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b08057070 con 0x55bf7b24bdc0 2024-05-08T18:50:43.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.836+0000 7f4b15977640 1 -- 172.21.15.132:0/322076787 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b0804adb0 con 0x55bf7b24bdc0 2024-05-08T18:50:43.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.836+0000 7f4b15977640 1 -- 172.21.15.132:0/322076787 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b08052590 con 0x55bf7b24bdc0 2024-05-08T18:50:43.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.836+0000 7f4b1a52d800 1 -- 172.21.15.132:0/322076787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b24bdc0 msgr2=0x55bf7b24a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.836+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/322076787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b24bdc0 0x55bf7b24a320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800a470 tx=0x7f4b0801cf20 comp rx=0 tx=0).stop 2024-05-08T18:50:43.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.836+0000 7f4b1a52d800 1 -- 172.21.15.132:0/322076787 shutdown_connections 2024-05-08T18:50:43.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.836+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/322076787 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b24bdc0 0x55bf7b24a320 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.836+0000 7f4b1a52d800 1 -- 172.21.15.132:0/322076787 >> 172.21.15.132:0/322076787 conn(0x55bf7b2d1830 msgr2=0x55bf7b2d3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:43.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.836+0000 7f4b1a52d800 1 -- 172.21.15.132:0/322076787 shutdown_connections 2024-05-08T18:50:43.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.836+0000 7f4b1a52d800 1 -- 172.21.15.132:0/322076787 wait complete. 2024-05-08T18:50:43.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.850+0000 7f4b1a52d800 1 Processor -- start 2024-05-08T18:50:43.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.850+0000 7f4b1a52d800 1 -- start start 2024-05-08T18:50:43.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.850+0000 7f4b1a52d800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b24a860 0x55bf7b3c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.850+0000 7f4b1a52d800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55bf7b2215b0 con 0x55bf7b24a860 2024-05-08T18:50:43.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.850+0000 7f4b16178640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b24a860 0x55bf7b3c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.850+0000 7f4b16178640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b24a860 0x55bf7b3c98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59390/0 (socket says 172.21.15.132:59390) 2024-05-08T18:50:43.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.850+0000 7f4b16178640 1 -- 172.21.15.132:0/3414084329 learned_addr learned my addr 172.21.15.132:0/3414084329 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:43.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.850+0000 7f4b16178640 1 -- 172.21.15.132:0/3414084329 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf7b3c9ea0 con 0x55bf7b24a860 2024-05-08T18:50:43.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.851+0000 7f4b16178640 1 --2- 172.21.15.132:0/3414084329 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b24a860 0x55bf7b3c98d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4b0801cf60 tx=0x7f4b0804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12cb7b948f0f0b5b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.851+0000 7f4a04608640 1 -- 172.21.15.132:0/3414084329 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b08057040 con 0x55bf7b24a860 2024-05-08T18:50:43.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.851+0000 7f4a04608640 1 -- 172.21.15.132:0/3414084329 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b08063070 con 0x55bf7b24a860 2024-05-08T18:50:43.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.851+0000 7f4a04608640 1 -- 172.21.15.132:0/3414084329 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b08052830 con 0x55bf7b24a860 2024-05-08T18:50:43.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.851+0000 7f4b1a52d800 1 -- 172.21.15.132:0/3414084329 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b24a860 msgr2=0x55bf7b3c98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.851+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/3414084329 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b24a860 0x55bf7b3c98d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4b0801cf60 tx=0x7f4b0804c000 comp rx=0 tx=0).stop 2024-05-08T18:50:43.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.852+0000 7f4b1a52d800 1 -- 172.21.15.132:0/3414084329 shutdown_connections 2024-05-08T18:50:43.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.852+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/3414084329 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b24a860 0x55bf7b3c98d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.852+0000 7f4b1a52d800 1 -- 172.21.15.132:0/3414084329 >> 172.21.15.132:0/3414084329 conn(0x55bf7b2d1830 msgr2=0x55bf7b3c51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:43.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.852+0000 7f4b1a52d800 1 -- 172.21.15.132:0/3414084329 shutdown_connections 2024-05-08T18:50:43.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.852+0000 7f4b1a52d800 1 -- 172.21.15.132:0/3414084329 wait complete. 2024-05-08T18:50:43.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.852+0000 7f4b1a52d800 1 Processor -- start 2024-05-08T18:50:43.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.852+0000 7f4b1a52d800 1 -- start start 2024-05-08T18:50:43.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.852+0000 7f4b1a52d800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b24a860 0x55bf7b3d1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.852+0000 7f4b1a52d800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55bf7b2e1b30 con 0x55bf7b24a860 2024-05-08T18:50:43.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.852+0000 7f4b16178640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b24a860 0x55bf7b3d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.852+0000 7f4b16178640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b24a860 0x55bf7b3d1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59400/0 (socket says 172.21.15.132:59400) 2024-05-08T18:50:43.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.852+0000 7f4b16178640 1 -- 172.21.15.132:0/4276437851 learned_addr learned my addr 172.21.15.132:0/4276437851 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:43.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.853+0000 7f4b16178640 1 -- 172.21.15.132:0/4276437851 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf7b3d17d0 con 0x55bf7b24a860 2024-05-08T18:50:43.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.853+0000 7f4b16178640 1 --2- 172.21.15.132:0/4276437851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b24a860 0x55bf7b3d1290 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4b08052460 tx=0x7f4b08002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.853+0000 7f4a02e05640 1 -- 172.21.15.132:0/4276437851 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b0806d070 con 0x55bf7b24a860 2024-05-08T18:50:43.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.853+0000 7f4a02e05640 1 -- 172.21.15.132:0/4276437851 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b08052de0 con 0x55bf7b24a860 2024-05-08T18:50:43.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.853+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4276437851 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bf7b3d1a60 con 0x55bf7b24a860 2024-05-08T18:50:43.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.853+0000 7f4a02e05640 1 -- 172.21.15.132:0/4276437851 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b08057050 con 0x55bf7b24a860 2024-05-08T18:50:43.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.853+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4276437851 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf7b3d4710 con 0x55bf7b24a860 2024-05-08T18:50:43.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.854+0000 7f4a02e05640 1 -- 172.21.15.132:0/4276437851 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4b0805d670 con 0x55bf7b24a860 2024-05-08T18:50:43.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.854+0000 7f4a02e05640 1 --2- 172.21.15.132:0/4276437851 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49fc03bb50 0x7f49fc03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.854+0000 7f4a02e05640 1 -- 172.21.15.132:0/4276437851 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f4b08093b80 con 0x55bf7b24a860 2024-05-08T18:50:43.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.854+0000 7f4b0d977640 1 --2- 172.21.15.132:0/4276437851 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49fc03bb50 0x7f49fc03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.854+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/4276437851 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55bf7b24bdc0 0x55bf7b3d84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.854+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4276437851 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b3d8aa0 con 0x55bf7b24bdc0 2024-05-08T18:50:43.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.854+0000 7f4b16979640 1 --2- 172.21.15.132:0/4276437851 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55bf7b24bdc0 0x55bf7b3d84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.855+0000 7f4b0d977640 1 --2- 172.21.15.132:0/4276437851 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49fc03bb50 0x7f49fc03e010 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4b00000f60 tx=0x7f4b000012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.855+0000 7f4b16979640 1 --2- 172.21.15.132:0/4276437851 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55bf7b24bdc0 0x55bf7b3d84d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.855+0000 7f4b16979640 1 -- 172.21.15.132:0/4276437851 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b1000a4a0 con 0x55bf7b24bdc0 2024-05-08T18:50:43.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.855+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4276437851 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b3d5aa0 con 0x55bf7b24bdc0 2024-05-08T18:50:43.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.855+0000 7f4b16979640 1 -- 172.21.15.132:0/4276437851 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4b1000a4a0 con 0x55bf7b24bdc0 2024-05-08T18:50:43.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.855+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/4276437851 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55bf7b3dadd0 0x55bf7b3dd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.855+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4276437851 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b3dd8b0 con 0x55bf7b3dadd0 2024-05-08T18:50:43.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.855+0000 7f4b16178640 1 --2- 172.21.15.132:0/4276437851 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55bf7b3dadd0 0x55bf7b3dd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.856+0000 7f4b16178640 1 --2- 172.21.15.132:0/4276437851 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55bf7b3dadd0 0x55bf7b3dd1c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.856+0000 7f4b16178640 1 -- 172.21.15.132:0/4276437851 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4b0805a040 con 0x55bf7b3dadd0 2024-05-08T18:50:43.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.856+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4276437851 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b3d9c70 con 0x55bf7b24bdc0 2024-05-08T18:50:43.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.856+0000 7f4b16979640 1 -- 172.21.15.132:0/4276437851 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4b1000a4a0 con 0x55bf7b24bdc0 2024-05-08T18:50:43.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.856+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4276437851 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b3da150 con 0x55bf7b24bdc0 2024-05-08T18:50:43.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.856+0000 7f4b16979640 1 -- 172.21.15.132:0/4276437851 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4b1000a4a0 con 0x55bf7b24bdc0 2024-05-08T18:50:43.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.857+0000 7f4b1a52d800 1 Processor -- start 2024-05-08T18:50:43.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.857+0000 7f4b1a52d800 1 -- start start 2024-05-08T18:50:43.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.857+0000 7f4b1a52d800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b3ec7f0 0x55bf7b3ecc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.857+0000 7f4b1a52d800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55bf7b1c7fc0 con 0x55bf7b3ec7f0 2024-05-08T18:50:43.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.857+0000 7f4b16979640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b3ec7f0 0x55bf7b3ecc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.857+0000 7f4b16979640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b3ec7f0 0x55bf7b3ecc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59410/0 (socket says 172.21.15.132:59410) 2024-05-08T18:50:43.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.857+0000 7f4b16979640 1 -- 172.21.15.132:0/2019132754 learned_addr learned my addr 172.21.15.132:0/2019132754 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:43.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.858+0000 7f4b16979640 1 -- 172.21.15.132:0/2019132754 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf7b3ed150 con 0x55bf7b3ec7f0 2024-05-08T18:50:43.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.858+0000 7f4b16979640 1 --2- 172.21.15.132:0/2019132754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b3ec7f0 0x55bf7b3ecc10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55bf7b3d8e80 tx=0x7f4b10018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.858+0000 7f49fbfff640 1 -- 172.21.15.132:0/2019132754 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b10014450 con 0x55bf7b3ec7f0 2024-05-08T18:50:43.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.858+0000 7f49fbfff640 1 -- 172.21.15.132:0/2019132754 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b10014610 con 0x55bf7b3ec7f0 2024-05-08T18:50:43.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.858+0000 7f49fbfff640 1 -- 172.21.15.132:0/2019132754 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b10014930 con 0x55bf7b3ec7f0 2024-05-08T18:50:43.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.858+0000 7f4b1a52d800 1 -- 172.21.15.132:0/2019132754 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bf7b3edbc0 con 0x55bf7b3ec7f0 2024-05-08T18:50:43.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.858+0000 7f4b1a52d800 1 -- 172.21.15.132:0/2019132754 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf7b3ee0c0 con 0x55bf7b3ec7f0 2024-05-08T18:50:43.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.859+0000 7f49fbfff640 1 -- 172.21.15.132:0/2019132754 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4b10011040 con 0x55bf7b3ec7f0 2024-05-08T18:50:43.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.859+0000 7f49fbfff640 1 --2- 172.21.15.132:0/2019132754 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49f003bba0 0x7f49f003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.859+0000 7f49fbfff640 1 -- 172.21.15.132:0/2019132754 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f4b1001e070 con 0x55bf7b3ec7f0 2024-05-08T18:50:43.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.859+0000 7f4b16178640 1 --2- 172.21.15.132:0/2019132754 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49f003bba0 0x7f49f003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.859+0000 7f4b1a52d800 1 Processor -- start 2024-05-08T18:50:43.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.860+0000 7f4b1a52d800 1 -- start start 2024-05-08T18:50:43.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.860+0000 7f4b16178640 1 --2- 172.21.15.132:0/2019132754 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49f003bba0 0x7f49f003e060 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55bf7b3d8f20 tx=0x7f4b0807e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.860+0000 7f4b1a52d800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b3f9a70 0x55bf7b3f9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.860+0000 7f4b1a52d800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55bf7b3ca160 con 0x55bf7b3f9a70 2024-05-08T18:50:43.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.860+0000 7f4b16979640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b3f9a70 0x55bf7b3f9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.860+0000 7f4b16979640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b3f9a70 0x55bf7b3f9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59414/0 (socket says 172.21.15.132:59414) 2024-05-08T18:50:43.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.860+0000 7f4b16979640 1 -- 172.21.15.132:0/980466870 learned_addr learned my addr 172.21.15.132:0/980466870 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:43.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.860+0000 7f4b16979640 1 -- 172.21.15.132:0/980466870 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf7b3fa460 con 0x55bf7b3f9a70 2024-05-08T18:50:43.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.861+0000 7f4b16979640 1 --2- 172.21.15.132:0/980466870 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b3f9a70 0x55bf7b3f9e90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4b10013fd0 tx=0x7f4b10011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a09c71067b5210 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.861+0000 7f49f9ffb640 1 -- 172.21.15.132:0/980466870 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b1002bc50 con 0x55bf7b3f9a70 2024-05-08T18:50:43.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.861+0000 7f49f9ffb640 1 -- 172.21.15.132:0/980466870 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b10047070 con 0x55bf7b3f9a70 2024-05-08T18:50:43.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.861+0000 7f49f9ffb640 1 -- 172.21.15.132:0/980466870 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b100167c0 con 0x55bf7b3f9a70 2024-05-08T18:50:43.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.861+0000 7f4b1a52d800 1 -- 172.21.15.132:0/980466870 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b3f9a70 msgr2=0x55bf7b3f9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.861+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/980466870 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b3f9a70 0x55bf7b3f9e90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4b10013fd0 tx=0x7f4b10011b50 comp rx=0 tx=0).stop 2024-05-08T18:50:43.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.861+0000 7f4b1a52d800 1 -- 172.21.15.132:0/980466870 shutdown_connections 2024-05-08T18:50:43.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.861+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/980466870 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b3f9a70 0x55bf7b3f9e90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.861+0000 7f4b1a52d800 1 -- 172.21.15.132:0/980466870 >> 172.21.15.132:0/980466870 conn(0x55bf7b3f5dd0 msgr2=0x55bf7b3f3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:43.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.861+0000 7f4b1a52d800 1 -- 172.21.15.132:0/980466870 shutdown_connections 2024-05-08T18:50:43.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.861+0000 7f4b1a52d800 1 -- 172.21.15.132:0/980466870 wait complete. 2024-05-08T18:50:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.861+0000 7f4b1a52d800 1 Processor -- start 2024-05-08T18:50:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.862+0000 7f4b1a52d800 1 -- start start 2024-05-08T18:50:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.862+0000 7f4b1a52d800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b3f9a70 0x55bf7b4010a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.862+0000 7f4b1a52d800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55bf7b3fabd0 con 0x55bf7b3f9a70 2024-05-08T18:50:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.862+0000 7f4b16979640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b3f9a70 0x55bf7b4010a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.862+0000 7f4b16979640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b3f9a70 0x55bf7b4010a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59424/0 (socket says 172.21.15.132:59424) 2024-05-08T18:50:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.862+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 learned_addr learned my addr 172.21.15.132:0/4072159885 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.862+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf7b4015e0 con 0x55bf7b3f9a70 2024-05-08T18:50:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.862+0000 7f4b16979640 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b3f9a70 0x55bf7b4010a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4b10011b90 tx=0x7f4b10052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.862+0000 7f49e7fff640 1 -- 172.21.15.132:0/4072159885 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b10016ac0 con 0x55bf7b3f9a70 2024-05-08T18:50:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.863+0000 7f49e7fff640 1 -- 172.21.15.132:0/4072159885 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b1002b350 con 0x55bf7b3f9a70 2024-05-08T18:50:43.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.863+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bf7b401870 con 0x55bf7b3f9a70 2024-05-08T18:50:43.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.863+0000 7f49e7fff640 1 -- 172.21.15.132:0/4072159885 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b1002b650 con 0x55bf7b3f9a70 2024-05-08T18:50:43.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.863+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf7b404520 con 0x55bf7b3f9a70 2024-05-08T18:50:43.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.863+0000 7f49e7fff640 1 -- 172.21.15.132:0/4072159885 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4b1002b8c0 con 0x55bf7b3f9a70 2024-05-08T18:50:43.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.864+0000 7f49e7fff640 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49e003bb50 0x7f49e003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.864+0000 7f49e7fff640 1 -- 172.21.15.132:0/4072159885 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f4b1000e040 con 0x55bf7b3f9a70 2024-05-08T18:50:43.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.864+0000 7f4b16178640 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49e003bb50 0x7f49e003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.864+0000 7f4b16178640 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49e003bb50 0x7f49e003e010 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4b0804ad80 tx=0x7f4b0807e420 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.864+0000 7f4b1a52d800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.864+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55bf7b40cd60 0x55bf7b40f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.864+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b40f970 con 0x55bf7b40cd60 2024-05-08T18:50:43.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.864+0000 7f4b0d977640 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55bf7b40cd60 0x55bf7b40f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.864+0000 7f4b0d977640 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55bf7b40cd60 0x55bf7b40f220 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.865+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b00009050 con 0x55bf7b40cd60 2024-05-08T18:50:43.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.865+0000 7f4b1a52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.865+0000 7f4b1a52d800 20 realm 2024-05-08T18:50:43.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.865+0000 7f4b1a52d800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.865+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b40c1b0 con 0x55bf7b40cd60 2024-05-08T18:50:43.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.865+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b00009050 con 0x55bf7b40cd60 2024-05-08T18:50:43.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.865+0000 7f4b1a52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.865+0000 7f4b1a52d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:43.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.865+0000 7f4b1a52d800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.865+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b410460 con 0x55bf7b40cd60 2024-05-08T18:50:43.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.865+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b00009050 con 0x55bf7b40cd60 2024-05-08T18:50:43.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.865+0000 7f4b1a52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.865+0000 7f4b1a52d800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.865+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b410d30 con 0x55bf7b40cd60 2024-05-08T18:50:43.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.865+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4b00009050 con 0x55bf7b40cd60 2024-05-08T18:50:43.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.865+0000 7f4b1a52d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:43.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.865+0000 7f4b1a52d800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.865+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55bf7b411670 0x55bf7b413a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.865+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b4141f0 con 0x55bf7b411670 2024-05-08T18:50:43.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.866+0000 7f4b16979640 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55bf7b411670 0x55bf7b413a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.866+0000 7f4b16979640 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55bf7b411670 0x55bf7b413a60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.866+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.866+0000 7f4b1a52d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:43.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.866+0000 7f4b1a52d800 20 searching for the correct realm 2024-05-08T18:50:43.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.866+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x55bf7b411670 2024-05-08T18:50:43.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.867+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.867+0000 7f4b16979640 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4b10038020 0x7f4b1003f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.867+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x7f4b10038020 2024-05-08T18:50:43.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.867+0000 7f4b16178640 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4b10038020 0x7f4b1003f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.867+0000 7f4b16178640 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4b10038020 0x7f4b1003f6a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.867+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b0809a040 con 0x7f4b10038020 2024-05-08T18:50:43.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.867+0000 7f4b16178640 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f4b0808c040 0x7f4b080067a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:43.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.867+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x7f4b0808c040 2024-05-08T18:50:43.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.867+0000 7f4b0d977640 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f4b0808c040 0x7f4b080067a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:43.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.868+0000 7f4b0d977640 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f4b0808c040 0x7f4b080067a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:43.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.868+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b00009050 con 0x7f4b0808c040 2024-05-08T18:50:43.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.868+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x55bf7b40cd60 2024-05-08T18:50:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.868+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b00009050 con 0x55bf7b40cd60 2024-05-08T18:50:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.868+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x55bf7b40cd60 2024-05-08T18:50:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.868+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.869+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x7f4b0808c040 2024-05-08T18:50:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.869+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.869+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x7f4b0808c040 2024-05-08T18:50:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.869+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.869+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x7f4b10038020 2024-05-08T18:50:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.869+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b0809a040 con 0x7f4b10038020 2024-05-08T18:50:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.869+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x55bf7b411670 2024-05-08T18:50:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.870+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.870+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x55bf7b40cd60 2024-05-08T18:50:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.870+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.870+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x7f4b0808c040 2024-05-08T18:50:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.870+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.870+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x55bf7b40cd60 2024-05-08T18:50:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.870+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.870+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x7f4b10038020 2024-05-08T18:50:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.871+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4b0809a040 con 0x7f4b10038020 2024-05-08T18:50:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.871+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x55bf7b411670 2024-05-08T18:50:43.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.871+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v18'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.871+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x55bf7b411670 2024-05-08T18:50:43.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.871+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.871+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x7f4b0808c040 2024-05-08T18:50:43.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.872+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.872+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x55bf7b411670 2024-05-08T18:50:43.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.872+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.872+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x55bf7b411670 2024-05-08T18:50:43.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.872+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.872+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x55bf7b40cd60 2024-05-08T18:50:43.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.872+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.872+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x55bf7b40cd60 2024-05-08T18:50:43.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.872+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.872+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x7f4b0808c040 2024-05-08T18:50:43.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.873+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.873+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x55bf7b411670 2024-05-08T18:50:43.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.873+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.873+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x7f4b10038020 2024-05-08T18:50:43.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.873+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b0809a040 con 0x7f4b10038020 2024-05-08T18:50:43.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.873+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x55bf7b40cd60 2024-05-08T18:50:43.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.874+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.874+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x7f4b0808c040 2024-05-08T18:50:43.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.874+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.874+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x55bf7b411670 2024-05-08T18:50:43.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.874+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.874+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x7f4b0808c040 2024-05-08T18:50:43.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.875+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.875+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x7f4b10038020 2024-05-08T18:50:43.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.875+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b0809a040 con 0x7f4b10038020 2024-05-08T18:50:43.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.875+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x55bf7b411670 2024-05-08T18:50:43.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.875+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.875+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415b40 con 0x7f4b0808c040 2024-05-08T18:50:43.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.875+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.875+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f4b0003a040 con 0x55bf7b40cd60 2024-05-08T18:50:43.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.876+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.876+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f4b0003a040 con 0x7f4b10038020 2024-05-08T18:50:43.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.876+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b0809a040 con 0x7f4b10038020 2024-05-08T18:50:43.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.876+0000 7f4b1a52d800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:43.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.876+0000 7f4b1a52d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:43.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.876+0000 7f4b1a52d800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:43.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.876+0000 7f4b1a52d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:43.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.876+0000 7f4b1a52d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:43.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.876+0000 7f4b1a52d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:43.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.876+0000 7f4b1a52d800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.876+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b414be0 con 0x55bf7b40cd60 2024-05-08T18:50:43.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.876+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.876+0000 7f4b1a52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.876+0000 7f4b1a52d800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.876+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415480 con 0x55bf7b40cd60 2024-05-08T18:50:43.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.876+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.876+0000 7f4b1a52d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:43.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.876+0000 7f4b1a52d800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.876+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b415fc0 con 0x55bf7b40cd60 2024-05-08T18:50:43.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.877+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.877+0000 7f4b1a52d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:43.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.877+0000 7f4b1a52d800 20 zone default found 2024-05-08T18:50:43.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.877+0000 7f4b1a52d800 4 Realm: () 2024-05-08T18:50:43.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.877+0000 7f4b1a52d800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:43.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.877+0000 7f4b1a52d800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:43.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.877+0000 7f4b1a52d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:43.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.877+0000 7f4b1a52d800 20 zonegroup default 2024-05-08T18:50:43.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.877+0000 7f4b1a52d800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.877+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b416050 con 0x7f4b0808c040 2024-05-08T18:50:43.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.877+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.877+0000 7f4b1a52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.877+0000 7f4b1a52d800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.877+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b417e70 con 0x55bf7b411670 2024-05-08T18:50:43.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.877+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.877+0000 7f4b1a52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.877+0000 7f4b1a52d800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.877+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b418210 con 0x55bf7b411670 2024-05-08T18:50:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.877+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.877+0000 7f4b1a52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.878+0000 7f4b1a52d800 20 started sync module instance, tier type = 2024-05-08T18:50:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.878+0000 7f4b1a52d800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.878+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b417310 con 0x7f4b10038020 2024-05-08T18:50:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.879+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b0809a040 con 0x7f4b10038020 2024-05-08T18:50:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.879+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94280895002368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b416f70 con 0x7f4b10038020 2024-05-08T18:50:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.879+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b419120 con 0x55bf7b40cd60 2024-05-08T18:50:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.880+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94280895002368] v25'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b0809a040 con 0x7f4b10038020 2024-05-08T18:50:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.880+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.880+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94280895007856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b419540 con 0x55bf7b40cd60 2024-05-08T18:50:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.880+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b419f00 con 0x55bf7b411670 2024-05-08T18:50:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.881+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94280895007856] v25'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.881+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.881+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94280895011888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b419540 con 0x55bf7b411670 2024-05-08T18:50:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.881+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b41a9a0 con 0x7f4b10038020 2024-05-08T18:50:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.882+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b0809a040 con 0x7f4b10038020 2024-05-08T18:50:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.882+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94280895014032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b41b240 con 0x7f4b10038020 2024-05-08T18:50:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.882+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b41bd40 con 0x55bf7b40cd60 2024-05-08T18:50:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.882+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94280895011888] v25'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.884+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.884+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94280895019056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b41bd00 con 0x55bf7b40cd60 2024-05-08T18:50:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.884+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b41c7c0 con 0x7f4b0808c040 2024-05-08T18:50:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.884+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94280895014032] v25'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b0809a040 con 0x7f4b10038020 2024-05-08T18:50:43.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.885+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.885+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94280895021776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b41c7c0 con 0x7f4b0808c040 2024-05-08T18:50:43.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.885+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b41d1d0 con 0x7f4b0808c040 2024-05-08T18:50:43.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.885+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94280895019056] v25'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.886+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(56 notify.6 [create] v25'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.886+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94280895008912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b41d1d0 con 0x7f4b0808c040 2024-05-08T18:50:43.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.886+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b41db90 con 0x7f4b0808c040 2024-05-08T18:50:43.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.886+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94280895021776] v25'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.887+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94280895008912] v25'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.887+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.887+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94280895024416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b41d140 con 0x7f4b0808c040 2024-05-08T18:50:43.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.887+0000 7f4b1a52d800 20 add_watcher() i=0 2024-05-08T18:50:43.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.887+0000 7f4b1a52d800 20 add_watcher() i=1 2024-05-08T18:50:43.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.887+0000 7f4b1a52d800 20 add_watcher() i=2 2024-05-08T18:50:43.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.887+0000 7f4b1a52d800 20 add_watcher() i=3 2024-05-08T18:50:43.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.887+0000 7f4b1a52d800 20 add_watcher() i=4 2024-05-08T18:50:43.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.887+0000 7f4b1a52d800 20 add_watcher() i=5 2024-05-08T18:50:43.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.887+0000 7f4b1a52d800 20 add_watcher() i=6 2024-05-08T18:50:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.888+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94280895024416] v25'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.888+0000 7f4b1a52d800 20 add_watcher() i=7 2024-05-08T18:50:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.888+0000 7f4b1a52d800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.888+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b420bc0 con 0x55bf7b40cd60 2024-05-08T18:50:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.889+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.889+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94280895026912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b41dfb0 con 0x55bf7b40cd60 2024-05-08T18:50:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.890+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94280895026912] v25'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.890+0000 7f49ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.890+0000 7f4b1a52d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.890+0000 7f4b1a52d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.890+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b429380 con 0x55bf7b40cd60 2024-05-08T18:50:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.891+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v25'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.891+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b4299d0 con 0x7f4b0808c040 2024-05-08T18:50:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.893+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v25'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.893+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b429e10 con 0x55bf7b411670 2024-05-08T18:50:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.894+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v25'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.894+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b429e00 con 0x55bf7b40cd60 2024-05-08T18:50:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.895+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v25'32 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.895+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42a370 con 0x7f4b10038020 2024-05-08T18:50:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.896+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v25'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b0809a040 con 0x7f4b10038020 2024-05-08T18:50:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.896+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42a8e0 con 0x55bf7b411670 2024-05-08T18:50:43.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.897+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v25'15 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.897+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42a970 con 0x55bf7b40cd60 2024-05-08T18:50:43.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.898+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v25'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.898+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aa00 con 0x7f4b0808c040 2024-05-08T18:50:43.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.899+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v25'15 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.899+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42ab30 con 0x7f4b10038020 2024-05-08T18:50:43.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.900+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v25'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b0809a040 con 0x7f4b10038020 2024-05-08T18:50:43.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.900+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x55bf7b411670 2024-05-08T18:50:43.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.901+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v25'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.901+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x7f4b10038020 2024-05-08T18:50:43.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.904+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v25'24 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b0809a040 con 0x7f4b10038020 2024-05-08T18:50:43.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.904+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x7f4b0808c040 2024-05-08T18:50:43.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.905+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v25'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.905+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x7f4b10038020 2024-05-08T18:50:43.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.906+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v25'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b0809a040 con 0x7f4b10038020 2024-05-08T18:50:43.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.907+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x7f4b0808c040 2024-05-08T18:50:43.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.909+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v25'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.909+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x55bf7b40cd60 2024-05-08T18:50:43.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.910+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v25'33 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.910+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x55bf7b411670 2024-05-08T18:50:43.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.911+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v25'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.911+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x7f4b10038020 2024-05-08T18:50:43.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.912+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v25'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b0809a040 con 0x7f4b10038020 2024-05-08T18:50:43.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.912+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x55bf7b411670 2024-05-08T18:50:43.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.915+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v25'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.915+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x55bf7b40cd60 2024-05-08T18:50:43.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.916+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v25'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.916+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x55bf7b40cd60 2024-05-08T18:50:43.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.917+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v25'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.917+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x55bf7b411670 2024-05-08T18:50:43.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.918+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v25'18 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.918+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x7f4b10038020 2024-05-08T18:50:43.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.919+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v25'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b0809a040 con 0x7f4b10038020 2024-05-08T18:50:43.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.919+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x55bf7b411670 2024-05-08T18:50:43.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.922+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v25'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.922+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x55bf7b411670 2024-05-08T18:50:43.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.923+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v25'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.923+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x55bf7b411670 2024-05-08T18:50:43.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.925+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v25'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.925+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x55bf7b411670 2024-05-08T18:50:43.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.926+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v25'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.926+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x7f4b0808c040 2024-05-08T18:50:43.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.928+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v25'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.928+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x55bf7b411670 2024-05-08T18:50:43.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.929+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v25'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.929+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x7f4b0808c040 2024-05-08T18:50:43.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.930+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v25'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.930+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x55bf7b411670 2024-05-08T18:50:43.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.934+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v25'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.934+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x7f4b0808c040 2024-05-08T18:50:43.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.935+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v25'22 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.935+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b42aff0 con 0x7f4b10038020 2024-05-08T18:50:43.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.937+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v25'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b0809a040 con 0x7f4b10038020 2024-05-08T18:50:43.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.937+0000 7f49477fe640 20 reqs_thread_entry: start 2024-05-08T18:50:43.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.937+0000 7f4b1a52d800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:43.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.937+0000 7f4b1a52d800 20 Filter name: none 2024-05-08T18:50:43.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.937+0000 7f49457fa640 20 reqs_thread_entry: start 2024-05-08T18:50:43.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.937+0000 7f4b1a52d800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-05-08T18:50:43.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.937+0000 7f4b1a52d800 20 rados->read ofs=0 len=0 2024-05-08T18:50:43.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.937+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b455f30 con 0x7f4b0808c040 2024-05-08T18:50:43.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.938+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.938+0000 7f4b1a52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:43.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.938+0000 7f4b1a52d800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-05-08T18:50:43.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.938+0000 7f4b1a52d800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-05-08T18:50:43.938 INFO:teuthology.orchestra.run.smithi132.stderr:could not remove user: unable to remove user, user does not exist 2024-05-08T18:50:43.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.938+0000 7f49ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:43.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.938+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94280895026912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b426fb0 con 0x55bf7b40cd60 2024-05-08T18:50:43.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.939+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94280895026912] v25'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.939+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94280895002368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b41d6e0 con 0x7f4b10038020 2024-05-08T18:50:43.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.942+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94280895002368] v25'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b0809a040 con 0x7f4b10038020 2024-05-08T18:50:43.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.942+0000 7f4b1a52d800 20 remove_watcher() i=0 2024-05-08T18:50:43.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.942+0000 7f4b1a52d800 2 removed watcher, disabling cache 2024-05-08T18:50:43.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.942+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94280895007856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b41d6e0 con 0x55bf7b40cd60 2024-05-08T18:50:43.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.943+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94280895007856] v25'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.943+0000 7f4b1a52d800 20 remove_watcher() i=1 2024-05-08T18:50:43.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.943+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94280895011888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b418c70 con 0x55bf7b411670 2024-05-08T18:50:43.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.945+0000 7f4b16979640 1 -- 172.21.15.132:0/4072159885 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94280895011888] v25'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b1003f070 con 0x55bf7b411670 2024-05-08T18:50:43.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.945+0000 7f4b1a52d800 20 remove_watcher() i=2 2024-05-08T18:50:43.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.945+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94280895014032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b41d6e0 con 0x7f4b10038020 2024-05-08T18:50:43.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.946+0000 7f4b16178640 1 -- 172.21.15.132:0/4072159885 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94280895014032] v25'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b0809a040 con 0x7f4b10038020 2024-05-08T18:50:43.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.946+0000 7f4b1a52d800 20 remove_watcher() i=3 2024-05-08T18:50:43.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.946+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94280895019056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b419c30 con 0x55bf7b40cd60 2024-05-08T18:50:43.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.948+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94280895019056] v25'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x55bf7b40cd60 2024-05-08T18:50:43.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.948+0000 7f4b1a52d800 20 remove_watcher() i=4 2024-05-08T18:50:43.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.948+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94280895021776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b418c70 con 0x7f4b0808c040 2024-05-08T18:50:43.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.949+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94280895021776] v25'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.949+0000 7f4b1a52d800 20 remove_watcher() i=5 2024-05-08T18:50:43.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.949+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94280895008912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b41d6e0 con 0x7f4b0808c040 2024-05-08T18:50:43.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.951+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94280895008912] v25'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.951+0000 7f4b1a52d800 20 remove_watcher() i=6 2024-05-08T18:50:43.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.951+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94280895024416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55bf7b41b830 con 0x7f4b0808c040 2024-05-08T18:50:43.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.952+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94280895024416] v25'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b00029040 con 0x7f4b0808c040 2024-05-08T18:50:43.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.952+0000 7f4b1a52d800 20 remove_watcher() i=7 2024-05-08T18:50:43.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.952+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f4b0808c040 msgr2=0x7f4b080067a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.952+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f4b0808c040 0x7f4b080067a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.952+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55bf7b40cd60 msgr2=0x55bf7b40f220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.952+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55bf7b40cd60 0x55bf7b40f220 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.952+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4b10038020 msgr2=0x7f4b1003f6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.952+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4b10038020 0x7f4b1003f6a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.952+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55bf7b411670 msgr2=0x55bf7b413a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.952+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55bf7b411670 0x55bf7b413a60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.952+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49e003bb50 msgr2=0x7f49e003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.952+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49e003bb50 0x7f49e003e010 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4b0804ad80 tx=0x7f4b0807e420 comp rx=0 tx=0).stop 2024-05-08T18:50:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.952+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b3f9a70 msgr2=0x55bf7b4010a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.952+0000 7f4b0d977640 1 -- 172.21.15.132:0/4072159885 reap_dead start 2024-05-08T18:50:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.952+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b3f9a70 0x55bf7b4010a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4b10011b90 tx=0x7f4b10052be0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.952+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 shutdown_connections 2024-05-08T18:50:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.952+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/4072159885 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b3f9a70 0x55bf7b4010a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.952+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 >> 172.21.15.132:0/4072159885 conn(0x55bf7b3f5dd0 msgr2=0x55bf7b3f3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.952+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 shutdown_connections 2024-05-08T18:50:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.952+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4072159885 wait complete. 2024-05-08T18:50:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 -- 172.21.15.132:0/2019132754 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49f003bba0 msgr2=0x7f49f003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/2019132754 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49f003bba0 0x7f49f003e060 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55bf7b3d8f20 tx=0x7f4b0807e040 comp rx=0 tx=0).stop 2024-05-08T18:50:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 -- 172.21.15.132:0/2019132754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b3ec7f0 msgr2=0x55bf7b3ecc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/2019132754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b3ec7f0 0x55bf7b3ecc10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55bf7b3d8e80 tx=0x7f4b10018830 comp rx=0 tx=0).stop 2024-05-08T18:50:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 -- 172.21.15.132:0/2019132754 shutdown_connections 2024-05-08T18:50:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/2019132754 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49f003bba0 0x7f49f003e060 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/2019132754 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b3ec7f0 0x55bf7b3ecc10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 -- 172.21.15.132:0/2019132754 >> 172.21.15.132:0/2019132754 conn(0x55bf7b3e0890 msgr2=0x55bf7b3e0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 -- 172.21.15.132:0/2019132754 shutdown_connections 2024-05-08T18:50:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 -- 172.21.15.132:0/2019132754 wait complete. 2024-05-08T18:50:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4276437851 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55bf7b24bdc0 msgr2=0x55bf7b3d84d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/4276437851 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55bf7b24bdc0 0x55bf7b3d84d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4276437851 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55bf7b3dadd0 msgr2=0x55bf7b3dd1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/4276437851 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55bf7b3dadd0 0x55bf7b3dd1c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4276437851 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49fc03bb50 msgr2=0x7f49fc03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/4276437851 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49fc03bb50 0x7f49fc03e010 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4b00000f60 tx=0x7f4b000012b0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4276437851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b24a860 msgr2=0x55bf7b3d1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/4276437851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b24a860 0x55bf7b3d1290 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4b08052460 tx=0x7f4b08002fb0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4276437851 shutdown_connections 2024-05-08T18:50:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/4276437851 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55bf7b3dadd0 0x55bf7b3dd1c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/4276437851 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55bf7b24bdc0 0x55bf7b3d84d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/4276437851 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49fc03bb50 0x7f49fc03e010 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 --2- 172.21.15.132:0/4276437851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55bf7b24a860 0x55bf7b3d1290 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4276437851 >> 172.21.15.132:0/4276437851 conn(0x55bf7b2d1830 msgr2=0x55bf7b3c39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:43.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4276437851 shutdown_connections 2024-05-08T18:50:43.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:43.953+0000 7f4b1a52d800 1 -- 172.21.15.132:0/4276437851 wait complete. 2024-05-08T18:50:43.961 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-08T18:50:43.962 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-05-08T18:50:43.962 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-05-08T18:50:43.962 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-05-08T18:50:44.006 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:44.006 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.008+0000 7ffa2363f800 1 Processor -- start 2024-05-08T18:50:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.008+0000 7ffa2363f800 1 -- start start 2024-05-08T18:50:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.008+0000 7ffa2363f800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x56282a1dbcd0 0x56282a1de0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.008+0000 7ffa2363f800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56282a1e2110 con 0x56282a1de600 2024-05-08T18:50:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.008+0000 7ffa2363f800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x56282a07be20 con 0x56282a1dbcd0 2024-05-08T18:50:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.008+0000 7ffa21137640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x56282a1dbcd0 0x56282a1de0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.008+0000 7ffa21137640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x56282a1dbcd0 0x56282a1de0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59436/0 (socket says 172.21.15.132:59436) 2024-05-08T18:50:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.008+0000 7ffa21137640 1 -- 172.21.15.132:0/3079153927 learned_addr learned my addr 172.21.15.132:0/3079153927 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.008+0000 7ffa20936640 1 --1- 172.21.15.132:0/3079153927 >> v1:172.21.15.42:6789/0 conn(0x56282a1de600 0x56282a1e09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46654/0 (socket says 172.21.15.132:46654) 2024-05-08T18:50:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.008+0000 7ffa21137640 1 -- 172.21.15.132:0/3079153927 >> v1:172.21.15.42:6789/0 conn(0x56282a1de600 legacy=0x56282a1e09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.008+0000 7ffa21137640 1 -- 172.21.15.132:0/3079153927 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56282a1e32f0 con 0x56282a1dbcd0 2024-05-08T18:50:44.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.010+0000 7ffa21137640 1 --2- 172.21.15.132:0/3079153927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a1dbcd0 0x56282a1de0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffa14005fd0 tx=0x7ffa1401cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4fde342fcb26555 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.010+0000 7ffa13fff640 1 -- 172.21.15.132:0/3079153927 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa14052540 con 0x56282a1dbcd0 2024-05-08T18:50:44.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.011+0000 7ffa13fff640 1 -- 172.21.15.132:0/3079153927 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa1404e070 con 0x56282a1dbcd0 2024-05-08T18:50:44.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.011+0000 7ffa13fff640 1 -- 172.21.15.132:0/3079153927 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa14052890 con 0x56282a1dbcd0 2024-05-08T18:50:44.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.011+0000 7ffa2363f800 1 -- 172.21.15.132:0/3079153927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a1dbcd0 msgr2=0x56282a1de0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.011+0000 7ffa2363f800 1 --2- 172.21.15.132:0/3079153927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a1dbcd0 0x56282a1de0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffa14005fd0 tx=0x7ffa1401cd80 comp rx=0 tx=0).stop 2024-05-08T18:50:44.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.011+0000 7ffa2363f800 1 -- 172.21.15.132:0/3079153927 shutdown_connections 2024-05-08T18:50:44.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.011+0000 7ffa2363f800 1 --2- 172.21.15.132:0/3079153927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a1dbcd0 0x56282a1de0c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.011+0000 7ffa2363f800 1 -- 172.21.15.132:0/3079153927 >> 172.21.15.132:0/3079153927 conn(0x56282a1d5720 msgr2=0x56282a1d7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.011+0000 7ffa2363f800 1 -- 172.21.15.132:0/3079153927 shutdown_connections 2024-05-08T18:50:44.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.011+0000 7ffa2363f800 1 -- 172.21.15.132:0/3079153927 wait complete. 2024-05-08T18:50:44.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.026+0000 7ffa2363f800 1 Processor -- start 2024-05-08T18:50:44.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.026+0000 7ffa2363f800 1 -- start start 2024-05-08T18:50:44.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.026+0000 7ffa2363f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a1dbcd0 0x56282a1db610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.026+0000 7ffa2363f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56282a1265b0 con 0x56282a1dbcd0 2024-05-08T18:50:44.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.026+0000 7ffa21137640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a1dbcd0 0x56282a1db610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.026+0000 7ffa21137640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a1dbcd0 0x56282a1db610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59442/0 (socket says 172.21.15.132:59442) 2024-05-08T18:50:44.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.026+0000 7ffa21137640 1 -- 172.21.15.132:0/1690667229 learned_addr learned my addr 172.21.15.132:0/1690667229 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.026+0000 7ffa21137640 1 -- 172.21.15.132:0/1690667229 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56282a1d9bd0 con 0x56282a1dbcd0 2024-05-08T18:50:44.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.027+0000 7ffa21137640 1 --2- 172.21.15.132:0/1690667229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a1dbcd0 0x56282a1db610 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400a190 tx=0x7ffa1404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611f7266aaa330ff server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.027+0000 7ff90f606640 1 -- 172.21.15.132:0/1690667229 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa14052410 con 0x56282a1dbcd0 2024-05-08T18:50:44.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.027+0000 7ff90f606640 1 -- 172.21.15.132:0/1690667229 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa14062070 con 0x56282a1dbcd0 2024-05-08T18:50:44.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.027+0000 7ff90f606640 1 -- 172.21.15.132:0/1690667229 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa14052700 con 0x56282a1dbcd0 2024-05-08T18:50:44.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.028+0000 7ffa2363f800 1 -- 172.21.15.132:0/1690667229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a1dbcd0 msgr2=0x56282a1db610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.028+0000 7ffa2363f800 1 --2- 172.21.15.132:0/1690667229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a1dbcd0 0x56282a1db610 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400a190 tx=0x7ffa1404c000 comp rx=0 tx=0).stop 2024-05-08T18:50:44.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.028+0000 7ffa2363f800 1 -- 172.21.15.132:0/1690667229 shutdown_connections 2024-05-08T18:50:44.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.028+0000 7ffa2363f800 1 --2- 172.21.15.132:0/1690667229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a1dbcd0 0x56282a1db610 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.028+0000 7ffa2363f800 1 -- 172.21.15.132:0/1690667229 >> 172.21.15.132:0/1690667229 conn(0x56282a1d5720 msgr2=0x56282a2c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.028+0000 7ffa2363f800 1 -- 172.21.15.132:0/1690667229 shutdown_connections 2024-05-08T18:50:44.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.028+0000 7ffa2363f800 1 -- 172.21.15.132:0/1690667229 wait complete. 2024-05-08T18:50:44.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.028+0000 7ffa2363f800 1 Processor -- start 2024-05-08T18:50:44.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.028+0000 7ffa2363f800 1 -- start start 2024-05-08T18:50:44.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.028+0000 7ffa2363f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a1dbcd0 0x56282a2d6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.028+0000 7ffa2363f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56282a1e2580 con 0x56282a1dbcd0 2024-05-08T18:50:44.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.029+0000 7ffa21137640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a1dbcd0 0x56282a2d6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.029+0000 7ffa21137640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a1dbcd0 0x56282a2d6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59452/0 (socket says 172.21.15.132:59452) 2024-05-08T18:50:44.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.029+0000 7ffa21137640 1 -- 172.21.15.132:0/2203990513 learned_addr learned my addr 172.21.15.132:0/2203990513 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.029+0000 7ffa21137640 1 -- 172.21.15.132:0/2203990513 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56282a2d67b0 con 0x56282a1dbcd0 2024-05-08T18:50:44.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.029+0000 7ffa21137640 1 --2- 172.21.15.132:0/2203990513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a1dbcd0 0x56282a2d6270 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffa14000f80 tx=0x7ffa14003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.029+0000 7ff90de03640 1 -- 172.21.15.132:0/2203990513 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1405d630 con 0x56282a1dbcd0 2024-05-08T18:50:44.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.029+0000 7ff90de03640 1 -- 172.21.15.132:0/2203990513 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa14058040 con 0x56282a1dbcd0 2024-05-08T18:50:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.029+0000 7ffa2363f800 1 -- 172.21.15.132:0/2203990513 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56282a2d6a40 con 0x56282a1dbcd0 2024-05-08T18:50:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.029+0000 7ff90de03640 1 -- 172.21.15.132:0/2203990513 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1405d920 con 0x56282a1dbcd0 2024-05-08T18:50:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.030+0000 7ffa2363f800 1 -- 172.21.15.132:0/2203990513 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56282a2d96f0 con 0x56282a1dbcd0 2024-05-08T18:50:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.030+0000 7ff90de03640 1 -- 172.21.15.132:0/2203990513 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ffa14050070 con 0x56282a1dbcd0 2024-05-08T18:50:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.030+0000 7ff90de03640 1 --2- 172.21.15.132:0/2203990513 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff90803bb50 0x7ff90803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.030+0000 7ff90de03640 1 -- 172.21.15.132:0/2203990513 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7ffa140947e0 con 0x56282a1dbcd0 2024-05-08T18:50:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.031+0000 7ffa20936640 1 --2- 172.21.15.132:0/2203990513 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff90803bb50 0x7ff90803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.031+0000 7ffa2363f800 1 --2- 172.21.15.132:0/2203990513 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56282a1de600 0x56282a2dd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.031+0000 7ffa2363f800 1 -- 172.21.15.132:0/2203990513 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56282a2dda30 con 0x56282a1de600 2024-05-08T18:50:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.031+0000 7ffa21938640 1 --2- 172.21.15.132:0/2203990513 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56282a1de600 0x56282a2dd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.031+0000 7ffa20936640 1 --2- 172.21.15.132:0/2203990513 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff90803bb50 0x7ff90803e010 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffa18000f60 tx=0x7ffa18001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.031+0000 7ffa21938640 1 --2- 172.21.15.132:0/2203990513 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56282a1de600 0x56282a2dd4b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.032+0000 7ffa21938640 1 -- 172.21.15.132:0/2203990513 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa1c0083e0 con 0x56282a1de600 2024-05-08T18:50:44.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.032+0000 7ffa2363f800 1 -- 172.21.15.132:0/2203990513 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56282a2daa40 con 0x56282a1de600 2024-05-08T18:50:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.032+0000 7ffa21938640 1 -- 172.21.15.132:0/2203990513 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa1c0083e0 con 0x56282a1de600 2024-05-08T18:50:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.032+0000 7ffa2363f800 1 --2- 172.21.15.132:0/2203990513 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56282a2dfd90 0x56282a2e2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.032+0000 7ffa21137640 1 --2- 172.21.15.132:0/2203990513 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56282a2dfd90 0x56282a2e2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.032+0000 7ffa2363f800 1 -- 172.21.15.132:0/2203990513 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56282a2e2850 con 0x56282a2dfd90 2024-05-08T18:50:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.033+0000 7ffa21137640 1 --2- 172.21.15.132:0/2203990513 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56282a2dfd90 0x56282a2e2180 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.033+0000 7ffa21137640 1 -- 172.21.15.132:0/2203990513 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffa14077020 con 0x56282a2dfd90 2024-05-08T18:50:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.033+0000 7ffa2363f800 1 -- 172.21.15.132:0/2203990513 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56282a2dec00 con 0x56282a1de600 2024-05-08T18:50:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.033+0000 7ffa21938640 1 -- 172.21.15.132:0/2203990513 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa1c0083e0 con 0x56282a1de600 2024-05-08T18:50:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.033+0000 7ffa2363f800 1 -- 172.21.15.132:0/2203990513 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56282a2df0a0 con 0x56282a1de600 2024-05-08T18:50:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.033+0000 7ffa21938640 1 -- 172.21.15.132:0/2203990513 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffa1c0083e0 con 0x56282a1de600 2024-05-08T18:50:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.034+0000 7ffa2363f800 1 Processor -- start 2024-05-08T18:50:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.034+0000 7ffa2363f800 1 -- start start 2024-05-08T18:50:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.034+0000 7ffa2363f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a2f17a0 0x56282a2f1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.034+0000 7ffa2363f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56282a0ccfc0 con 0x56282a2f17a0 2024-05-08T18:50:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.034+0000 7ffa21938640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a2f17a0 0x56282a2f1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.034+0000 7ffa21938640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a2f17a0 0x56282a2f1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59454/0 (socket says 172.21.15.132:59454) 2024-05-08T18:50:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.034+0000 7ffa21938640 1 -- 172.21.15.132:0/1496873870 learned_addr learned my addr 172.21.15.132:0/1496873870 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.035+0000 7ffa21938640 1 -- 172.21.15.132:0/1496873870 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56282a2f2100 con 0x56282a2f17a0 2024-05-08T18:50:44.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.035+0000 7ffa21938640 1 --2- 172.21.15.132:0/1496873870 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a2f17a0 0x56282a2f1bc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x56282a2d7490 tx=0x7ffa1c008f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.035+0000 7ff906ffd640 1 -- 172.21.15.132:0/1496873870 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1c007ca0 con 0x56282a2f17a0 2024-05-08T18:50:44.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.035+0000 7ffa2363f800 1 -- 172.21.15.132:0/1496873870 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56282a2f2b70 con 0x56282a2f17a0 2024-05-08T18:50:44.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.035+0000 7ff906ffd640 1 -- 172.21.15.132:0/1496873870 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa1c01e020 con 0x56282a2f17a0 2024-05-08T18:50:44.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.035+0000 7ffa2363f800 1 -- 172.21.15.132:0/1496873870 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56282a2f3070 con 0x56282a2f17a0 2024-05-08T18:50:44.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.035+0000 7ff906ffd640 1 -- 172.21.15.132:0/1496873870 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1c019420 con 0x56282a2f17a0 2024-05-08T18:50:44.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.036+0000 7ff906ffd640 1 -- 172.21.15.132:0/1496873870 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ffa1c016040 con 0x56282a2f17a0 2024-05-08T18:50:44.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.036+0000 7ff906ffd640 1 --2- 172.21.15.132:0/1496873870 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8f803bb50 0x7ff8f803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.036+0000 7ff906ffd640 1 -- 172.21.15.132:0/1496873870 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7ffa1c01f030 con 0x56282a2f17a0 2024-05-08T18:50:44.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.036+0000 7ffa21137640 1 --2- 172.21.15.132:0/1496873870 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8f803bb50 0x7ff8f803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.037+0000 7ffa2363f800 1 Processor -- start 2024-05-08T18:50:44.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.037+0000 7ffa21137640 1 --2- 172.21.15.132:0/1496873870 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8f803bb50 0x7ff8f803e010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffa14092e40 tx=0x7ffa1407acc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.037+0000 7ffa2363f800 1 -- start start 2024-05-08T18:50:44.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.037+0000 7ffa2363f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a2feae0 0x56282a2fef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.037+0000 7ffa2363f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56282a1d9e90 con 0x56282a2feae0 2024-05-08T18:50:44.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.037+0000 7ffa21938640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a2feae0 0x56282a2fef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.037+0000 7ffa21938640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a2feae0 0x56282a2fef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59466/0 (socket says 172.21.15.132:59466) 2024-05-08T18:50:44.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.037+0000 7ffa21938640 1 -- 172.21.15.132:0/1105992172 learned_addr learned my addr 172.21.15.132:0/1105992172 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.037+0000 7ffa21938640 1 -- 172.21.15.132:0/1105992172 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56282a2ff4d0 con 0x56282a2feae0 2024-05-08T18:50:44.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.038+0000 7ffa21938640 1 --2- 172.21.15.132:0/1105992172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a2feae0 0x56282a2fef00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c052f00 tx=0x7ffa1c040950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25ffbb3ad8f6723 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.038+0000 7ff904ff9640 1 -- 172.21.15.132:0/1105992172 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1c044020 con 0x56282a2feae0 2024-05-08T18:50:44.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.038+0000 7ff904ff9640 1 -- 172.21.15.132:0/1105992172 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa1c015c20 con 0x56282a2feae0 2024-05-08T18:50:44.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.038+0000 7ff904ff9640 1 -- 172.21.15.132:0/1105992172 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1c01d040 con 0x56282a2feae0 2024-05-08T18:50:44.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.038+0000 7ffa2363f800 1 -- 172.21.15.132:0/1105992172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a2feae0 msgr2=0x56282a2fef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.038+0000 7ffa2363f800 1 --2- 172.21.15.132:0/1105992172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a2feae0 0x56282a2fef00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c052f00 tx=0x7ffa1c040950 comp rx=0 tx=0).stop 2024-05-08T18:50:44.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.038+0000 7ffa2363f800 1 -- 172.21.15.132:0/1105992172 shutdown_connections 2024-05-08T18:50:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.038+0000 7ffa2363f800 1 --2- 172.21.15.132:0/1105992172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a2feae0 0x56282a2fef00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.038+0000 7ffa2363f800 1 -- 172.21.15.132:0/1105992172 >> 172.21.15.132:0/1105992172 conn(0x56282a2fadf0 msgr2=0x56282a2f8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.038+0000 7ffa2363f800 1 -- 172.21.15.132:0/1105992172 shutdown_connections 2024-05-08T18:50:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.038+0000 7ffa2363f800 1 -- 172.21.15.132:0/1105992172 wait complete. 2024-05-08T18:50:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.039+0000 7ffa2363f800 1 Processor -- start 2024-05-08T18:50:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.039+0000 7ffa2363f800 1 -- start start 2024-05-08T18:50:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.039+0000 7ffa2363f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a2feae0 0x56282a305f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.039+0000 7ffa2363f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56282a2ffc50 con 0x56282a2feae0 2024-05-08T18:50:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.039+0000 7ffa21938640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a2feae0 0x56282a305f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.039+0000 7ffa21938640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a2feae0 0x56282a305f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59478/0 (socket says 172.21.15.132:59478) 2024-05-08T18:50:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.039+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 learned_addr learned my addr 172.21.15.132:0/434712196 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.039+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56282a3064a0 con 0x56282a2feae0 2024-05-08T18:50:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.040+0000 7ffa21938640 1 --2- 172.21.15.132:0/434712196 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a2feae0 0x56282a305f60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0238c0 tx=0x7ffa1c052e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.040+0000 7ff8f6ffd640 1 -- 172.21.15.132:0/434712196 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1c01d030 con 0x56282a2feae0 2024-05-08T18:50:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.040+0000 7ff8f6ffd640 1 -- 172.21.15.132:0/434712196 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa1c0176e0 con 0x56282a2feae0 2024-05-08T18:50:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.040+0000 7ff8f6ffd640 1 -- 172.21.15.132:0/434712196 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1c04b040 con 0x56282a2feae0 2024-05-08T18:50:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.040+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56282a306730 con 0x56282a2feae0 2024-05-08T18:50:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.040+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56282a3093e0 con 0x56282a2feae0 2024-05-08T18:50:44.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.040+0000 7ff8f6ffd640 1 -- 172.21.15.132:0/434712196 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ffa1c054ad0 con 0x56282a2feae0 2024-05-08T18:50:44.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.041+0000 7ff8f6ffd640 1 --2- 172.21.15.132:0/434712196 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8ec03bb50 0x7ff8ec03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.041+0000 7ff8f6ffd640 1 -- 172.21.15.132:0/434712196 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7ffa1c053010 con 0x56282a2feae0 2024-05-08T18:50:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.041+0000 7ffa21137640 1 --2- 172.21.15.132:0/434712196 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8ec03bb50 0x7ff8ec03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.041+0000 7ffa21137640 1 --2- 172.21.15.132:0/434712196 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8ec03bb50 0x7ff8ec03e010 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffa1407ae30 tx=0x7ffa14085000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.041+0000 7ffa2363f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.041+0000 7ffa2363f800 1 --2- 172.21.15.132:0/434712196 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56282a311ac0 0x56282a313f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.041+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56282a3146d0 con 0x56282a311ac0 2024-05-08T18:50:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.042+0000 7ffa20936640 1 --2- 172.21.15.132:0/434712196 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56282a311ac0 0x56282a313f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.042+0000 7ffa20936640 1 --2- 172.21.15.132:0/434712196 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56282a311ac0 0x56282a313f80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.042+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa1800f610 con 0x56282a311ac0 2024-05-08T18:50:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.042+0000 7ffa2363f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.042+0000 7ffa2363f800 20 realm 2024-05-08T18:50:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.042+0000 7ffa2363f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.042+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56282a310f10 con 0x56282a311ac0 2024-05-08T18:50:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.042+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa1800f610 con 0x56282a311ac0 2024-05-08T18:50:44.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.042+0000 7ffa2363f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.042+0000 7ffa2363f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.042+0000 7ffa2363f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.042+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56282a3151c0 con 0x56282a311ac0 2024-05-08T18:50:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.043+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa1800f610 con 0x56282a311ac0 2024-05-08T18:50:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.043+0000 7ffa2363f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.043+0000 7ffa2363f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.043+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56282a315a90 con 0x56282a311ac0 2024-05-08T18:50:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.043+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa1800f610 con 0x56282a311ac0 2024-05-08T18:50:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.043+0000 7ffa2363f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.043+0000 7ffa2363f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.043+0000 7ffa2363f800 1 --2- 172.21.15.132:0/434712196 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56282a3164b0 0x56282a3188a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.043+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56282a318fe0 con 0x56282a3164b0 2024-05-08T18:50:44.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.043+0000 7ffa21938640 1 --2- 172.21.15.132:0/434712196 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56282a3164b0 0x56282a3188a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.043+0000 7ffa21938640 1 --2- 172.21.15.132:0/434712196 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56282a3164b0 0x56282a3188a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.044+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.044+0000 7ffa2363f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.044+0000 7ffa2363f800 20 searching for the correct realm 2024-05-08T18:50:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.044+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x56282a3164b0 2024-05-08T18:50:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.044+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.044+0000 7ffa21938640 1 --2- 172.21.15.132:0/434712196 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7ffa1c019040 0x7ffa1c051190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.044+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x7ffa1c019040 2024-05-08T18:50:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.044+0000 7ffa21137640 1 --2- 172.21.15.132:0/434712196 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7ffa1c019040 0x7ffa1c051190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.045+0000 7ffa21137640 1 --2- 172.21.15.132:0/434712196 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7ffa1c019040 0x7ffa1c051190 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.045+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa14077020 con 0x7ffa1c019040 2024-05-08T18:50:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.045+0000 7ffa21137640 1 --2- 172.21.15.132:0/434712196 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7ffa140a1040 0x7ffa14070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.045+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x7ffa140a1040 2024-05-08T18:50:44.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.045+0000 7ffa20936640 1 --2- 172.21.15.132:0/434712196 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7ffa140a1040 0x7ffa14070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.045+0000 7ffa20936640 1 --2- 172.21.15.132:0/434712196 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7ffa140a1040 0x7ffa14070600 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.046+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1800f610 con 0x7ffa140a1040 2024-05-08T18:50:44.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.046+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x56282a311ac0 2024-05-08T18:50:44.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.046+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1800f610 con 0x56282a311ac0 2024-05-08T18:50:44.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.046+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x56282a311ac0 2024-05-08T18:50:44.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.046+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1802b040 con 0x56282a311ac0 2024-05-08T18:50:44.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.046+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x7ffa140a1040 2024-05-08T18:50:44.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.047+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1802b040 con 0x7ffa140a1040 2024-05-08T18:50:44.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.047+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x7ffa140a1040 2024-05-08T18:50:44.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.047+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1802b040 con 0x7ffa140a1040 2024-05-08T18:50:44.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.047+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x7ffa1c019040 2024-05-08T18:50:44.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.047+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa14077020 con 0x7ffa1c019040 2024-05-08T18:50:44.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.047+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x56282a3164b0 2024-05-08T18:50:44.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.047+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.047+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x56282a311ac0 2024-05-08T18:50:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.048+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1802b040 con 0x56282a311ac0 2024-05-08T18:50:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.048+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x7ffa140a1040 2024-05-08T18:50:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.048+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1802b040 con 0x7ffa140a1040 2024-05-08T18:50:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.048+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x56282a311ac0 2024-05-08T18:50:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.048+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffa1802b040 con 0x56282a311ac0 2024-05-08T18:50:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.048+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x7ffa1c019040 2024-05-08T18:50:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.048+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffa14077020 con 0x7ffa1c019040 2024-05-08T18:50:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.048+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x56282a3164b0 2024-05-08T18:50:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.049+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v18'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.049+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x56282a3164b0 2024-05-08T18:50:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.049+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.049+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x7ffa140a1040 2024-05-08T18:50:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.049+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1802b040 con 0x7ffa140a1040 2024-05-08T18:50:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.050+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x56282a3164b0 2024-05-08T18:50:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.050+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.050+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x56282a3164b0 2024-05-08T18:50:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.050+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.050+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x56282a311ac0 2024-05-08T18:50:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.050+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1802b040 con 0x56282a311ac0 2024-05-08T18:50:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.050+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x56282a311ac0 2024-05-08T18:50:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.050+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffa1802b040 con 0x56282a311ac0 2024-05-08T18:50:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.050+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x7ffa140a1040 2024-05-08T18:50:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.051+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1802b040 con 0x7ffa140a1040 2024-05-08T18:50:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.051+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x56282a3164b0 2024-05-08T18:50:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.051+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.051+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x7ffa1c019040 2024-05-08T18:50:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.051+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa14077020 con 0x7ffa1c019040 2024-05-08T18:50:44.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.051+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x56282a311ac0 2024-05-08T18:50:44.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.051+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1802b040 con 0x56282a311ac0 2024-05-08T18:50:44.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.051+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x7ffa140a1040 2024-05-08T18:50:44.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.052+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1803b040 con 0x7ffa140a1040 2024-05-08T18:50:44.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.052+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x56282a3164b0 2024-05-08T18:50:44.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.052+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.052+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x7ffa140a1040 2024-05-08T18:50:44.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.052+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1803b040 con 0x7ffa140a1040 2024-05-08T18:50:44.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.052+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x7ffa1c019040 2024-05-08T18:50:44.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.053+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa14077020 con 0x7ffa1c019040 2024-05-08T18:50:44.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.053+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x56282a3164b0 2024-05-08T18:50:44.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.053+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.053+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x7ffa140a1040 2024-05-08T18:50:44.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.053+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1803b040 con 0x7ffa140a1040 2024-05-08T18:50:44.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.053+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x56282a311ac0 2024-05-08T18:50:44.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.053+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffa1803b040 con 0x56282a311ac0 2024-05-08T18:50:44.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.054+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56282a31a8f0 con 0x7ffa1c019040 2024-05-08T18:50:44.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.054+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa14077020 con 0x7ffa1c019040 2024-05-08T18:50:44.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.054+0000 7ffa2363f800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:44.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.054+0000 7ffa2363f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:44.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.054+0000 7ffa2363f800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:44.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.054+0000 7ffa2363f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:44.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.054+0000 7ffa2363f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:44.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.054+0000 7ffa2363f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:44.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.054+0000 7ffa2363f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.054+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56282a319830 con 0x56282a311ac0 2024-05-08T18:50:44.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.054+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x56282a311ac0 2024-05-08T18:50:44.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.054+0000 7ffa2363f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.054+0000 7ffa2363f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.054+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56282a319c20 con 0x56282a311ac0 2024-05-08T18:50:44.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.054+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa1803b040 con 0x56282a311ac0 2024-05-08T18:50:44.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.054+0000 7ffa2363f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:44.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.054+0000 7ffa2363f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.054+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56282a31ad70 con 0x56282a311ac0 2024-05-08T18:50:44.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.055+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffa1803b040 con 0x56282a311ac0 2024-05-08T18:50:44.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.055+0000 7ffa2363f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:44.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.055+0000 7ffa2363f800 20 zone default found 2024-05-08T18:50:44.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.055+0000 7ffa2363f800 4 Realm: () 2024-05-08T18:50:44.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.055+0000 7ffa2363f800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:44.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.055+0000 7ffa2363f800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:44.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.055+0000 7ffa2363f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:44.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.055+0000 7ffa2363f800 20 zonegroup default 2024-05-08T18:50:44.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.055+0000 7ffa2363f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.055+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56282a31ad90 con 0x7ffa140a1040 2024-05-08T18:50:44.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.055+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x7ffa140a1040 2024-05-08T18:50:44.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.055+0000 7ffa2363f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.055+0000 7ffa2363f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.055+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56282a31cbb0 con 0x56282a3164b0 2024-05-08T18:50:44.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.055+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.055+0000 7ffa2363f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.055+0000 7ffa2363f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.055+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56282a31cfa0 con 0x56282a3164b0 2024-05-08T18:50:44.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.055+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.055+0000 7ffa2363f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.055+0000 7ffa2363f800 20 started sync module instance, tier type = 2024-05-08T18:50:44.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.055+0000 7ffa2363f800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:44.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.056+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a31c050 con 0x7ffa1c019040 2024-05-08T18:50:44.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.057+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa14077020 con 0x7ffa1c019040 2024-05-08T18:50:44.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.057+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94730506582944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a31d400 con 0x7ffa1c019040 2024-05-08T18:50:44.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.057+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a31dc50 con 0x56282a311ac0 2024-05-08T18:50:44.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.058+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94730506582944] v25'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa14077020 con 0x7ffa1c019040 2024-05-08T18:50:44.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.058+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x56282a311ac0 2024-05-08T18:50:44.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.058+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94730506590112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a31e070 con 0x56282a311ac0 2024-05-08T18:50:44.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.058+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a31e8c0 con 0x56282a3164b0 2024-05-08T18:50:44.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.059+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94730506590112] v25'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x56282a311ac0 2024-05-08T18:50:44.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.059+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.059+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94730506591648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a31e7f0 con 0x56282a3164b0 2024-05-08T18:50:44.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.059+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a31f360 con 0x7ffa1c019040 2024-05-08T18:50:44.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.062+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94730506591648] v25'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.062+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa14077020 con 0x7ffa1c019040 2024-05-08T18:50:44.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.062+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94730506595920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a31f700 con 0x7ffa1c019040 2024-05-08T18:50:44.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.062+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a3201c0 con 0x56282a311ac0 2024-05-08T18:50:44.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.064+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x56282a311ac0 2024-05-08T18:50:44.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.065+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94730506599568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a320a60 con 0x56282a311ac0 2024-05-08T18:50:44.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.065+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a321520 con 0x7ffa140a1040 2024-05-08T18:50:44.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.067+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94730506595920] v25'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa14077020 con 0x7ffa1c019040 2024-05-08T18:50:44.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.067+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x7ffa140a1040 2024-05-08T18:50:44.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.067+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94730506604624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a321520 con 0x7ffa140a1040 2024-05-08T18:50:44.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.067+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a321f60 con 0x7ffa140a1040 2024-05-08T18:50:44.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.067+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94730506599568] v25'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x56282a311ac0 2024-05-08T18:50:44.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.068+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(56 notify.6 [create] v25'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x7ffa140a1040 2024-05-08T18:50:44.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.068+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94730506601904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a321f60 con 0x7ffa140a1040 2024-05-08T18:50:44.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.068+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a322970 con 0x7ffa140a1040 2024-05-08T18:50:44.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.070+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94730506604624] v25'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x7ffa140a1040 2024-05-08T18:50:44.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.070+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(58 notify.7 [create] v25'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x7ffa140a1040 2024-05-08T18:50:44.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.070+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94730506592832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a322970 con 0x7ffa140a1040 2024-05-08T18:50:44.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.070+0000 7ffa2363f800 20 add_watcher() i=0 2024-05-08T18:50:44.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.070+0000 7ffa2363f800 20 add_watcher() i=1 2024-05-08T18:50:44.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.070+0000 7ffa2363f800 20 add_watcher() i=2 2024-05-08T18:50:44.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.070+0000 7ffa2363f800 20 add_watcher() i=3 2024-05-08T18:50:44.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.070+0000 7ffa2363f800 20 add_watcher() i=4 2024-05-08T18:50:44.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.070+0000 7ffa2363f800 20 add_watcher() i=5 2024-05-08T18:50:44.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.070+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94730506601904] v25'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x7ffa140a1040 2024-05-08T18:50:44.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.070+0000 7ffa2363f800 20 add_watcher() i=6 2024-05-08T18:50:44.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.071+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94730506592832] v25'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x7ffa140a1040 2024-05-08T18:50:44.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.071+0000 7ffa2363f800 20 add_watcher() i=7 2024-05-08T18:50:44.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.071+0000 7ffa2363f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:44.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.071+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56282a322970 con 0x56282a311ac0 2024-05-08T18:50:44.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.071+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffa1803b040 con 0x56282a311ac0 2024-05-08T18:50:44.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.071+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94730506609856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a3228e0 con 0x56282a311ac0 2024-05-08T18:50:44.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.072+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94730506609856] v25'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x56282a311ac0 2024-05-08T18:50:44.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.073+0000 7ff8d7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:44.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.073+0000 7ffa2363f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:44.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.073+0000 7ffa2363f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:44.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.073+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32e170 con 0x56282a311ac0 2024-05-08T18:50:44.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.074+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v25'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x56282a311ac0 2024-05-08T18:50:44.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.074+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32e840 con 0x7ffa140a1040 2024-05-08T18:50:44.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.075+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v25'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x7ffa140a1040 2024-05-08T18:50:44.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.075+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32ec60 con 0x56282a3164b0 2024-05-08T18:50:44.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.076+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v25'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.076+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32ec20 con 0x56282a311ac0 2024-05-08T18:50:44.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.077+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v25'37 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x56282a311ac0 2024-05-08T18:50:44.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.077+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32ecb0 con 0x7ffa1c019040 2024-05-08T18:50:44.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.078+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v25'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa14077020 con 0x7ffa1c019040 2024-05-08T18:50:44.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.078+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32f240 con 0x56282a3164b0 2024-05-08T18:50:44.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.079+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v25'17 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.079+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32f240 con 0x56282a311ac0 2024-05-08T18:50:44.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.080+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v25'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x56282a311ac0 2024-05-08T18:50:44.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.080+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32f660 con 0x7ffa140a1040 2024-05-08T18:50:44.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.081+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v25'17 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x7ffa140a1040 2024-05-08T18:50:44.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.081+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32f660 con 0x7ffa1c019040 2024-05-08T18:50:44.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.082+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v25'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa14077020 con 0x7ffa1c019040 2024-05-08T18:50:44.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.083+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32f660 con 0x56282a3164b0 2024-05-08T18:50:44.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.083+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v25'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.084+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32f660 con 0x7ffa1c019040 2024-05-08T18:50:44.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.084+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v25'27 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa14077020 con 0x7ffa1c019040 2024-05-08T18:50:44.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.085+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32fb10 con 0x7ffa140a1040 2024-05-08T18:50:44.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.086+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v25'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x7ffa140a1040 2024-05-08T18:50:44.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.086+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32fb10 con 0x7ffa1c019040 2024-05-08T18:50:44.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.087+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v25'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa14077020 con 0x7ffa1c019040 2024-05-08T18:50:44.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.087+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32fb10 con 0x7ffa140a1040 2024-05-08T18:50:44.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.088+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v25'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x7ffa140a1040 2024-05-08T18:50:44.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.088+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32fb10 con 0x56282a311ac0 2024-05-08T18:50:44.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.089+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v25'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x56282a311ac0 2024-05-08T18:50:44.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.089+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32fb10 con 0x56282a3164b0 2024-05-08T18:50:44.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.090+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v25'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.090+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32fb10 con 0x7ffa1c019040 2024-05-08T18:50:44.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.091+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v25'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa14077020 con 0x7ffa1c019040 2024-05-08T18:50:44.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.091+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32fb10 con 0x56282a3164b0 2024-05-08T18:50:44.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.092+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v25'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.093+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32fb10 con 0x56282a311ac0 2024-05-08T18:50:44.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.095+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v25'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x56282a311ac0 2024-05-08T18:50:44.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.095+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32fb10 con 0x56282a311ac0 2024-05-08T18:50:44.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.096+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v25'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x56282a311ac0 2024-05-08T18:50:44.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.096+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32fb10 con 0x56282a3164b0 2024-05-08T18:50:44.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.097+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v25'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.097+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32fb10 con 0x7ffa1c019040 2024-05-08T18:50:44.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.098+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v25'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa14077020 con 0x7ffa1c019040 2024-05-08T18:50:44.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.098+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32fb10 con 0x56282a3164b0 2024-05-08T18:50:44.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.101+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v25'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.101+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32fb10 con 0x56282a3164b0 2024-05-08T18:50:44.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.102+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v25'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.102+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32fb10 con 0x56282a3164b0 2024-05-08T18:50:44.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.103+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v25'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.103+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32fb10 con 0x56282a3164b0 2024-05-08T18:50:44.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.104+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v25'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.104+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32fb10 con 0x7ffa140a1040 2024-05-08T18:50:44.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.105+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v25'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x7ffa140a1040 2024-05-08T18:50:44.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.105+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32fb10 con 0x56282a3164b0 2024-05-08T18:50:44.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.106+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v25'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.106+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32fb10 con 0x7ffa140a1040 2024-05-08T18:50:44.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.107+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v25'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x7ffa140a1040 2024-05-08T18:50:44.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.107+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32fb10 con 0x56282a3164b0 2024-05-08T18:50:44.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.109+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v25'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.109+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32fb10 con 0x7ffa140a1040 2024-05-08T18:50:44.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.110+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v25'24 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x7ffa140a1040 2024-05-08T18:50:44.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.110+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32fb10 con 0x7ffa1c019040 2024-05-08T18:50:44.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.111+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v25'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffa14077020 con 0x7ffa1c019040 2024-05-08T18:50:44.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.111+0000 7ff8d6fe5640 20 reqs_thread_entry: start 2024-05-08T18:50:44.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.111+0000 7ffa2363f800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:44.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.111+0000 7ffa2363f800 20 Filter name: none 2024-05-08T18:50:44.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.111+0000 7ff8d4fe1640 20 reqs_thread_entry: start 2024-05-08T18:50:44.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.111+0000 7ffa2363f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:50:44.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.111+0000 7ffa2363f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.111+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56282a35ab30 con 0x7ffa140a1040 2024-05-08T18:50:44.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.112+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x7ffa140a1040 2024-05-08T18:50:44.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.112+0000 7ffa2363f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.112+0000 7ffa2363f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-08T18:50:44.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.112+0000 7ffa2363f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:50:44.112 INFO:teuthology.orchestra.run.smithi132.stderr:could not remove user: unable to remove user, user does not exist 2024-05-08T18:50:44.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.113+0000 7ff8d7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:44.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.113+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94730506609856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a32bf10 con 0x56282a311ac0 2024-05-08T18:50:44.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.114+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94730506609856] v25'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x56282a311ac0 2024-05-08T18:50:44.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.114+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94730506582944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a3224c0 con 0x7ffa1c019040 2024-05-08T18:50:44.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.115+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94730506582944] v25'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa14077020 con 0x7ffa1c019040 2024-05-08T18:50:44.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.115+0000 7ffa2363f800 20 remove_watcher() i=0 2024-05-08T18:50:44.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.115+0000 7ffa2363f800 2 removed watcher, disabling cache 2024-05-08T18:50:44.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.115+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94730506590112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a3224c0 con 0x56282a311ac0 2024-05-08T18:50:44.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.116+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94730506590112] v25'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x56282a311ac0 2024-05-08T18:50:44.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.116+0000 7ffa2363f800 20 remove_watcher() i=1 2024-05-08T18:50:44.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.116+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94730506591648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a31d7a0 con 0x56282a3164b0 2024-05-08T18:50:44.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.117+0000 7ffa21938640 1 -- 172.21.15.132:0/434712196 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94730506591648] v25'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1c02a070 con 0x56282a3164b0 2024-05-08T18:50:44.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.117+0000 7ffa2363f800 20 remove_watcher() i=2 2024-05-08T18:50:44.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.117+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94730506595920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a3224c0 con 0x7ffa1c019040 2024-05-08T18:50:44.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.119+0000 7ffa21137640 1 -- 172.21.15.132:0/434712196 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94730506595920] v25'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa14077020 con 0x7ffa1c019040 2024-05-08T18:50:44.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.119+0000 7ffa2363f800 20 remove_watcher() i=3 2024-05-08T18:50:44.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.119+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94730506599568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a31dda0 con 0x56282a311ac0 2024-05-08T18:50:44.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.121+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94730506599568] v25'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x56282a311ac0 2024-05-08T18:50:44.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.121+0000 7ffa2363f800 20 remove_watcher() i=4 2024-05-08T18:50:44.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.121+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94730506604624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a31d7a0 con 0x7ffa140a1040 2024-05-08T18:50:44.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.123+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94730506604624] v25'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x7ffa140a1040 2024-05-08T18:50:44.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.123+0000 7ffa2363f800 20 remove_watcher() i=5 2024-05-08T18:50:44.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.123+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94730506601904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a31ee50 con 0x7ffa140a1040 2024-05-08T18:50:44.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.124+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94730506601904] v25'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x7ffa140a1040 2024-05-08T18:50:44.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.124+0000 7ffa2363f800 20 remove_watcher() i=6 2024-05-08T18:50:44.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.124+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94730506592832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56282a3224c0 con 0x7ffa140a1040 2024-05-08T18:50:44.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.124+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94730506592832] v25'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1803b040 con 0x7ffa140a1040 2024-05-08T18:50:44.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.124+0000 7ffa2363f800 20 remove_watcher() i=7 2024-05-08T18:50:44.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7ffa140a1040 msgr2=0x7ffa14070600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 --2- 172.21.15.132:0/434712196 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7ffa140a1040 0x7ffa14070600 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56282a311ac0 msgr2=0x56282a313f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 --2- 172.21.15.132:0/434712196 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56282a311ac0 0x56282a313f80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7ffa1c019040 msgr2=0x7ffa1c051190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 --2- 172.21.15.132:0/434712196 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7ffa1c019040 0x7ffa1c051190 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56282a3164b0 msgr2=0x56282a3188a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 --2- 172.21.15.132:0/434712196 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56282a3164b0 0x56282a3188a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8ec03bb50 msgr2=0x7ff8ec03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 --2- 172.21.15.132:0/434712196 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8ec03bb50 0x7ff8ec03e010 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffa1407ae30 tx=0x7ffa14085000 comp rx=0 tx=0).stop 2024-05-08T18:50:44.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a2feae0 msgr2=0x56282a305f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 --2- 172.21.15.132:0/434712196 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a2feae0 0x56282a305f60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0238c0 tx=0x7ffa1c052e60 comp rx=0 tx=0).stop 2024-05-08T18:50:44.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 reap_dead start 2024-05-08T18:50:44.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa20936640 1 -- 172.21.15.132:0/434712196 reap_dead start 2024-05-08T18:50:44.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 shutdown_connections 2024-05-08T18:50:44.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 >> 172.21.15.132:0/434712196 conn(0x56282a2fadf0 msgr2=0x56282a2f84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 shutdown_connections 2024-05-08T18:50:44.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 -- 172.21.15.132:0/434712196 wait complete. 2024-05-08T18:50:44.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 -- 172.21.15.132:0/1496873870 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8f803bb50 msgr2=0x7ff8f803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 --2- 172.21.15.132:0/1496873870 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8f803bb50 0x7ff8f803e010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffa14092e40 tx=0x7ffa1407acc0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 -- 172.21.15.132:0/1496873870 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a2f17a0 msgr2=0x56282a2f1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 --2- 172.21.15.132:0/1496873870 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a2f17a0 0x56282a2f1bc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x56282a2d7490 tx=0x7ffa1c008f90 comp rx=0 tx=0).stop 2024-05-08T18:50:44.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 -- 172.21.15.132:0/1496873870 shutdown_connections 2024-05-08T18:50:44.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 --2- 172.21.15.132:0/1496873870 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8f803bb50 0x7ff8f803e010 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 --2- 172.21.15.132:0/1496873870 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a2f17a0 0x56282a2f1bc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 -- 172.21.15.132:0/1496873870 >> 172.21.15.132:0/1496873870 conn(0x56282a2e5840 msgr2=0x56282a2e5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 -- 172.21.15.132:0/1496873870 shutdown_connections 2024-05-08T18:50:44.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.125+0000 7ffa2363f800 1 -- 172.21.15.132:0/1496873870 wait complete. 2024-05-08T18:50:44.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.126+0000 7ffa2363f800 1 -- 172.21.15.132:0/2203990513 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56282a1de600 msgr2=0x56282a2dd4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.126+0000 7ffa2363f800 1 --2- 172.21.15.132:0/2203990513 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56282a1de600 0x56282a2dd4b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.126+0000 7ffa2363f800 1 -- 172.21.15.132:0/2203990513 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56282a2dfd90 msgr2=0x56282a2e2180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.126+0000 7ffa2363f800 1 --2- 172.21.15.132:0/2203990513 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56282a2dfd90 0x56282a2e2180 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.126+0000 7ffa2363f800 1 -- 172.21.15.132:0/2203990513 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff90803bb50 msgr2=0x7ff90803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.126+0000 7ffa2363f800 1 --2- 172.21.15.132:0/2203990513 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff90803bb50 0x7ff90803e010 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffa18000f60 tx=0x7ffa18001370 comp rx=0 tx=0).stop 2024-05-08T18:50:44.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.126+0000 7ffa2363f800 1 -- 172.21.15.132:0/2203990513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a1dbcd0 msgr2=0x56282a2d6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.126+0000 7ffa2363f800 1 --2- 172.21.15.132:0/2203990513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a1dbcd0 0x56282a2d6270 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffa14000f80 tx=0x7ffa14003330 comp rx=0 tx=0).stop 2024-05-08T18:50:44.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.126+0000 7ffa2363f800 1 -- 172.21.15.132:0/2203990513 shutdown_connections 2024-05-08T18:50:44.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.126+0000 7ffa2363f800 1 --2- 172.21.15.132:0/2203990513 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56282a2dfd90 0x56282a2e2180 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.126+0000 7ffa2363f800 1 --2- 172.21.15.132:0/2203990513 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56282a1de600 0x56282a2dd4b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.126+0000 7ffa2363f800 1 --2- 172.21.15.132:0/2203990513 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff90803bb50 0x7ff90803e010 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.126+0000 7ffa2363f800 1 --2- 172.21.15.132:0/2203990513 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56282a1dbcd0 0x56282a2d6270 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.126+0000 7ffa2363f800 1 -- 172.21.15.132:0/2203990513 >> 172.21.15.132:0/2203990513 conn(0x56282a1d5720 msgr2=0x56282a1da3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.126+0000 7ffa2363f800 1 -- 172.21.15.132:0/2203990513 shutdown_connections 2024-05-08T18:50:44.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.126+0000 7ffa2363f800 1 -- 172.21.15.132:0/2203990513 wait complete. 2024-05-08T18:50:44.133 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-08T18:50:44.134 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-05-08T18:50:44.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-05-08T18:50:44.134 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-05-08T18:50:44.178 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:44.178 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:44.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.180+0000 7f4b0a12e800 1 Processor -- start 2024-05-08T18:50:44.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.180+0000 7f4b0a12e800 1 -- start start 2024-05-08T18:50:44.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.180+0000 7f4b0a12e800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x562e4211bcd0 0x562e4211e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.180+0000 7f4b0a12e800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562e42122110 con 0x562e4211e600 2024-05-08T18:50:44.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.180+0000 7f4b0a12e800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x562e41fbbe20 con 0x562e4211bcd0 2024-05-08T18:50:44.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.180+0000 7f4b05e84640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x562e4211bcd0 0x562e4211e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.180+0000 7f4b05683640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x562e4211e600 0x562e421209f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46662/0 (socket says 172.21.15.132:46662) 2024-05-08T18:50:44.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.180+0000 7f4b05e84640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x562e4211bcd0 0x562e4211e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59494/0 (socket says 172.21.15.132:59494) 2024-05-08T18:50:44.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.180+0000 7f4b05683640 1 -- 172.21.15.132:0/2679289579 learned_addr learned my addr 172.21.15.132:0/2679289579 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:50:44.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.181+0000 7f4b05e84640 1 -- 172.21.15.132:0/2679289579 >> v1:172.21.15.42:6789/0 conn(0x562e4211e600 legacy=0x562e421209f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.181+0000 7f4b05e84640 1 -- 172.21.15.132:0/2679289579 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e421232f0 con 0x562e4211bcd0 2024-05-08T18:50:44.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.183+0000 7f4b05e84640 1 --2- 172.21.15.132:0/2679289579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211bcd0 0x562e4211e0c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000a470 tx=0x7f4b0001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86dd237da517d0a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.183+0000 7f4b04e82640 1 -- 172.21.15.132:0/2679289579 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b00057070 con 0x562e4211bcd0 2024-05-08T18:50:44.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.183+0000 7f4b04e82640 1 -- 172.21.15.132:0/2679289579 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b00052570 con 0x562e4211bcd0 2024-05-08T18:50:44.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.183+0000 7f4b04e82640 1 -- 172.21.15.132:0/2679289579 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b00052870 con 0x562e4211bcd0 2024-05-08T18:50:44.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.183+0000 7f4b0a12e800 1 -- 172.21.15.132:0/2679289579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211bcd0 msgr2=0x562e4211e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.183+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/2679289579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211bcd0 0x562e4211e0c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000a470 tx=0x7f4b0001ce90 comp rx=0 tx=0).stop 2024-05-08T18:50:44.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.183+0000 7f4b0a12e800 1 -- 172.21.15.132:0/2679289579 shutdown_connections 2024-05-08T18:50:44.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.183+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/2679289579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211bcd0 0x562e4211e0c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.183+0000 7f4b0a12e800 1 -- 172.21.15.132:0/2679289579 >> 172.21.15.132:0/2679289579 conn(0x562e42115720 msgr2=0x562e42117b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.183+0000 7f4b0a12e800 1 -- 172.21.15.132:0/2679289579 shutdown_connections 2024-05-08T18:50:44.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.183+0000 7f4b0a12e800 1 -- 172.21.15.132:0/2679289579 wait complete. 2024-05-08T18:50:44.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.197+0000 7f4b0a12e800 1 Processor -- start 2024-05-08T18:50:44.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.197+0000 7f4b0a12e800 1 -- start start 2024-05-08T18:50:44.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.197+0000 7f4b0a12e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211bcd0 0x562e4220c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.197+0000 7f4b0a12e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562e420665b0 con 0x562e4211bcd0 2024-05-08T18:50:44.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.197+0000 7f4b05e84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211bcd0 0x562e4220c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.197+0000 7f4b05e84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211bcd0 0x562e4220c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59498/0 (socket says 172.21.15.132:59498) 2024-05-08T18:50:44.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.197+0000 7f4b05e84640 1 -- 172.21.15.132:0/558367448 learned_addr learned my addr 172.21.15.132:0/558367448 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.198+0000 7f4b05e84640 1 -- 172.21.15.132:0/558367448 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e4220cbf0 con 0x562e4211bcd0 2024-05-08T18:50:44.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.198+0000 7f4b05e84640 1 --2- 172.21.15.132:0/558367448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211bcd0 0x562e4220c620 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4b00055040 tx=0x7f4b0004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8d2f65f614b9a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.198+0000 7f49f3e07640 1 -- 172.21.15.132:0/558367448 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b00057040 con 0x562e4211bcd0 2024-05-08T18:50:44.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.198+0000 7f49f3e07640 1 -- 172.21.15.132:0/558367448 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b00052990 con 0x562e4211bcd0 2024-05-08T18:50:44.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.198+0000 7f49f3e07640 1 -- 172.21.15.132:0/558367448 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b00052c70 con 0x562e4211bcd0 2024-05-08T18:50:44.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.199+0000 7f4b0a12e800 1 -- 172.21.15.132:0/558367448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211bcd0 msgr2=0x562e4220c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.199+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/558367448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211bcd0 0x562e4220c620 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4b00055040 tx=0x7f4b0004c000 comp rx=0 tx=0).stop 2024-05-08T18:50:44.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.199+0000 7f4b0a12e800 1 -- 172.21.15.132:0/558367448 shutdown_connections 2024-05-08T18:50:44.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.199+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/558367448 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211bcd0 0x562e4220c620 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.199+0000 7f4b0a12e800 1 -- 172.21.15.132:0/558367448 >> 172.21.15.132:0/558367448 conn(0x562e42115720 msgr2=0x562e42207f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.199+0000 7f4b0a12e800 1 -- 172.21.15.132:0/558367448 shutdown_connections 2024-05-08T18:50:44.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.199+0000 7f4b0a12e800 1 -- 172.21.15.132:0/558367448 wait complete. 2024-05-08T18:50:44.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.199+0000 7f4b0a12e800 1 Processor -- start 2024-05-08T18:50:44.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.199+0000 7f4b0a12e800 1 -- start start 2024-05-08T18:50:44.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.199+0000 7f4b0a12e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211bcd0 0x562e422140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.199+0000 7f4b0a12e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562e42122580 con 0x562e4211bcd0 2024-05-08T18:50:44.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.200+0000 7f4b05e84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211bcd0 0x562e422140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.200+0000 7f4b05e84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211bcd0 0x562e422140d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59502/0 (socket says 172.21.15.132:59502) 2024-05-08T18:50:44.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.200+0000 7f4b05e84640 1 -- 172.21.15.132:0/586481509 learned_addr learned my addr 172.21.15.132:0/586481509 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.200+0000 7f4b05e84640 1 -- 172.21.15.132:0/586481509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e42214610 con 0x562e4211bcd0 2024-05-08T18:50:44.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.200+0000 7f4b05e84640 1 --2- 172.21.15.132:0/586481509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211bcd0 0x562e422140d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000a470 tx=0x7f4b00003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.200+0000 7f49f2604640 1 -- 172.21.15.132:0/586481509 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b00073070 con 0x562e4211bcd0 2024-05-08T18:50:44.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.200+0000 7f49f2604640 1 -- 172.21.15.132:0/586481509 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b0005d650 con 0x562e4211bcd0 2024-05-08T18:50:44.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.200+0000 7f49f2604640 1 -- 172.21.15.132:0/586481509 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b00057070 con 0x562e4211bcd0 2024-05-08T18:50:44.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.200+0000 7f4b0a12e800 1 -- 172.21.15.132:0/586481509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e422148a0 con 0x562e4211bcd0 2024-05-08T18:50:44.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.201+0000 7f4b0a12e800 1 -- 172.21.15.132:0/586481509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e42217550 con 0x562e4211bcd0 2024-05-08T18:50:44.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.201+0000 7f49f2604640 1 -- 172.21.15.132:0/586481509 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4b00076070 con 0x562e4211bcd0 2024-05-08T18:50:44.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.202+0000 7f49f2604640 1 --2- 172.21.15.132:0/586481509 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49ec03bb50 0x7f49ec03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.202+0000 7f49f2604640 1 -- 172.21.15.132:0/586481509 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f4b000941e0 con 0x562e4211bcd0 2024-05-08T18:50:44.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.202+0000 7f4b05683640 1 --2- 172.21.15.132:0/586481509 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49ec03bb50 0x7f49ec03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.202+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/586481509 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562e4211e600 0x562e4221b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.202+0000 7f4b0a12e800 1 -- 172.21.15.132:0/586481509 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562e4221b8a0 con 0x562e4211e600 2024-05-08T18:50:44.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.202+0000 7f4b06685640 1 --2- 172.21.15.132:0/586481509 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562e4211e600 0x562e4221b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.202+0000 7f4b05683640 1 --2- 172.21.15.132:0/586481509 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49ec03bb50 0x7f49ec03e010 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4af0000f60 tx=0x7f4af00012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.202+0000 7f4b06685640 1 --2- 172.21.15.132:0/586481509 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562e4211e600 0x562e4221b310 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.202+0000 7f4b06685640 1 -- 172.21.15.132:0/586481509 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4af800a4a0 con 0x562e4211e600 2024-05-08T18:50:44.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.203+0000 7f4b0a12e800 1 -- 172.21.15.132:0/586481509 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562e422188e0 con 0x562e4211e600 2024-05-08T18:50:44.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.203+0000 7f4b06685640 1 -- 172.21.15.132:0/586481509 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4af800a4a0 con 0x562e4211e600 2024-05-08T18:50:44.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.203+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/586481509 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562e4221dbf0 0x562e4221ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.203+0000 7f4b0a12e800 1 -- 172.21.15.132:0/586481509 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562e422206d0 con 0x562e4221dbf0 2024-05-08T18:50:44.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.203+0000 7f4b05e84640 1 --2- 172.21.15.132:0/586481509 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562e4221dbf0 0x562e4221ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.203+0000 7f4b05e84640 1 --2- 172.21.15.132:0/586481509 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562e4221dbf0 0x562e4221ffe0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.203+0000 7f4b05e84640 1 -- 172.21.15.132:0/586481509 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4b00075030 con 0x562e4221dbf0 2024-05-08T18:50:44.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.203+0000 7f4b0a12e800 1 -- 172.21.15.132:0/586481509 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562e4221ca90 con 0x562e4211e600 2024-05-08T18:50:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.204+0000 7f4b06685640 1 -- 172.21.15.132:0/586481509 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4af800a4a0 con 0x562e4211e600 2024-05-08T18:50:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.204+0000 7f4b0a12e800 1 -- 172.21.15.132:0/586481509 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562e4221cf70 con 0x562e4211e600 2024-05-08T18:50:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.204+0000 7f4b06685640 1 -- 172.21.15.132:0/586481509 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4af800a4a0 con 0x562e4211e600 2024-05-08T18:50:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.204+0000 7f4b0a12e800 1 Processor -- start 2024-05-08T18:50:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.204+0000 7f4b0a12e800 1 -- start start 2024-05-08T18:50:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.205+0000 7f4b0a12e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4222f610 0x562e4222fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.205+0000 7f4b0a12e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562e4200cfc0 con 0x562e4222f610 2024-05-08T18:50:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.205+0000 7f4b06685640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4222f610 0x562e4222fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.205+0000 7f4b06685640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4222f610 0x562e4222fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59508/0 (socket says 172.21.15.132:59508) 2024-05-08T18:50:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.205+0000 7f4b06685640 1 -- 172.21.15.132:0/2127941055 learned_addr learned my addr 172.21.15.132:0/2127941055 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.205+0000 7f4b06685640 1 -- 172.21.15.132:0/2127941055 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e4222ff70 con 0x562e4222f610 2024-05-08T18:50:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.205+0000 7f4b06685640 1 --2- 172.21.15.132:0/2127941055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4222f610 0x562e4222fa30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x562e4221bca0 tx=0x7f4af8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.205+0000 7f49eb7fe640 1 -- 172.21.15.132:0/2127941055 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af8014450 con 0x562e4222f610 2024-05-08T18:50:44.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.206+0000 7f49eb7fe640 1 -- 172.21.15.132:0/2127941055 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af8014610 con 0x562e4222f610 2024-05-08T18:50:44.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.206+0000 7f4b0a12e800 1 -- 172.21.15.132:0/2127941055 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e422309e0 con 0x562e4222f610 2024-05-08T18:50:44.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.206+0000 7f49eb7fe640 1 -- 172.21.15.132:0/2127941055 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af8014930 con 0x562e4222f610 2024-05-08T18:50:44.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.206+0000 7f4b0a12e800 1 -- 172.21.15.132:0/2127941055 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e42230ee0 con 0x562e4222f610 2024-05-08T18:50:44.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.206+0000 7f49eb7fe640 1 -- 172.21.15.132:0/2127941055 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4af8011040 con 0x562e4222f610 2024-05-08T18:50:44.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.207+0000 7f49eb7fe640 1 --2- 172.21.15.132:0/2127941055 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49e003bba0 0x7f49e003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.207+0000 7f49eb7fe640 1 -- 172.21.15.132:0/2127941055 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f4af801e070 con 0x562e4222f610 2024-05-08T18:50:44.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.207+0000 7f4b05e84640 1 --2- 172.21.15.132:0/2127941055 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49e003bba0 0x7f49e003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.207+0000 7f4b0a12e800 1 Processor -- start 2024-05-08T18:50:44.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.207+0000 7f4b0a12e800 1 -- start start 2024-05-08T18:50:44.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.207+0000 7f4b05e84640 1 --2- 172.21.15.132:0/2127941055 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49e003bba0 0x7f49e003e060 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x562e4221bd40 tx=0x7f4b0005ce80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.207+0000 7f4b0a12e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211b390 0x562e42119ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.207+0000 7f4b0a12e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562e4220ceb0 con 0x562e4211b390 2024-05-08T18:50:44.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.207+0000 7f4b06685640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211b390 0x562e42119ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.207+0000 7f4b06685640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211b390 0x562e42119ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59518/0 (socket says 172.21.15.132:59518) 2024-05-08T18:50:44.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.207+0000 7f4b06685640 1 -- 172.21.15.132:0/4169730325 learned_addr learned my addr 172.21.15.132:0/4169730325 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.208+0000 7f4b06685640 1 -- 172.21.15.132:0/4169730325 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e4211b840 con 0x562e4211b390 2024-05-08T18:50:44.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.208+0000 7f4b06685640 1 --2- 172.21.15.132:0/4169730325 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211b390 0x562e42119ac0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4af8052c80 tx=0x7f4af8016570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5506749ee2197c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.208+0000 7f49e97fa640 1 -- 172.21.15.132:0/4169730325 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af8028070 con 0x562e4211b390 2024-05-08T18:50:44.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.208+0000 7f49e97fa640 1 -- 172.21.15.132:0/4169730325 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af8054550 con 0x562e4211b390 2024-05-08T18:50:44.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.208+0000 7f49e97fa640 1 -- 172.21.15.132:0/4169730325 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af8016930 con 0x562e4211b390 2024-05-08T18:50:44.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.208+0000 7f4b0a12e800 1 -- 172.21.15.132:0/4169730325 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211b390 msgr2=0x562e42119ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.208+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/4169730325 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211b390 0x562e42119ac0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4af8052c80 tx=0x7f4af8016570 comp rx=0 tx=0).stop 2024-05-08T18:50:44.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.208+0000 7f4b0a12e800 1 -- 172.21.15.132:0/4169730325 shutdown_connections 2024-05-08T18:50:44.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.208+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/4169730325 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211b390 0x562e42119ac0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.208+0000 7f4b0a12e800 1 -- 172.21.15.132:0/4169730325 >> 172.21.15.132:0/4169730325 conn(0x562e42238bf0 msgr2=0x562e42236c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.208+0000 7f4b0a12e800 1 -- 172.21.15.132:0/4169730325 shutdown_connections 2024-05-08T18:50:44.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.208+0000 7f4b0a12e800 1 -- 172.21.15.132:0/4169730325 wait complete. 2024-05-08T18:50:44.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.209+0000 7f4b0a12e800 1 Processor -- start 2024-05-08T18:50:44.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.209+0000 7f4b0a12e800 1 -- start start 2024-05-08T18:50:44.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.209+0000 7f4b0a12e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211b390 0x562e422460b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.209+0000 7f4b0a12e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562e4211a180 con 0x562e4211b390 2024-05-08T18:50:44.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.209+0000 7f4b06685640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211b390 0x562e422460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.209+0000 7f4b06685640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211b390 0x562e422460b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59524/0 (socket says 172.21.15.132:59524) 2024-05-08T18:50:44.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.209+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 learned_addr learned my addr 172.21.15.132:0/1381225050 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.209+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e422465f0 con 0x562e4211b390 2024-05-08T18:50:44.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.210+0000 7f4b06685640 1 --2- 172.21.15.132:0/1381225050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211b390 0x562e422460b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4af8001700 tx=0x7f4af8052c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.210+0000 7f49d77fe640 1 -- 172.21.15.132:0/1381225050 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af802b350 con 0x562e4211b390 2024-05-08T18:50:44.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.210+0000 7f49d77fe640 1 -- 172.21.15.132:0/1381225050 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af8031070 con 0x562e4211b390 2024-05-08T18:50:44.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.210+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e42246880 con 0x562e4211b390 2024-05-08T18:50:44.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.210+0000 7f49d77fe640 1 -- 172.21.15.132:0/1381225050 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af8014ad0 con 0x562e4211b390 2024-05-08T18:50:44.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.210+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e42249530 con 0x562e4211b390 2024-05-08T18:50:44.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.211+0000 7f49d77fe640 1 -- 172.21.15.132:0/1381225050 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4af8001770 con 0x562e4211b390 2024-05-08T18:50:44.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.211+0000 7f49d77fe640 1 --2- 172.21.15.132:0/1381225050 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49d003bba0 0x7f49d003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.211+0000 7f49d77fe640 1 -- 172.21.15.132:0/1381225050 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f4af800e040 con 0x562e4211b390 2024-05-08T18:50:44.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.211+0000 7f4b05e84640 1 --2- 172.21.15.132:0/1381225050 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49d003bba0 0x7f49d003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.211+0000 7f4b05e84640 1 --2- 172.21.15.132:0/1381225050 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49d003bba0 0x7f49d003e060 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4b0006d000 tx=0x7f4b0008b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.211+0000 7f4b0a12e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.211+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/1381225050 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562e42251bb0 0x562e42254070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.211+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562e422547c0 con 0x562e42251bb0 2024-05-08T18:50:44.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.212+0000 7f4b05683640 1 --2- 172.21.15.132:0/1381225050 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562e42251bb0 0x562e42254070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.212+0000 7f4b05683640 1 --2- 172.21.15.132:0/1381225050 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562e42251bb0 0x562e42254070 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.212+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4af0009050 con 0x562e42251bb0 2024-05-08T18:50:44.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.212+0000 7f4b0a12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.212+0000 7f4b0a12e800 20 realm 2024-05-08T18:50:44.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.212+0000 7f4b0a12e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.212+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562e42251000 con 0x562e42251bb0 2024-05-08T18:50:44.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.212+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4af0009050 con 0x562e42251bb0 2024-05-08T18:50:44.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.212+0000 7f4b0a12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.212+0000 7f4b0a12e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:44.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.212+0000 7f4b0a12e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.212+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562e422552b0 con 0x562e42251bb0 2024-05-08T18:50:44.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.212+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4af0009050 con 0x562e42251bb0 2024-05-08T18:50:44.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.212+0000 7f4b0a12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.213+0000 7f4b0a12e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.213+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562e42255b80 con 0x562e42251bb0 2024-05-08T18:50:44.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.213+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4af0009050 con 0x562e42251bb0 2024-05-08T18:50:44.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.213+0000 7f4b0a12e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:44.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.213+0000 7f4b0a12e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.213+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/1381225050 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562e422564c0 0x562e422588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.213+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562e42259040 con 0x562e422564c0 2024-05-08T18:50:44.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.213+0000 7f4b06685640 1 --2- 172.21.15.132:0/1381225050 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562e422564c0 0x562e422588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.213+0000 7f4b06685640 1 --2- 172.21.15.132:0/1381225050 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562e422564c0 0x562e422588b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.213+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.213+0000 7f4b0a12e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:44.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.213+0000 7f4b0a12e800 20 searching for the correct realm 2024-05-08T18:50:44.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.213+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x562e422564c0 2024-05-08T18:50:44.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.214+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.214+0000 7f4b06685640 1 --2- 172.21.15.132:0/1381225050 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4af8014070 0x7f4af80389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.214+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x7f4af8014070 2024-05-08T18:50:44.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.214+0000 7f4b05e84640 1 --2- 172.21.15.132:0/1381225050 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4af8014070 0x7f4af80389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.214+0000 7f4b05e84640 1 --2- 172.21.15.132:0/1381225050 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4af8014070 0x7f4af80389c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.215+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b00075030 con 0x7f4af8014070 2024-05-08T18:50:44.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.215+0000 7f4b05e84640 1 --2- 172.21.15.132:0/1381225050 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f4b000a1040 0x7f4b0005b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.215+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x7f4b000a1040 2024-05-08T18:50:44.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.215+0000 7f4b05683640 1 --2- 172.21.15.132:0/1381225050 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f4b000a1040 0x7f4b0005b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.215+0000 7f4b05683640 1 --2- 172.21.15.132:0/1381225050 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f4b000a1040 0x7f4b0005b7a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.216+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af0009050 con 0x7f4b000a1040 2024-05-08T18:50:44.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.216+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x562e42251bb0 2024-05-08T18:50:44.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.216+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af0009050 con 0x562e42251bb0 2024-05-08T18:50:44.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.216+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x562e42251bb0 2024-05-08T18:50:44.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.216+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.216+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x7f4b000a1040 2024-05-08T18:50:44.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.216+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.216+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x7f4b000a1040 2024-05-08T18:50:44.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.217+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.217+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x7f4af8014070 2024-05-08T18:50:44.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.217+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b00075030 con 0x7f4af8014070 2024-05-08T18:50:44.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.217+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x562e422564c0 2024-05-08T18:50:44.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.217+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.217+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x562e42251bb0 2024-05-08T18:50:44.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.217+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.217+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x7f4b000a1040 2024-05-08T18:50:44.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.218+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.218+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x562e42251bb0 2024-05-08T18:50:44.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.218+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.218+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x7f4af8014070 2024-05-08T18:50:44.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.218+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4b00075030 con 0x7f4af8014070 2024-05-08T18:50:44.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.218+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x562e422564c0 2024-05-08T18:50:44.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.218+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v18'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.218+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x562e422564c0 2024-05-08T18:50:44.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.219+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.219+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x7f4b000a1040 2024-05-08T18:50:44.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.219+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.219+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x562e422564c0 2024-05-08T18:50:44.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.219+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.219+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x562e422564c0 2024-05-08T18:50:44.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.220+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.220+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x562e42251bb0 2024-05-08T18:50:44.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.220+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.220+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x562e42251bb0 2024-05-08T18:50:44.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.220+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.220+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x7f4b000a1040 2024-05-08T18:50:44.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.220+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.220+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x562e422564c0 2024-05-08T18:50:44.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.221+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.221+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x7f4af8014070 2024-05-08T18:50:44.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.221+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b00075030 con 0x7f4af8014070 2024-05-08T18:50:44.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.221+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x562e42251bb0 2024-05-08T18:50:44.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.221+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.221+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x7f4b000a1040 2024-05-08T18:50:44.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.221+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.221+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x562e422564c0 2024-05-08T18:50:44.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.222+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.222+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x7f4b000a1040 2024-05-08T18:50:44.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.222+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.222+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x7f4af8014070 2024-05-08T18:50:44.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.222+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b00075030 con 0x7f4af8014070 2024-05-08T18:50:44.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.222+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x562e422564c0 2024-05-08T18:50:44.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.222+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.222+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a970 con 0x7f4b000a1040 2024-05-08T18:50:44.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.223+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.223+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f4af003a040 con 0x562e42251bb0 2024-05-08T18:50:44.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.223+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.223+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f4af003a040 con 0x7f4af8014070 2024-05-08T18:50:44.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.223+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b00075030 con 0x7f4af8014070 2024-05-08T18:50:44.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.223+0000 7f4b0a12e800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:44.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.223+0000 7f4b0a12e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:44.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.223+0000 7f4b0a12e800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:44.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.223+0000 7f4b0a12e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:44.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.223+0000 7f4b0a12e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:44.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.223+0000 7f4b0a12e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:44.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.223+0000 7f4b0a12e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.223+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562e42259a00 con 0x562e42251bb0 2024-05-08T18:50:44.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.224+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.224+0000 7f4b0a12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.224+0000 7f4b0a12e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.224+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562e4225a2a0 con 0x562e42251bb0 2024-05-08T18:50:44.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.224+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.224+0000 7f4b0a12e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:44.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.224+0000 7f4b0a12e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.224+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562e4225adf0 con 0x562e42251bb0 2024-05-08T18:50:44.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.224+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.224+0000 7f4b0a12e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:44.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.224+0000 7f4b0a12e800 20 zone default found 2024-05-08T18:50:44.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.224+0000 7f4b0a12e800 4 Realm: () 2024-05-08T18:50:44.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.224+0000 7f4b0a12e800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:44.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.224+0000 7f4b0a12e800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:44.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.224+0000 7f4b0a12e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:44.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.224+0000 7f4b0a12e800 20 zonegroup default 2024-05-08T18:50:44.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.224+0000 7f4b0a12e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.224+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562e4225ae50 con 0x7f4b000a1040 2024-05-08T18:50:44.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.225+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.225+0000 7f4b0a12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.225+0000 7f4b0a12e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.225+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562e4225cc70 con 0x562e422564c0 2024-05-08T18:50:44.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.225+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.225+0000 7f4b0a12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.225+0000 7f4b0a12e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.225+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562e4225d090 con 0x562e422564c0 2024-05-08T18:50:44.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.225+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.225+0000 7f4b0a12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.225+0000 7f4b0a12e800 20 started sync module instance, tier type = 2024-05-08T18:50:44.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.225+0000 7f4b0a12e800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:44.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.225+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4225c110 con 0x7f4af8014070 2024-05-08T18:50:44.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.226+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b00075030 con 0x7f4af8014070 2024-05-08T18:50:44.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.226+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94756678253664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4225d4d0 con 0x7f4af8014070 2024-05-08T18:50:44.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.226+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4225dd20 con 0x562e42251bb0 2024-05-08T18:50:44.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.227+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.227+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94756678261120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4225e390 con 0x562e42251bb0 2024-05-08T18:50:44.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.227+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4225eeb0 con 0x562e422564c0 2024-05-08T18:50:44.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.228+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94756678253664] v25'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b00075030 con 0x7f4af8014070 2024-05-08T18:50:44.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.228+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.228+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94756678265216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4225ee70 con 0x562e422564c0 2024-05-08T18:50:44.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.228+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4225f960 con 0x7f4af8014070 2024-05-08T18:50:44.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.229+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94756678261120] v25'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.229+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b00075030 con 0x7f4af8014070 2024-05-08T18:50:44.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.229+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94756678265216] v25'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.229+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94756678268016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4225fd80 con 0x7f4af8014070 2024-05-08T18:50:44.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.230+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4225c500 con 0x562e42251bb0 2024-05-08T18:50:44.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.230+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.230+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94756678271632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4225c500 con 0x562e42251bb0 2024-05-08T18:50:44.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.231+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e42261210 con 0x7f4b000a1040 2024-05-08T18:50:44.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.231+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94756678268016] v25'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b00075030 con 0x7f4af8014070 2024-05-08T18:50:44.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.232+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94756678271632] v25'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.232+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.232+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94756678272688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e422611d0 con 0x7f4b000a1040 2024-05-08T18:50:44.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.232+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e42261ab0 con 0x7f4b000a1040 2024-05-08T18:50:44.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.233+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94756678272688] v25'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.236+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.236+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94756678274304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e422611d0 con 0x7f4b000a1040 2024-05-08T18:50:44.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.236+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e422620d0 con 0x7f4b000a1040 2024-05-08T18:50:44.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.239+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(58 notify.7 [create] v25'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.239+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94756678274304] v25'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.239+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94756678278176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e422624f0 con 0x7f4b000a1040 2024-05-08T18:50:44.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.239+0000 7f4b0a12e800 20 add_watcher() i=0 2024-05-08T18:50:44.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.239+0000 7f4b0a12e800 20 add_watcher() i=1 2024-05-08T18:50:44.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.239+0000 7f4b0a12e800 20 add_watcher() i=2 2024-05-08T18:50:44.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.239+0000 7f4b0a12e800 20 add_watcher() i=3 2024-05-08T18:50:44.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.239+0000 7f4b0a12e800 20 add_watcher() i=4 2024-05-08T18:50:44.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.239+0000 7f4b0a12e800 20 add_watcher() i=5 2024-05-08T18:50:44.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.239+0000 7f4b0a12e800 20 add_watcher() i=6 2024-05-08T18:50:44.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.242+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94756678278176] v25'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.242+0000 7f4b0a12e800 20 add_watcher() i=7 2024-05-08T18:50:44.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.242+0000 7f4b0a12e800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:44.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.242+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562e422624f0 con 0x562e42251bb0 2024-05-08T18:50:44.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.242+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.242+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94756678279232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e42262490 con 0x562e42251bb0 2024-05-08T18:50:44.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.244+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94756678279232] v25'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.244+0000 7f49b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:44.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.244+0000 7f4b0a12e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:44.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.244+0000 7f4b0a12e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:44.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.245+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226ddb0 con 0x562e42251bb0 2024-05-08T18:50:44.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.246+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v25'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.246+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226e400 con 0x7f4b000a1040 2024-05-08T18:50:44.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.247+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v25'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.247+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226e840 con 0x562e422564c0 2024-05-08T18:50:44.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.249+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v25'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.249+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226e850 con 0x562e42251bb0 2024-05-08T18:50:44.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.252+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v25'42 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.252+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226ede0 con 0x7f4af8014070 2024-05-08T18:50:44.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.255+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v25'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b00075030 con 0x7f4af8014070 2024-05-08T18:50:44.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.256+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f290 con 0x562e422564c0 2024-05-08T18:50:44.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.258+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v25'19 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.258+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f290 con 0x562e42251bb0 2024-05-08T18:50:44.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.259+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v25'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.259+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f290 con 0x7f4b000a1040 2024-05-08T18:50:44.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.260+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v25'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.260+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f320 con 0x7f4af8014070 2024-05-08T18:50:44.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.264+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v25'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b00075030 con 0x7f4af8014070 2024-05-08T18:50:44.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.264+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f3b0 con 0x562e422564c0 2024-05-08T18:50:44.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.265+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v25'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.265+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f4a0 con 0x7f4af8014070 2024-05-08T18:50:44.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.267+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v25'30 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b00075030 con 0x7f4af8014070 2024-05-08T18:50:44.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.267+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f8c0 con 0x7f4b000a1040 2024-05-08T18:50:44.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.269+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v25'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.269+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f8c0 con 0x7f4af8014070 2024-05-08T18:50:44.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.270+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v25'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b00075030 con 0x7f4af8014070 2024-05-08T18:50:44.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.270+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f8c0 con 0x7f4b000a1040 2024-05-08T18:50:44.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.275+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v25'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.275+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f8c0 con 0x562e42251bb0 2024-05-08T18:50:44.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.277+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v25'43 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.277+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f8c0 con 0x562e422564c0 2024-05-08T18:50:44.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.280+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v25'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.280+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f8c0 con 0x7f4af8014070 2024-05-08T18:50:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.282+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v25'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b00075030 con 0x7f4af8014070 2024-05-08T18:50:44.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.282+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f8c0 con 0x562e422564c0 2024-05-08T18:50:44.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.285+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v25'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.285+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f8c0 con 0x562e42251bb0 2024-05-08T18:50:44.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.286+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v25'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.286+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f8c0 con 0x562e42251bb0 2024-05-08T18:50:44.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.288+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v25'44 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.288+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f8c0 con 0x562e422564c0 2024-05-08T18:50:44.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.289+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v25'24 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.289+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f8c0 con 0x7f4af8014070 2024-05-08T18:50:44.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.289+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v25'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b00075030 con 0x7f4af8014070 2024-05-08T18:50:44.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.289+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f8c0 con 0x562e422564c0 2024-05-08T18:50:44.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.291+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v25'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.291+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f8c0 con 0x562e422564c0 2024-05-08T18:50:44.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.294+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v25'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.294+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f8c0 con 0x562e422564c0 2024-05-08T18:50:44.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.297+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v25'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.297+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f8c0 con 0x562e422564c0 2024-05-08T18:50:44.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.299+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v25'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.299+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f8c0 con 0x7f4b000a1040 2024-05-08T18:50:44.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.302+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v25'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.302+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f8c0 con 0x562e422564c0 2024-05-08T18:50:44.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.305+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v25'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.305+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f8c0 con 0x7f4b000a1040 2024-05-08T18:50:44.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.306+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v25'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.306+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f8c0 con 0x562e422564c0 2024-05-08T18:50:44.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.307+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v25'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.307+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f8c0 con 0x7f4b000a1040 2024-05-08T18:50:44.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.309+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v25'26 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.309+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226f8c0 con 0x7f4af8014070 2024-05-08T18:50:44.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.310+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v25'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b00075030 con 0x7f4af8014070 2024-05-08T18:50:44.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.310+0000 7f49b67fc640 20 reqs_thread_entry: start 2024-05-08T18:50:44.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.310+0000 7f4b0a12e800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:44.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.310+0000 7f4b0a12e800 20 Filter name: none 2024-05-08T18:50:44.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.310+0000 7f4927fff640 20 reqs_thread_entry: start 2024-05-08T18:50:44.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.310+0000 7f4b0a12e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:50:44.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.310+0000 7f4b0a12e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.310+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562e4229a870 con 0x562e42251bb0 2024-05-08T18:50:44.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.311+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.311+0000 7f4b0a12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.311+0000 7f4b0a12e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-05-08T18:50:44.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.311+0000 7f4b0a12e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:44.311 INFO:teuthology.orchestra.run.smithi132.stderr:could not remove user: unable to remove user, user does not exist 2024-05-08T18:50:44.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.311+0000 7f49b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:44.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.311+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94756678279232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4226bab0 con 0x562e42251bb0 2024-05-08T18:50:44.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.315+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94756678279232] v25'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.315+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94756678253664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e42262040 con 0x7f4af8014070 2024-05-08T18:50:44.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.316+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94756678253664] v25'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b00075030 con 0x7f4af8014070 2024-05-08T18:50:44.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.316+0000 7f4b0a12e800 20 remove_watcher() i=0 2024-05-08T18:50:44.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.316+0000 7f4b0a12e800 2 removed watcher, disabling cache 2024-05-08T18:50:44.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.316+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94756678261120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e42262040 con 0x562e42251bb0 2024-05-08T18:50:44.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.317+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94756678261120] v25'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.317+0000 7f4b0a12e800 20 remove_watcher() i=1 2024-05-08T18:50:44.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.317+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94756678265216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4225d980 con 0x562e422564c0 2024-05-08T18:50:44.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.318+0000 7f4b06685640 1 -- 172.21.15.132:0/1381225050 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94756678265216] v25'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af803d070 con 0x562e422564c0 2024-05-08T18:50:44.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.318+0000 7f4b0a12e800 20 remove_watcher() i=2 2024-05-08T18:50:44.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.318+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94756678268016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e42262040 con 0x7f4af8014070 2024-05-08T18:50:44.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.319+0000 7f4b05e84640 1 -- 172.21.15.132:0/1381225050 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94756678268016] v25'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b00075030 con 0x7f4af8014070 2024-05-08T18:50:44.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.319+0000 7f4b0a12e800 20 remove_watcher() i=3 2024-05-08T18:50:44.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.319+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94756678271632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4225e980 con 0x562e42251bb0 2024-05-08T18:50:44.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.321+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94756678271632] v25'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x562e42251bb0 2024-05-08T18:50:44.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.321+0000 7f4b0a12e800 20 remove_watcher() i=4 2024-05-08T18:50:44.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.321+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94756678272688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4225f470 con 0x7f4b000a1040 2024-05-08T18:50:44.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.322+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94756678272688] v25'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.322+0000 7f4b0a12e800 20 remove_watcher() i=5 2024-05-08T18:50:44.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.322+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94756678274304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e42262040 con 0x7f4b000a1040 2024-05-08T18:50:44.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.324+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94756678274304] v25'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.324+0000 7f4b0a12e800 20 remove_watcher() i=6 2024-05-08T18:50:44.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.324+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94756678278176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562e4225e980 con 0x7f4b000a1040 2024-05-08T18:50:44.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.325+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94756678278176] v25'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4af0029040 con 0x7f4b000a1040 2024-05-08T18:50:44.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.325+0000 7f4b0a12e800 20 remove_watcher() i=7 2024-05-08T18:50:44.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.325+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f4b000a1040 msgr2=0x7f4b0005b7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.325+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/1381225050 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f4b000a1040 0x7f4b0005b7a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.325+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562e42251bb0 msgr2=0x562e42254070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.325+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/1381225050 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562e42251bb0 0x562e42254070 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.325+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4af8014070 msgr2=0x7f4af80389c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.325+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/1381225050 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4af8014070 0x7f4af80389c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.325+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562e422564c0 msgr2=0x562e422588b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.325+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/1381225050 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562e422564c0 0x562e422588b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.325+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49d003bba0 msgr2=0x7f49d003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.325+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/1381225050 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49d003bba0 0x7f49d003e060 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4b0006d000 tx=0x7f4b0008b000 comp rx=0 tx=0).stop 2024-05-08T18:50:44.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.325+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211b390 msgr2=0x562e422460b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.325+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/1381225050 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211b390 0x562e422460b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4af8001700 tx=0x7f4af8052c10 comp rx=0 tx=0).stop 2024-05-08T18:50:44.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.325+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 reap_dead start 2024-05-08T18:50:44.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.325+0000 7f4b05683640 1 -- 172.21.15.132:0/1381225050 reap_dead start 2024-05-08T18:50:44.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.325+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 shutdown_connections 2024-05-08T18:50:44.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.325+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 >> 172.21.15.132:0/1381225050 conn(0x562e42238bf0 msgr2=0x562e42236250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.325+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 shutdown_connections 2024-05-08T18:50:44.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.325+0000 7f4b0a12e800 1 -- 172.21.15.132:0/1381225050 wait complete. 2024-05-08T18:50:44.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 -- 172.21.15.132:0/2127941055 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49e003bba0 msgr2=0x7f49e003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/2127941055 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49e003bba0 0x7f49e003e060 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x562e4221bd40 tx=0x7f4b0005ce80 comp rx=0 tx=0).stop 2024-05-08T18:50:44.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 -- 172.21.15.132:0/2127941055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4222f610 msgr2=0x562e4222fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/2127941055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4222f610 0x562e4222fa30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x562e4221bca0 tx=0x7f4af8018830 comp rx=0 tx=0).stop 2024-05-08T18:50:44.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 -- 172.21.15.132:0/2127941055 shutdown_connections 2024-05-08T18:50:44.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/2127941055 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49e003bba0 0x7f49e003e060 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/2127941055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4222f610 0x562e4222fa30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 -- 172.21.15.132:0/2127941055 >> 172.21.15.132:0/2127941055 conn(0x562e422236b0 msgr2=0x562e42223ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 -- 172.21.15.132:0/2127941055 shutdown_connections 2024-05-08T18:50:44.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 -- 172.21.15.132:0/2127941055 wait complete. 2024-05-08T18:50:44.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 -- 172.21.15.132:0/586481509 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562e4211e600 msgr2=0x562e4221b310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/586481509 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562e4211e600 0x562e4221b310 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 -- 172.21.15.132:0/586481509 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562e4221dbf0 msgr2=0x562e4221ffe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/586481509 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562e4221dbf0 0x562e4221ffe0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 -- 172.21.15.132:0/586481509 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49ec03bb50 msgr2=0x7f49ec03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/586481509 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49ec03bb50 0x7f49ec03e010 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4af0000f60 tx=0x7f4af00012b0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 -- 172.21.15.132:0/586481509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211bcd0 msgr2=0x562e422140d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/586481509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211bcd0 0x562e422140d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000a470 tx=0x7f4b00003020 comp rx=0 tx=0).stop 2024-05-08T18:50:44.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 -- 172.21.15.132:0/586481509 shutdown_connections 2024-05-08T18:50:44.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/586481509 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562e4221dbf0 0x562e4221ffe0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/586481509 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562e4211e600 0x562e4221b310 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/586481509 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f49ec03bb50 0x7f49ec03e010 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 --2- 172.21.15.132:0/586481509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e4211bcd0 0x562e422140d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 -- 172.21.15.132:0/586481509 >> 172.21.15.132:0/586481509 conn(0x562e42115720 msgr2=0x562e42206740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 -- 172.21.15.132:0/586481509 shutdown_connections 2024-05-08T18:50:44.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.326+0000 7f4b0a12e800 1 -- 172.21.15.132:0/586481509 wait complete. 2024-05-08T18:50:44.334 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-08T18:50:44.334 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-08T18:50:44.335 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-08T18:50:44.335 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-05-08T18:50:44.380 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:44.381 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:44.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.382+0000 7fe4f100a800 1 Processor -- start 2024-05-08T18:50:44.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.382+0000 7fe4f100a800 1 -- start start 2024-05-08T18:50:44.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.382+0000 7fe4f100a800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x56248f0655c0 0x56248f0f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.382+0000 7fe4f100a800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56248f0f9150 con 0x56248f0f5450 2024-05-08T18:50:44.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.382+0000 7fe4f100a800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x56248ef92e20 con 0x56248f0655c0 2024-05-08T18:50:44.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.382+0000 7fe4eeb02640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x56248f0655c0 0x56248f0f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.382+0000 7fe4eeb02640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x56248f0655c0 0x56248f0f4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59526/0 (socket says 172.21.15.132:59526) 2024-05-08T18:50:44.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.382+0000 7fe4e7fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x56248f0f5450 0x56248f0f78f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46668/0 (socket says 172.21.15.132:46668) 2024-05-08T18:50:44.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.382+0000 7fe4eeb02640 1 -- 172.21.15.132:0/2445288693 learned_addr learned my addr 172.21.15.132:0/2445288693 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.383+0000 7fe4eeb02640 1 -- 172.21.15.132:0/2445288693 >> v1:172.21.15.42:6789/0 conn(0x56248f0f5450 legacy=0x56248f0f78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.383+0000 7fe4eeb02640 1 -- 172.21.15.132:0/2445288693 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56248f0fa380 con 0x56248f0655c0 2024-05-08T18:50:44.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.384+0000 7fe4eeb02640 1 --2- 172.21.15.132:0/2445288693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f0655c0 0x56248f0f4eb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000a520 tx=0x7fe4e001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd08f6c75ae2cef9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.385+0000 7fe4ee301640 1 -- 172.21.15.132:0/2445288693 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e0057070 con 0x56248f0655c0 2024-05-08T18:50:44.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.385+0000 7fe4ee301640 1 -- 172.21.15.132:0/2445288693 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e0052570 con 0x56248f0655c0 2024-05-08T18:50:44.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.385+0000 7fe4ee301640 1 -- 172.21.15.132:0/2445288693 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e004ae60 con 0x56248f0655c0 2024-05-08T18:50:44.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.385+0000 7fe4f100a800 1 -- 172.21.15.132:0/2445288693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f0655c0 msgr2=0x56248f0f4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.385+0000 7fe4f100a800 1 --2- 172.21.15.132:0/2445288693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f0655c0 0x56248f0f4eb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000a520 tx=0x7fe4e001d010 comp rx=0 tx=0).stop 2024-05-08T18:50:44.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.385+0000 7fe4f100a800 1 -- 172.21.15.132:0/2445288693 shutdown_connections 2024-05-08T18:50:44.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.385+0000 7fe4f100a800 1 --2- 172.21.15.132:0/2445288693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f0655c0 0x56248f0f4eb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.385+0000 7fe4f100a800 1 -- 172.21.15.132:0/2445288693 >> 172.21.15.132:0/2445288693 conn(0x56248f0ec810 msgr2=0x56248f0eec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.385+0000 7fe4f100a800 1 -- 172.21.15.132:0/2445288693 shutdown_connections 2024-05-08T18:50:44.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.385+0000 7fe4f100a800 1 -- 172.21.15.132:0/2445288693 wait complete. 2024-05-08T18:50:44.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.399+0000 7fe4f100a800 1 Processor -- start 2024-05-08T18:50:44.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.399+0000 7fe4f100a800 1 -- start start 2024-05-08T18:50:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.399+0000 7fe4f100a800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f0655c0 0x56248f1e36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.399+0000 7fe4f100a800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56248f03d5d0 con 0x56248f0655c0 2024-05-08T18:50:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.399+0000 7fe4eeb02640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f0655c0 0x56248f1e36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.399+0000 7fe4eeb02640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f0655c0 0x56248f1e36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59542/0 (socket says 172.21.15.132:59542) 2024-05-08T18:50:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.399+0000 7fe4eeb02640 1 -- 172.21.15.132:0/430580698 learned_addr learned my addr 172.21.15.132:0/430580698 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.400+0000 7fe4eeb02640 1 -- 172.21.15.132:0/430580698 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56248f1e3cc0 con 0x56248f0655c0 2024-05-08T18:50:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.400+0000 7fe4eeb02640 1 --2- 172.21.15.132:0/430580698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f0655c0 0x56248f1e36f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0055040 tx=0x7fe4e004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b1774017548a1a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.400+0000 7fe3dce09640 1 -- 172.21.15.132:0/430580698 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e0057040 con 0x56248f0655c0 2024-05-08T18:50:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.400+0000 7fe3dce09640 1 -- 172.21.15.132:0/430580698 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e0052720 con 0x56248f0655c0 2024-05-08T18:50:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.400+0000 7fe3dce09640 1 -- 172.21.15.132:0/430580698 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e0052a20 con 0x56248f0655c0 2024-05-08T18:50:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.401+0000 7fe4f100a800 1 -- 172.21.15.132:0/430580698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f0655c0 msgr2=0x56248f1e36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.401+0000 7fe4f100a800 1 --2- 172.21.15.132:0/430580698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f0655c0 0x56248f1e36f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0055040 tx=0x7fe4e004c000 comp rx=0 tx=0).stop 2024-05-08T18:50:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.401+0000 7fe4f100a800 1 -- 172.21.15.132:0/430580698 shutdown_connections 2024-05-08T18:50:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.401+0000 7fe4f100a800 1 --2- 172.21.15.132:0/430580698 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f0655c0 0x56248f1e36f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.401+0000 7fe4f100a800 1 -- 172.21.15.132:0/430580698 >> 172.21.15.132:0/430580698 conn(0x56248f0ec810 msgr2=0x56248f1df010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.401+0000 7fe4f100a800 1 -- 172.21.15.132:0/430580698 shutdown_connections 2024-05-08T18:50:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.401+0000 7fe4f100a800 1 -- 172.21.15.132:0/430580698 wait complete. 2024-05-08T18:50:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.401+0000 7fe4f100a800 1 Processor -- start 2024-05-08T18:50:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.401+0000 7fe4f100a800 1 -- start start 2024-05-08T18:50:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.401+0000 7fe4f100a800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f0655c0 0x56248f1eb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.401+0000 7fe4f100a800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56248f0f95c0 con 0x56248f0655c0 2024-05-08T18:50:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.401+0000 7fe4eeb02640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f0655c0 0x56248f1eb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.402+0000 7fe4eeb02640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f0655c0 0x56248f1eb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59550/0 (socket says 172.21.15.132:59550) 2024-05-08T18:50:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.402+0000 7fe4eeb02640 1 -- 172.21.15.132:0/521418492 learned_addr learned my addr 172.21.15.132:0/521418492 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.402+0000 7fe4eeb02640 1 -- 172.21.15.132:0/521418492 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56248f1eb6e0 con 0x56248f0655c0 2024-05-08T18:50:44.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.402+0000 7fe4eeb02640 1 --2- 172.21.15.132:0/521418492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f0655c0 0x56248f1eb1a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0052540 tx=0x7fe4e0003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.402+0000 7fe3db606640 1 -- 172.21.15.132:0/521418492 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e0073070 con 0x56248f0655c0 2024-05-08T18:50:44.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.402+0000 7fe3db606640 1 -- 172.21.15.132:0/521418492 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e005d440 con 0x56248f0655c0 2024-05-08T18:50:44.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.402+0000 7fe4f100a800 1 -- 172.21.15.132:0/521418492 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56248f1eb970 con 0x56248f0655c0 2024-05-08T18:50:44.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.402+0000 7fe3db606640 1 -- 172.21.15.132:0/521418492 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e0057070 con 0x56248f0655c0 2024-05-08T18:50:44.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.402+0000 7fe4f100a800 1 -- 172.21.15.132:0/521418492 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56248f1ee620 con 0x56248f0655c0 2024-05-08T18:50:44.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.403+0000 7fe4f100a800 1 Processor -- start 2024-05-08T18:50:44.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.403+0000 7fe4f100a800 1 -- start start 2024-05-08T18:50:44.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.403+0000 7fe4f100a800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f1f8830 0x56248f1f8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.403+0000 7fe4f100a800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56248efe3fc0 con 0x56248f1f8830 2024-05-08T18:50:44.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.403+0000 7fe3db606640 1 -- 172.21.15.132:0/521418492 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fe4e0076070 con 0x56248f0655c0 2024-05-08T18:50:44.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.403+0000 7fe4ef303640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f1f8830 0x56248f1f8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.403+0000 7fe4ef303640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f1f8830 0x56248f1f8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59556/0 (socket says 172.21.15.132:59556) 2024-05-08T18:50:44.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.403+0000 7fe4ef303640 1 -- 172.21.15.132:0/3279101660 learned_addr learned my addr 172.21.15.132:0/3279101660 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.403+0000 7fe3db606640 1 --2- 172.21.15.132:0/521418492 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe3d403bba0 0x7fe3d403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.403+0000 7fe3db606640 1 -- 172.21.15.132:0/521418492 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fe4e0093db0 con 0x56248f0655c0 2024-05-08T18:50:44.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.404+0000 7fe4eeb02640 1 --2- 172.21.15.132:0/521418492 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe3d403bba0 0x7fe3d403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.404+0000 7fe4ef303640 1 -- 172.21.15.132:0/3279101660 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56248f1f9190 con 0x56248f1f8830 2024-05-08T18:50:44.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.404+0000 7fe4ef303640 1 --2- 172.21.15.132:0/3279101660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f1f8830 0x56248f1f8c50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800a430 tx=0x7fe4e800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3dd9234dfe02802 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.404+0000 7fe4eeb02640 1 --2- 172.21.15.132:0/521418492 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe3d403bba0 0x7fe3d403e060 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe4e005c750 tx=0x7fe4e0066f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.404+0000 7fe3d9602640 1 -- 172.21.15.132:0/3279101660 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e8015070 con 0x56248f1f8830 2024-05-08T18:50:44.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.404+0000 7fe3d9602640 1 -- 172.21.15.132:0/3279101660 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e8001670 con 0x56248f1f8830 2024-05-08T18:50:44.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.404+0000 7fe3d9602640 1 -- 172.21.15.132:0/3279101660 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e8001990 con 0x56248f1f8830 2024-05-08T18:50:44.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.404+0000 7fe4f100a800 1 -- 172.21.15.132:0/3279101660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f1f8830 msgr2=0x56248f1f8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.404+0000 7fe4f100a800 1 --2- 172.21.15.132:0/3279101660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f1f8830 0x56248f1f8c50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800a430 tx=0x7fe4e800a8f0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.404+0000 7fe4f100a800 1 -- 172.21.15.132:0/3279101660 shutdown_connections 2024-05-08T18:50:44.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.404+0000 7fe4f100a800 1 --2- 172.21.15.132:0/3279101660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f1f8830 0x56248f1f8c50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.404+0000 7fe4f100a800 1 -- 172.21.15.132:0/3279101660 >> 172.21.15.132:0/3279101660 conn(0x56248f0f5450 msgr2=0x56248f1f52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.404+0000 7fe4f100a800 1 -- 172.21.15.132:0/3279101660 shutdown_connections 2024-05-08T18:50:44.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.404+0000 7fe4f100a800 1 -- 172.21.15.132:0/3279101660 wait complete. 2024-05-08T18:50:44.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.405+0000 7fe4f100a800 1 Processor -- start 2024-05-08T18:50:44.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.405+0000 7fe4f100a800 1 -- start start 2024-05-08T18:50:44.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.405+0000 7fe4f100a800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f1f8830 0x56248f1ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.405+0000 7fe4f100a800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56248f1f9b20 con 0x56248f1f8830 2024-05-08T18:50:44.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.405+0000 7fe4ef303640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f1f8830 0x56248f1ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.405+0000 7fe4ef303640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f1f8830 0x56248f1ffd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59568/0 (socket says 172.21.15.132:59568) 2024-05-08T18:50:44.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.405+0000 7fe4ef303640 1 -- 172.21.15.132:0/567334740 learned_addr learned my addr 172.21.15.132:0/567334740 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.406+0000 7fe4ef303640 1 -- 172.21.15.132:0/567334740 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56248f2002a0 con 0x56248f1f8830 2024-05-08T18:50:44.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.406+0000 7fe4ef303640 1 --2- 172.21.15.132:0/567334740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f1f8830 0x56248f1ffd60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800a930 tx=0x7fe4e8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.406+0000 7fe3d37fe640 1 -- 172.21.15.132:0/567334740 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e8020020 con 0x56248f1f8830 2024-05-08T18:50:44.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.406+0000 7fe3d37fe640 1 -- 172.21.15.132:0/567334740 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e80108b0 con 0x56248f1f8830 2024-05-08T18:50:44.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.406+0000 7fe3d37fe640 1 -- 172.21.15.132:0/567334740 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e8015040 con 0x56248f1f8830 2024-05-08T18:50:44.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.406+0000 7fe4f100a800 1 -- 172.21.15.132:0/567334740 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56248f200530 con 0x56248f1f8830 2024-05-08T18:50:44.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.407+0000 7fe4f100a800 1 -- 172.21.15.132:0/567334740 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56248f2031e0 con 0x56248f1f8830 2024-05-08T18:50:44.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.407+0000 7fe3d37fe640 1 -- 172.21.15.132:0/567334740 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fe4e8023020 con 0x56248f1f8830 2024-05-08T18:50:44.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.408+0000 7fe3d37fe640 1 --2- 172.21.15.132:0/567334740 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe3c803bba0 0x7fe3c803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.408+0000 7fe3d37fe640 1 -- 172.21.15.132:0/567334740 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fe4e80521c0 con 0x56248f1f8830 2024-05-08T18:50:44.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.408+0000 7fe4e7fff640 1 --2- 172.21.15.132:0/567334740 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe3c803bba0 0x7fe3c803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.408+0000 7fe4f100a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:44.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.408+0000 7fe4f100a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.408+0000 7fe4e7fff640 1 --2- 172.21.15.132:0/567334740 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe3c803bba0 0x7fe3c803e060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8000f60 tx=0x7fe4d80012f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.408+0000 7fe4f100a800 1 Processor -- start 2024-05-08T18:50:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.408+0000 7fe4f100a800 1 -- start start 2024-05-08T18:50:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.408+0000 7fe4f100a800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f21c530 0x56248f21c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.409+0000 7fe4f100a800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56248f1e3f80 con 0x56248f21c530 2024-05-08T18:50:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.409+0000 7fe4eeb02640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f21c530 0x56248f21c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.409+0000 7fe4eeb02640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f21c530 0x56248f21c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59570/0 (socket says 172.21.15.132:59570) 2024-05-08T18:50:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.409+0000 7fe4eeb02640 1 -- 172.21.15.132:0/2597784140 learned_addr learned my addr 172.21.15.132:0/2597784140 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.409+0000 7fe4eeb02640 1 -- 172.21.15.132:0/2597784140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56248f21ce90 con 0x56248f21c530 2024-05-08T18:50:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.409+0000 7fe4eeb02640 1 --2- 172.21.15.132:0/2597784140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f21c530 0x56248f21c950 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0006e20 tx=0x7fe4e0076f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.409+0000 7fe3b37e6640 1 -- 172.21.15.132:0/2597784140 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e005c950 con 0x56248f21c530 2024-05-08T18:50:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.409+0000 7fe3b37e6640 1 -- 172.21.15.132:0/2597784140 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e0006c30 con 0x56248f21c530 2024-05-08T18:50:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.409+0000 7fe4f100a800 1 -- 172.21.15.132:0/2597784140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56248f21d900 con 0x56248f21c530 2024-05-08T18:50:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.409+0000 7fe3b37e6640 1 -- 172.21.15.132:0/2597784140 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e00766e0 con 0x56248f21c530 2024-05-08T18:50:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.410+0000 7fe4f100a800 1 -- 172.21.15.132:0/2597784140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56248f21de00 con 0x56248f21c530 2024-05-08T18:50:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.410+0000 7fe3b37e6640 1 -- 172.21.15.132:0/2597784140 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fe4e00934a0 con 0x56248f21c530 2024-05-08T18:50:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.410+0000 7fe3b37e6640 1 --2- 172.21.15.132:0/2597784140 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe33003bba0 0x7fe33003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.410+0000 7fe3b37e6640 1 -- 172.21.15.132:0/2597784140 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fe4e009eaf0 con 0x56248f21c530 2024-05-08T18:50:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.411+0000 7fe4e7fff640 1 --2- 172.21.15.132:0/2597784140 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe33003bba0 0x7fe33003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.411+0000 7fe3b17e2640 20 reqs_thread_entry: start 2024-05-08T18:50:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.411+0000 7fe4e7fff640 1 --2- 172.21.15.132:0/2597784140 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe33003bba0 0x7fe33003e060 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8001ed0 tx=0x7fe4d800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.411+0000 7fe4f100a800 1 --2- 172.21.15.132:0/521418492 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56248f229f80 0x56248f22c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.411+0000 7fe4f100a800 1 -- 172.21.15.132:0/521418492 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56248f22caf0 con 0x56248f229f80 2024-05-08T18:50:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.411+0000 7fe4ef303640 1 --2- 172.21.15.132:0/521418492 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56248f229f80 0x56248f22c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.411+0000 7fe4ef303640 1 --2- 172.21.15.132:0/521418492 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56248f229f80 0x56248f22c420 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.412+0000 7fe4ef303640 1 -- 172.21.15.132:0/521418492 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4e8010d70 con 0x56248f229f80 2024-05-08T18:50:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.412+0000 7fe4f100a800 1 --2- 172.21.15.132:0/521418492 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56248f22e8c0 0x56248f230cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.412+0000 7fe4f100a800 1 -- 172.21.15.132:0/521418492 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:2 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56248f2313b0 con 0x56248f22e8c0 2024-05-08T18:50:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.412+0000 7fe4eeb02640 1 --2- 172.21.15.132:0/521418492 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56248f22e8c0 0x56248f230cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.412+0000 7fe4eeb02640 1 --2- 172.21.15.132:0/521418492 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56248f22e8c0 0x56248f230cb0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.412+0000 7fe4eeb02640 1 -- 172.21.15.132:0/521418492 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(2 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe4e0075030 con 0x56248f22e8c0 2024-05-08T18:50:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.412+0000 7fe4f100a800 1 -- 172.21.15.132:0/521418492 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56248f22ddc0 con 0x56248f22e8c0 2024-05-08T18:50:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.414+0000 7fe4eeb02640 1 -- 172.21.15.132:0/521418492 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [stat,call,call,writefull 0~993] v25'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fe4e0075030 con 0x56248f22e8c0 2024-05-08T18:50:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 -- 172.21.15.132:0/567334740 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe3c803bba0 msgr2=0x7fe3c803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 --2- 172.21.15.132:0/567334740 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe3c803bba0 0x7fe3c803e060 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8000f60 tx=0x7fe4d80012f0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 -- 172.21.15.132:0/567334740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f1f8830 msgr2=0x56248f1ffd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 --2- 172.21.15.132:0/567334740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f1f8830 0x56248f1ffd60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800a930 tx=0x7fe4e8003370 comp rx=0 tx=0).stop 2024-05-08T18:50:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 -- 172.21.15.132:0/567334740 shutdown_connections 2024-05-08T18:50:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 --2- 172.21.15.132:0/567334740 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe3c803bba0 0x7fe3c803e060 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 --2- 172.21.15.132:0/567334740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f1f8830 0x56248f1ffd60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 -- 172.21.15.132:0/567334740 >> 172.21.15.132:0/567334740 conn(0x56248f0f5450 msgr2=0x56248f1f2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 -- 172.21.15.132:0/567334740 shutdown_connections 2024-05-08T18:50:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 -- 172.21.15.132:0/567334740 wait complete. 2024-05-08T18:50:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 -- 172.21.15.132:0/2597784140 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe33003bba0 msgr2=0x7fe33003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 --2- 172.21.15.132:0/2597784140 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe33003bba0 0x7fe33003e060 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8001ed0 tx=0x7fe4d800f000 comp rx=0 tx=0).stop 2024-05-08T18:50:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 -- 172.21.15.132:0/2597784140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f21c530 msgr2=0x56248f21c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 --2- 172.21.15.132:0/2597784140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f21c530 0x56248f21c950 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0006e20 tx=0x7fe4e0076f50 comp rx=0 tx=0).stop 2024-05-08T18:50:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 -- 172.21.15.132:0/2597784140 shutdown_connections 2024-05-08T18:50:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 --2- 172.21.15.132:0/2597784140 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe33003bba0 0x7fe33003e060 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 --2- 172.21.15.132:0/2597784140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f21c530 0x56248f21c950 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 -- 172.21.15.132:0/2597784140 >> 172.21.15.132:0/2597784140 conn(0x56248f211000 msgr2=0x56248f211a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 -- 172.21.15.132:0/2597784140 shutdown_connections 2024-05-08T18:50:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 -- 172.21.15.132:0/2597784140 wait complete. 2024-05-08T18:50:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 -- 172.21.15.132:0/521418492 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56248f229f80 msgr2=0x56248f22c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 --2- 172.21.15.132:0/521418492 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56248f229f80 0x56248f22c420 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 -- 172.21.15.132:0/521418492 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56248f22e8c0 msgr2=0x56248f230cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 --2- 172.21.15.132:0/521418492 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56248f22e8c0 0x56248f230cb0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 -- 172.21.15.132:0/521418492 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe3d403bba0 msgr2=0x7fe3d403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.415+0000 7fe4f100a800 1 --2- 172.21.15.132:0/521418492 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe3d403bba0 0x7fe3d403e060 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe4e005c750 tx=0x7fe4e0066f90 comp rx=0 tx=0).stop 2024-05-08T18:50:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.416+0000 7fe4f100a800 1 -- 172.21.15.132:0/521418492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f0655c0 msgr2=0x56248f1eb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.416+0000 7fe4f100a800 1 --2- 172.21.15.132:0/521418492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f0655c0 0x56248f1eb1a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0052540 tx=0x7fe4e0003020 comp rx=0 tx=0).stop 2024-05-08T18:50:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.416+0000 7fe4f100a800 1 -- 172.21.15.132:0/521418492 shutdown_connections 2024-05-08T18:50:44.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.416+0000 7fe4f100a800 1 --2- 172.21.15.132:0/521418492 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56248f22e8c0 0x56248f230cb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.416+0000 7fe4f100a800 1 --2- 172.21.15.132:0/521418492 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56248f229f80 0x56248f22c420 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.416+0000 7fe4f100a800 1 --2- 172.21.15.132:0/521418492 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe3d403bba0 0x7fe3d403e060 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.416+0000 7fe4f100a800 1 --2- 172.21.15.132:0/521418492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56248f0655c0 0x56248f1eb1a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.416+0000 7fe4f100a800 1 -- 172.21.15.132:0/521418492 >> 172.21.15.132:0/521418492 conn(0x56248f0ec810 msgr2=0x56248f1dd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.416+0000 7fe4f100a800 1 -- 172.21.15.132:0/521418492 shutdown_connections 2024-05-08T18:50:44.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.416+0000 7fe4f100a800 1 -- 172.21.15.132:0/521418492 wait complete. 2024-05-08T18:50:44.424 INFO:teuthology.orchestra.run.smithi132.stdout:{"id":"bda7b4b2-a5a7-480e-b283-597f208ae0d4","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-05-08T18:50:44.425 DEBUG:tasks.util.rgw: json result: {'id': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-05-08T18:50:44.426 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-05-08T18:50:44.426 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-05-08T18:50:44.426 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-05-08T18:50:44.469 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:44.469 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:44.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.471+0000 7fcd8de30800 1 Processor -- start 2024-05-08T18:50:44.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.471+0000 7fcd8de30800 1 -- start start 2024-05-08T18:50:44.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.471+0000 7fcd8de30800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55be2489f510 0x55be2489f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.471+0000 7fcd8de30800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55be2489ff60 con 0x55be248a2550 2024-05-08T18:50:44.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.471+0000 7fcd8de30800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55be24741e20 con 0x55be2489f510 2024-05-08T18:50:44.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.471+0000 7fcd89084640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55be2489f510 0x55be2489f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.471+0000 7fcd88883640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55be248a2550 0x55be248a2a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46684/0 (socket says 172.21.15.132:46684) 2024-05-08T18:50:44.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.471+0000 7fcd89084640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55be2489f510 0x55be2489f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59584/0 (socket says 172.21.15.132:59584) 2024-05-08T18:50:44.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.471+0000 7fcd88883640 1 -- 172.21.15.132:0/306908961 learned_addr learned my addr 172.21.15.132:0/306908961 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:50:44.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.472+0000 7fcd89084640 1 -- 172.21.15.132:0/306908961 >> v1:172.21.15.42:6789/0 conn(0x55be248a2550 legacy=0x55be248a2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.472+0000 7fcd89084640 1 -- 172.21.15.132:0/306908961 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be248a3110 con 0x55be2489f510 2024-05-08T18:50:44.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.473+0000 7fcd89084640 1 --2- 172.21.15.132:0/306908961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be2489f510 0x55be2489f930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c005fd0 tx=0x7fcd7c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6527b76890572db6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.474+0000 7fcd7bfff640 1 -- 172.21.15.132:0/306908961 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd7c052560 con 0x55be2489f510 2024-05-08T18:50:44.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.474+0000 7fcd7bfff640 1 -- 172.21.15.132:0/306908961 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd7c052700 con 0x55be2489f510 2024-05-08T18:50:44.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.474+0000 7fcd7bfff640 1 -- 172.21.15.132:0/306908961 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd7c052a60 con 0x55be2489f510 2024-05-08T18:50:44.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.474+0000 7fcd8de30800 1 -- 172.21.15.132:0/306908961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be2489f510 msgr2=0x55be2489f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.474+0000 7fcd8de30800 1 --2- 172.21.15.132:0/306908961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be2489f510 0x55be2489f930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c005fd0 tx=0x7fcd7c01ccc0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.474+0000 7fcd8de30800 1 -- 172.21.15.132:0/306908961 shutdown_connections 2024-05-08T18:50:44.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.474+0000 7fcd8de30800 1 --2- 172.21.15.132:0/306908961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be2489f510 0x55be2489f930 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.474+0000 7fcd8de30800 1 -- 172.21.15.132:0/306908961 >> 172.21.15.132:0/306908961 conn(0x55be2489ae90 msgr2=0x55be2489d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.474+0000 7fcd8de30800 1 -- 172.21.15.132:0/306908961 shutdown_connections 2024-05-08T18:50:44.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.474+0000 7fcd8de30800 1 -- 172.21.15.132:0/306908961 wait complete. 2024-05-08T18:50:44.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.487+0000 7fcd8de30800 1 Processor -- start 2024-05-08T18:50:44.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.487+0000 7fcd8de30800 1 -- start start 2024-05-08T18:50:44.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.488+0000 7fcd8de30800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be2489f510 0x55be249926f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.488+0000 7fcd8de30800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55be247ec5a0 con 0x55be2489f510 2024-05-08T18:50:44.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.488+0000 7fcd89084640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be2489f510 0x55be249926f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.488+0000 7fcd89084640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be2489f510 0x55be249926f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59592/0 (socket says 172.21.15.132:59592) 2024-05-08T18:50:44.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.488+0000 7fcd89084640 1 -- 172.21.15.132:0/2627391945 learned_addr learned my addr 172.21.15.132:0/2627391945 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.488+0000 7fcd89084640 1 -- 172.21.15.132:0/2627391945 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be24992cc0 con 0x55be2489f510 2024-05-08T18:50:44.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.488+0000 7fcd89084640 1 --2- 172.21.15.132:0/2627391945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be2489f510 0x55be249926f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c007000 tx=0x7fcd7c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e861faf3517662 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.488+0000 7fcc77606640 1 -- 172.21.15.132:0/2627391945 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd7c0529e0 con 0x55be2489f510 2024-05-08T18:50:44.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.488+0000 7fcc77606640 1 -- 172.21.15.132:0/2627391945 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd7c052b80 con 0x55be2489f510 2024-05-08T18:50:44.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.488+0000 7fcc77606640 1 -- 172.21.15.132:0/2627391945 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd7c05c430 con 0x55be2489f510 2024-05-08T18:50:44.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.489+0000 7fcd8de30800 1 -- 172.21.15.132:0/2627391945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be2489f510 msgr2=0x55be249926f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.489+0000 7fcd8de30800 1 --2- 172.21.15.132:0/2627391945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be2489f510 0x55be249926f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c007000 tx=0x7fcd7c04c000 comp rx=0 tx=0).stop 2024-05-08T18:50:44.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.489+0000 7fcd8de30800 1 -- 172.21.15.132:0/2627391945 shutdown_connections 2024-05-08T18:50:44.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.489+0000 7fcd8de30800 1 --2- 172.21.15.132:0/2627391945 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be2489f510 0x55be249926f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.489+0000 7fcd8de30800 1 -- 172.21.15.132:0/2627391945 >> 172.21.15.132:0/2627391945 conn(0x55be2489ae90 msgr2=0x55be2498e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.489+0000 7fcd8de30800 1 -- 172.21.15.132:0/2627391945 shutdown_connections 2024-05-08T18:50:44.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.489+0000 7fcd8de30800 1 -- 172.21.15.132:0/2627391945 wait complete. 2024-05-08T18:50:44.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.490+0000 7fcd8de30800 1 Processor -- start 2024-05-08T18:50:44.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.490+0000 7fcd8de30800 1 -- start start 2024-05-08T18:50:44.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.490+0000 7fcd8de30800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be2489f510 0x55be2499a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.490+0000 7fcd8de30800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55be248aa9c0 con 0x55be2489f510 2024-05-08T18:50:44.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.490+0000 7fcd89084640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be2489f510 0x55be2499a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.490+0000 7fcd89084640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be2489f510 0x55be2499a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59596/0 (socket says 172.21.15.132:59596) 2024-05-08T18:50:44.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.490+0000 7fcd89084640 1 -- 172.21.15.132:0/3341238703 learned_addr learned my addr 172.21.15.132:0/3341238703 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.490+0000 7fcd89084640 1 -- 172.21.15.132:0/3341238703 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be2499a690 con 0x55be2489f510 2024-05-08T18:50:44.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.490+0000 7fcd89084640 1 --2- 172.21.15.132:0/3341238703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be2489f510 0x55be2499a150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0526d0 tx=0x7fcd7c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.491+0000 7fcc75e03640 1 -- 172.21.15.132:0/3341238703 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd7c075070 con 0x55be2489f510 2024-05-08T18:50:44.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.491+0000 7fcc75e03640 1 -- 172.21.15.132:0/3341238703 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd7c070540 con 0x55be2489f510 2024-05-08T18:50:44.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.491+0000 7fcd8de30800 1 -- 172.21.15.132:0/3341238703 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be2499a920 con 0x55be2489f510 2024-05-08T18:50:44.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.491+0000 7fcc75e03640 1 -- 172.21.15.132:0/3341238703 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd7c070820 con 0x55be2489f510 2024-05-08T18:50:44.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.491+0000 7fcd8de30800 1 -- 172.21.15.132:0/3341238703 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be2499d5d0 con 0x55be2489f510 2024-05-08T18:50:44.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.491+0000 7fcc75e03640 1 -- 172.21.15.132:0/3341238703 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fcd7c078070 con 0x55be2489f510 2024-05-08T18:50:44.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.492+0000 7fcc75e03640 1 --2- 172.21.15.132:0/3341238703 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcc7003bb50 0x7fcc7003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.492+0000 7fcc75e03640 1 -- 172.21.15.132:0/3341238703 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fcd7c06d070 con 0x55be2489f510 2024-05-08T18:50:44.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.492+0000 7fcd88883640 1 --2- 172.21.15.132:0/3341238703 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcc7003bb50 0x7fcc7003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.492+0000 7fcd8de30800 1 --2- 172.21.15.132:0/3341238703 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55be248a2550 0x55be249a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.492+0000 7fcd8de30800 1 -- 172.21.15.132:0/3341238703 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be249a1910 con 0x55be248a2550 2024-05-08T18:50:44.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.492+0000 7fcd89885640 1 --2- 172.21.15.132:0/3341238703 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55be248a2550 0x55be249a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.492+0000 7fcd88883640 1 --2- 172.21.15.132:0/3341238703 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcc7003bb50 0x7fcc7003e010 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcd80000f60 tx=0x7fcd800012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.492+0000 7fcd89885640 1 --2- 172.21.15.132:0/3341238703 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55be248a2550 0x55be249a1390 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.493+0000 7fcd89885640 1 -- 172.21.15.132:0/3341238703 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd840083e0 con 0x55be248a2550 2024-05-08T18:50:44.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.493+0000 7fcd8de30800 1 -- 172.21.15.132:0/3341238703 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be2499e920 con 0x55be248a2550 2024-05-08T18:50:44.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.493+0000 7fcd89885640 1 -- 172.21.15.132:0/3341238703 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcd840083e0 con 0x55be248a2550 2024-05-08T18:50:44.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.493+0000 7fcd8de30800 1 --2- 172.21.15.132:0/3341238703 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55be249a3c50 0x55be249a6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.493+0000 7fcd8de30800 1 -- 172.21.15.132:0/3341238703 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be249a6710 con 0x55be249a3c50 2024-05-08T18:50:44.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.493+0000 7fcd89084640 1 --2- 172.21.15.132:0/3341238703 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55be249a3c50 0x55be249a6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.493+0000 7fcd89084640 1 --2- 172.21.15.132:0/3341238703 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55be249a3c50 0x55be249a6040 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.494+0000 7fcd89084640 1 -- 172.21.15.132:0/3341238703 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcd7c077030 con 0x55be249a3c50 2024-05-08T18:50:44.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.494+0000 7fcd8de30800 1 -- 172.21.15.132:0/3341238703 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be249a2ac0 con 0x55be248a2550 2024-05-08T18:50:44.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.494+0000 7fcd89885640 1 -- 172.21.15.132:0/3341238703 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcd840083e0 con 0x55be248a2550 2024-05-08T18:50:44.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.494+0000 7fcd8de30800 1 -- 172.21.15.132:0/3341238703 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be249a2f60 con 0x55be248a2550 2024-05-08T18:50:44.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.494+0000 7fcd89885640 1 -- 172.21.15.132:0/3341238703 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcd840083e0 con 0x55be248a2550 2024-05-08T18:50:44.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.494+0000 7fcd8de30800 1 Processor -- start 2024-05-08T18:50:44.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.495+0000 7fcd8de30800 1 -- start start 2024-05-08T18:50:44.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.495+0000 7fcd8de30800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be248a2110 0x55be248a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.495+0000 7fcd8de30800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55be24792fc0 con 0x55be248a2110 2024-05-08T18:50:44.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.495+0000 7fcd89885640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be248a2110 0x55be248a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.495+0000 7fcd89885640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be248a2110 0x55be248a0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59608/0 (socket says 172.21.15.132:59608) 2024-05-08T18:50:44.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.495+0000 7fcd89885640 1 -- 172.21.15.132:0/2956548337 learned_addr learned my addr 172.21.15.132:0/2956548337 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.495+0000 7fcd89885640 1 -- 172.21.15.132:0/2956548337 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be248a0ac0 con 0x55be248a2110 2024-05-08T18:50:44.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.495+0000 7fcd89885640 1 --2- 172.21.15.132:0/2956548337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be248a2110 0x55be248a0580 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55be2499b020 tx=0x7fcd84008f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.495+0000 7fcc6effd640 1 -- 172.21.15.132:0/2956548337 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd84007ca0 con 0x55be248a2110 2024-05-08T18:50:44.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.496+0000 7fcc6effd640 1 -- 172.21.15.132:0/2956548337 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd8401e020 con 0x55be248a2110 2024-05-08T18:50:44.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.496+0000 7fcd8de30800 1 -- 172.21.15.132:0/2956548337 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be248a0d50 con 0x55be248a2110 2024-05-08T18:50:44.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.496+0000 7fcc6effd640 1 -- 172.21.15.132:0/2956548337 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd84019420 con 0x55be248a2110 2024-05-08T18:50:44.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.496+0000 7fcd8de30800 1 -- 172.21.15.132:0/2956548337 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be248a1250 con 0x55be248a2110 2024-05-08T18:50:44.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.496+0000 7fcc6effd640 1 -- 172.21.15.132:0/2956548337 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fcd84016040 con 0x55be248a2110 2024-05-08T18:50:44.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.497+0000 7fcc6effd640 1 --2- 172.21.15.132:0/2956548337 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcc6003bb50 0x7fcc6003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.497+0000 7fcc6effd640 1 -- 172.21.15.132:0/2956548337 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fcd8401f030 con 0x55be248a2110 2024-05-08T18:50:44.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.497+0000 7fcd89084640 1 --2- 172.21.15.132:0/2956548337 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcc6003bb50 0x7fcc6003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.497+0000 7fcd8de30800 1 Processor -- start 2024-05-08T18:50:44.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.497+0000 7fcd8de30800 1 -- start start 2024-05-08T18:50:44.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.497+0000 7fcd89084640 1 --2- 172.21.15.132:0/2956548337 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcc6003bb50 0x7fcc6003e010 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0931d0 tx=0x7fcd7c052430 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.497+0000 7fcd8de30800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be249c4c40 0x55be249c5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.497+0000 7fcd8de30800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55be24992fe0 con 0x55be249c4c40 2024-05-08T18:50:44.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.497+0000 7fcd89885640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be249c4c40 0x55be249c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.497+0000 7fcd89885640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be249c4c40 0x55be249c5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59620/0 (socket says 172.21.15.132:59620) 2024-05-08T18:50:44.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.497+0000 7fcd89885640 1 -- 172.21.15.132:0/971556255 learned_addr learned my addr 172.21.15.132:0/971556255 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.498+0000 7fcd89885640 1 -- 172.21.15.132:0/971556255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be249c5630 con 0x55be249c4c40 2024-05-08T18:50:44.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.498+0000 7fcd89885640 1 --2- 172.21.15.132:0/971556255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be249c4c40 0x55be249c5060 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcd84052ee0 tx=0x7fcd840530e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5650ca2c4ad15a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.498+0000 7fcc6cff9640 1 -- 172.21.15.132:0/971556255 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd8401d040 con 0x55be249c4c40 2024-05-08T18:50:44.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.498+0000 7fcc6cff9640 1 -- 172.21.15.132:0/971556255 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd84023410 con 0x55be249c4c40 2024-05-08T18:50:44.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.498+0000 7fcc6cff9640 1 -- 172.21.15.132:0/971556255 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd84019b30 con 0x55be249c4c40 2024-05-08T18:50:44.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.498+0000 7fcd8de30800 1 -- 172.21.15.132:0/971556255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be249c4c40 msgr2=0x55be249c5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.498+0000 7fcd8de30800 1 --2- 172.21.15.132:0/971556255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be249c4c40 0x55be249c5060 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcd84052ee0 tx=0x7fcd840530e0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.498+0000 7fcd8de30800 1 -- 172.21.15.132:0/971556255 shutdown_connections 2024-05-08T18:50:44.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.498+0000 7fcd8de30800 1 --2- 172.21.15.132:0/971556255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be249c4c40 0x55be249c5060 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.498+0000 7fcd8de30800 1 -- 172.21.15.132:0/971556255 >> 172.21.15.132:0/971556255 conn(0x55be249c0f10 msgr2=0x55be249bef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.498+0000 7fcd8de30800 1 -- 172.21.15.132:0/971556255 shutdown_connections 2024-05-08T18:50:44.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.498+0000 7fcd8de30800 1 -- 172.21.15.132:0/971556255 wait complete. 2024-05-08T18:50:44.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.499+0000 7fcd8de30800 1 Processor -- start 2024-05-08T18:50:44.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.499+0000 7fcd8de30800 1 -- start start 2024-05-08T18:50:44.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.499+0000 7fcd8de30800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be249c4c40 0x55be249cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.499+0000 7fcd8de30800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55be249c5d80 con 0x55be249c4c40 2024-05-08T18:50:44.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.499+0000 7fcd89885640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be249c4c40 0x55be249cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.499+0000 7fcd89885640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be249c4c40 0x55be249cc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59628/0 (socket says 172.21.15.132:59628) 2024-05-08T18:50:44.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.499+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 learned_addr learned my addr 172.21.15.132:0/3866839826 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.499+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be249cc650 con 0x55be249c4c40 2024-05-08T18:50:44.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.499+0000 7fcd89885640 1 --2- 172.21.15.132:0/3866839826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be249c4c40 0x55be249cc110 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcd84052ee0 tx=0x7fcd84052e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.500+0000 7fcc5effd640 1 -- 172.21.15.132:0/3866839826 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd8401d030 con 0x55be249c4c40 2024-05-08T18:50:44.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.500+0000 7fcc5effd640 1 -- 172.21.15.132:0/3866839826 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd8404c040 con 0x55be249c4c40 2024-05-08T18:50:44.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.500+0000 7fcc5effd640 1 -- 172.21.15.132:0/3866839826 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd840544c0 con 0x55be249c4c40 2024-05-08T18:50:44.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.500+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55be249cc940 con 0x55be249c4c40 2024-05-08T18:50:44.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.500+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be249cf590 con 0x55be249c4c40 2024-05-08T18:50:44.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.500+0000 7fcc5effd640 1 -- 172.21.15.132:0/3866839826 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fcd84054660 con 0x55be249c4c40 2024-05-08T18:50:44.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.501+0000 7fcc5effd640 1 --2- 172.21.15.132:0/3866839826 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcc5403bba0 0x7fcc5403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.501+0000 7fcc5effd640 1 -- 172.21.15.132:0/3866839826 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fcd84038ae0 con 0x55be249c4c40 2024-05-08T18:50:44.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.501+0000 7fcd89084640 1 --2- 172.21.15.132:0/3866839826 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcc5403bba0 0x7fcc5403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.501+0000 7fcd8de30800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.501+0000 7fcd8de30800 1 --2- 172.21.15.132:0/3866839826 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55be249d7c90 0x55be249da150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.501+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be249da8a0 con 0x55be249d7c90 2024-05-08T18:50:44.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.501+0000 7fcd88883640 1 --2- 172.21.15.132:0/3866839826 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55be249d7c90 0x55be249da150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.501+0000 7fcd89084640 1 --2- 172.21.15.132:0/3866839826 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcc5403bba0 0x7fcc5403e060 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c093430 tx=0x7fcd7c08b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.501+0000 7fcd88883640 1 --2- 172.21.15.132:0/3866839826 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55be249d7c90 0x55be249da150 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.501+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd80009050 con 0x55be249d7c90 2024-05-08T18:50:44.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.501+0000 7fcd8de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.501+0000 7fcd8de30800 20 realm 2024-05-08T18:50:44.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.501+0000 7fcd8de30800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.501+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be249d70e0 con 0x55be249d7c90 2024-05-08T18:50:44.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.502+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd80009050 con 0x55be249d7c90 2024-05-08T18:50:44.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.502+0000 7fcd8de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.502+0000 7fcd8de30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:44.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.502+0000 7fcd8de30800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.502+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be249db380 con 0x55be249d7c90 2024-05-08T18:50:44.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.502+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd80009050 con 0x55be249d7c90 2024-05-08T18:50:44.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.502+0000 7fcd8de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.502+0000 7fcd8de30800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.502+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be249dbc50 con 0x55be249d7c90 2024-05-08T18:50:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.502+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcd80009050 con 0x55be249d7c90 2024-05-08T18:50:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.502+0000 7fcd8de30800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.502+0000 7fcd8de30800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.502+0000 7fcd8de30800 1 --2- 172.21.15.132:0/3866839826 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55be249dc500 0x55be249de8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.502+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be249df030 con 0x55be249dc500 2024-05-08T18:50:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.502+0000 7fcd89885640 1 --2- 172.21.15.132:0/3866839826 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55be249dc500 0x55be249de8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.502+0000 7fcd89885640 1 --2- 172.21.15.132:0/3866839826 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55be249dc500 0x55be249de8f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.503+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcd8403e070 con 0x55be249dc500 2024-05-08T18:50:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.503+0000 7fcd8de30800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.503+0000 7fcd8de30800 20 searching for the correct realm 2024-05-08T18:50:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.503+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x55be249dc500 2024-05-08T18:50:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.503+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.503+0000 7fcd89885640 1 --2- 172.21.15.132:0/3866839826 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fcd84046030 0x7fcd840383f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.503+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x7fcd84046030 2024-05-08T18:50:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.503+0000 7fcd89084640 1 --2- 172.21.15.132:0/3866839826 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fcd84046030 0x7fcd840383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.504+0000 7fcd89084640 1 --2- 172.21.15.132:0/3866839826 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fcd84046030 0x7fcd840383f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.504+0000 7fcd89084640 1 -- 172.21.15.132:0/3866839826 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd7c077030 con 0x7fcd84046030 2024-05-08T18:50:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.504+0000 7fcd89084640 1 --2- 172.21.15.132:0/3866839826 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fcd7c0a1040 0x7fcd7c05b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.504+0000 7fcd89084640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x7fcd7c0a1040 2024-05-08T18:50:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.504+0000 7fcd88883640 1 --2- 172.21.15.132:0/3866839826 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fcd7c0a1040 0x7fcd7c05b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.505+0000 7fcd88883640 1 --2- 172.21.15.132:0/3866839826 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fcd7c0a1040 0x7fcd7c05b5b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.505+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd80009050 con 0x7fcd7c0a1040 2024-05-08T18:50:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.505+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x55be249d7c90 2024-05-08T18:50:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.505+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd80009050 con 0x55be249d7c90 2024-05-08T18:50:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.505+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x55be249d7c90 2024-05-08T18:50:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.505+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.505+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x7fcd7c0a1040 2024-05-08T18:50:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.506+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.506+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x7fcd7c0a1040 2024-05-08T18:50:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.506+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.506+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x7fcd84046030 2024-05-08T18:50:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.506+0000 7fcd89084640 1 -- 172.21.15.132:0/3866839826 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd7c077030 con 0x7fcd84046030 2024-05-08T18:50:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.506+0000 7fcd89084640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x55be249dc500 2024-05-08T18:50:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.506+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.506+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x55be249d7c90 2024-05-08T18:50:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.506+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.507+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x7fcd7c0a1040 2024-05-08T18:50:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.507+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.507+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x55be249d7c90 2024-05-08T18:50:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.507+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.507+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x7fcd84046030 2024-05-08T18:50:44.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.507+0000 7fcd89084640 1 -- 172.21.15.132:0/3866839826 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcd7c077030 con 0x7fcd84046030 2024-05-08T18:50:44.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.507+0000 7fcd89084640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x55be249dc500 2024-05-08T18:50:44.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.508+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.508+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x55be249dc500 2024-05-08T18:50:44.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.508+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.508+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x7fcd7c0a1040 2024-05-08T18:50:44.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.508+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.508+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x55be249dc500 2024-05-08T18:50:44.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.509+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.509+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x55be249dc500 2024-05-08T18:50:44.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.509+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.509+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x55be249d7c90 2024-05-08T18:50:44.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.509+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.509+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x55be249d7c90 2024-05-08T18:50:44.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.509+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.509+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x7fcd7c0a1040 2024-05-08T18:50:44.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.509+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.510+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x55be249dc500 2024-05-08T18:50:44.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.510+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.510+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x7fcd84046030 2024-05-08T18:50:44.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.510+0000 7fcd89084640 1 -- 172.21.15.132:0/3866839826 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd7c077030 con 0x7fcd84046030 2024-05-08T18:50:44.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.510+0000 7fcd89084640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x55be249d7c90 2024-05-08T18:50:44.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.510+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.510+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x7fcd7c0a1040 2024-05-08T18:50:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.510+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.510+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x55be249dc500 2024-05-08T18:50:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.511+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.511+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x7fcd7c0a1040 2024-05-08T18:50:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.511+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.511+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x7fcd84046030 2024-05-08T18:50:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.511+0000 7fcd89084640 1 -- 172.21.15.132:0/3866839826 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd7c077030 con 0x7fcd84046030 2024-05-08T18:50:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.511+0000 7fcd89084640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x55be249dc500 2024-05-08T18:50:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.512+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.512+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x7fcd7c0a1040 2024-05-08T18:50:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.512+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.512+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x55be249d7c90 2024-05-08T18:50:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.512+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.512+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0a10 con 0x7fcd84046030 2024-05-08T18:50:44.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.512+0000 7fcd89084640 1 -- 172.21.15.132:0/3866839826 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd7c077030 con 0x7fcd84046030 2024-05-08T18:50:44.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.512+0000 7fcd8de30800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:44.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.512+0000 7fcd8de30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:44.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.512+0000 7fcd8de30800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:44.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.512+0000 7fcd8de30800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:44.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.512+0000 7fcd8de30800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:44.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.512+0000 7fcd8de30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:44.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.512+0000 7fcd8de30800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.512+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be249dfae0 con 0x55be249d7c90 2024-05-08T18:50:44.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.513+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.513+0000 7fcd8de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.513+0000 7fcd8de30800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.513+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be249e0380 con 0x55be249d7c90 2024-05-08T18:50:44.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.513+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.513+0000 7fcd8de30800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:44.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.513+0000 7fcd8de30800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.513+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be249df720 con 0x55be249d7c90 2024-05-08T18:50:44.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.513+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.513+0000 7fcd8de30800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:44.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.513+0000 7fcd8de30800 20 zone default found 2024-05-08T18:50:44.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.513+0000 7fcd8de30800 4 Realm: () 2024-05-08T18:50:44.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.513+0000 7fcd8de30800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:44.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.513+0000 7fcd8de30800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:44.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.513+0000 7fcd8de30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:44.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.513+0000 7fcd8de30800 20 zonegroup default 2024-05-08T18:50:44.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.513+0000 7fcd8de30800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.513+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be249e1390 con 0x7fcd7c0a1040 2024-05-08T18:50:44.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.513+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.513+0000 7fcd8de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.513+0000 7fcd8de30800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.513+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be249e2dd0 con 0x55be249dc500 2024-05-08T18:50:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.514+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.514+0000 7fcd8de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.514+0000 7fcd8de30800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.514+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be249e3260 con 0x55be249dc500 2024-05-08T18:50:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.514+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.514+0000 7fcd8de30800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.514+0000 7fcd8de30800 20 started sync module instance, tier type = 2024-05-08T18:50:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.514+0000 7fcd8de30800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.514+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be249e21b0 con 0x7fcd84046030 2024-05-08T18:50:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.515+0000 7fcd89084640 1 -- 172.21.15.132:0/3866839826 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd7c077030 con 0x7fcd84046030 2024-05-08T18:50:44.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.515+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94275146489088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be249e36c0 con 0x7fcd84046030 2024-05-08T18:50:44.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.515+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be249e3f10 con 0x55be249d7c90 2024-05-08T18:50:44.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.516+0000 7fcd89084640 1 -- 172.21.15.132:0/3866839826 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94275146489088] v25'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd7c077030 con 0x7fcd84046030 2024-05-08T18:50:44.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.516+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.516+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94275146496608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be249e4330 con 0x55be249d7c90 2024-05-08T18:50:44.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.516+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be249e4bc0 con 0x55be249dc500 2024-05-08T18:50:44.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.517+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.517+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94275146498864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be249e47d0 con 0x55be249dc500 2024-05-08T18:50:44.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.517+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be249e5b70 con 0x7fcd84046030 2024-05-08T18:50:44.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.518+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94275146496608] v25'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.518+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94275146498864] v25'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.518+0000 7fcd89084640 1 -- 172.21.15.132:0/3866839826 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd7c077030 con 0x7fcd84046030 2024-05-08T18:50:44.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.518+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94275146502064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be249e5680 con 0x7fcd84046030 2024-05-08T18:50:44.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.519+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be249e65b0 con 0x55be249d7c90 2024-05-08T18:50:44.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.519+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.519+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94275146506496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be249e69d0 con 0x55be249d7c90 2024-05-08T18:50:44.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.520+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be249e7450 con 0x7fcd7c0a1040 2024-05-08T18:50:44.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.520+0000 7fcd89084640 1 -- 172.21.15.132:0/3866839826 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94275146502064] v25'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd7c077030 con 0x7fcd84046030 2024-05-08T18:50:44.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.520+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94275146506496] v25'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.521+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.521+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94275146510144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be249e6520 con 0x7fcd7c0a1040 2024-05-08T18:50:44.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.521+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be249e7cf0 con 0x7fcd7c0a1040 2024-05-08T18:50:44.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.522+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(56 notify.6 [create] v25'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.522+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94275146510144] v25'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.522+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94275146512272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be249e8060 con 0x7fcd7c0a1040 2024-05-08T18:50:44.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.522+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be249e8400 con 0x7fcd7c0a1040 2024-05-08T18:50:44.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.523+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94275146512272] v25'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.523+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.523+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94275146513328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be249e8480 con 0x7fcd7c0a1040 2024-05-08T18:50:44.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.524+0000 7fcd8de30800 20 add_watcher() i=0 2024-05-08T18:50:44.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.524+0000 7fcd8de30800 20 add_watcher() i=1 2024-05-08T18:50:44.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.524+0000 7fcd8de30800 20 add_watcher() i=2 2024-05-08T18:50:44.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.524+0000 7fcd8de30800 20 add_watcher() i=3 2024-05-08T18:50:44.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.524+0000 7fcd8de30800 20 add_watcher() i=4 2024-05-08T18:50:44.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.524+0000 7fcd8de30800 20 add_watcher() i=5 2024-05-08T18:50:44.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.524+0000 7fcd8de30800 20 add_watcher() i=6 2024-05-08T18:50:44.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.524+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94275146513328] v25'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.524+0000 7fcd8de30800 20 add_watcher() i=7 2024-05-08T18:50:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.524+0000 7fcd8de30800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.525+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be249eb620 con 0x55be249d7c90 2024-05-08T18:50:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.525+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.525+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94275146514384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be249e88a0 con 0x55be249d7c90 2024-05-08T18:50:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.526+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94275146514384] v25'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.526+0000 7fcc3ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.526+0000 7fcd8de30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.526+0000 7fcd8de30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.526+0000 7fcd8de30800 5 note: GC not initialized 2024-05-08T18:50:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.526+0000 7fcc3efe5640 20 reqs_thread_entry: start 2024-05-08T18:50:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.526+0000 7fcd8de30800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.526+0000 7fcd8de30800 20 Filter name: none 2024-05-08T18:50:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.527+0000 7fcc3cfe1640 20 reqs_thread_entry: start 2024-05-08T18:50:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.527+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f110 con 0x55be249d7c90 2024-05-08T18:50:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.527+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.527+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f110 con 0x7fcd84046030 2024-05-08T18:50:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.527+0000 7fcd89084640 1 -- 172.21.15.132:0/3866839826 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcd7c077030 con 0x7fcd84046030 2024-05-08T18:50:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.527+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f110 con 0x55be249d7c90 2024-05-08T18:50:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.527+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.527+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f0d0 con 0x55be249dc500 2024-05-08T18:50:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.528+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.528+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f6b0 con 0x55be249dc500 2024-05-08T18:50:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.528+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.528+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f6b0 con 0x55be249dc500 2024-05-08T18:50:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.528+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.528+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f660 con 0x55be249d7c90 2024-05-08T18:50:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.528+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.528+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f660 con 0x55be249d7c90 2024-05-08T18:50:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.528+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.528+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f610 con 0x55be249dc500 2024-05-08T18:50:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.529+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.529+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f610 con 0x55be249dc500 2024-05-08T18:50:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.529+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.529+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f610 con 0x7fcd7c0a1040 2024-05-08T18:50:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.529+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.529+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f5a0 con 0x55be249d7c90 2024-05-08T18:50:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.530+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.530+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x7fcd84046030 2024-05-08T18:50:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.530+0000 7fcd89084640 1 -- 172.21.15.132:0/3866839826 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd7c077030 con 0x7fcd84046030 2024-05-08T18:50:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.530+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x55be249dc500 2024-05-08T18:50:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.530+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.530+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x7fcd7c0a1040 2024-05-08T18:50:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.530+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.530+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x7fcd7c0a1040 2024-05-08T18:50:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.531+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.531+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x55be249dc500 2024-05-08T18:50:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.531+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.531+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x7fcd7c0a1040 2024-05-08T18:50:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.531+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.531+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x55be249d7c90 2024-05-08T18:50:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.531+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.531+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x55be249dc500 2024-05-08T18:50:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.532+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.532+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x7fcd7c0a1040 2024-05-08T18:50:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.532+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.532+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x7fcd84046030 2024-05-08T18:50:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.532+0000 7fcd89084640 1 -- 172.21.15.132:0/3866839826 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd7c077030 con 0x7fcd84046030 2024-05-08T18:50:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.532+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x7fcd7c0a1040 2024-05-08T18:50:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.533+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.533+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x55be249d7c90 2024-05-08T18:50:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.533+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.533+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x55be249d7c90 2024-05-08T18:50:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.533+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.533+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x55be249dc500 2024-05-08T18:50:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.533+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.533+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x55be249d7c90 2024-05-08T18:50:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.533+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.533+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x55be249d7c90 2024-05-08T18:50:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.534+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.534+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x55be249dc500 2024-05-08T18:50:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.534+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.534+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x55be249dc500 2024-05-08T18:50:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.534+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.534+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x55be249dc500 2024-05-08T18:50:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.534+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.534+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x7fcd7c0a1040 2024-05-08T18:50:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.535+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.536+0000 7fcc3ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.536+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94275146514384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x55be249d7c90 2024-05-08T18:50:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.536+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94275146514384] v25'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.537+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94275146489088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x7fcd84046030 2024-05-08T18:50:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.538+0000 7fcd89084640 1 -- 172.21.15.132:0/3866839826 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94275146489088] v25'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd7c077030 con 0x7fcd84046030 2024-05-08T18:50:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.538+0000 7fcd8de30800 20 remove_watcher() i=0 2024-05-08T18:50:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.538+0000 7fcd8de30800 2 removed watcher, disabling cache 2024-05-08T18:50:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.538+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94275146496608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x55be249d7c90 2024-05-08T18:50:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.539+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94275146496608] v25'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.539+0000 7fcd8de30800 20 remove_watcher() i=1 2024-05-08T18:50:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.539+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94275146498864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x55be249dc500 2024-05-08T18:50:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.540+0000 7fcd89885640 1 -- 172.21.15.132:0/3866839826 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94275146498864] v25'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd8405e040 con 0x55be249dc500 2024-05-08T18:50:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.540+0000 7fcd8de30800 20 remove_watcher() i=2 2024-05-08T18:50:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.540+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94275146502064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x7fcd84046030 2024-05-08T18:50:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.541+0000 7fcd89084640 1 -- 172.21.15.132:0/3866839826 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94275146502064] v25'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd7c077030 con 0x7fcd84046030 2024-05-08T18:50:44.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.541+0000 7fcd8de30800 20 remove_watcher() i=3 2024-05-08T18:50:44.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.541+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94275146506496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x55be249d7c90 2024-05-08T18:50:44.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.542+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.1 v2:172.21.15.132:6800/3697320277 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94275146506496] v25'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x55be249d7c90 2024-05-08T18:50:44.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.542+0000 7fcd8de30800 20 remove_watcher() i=4 2024-05-08T18:50:44.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.542+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94275146510144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x7fcd7c0a1040 2024-05-08T18:50:44.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.543+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94275146510144] v25'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.543+0000 7fcd8de30800 20 remove_watcher() i=5 2024-05-08T18:50:44.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.543+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94275146512272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x7fcd7c0a1040 2024-05-08T18:50:44.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.544+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94275146512272] v25'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.544+0000 7fcd8de30800 20 remove_watcher() i=6 2024-05-08T18:50:44.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.544+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94275146513328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55be24a1f580 con 0x7fcd7c0a1040 2024-05-08T18:50:44.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94275146513328] v25'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd80029040 con 0x7fcd7c0a1040 2024-05-08T18:50:44.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 20 remove_watcher() i=7 2024-05-08T18:50:44.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fcd7c0a1040 msgr2=0x7fcd7c05b5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 --2- 172.21.15.132:0/3866839826 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fcd7c0a1040 0x7fcd7c05b5b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55be249d7c90 msgr2=0x55be249da150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 --2- 172.21.15.132:0/3866839826 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55be249d7c90 0x55be249da150 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fcd84046030 msgr2=0x7fcd840383f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 --2- 172.21.15.132:0/3866839826 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fcd84046030 0x7fcd840383f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55be249dc500 msgr2=0x55be249de8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 --2- 172.21.15.132:0/3866839826 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55be249dc500 0x55be249de8f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcc5403bba0 msgr2=0x7fcc5403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 --2- 172.21.15.132:0/3866839826 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcc5403bba0 0x7fcc5403e060 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c093430 tx=0x7fcd7c08b000 comp rx=0 tx=0).stop 2024-05-08T18:50:44.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be249c4c40 msgr2=0x55be249cc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 --2- 172.21.15.132:0/3866839826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be249c4c40 0x55be249cc110 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcd84052ee0 tx=0x7fcd84052e70 comp rx=0 tx=0).stop 2024-05-08T18:50:44.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 reap_dead start 2024-05-08T18:50:44.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd88883640 1 -- 172.21.15.132:0/3866839826 reap_dead start 2024-05-08T18:50:44.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 shutdown_connections 2024-05-08T18:50:44.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 >> 172.21.15.132:0/3866839826 conn(0x55be249c0f10 msgr2=0x55be249be570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 shutdown_connections 2024-05-08T18:50:44.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 -- 172.21.15.132:0/3866839826 wait complete. 2024-05-08T18:50:44.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 -- 172.21.15.132:0/2956548337 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcc6003bb50 msgr2=0x7fcc6003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 --2- 172.21.15.132:0/2956548337 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcc6003bb50 0x7fcc6003e010 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0931d0 tx=0x7fcd7c052430 comp rx=0 tx=0).stop 2024-05-08T18:50:44.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 -- 172.21.15.132:0/2956548337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be248a2110 msgr2=0x55be248a0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 --2- 172.21.15.132:0/2956548337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be248a2110 0x55be248a0580 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55be2499b020 tx=0x7fcd84008f90 comp rx=0 tx=0).stop 2024-05-08T18:50:44.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 -- 172.21.15.132:0/2956548337 shutdown_connections 2024-05-08T18:50:44.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 --2- 172.21.15.132:0/2956548337 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcc6003bb50 0x7fcc6003e010 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 --2- 172.21.15.132:0/2956548337 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be248a2110 0x55be248a0580 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 -- 172.21.15.132:0/2956548337 >> 172.21.15.132:0/2956548337 conn(0x55be249a9700 msgr2=0x55be249a9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.545+0000 7fcd8de30800 1 -- 172.21.15.132:0/2956548337 shutdown_connections 2024-05-08T18:50:44.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.546+0000 7fcd8de30800 1 -- 172.21.15.132:0/2956548337 wait complete. 2024-05-08T18:50:44.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.546+0000 7fcd8de30800 1 -- 172.21.15.132:0/3341238703 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55be248a2550 msgr2=0x55be249a1390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.546+0000 7fcd8de30800 1 --2- 172.21.15.132:0/3341238703 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55be248a2550 0x55be249a1390 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.546+0000 7fcd8de30800 1 -- 172.21.15.132:0/3341238703 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55be249a3c50 msgr2=0x55be249a6040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.546+0000 7fcd8de30800 1 --2- 172.21.15.132:0/3341238703 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55be249a3c50 0x55be249a6040 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.546+0000 7fcd8de30800 1 -- 172.21.15.132:0/3341238703 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcc7003bb50 msgr2=0x7fcc7003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.546+0000 7fcd8de30800 1 --2- 172.21.15.132:0/3341238703 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcc7003bb50 0x7fcc7003e010 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcd80000f60 tx=0x7fcd800012b0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.546+0000 7fcd8de30800 1 -- 172.21.15.132:0/3341238703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be2489f510 msgr2=0x55be2499a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.546+0000 7fcd8de30800 1 --2- 172.21.15.132:0/3341238703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be2489f510 0x55be2499a150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0526d0 tx=0x7fcd7c003330 comp rx=0 tx=0).stop 2024-05-08T18:50:44.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.546+0000 7fcd8de30800 1 -- 172.21.15.132:0/3341238703 shutdown_connections 2024-05-08T18:50:44.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.546+0000 7fcd8de30800 1 --2- 172.21.15.132:0/3341238703 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55be249a3c50 0x55be249a6040 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.546+0000 7fcd8de30800 1 --2- 172.21.15.132:0/3341238703 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55be248a2550 0x55be249a1390 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.546+0000 7fcd8de30800 1 --2- 172.21.15.132:0/3341238703 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcc7003bb50 0x7fcc7003e010 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.546+0000 7fcd8de30800 1 --2- 172.21.15.132:0/3341238703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55be2489f510 0x55be2499a150 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.546+0000 7fcd8de30800 1 -- 172.21.15.132:0/3341238703 >> 172.21.15.132:0/3341238703 conn(0x55be2489ae90 msgr2=0x55be2498c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.546+0000 7fcd8de30800 1 -- 172.21.15.132:0/3341238703 shutdown_connections 2024-05-08T18:50:44.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.546+0000 7fcd8de30800 1 -- 172.21.15.132:0/3341238703 wait complete. 2024-05-08T18:50:44.556 INFO:teuthology.orchestra.run.smithi132.stdout:{"entries":[],"summary":[]} 2024-05-08T18:50:44.556 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-05-08T18:50:44.556 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:50:44.556 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:50:44.556 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:50:44.643 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:44.643 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:44.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.642+0000 7facd2f33800 1 Processor -- start 2024-05-08T18:50:44.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.642+0000 7facd2f33800 1 -- start start 2024-05-08T18:50:44.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.642+0000 7facd2f33800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5568515515d0 0x5568515539c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.642+0000 7facd2f33800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556851553f90 con 0x55685154d140 2024-05-08T18:50:44.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.642+0000 7facd2f33800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x5568513eee20 con 0x5568515515d0 2024-05-08T18:50:44.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.642+0000 7facc63ed640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5568515515d0 0x5568515539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.642+0000 7facc63ed640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5568515515d0 0x5568515539c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59630/0 (socket says 172.21.15.132:59630) 2024-05-08T18:50:44.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.642+0000 7faccebee640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55685154d140 0x55685154d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46694/0 (socket says 172.21.15.132:46694) 2024-05-08T18:50:44.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.642+0000 7facc63ed640 1 -- 172.21.15.132:0/253114500 learned_addr learned my addr 172.21.15.132:0/253114500 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.643+0000 7facc63ed640 1 -- 172.21.15.132:0/253114500 >> v1:172.21.15.42:6789/0 conn(0x55685154d140 legacy=0x55685154d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.643+0000 7facc63ed640 1 -- 172.21.15.132:0/253114500 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568515551c0 con 0x5568515515d0 2024-05-08T18:50:44.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.645+0000 7facc63ed640 1 --2- 172.21.15.132:0/253114500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568515515d0 0x5568515539c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7facb800a520 tx=0x7facb801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbdf3665875f7e55 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.645+0000 7facce3ed640 1 -- 172.21.15.132:0/253114500 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facb8057070 con 0x5568515515d0 2024-05-08T18:50:44.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.645+0000 7facce3ed640 1 -- 172.21.15.132:0/253114500 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb8052570 con 0x5568515515d0 2024-05-08T18:50:44.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.645+0000 7facce3ed640 1 -- 172.21.15.132:0/253114500 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facb804ae60 con 0x5568515515d0 2024-05-08T18:50:44.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.645+0000 7facd2f33800 1 -- 172.21.15.132:0/253114500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568515515d0 msgr2=0x5568515539c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.645+0000 7facd2f33800 1 --2- 172.21.15.132:0/253114500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568515515d0 0x5568515539c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7facb800a520 tx=0x7facb801d010 comp rx=0 tx=0).stop 2024-05-08T18:50:44.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.645+0000 7facd2f33800 1 -- 172.21.15.132:0/253114500 shutdown_connections 2024-05-08T18:50:44.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.645+0000 7facd2f33800 1 --2- 172.21.15.132:0/253114500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568515515d0 0x5568515539c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.645+0000 7facd2f33800 1 -- 172.21.15.132:0/253114500 >> 172.21.15.132:0/253114500 conn(0x5568515486a0 msgr2=0x55685154ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.645+0000 7facd2f33800 1 -- 172.21.15.132:0/253114500 shutdown_connections 2024-05-08T18:50:44.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.645+0000 7facd2f33800 1 -- 172.21.15.132:0/253114500 wait complete. 2024-05-08T18:50:44.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.658+0000 7facd2f33800 1 Processor -- start 2024-05-08T18:50:44.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.658+0000 7facd2f33800 1 -- start start 2024-05-08T18:50:44.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.658+0000 7facd2f33800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55685154d140 0x55685163f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.658+0000 7facd2f33800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5568514995b0 con 0x55685154d140 2024-05-08T18:50:44.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.659+0000 7faccebee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55685154d140 0x55685163f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.659+0000 7faccebee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55685154d140 0x55685163f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59636/0 (socket says 172.21.15.132:59636) 2024-05-08T18:50:44.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.659+0000 7faccebee640 1 -- 172.21.15.132:0/1650730987 learned_addr learned my addr 172.21.15.132:0/1650730987 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.659+0000 7faccebee640 1 -- 172.21.15.132:0/1650730987 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55685163fbe0 con 0x55685154d140 2024-05-08T18:50:44.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.659+0000 7faccebee640 1 --2- 172.21.15.132:0/1650730987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55685154d140 0x55685163f610 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7facc000b230 tx=0x7facc000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1851879ebff7eb8f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.659+0000 7fabbce09640 1 -- 172.21.15.132:0/1650730987 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facc000e5c0 con 0x55685154d140 2024-05-08T18:50:44.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.659+0000 7fabbce09640 1 -- 172.21.15.132:0/1650730987 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc0006070 con 0x55685154d140 2024-05-08T18:50:44.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.659+0000 7fabbce09640 1 -- 172.21.15.132:0/1650730987 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facc000e890 con 0x55685154d140 2024-05-08T18:50:44.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.660+0000 7facd2f33800 1 -- 172.21.15.132:0/1650730987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55685154d140 msgr2=0x55685163f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.660+0000 7facd2f33800 1 --2- 172.21.15.132:0/1650730987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55685154d140 0x55685163f610 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7facc000b230 tx=0x7facc000b6f0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.660+0000 7facd2f33800 1 -- 172.21.15.132:0/1650730987 shutdown_connections 2024-05-08T18:50:44.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.660+0000 7facd2f33800 1 --2- 172.21.15.132:0/1650730987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55685154d140 0x55685163f610 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.660+0000 7facd2f33800 1 -- 172.21.15.132:0/1650730987 >> 172.21.15.132:0/1650730987 conn(0x5568515486a0 msgr2=0x55685163da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.660+0000 7facd2f33800 1 -- 172.21.15.132:0/1650730987 shutdown_connections 2024-05-08T18:50:44.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.660+0000 7facd2f33800 1 -- 172.21.15.132:0/1650730987 wait complete. 2024-05-08T18:50:44.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.661+0000 7facd2f33800 1 Processor -- start 2024-05-08T18:50:44.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.661+0000 7facd2f33800 1 -- start start 2024-05-08T18:50:44.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.661+0000 7facd2f33800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55685154d140 0x55685163b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.661+0000 7facd2f33800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556851554460 con 0x55685154d140 2024-05-08T18:50:44.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.661+0000 7faccebee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55685154d140 0x55685163b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.661+0000 7faccebee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55685154d140 0x55685163b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59648/0 (socket says 172.21.15.132:59648) 2024-05-08T18:50:44.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.661+0000 7faccebee640 1 -- 172.21.15.132:0/1423106612 learned_addr learned my addr 172.21.15.132:0/1423106612 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.661+0000 7faccebee640 1 -- 172.21.15.132:0/1423106612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556851639a40 con 0x55685154d140 2024-05-08T18:50:44.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.662+0000 7faccebee640 1 --2- 172.21.15.132:0/1423106612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55685154d140 0x55685163b350 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7facc0000fd0 tx=0x7facc0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.662+0000 7fabbb606640 1 -- 172.21.15.132:0/1423106612 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facc000f8d0 con 0x55685154d140 2024-05-08T18:50:44.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.662+0000 7fabbb606640 1 -- 172.21.15.132:0/1423106612 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc000fa90 con 0x55685154d140 2024-05-08T18:50:44.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.662+0000 7facd2f33800 1 -- 172.21.15.132:0/1423106612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556851639cd0 con 0x55685154d140 2024-05-08T18:50:44.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.662+0000 7fabbb606640 1 -- 172.21.15.132:0/1423106612 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facc000fdb0 con 0x55685154d140 2024-05-08T18:50:44.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.662+0000 7facd2f33800 1 -- 172.21.15.132:0/1423106612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55685163a1f0 con 0x55685154d140 2024-05-08T18:50:44.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.663+0000 7fabbb606640 1 -- 172.21.15.132:0/1423106612 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7facc0017070 con 0x55685154d140 2024-05-08T18:50:44.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.663+0000 7fabbb606640 1 --2- 172.21.15.132:0/1423106612 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fabb403bba0 0x7fabb403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.663+0000 7fabbb606640 1 -- 172.21.15.132:0/1423106612 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7facc0015020 con 0x55685154d140 2024-05-08T18:50:44.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.663+0000 7facc63ed640 1 --2- 172.21.15.132:0/1423106612 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fabb403bba0 0x7fabb403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.663+0000 7facd2f33800 1 --2- 172.21.15.132:0/1423106612 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5568515515d0 0x556851650600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.663+0000 7facd2f33800 1 -- 172.21.15.132:0/1423106612 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x556851650b90 con 0x5568515515d0 2024-05-08T18:50:44.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.663+0000 7faccf3ef640 1 --2- 172.21.15.132:0/1423106612 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5568515515d0 0x556851650600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.664+0000 7facc63ed640 1 --2- 172.21.15.132:0/1423106612 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fabb403bba0 0x7fabb403e060 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7facb8054000 tx=0x7facb804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.664+0000 7faccf3ef640 1 --2- 172.21.15.132:0/1423106612 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5568515515d0 0x556851650600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.664+0000 7faccf3ef640 1 -- 172.21.15.132:0/1423106612 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7facc800a4a0 con 0x5568515515d0 2024-05-08T18:50:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.664+0000 7facd2f33800 1 -- 172.21.15.132:0/1423106612 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5568516514c0 con 0x5568515515d0 2024-05-08T18:50:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.664+0000 7faccf3ef640 1 -- 172.21.15.132:0/1423106612 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7facc800a4a0 con 0x5568515515d0 2024-05-08T18:50:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.664+0000 7facd2f33800 1 --2- 172.21.15.132:0/1423106612 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556851652ef0 0x556851655380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.664+0000 7facd2f33800 1 -- 172.21.15.132:0/1423106612 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x556851655b10 con 0x556851652ef0 2024-05-08T18:50:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.664+0000 7faccebee640 1 --2- 172.21.15.132:0/1423106612 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556851652ef0 0x556851655380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.664+0000 7faccebee640 1 --2- 172.21.15.132:0/1423106612 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556851652ef0 0x556851655380 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.665+0000 7faccebee640 1 -- 172.21.15.132:0/1423106612 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7facc002e070 con 0x556851652ef0 2024-05-08T18:50:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.665+0000 7facd2f33800 1 -- 172.21.15.132:0/1423106612 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x556851651d10 con 0x5568515515d0 2024-05-08T18:50:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.665+0000 7faccf3ef640 1 -- 172.21.15.132:0/1423106612 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7facc800a4a0 con 0x5568515515d0 2024-05-08T18:50:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.665+0000 7facd2f33800 1 -- 172.21.15.132:0/1423106612 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5568516520f0 con 0x5568515515d0 2024-05-08T18:50:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.665+0000 7faccf3ef640 1 -- 172.21.15.132:0/1423106612 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7facc800a4a0 con 0x5568515515d0 2024-05-08T18:50:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.666+0000 7facd2f33800 1 Processor -- start 2024-05-08T18:50:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.666+0000 7facd2f33800 1 -- start start 2024-05-08T18:50:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.666+0000 7facd2f33800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556851664a20 0x556851664e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.666+0000 7facd2f33800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55685163b890 con 0x556851664a20 2024-05-08T18:50:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.666+0000 7faccf3ef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556851664a20 0x556851664e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.666+0000 7faccf3ef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556851664a20 0x556851664e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59662/0 (socket says 172.21.15.132:59662) 2024-05-08T18:50:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.666+0000 7faccf3ef640 1 -- 172.21.15.132:0/3841643995 learned_addr learned my addr 172.21.15.132:0/3841643995 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.667+0000 7faccf3ef640 1 -- 172.21.15.132:0/3841643995 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556851665380 con 0x556851664a20 2024-05-08T18:50:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.667+0000 7faccf3ef640 1 --2- 172.21.15.132:0/3841643995 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556851664a20 0x556851664e40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x556851650f90 tx=0x7facc8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.667+0000 7fabb8e01640 1 -- 172.21.15.132:0/3841643995 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facc8014450 con 0x556851664a20 2024-05-08T18:50:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.667+0000 7fabb8e01640 1 -- 172.21.15.132:0/3841643995 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc80145f0 con 0x556851664a20 2024-05-08T18:50:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.667+0000 7facd2f33800 1 -- 172.21.15.132:0/3841643995 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556851665df0 con 0x556851664a20 2024-05-08T18:50:44.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.667+0000 7fabb8e01640 1 -- 172.21.15.132:0/3841643995 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facc80148d0 con 0x556851664a20 2024-05-08T18:50:44.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.667+0000 7facd2f33800 1 -- 172.21.15.132:0/3841643995 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568516662f0 con 0x556851664a20 2024-05-08T18:50:44.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.668+0000 7fabb8e01640 1 -- 172.21.15.132:0/3841643995 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7facc8011040 con 0x556851664a20 2024-05-08T18:50:44.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.668+0000 7fabb8e01640 1 --2- 172.21.15.132:0/3841643995 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7faba803bba0 0x7faba803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.668+0000 7fabb8e01640 1 -- 172.21.15.132:0/3841643995 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7facc801e070 con 0x556851664a20 2024-05-08T18:50:44.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.668+0000 7faccebee640 1 --2- 172.21.15.132:0/3841643995 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7faba803bba0 0x7faba803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.668+0000 7facd2f33800 1 Processor -- start 2024-05-08T18:50:44.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.668+0000 7faccebee640 1 --2- 172.21.15.132:0/3841643995 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7faba803bba0 0x7faba803e060 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55685163a7b0 tx=0x7facc0051760 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.668+0000 7facd2f33800 1 -- start start 2024-05-08T18:50:44.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.668+0000 7facd2f33800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556851671c70 0x556851672090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.668+0000 7facd2f33800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55685143ffc0 con 0x556851671c70 2024-05-08T18:50:44.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.669+0000 7faccf3ef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556851671c70 0x556851672090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.669+0000 7faccf3ef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556851671c70 0x556851672090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59674/0 (socket says 172.21.15.132:59674) 2024-05-08T18:50:44.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.669+0000 7faccf3ef640 1 -- 172.21.15.132:0/2767958413 learned_addr learned my addr 172.21.15.132:0/2767958413 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.669+0000 7faccf3ef640 1 -- 172.21.15.132:0/2767958413 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556851672660 con 0x556851671c70 2024-05-08T18:50:44.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.669+0000 7faccf3ef640 1 --2- 172.21.15.132:0/2767958413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556851671c70 0x556851672090 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7facc8013fd0 tx=0x7facc80118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c29224f30af7d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.669+0000 7fabb27fc640 1 -- 172.21.15.132:0/2767958413 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facc8044020 con 0x556851671c70 2024-05-08T18:50:44.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.669+0000 7fabb27fc640 1 -- 172.21.15.132:0/2767958413 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc8011d30 con 0x556851671c70 2024-05-08T18:50:44.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.669+0000 7fabb27fc640 1 -- 172.21.15.132:0/2767958413 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facc8022db0 con 0x556851671c70 2024-05-08T18:50:44.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.670+0000 7facd2f33800 1 -- 172.21.15.132:0/2767958413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556851671c70 msgr2=0x556851672090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.670+0000 7facd2f33800 1 --2- 172.21.15.132:0/2767958413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556851671c70 0x556851672090 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7facc8013fd0 tx=0x7facc80118e0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.670+0000 7facd2f33800 1 -- 172.21.15.132:0/2767958413 shutdown_connections 2024-05-08T18:50:44.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.670+0000 7facd2f33800 1 --2- 172.21.15.132:0/2767958413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556851671c70 0x556851672090 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.670+0000 7facd2f33800 1 -- 172.21.15.132:0/2767958413 >> 172.21.15.132:0/2767958413 conn(0x55685166e020 msgr2=0x55685166c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.670+0000 7facd2f33800 1 -- 172.21.15.132:0/2767958413 shutdown_connections 2024-05-08T18:50:44.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.670+0000 7facd2f33800 1 -- 172.21.15.132:0/2767958413 wait complete. 2024-05-08T18:50:44.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.670+0000 7facd2f33800 1 Processor -- start 2024-05-08T18:50:44.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.670+0000 7facd2f33800 1 -- start start 2024-05-08T18:50:44.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.670+0000 7facd2f33800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556851671c70 0x556851679080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.670+0000 7facd2f33800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556851672c40 con 0x556851671c70 2024-05-08T18:50:44.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.670+0000 7faccf3ef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556851671c70 0x556851679080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.670+0000 7faccf3ef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556851671c70 0x556851679080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59688/0 (socket says 172.21.15.132:59688) 2024-05-08T18:50:44.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.670+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 learned_addr learned my addr 172.21.15.132:0/1088861868 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.671+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568516795c0 con 0x556851671c70 2024-05-08T18:50:44.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.671+0000 7faccf3ef640 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556851671c70 0x556851679080 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7facc8013fd0 tx=0x7facc8052cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.671+0000 7fabb0ff9640 1 -- 172.21.15.132:0/1088861868 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facc80409c0 con 0x556851671c70 2024-05-08T18:50:44.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.671+0000 7fabb0ff9640 1 -- 172.21.15.132:0/1088861868 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc8040b60 con 0x556851671c70 2024-05-08T18:50:44.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.671+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556851679850 con 0x556851671c70 2024-05-08T18:50:44.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.671+0000 7fabb0ff9640 1 -- 172.21.15.132:0/1088861868 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7facc8040e40 con 0x556851671c70 2024-05-08T18:50:44.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.671+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55685167c500 con 0x556851671c70 2024-05-08T18:50:44.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.672+0000 7fabb0ff9640 1 -- 172.21.15.132:0/1088861868 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7facc80548c0 con 0x556851671c70 2024-05-08T18:50:44.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.672+0000 7fabb0ff9640 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fab9803bb50 0x7fab9803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.672+0000 7fabb0ff9640 1 -- 172.21.15.132:0/1088861868 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7facc800e040 con 0x556851671c70 2024-05-08T18:50:44.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.672+0000 7faccebee640 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fab9803bb50 0x7fab9803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.672+0000 7facd2f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.672+0000 7facd2f33800 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x556851684d30 0x5568516871f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.672+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x556851687940 con 0x556851684d30 2024-05-08T18:50:44.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.672+0000 7facc63ed640 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x556851684d30 0x5568516871f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.673+0000 7faccebee640 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fab9803bb50 0x7fab9803e010 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7facc0000c00 tx=0x7facc0046000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.673+0000 7facc63ed640 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x556851684d30 0x5568516871f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.673+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.673+0000 7facd2f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.673+0000 7facd2f33800 20 realm 2024-05-08T18:50:44.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.673+0000 7facd2f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.673+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x556851687d10 con 0x556851684d30 2024-05-08T18:50:44.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.673+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.673+0000 7facd2f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.673+0000 7facd2f33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:44.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.673+0000 7facd2f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.673+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5568516885e0 con 0x556851684d30 2024-05-08T18:50:44.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.673+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.673+0000 7facd2f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.673+0000 7facd2f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.674+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x556851688980 con 0x556851684d30 2024-05-08T18:50:44.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.674+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.674+0000 7facd2f33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:44.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.674+0000 7facd2f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.674+0000 7facd2f33800 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556851689470 0x55685168b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.674+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55685168bfe0 con 0x556851689470 2024-05-08T18:50:44.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.674+0000 7faccf3ef640 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556851689470 0x55685168b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.674+0000 7faccf3ef640 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556851689470 0x55685168b880 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.674+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7facc802a070 con 0x556851689470 2024-05-08T18:50:44.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.674+0000 7facd2f33800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:44.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.674+0000 7facd2f33800 20 searching for the correct realm 2024-05-08T18:50:44.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.674+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x556851689470 2024-05-08T18:50:44.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.675+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facc802a070 con 0x556851689470 2024-05-08T18:50:44.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.675+0000 7faccf3ef640 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7facc8014070 0x7facc8049400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.675+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x7facc8014070 2024-05-08T18:50:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.675+0000 7faccebee640 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7facc8014070 0x7facc8049400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.675+0000 7faccebee640 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7facc8014070 0x7facc8049400 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.676+0000 7faccebee640 1 -- 172.21.15.132:0/1088861868 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facc002e070 con 0x7facc8014070 2024-05-08T18:50:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.676+0000 7faccebee640 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7facc000f070 0x7facc001a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.676+0000 7faccebee640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x7facc000f070 2024-05-08T18:50:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.676+0000 7facc63ed640 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7facc000f070 0x7facc001a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.676+0000 7facc63ed640 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7facc000f070 0x7facc001a480 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.677+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb805a040 con 0x7facc000f070 2024-05-08T18:50:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.677+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x556851684d30 2024-05-08T18:50:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.677+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.677+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x556851684d30 2024-05-08T18:50:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.677+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.677+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x7facc000f070 2024-05-08T18:50:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.677+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb805a040 con 0x7facc000f070 2024-05-08T18:50:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.677+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x7facc000f070 2024-05-08T18:50:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.678+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb805a040 con 0x7facc000f070 2024-05-08T18:50:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.678+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x7facc8014070 2024-05-08T18:50:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.678+0000 7faccebee640 1 -- 172.21.15.132:0/1088861868 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facc002e070 con 0x7facc8014070 2024-05-08T18:50:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.678+0000 7faccebee640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x556851689470 2024-05-08T18:50:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.678+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facc802a070 con 0x556851689470 2024-05-08T18:50:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.678+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x556851684d30 2024-05-08T18:50:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.678+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.678+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x7facc000f070 2024-05-08T18:50:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.679+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb805a040 con 0x7facc000f070 2024-05-08T18:50:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.679+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x556851684d30 2024-05-08T18:50:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.679+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.679+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x7facc8014070 2024-05-08T18:50:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.679+0000 7faccebee640 1 -- 172.21.15.132:0/1088861868 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7facc002e070 con 0x7facc8014070 2024-05-08T18:50:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.679+0000 7faccebee640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x556851689470 2024-05-08T18:50:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.680+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7facc802a070 con 0x556851689470 2024-05-08T18:50:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.680+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x556851689470 2024-05-08T18:50:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.680+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facc802a070 con 0x556851689470 2024-05-08T18:50:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.680+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x7facc000f070 2024-05-08T18:50:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.680+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb805a040 con 0x7facc000f070 2024-05-08T18:50:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.680+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x556851689470 2024-05-08T18:50:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.680+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facc802a070 con 0x556851689470 2024-05-08T18:50:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.680+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x556851689470 2024-05-08T18:50:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.681+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facc802a070 con 0x556851689470 2024-05-08T18:50:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.681+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x556851684d30 2024-05-08T18:50:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.681+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.681+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x556851684d30 2024-05-08T18:50:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.681+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.681+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x7facc000f070 2024-05-08T18:50:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.681+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb805a040 con 0x7facc000f070 2024-05-08T18:50:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.681+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x556851689470 2024-05-08T18:50:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.682+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facc802a070 con 0x556851689470 2024-05-08T18:50:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.682+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x7facc8014070 2024-05-08T18:50:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.682+0000 7faccebee640 1 -- 172.21.15.132:0/1088861868 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facc002e070 con 0x7facc8014070 2024-05-08T18:50:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.682+0000 7faccebee640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x556851684d30 2024-05-08T18:50:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.682+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.682+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x7facc000f070 2024-05-08T18:50:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.682+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb805a040 con 0x7facc000f070 2024-05-08T18:50:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.682+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x556851689470 2024-05-08T18:50:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.683+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facc802a070 con 0x556851689470 2024-05-08T18:50:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.683+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x7facc000f070 2024-05-08T18:50:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.683+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb805a040 con 0x7facc000f070 2024-05-08T18:50:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.683+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x7facc8014070 2024-05-08T18:50:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.683+0000 7faccebee640 1 -- 172.21.15.132:0/1088861868 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facc002e070 con 0x7facc8014070 2024-05-08T18:50:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.683+0000 7faccebee640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x556851689470 2024-05-08T18:50:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.683+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facc802a070 con 0x556851689470 2024-05-08T18:50:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.683+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x7facc000f070 2024-05-08T18:50:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.684+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facb805a040 con 0x7facc000f070 2024-05-08T18:50:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.684+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x556851684d30 2024-05-08T18:50:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.684+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.684+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55685168d9c0 con 0x7facc8014070 2024-05-08T18:50:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.684+0000 7faccebee640 1 -- 172.21.15.132:0/1088861868 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7facc002e070 con 0x7facc8014070 2024-05-08T18:50:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.684+0000 7facd2f33800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.684+0000 7facd2f33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.684+0000 7facd2f33800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.684+0000 7facd2f33800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.684+0000 7facd2f33800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.684+0000 7facd2f33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.684+0000 7facd2f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.684+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55685168ca90 con 0x556851684d30 2024-05-08T18:50:44.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.684+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.685+0000 7facd2f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.685+0000 7facd2f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.685+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55685168d330 con 0x556851684d30 2024-05-08T18:50:44.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.685+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.685+0000 7facd2f33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:44.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.685+0000 7facd2f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.685+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55685168c6d0 con 0x556851684d30 2024-05-08T18:50:44.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.685+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.685+0000 7facd2f33800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:44.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.685+0000 7facd2f33800 20 zone default found 2024-05-08T18:50:44.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.685+0000 7facd2f33800 4 Realm: () 2024-05-08T18:50:44.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.685+0000 7facd2f33800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:44.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.685+0000 7facd2f33800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:44.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.685+0000 7facd2f33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:44.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.685+0000 7facd2f33800 20 zonegroup default 2024-05-08T18:50:44.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.685+0000 7facd2f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.685+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55685168e340 con 0x7facc000f070 2024-05-08T18:50:44.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.686+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7facb805a040 con 0x7facc000f070 2024-05-08T18:50:44.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.686+0000 7facd2f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.686+0000 7facd2f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.686+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55685168fd80 con 0x556851689470 2024-05-08T18:50:44.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.686+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7facc802a070 con 0x556851689470 2024-05-08T18:50:44.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.686+0000 7facd2f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.686+0000 7facd2f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.686+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5568516901c0 con 0x556851689470 2024-05-08T18:50:44.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.686+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7facc802a070 con 0x556851689470 2024-05-08T18:50:44.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.686+0000 7facd2f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.686+0000 7facd2f33800 20 started sync module instance, tier type = 2024-05-08T18:50:44.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.686+0000 7facd2f33800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:44.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.686+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55685168f160 con 0x7facc8014070 2024-05-08T18:50:44.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.687+0000 7faccebee640 1 -- 172.21.15.132:0/1088861868 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facc002e070 con 0x7facc8014070 2024-05-08T18:50:44.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.687+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93906530790576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x556851690650 con 0x7facc8014070 2024-05-08T18:50:44.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.687+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x556851690ea0 con 0x556851684d30 2024-05-08T18:50:44.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.688+0000 7faccebee640 1 -- 172.21.15.132:0/1088861868 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93906530790576] v25'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facc002e070 con 0x7facc8014070 2024-05-08T18:50:44.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.689+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.689+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93906530798064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5568516912c0 con 0x556851684d30 2024-05-08T18:50:44.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.689+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x556851691b10 con 0x556851689470 2024-05-08T18:50:44.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.690+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93906530798064] v25'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.690+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facc802a070 con 0x556851689470 2024-05-08T18:50:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.690+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93906530799600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x556851691a40 con 0x556851689470 2024-05-08T18:50:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.690+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x556851692590 con 0x7facc8014070 2024-05-08T18:50:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.691+0000 7faccebee640 1 -- 172.21.15.132:0/1088861868 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facc002e070 con 0x7facc8014070 2024-05-08T18:50:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.691+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93906530803872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x556851692e60 con 0x7facc8014070 2024-05-08T18:50:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.691+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x556851693960 con 0x556851684d30 2024-05-08T18:50:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.691+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93906530799600] v25'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facc802a070 con 0x556851689470 2024-05-08T18:50:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.692+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.692+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93906530808912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x556851693d50 con 0x556851684d30 2024-05-08T18:50:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.692+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x556851694790 con 0x7facc000f070 2024-05-08T18:50:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.693+0000 7faccebee640 1 -- 172.21.15.132:0/1088861868 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93906530803872] v25'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facc002e070 con 0x7facc8014070 2024-05-08T18:50:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.694+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93906530808912] v25'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.694+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb805a040 con 0x7facc000f070 2024-05-08T18:50:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.694+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93906530800784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x556851694750 con 0x7facc000f070 2024-05-08T18:50:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.694+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x556851695030 con 0x7facc000f070 2024-05-08T18:50:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.695+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93906530800784] v25'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb805a040 con 0x7facc000f070 2024-05-08T18:50:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.695+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb805a040 con 0x7facc000f070 2024-05-08T18:50:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.695+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93906530812512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x556851694750 con 0x7facc000f070 2024-05-08T18:50:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.695+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x556851695600 con 0x7facc000f070 2024-05-08T18:50:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.696+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93906530812512] v25'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb805a040 con 0x7facc000f070 2024-05-08T18:50:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.696+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb805a040 con 0x7facc000f070 2024-05-08T18:50:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.696+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93906530814768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x556851695600 con 0x7facc000f070 2024-05-08T18:50:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.696+0000 7facd2f33800 20 add_watcher() i=0 2024-05-08T18:50:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.696+0000 7facd2f33800 20 add_watcher() i=1 2024-05-08T18:50:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.696+0000 7facd2f33800 20 add_watcher() i=2 2024-05-08T18:50:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.696+0000 7facd2f33800 20 add_watcher() i=3 2024-05-08T18:50:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.696+0000 7facd2f33800 20 add_watcher() i=4 2024-05-08T18:50:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.696+0000 7facd2f33800 20 add_watcher() i=5 2024-05-08T18:50:44.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.696+0000 7facd2f33800 20 add_watcher() i=6 2024-05-08T18:50:44.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.697+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93906530814768] v25'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb805a040 con 0x7facc000f070 2024-05-08T18:50:44.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.697+0000 7facd2f33800 20 add_watcher() i=7 2024-05-08T18:50:44.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.697+0000 7facd2f33800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:44.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.697+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x556851698960 con 0x556851684d30 2024-05-08T18:50:44.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.698+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.698+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93906530816704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x556851695b90 con 0x556851684d30 2024-05-08T18:50:44.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.699+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93906530816704] v25'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.699+0000 7fab857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:44.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.699+0000 7facd2f33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:44.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.699+0000 7facd2f33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:44.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.699+0000 7facd2f33800 5 note: GC not initialized 2024-05-08T18:50:44.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.699+0000 7faafffff640 20 reqs_thread_entry: start 2024-05-08T18:50:44.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.699+0000 7facd2f33800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:44.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.699+0000 7facd2f33800 20 Filter name: none 2024-05-08T18:50:44.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.700+0000 7faafdffb640 20 reqs_thread_entry: start 2024-05-08T18:50:44.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.700+0000 7facd2f33800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.700+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5568516cb9b0 con 0x556851684d30 2024-05-08T18:50:44.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.700+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.700+0000 7facd2f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.709 INFO:teuthology.orchestra.run.smithi132.stderr:could not fetch user info: no user info saved 2024-05-08T18:50:44.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.701+0000 7fab857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:44.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.701+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93906530816704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5568516cb970 con 0x556851684d30 2024-05-08T18:50:44.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.702+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93906530816704] v25'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.702+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93906530790576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5568516cb970 con 0x7facc8014070 2024-05-08T18:50:44.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.703+0000 7faccebee640 1 -- 172.21.15.132:0/1088861868 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93906530790576] v25'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facc002e070 con 0x7facc8014070 2024-05-08T18:50:44.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.703+0000 7facd2f33800 20 remove_watcher() i=0 2024-05-08T18:50:44.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.703+0000 7facd2f33800 2 removed watcher, disabling cache 2024-05-08T18:50:44.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.703+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93906530798064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55685168ecb0 con 0x556851684d30 2024-05-08T18:50:44.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.704+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93906530798064] v25'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.704+0000 7facd2f33800 20 remove_watcher() i=1 2024-05-08T18:50:44.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.704+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93906530799600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5568516909f0 con 0x556851689470 2024-05-08T18:50:44.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.705+0000 7faccf3ef640 1 -- 172.21.15.132:0/1088861868 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93906530799600] v25'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facc802a070 con 0x556851689470 2024-05-08T18:50:44.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.705+0000 7facd2f33800 20 remove_watcher() i=2 2024-05-08T18:50:44.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.705+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93906530803872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55685168ecb0 con 0x7facc8014070 2024-05-08T18:50:44.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.706+0000 7faccebee640 1 -- 172.21.15.132:0/1088861868 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93906530803872] v25'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facc002e070 con 0x7facc8014070 2024-05-08T18:50:44.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.706+0000 7facd2f33800 20 remove_watcher() i=3 2024-05-08T18:50:44.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.706+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93906530808912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x556851690ff0 con 0x556851684d30 2024-05-08T18:50:44.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.707+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93906530808912] v25'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb805a040 con 0x556851684d30 2024-05-08T18:50:44.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.707+0000 7facd2f33800 20 remove_watcher() i=4 2024-05-08T18:50:44.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.707+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93906530800784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5568516909f0 con 0x7facc000f070 2024-05-08T18:50:44.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.708+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93906530800784] v25'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb805a040 con 0x7facc000f070 2024-05-08T18:50:44.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.708+0000 7facd2f33800 20 remove_watcher() i=5 2024-05-08T18:50:44.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.708+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93906530812512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55685168ecb0 con 0x7facc000f070 2024-05-08T18:50:44.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.709+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93906530812512] v25'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb805a040 con 0x7facc000f070 2024-05-08T18:50:44.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.709+0000 7facd2f33800 20 remove_watcher() i=6 2024-05-08T18:50:44.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.709+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93906530814768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x556851693450 con 0x7facc000f070 2024-05-08T18:50:44.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.710+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93906530814768] v25'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7facb805a040 con 0x7facc000f070 2024-05-08T18:50:44.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.710+0000 7facd2f33800 20 remove_watcher() i=7 2024-05-08T18:50:44.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.710+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7facc000f070 msgr2=0x7facc001a480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.710+0000 7facd2f33800 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7facc000f070 0x7facc001a480 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.710+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x556851684d30 msgr2=0x5568516871f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.710+0000 7facd2f33800 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x556851684d30 0x5568516871f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.710+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7facc8014070 msgr2=0x7facc8049400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.710+0000 7facd2f33800 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7facc8014070 0x7facc8049400 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.710+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556851689470 msgr2=0x55685168b880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.710+0000 7facd2f33800 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556851689470 0x55685168b880 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.710+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fab9803bb50 msgr2=0x7fab9803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.710+0000 7facd2f33800 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fab9803bb50 0x7fab9803e010 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7facc0000c00 tx=0x7facc0046000 comp rx=0 tx=0).stop 2024-05-08T18:50:44.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.710+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556851671c70 msgr2=0x556851679080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.710+0000 7facc63ed640 1 -- 172.21.15.132:0/1088861868 reap_dead start 2024-05-08T18:50:44.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.710+0000 7facd2f33800 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556851671c70 0x556851679080 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7facc8013fd0 tx=0x7facc8052cd0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.710+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 shutdown_connections 2024-05-08T18:50:44.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.710+0000 7facd2f33800 1 --2- 172.21.15.132:0/1088861868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556851671c70 0x556851679080 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.710+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 >> 172.21.15.132:0/1088861868 conn(0x55685166e020 msgr2=0x55685166b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.710+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 shutdown_connections 2024-05-08T18:50:44.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 -- 172.21.15.132:0/1088861868 wait complete. 2024-05-08T18:50:44.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 -- 172.21.15.132:0/3841643995 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7faba803bba0 msgr2=0x7faba803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 --2- 172.21.15.132:0/3841643995 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7faba803bba0 0x7faba803e060 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55685163a7b0 tx=0x7facc0051760 comp rx=0 tx=0).stop 2024-05-08T18:50:44.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 -- 172.21.15.132:0/3841643995 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556851664a20 msgr2=0x556851664e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 --2- 172.21.15.132:0/3841643995 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556851664a20 0x556851664e40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x556851650f90 tx=0x7facc8018830 comp rx=0 tx=0).stop 2024-05-08T18:50:44.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 -- 172.21.15.132:0/3841643995 shutdown_connections 2024-05-08T18:50:44.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 --2- 172.21.15.132:0/3841643995 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7faba803bba0 0x7faba803e060 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 --2- 172.21.15.132:0/3841643995 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556851664a20 0x556851664e40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 -- 172.21.15.132:0/3841643995 >> 172.21.15.132:0/3841643995 conn(0x556851658ac0 msgr2=0x556851658ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 -- 172.21.15.132:0/3841643995 shutdown_connections 2024-05-08T18:50:44.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 -- 172.21.15.132:0/3841643995 wait complete. 2024-05-08T18:50:44.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 -- 172.21.15.132:0/1423106612 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5568515515d0 msgr2=0x556851650600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 --2- 172.21.15.132:0/1423106612 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5568515515d0 0x556851650600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 -- 172.21.15.132:0/1423106612 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556851652ef0 msgr2=0x556851655380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 --2- 172.21.15.132:0/1423106612 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556851652ef0 0x556851655380 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 -- 172.21.15.132:0/1423106612 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fabb403bba0 msgr2=0x7fabb403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 --2- 172.21.15.132:0/1423106612 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fabb403bba0 0x7fabb403e060 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7facb8054000 tx=0x7facb804e000 comp rx=0 tx=0).stop 2024-05-08T18:50:44.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 -- 172.21.15.132:0/1423106612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55685154d140 msgr2=0x55685163b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 --2- 172.21.15.132:0/1423106612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55685154d140 0x55685163b350 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7facc0000fd0 tx=0x7facc0000ed0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 -- 172.21.15.132:0/1423106612 shutdown_connections 2024-05-08T18:50:44.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 --2- 172.21.15.132:0/1423106612 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556851652ef0 0x556851655380 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 --2- 172.21.15.132:0/1423106612 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5568515515d0 0x556851650600 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 --2- 172.21.15.132:0/1423106612 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fabb403bba0 0x7fabb403e060 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 --2- 172.21.15.132:0/1423106612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55685154d140 0x55685163b350 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 -- 172.21.15.132:0/1423106612 >> 172.21.15.132:0/1423106612 conn(0x5568515486a0 msgr2=0x556851638ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 -- 172.21.15.132:0/1423106612 shutdown_connections 2024-05-08T18:50:44.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.711+0000 7facd2f33800 1 -- 172.21.15.132:0/1423106612 wait complete. 2024-05-08T18:50:44.719 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-08T18:50:44.720 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-05-08T18:50:44.720 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-05-08T18:50:44.720 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-05-08T18:50:44.774 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:44.774 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:44.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.775+0000 7f3858f46800 1 Processor -- start 2024-05-08T18:50:44.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.775+0000 7f3858f46800 1 -- start start 2024-05-08T18:50:44.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.775+0000 7f3858f46800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x564b7479b180 0x564b7479b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.775+0000 7f3858f46800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564b7479bc20 con 0x564b7479c3e0 2024-05-08T18:50:44.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.775+0000 7f3858f46800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x564b7463ce20 con 0x564b7479b180 2024-05-08T18:50:44.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.776+0000 7f3856a3e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x564b7479b180 0x564b7479b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.776+0000 7f3856a3e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x564b7479b180 0x564b7479b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59700/0 (socket says 172.21.15.132:59700) 2024-05-08T18:50:44.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.776+0000 7f3856a3e640 1 -- 172.21.15.132:0/1001973398 learned_addr learned my addr 172.21.15.132:0/1001973398 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.776+0000 7f3856a3e640 1 -- 172.21.15.132:0/1001973398 >> v1:172.21.15.42:6789/0 conn(0x564b7479c3e0 legacy=0x564b7479c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.776+0000 7f3856a3e640 1 -- 172.21.15.132:0/1001973398 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b7479cfa0 con 0x564b7479b180 2024-05-08T18:50:44.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.778+0000 7f3856a3e640 1 --2- 172.21.15.132:0/1001973398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b7479b180 0x564b7479b5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f384800a520 tx=0x7f384801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6293032b391f98c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.778+0000 7f385623d640 1 -- 172.21.15.132:0/1001973398 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3848057070 con 0x564b7479b180 2024-05-08T18:50:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.778+0000 7f385623d640 1 -- 172.21.15.132:0/1001973398 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3848052570 con 0x564b7479b180 2024-05-08T18:50:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.778+0000 7f385623d640 1 -- 172.21.15.132:0/1001973398 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3848052870 con 0x564b7479b180 2024-05-08T18:50:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.779+0000 7f3858f46800 1 -- 172.21.15.132:0/1001973398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b7479b180 msgr2=0x564b7479b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.779+0000 7f3858f46800 1 --2- 172.21.15.132:0/1001973398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b7479b180 0x564b7479b5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f384800a520 tx=0x7f384801d010 comp rx=0 tx=0).stop 2024-05-08T18:50:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.779+0000 7f3858f46800 1 -- 172.21.15.132:0/1001973398 shutdown_connections 2024-05-08T18:50:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.779+0000 7f3858f46800 1 --2- 172.21.15.132:0/1001973398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b7479b180 0x564b7479b5a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.779+0000 7f3858f46800 1 -- 172.21.15.132:0/1001973398 >> 172.21.15.132:0/1001973398 conn(0x564b74796760 msgr2=0x564b74798b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.779+0000 7f3858f46800 1 -- 172.21.15.132:0/1001973398 shutdown_connections 2024-05-08T18:50:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.779+0000 7f3858f46800 1 -- 172.21.15.132:0/1001973398 wait complete. 2024-05-08T18:50:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.792+0000 7f3858f46800 1 Processor -- start 2024-05-08T18:50:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.792+0000 7f3858f46800 1 -- start start 2024-05-08T18:50:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.792+0000 7f3858f46800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b7479b180 0x564b7488c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.792+0000 7f3858f46800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564b746e76b0 con 0x564b7479b180 2024-05-08T18:50:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.793+0000 7f3856a3e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b7479b180 0x564b7488c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.793+0000 7f3856a3e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b7479b180 0x564b7488c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59716/0 (socket says 172.21.15.132:59716) 2024-05-08T18:50:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.793+0000 7f3856a3e640 1 -- 172.21.15.132:0/1440079006 learned_addr learned my addr 172.21.15.132:0/1440079006 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.793+0000 7f3856a3e640 1 -- 172.21.15.132:0/1440079006 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b7488cce0 con 0x564b7479b180 2024-05-08T18:50:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.793+0000 7f3856a3e640 1 --2- 172.21.15.132:0/1440079006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b7479b180 0x564b7488c710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f384801d050 tx=0x7f384804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1635aa9de1d2841b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.793+0000 7f3744e09640 1 -- 172.21.15.132:0/1440079006 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3848057040 con 0x564b7479b180 2024-05-08T18:50:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.793+0000 7f3744e09640 1 -- 172.21.15.132:0/1440079006 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3848052850 con 0x564b7479b180 2024-05-08T18:50:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.793+0000 7f3744e09640 1 -- 172.21.15.132:0/1440079006 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3848052b70 con 0x564b7479b180 2024-05-08T18:50:44.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.794+0000 7f3858f46800 1 -- 172.21.15.132:0/1440079006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b7479b180 msgr2=0x564b7488c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.794+0000 7f3858f46800 1 --2- 172.21.15.132:0/1440079006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b7479b180 0x564b7488c710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f384801d050 tx=0x7f384804c000 comp rx=0 tx=0).stop 2024-05-08T18:50:44.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.794+0000 7f3858f46800 1 -- 172.21.15.132:0/1440079006 shutdown_connections 2024-05-08T18:50:44.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.794+0000 7f3858f46800 1 --2- 172.21.15.132:0/1440079006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b7479b180 0x564b7488c710 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.794+0000 7f3858f46800 1 -- 172.21.15.132:0/1440079006 >> 172.21.15.132:0/1440079006 conn(0x564b74796760 msgr2=0x564b74888030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.794+0000 7f3858f46800 1 -- 172.21.15.132:0/1440079006 shutdown_connections 2024-05-08T18:50:44.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.794+0000 7f3858f46800 1 -- 172.21.15.132:0/1440079006 wait complete. 2024-05-08T18:50:44.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.794+0000 7f3858f46800 1 Processor -- start 2024-05-08T18:50:44.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.795+0000 7f3858f46800 1 -- start start 2024-05-08T18:50:44.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.795+0000 7f3858f46800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b7479b180 0x564b748940d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.795+0000 7f3858f46800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564b747a48b0 con 0x564b7479b180 2024-05-08T18:50:44.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.795+0000 7f3856a3e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b7479b180 0x564b748940d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.795+0000 7f3856a3e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b7479b180 0x564b748940d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59720/0 (socket says 172.21.15.132:59720) 2024-05-08T18:50:44.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.795+0000 7f3856a3e640 1 -- 172.21.15.132:0/3777165979 learned_addr learned my addr 172.21.15.132:0/3777165979 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.795+0000 7f3856a3e640 1 -- 172.21.15.132:0/3777165979 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b74894610 con 0x564b7479b180 2024-05-08T18:50:44.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.795+0000 7f3856a3e640 1 --2- 172.21.15.132:0/3777165979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b7479b180 0x564b748940d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f384801d050 tx=0x7f3848003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.796+0000 7f3743606640 1 -- 172.21.15.132:0/3777165979 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3848075070 con 0x564b7479b180 2024-05-08T18:50:44.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.796+0000 7f3743606640 1 -- 172.21.15.132:0/3777165979 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3848068810 con 0x564b7479b180 2024-05-08T18:50:44.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.796+0000 7f3743606640 1 -- 172.21.15.132:0/3777165979 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3848057070 con 0x564b7479b180 2024-05-08T18:50:44.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.796+0000 7f3858f46800 1 -- 172.21.15.132:0/3777165979 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b748948a0 con 0x564b7479b180 2024-05-08T18:50:44.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.796+0000 7f3858f46800 1 -- 172.21.15.132:0/3777165979 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b7470e7c0 con 0x564b7479b180 2024-05-08T18:50:44.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.797+0000 7f3743606640 1 -- 172.21.15.132:0/3777165979 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f3848078070 con 0x564b7479b180 2024-05-08T18:50:44.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.797+0000 7f3743606640 1 --2- 172.21.15.132:0/3777165979 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f373c03bb50 0x7f373c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.797+0000 7f3743606640 1 -- 172.21.15.132:0/3777165979 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f3848096460 con 0x564b7479b180 2024-05-08T18:50:44.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.797+0000 7f384ffff640 1 --2- 172.21.15.132:0/3777165979 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f373c03bb50 0x7f373c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.797+0000 7f3858f46800 1 --2- 172.21.15.132:0/3777165979 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564b7479c3e0 0x564b7489a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.797+0000 7f3858f46800 1 -- 172.21.15.132:0/3777165979 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b7489a9e0 con 0x564b7479c3e0 2024-05-08T18:50:44.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.797+0000 7f385723f640 1 --2- 172.21.15.132:0/3777165979 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564b7479c3e0 0x564b7489a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.797+0000 7f384ffff640 1 --2- 172.21.15.132:0/3777165979 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f373c03bb50 0x7f373c03e010 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3840001e10 tx=0x7f3840001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.797+0000 7f385723f640 1 --2- 172.21.15.132:0/3777165979 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564b7479c3e0 0x564b7489a4a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.798+0000 7f385723f640 1 -- 172.21.15.132:0/3777165979 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f385000a4a0 con 0x564b7479c3e0 2024-05-08T18:50:44.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.798+0000 7f3858f46800 1 -- 172.21.15.132:0/3777165979 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b7489ad80 con 0x564b7479c3e0 2024-05-08T18:50:44.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.798+0000 7f385723f640 1 -- 172.21.15.132:0/3777165979 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f385000a4a0 con 0x564b7479c3e0 2024-05-08T18:50:44.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.798+0000 7f3858f46800 1 --2- 172.21.15.132:0/3777165979 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564b7489cb70 0x564b7489ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.798+0000 7f3858f46800 1 -- 172.21.15.132:0/3777165979 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b7489f600 con 0x564b7489cb70 2024-05-08T18:50:44.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.798+0000 7f3856a3e640 1 --2- 172.21.15.132:0/3777165979 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564b7489cb70 0x564b7489ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.798+0000 7f3856a3e640 1 --2- 172.21.15.132:0/3777165979 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564b7489cb70 0x564b7489ef60 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.799+0000 7f3856a3e640 1 -- 172.21.15.132:0/3777165979 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3848077030 con 0x564b7489cb70 2024-05-08T18:50:44.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.799+0000 7f3858f46800 1 -- 172.21.15.132:0/3777165979 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b7489ba10 con 0x564b7479c3e0 2024-05-08T18:50:44.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.799+0000 7f385723f640 1 -- 172.21.15.132:0/3777165979 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f385000a4a0 con 0x564b7479c3e0 2024-05-08T18:50:44.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.799+0000 7f3858f46800 1 -- 172.21.15.132:0/3777165979 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b7489bef0 con 0x564b7479c3e0 2024-05-08T18:50:44.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.799+0000 7f385723f640 1 -- 172.21.15.132:0/3777165979 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f385000a4a0 con 0x564b7479c3e0 2024-05-08T18:50:44.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.800+0000 7f3858f46800 1 Processor -- start 2024-05-08T18:50:44.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.800+0000 7f3858f46800 1 -- start start 2024-05-08T18:50:44.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.800+0000 7f3858f46800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b748ae580 0x564b748ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.800+0000 7f3858f46800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564b7468dfc0 con 0x564b748ae580 2024-05-08T18:50:44.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.800+0000 7f385723f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b748ae580 0x564b748ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.800+0000 7f385723f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b748ae580 0x564b748ae9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59736/0 (socket says 172.21.15.132:59736) 2024-05-08T18:50:44.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.800+0000 7f385723f640 1 -- 172.21.15.132:0/455982242 learned_addr learned my addr 172.21.15.132:0/455982242 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.800+0000 7f385723f640 1 -- 172.21.15.132:0/455982242 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b748aeee0 con 0x564b748ae580 2024-05-08T18:50:44.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.801+0000 7f385723f640 1 --2- 172.21.15.132:0/455982242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b748ae580 0x564b748ae9a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x564b7470f720 tx=0x7f3850018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.801+0000 7f3740e01640 1 -- 172.21.15.132:0/455982242 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3850014450 con 0x564b748ae580 2024-05-08T18:50:44.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.801+0000 7f3740e01640 1 -- 172.21.15.132:0/455982242 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38500145f0 con 0x564b748ae580 2024-05-08T18:50:44.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.801+0000 7f3740e01640 1 -- 172.21.15.132:0/455982242 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38500148d0 con 0x564b748ae580 2024-05-08T18:50:44.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.801+0000 7f3858f46800 1 -- 172.21.15.132:0/455982242 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b748af950 con 0x564b748ae580 2024-05-08T18:50:44.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.801+0000 7f3858f46800 1 -- 172.21.15.132:0/455982242 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b748afe50 con 0x564b748ae580 2024-05-08T18:50:44.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.802+0000 7f3740e01640 1 -- 172.21.15.132:0/455982242 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f3850011040 con 0x564b748ae580 2024-05-08T18:50:44.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.802+0000 7f3740e01640 1 --2- 172.21.15.132:0/455982242 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f373003bba0 0x7f373003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.802+0000 7f3740e01640 1 -- 172.21.15.132:0/455982242 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f385001e070 con 0x564b748ae580 2024-05-08T18:50:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.802+0000 7f3856a3e640 1 --2- 172.21.15.132:0/455982242 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f373003bba0 0x7f373003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.802+0000 7f3858f46800 1 Processor -- start 2024-05-08T18:50:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.802+0000 7f3856a3e640 1 --2- 172.21.15.132:0/455982242 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f373003bba0 0x7f373003e060 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x564b7470ebf0 tx=0x7f3848078f00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.802+0000 7f3858f46800 1 -- start start 2024-05-08T18:50:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.802+0000 7f3858f46800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b748bb870 0x564b748bbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.802+0000 7f3858f46800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564b7488cfa0 con 0x564b748bb870 2024-05-08T18:50:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.803+0000 7f385723f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b748bb870 0x564b748bbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.803+0000 7f385723f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b748bb870 0x564b748bbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59746/0 (socket says 172.21.15.132:59746) 2024-05-08T18:50:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.803+0000 7f385723f640 1 -- 172.21.15.132:0/222472872 learned_addr learned my addr 172.21.15.132:0/222472872 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.803+0000 7f385723f640 1 -- 172.21.15.132:0/222472872 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b748bc260 con 0x564b748bb870 2024-05-08T18:50:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.803+0000 7f385723f640 1 --2- 172.21.15.132:0/222472872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b748bb870 0x564b748bbc90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3850013010 tx=0x7f38500118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93bd21d07d626f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.803+0000 7f373a7fc640 1 -- 172.21.15.132:0/222472872 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3850011c00 con 0x564b748bb870 2024-05-08T18:50:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.803+0000 7f373a7fc640 1 -- 172.21.15.132:0/222472872 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3850011da0 con 0x564b748bb870 2024-05-08T18:50:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.803+0000 7f373a7fc640 1 -- 172.21.15.132:0/222472872 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3850014a70 con 0x564b748bb870 2024-05-08T18:50:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.804+0000 7f3858f46800 1 -- 172.21.15.132:0/222472872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b748bb870 msgr2=0x564b748bbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.804+0000 7f3858f46800 1 --2- 172.21.15.132:0/222472872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b748bb870 0x564b748bbc90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3850013010 tx=0x7f38500118e0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.804+0000 7f3858f46800 1 -- 172.21.15.132:0/222472872 shutdown_connections 2024-05-08T18:50:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.804+0000 7f3858f46800 1 --2- 172.21.15.132:0/222472872 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b748bb870 0x564b748bbc90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.804+0000 7f3858f46800 1 -- 172.21.15.132:0/222472872 >> 172.21.15.132:0/222472872 conn(0x564b748b7b80 msgr2=0x564b748b5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.804+0000 7f3858f46800 1 -- 172.21.15.132:0/222472872 shutdown_connections 2024-05-08T18:50:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.804+0000 7f3858f46800 1 -- 172.21.15.132:0/222472872 wait complete. 2024-05-08T18:50:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.804+0000 7f3858f46800 1 Processor -- start 2024-05-08T18:50:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.804+0000 7f3858f46800 1 -- start start 2024-05-08T18:50:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.804+0000 7f3858f46800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b748bb870 0x564b748c2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.804+0000 7f3858f46800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564b748bc9b0 con 0x564b748bb870 2024-05-08T18:50:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.804+0000 7f385723f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b748bb870 0x564b748c2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.804+0000 7f385723f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b748bb870 0x564b748c2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59762/0 (socket says 172.21.15.132:59762) 2024-05-08T18:50:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.804+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 learned_addr learned my addr 172.21.15.132:0/1274708622 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.805+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b748c32b0 con 0x564b748bb870 2024-05-08T18:50:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.805+0000 7f385723f640 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b748bb870 0x564b748c2d70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f38500119b0 tx=0x7f3850052d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.805+0000 7f3738ff9640 1 -- 172.21.15.132:0/1274708622 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3850051550 con 0x564b748bb870 2024-05-08T18:50:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.805+0000 7f3738ff9640 1 -- 172.21.15.132:0/1274708622 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38500516f0 con 0x564b748bb870 2024-05-08T18:50:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.805+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b748c3540 con 0x564b748bb870 2024-05-08T18:50:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.805+0000 7f3738ff9640 1 -- 172.21.15.132:0/1274708622 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f385003f600 con 0x564b748bb870 2024-05-08T18:50:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.805+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b748c61f0 con 0x564b748bb870 2024-05-08T18:50:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.806+0000 7f3738ff9640 1 -- 172.21.15.132:0/1274708622 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f3850054910 con 0x564b748bb870 2024-05-08T18:50:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.806+0000 7f3738ff9640 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f372003bb50 0x7f372003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.806+0000 7f3738ff9640 1 -- 172.21.15.132:0/1274708622 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f385000e040 con 0x564b748bb870 2024-05-08T18:50:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.806+0000 7f3856a3e640 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f372003bb50 0x7f372003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.806+0000 7f3856a3e640 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f372003bb50 0x7f372003e010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f384808dfd0 tx=0x7f3848082000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.807+0000 7f3858f46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.807+0000 7f3858f46800 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564b748cead0 0x564b748d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.807+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b748d16e0 con 0x564b748cead0 2024-05-08T18:50:44.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.807+0000 7f384ffff640 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564b748cead0 0x564b748d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.807+0000 7f384ffff640 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564b748cead0 0x564b748d0f90 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.807+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f384000bdb0 con 0x564b748cead0 2024-05-08T18:50:44.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.807+0000 7f3858f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.807+0000 7f3858f46800 20 realm 2024-05-08T18:50:44.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.807+0000 7f3858f46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.807+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b748cdf20 con 0x564b748cead0 2024-05-08T18:50:44.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.808+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f384000bdb0 con 0x564b748cead0 2024-05-08T18:50:44.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.808+0000 7f3858f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.808+0000 7f3858f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:44.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.808+0000 7f3858f46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.808+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b748d21d0 con 0x564b748cead0 2024-05-08T18:50:44.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.808+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f384000bdb0 con 0x564b748cead0 2024-05-08T18:50:44.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.808+0000 7f3858f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.808+0000 7f3858f46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.808+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b748d2aa0 con 0x564b748cead0 2024-05-08T18:50:44.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.808+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f384000bdb0 con 0x564b748cead0 2024-05-08T18:50:44.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.808+0000 7f3858f46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:44.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.808+0000 7f3858f46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.808+0000 7f3858f46800 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564b748d33e0 0x564b748d5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.808+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b748d5fa0 con 0x564b748d33e0 2024-05-08T18:50:44.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.808+0000 7f385723f640 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564b748d33e0 0x564b748d5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.808+0000 7f385723f640 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564b748d33e0 0x564b748d5810 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.809+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3850046070 con 0x564b748d33e0 2024-05-08T18:50:44.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.809+0000 7f3858f46800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:44.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.809+0000 7f3858f46800 20 searching for the correct realm 2024-05-08T18:50:44.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.809+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x564b748d33e0 2024-05-08T18:50:44.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.809+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3850046070 con 0x564b748d33e0 2024-05-08T18:50:44.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.809+0000 7f385723f640 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f3850014070 0x7f3850036440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.809+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x7f3850014070 2024-05-08T18:50:44.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.809+0000 7f3856a3e640 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f3850014070 0x7f3850036440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.810+0000 7f3856a3e640 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f3850014070 0x7f3850036440 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.810+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3848082070 con 0x7f3850014070 2024-05-08T18:50:44.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.810+0000 7f3856a3e640 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f3848085040 0x7f384808d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.810+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x7f3848085040 2024-05-08T18:50:44.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.810+0000 7f384ffff640 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f3848085040 0x7f384808d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.811+0000 7f384ffff640 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f3848085040 0x7f384808d850 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.811+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384000bdb0 con 0x7f3848085040 2024-05-08T18:50:44.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.811+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x564b748cead0 2024-05-08T18:50:44.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.811+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384000bdb0 con 0x564b748cead0 2024-05-08T18:50:44.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.811+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x564b748cead0 2024-05-08T18:50:44.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.811+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.811+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x7f3848085040 2024-05-08T18:50:44.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.812+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384002a040 con 0x7f3848085040 2024-05-08T18:50:44.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.812+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x7f3848085040 2024-05-08T18:50:44.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.812+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384002a040 con 0x7f3848085040 2024-05-08T18:50:44.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.812+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x7f3850014070 2024-05-08T18:50:44.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.812+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3848082070 con 0x7f3850014070 2024-05-08T18:50:44.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.812+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x564b748d33e0 2024-05-08T18:50:44.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.812+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3850046070 con 0x564b748d33e0 2024-05-08T18:50:44.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.812+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x564b748cead0 2024-05-08T18:50:44.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.813+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.813+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x7f3848085040 2024-05-08T18:50:44.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.813+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384002a040 con 0x7f3848085040 2024-05-08T18:50:44.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.813+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x564b748cead0 2024-05-08T18:50:44.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.813+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.813+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x7f3850014070 2024-05-08T18:50:44.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.814+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3848082070 con 0x7f3850014070 2024-05-08T18:50:44.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.814+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x564b748d33e0 2024-05-08T18:50:44.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.814+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3850046070 con 0x564b748d33e0 2024-05-08T18:50:44.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.814+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x564b748d33e0 2024-05-08T18:50:44.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.814+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3850046070 con 0x564b748d33e0 2024-05-08T18:50:44.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.814+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x7f3848085040 2024-05-08T18:50:44.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.814+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384002a040 con 0x7f3848085040 2024-05-08T18:50:44.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.814+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x564b748d33e0 2024-05-08T18:50:44.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.815+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3850046070 con 0x564b748d33e0 2024-05-08T18:50:44.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.815+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x564b748d33e0 2024-05-08T18:50:44.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.815+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3850046070 con 0x564b748d33e0 2024-05-08T18:50:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.815+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x564b748cead0 2024-05-08T18:50:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.815+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.815+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x564b748cead0 2024-05-08T18:50:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.815+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.815+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x7f3848085040 2024-05-08T18:50:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.815+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384002a040 con 0x7f3848085040 2024-05-08T18:50:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.816+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x564b748d33e0 2024-05-08T18:50:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.816+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3850046070 con 0x564b748d33e0 2024-05-08T18:50:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.816+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x7f3850014070 2024-05-08T18:50:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.816+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3848082070 con 0x7f3850014070 2024-05-08T18:50:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.816+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x564b748cead0 2024-05-08T18:50:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.816+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.816+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x7f3848085040 2024-05-08T18:50:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.817+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384002a040 con 0x7f3848085040 2024-05-08T18:50:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.817+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x564b748d33e0 2024-05-08T18:50:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.817+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3850046070 con 0x564b748d33e0 2024-05-08T18:50:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.817+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x7f3848085040 2024-05-08T18:50:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.817+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384002a040 con 0x7f3848085040 2024-05-08T18:50:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.817+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x7f3850014070 2024-05-08T18:50:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.817+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3848082070 con 0x7f3850014070 2024-05-08T18:50:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.817+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x564b748d33e0 2024-05-08T18:50:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.818+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3850046070 con 0x564b748d33e0 2024-05-08T18:50:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.818+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x7f3848085040 2024-05-08T18:50:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.818+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384002a040 con 0x7f3848085040 2024-05-08T18:50:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.818+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x564b748cead0 2024-05-08T18:50:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.818+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.818+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b748d78f0 con 0x7f3850014070 2024-05-08T18:50:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.818+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3848082070 con 0x7f3850014070 2024-05-08T18:50:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.818+0000 7f3858f46800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.818+0000 7f3858f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.818+0000 7f3858f46800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.818+0000 7f3858f46800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.818+0000 7f3858f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.818+0000 7f3858f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.818+0000 7f3858f46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.818+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b748d6960 con 0x564b748cead0 2024-05-08T18:50:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.819+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.819+0000 7f3858f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.819+0000 7f3858f46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.819+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b748d7200 con 0x564b748cead0 2024-05-08T18:50:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.819+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.819+0000 7f3858f46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.819+0000 7f3858f46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.819+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b748d7d70 con 0x564b748cead0 2024-05-08T18:50:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.819+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.819+0000 7f3858f46800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.819+0000 7f3858f46800 20 zone default found 2024-05-08T18:50:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.819+0000 7f3858f46800 4 Realm: () 2024-05-08T18:50:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.819+0000 7f3858f46800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.819+0000 7f3858f46800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.819+0000 7f3858f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.819+0000 7f3858f46800 20 zonegroup default 2024-05-08T18:50:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.819+0000 7f3858f46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.819+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b748d7db0 con 0x7f3848085040 2024-05-08T18:50:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.820+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f384002a040 con 0x7f3848085040 2024-05-08T18:50:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.820+0000 7f3858f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.820+0000 7f3858f46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.820+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b748d9bd0 con 0x564b748d33e0 2024-05-08T18:50:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.820+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3850046070 con 0x564b748d33e0 2024-05-08T18:50:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.820+0000 7f3858f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.820+0000 7f3858f46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.820+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b748d9ff0 con 0x564b748d33e0 2024-05-08T18:50:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.820+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3850046070 con 0x564b748d33e0 2024-05-08T18:50:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.820+0000 7f3858f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.820+0000 7f3858f46800 20 started sync module instance, tier type = 2024-05-08T18:50:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.820+0000 7f3858f46800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.820+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748d9070 con 0x7f3850014070 2024-05-08T18:50:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.821+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3848082070 con 0x7f3850014070 2024-05-08T18:50:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.821+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94882077971552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748da900 con 0x7f3850014070 2024-05-08T18:50:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.821+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748db150 con 0x564b748cead0 2024-05-08T18:50:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.823+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.823+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94882077977760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748db650 con 0x564b748cead0 2024-05-08T18:50:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.823+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748dc170 con 0x564b748d33e0 2024-05-08T18:50:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.823+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94882077971552] v25'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3848082070 con 0x7f3850014070 2024-05-08T18:50:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.824+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94882077977760] v25'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.824+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3850046070 con 0x564b748d33e0 2024-05-08T18:50:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.824+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94882077981760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748dc130 con 0x564b748d33e0 2024-05-08T18:50:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.824+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748dca10 con 0x7f3850014070 2024-05-08T18:50:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.825+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94882077981760] v25'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3850046070 con 0x564b748d33e0 2024-05-08T18:50:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.825+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3848082070 con 0x7f3850014070 2024-05-08T18:50:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.825+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94882077984096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748dc130 con 0x7f3850014070 2024-05-08T18:50:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.825+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748dd4d0 con 0x564b748cead0 2024-05-08T18:50:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.827+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.827+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94882077986816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748ddda0 con 0x564b748cead0 2024-05-08T18:50:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.827+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748de850 con 0x7f3848085040 2024-05-08T18:50:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.827+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94882077984096] v25'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3848082070 con 0x7f3850014070 2024-05-08T18:50:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.828+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94882077986816] v25'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.828+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384002a040 con 0x7f3848085040 2024-05-08T18:50:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.828+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94882077975632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748dd7f0 con 0x7f3848085040 2024-05-08T18:50:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.828+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748df0f0 con 0x7f3848085040 2024-05-08T18:50:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.829+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94882077975632] v25'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384002a040 con 0x7f3848085040 2024-05-08T18:50:44.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.829+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384002a040 con 0x7f3848085040 2024-05-08T18:50:44.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.829+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94882077991728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748dd7f0 con 0x7f3848085040 2024-05-08T18:50:44.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.829+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748df710 con 0x7f3848085040 2024-05-08T18:50:44.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.830+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(58 notify.7 [create] v25'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384002a040 con 0x7f3848085040 2024-05-08T18:50:44.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.830+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94882077995616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748dfb70 con 0x7f3848085040 2024-05-08T18:50:44.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.830+0000 7f3858f46800 20 add_watcher() i=0 2024-05-08T18:50:44.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.830+0000 7f3858f46800 20 add_watcher() i=1 2024-05-08T18:50:44.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.830+0000 7f3858f46800 20 add_watcher() i=2 2024-05-08T18:50:44.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.830+0000 7f3858f46800 20 add_watcher() i=3 2024-05-08T18:50:44.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.830+0000 7f3858f46800 20 add_watcher() i=4 2024-05-08T18:50:44.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.830+0000 7f3858f46800 20 add_watcher() i=5 2024-05-08T18:50:44.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.830+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94882077991728] v25'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384002a040 con 0x7f3848085040 2024-05-08T18:50:44.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.830+0000 7f3858f46800 20 add_watcher() i=6 2024-05-08T18:50:44.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.831+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94882077995616] v25'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384002a040 con 0x7f3848085040 2024-05-08T18:50:44.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.831+0000 7f3858f46800 20 add_watcher() i=7 2024-05-08T18:50:44.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.831+0000 7f3858f46800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:44.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.831+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b748dec40 con 0x564b748cead0 2024-05-08T18:50:44.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.831+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.831+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94882077996672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748dec40 con 0x564b748cead0 2024-05-08T18:50:44.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.832+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94882077996672] v25'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.832+0000 7f370d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:44.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.833+0000 7f3858f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:44.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.833+0000 7f3858f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:44.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.833+0000 7f3858f46800 5 note: GC not initialized 2024-05-08T18:50:44.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.833+0000 7f3687fff640 20 reqs_thread_entry: start 2024-05-08T18:50:44.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.833+0000 7f3858f46800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:44.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.833+0000 7f3858f46800 20 Filter name: none 2024-05-08T18:50:44.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.833+0000 7f3685ffb640 20 reqs_thread_entry: start 2024-05-08T18:50:44.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.833+0000 7f3858f46800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:50:44.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.833+0000 7f3858f46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.833+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b74916150 con 0x564b748cead0 2024-05-08T18:50:44.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.833+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.833+0000 7f3858f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.833+0000 7f3858f46800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-05-08T18:50:44.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.833+0000 7f3858f46800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:44.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.833+0000 7f3858f46800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-05-08T18:50:44.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.833+0000 7f3858f46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.833+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b749148f0 con 0x564b748cead0 2024-05-08T18:50:44.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.834+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.834+0000 7f3858f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.834+0000 7f3858f46800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-05-08T18:50:44.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.834+0000 7f3858f46800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-08T18:50:44.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.834+0000 7f3858f46800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-05-08T18:50:44.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.834+0000 7f3858f46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.834+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b749148f0 con 0x7f3848085040 2024-05-08T18:50:44.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.834+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f384002a040 con 0x7f3848085040 2024-05-08T18:50:44.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.834+0000 7f3858f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.834+0000 7f3858f46800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-05-08T18:50:44.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.834+0000 7f3858f46800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-05-08T18:50:44.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.834+0000 7f3858f46800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-05-08T18:50:44.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.834+0000 7f3858f46800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-05-08T18:50:44.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.834+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b74915250 con 0x564b748cead0 2024-05-08T18:50:44.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.835+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v25'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.835+0000 7f3858f46800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:44.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.835+0000 7f3858f46800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:44.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.835+0000 7f3858f46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:50:44.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.835+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94882078215472 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b74919a80 con 0x564b748cead0 2024-05-08T18:50:44.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.835+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== watch-notify(notify (1) cookie 94882077986816 notify 107374182400 ret 0) ==== 609+0+0 (crc 0 0 0) 0x564b749155f0 con 0x564b748cead0 2024-05-08T18:50:44.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.835+0000 7f373a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182400 cookie 94882077986816 notifier 4284 bl.length()=567 2024-05-08T18:50:44.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.835+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(66 notify.4 [notify cookie 94882078215472 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.835+0000 7f373a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:44.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.835+0000 7f373a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:44.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.835+0000 7f373a7fc640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f371c003ea0 con 0x564b748cead0 2024-05-08T18:50:44.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.836+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.836+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== watch-notify(notify_complete (2) cookie 94882078215472 notify 107374182400 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564b74915d00 con 0x564b748cead0 2024-05-08T18:50:44.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.836+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b74914ce0 con 0x564b748cead0 2024-05-08T18:50:44.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.837+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v25'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.837+0000 7f3858f46800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-05-08T18:50:44.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.837+0000 7f3858f46800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-08T18:50:44.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.837+0000 7f3858f46800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-05-08T18:50:44.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.837+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94882078215344 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b74919e90 con 0x7f3850014070 2024-05-08T18:50:44.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.837+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== watch-notify(notify (1) cookie 94882077984096 notify 107374182400 ret 0) ==== 211+0+0 (crc 0 0 0) 0x7f384809e040 con 0x7f3850014070 2024-05-08T18:50:44.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.837+0000 7f373a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182400 cookie 94882077984096 notifier 4284 bl.length()=169 2024-05-08T18:50:44.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.837+0000 7f373a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-05-08T18:50:44.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.837+0000 7f373a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-08T18:50:44.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.837+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(69 notify.3 [notify cookie 94882078215344 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3848082070 con 0x7f3850014070 2024-05-08T18:50:44.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.837+0000 7f373a7fc640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f371c003ea0 con 0x7f3850014070 2024-05-08T18:50:44.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.838+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== watch-notify(notify_complete (2) cookie 94882078215344 notify 107374182400 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564b7470e7c0 con 0x7f3850014070 2024-05-08T18:50:44.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.838+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3848082070 con 0x7f3850014070 2024-05-08T18:50:44.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.838+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b74917b80 con 0x7f3848085040 2024-05-08T18:50:44.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.839+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v25'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f384002a040 con 0x7f3848085040 2024-05-08T18:50:44.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.839+0000 7f3858f46800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-05-08T18:50:44.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.839+0000 7f3858f46800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-05-08T18:50:44.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.839+0000 7f3858f46800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-05-08T18:50:44.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.839+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94882078225776 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b749190e0 con 0x7f3850014070 2024-05-08T18:50:44.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.839+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== watch-notify(notify (1) cookie 94882077984096 notify 107374182401 ret 0) ==== 219+0+0 (crc 0 0 0) 0x564b7470e7c0 con 0x7f3850014070 2024-05-08T18:50:44.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.839+0000 7f373a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182401 cookie 94882077984096 notifier 4284 bl.length()=177 2024-05-08T18:50:44.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.839+0000 7f373a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-05-08T18:50:44.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.839+0000 7f373a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-05-08T18:50:44.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.839+0000 7f373a7fc640 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f371c003ea0 con 0x7f3850014070 2024-05-08T18:50:44.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.839+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(72 notify.3 [notify cookie 94882078225776 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3848082070 con 0x7f3850014070 2024-05-08T18:50:44.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.840+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== watch-notify(notify_complete (2) cookie 94882078225776 notify 107374182401 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564b748948a0 con 0x7f3850014070 2024-05-08T18:50:44.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.840+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3848082070 con 0x7f3850014070 2024-05-08T18:50:44.850 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:50:44.835566Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:44.835553Z","tags":[],"group_ids":[]} 2024-05-08T18:50:44.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.841+0000 7f370d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:44.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.841+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94882077996672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b749169e0 con 0x564b748cead0 2024-05-08T18:50:44.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.842+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94882077996672] v25'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.842+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94882077971552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748df680 con 0x7f3850014070 2024-05-08T18:50:44.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.843+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94882077971552] v25'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3848082070 con 0x7f3850014070 2024-05-08T18:50:44.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.843+0000 7f3858f46800 20 remove_watcher() i=0 2024-05-08T18:50:44.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.843+0000 7f3858f46800 2 removed watcher, disabling cache 2024-05-08T18:50:44.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.843+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94882077977760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748d9460 con 0x564b748cead0 2024-05-08T18:50:44.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.844+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94882077977760] v25'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.844+0000 7f3858f46800 20 remove_watcher() i=1 2024-05-08T18:50:44.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.844+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94882077981760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748d9460 con 0x564b748d33e0 2024-05-08T18:50:44.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.845+0000 7f385723f640 1 -- 172.21.15.132:0/1274708622 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94882077981760] v25'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3850046070 con 0x564b748d33e0 2024-05-08T18:50:44.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.845+0000 7f3858f46800 20 remove_watcher() i=2 2024-05-08T18:50:44.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.845+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94882077984096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748dbc40 con 0x7f3850014070 2024-05-08T18:50:44.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.846+0000 7f3856a3e640 1 -- 172.21.15.132:0/1274708622 <== osd.2 v2:172.21.15.132:6808/1108348591 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94882077984096] v25'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3848082070 con 0x7f3850014070 2024-05-08T18:50:44.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.846+0000 7f3858f46800 20 remove_watcher() i=3 2024-05-08T18:50:44.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.846+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94882077986816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748d9460 con 0x564b748cead0 2024-05-08T18:50:44.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.849+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.1 v2:172.21.15.132:6800/3697320277 32 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94882077986816] v25'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384002a040 con 0x564b748cead0 2024-05-08T18:50:44.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.849+0000 7f3858f46800 20 remove_watcher() i=4 2024-05-08T18:50:44.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.849+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94882077975632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748dbc40 con 0x7f3848085040 2024-05-08T18:50:44.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.850+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94882077975632] v25'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384002a040 con 0x7f3848085040 2024-05-08T18:50:44.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.850+0000 7f3858f46800 20 remove_watcher() i=5 2024-05-08T18:50:44.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.850+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94882077991728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748dd000 con 0x7f3848085040 2024-05-08T18:50:44.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.850+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94882077991728] v25'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384002a040 con 0x7f3848085040 2024-05-08T18:50:44.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.851+0000 7f3858f46800 20 remove_watcher() i=6 2024-05-08T18:50:44.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.851+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94882077995616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b748d9460 con 0x7f3848085040 2024-05-08T18:50:44.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.851+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94882077995616] v25'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384002a040 con 0x7f3848085040 2024-05-08T18:50:44.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.851+0000 7f3858f46800 20 remove_watcher() i=7 2024-05-08T18:50:44.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f3848085040 msgr2=0x7f384808d850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f3848085040 0x7f384808d850 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564b748cead0 msgr2=0x564b748d0f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564b748cead0 0x564b748d0f90 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f3850014070 msgr2=0x7f3850036440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f3850014070 0x7f3850036440 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564b748d33e0 msgr2=0x564b748d5810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564b748d33e0 0x564b748d5810 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f372003bb50 msgr2=0x7f372003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f372003bb50 0x7f372003e010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f384808dfd0 tx=0x7f3848082000 comp rx=0 tx=0).stop 2024-05-08T18:50:44.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f384ffff640 1 -- 172.21.15.132:0/1274708622 reap_dead start 2024-05-08T18:50:44.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b748bb870 msgr2=0x564b748c2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b748bb870 0x564b748c2d70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f38500119b0 tx=0x7f3850052d20 comp rx=0 tx=0).stop 2024-05-08T18:50:44.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 shutdown_connections 2024-05-08T18:50:44.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 --2- 172.21.15.132:0/1274708622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b748bb870 0x564b748c2d70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 >> 172.21.15.132:0/1274708622 conn(0x564b748b7b80 msgr2=0x564b748b51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 shutdown_connections 2024-05-08T18:50:44.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 -- 172.21.15.132:0/1274708622 wait complete. 2024-05-08T18:50:44.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 -- 172.21.15.132:0/455982242 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f373003bba0 msgr2=0x7f373003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 --2- 172.21.15.132:0/455982242 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f373003bba0 0x7f373003e060 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x564b7470ebf0 tx=0x7f3848078f00 comp rx=0 tx=0).stop 2024-05-08T18:50:44.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 -- 172.21.15.132:0/455982242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b748ae580 msgr2=0x564b748ae9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 --2- 172.21.15.132:0/455982242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b748ae580 0x564b748ae9a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x564b7470f720 tx=0x7f3850018830 comp rx=0 tx=0).stop 2024-05-08T18:50:44.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 -- 172.21.15.132:0/455982242 shutdown_connections 2024-05-08T18:50:44.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 --2- 172.21.15.132:0/455982242 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f373003bba0 0x7f373003e060 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 --2- 172.21.15.132:0/455982242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b748ae580 0x564b748ae9a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 -- 172.21.15.132:0/455982242 >> 172.21.15.132:0/455982242 conn(0x564b748a2620 msgr2=0x564b748a2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 -- 172.21.15.132:0/455982242 shutdown_connections 2024-05-08T18:50:44.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.852+0000 7f3858f46800 1 -- 172.21.15.132:0/455982242 wait complete. 2024-05-08T18:50:44.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.853+0000 7f3858f46800 1 -- 172.21.15.132:0/3777165979 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564b7479c3e0 msgr2=0x564b7489a4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.853+0000 7f3858f46800 1 --2- 172.21.15.132:0/3777165979 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564b7479c3e0 0x564b7489a4a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.853+0000 7f3858f46800 1 -- 172.21.15.132:0/3777165979 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564b7489cb70 msgr2=0x564b7489ef60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.853+0000 7f3858f46800 1 --2- 172.21.15.132:0/3777165979 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564b7489cb70 0x564b7489ef60 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.853+0000 7f3858f46800 1 -- 172.21.15.132:0/3777165979 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f373c03bb50 msgr2=0x7f373c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.853+0000 7f3858f46800 1 --2- 172.21.15.132:0/3777165979 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f373c03bb50 0x7f373c03e010 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3840001e10 tx=0x7f3840001390 comp rx=0 tx=0).stop 2024-05-08T18:50:44.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.853+0000 7f3858f46800 1 -- 172.21.15.132:0/3777165979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b7479b180 msgr2=0x564b748940d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.853+0000 7f3858f46800 1 --2- 172.21.15.132:0/3777165979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b7479b180 0x564b748940d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f384801d050 tx=0x7f3848003020 comp rx=0 tx=0).stop 2024-05-08T18:50:44.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.853+0000 7f3858f46800 1 -- 172.21.15.132:0/3777165979 shutdown_connections 2024-05-08T18:50:44.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.853+0000 7f3858f46800 1 --2- 172.21.15.132:0/3777165979 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564b7489cb70 0x564b7489ef60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.853+0000 7f3858f46800 1 --2- 172.21.15.132:0/3777165979 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564b7479c3e0 0x564b7489a4a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.853+0000 7f3858f46800 1 --2- 172.21.15.132:0/3777165979 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f373c03bb50 0x7f373c03e010 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.853+0000 7f3858f46800 1 --2- 172.21.15.132:0/3777165979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b7479b180 0x564b748940d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.853+0000 7f3858f46800 1 -- 172.21.15.132:0/3777165979 >> 172.21.15.132:0/3777165979 conn(0x564b74796760 msgr2=0x564b74886830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.853+0000 7f3858f46800 1 -- 172.21.15.132:0/3777165979 shutdown_connections 2024-05-08T18:50:44.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.853+0000 7f3858f46800 1 -- 172.21.15.132:0/3777165979 wait complete. 2024-05-08T18:50:44.861 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:50:44.835566Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:44.835553Z', 'tags': [], 'group_ids': []} 2024-05-08T18:50:44.861 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-05-08T18:50:44.861 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-05-08T18:50:44.862 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-05-08T18:50:44.909 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:44.909 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:44.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.911+0000 7f9970840800 1 Processor -- start 2024-05-08T18:50:44.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.911+0000 7f9970840800 1 -- start start 2024-05-08T18:50:44.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.911+0000 7f9970840800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x562016c2ecf0 0x562016c310e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.911+0000 7f9970840800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562016c35130 con 0x562016c31620 2024-05-08T18:50:44.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.911+0000 7f9970840800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x562016acee20 con 0x562016c2ecf0 2024-05-08T18:50:44.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.911+0000 7f996b4d5640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x562016c2ecf0 0x562016c310e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.911+0000 7f996acd4640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x562016c31620 0x562016c33a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46710/0 (socket says 172.21.15.132:46710) 2024-05-08T18:50:44.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.911+0000 7f996b4d5640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x562016c2ecf0 0x562016c310e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59770/0 (socket says 172.21.15.132:59770) 2024-05-08T18:50:44.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.911+0000 7f996acd4640 1 -- 172.21.15.132:0/3151425638 learned_addr learned my addr 172.21.15.132:0/3151425638 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:50:44.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.911+0000 7f996b4d5640 1 -- 172.21.15.132:0/3151425638 >> v1:172.21.15.42:6789/0 conn(0x562016c31620 legacy=0x562016c33a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.911+0000 7f996b4d5640 1 -- 172.21.15.132:0/3151425638 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562016c36310 con 0x562016c2ecf0 2024-05-08T18:50:44.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.913+0000 7f996b4d5640 1 --2- 172.21.15.132:0/3151425638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016c2ecf0 0x562016c310e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f995c00a470 tx=0x7f995c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10eaf3e11ef1ae9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.913+0000 7f996a4d3640 1 -- 172.21.15.132:0/3151425638 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f995c057070 con 0x562016c2ecf0 2024-05-08T18:50:44.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.913+0000 7f996a4d3640 1 -- 172.21.15.132:0/3151425638 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995c052570 con 0x562016c2ecf0 2024-05-08T18:50:44.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.914+0000 7f996a4d3640 1 -- 172.21.15.132:0/3151425638 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f995c052870 con 0x562016c2ecf0 2024-05-08T18:50:44.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.914+0000 7f9970840800 1 -- 172.21.15.132:0/3151425638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016c2ecf0 msgr2=0x562016c310e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.914+0000 7f9970840800 1 --2- 172.21.15.132:0/3151425638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016c2ecf0 0x562016c310e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f995c00a470 tx=0x7f995c01ce90 comp rx=0 tx=0).stop 2024-05-08T18:50:44.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.914+0000 7f9970840800 1 -- 172.21.15.132:0/3151425638 shutdown_connections 2024-05-08T18:50:44.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.914+0000 7f9970840800 1 --2- 172.21.15.132:0/3151425638 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016c2ecf0 0x562016c310e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.914+0000 7f9970840800 1 -- 172.21.15.132:0/3151425638 >> 172.21.15.132:0/3151425638 conn(0x562016c28740 msgr2=0x562016c2ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.914+0000 7f9970840800 1 -- 172.21.15.132:0/3151425638 shutdown_connections 2024-05-08T18:50:44.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.914+0000 7f9970840800 1 -- 172.21.15.132:0/3151425638 wait complete. 2024-05-08T18:50:44.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.928+0000 7f9970840800 1 Processor -- start 2024-05-08T18:50:44.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.928+0000 7f9970840800 1 -- start start 2024-05-08T18:50:44.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.928+0000 7f9970840800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016c2ecf0 0x562016c2e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.928+0000 7f9970840800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562016b795d0 con 0x562016c2ecf0 2024-05-08T18:50:44.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.928+0000 7f996b4d5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016c2ecf0 0x562016c2e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.929+0000 7f996b4d5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016c2ecf0 0x562016c2e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59784/0 (socket says 172.21.15.132:59784) 2024-05-08T18:50:44.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.929+0000 7f996b4d5640 1 -- 172.21.15.132:0/1041514535 learned_addr learned my addr 172.21.15.132:0/1041514535 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.929+0000 7f996b4d5640 1 -- 172.21.15.132:0/1041514535 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562016c2cbf0 con 0x562016c2ecf0 2024-05-08T18:50:44.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.929+0000 7f996b4d5640 1 --2- 172.21.15.132:0/1041514535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016c2ecf0 0x562016c2e630 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f995c055040 tx=0x7f995c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de55810005d0b89 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.929+0000 7f985960a640 1 -- 172.21.15.132:0/1041514535 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f995c057040 con 0x562016c2ecf0 2024-05-08T18:50:44.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.929+0000 7f985960a640 1 -- 172.21.15.132:0/1041514535 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995c052990 con 0x562016c2ecf0 2024-05-08T18:50:44.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.929+0000 7f985960a640 1 -- 172.21.15.132:0/1041514535 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f995c052c70 con 0x562016c2ecf0 2024-05-08T18:50:44.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.930+0000 7f9970840800 1 -- 172.21.15.132:0/1041514535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016c2ecf0 msgr2=0x562016c2e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.930+0000 7f9970840800 1 --2- 172.21.15.132:0/1041514535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016c2ecf0 0x562016c2e630 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f995c055040 tx=0x7f995c04c000 comp rx=0 tx=0).stop 2024-05-08T18:50:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.930+0000 7f9970840800 1 -- 172.21.15.132:0/1041514535 shutdown_connections 2024-05-08T18:50:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.930+0000 7f9970840800 1 --2- 172.21.15.132:0/1041514535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016c2ecf0 0x562016c2e630 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.930+0000 7f9970840800 1 -- 172.21.15.132:0/1041514535 >> 172.21.15.132:0/1041514535 conn(0x562016c28740 msgr2=0x562016d1af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.930+0000 7f9970840800 1 -- 172.21.15.132:0/1041514535 shutdown_connections 2024-05-08T18:50:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.930+0000 7f9970840800 1 -- 172.21.15.132:0/1041514535 wait complete. 2024-05-08T18:50:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.930+0000 7f9970840800 1 Processor -- start 2024-05-08T18:50:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.930+0000 7f9970840800 1 -- start start 2024-05-08T18:50:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.931+0000 7f9970840800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016c2ecf0 0x562016d292c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.931+0000 7f9970840800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562016c355a0 con 0x562016c2ecf0 2024-05-08T18:50:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.931+0000 7f996b4d5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016c2ecf0 0x562016d292c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.931+0000 7f996b4d5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016c2ecf0 0x562016d292c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59792/0 (socket says 172.21.15.132:59792) 2024-05-08T18:50:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.931+0000 7f996b4d5640 1 -- 172.21.15.132:0/2075792112 learned_addr learned my addr 172.21.15.132:0/2075792112 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.931+0000 7f996b4d5640 1 -- 172.21.15.132:0/2075792112 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562016d29800 con 0x562016c2ecf0 2024-05-08T18:50:44.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.931+0000 7f996b4d5640 1 --2- 172.21.15.132:0/2075792112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016c2ecf0 0x562016d292c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f995c00a470 tx=0x7f995c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.931+0000 7f9857e07640 1 -- 172.21.15.132:0/2075792112 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f995c073070 con 0x562016c2ecf0 2024-05-08T18:50:44.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.931+0000 7f9857e07640 1 -- 172.21.15.132:0/2075792112 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995c05d780 con 0x562016c2ecf0 2024-05-08T18:50:44.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.931+0000 7f9857e07640 1 -- 172.21.15.132:0/2075792112 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f995c057070 con 0x562016c2ecf0 2024-05-08T18:50:44.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.931+0000 7f9970840800 1 -- 172.21.15.132:0/2075792112 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562016d29a90 con 0x562016c2ecf0 2024-05-08T18:50:44.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.932+0000 7f9970840800 1 -- 172.21.15.132:0/2075792112 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562016d2c6f0 con 0x562016c2ecf0 2024-05-08T18:50:44.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.932+0000 7f9857e07640 1 -- 172.21.15.132:0/2075792112 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f995c076070 con 0x562016c2ecf0 2024-05-08T18:50:44.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.932+0000 7f9857e07640 1 --2- 172.21.15.132:0/2075792112 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f985003bba0 0x7f985003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.933+0000 7f9857e07640 1 -- 172.21.15.132:0/2075792112 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f995c094280 con 0x562016c2ecf0 2024-05-08T18:50:44.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.933+0000 7f996acd4640 1 --2- 172.21.15.132:0/2075792112 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f985003bba0 0x7f985003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.933+0000 7f9970840800 1 --2- 172.21.15.132:0/2075792112 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562016c31620 0x562016d304b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.933+0000 7f9970840800 1 -- 172.21.15.132:0/2075792112 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562016d309f0 con 0x562016c31620 2024-05-08T18:50:44.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.933+0000 7f996bcd6640 1 --2- 172.21.15.132:0/2075792112 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562016c31620 0x562016d304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.933+0000 7f996acd4640 1 --2- 172.21.15.132:0/2075792112 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f985003bba0 0x7f985003e060 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9960000f60 tx=0x7f99600012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.933+0000 7f996bcd6640 1 --2- 172.21.15.132:0/2075792112 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562016c31620 0x562016d304b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.933+0000 7f996bcd6640 1 -- 172.21.15.132:0/2075792112 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f996400a4a0 con 0x562016c31620 2024-05-08T18:50:44.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.933+0000 7f9970840800 1 -- 172.21.15.132:0/2075792112 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562016d2da80 con 0x562016c31620 2024-05-08T18:50:44.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.934+0000 7f996bcd6640 1 -- 172.21.15.132:0/2075792112 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f996400a4a0 con 0x562016c31620 2024-05-08T18:50:44.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.934+0000 7f9970840800 1 --2- 172.21.15.132:0/2075792112 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562016d32d20 0x562016d35110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.934+0000 7f9970840800 1 -- 172.21.15.132:0/2075792112 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562016d35800 con 0x562016d32d20 2024-05-08T18:50:44.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.934+0000 7f996b4d5640 1 --2- 172.21.15.132:0/2075792112 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562016d32d20 0x562016d35110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.934+0000 7f996b4d5640 1 --2- 172.21.15.132:0/2075792112 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562016d32d20 0x562016d35110 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.934+0000 7f996b4d5640 1 -- 172.21.15.132:0/2075792112 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f995c075030 con 0x562016d32d20 2024-05-08T18:50:44.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.934+0000 7f9970840800 1 -- 172.21.15.132:0/2075792112 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562016d31bc0 con 0x562016c31620 2024-05-08T18:50:44.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.935+0000 7f996bcd6640 1 -- 172.21.15.132:0/2075792112 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f996400a4a0 con 0x562016c31620 2024-05-08T18:50:44.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.935+0000 7f9970840800 1 -- 172.21.15.132:0/2075792112 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562016d320a0 con 0x562016c31620 2024-05-08T18:50:44.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.935+0000 7f996bcd6640 1 -- 172.21.15.132:0/2075792112 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f996400a4a0 con 0x562016c31620 2024-05-08T18:50:44.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.935+0000 7f9970840800 1 Processor -- start 2024-05-08T18:50:44.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.935+0000 7f9970840800 1 -- start start 2024-05-08T18:50:44.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.935+0000 7f9970840800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016d44740 0x562016d44b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.935+0000 7f9970840800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562016b1ffc0 con 0x562016d44740 2024-05-08T18:50:44.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.936+0000 7f996bcd6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016d44740 0x562016d44b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.936+0000 7f996bcd6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016d44740 0x562016d44b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59806/0 (socket says 172.21.15.132:59806) 2024-05-08T18:50:44.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.936+0000 7f996bcd6640 1 -- 172.21.15.132:0/2761685358 learned_addr learned my addr 172.21.15.132:0/2761685358 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.936+0000 7f996bcd6640 1 -- 172.21.15.132:0/2761685358 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562016d450a0 con 0x562016d44740 2024-05-08T18:50:44.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.936+0000 7f996bcd6640 1 --2- 172.21.15.132:0/2761685358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016d44740 0x562016d44b60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x562016d30dd0 tx=0x7f9964018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.936+0000 7f9855602640 1 -- 172.21.15.132:0/2761685358 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9964014450 con 0x562016d44740 2024-05-08T18:50:44.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.937+0000 7f9855602640 1 -- 172.21.15.132:0/2761685358 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9964014610 con 0x562016d44740 2024-05-08T18:50:44.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.937+0000 7f9970840800 1 -- 172.21.15.132:0/2761685358 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562016d45b10 con 0x562016d44740 2024-05-08T18:50:44.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.937+0000 7f9855602640 1 -- 172.21.15.132:0/2761685358 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9964014930 con 0x562016d44740 2024-05-08T18:50:44.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.937+0000 7f9970840800 1 -- 172.21.15.132:0/2761685358 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562016d46010 con 0x562016d44740 2024-05-08T18:50:44.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.937+0000 7f9855602640 1 -- 172.21.15.132:0/2761685358 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9964011040 con 0x562016d44740 2024-05-08T18:50:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.938+0000 7f9855602640 1 --2- 172.21.15.132:0/2761685358 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f984403bba0 0x7f984403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.938+0000 7f9855602640 1 -- 172.21.15.132:0/2761685358 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f996401e070 con 0x562016d44740 2024-05-08T18:50:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.938+0000 7f996b4d5640 1 --2- 172.21.15.132:0/2761685358 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f984403bba0 0x7f984403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.938+0000 7f9970840800 1 Processor -- start 2024-05-08T18:50:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.938+0000 7f9970840800 1 -- start start 2024-05-08T18:50:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.938+0000 7f996b4d5640 1 --2- 172.21.15.132:0/2761685358 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f984403bba0 0x7f984403e060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x562016d30e70 tx=0x7f995c0926f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.938+0000 7f9970840800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016d519c0 0x562016d51de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.938+0000 7f9970840800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562016c2ceb0 con 0x562016d519c0 2024-05-08T18:50:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.938+0000 7f996bcd6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016d519c0 0x562016d51de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.938+0000 7f996bcd6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016d519c0 0x562016d51de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59820/0 (socket says 172.21.15.132:59820) 2024-05-08T18:50:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.938+0000 7f996bcd6640 1 -- 172.21.15.132:0/904599876 learned_addr learned my addr 172.21.15.132:0/904599876 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.939+0000 7f996bcd6640 1 -- 172.21.15.132:0/904599876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562016d523b0 con 0x562016d519c0 2024-05-08T18:50:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.939+0000 7f996bcd6640 1 --2- 172.21.15.132:0/904599876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016d519c0 0x562016d51de0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9964052c80 tx=0x7f9964016570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f443d2cbd07d1fa9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.939+0000 7f984effd640 1 -- 172.21.15.132:0/904599876 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9964028070 con 0x562016d519c0 2024-05-08T18:50:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.939+0000 7f984effd640 1 -- 172.21.15.132:0/904599876 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9964054550 con 0x562016d519c0 2024-05-08T18:50:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.939+0000 7f984effd640 1 -- 172.21.15.132:0/904599876 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9964016930 con 0x562016d519c0 2024-05-08T18:50:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.939+0000 7f9970840800 1 -- 172.21.15.132:0/904599876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016d519c0 msgr2=0x562016d51de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.939+0000 7f9970840800 1 --2- 172.21.15.132:0/904599876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016d519c0 0x562016d51de0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9964052c80 tx=0x7f9964016570 comp rx=0 tx=0).stop 2024-05-08T18:50:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.939+0000 7f9970840800 1 -- 172.21.15.132:0/904599876 shutdown_connections 2024-05-08T18:50:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.939+0000 7f9970840800 1 --2- 172.21.15.132:0/904599876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016d519c0 0x562016d51de0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.939+0000 7f9970840800 1 -- 172.21.15.132:0/904599876 >> 172.21.15.132:0/904599876 conn(0x562016d4dd20 msgr2=0x562016d4bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.939+0000 7f9970840800 1 -- 172.21.15.132:0/904599876 shutdown_connections 2024-05-08T18:50:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.939+0000 7f9970840800 1 -- 172.21.15.132:0/904599876 wait complete. 2024-05-08T18:50:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.940+0000 7f9970840800 1 Processor -- start 2024-05-08T18:50:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.940+0000 7f9970840800 1 -- start start 2024-05-08T18:50:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.940+0000 7f9970840800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016d519c0 0x562016d59000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.940+0000 7f9970840800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562016d52b20 con 0x562016d519c0 2024-05-08T18:50:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.940+0000 7f996bcd6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016d519c0 0x562016d59000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.940+0000 7f996bcd6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016d519c0 0x562016d59000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59824/0 (socket says 172.21.15.132:59824) 2024-05-08T18:50:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.940+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 learned_addr learned my addr 172.21.15.132:0/366232240 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.940+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562016d59540 con 0x562016d519c0 2024-05-08T18:50:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.941+0000 7f996bcd6640 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016d519c0 0x562016d59000 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9964001700 tx=0x7f9964052c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.941+0000 7f984d7fa640 1 -- 172.21.15.132:0/366232240 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f996402b350 con 0x562016d519c0 2024-05-08T18:50:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.941+0000 7f984d7fa640 1 -- 172.21.15.132:0/366232240 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9964031070 con 0x562016d519c0 2024-05-08T18:50:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.941+0000 7f984d7fa640 1 -- 172.21.15.132:0/366232240 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9964014ad0 con 0x562016d519c0 2024-05-08T18:50:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.941+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562016d597d0 con 0x562016d519c0 2024-05-08T18:50:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.941+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562016d5c480 con 0x562016d519c0 2024-05-08T18:50:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.942+0000 7f984d7fa640 1 -- 172.21.15.132:0/366232240 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9964001770 con 0x562016d519c0 2024-05-08T18:50:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.942+0000 7f984d7fa640 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f983403bba0 0x7f983403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.942+0000 7f984d7fa640 1 -- 172.21.15.132:0/366232240 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f996400e040 con 0x562016d519c0 2024-05-08T18:50:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.942+0000 7f996b4d5640 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f983403bba0 0x7f983403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.942+0000 7f996b4d5640 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f983403bba0 0x7f983403e060 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f995c05b730 tx=0x7f995c082000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.942+0000 7f9970840800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.942+0000 7f9970840800 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562016d64a90 0x562016d66f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.942+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562016d676a0 con 0x562016d64a90 2024-05-08T18:50:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.943+0000 7f996acd4640 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562016d64a90 0x562016d66f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.943+0000 7f996acd4640 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562016d64a90 0x562016d66f50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.943+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9960009050 con 0x562016d64a90 2024-05-08T18:50:44.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.943+0000 7f9970840800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.943+0000 7f9970840800 20 realm 2024-05-08T18:50:44.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.943+0000 7f9970840800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.943+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562016d63ee0 con 0x562016d64a90 2024-05-08T18:50:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.943+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9960009050 con 0x562016d64a90 2024-05-08T18:50:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.943+0000 7f9970840800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.943+0000 7f9970840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.943+0000 7f9970840800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.943+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562016d68190 con 0x562016d64a90 2024-05-08T18:50:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.944+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9960009050 con 0x562016d64a90 2024-05-08T18:50:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.944+0000 7f9970840800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.944+0000 7f9970840800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.944+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562016d68a60 con 0x562016d64a90 2024-05-08T18:50:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.944+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9960009050 con 0x562016d64a90 2024-05-08T18:50:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.944+0000 7f9970840800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.944+0000 7f9970840800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.944+0000 7f9970840800 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562016d693a0 0x562016d6b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.944+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562016d6bf20 con 0x562016d693a0 2024-05-08T18:50:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.944+0000 7f996bcd6640 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562016d693a0 0x562016d6b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.944+0000 7f996bcd6640 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562016d693a0 0x562016d6b790 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.944+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f996403d070 con 0x562016d693a0 2024-05-08T18:50:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.944+0000 7f9970840800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.944+0000 7f9970840800 20 searching for the correct realm 2024-05-08T18:50:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.944+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x562016d693a0 2024-05-08T18:50:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.945+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f996403d070 con 0x562016d693a0 2024-05-08T18:50:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.945+0000 7f996bcd6640 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9964014070 0x7f99640389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.945+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x7f9964014070 2024-05-08T18:50:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.945+0000 7f996b4d5640 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9964014070 0x7f99640389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.945+0000 7f996b4d5640 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9964014070 0x7f99640389c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.946+0000 7f996b4d5640 1 -- 172.21.15.132:0/366232240 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995c075030 con 0x7f9964014070 2024-05-08T18:50:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.946+0000 7f996b4d5640 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f995c078060 0x7f995c076580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.946+0000 7f996b4d5640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x7f995c078060 2024-05-08T18:50:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.946+0000 7f996acd4640 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f995c078060 0x7f995c076580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.946+0000 7f996acd4640 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f995c078060 0x7f995c076580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.947+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9960009050 con 0x7f995c078060 2024-05-08T18:50:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.947+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x562016d64a90 2024-05-08T18:50:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.947+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9960009050 con 0x562016d64a90 2024-05-08T18:50:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.947+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x562016d64a90 2024-05-08T18:50:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.947+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9960029040 con 0x562016d64a90 2024-05-08T18:50:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.947+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x7f995c078060 2024-05-08T18:50:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.947+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9960029040 con 0x7f995c078060 2024-05-08T18:50:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.947+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x7f995c078060 2024-05-08T18:50:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.948+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9960029040 con 0x7f995c078060 2024-05-08T18:50:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.948+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x7f9964014070 2024-05-08T18:50:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.948+0000 7f996b4d5640 1 -- 172.21.15.132:0/366232240 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995c075030 con 0x7f9964014070 2024-05-08T18:50:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.948+0000 7f996b4d5640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x562016d693a0 2024-05-08T18:50:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.948+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f996403d070 con 0x562016d693a0 2024-05-08T18:50:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.948+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x562016d64a90 2024-05-08T18:50:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.948+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9960029040 con 0x562016d64a90 2024-05-08T18:50:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.948+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x7f995c078060 2024-05-08T18:50:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.949+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9960029040 con 0x7f995c078060 2024-05-08T18:50:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.949+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x562016d64a90 2024-05-08T18:50:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.949+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9960029040 con 0x562016d64a90 2024-05-08T18:50:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.949+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x7f9964014070 2024-05-08T18:50:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.949+0000 7f996b4d5640 1 -- 172.21.15.132:0/366232240 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f995c075030 con 0x7f9964014070 2024-05-08T18:50:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.949+0000 7f996b4d5640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x562016d693a0 2024-05-08T18:50:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.949+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f996403d070 con 0x562016d693a0 2024-05-08T18:50:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.949+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x562016d693a0 2024-05-08T18:50:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.950+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f996403d070 con 0x562016d693a0 2024-05-08T18:50:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.950+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x7f995c078060 2024-05-08T18:50:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.950+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9960029040 con 0x7f995c078060 2024-05-08T18:50:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.950+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x562016d693a0 2024-05-08T18:50:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.950+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f996403d070 con 0x562016d693a0 2024-05-08T18:50:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.950+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x562016d693a0 2024-05-08T18:50:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.950+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f996403d070 con 0x562016d693a0 2024-05-08T18:50:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.950+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x562016d64a90 2024-05-08T18:50:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.950+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9960029040 con 0x562016d64a90 2024-05-08T18:50:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.950+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x562016d64a90 2024-05-08T18:50:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.951+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9960029040 con 0x562016d64a90 2024-05-08T18:50:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.951+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x7f995c078060 2024-05-08T18:50:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.951+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9960029040 con 0x7f995c078060 2024-05-08T18:50:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.951+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x562016d693a0 2024-05-08T18:50:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.951+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f996403d070 con 0x562016d693a0 2024-05-08T18:50:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.951+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x7f9964014070 2024-05-08T18:50:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.951+0000 7f996b4d5640 1 -- 172.21.15.132:0/366232240 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995c075030 con 0x7f9964014070 2024-05-08T18:50:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.951+0000 7f996b4d5640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x562016d64a90 2024-05-08T18:50:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.952+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9960029040 con 0x562016d64a90 2024-05-08T18:50:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.952+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x7f995c078060 2024-05-08T18:50:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.952+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9960029040 con 0x7f995c078060 2024-05-08T18:50:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.952+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x562016d693a0 2024-05-08T18:50:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.952+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f996403d070 con 0x562016d693a0 2024-05-08T18:50:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.952+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x7f995c078060 2024-05-08T18:50:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.953+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9960029040 con 0x7f995c078060 2024-05-08T18:50:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.953+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x7f9964014070 2024-05-08T18:50:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.953+0000 7f996b4d5640 1 -- 172.21.15.132:0/366232240 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995c075030 con 0x7f9964014070 2024-05-08T18:50:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.953+0000 7f996b4d5640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x562016d693a0 2024-05-08T18:50:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.953+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f996403d070 con 0x562016d693a0 2024-05-08T18:50:44.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.953+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d850 con 0x7f995c078060 2024-05-08T18:50:44.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.954+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9960029040 con 0x7f995c078060 2024-05-08T18:50:44.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.954+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f996003a040 con 0x562016d64a90 2024-05-08T18:50:44.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.954+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9960029040 con 0x562016d64a90 2024-05-08T18:50:44.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.954+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f996003a040 con 0x7f9964014070 2024-05-08T18:50:44.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.954+0000 7f996b4d5640 1 -- 172.21.15.132:0/366232240 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f995c075030 con 0x7f9964014070 2024-05-08T18:50:44.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.954+0000 7f9970840800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:44.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.954+0000 7f9970840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:44.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.954+0000 7f9970840800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:44.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.954+0000 7f9970840800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:44.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.954+0000 7f9970840800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:44.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.954+0000 7f9970840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:44.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.954+0000 7f9970840800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.954+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562016d6c8e0 con 0x562016d64a90 2024-05-08T18:50:44.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.954+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9960029040 con 0x562016d64a90 2024-05-08T18:50:44.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.954+0000 7f9970840800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.954+0000 7f9970840800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.954+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562016d6d180 con 0x562016d64a90 2024-05-08T18:50:44.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.955+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9960029040 con 0x562016d64a90 2024-05-08T18:50:44.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.955+0000 7f9970840800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:44.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.955+0000 7f9970840800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.955+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562016d6dcd0 con 0x562016d64a90 2024-05-08T18:50:44.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.955+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9960029040 con 0x562016d64a90 2024-05-08T18:50:44.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.955+0000 7f9970840800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:44.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.955+0000 7f9970840800 20 zone default found 2024-05-08T18:50:44.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.955+0000 7f9970840800 4 Realm: () 2024-05-08T18:50:44.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.955+0000 7f9970840800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:44.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.955+0000 7f9970840800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.955+0000 7f9970840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.955+0000 7f9970840800 20 zonegroup default 2024-05-08T18:50:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.955+0000 7f9970840800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.955+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562016d6dd30 con 0x7f995c078060 2024-05-08T18:50:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.955+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9960029040 con 0x7f995c078060 2024-05-08T18:50:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.955+0000 7f9970840800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.955+0000 7f9970840800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.955+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562016d6fb50 con 0x562016d693a0 2024-05-08T18:50:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.956+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f996403d070 con 0x562016d693a0 2024-05-08T18:50:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.956+0000 7f9970840800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.956+0000 7f9970840800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.956+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562016d6ff40 con 0x562016d693a0 2024-05-08T18:50:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.956+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f996403d070 con 0x562016d693a0 2024-05-08T18:50:44.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.956+0000 7f9970840800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.956+0000 7f9970840800 20 started sync module instance, tier type = 2024-05-08T18:50:44.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.956+0000 7f9970840800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:44.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.956+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d6eff0 con 0x7f9964014070 2024-05-08T18:50:44.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.957+0000 7f996b4d5640 1 -- 172.21.15.132:0/366232240 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995c075030 con 0x7f9964014070 2024-05-08T18:50:44.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.957+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94695822125888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d703d0 con 0x7f9964014070 2024-05-08T18:50:44.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.957+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d70c20 con 0x562016d64a90 2024-05-08T18:50:44.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.958+0000 7f996b4d5640 1 -- 172.21.15.132:0/366232240 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94695822125888] v25'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995c075030 con 0x7f9964014070 2024-05-08T18:50:44.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.958+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9960029040 con 0x562016d64a90 2024-05-08T18:50:44.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.958+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94695822128096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d70d40 con 0x562016d64a90 2024-05-08T18:50:44.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.958+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d71830 con 0x562016d693a0 2024-05-08T18:50:44.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.961+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f996403d070 con 0x562016d693a0 2024-05-08T18:50:44.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.961+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94695822136064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d71830 con 0x562016d693a0 2024-05-08T18:50:44.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.961+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d72850 con 0x7f9964014070 2024-05-08T18:50:44.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.961+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94695822128096] v25'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9960029040 con 0x562016d64a90 2024-05-08T18:50:44.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.963+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94695822136064] v25'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f996403d070 con 0x562016d693a0 2024-05-08T18:50:44.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.964+0000 7f996b4d5640 1 -- 172.21.15.132:0/366232240 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995c075030 con 0x7f9964014070 2024-05-08T18:50:44.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.964+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94695822138448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d707b0 con 0x7f9964014070 2024-05-08T18:50:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.964+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d73260 con 0x562016d64a90 2024-05-08T18:50:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.967+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9960029040 con 0x562016d64a90 2024-05-08T18:50:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.967+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94695822143168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d73950 con 0x562016d64a90 2024-05-08T18:50:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.967+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d74470 con 0x7f995c078060 2024-05-08T18:50:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.967+0000 7f996b4d5640 1 -- 172.21.15.132:0/366232240 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94695822138448] v25'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995c075030 con 0x7f9964014070 2024-05-08T18:50:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.968+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9960029040 con 0x7f995c078060 2024-05-08T18:50:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.968+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94695822143168] v25'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9960029040 con 0x562016d64a90 2024-05-08T18:50:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.968+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94695822147392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d74430 con 0x7f995c078060 2024-05-08T18:50:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.968+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d73400 con 0x7f995c078060 2024-05-08T18:50:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.969+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94695822147392] v25'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9960029040 con 0x7f995c078060 2024-05-08T18:50:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.969+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9960029040 con 0x7f995c078060 2024-05-08T18:50:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.969+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94695822144512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d74a00 con 0x7f995c078060 2024-05-08T18:50:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.969+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d753c0 con 0x7f995c078060 2024-05-08T18:50:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.970+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94695822144512] v25'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9960029040 con 0x7f995c078060 2024-05-08T18:50:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.970+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9960029040 con 0x7f995c078060 2024-05-08T18:50:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.970+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94695822140192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d753c0 con 0x7f995c078060 2024-05-08T18:50:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.970+0000 7f9970840800 20 add_watcher() i=0 2024-05-08T18:50:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.970+0000 7f9970840800 20 add_watcher() i=1 2024-05-08T18:50:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.970+0000 7f9970840800 20 add_watcher() i=2 2024-05-08T18:50:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.970+0000 7f9970840800 20 add_watcher() i=3 2024-05-08T18:50:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.970+0000 7f9970840800 20 add_watcher() i=4 2024-05-08T18:50:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.970+0000 7f9970840800 20 add_watcher() i=5 2024-05-08T18:50:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.970+0000 7f9970840800 20 add_watcher() i=6 2024-05-08T18:50:44.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.971+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94695822140192] v25'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9960029040 con 0x7f995c078060 2024-05-08T18:50:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.971+0000 7f9970840800 20 add_watcher() i=7 2024-05-08T18:50:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.971+0000 7f9970840800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.971+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562016d787b0 con 0x562016d64a90 2024-05-08T18:50:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.971+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9960029040 con 0x562016d64a90 2024-05-08T18:50:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.971+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94695822164256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d75530 con 0x562016d64a90 2024-05-08T18:50:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.972+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94695822164256] v25'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9960029040 con 0x562016d64a90 2024-05-08T18:50:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.972+0000 7f9821fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.972+0000 7f9970840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.972+0000 7f9970840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.973+0000 7f9970840800 5 note: GC not initialized 2024-05-08T18:50:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.973+0000 7f9820fe1640 20 reqs_thread_entry: start 2024-05-08T18:50:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.973+0000 7f9970840800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.973+0000 7f9970840800 20 Filter name: none 2024-05-08T18:50:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.973+0000 7f979a7fc640 20 reqs_thread_entry: start 2024-05-08T18:50:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.973+0000 7f9970840800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:50:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.973+0000 7f9970840800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.973+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562016dabbf0 con 0x7f995c078060 2024-05-08T18:50:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.973+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f9960029040 con 0x7f995c078060 2024-05-08T18:50:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.973+0000 7f9970840800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.973+0000 7f9970840800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-08T18:50:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.973+0000 7f9970840800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:50:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.973+0000 7f9970840800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-05-08T18:50:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.973+0000 7f9970840800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.974+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562016daa3b0 con 0x562016d64a90 2024-05-08T18:50:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.974+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f9960029040 con 0x562016d64a90 2024-05-08T18:50:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.974+0000 7f9970840800 20 rados_obj.operate() r=0 bl.length=7 2024-05-08T18:50:44.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.974+0000 7f9970840800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-05-08T18:50:44.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.974+0000 7f9970840800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-08T18:50:44.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.974+0000 7f9970840800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:50:44.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.974+0000 7f9970840800 20 rados->read ofs=0 len=0 2024-05-08T18:50:44.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.974+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562016daa7a0 con 0x562016d64a90 2024-05-08T18:50:44.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.974+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9960043040 con 0x562016d64a90 2024-05-08T18:50:44.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.974+0000 7f9970840800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:44.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.974+0000 7f9970840800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:50:44.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.974+0000 7f9970840800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:44.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.974+0000 7f9970840800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:44.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.974+0000 7f9970840800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-05-08T18:50:44.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.974+0000 7f9970840800 20 get_user_info_from_index found 0 xattrs 2024-05-08T18:50:44.978 INFO:teuthology.orchestra.run.smithi132.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-05-08T18:50:44.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.975+0000 7f9821fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:44.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.975+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94695822164256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d77760 con 0x562016d64a90 2024-05-08T18:50:44.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.976+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94695822164256] v25'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9960043040 con 0x562016d64a90 2024-05-08T18:50:44.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.976+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94695822125888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d78120 con 0x7f9964014070 2024-05-08T18:50:44.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.977+0000 7f996b4d5640 1 -- 172.21.15.132:0/366232240 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94695822125888] v25'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995c075030 con 0x7f9964014070 2024-05-08T18:50:44.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.977+0000 7f9970840800 20 remove_watcher() i=0 2024-05-08T18:50:44.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.977+0000 7f9970840800 2 removed watcher, disabling cache 2024-05-08T18:50:44.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.977+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94695822128096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d6eb40 con 0x562016d64a90 2024-05-08T18:50:44.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.978+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94695822128096] v25'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9960043040 con 0x562016d64a90 2024-05-08T18:50:44.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.978+0000 7f9970840800 20 remove_watcher() i=1 2024-05-08T18:50:44.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.978+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94695822136064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d6eb40 con 0x562016d693a0 2024-05-08T18:50:44.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.980+0000 7f996bcd6640 1 -- 172.21.15.132:0/366232240 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94695822136064] v25'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f996403d070 con 0x562016d693a0 2024-05-08T18:50:44.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.980+0000 7f9970840800 20 remove_watcher() i=2 2024-05-08T18:50:44.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.980+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94695822138448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d6eb40 con 0x7f9964014070 2024-05-08T18:50:44.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.981+0000 7f996b4d5640 1 -- 172.21.15.132:0/366232240 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94695822138448] v25'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f995c075030 con 0x7f9964014070 2024-05-08T18:50:44.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.981+0000 7f9970840800 20 remove_watcher() i=3 2024-05-08T18:50:44.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.981+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94695822143168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d6eb40 con 0x562016d64a90 2024-05-08T18:50:44.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.982+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94695822143168] v25'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9960043040 con 0x562016d64a90 2024-05-08T18:50:44.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.982+0000 7f9970840800 20 remove_watcher() i=4 2024-05-08T18:50:44.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.982+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94695822147392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d72ec0 con 0x7f995c078060 2024-05-08T18:50:44.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.983+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94695822147392] v25'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9960043040 con 0x7f995c078060 2024-05-08T18:50:44.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.983+0000 7f9970840800 20 remove_watcher() i=5 2024-05-08T18:50:44.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.983+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94695822144512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d6eb40 con 0x7f995c078060 2024-05-08T18:50:44.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.984+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94695822144512] v25'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9960043040 con 0x7f995c078060 2024-05-08T18:50:44.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.984+0000 7f9970840800 20 remove_watcher() i=6 2024-05-08T18:50:44.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.984+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94695822140192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562016d73f40 con 0x7f995c078060 2024-05-08T18:50:44.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.985+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94695822140192] v25'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9960043040 con 0x7f995c078060 2024-05-08T18:50:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.985+0000 7f9970840800 20 remove_watcher() i=7 2024-05-08T18:50:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.985+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f995c078060 msgr2=0x7f995c076580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.985+0000 7f9970840800 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f995c078060 0x7f995c076580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.985+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562016d64a90 msgr2=0x562016d66f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.985+0000 7f9970840800 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562016d64a90 0x562016d66f50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.985+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9964014070 msgr2=0x7f99640389c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.985+0000 7f9970840800 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9964014070 0x7f99640389c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.985+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562016d693a0 msgr2=0x562016d6b790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.985+0000 7f9970840800 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562016d693a0 0x562016d6b790 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.985+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f983403bba0 msgr2=0x7f983403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.985+0000 7f9970840800 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f983403bba0 0x7f983403e060 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f995c05b730 tx=0x7f995c082000 comp rx=0 tx=0).stop 2024-05-08T18:50:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.985+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016d519c0 msgr2=0x562016d59000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.985+0000 7f996acd4640 1 -- 172.21.15.132:0/366232240 reap_dead start 2024-05-08T18:50:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.985+0000 7f9970840800 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016d519c0 0x562016d59000 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9964001700 tx=0x7f9964052c10 comp rx=0 tx=0).stop 2024-05-08T18:50:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.985+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 shutdown_connections 2024-05-08T18:50:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.985+0000 7f9970840800 1 --2- 172.21.15.132:0/366232240 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016d519c0 0x562016d59000 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.985+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 >> 172.21.15.132:0/366232240 conn(0x562016d4dd20 msgr2=0x562016d4b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.985+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 shutdown_connections 2024-05-08T18:50:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.985+0000 7f9970840800 1 -- 172.21.15.132:0/366232240 wait complete. 2024-05-08T18:50:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 -- 172.21.15.132:0/2761685358 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f984403bba0 msgr2=0x7f984403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 --2- 172.21.15.132:0/2761685358 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f984403bba0 0x7f984403e060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x562016d30e70 tx=0x7f995c0926f0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 -- 172.21.15.132:0/2761685358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016d44740 msgr2=0x562016d44b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 --2- 172.21.15.132:0/2761685358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016d44740 0x562016d44b60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x562016d30dd0 tx=0x7f9964018830 comp rx=0 tx=0).stop 2024-05-08T18:50:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 -- 172.21.15.132:0/2761685358 shutdown_connections 2024-05-08T18:50:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 --2- 172.21.15.132:0/2761685358 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f984403bba0 0x7f984403e060 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 --2- 172.21.15.132:0/2761685358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016d44740 0x562016d44b60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 -- 172.21.15.132:0/2761685358 >> 172.21.15.132:0/2761685358 conn(0x562016d387e0 msgr2=0x562016d38be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 -- 172.21.15.132:0/2761685358 shutdown_connections 2024-05-08T18:50:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 -- 172.21.15.132:0/2761685358 wait complete. 2024-05-08T18:50:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 -- 172.21.15.132:0/2075792112 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562016c31620 msgr2=0x562016d304b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 --2- 172.21.15.132:0/2075792112 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562016c31620 0x562016d304b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 -- 172.21.15.132:0/2075792112 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562016d32d20 msgr2=0x562016d35110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 --2- 172.21.15.132:0/2075792112 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562016d32d20 0x562016d35110 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 -- 172.21.15.132:0/2075792112 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f985003bba0 msgr2=0x7f985003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 --2- 172.21.15.132:0/2075792112 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f985003bba0 0x7f985003e060 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9960000f60 tx=0x7f99600012b0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 -- 172.21.15.132:0/2075792112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016c2ecf0 msgr2=0x562016d292c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 --2- 172.21.15.132:0/2075792112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016c2ecf0 0x562016d292c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f995c00a470 tx=0x7f995c003020 comp rx=0 tx=0).stop 2024-05-08T18:50:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 -- 172.21.15.132:0/2075792112 shutdown_connections 2024-05-08T18:50:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 --2- 172.21.15.132:0/2075792112 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562016d32d20 0x562016d35110 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 --2- 172.21.15.132:0/2075792112 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562016c31620 0x562016d304b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 --2- 172.21.15.132:0/2075792112 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f985003bba0 0x7f985003e060 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 --2- 172.21.15.132:0/2075792112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562016c2ecf0 0x562016d292c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:44.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 -- 172.21.15.132:0/2075792112 >> 172.21.15.132:0/2075792112 conn(0x562016c28740 msgr2=0x562016c2d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:44.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 -- 172.21.15.132:0/2075792112 shutdown_connections 2024-05-08T18:50:44.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:44.986+0000 7f9970840800 1 -- 172.21.15.132:0/2075792112 wait complete. 2024-05-08T18:50:44.994 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-05-08T18:50:44.994 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:50:44.994 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:50:44.995 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:50:45.038 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:45.039 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:45.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.040+0000 7fc1b3616800 1 Processor -- start 2024-05-08T18:50:45.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.040+0000 7fc1b3616800 1 -- start start 2024-05-08T18:50:45.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.040+0000 7fc1b3616800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x561f8934f710 0x561f8934fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.040+0000 7fc1b3616800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561f89350d40 con 0x561f89350070 2024-05-08T18:50:45.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.040+0000 7fc1b3616800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x561f891f0e20 con 0x561f8934f710 2024-05-08T18:50:45.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.040+0000 7fc1aec7d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x561f8934f710 0x561f8934fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.040+0000 7fc1a7fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x561f89350070 0x561f893504f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46716/0 (socket says 172.21.15.132:46716) 2024-05-08T18:50:45.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.040+0000 7fc1aec7d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x561f8934f710 0x561f8934fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59836/0 (socket says 172.21.15.132:59836) 2024-05-08T18:50:45.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.040+0000 7fc1a7fff640 1 -- 172.21.15.132:0/2873937612 learned_addr learned my addr 172.21.15.132:0/2873937612 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:50:45.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.041+0000 7fc1aec7d640 1 -- 172.21.15.132:0/2873937612 >> v1:172.21.15.42:6789/0 conn(0x561f89350070 legacy=0x561f893504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.041+0000 7fc1aec7d640 1 -- 172.21.15.132:0/2873937612 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f89350f60 con 0x561f8934f710 2024-05-08T18:50:45.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.043+0000 7fc1aec7d640 1 --2- 172.21.15.132:0/2873937612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8934f710 0x561f8934fb30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000a470 tx=0x7fc1a001ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a6dbae1aa95762 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.043+0000 7fc1ae47c640 1 -- 172.21.15.132:0/2873937612 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a0057070 con 0x561f8934f710 2024-05-08T18:50:45.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.043+0000 7fc1ae47c640 1 -- 172.21.15.132:0/2873937612 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a0052570 con 0x561f8934f710 2024-05-08T18:50:45.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.043+0000 7fc1ae47c640 1 -- 172.21.15.132:0/2873937612 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a0052870 con 0x561f8934f710 2024-05-08T18:50:45.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.043+0000 7fc1b3616800 1 -- 172.21.15.132:0/2873937612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8934f710 msgr2=0x561f8934fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.043+0000 7fc1b3616800 1 --2- 172.21.15.132:0/2873937612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8934f710 0x561f8934fb30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000a470 tx=0x7fc1a001ce00 comp rx=0 tx=0).stop 2024-05-08T18:50:45.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.043+0000 7fc1b3616800 1 -- 172.21.15.132:0/2873937612 shutdown_connections 2024-05-08T18:50:45.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.043+0000 7fc1b3616800 1 --2- 172.21.15.132:0/2873937612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8934f710 0x561f8934fb30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.043+0000 7fc1b3616800 1 -- 172.21.15.132:0/2873937612 >> 172.21.15.132:0/2873937612 conn(0x561f89349ea0 msgr2=0x561f8934c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.043+0000 7fc1b3616800 1 -- 172.21.15.132:0/2873937612 shutdown_connections 2024-05-08T18:50:45.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.043+0000 7fc1b3616800 1 -- 172.21.15.132:0/2873937612 wait complete. 2024-05-08T18:50:45.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.057+0000 7fc1b3616800 1 Processor -- start 2024-05-08T18:50:45.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.057+0000 7fc1b3616800 1 -- start start 2024-05-08T18:50:45.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.057+0000 7fc1b3616800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8934f710 0x561f8943f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.057+0000 7fc1b3616800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561f8929b5b0 con 0x561f8934f710 2024-05-08T18:50:45.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.058+0000 7fc1aec7d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8934f710 0x561f8943f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.058+0000 7fc1aec7d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8934f710 0x561f8943f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59846/0 (socket says 172.21.15.132:59846) 2024-05-08T18:50:45.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.058+0000 7fc1aec7d640 1 -- 172.21.15.132:0/2183708316 learned_addr learned my addr 172.21.15.132:0/2183708316 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.058+0000 7fc1aec7d640 1 -- 172.21.15.132:0/2183708316 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f8943fca0 con 0x561f8934f710 2024-05-08T18:50:45.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.058+0000 7fc1aec7d640 1 --2- 172.21.15.132:0/2183708316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8934f710 0x561f8943f6d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0055040 tx=0x7fc1a004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37391946ae715f78 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.058+0000 7fc09ce09640 1 -- 172.21.15.132:0/2183708316 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a0057040 con 0x561f8934f710 2024-05-08T18:50:45.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.058+0000 7fc09ce09640 1 -- 172.21.15.132:0/2183708316 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a0052990 con 0x561f8934f710 2024-05-08T18:50:45.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.058+0000 7fc09ce09640 1 -- 172.21.15.132:0/2183708316 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a0052c70 con 0x561f8934f710 2024-05-08T18:50:45.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.059+0000 7fc1b3616800 1 -- 172.21.15.132:0/2183708316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8934f710 msgr2=0x561f8943f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.059+0000 7fc1b3616800 1 --2- 172.21.15.132:0/2183708316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8934f710 0x561f8943f6d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0055040 tx=0x7fc1a004c000 comp rx=0 tx=0).stop 2024-05-08T18:50:45.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.059+0000 7fc1b3616800 1 -- 172.21.15.132:0/2183708316 shutdown_connections 2024-05-08T18:50:45.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.059+0000 7fc1b3616800 1 --2- 172.21.15.132:0/2183708316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8934f710 0x561f8943f6d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.059+0000 7fc1b3616800 1 -- 172.21.15.132:0/2183708316 >> 172.21.15.132:0/2183708316 conn(0x561f89349ea0 msgr2=0x561f8943aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.059+0000 7fc1b3616800 1 -- 172.21.15.132:0/2183708316 shutdown_connections 2024-05-08T18:50:45.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.059+0000 7fc1b3616800 1 -- 172.21.15.132:0/2183708316 wait complete. 2024-05-08T18:50:45.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.059+0000 7fc1b3616800 1 Processor -- start 2024-05-08T18:50:45.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.059+0000 7fc1b3616800 1 -- start start 2024-05-08T18:50:45.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.059+0000 7fc1b3616800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8934f710 0x561f89447180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.060+0000 7fc1b3616800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561f8934e5d0 con 0x561f8934f710 2024-05-08T18:50:45.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.060+0000 7fc1aec7d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8934f710 0x561f89447180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.060+0000 7fc1aec7d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8934f710 0x561f89447180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59852/0 (socket says 172.21.15.132:59852) 2024-05-08T18:50:45.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.060+0000 7fc1aec7d640 1 -- 172.21.15.132:0/3058741426 learned_addr learned my addr 172.21.15.132:0/3058741426 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.060+0000 7fc1aec7d640 1 -- 172.21.15.132:0/3058741426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f894476c0 con 0x561f8934f710 2024-05-08T18:50:45.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.060+0000 7fc1aec7d640 1 --2- 172.21.15.132:0/3058741426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8934f710 0x561f89447180 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000a470 tx=0x7fc1a0003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.060+0000 7fc09b606640 1 -- 172.21.15.132:0/3058741426 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a0073070 con 0x561f8934f710 2024-05-08T18:50:45.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.060+0000 7fc09b606640 1 -- 172.21.15.132:0/3058741426 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a005d440 con 0x561f8934f710 2024-05-08T18:50:45.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.060+0000 7fc1b3616800 1 -- 172.21.15.132:0/3058741426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f89447950 con 0x561f8934f710 2024-05-08T18:50:45.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.060+0000 7fc09b606640 1 -- 172.21.15.132:0/3058741426 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a0057070 con 0x561f8934f710 2024-05-08T18:50:45.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.060+0000 7fc1b3616800 1 -- 172.21.15.132:0/3058741426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f8944a600 con 0x561f8934f710 2024-05-08T18:50:45.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.061+0000 7fc09b606640 1 -- 172.21.15.132:0/3058741426 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc1a0076070 con 0x561f8934f710 2024-05-08T18:50:45.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.061+0000 7fc09b606640 1 --2- 172.21.15.132:0/3058741426 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc09403bba0 0x7fc09403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.061+0000 7fc09b606640 1 -- 172.21.15.132:0/3058741426 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fc1a0093fb0 con 0x561f8934f710 2024-05-08T18:50:45.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.061+0000 7fc1a7fff640 1 --2- 172.21.15.132:0/3058741426 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc09403bba0 0x7fc09403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.062+0000 7fc1b3616800 1 --2- 172.21.15.132:0/3058741426 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x561f89350070 0x561f8944e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.062+0000 7fc1b3616800 1 -- 172.21.15.132:0/3058741426 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x561f8944e900 con 0x561f89350070 2024-05-08T18:50:45.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.062+0000 7fc1af47e640 1 --2- 172.21.15.132:0/3058741426 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x561f89350070 0x561f8944e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.062+0000 7fc1a7fff640 1 --2- 172.21.15.132:0/3058741426 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc09403bba0 0x7fc09403e060 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc198000f60 tx=0x7fc1980012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.062+0000 7fc1af47e640 1 --2- 172.21.15.132:0/3058741426 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x561f89350070 0x561f8944e3c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.062+0000 7fc1af47e640 1 -- 172.21.15.132:0/3058741426 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1a800a4a0 con 0x561f89350070 2024-05-08T18:50:45.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.062+0000 7fc1b3616800 1 -- 172.21.15.132:0/3058741426 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x561f8944b990 con 0x561f89350070 2024-05-08T18:50:45.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.062+0000 7fc1af47e640 1 -- 172.21.15.132:0/3058741426 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc1a800a4a0 con 0x561f89350070 2024-05-08T18:50:45.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.063+0000 7fc1b3616800 1 --2- 172.21.15.132:0/3058741426 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x561f89450c50 0x561f89453040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.063+0000 7fc1b3616800 1 -- 172.21.15.132:0/3058741426 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x561f89453730 con 0x561f89450c50 2024-05-08T18:50:45.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.063+0000 7fc1aec7d640 1 --2- 172.21.15.132:0/3058741426 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x561f89450c50 0x561f89453040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.063+0000 7fc1aec7d640 1 --2- 172.21.15.132:0/3058741426 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x561f89450c50 0x561f89453040 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.063+0000 7fc1aec7d640 1 -- 172.21.15.132:0/3058741426 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc1a0075030 con 0x561f89450c50 2024-05-08T18:50:45.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.063+0000 7fc1b3616800 1 -- 172.21.15.132:0/3058741426 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x561f8944faf0 con 0x561f89350070 2024-05-08T18:50:45.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.063+0000 7fc1af47e640 1 -- 172.21.15.132:0/3058741426 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc1a800a4a0 con 0x561f89350070 2024-05-08T18:50:45.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.063+0000 7fc1b3616800 1 -- 172.21.15.132:0/3058741426 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x561f8944ffd0 con 0x561f89350070 2024-05-08T18:50:45.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.064+0000 7fc1af47e640 1 -- 172.21.15.132:0/3058741426 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc1a800a4a0 con 0x561f89350070 2024-05-08T18:50:45.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.064+0000 7fc1b3616800 1 Processor -- start 2024-05-08T18:50:45.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.064+0000 7fc1b3616800 1 -- start start 2024-05-08T18:50:45.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.064+0000 7fc1b3616800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f894626b0 0x561f89462ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.064+0000 7fc1b3616800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561f89241fc0 con 0x561f894626b0 2024-05-08T18:50:45.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.064+0000 7fc1af47e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f894626b0 0x561f89462ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.064+0000 7fc1af47e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f894626b0 0x561f89462ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59856/0 (socket says 172.21.15.132:59856) 2024-05-08T18:50:45.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.064+0000 7fc1af47e640 1 -- 172.21.15.132:0/842601385 learned_addr learned my addr 172.21.15.132:0/842601385 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.065+0000 7fc1af47e640 1 -- 172.21.15.132:0/842601385 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f89463010 con 0x561f894626b0 2024-05-08T18:50:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.065+0000 7fc1af47e640 1 --2- 172.21.15.132:0/842601385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f894626b0 0x561f89462ad0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x561f8944ed00 tx=0x7fc1a8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.065+0000 7fc098e01640 1 -- 172.21.15.132:0/842601385 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a8014450 con 0x561f894626b0 2024-05-08T18:50:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.065+0000 7fc098e01640 1 -- 172.21.15.132:0/842601385 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a8014610 con 0x561f894626b0 2024-05-08T18:50:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.065+0000 7fc1b3616800 1 -- 172.21.15.132:0/842601385 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f89463a80 con 0x561f894626b0 2024-05-08T18:50:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.065+0000 7fc098e01640 1 -- 172.21.15.132:0/842601385 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a8014930 con 0x561f894626b0 2024-05-08T18:50:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.065+0000 7fc1b3616800 1 -- 172.21.15.132:0/842601385 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f89463f80 con 0x561f894626b0 2024-05-08T18:50:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.066+0000 7fc098e01640 1 -- 172.21.15.132:0/842601385 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc1a8011040 con 0x561f894626b0 2024-05-08T18:50:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.066+0000 7fc098e01640 1 --2- 172.21.15.132:0/842601385 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc08803bb50 0x7fc08803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.066+0000 7fc098e01640 1 -- 172.21.15.132:0/842601385 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fc1a801e070 con 0x561f894626b0 2024-05-08T18:50:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.066+0000 7fc1aec7d640 1 --2- 172.21.15.132:0/842601385 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc08803bb50 0x7fc08803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.066+0000 7fc1b3616800 1 Processor -- start 2024-05-08T18:50:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.067+0000 7fc1aec7d640 1 --2- 172.21.15.132:0/842601385 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc08803bb50 0x7fc08803e010 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x561f8944eda0 tx=0x7fc1a0066880 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.067+0000 7fc1b3616800 1 -- start start 2024-05-08T18:50:45.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.067+0000 7fc1b3616800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8946f900 0x561f8946fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.067+0000 7fc1b3616800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561f8943ff60 con 0x561f8946f900 2024-05-08T18:50:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.067+0000 7fc1af47e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8946f900 0x561f8946fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.067+0000 7fc1af47e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8946f900 0x561f8946fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59862/0 (socket says 172.21.15.132:59862) 2024-05-08T18:50:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.067+0000 7fc1af47e640 1 -- 172.21.15.132:0/3041763976 learned_addr learned my addr 172.21.15.132:0/3041763976 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.067+0000 7fc1af47e640 1 -- 172.21.15.132:0/3041763976 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f894702f0 con 0x561f8946f900 2024-05-08T18:50:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.067+0000 7fc1af47e640 1 --2- 172.21.15.132:0/3041763976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8946f900 0x561f8946fd20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8013fd0 tx=0x7fc1a8011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49361b5359a0b0af server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.067+0000 7fc0927fc640 1 -- 172.21.15.132:0/3041763976 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a802bc50 con 0x561f8946f900 2024-05-08T18:50:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.067+0000 7fc0927fc640 1 -- 172.21.15.132:0/3041763976 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a8047070 con 0x561f8946f900 2024-05-08T18:50:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.067+0000 7fc0927fc640 1 -- 172.21.15.132:0/3041763976 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a80167c0 con 0x561f8946f900 2024-05-08T18:50:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.068+0000 7fc1b3616800 1 -- 172.21.15.132:0/3041763976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8946f900 msgr2=0x561f8946fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.068+0000 7fc1b3616800 1 --2- 172.21.15.132:0/3041763976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8946f900 0x561f8946fd20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8013fd0 tx=0x7fc1a8011b50 comp rx=0 tx=0).stop 2024-05-08T18:50:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.068+0000 7fc1b3616800 1 -- 172.21.15.132:0/3041763976 shutdown_connections 2024-05-08T18:50:45.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.068+0000 7fc1b3616800 1 --2- 172.21.15.132:0/3041763976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8946f900 0x561f8946fd20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.068+0000 7fc1b3616800 1 -- 172.21.15.132:0/3041763976 >> 172.21.15.132:0/3041763976 conn(0x561f8946bcb0 msgr2=0x561f89469d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.068+0000 7fc1b3616800 1 -- 172.21.15.132:0/3041763976 shutdown_connections 2024-05-08T18:50:45.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.068+0000 7fc1b3616800 1 -- 172.21.15.132:0/3041763976 wait complete. 2024-05-08T18:50:45.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.068+0000 7fc1b3616800 1 Processor -- start 2024-05-08T18:50:45.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.068+0000 7fc1b3616800 1 -- start start 2024-05-08T18:50:45.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.068+0000 7fc1b3616800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8946f900 0x561f89476e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.068+0000 7fc1b3616800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561f89470a50 con 0x561f8946f900 2024-05-08T18:50:45.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.069+0000 7fc1af47e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8946f900 0x561f89476e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.069+0000 7fc1af47e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8946f900 0x561f89476e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59864/0 (socket says 172.21.15.132:59864) 2024-05-08T18:50:45.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.069+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 learned_addr learned my addr 172.21.15.132:0/481690508 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.069+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f894773d0 con 0x561f8946f900 2024-05-08T18:50:45.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.069+0000 7fc1af47e640 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8946f900 0x561f89476e90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8011b90 tx=0x7fc1a8052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.069+0000 7fc090ff9640 1 -- 172.21.15.132:0/481690508 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a8016ac0 con 0x561f8946f900 2024-05-08T18:50:45.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.069+0000 7fc090ff9640 1 -- 172.21.15.132:0/481690508 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a802b350 con 0x561f8946f900 2024-05-08T18:50:45.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.069+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f89477660 con 0x561f8946f900 2024-05-08T18:50:45.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.070+0000 7fc090ff9640 1 -- 172.21.15.132:0/481690508 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a802b630 con 0x561f8946f900 2024-05-08T18:50:45.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.070+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f8947a310 con 0x561f8946f900 2024-05-08T18:50:45.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.070+0000 7fc090ff9640 1 -- 172.21.15.132:0/481690508 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc1a802b7d0 con 0x561f8946f900 2024-05-08T18:50:45.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.070+0000 7fc090ff9640 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc07803bba0 0x7fc07803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.071+0000 7fc090ff9640 1 -- 172.21.15.132:0/481690508 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fc1a800e040 con 0x561f8946f900 2024-05-08T18:50:45.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.071+0000 7fc1aec7d640 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc07803bba0 0x7fc07803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.071+0000 7fc1b3616800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.071+0000 7fc1b3616800 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x561f89482b00 0x561f89484fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.071+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x561f89485710 con 0x561f89482b00 2024-05-08T18:50:45.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.071+0000 7fc1a7fff640 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x561f89482b00 0x561f89484fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.071+0000 7fc1aec7d640 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc07803bba0 0x7fc07803e060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0091270 tx=0x7fc1a007a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.071+0000 7fc1a7fff640 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x561f89482b00 0x561f89484fc0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.071+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc198009050 con 0x561f89482b00 2024-05-08T18:50:45.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.071+0000 7fc1b3616800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.071+0000 7fc1b3616800 20 realm 2024-05-08T18:50:45.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.071+0000 7fc1b3616800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.071+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x561f89481f50 con 0x561f89482b00 2024-05-08T18:50:45.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.072+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc198009050 con 0x561f89482b00 2024-05-08T18:50:45.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.072+0000 7fc1b3616800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.072+0000 7fc1b3616800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:45.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.072+0000 7fc1b3616800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.072+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x561f894861f0 con 0x561f89482b00 2024-05-08T18:50:45.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.072+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc198009050 con 0x561f89482b00 2024-05-08T18:50:45.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.072+0000 7fc1b3616800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.072+0000 7fc1b3616800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.072+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x561f89486ac0 con 0x561f89482b00 2024-05-08T18:50:45.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.072+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc198009050 con 0x561f89482b00 2024-05-08T18:50:45.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.072+0000 7fc1b3616800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:45.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.072+0000 7fc1b3616800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.072+0000 7fc1b3616800 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x561f89487370 0x561f89489760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.072+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x561f89489ea0 con 0x561f89487370 2024-05-08T18:50:45.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.072+0000 7fc1af47e640 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x561f89487370 0x561f89489760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.072+0000 7fc1af47e640 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x561f89487370 0x561f89489760 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.073+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc1a803f070 con 0x561f89487370 2024-05-08T18:50:45.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.073+0000 7fc1b3616800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:45.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.073+0000 7fc1b3616800 20 searching for the correct realm 2024-05-08T18:50:45.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.073+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x561f89487370 2024-05-08T18:50:45.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.073+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a803f070 con 0x561f89487370 2024-05-08T18:50:45.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.073+0000 7fc1af47e640 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fc1a8038020 0x7fc1a802e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.073+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x7fc1a8038020 2024-05-08T18:50:45.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.073+0000 7fc1aec7d640 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fc1a8038020 0x7fc1a802e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.074+0000 7fc1aec7d640 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fc1a8038020 0x7fc1a802e590 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.074+0000 7fc1aec7d640 1 -- 172.21.15.132:0/481690508 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a0075030 con 0x7fc1a8038020 2024-05-08T18:50:45.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.074+0000 7fc1aec7d640 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fc1a0082030 0x7fc1a0076360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.074+0000 7fc1aec7d640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x7fc1a0082030 2024-05-08T18:50:45.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.074+0000 7fc1a7fff640 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fc1a0082030 0x7fc1a0076360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.075+0000 7fc1a7fff640 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fc1a0082030 0x7fc1a0076360 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.075+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc198009050 con 0x7fc1a0082030 2024-05-08T18:50:45.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.075+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x561f89482b00 2024-05-08T18:50:45.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.075+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc198009050 con 0x561f89482b00 2024-05-08T18:50:45.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.075+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x561f89482b00 2024-05-08T18:50:45.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.075+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc198029040 con 0x561f89482b00 2024-05-08T18:50:45.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.075+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x7fc1a0082030 2024-05-08T18:50:45.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.076+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc198029040 con 0x7fc1a0082030 2024-05-08T18:50:45.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.076+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x7fc1a0082030 2024-05-08T18:50:45.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.076+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc198029040 con 0x7fc1a0082030 2024-05-08T18:50:45.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.076+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x7fc1a8038020 2024-05-08T18:50:45.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.076+0000 7fc1aec7d640 1 -- 172.21.15.132:0/481690508 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a0075030 con 0x7fc1a8038020 2024-05-08T18:50:45.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.076+0000 7fc1aec7d640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x561f89487370 2024-05-08T18:50:45.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.076+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a803f070 con 0x561f89487370 2024-05-08T18:50:45.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.076+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x561f89482b00 2024-05-08T18:50:45.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.077+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc198029040 con 0x561f89482b00 2024-05-08T18:50:45.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.077+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x7fc1a0082030 2024-05-08T18:50:45.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.077+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc198029040 con 0x7fc1a0082030 2024-05-08T18:50:45.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.077+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x561f89482b00 2024-05-08T18:50:45.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.077+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc198029040 con 0x561f89482b00 2024-05-08T18:50:45.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.077+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x7fc1a8038020 2024-05-08T18:50:45.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.078+0000 7fc1aec7d640 1 -- 172.21.15.132:0/481690508 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc1a0075030 con 0x7fc1a8038020 2024-05-08T18:50:45.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.078+0000 7fc1aec7d640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x561f89487370 2024-05-08T18:50:45.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.078+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc1a803f070 con 0x561f89487370 2024-05-08T18:50:45.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.078+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x561f89487370 2024-05-08T18:50:45.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.078+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a803f070 con 0x561f89487370 2024-05-08T18:50:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.078+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x7fc1a0082030 2024-05-08T18:50:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.078+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc198029040 con 0x7fc1a0082030 2024-05-08T18:50:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.079+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x561f89487370 2024-05-08T18:50:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.079+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a803f070 con 0x561f89487370 2024-05-08T18:50:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.079+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x561f89487370 2024-05-08T18:50:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.079+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a803f070 con 0x561f89487370 2024-05-08T18:50:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.079+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x561f89482b00 2024-05-08T18:50:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.079+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc198029040 con 0x561f89482b00 2024-05-08T18:50:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.079+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x561f89482b00 2024-05-08T18:50:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.079+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc198029040 con 0x561f89482b00 2024-05-08T18:50:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.079+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x7fc1a0082030 2024-05-08T18:50:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.080+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc198029040 con 0x7fc1a0082030 2024-05-08T18:50:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.080+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x561f89487370 2024-05-08T18:50:45.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.080+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a803f070 con 0x561f89487370 2024-05-08T18:50:45.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.080+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x7fc1a8038020 2024-05-08T18:50:45.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.080+0000 7fc1aec7d640 1 -- 172.21.15.132:0/481690508 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a0075030 con 0x7fc1a8038020 2024-05-08T18:50:45.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.081+0000 7fc1aec7d640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x561f89482b00 2024-05-08T18:50:45.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.081+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc198029040 con 0x561f89482b00 2024-05-08T18:50:45.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.081+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x7fc1a0082030 2024-05-08T18:50:45.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.081+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc198029040 con 0x7fc1a0082030 2024-05-08T18:50:45.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.081+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x561f89487370 2024-05-08T18:50:45.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.082+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a803f070 con 0x561f89487370 2024-05-08T18:50:45.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.082+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x7fc1a0082030 2024-05-08T18:50:45.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.082+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc198029040 con 0x7fc1a0082030 2024-05-08T18:50:45.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.082+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x7fc1a8038020 2024-05-08T18:50:45.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.082+0000 7fc1aec7d640 1 -- 172.21.15.132:0/481690508 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a0075030 con 0x7fc1a8038020 2024-05-08T18:50:45.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.082+0000 7fc1aec7d640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x561f89487370 2024-05-08T18:50:45.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.082+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a803f070 con 0x561f89487370 2024-05-08T18:50:45.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.082+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x7fc1a0082030 2024-05-08T18:50:45.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.083+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc198029040 con 0x7fc1a0082030 2024-05-08T18:50:45.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.083+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x561f89482b00 2024-05-08T18:50:45.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.083+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc198029040 con 0x561f89482b00 2024-05-08T18:50:45.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.083+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b8b0 con 0x7fc1a8038020 2024-05-08T18:50:45.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.083+0000 7fc1aec7d640 1 -- 172.21.15.132:0/481690508 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a0075030 con 0x7fc1a8038020 2024-05-08T18:50:45.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.083+0000 7fc1b3616800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:45.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.083+0000 7fc1b3616800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:45.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.083+0000 7fc1b3616800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:45.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.083+0000 7fc1b3616800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:45.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.083+0000 7fc1b3616800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:45.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.083+0000 7fc1b3616800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:45.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.083+0000 7fc1b3616800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.083+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x561f8948a9b0 con 0x561f89482b00 2024-05-08T18:50:45.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.083+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc198029040 con 0x561f89482b00 2024-05-08T18:50:45.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.083+0000 7fc1b3616800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.083+0000 7fc1b3616800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.083+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x561f8948b250 con 0x561f89482b00 2024-05-08T18:50:45.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.083+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc198029040 con 0x561f89482b00 2024-05-08T18:50:45.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.084+0000 7fc1b3616800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:45.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.084+0000 7fc1b3616800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.084+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x561f8948a5f0 con 0x561f89482b00 2024-05-08T18:50:45.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.084+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc198029040 con 0x561f89482b00 2024-05-08T18:50:45.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.084+0000 7fc1b3616800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:45.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.084+0000 7fc1b3616800 20 zone default found 2024-05-08T18:50:45.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.084+0000 7fc1b3616800 4 Realm: () 2024-05-08T18:50:45.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.084+0000 7fc1b3616800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:45.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.084+0000 7fc1b3616800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:45.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.084+0000 7fc1b3616800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:45.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.084+0000 7fc1b3616800 20 zonegroup default 2024-05-08T18:50:45.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.084+0000 7fc1b3616800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.084+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x561f8948c230 con 0x7fc1a0082030 2024-05-08T18:50:45.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.084+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc198029040 con 0x7fc1a0082030 2024-05-08T18:50:45.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.084+0000 7fc1b3616800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.084+0000 7fc1b3616800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.084+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x561f8948dca0 con 0x561f89487370 2024-05-08T18:50:45.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.084+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc1a803f070 con 0x561f89487370 2024-05-08T18:50:45.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.084+0000 7fc1b3616800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.084+0000 7fc1b3616800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.084+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x561f8948e170 con 0x561f89487370 2024-05-08T18:50:45.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.085+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc1a803f070 con 0x561f89487370 2024-05-08T18:50:45.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.085+0000 7fc1b3616800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.085+0000 7fc1b3616800 20 started sync module instance, tier type = 2024-05-08T18:50:45.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.085+0000 7fc1b3616800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:45.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.085+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f8948d0a0 con 0x7fc1a8038020 2024-05-08T18:50:45.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.086+0000 7fc1aec7d640 1 -- 172.21.15.132:0/481690508 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a0075030 con 0x7fc1a8038020 2024-05-08T18:50:45.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.086+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94693447226512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f8948cd00 con 0x7fc1a8038020 2024-05-08T18:50:45.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.086+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f8948f0a0 con 0x561f89482b00 2024-05-08T18:50:45.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.087+0000 7fc1aec7d640 1 -- 172.21.15.132:0/481690508 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94693447226512] v25'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a0075030 con 0x7fc1a8038020 2024-05-08T18:50:45.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.087+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc198029040 con 0x561f89482b00 2024-05-08T18:50:45.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.087+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94693447232496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f8948f010 con 0x561f89482b00 2024-05-08T18:50:45.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.087+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f8948ff60 con 0x561f89487370 2024-05-08T18:50:45.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.088+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a803f070 con 0x561f89487370 2024-05-08T18:50:45.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.088+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94693447232496] v25'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc198029040 con 0x561f89482b00 2024-05-08T18:50:45.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.088+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94693447236272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f8948fed0 con 0x561f89487370 2024-05-08T18:50:45.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.088+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f8948f4d0 con 0x7fc1a8038020 2024-05-08T18:50:45.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.090+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94693447236272] v25'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a803f070 con 0x561f89487370 2024-05-08T18:50:45.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.090+0000 7fc1aec7d640 1 -- 172.21.15.132:0/481690508 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a0075030 con 0x7fc1a8038020 2024-05-08T18:50:45.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.090+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94693447238480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f89490ed0 con 0x7fc1a8038020 2024-05-08T18:50:45.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.090+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f89491890 con 0x561f89482b00 2024-05-08T18:50:45.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.091+0000 7fc1aec7d640 1 -- 172.21.15.132:0/481690508 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94693447238480] v25'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a0075030 con 0x7fc1a8038020 2024-05-08T18:50:45.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.094+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc198029040 con 0x561f89482b00 2024-05-08T18:50:45.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.094+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94693447242720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f89491cb0 con 0x561f89482b00 2024-05-08T18:50:45.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.094+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f89492670 con 0x7fc1a0082030 2024-05-08T18:50:45.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.097+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94693447242720] v25'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc198029040 con 0x561f89482b00 2024-05-08T18:50:45.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.097+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc198029040 con 0x7fc1a0082030 2024-05-08T18:50:45.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.097+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94693447246752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f89491cb0 con 0x7fc1a0082030 2024-05-08T18:50:45.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.097+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f89493080 con 0x7fc1a0082030 2024-05-08T18:50:45.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.098+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94693447246752] v25'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc198029040 con 0x7fc1a0082030 2024-05-08T18:50:45.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.098+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc198029040 con 0x7fc1a0082030 2024-05-08T18:50:45.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.098+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94693447243776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f89493260 con 0x7fc1a0082030 2024-05-08T18:50:45.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.098+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f89493ab0 con 0x7fc1a0082030 2024-05-08T18:50:45.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.099+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94693447243776] v25'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc198029040 con 0x7fc1a0082030 2024-05-08T18:50:45.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.099+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc198029040 con 0x7fc1a0082030 2024-05-08T18:50:45.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.099+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94693447249600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f894938f0 con 0x7fc1a0082030 2024-05-08T18:50:45.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.099+0000 7fc1b3616800 20 add_watcher() i=0 2024-05-08T18:50:45.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.099+0000 7fc1b3616800 20 add_watcher() i=1 2024-05-08T18:50:45.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.099+0000 7fc1b3616800 20 add_watcher() i=2 2024-05-08T18:50:45.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.099+0000 7fc1b3616800 20 add_watcher() i=3 2024-05-08T18:50:45.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.099+0000 7fc1b3616800 20 add_watcher() i=4 2024-05-08T18:50:45.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.099+0000 7fc1b3616800 20 add_watcher() i=5 2024-05-08T18:50:45.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.099+0000 7fc1b3616800 20 add_watcher() i=6 2024-05-08T18:50:45.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.100+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94693447249600] v25'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc198029040 con 0x7fc1a0082030 2024-05-08T18:50:45.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.100+0000 7fc1b3616800 20 add_watcher() i=7 2024-05-08T18:50:45.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.100+0000 7fc1b3616800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:45.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.100+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x561f89496e30 con 0x561f89482b00 2024-05-08T18:50:45.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.100+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc198029040 con 0x561f89482b00 2024-05-08T18:50:45.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.100+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94693447250816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f894942f0 con 0x561f89482b00 2024-05-08T18:50:45.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.101+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94693447250816] v25'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc198029040 con 0x561f89482b00 2024-05-08T18:50:45.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.101+0000 7fc0657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:45.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.102+0000 7fc1b3616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:45.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.102+0000 7fc1b3616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:45.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.102+0000 7fc1b3616800 5 note: GC not initialized 2024-05-08T18:50:45.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.102+0000 7fbfdffff640 20 reqs_thread_entry: start 2024-05-08T18:50:45.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.102+0000 7fc1b3616800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:45.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.102+0000 7fc1b3616800 20 Filter name: none 2024-05-08T18:50:45.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.102+0000 7fbfddffb640 20 reqs_thread_entry: start 2024-05-08T18:50:45.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.102+0000 7fc1b3616800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.102+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x561f894c9ed0 con 0x561f89482b00 2024-05-08T18:50:45.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.102+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc198029040 con 0x561f89482b00 2024-05-08T18:50:45.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.102+0000 7fc1b3616800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:45.105 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:50:44.835566Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:44.835553Z","tags":[],"group_ids":[]} 2024-05-08T18:50:45.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.103+0000 7fc0657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:45.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.103+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94693447250816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f89496760 con 0x561f89482b00 2024-05-08T18:50:45.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.105+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94693447250816] v25'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc198029040 con 0x561f89482b00 2024-05-08T18:50:45.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.105+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94693447226512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f89493340 con 0x7fc1a8038020 2024-05-08T18:50:45.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.106+0000 7fc1aec7d640 1 -- 172.21.15.132:0/481690508 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94693447226512] v25'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a0075030 con 0x7fc1a8038020 2024-05-08T18:50:45.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.106+0000 7fc1b3616800 20 remove_watcher() i=0 2024-05-08T18:50:45.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.106+0000 7fc1b3616800 2 removed watcher, disabling cache 2024-05-08T18:50:45.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.106+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94693447232496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f8948d490 con 0x561f89482b00 2024-05-08T18:50:45.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.107+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94693447232496] v25'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc198029040 con 0x561f89482b00 2024-05-08T18:50:45.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.107+0000 7fc1b3616800 20 remove_watcher() i=1 2024-05-08T18:50:45.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.107+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94693447236272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f8948d490 con 0x561f89487370 2024-05-08T18:50:45.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.108+0000 7fc1af47e640 1 -- 172.21.15.132:0/481690508 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94693447236272] v25'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a803f070 con 0x561f89487370 2024-05-08T18:50:45.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.108+0000 7fc1b3616800 20 remove_watcher() i=2 2024-05-08T18:50:45.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.108+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94693447238480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f8948fab0 con 0x7fc1a8038020 2024-05-08T18:50:45.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.109+0000 7fc1aec7d640 1 -- 172.21.15.132:0/481690508 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94693447238480] v25'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a0075030 con 0x7fc1a8038020 2024-05-08T18:50:45.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.109+0000 7fc1b3616800 20 remove_watcher() i=3 2024-05-08T18:50:45.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.109+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94693447242720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f8948d490 con 0x561f89482b00 2024-05-08T18:50:45.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.110+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94693447242720] v25'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc198029040 con 0x561f89482b00 2024-05-08T18:50:45.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.110+0000 7fc1b3616800 20 remove_watcher() i=4 2024-05-08T18:50:45.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.110+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94693447246752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f89490350 con 0x7fc1a0082030 2024-05-08T18:50:45.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.111+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94693447246752] v25'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc198029040 con 0x7fc1a0082030 2024-05-08T18:50:45.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.111+0000 7fc1b3616800 20 remove_watcher() i=5 2024-05-08T18:50:45.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.111+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94693447243776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f8948fab0 con 0x7fc1a0082030 2024-05-08T18:50:45.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.112+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94693447243776] v25'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc198029040 con 0x7fc1a0082030 2024-05-08T18:50:45.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.112+0000 7fc1b3616800 20 remove_watcher() i=6 2024-05-08T18:50:45.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.112+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94693447249600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x561f8948d490 con 0x7fc1a0082030 2024-05-08T18:50:45.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.113+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94693447249600] v25'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc198029040 con 0x7fc1a0082030 2024-05-08T18:50:45.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.113+0000 7fc1b3616800 20 remove_watcher() i=7 2024-05-08T18:50:45.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.113+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fc1a0082030 msgr2=0x7fc1a0076360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.113+0000 7fc1b3616800 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fc1a0082030 0x7fc1a0076360 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.113+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x561f89482b00 msgr2=0x561f89484fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.113+0000 7fc1b3616800 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x561f89482b00 0x561f89484fc0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.113+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fc1a8038020 msgr2=0x7fc1a802e590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.113+0000 7fc1b3616800 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fc1a8038020 0x7fc1a802e590 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.113+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x561f89487370 msgr2=0x561f89489760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.113+0000 7fc1b3616800 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x561f89487370 0x561f89489760 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.113+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc07803bba0 msgr2=0x7fc07803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.113+0000 7fc1b3616800 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc07803bba0 0x7fc07803e060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0091270 tx=0x7fc1a007a000 comp rx=0 tx=0).stop 2024-05-08T18:50:45.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.113+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8946f900 msgr2=0x561f89476e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.113+0000 7fc1a7fff640 1 -- 172.21.15.132:0/481690508 reap_dead start 2024-05-08T18:50:45.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.113+0000 7fc1b3616800 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8946f900 0x561f89476e90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8011b90 tx=0x7fc1a8052be0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 shutdown_connections 2024-05-08T18:50:45.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 --2- 172.21.15.132:0/481690508 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8946f900 0x561f89476e90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 >> 172.21.15.132:0/481690508 conn(0x561f8946bcb0 msgr2=0x561f89471170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 shutdown_connections 2024-05-08T18:50:45.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 -- 172.21.15.132:0/481690508 wait complete. 2024-05-08T18:50:45.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 -- 172.21.15.132:0/842601385 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc08803bb50 msgr2=0x7fc08803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 --2- 172.21.15.132:0/842601385 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc08803bb50 0x7fc08803e010 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x561f8944eda0 tx=0x7fc1a0066880 comp rx=0 tx=0).stop 2024-05-08T18:50:45.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 -- 172.21.15.132:0/842601385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f894626b0 msgr2=0x561f89462ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 --2- 172.21.15.132:0/842601385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f894626b0 0x561f89462ad0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x561f8944ed00 tx=0x7fc1a8018830 comp rx=0 tx=0).stop 2024-05-08T18:50:45.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 -- 172.21.15.132:0/842601385 shutdown_connections 2024-05-08T18:50:45.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 --2- 172.21.15.132:0/842601385 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc08803bb50 0x7fc08803e010 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 --2- 172.21.15.132:0/842601385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f894626b0 0x561f89462ad0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 -- 172.21.15.132:0/842601385 >> 172.21.15.132:0/842601385 conn(0x561f89456750 msgr2=0x561f89456b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 -- 172.21.15.132:0/842601385 shutdown_connections 2024-05-08T18:50:45.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 -- 172.21.15.132:0/842601385 wait complete. 2024-05-08T18:50:45.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 -- 172.21.15.132:0/3058741426 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x561f89350070 msgr2=0x561f8944e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 --2- 172.21.15.132:0/3058741426 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x561f89350070 0x561f8944e3c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 -- 172.21.15.132:0/3058741426 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x561f89450c50 msgr2=0x561f89453040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 --2- 172.21.15.132:0/3058741426 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x561f89450c50 0x561f89453040 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 -- 172.21.15.132:0/3058741426 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc09403bba0 msgr2=0x7fc09403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 --2- 172.21.15.132:0/3058741426 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc09403bba0 0x7fc09403e060 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc198000f60 tx=0x7fc1980012b0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 -- 172.21.15.132:0/3058741426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8934f710 msgr2=0x561f89447180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 --2- 172.21.15.132:0/3058741426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8934f710 0x561f89447180 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000a470 tx=0x7fc1a0003020 comp rx=0 tx=0).stop 2024-05-08T18:50:45.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.114+0000 7fc1b3616800 1 -- 172.21.15.132:0/3058741426 shutdown_connections 2024-05-08T18:50:45.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.115+0000 7fc1b3616800 1 --2- 172.21.15.132:0/3058741426 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x561f89450c50 0x561f89453040 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.115+0000 7fc1b3616800 1 --2- 172.21.15.132:0/3058741426 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x561f89350070 0x561f8944e3c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.115+0000 7fc1b3616800 1 --2- 172.21.15.132:0/3058741426 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc09403bba0 0x7fc09403e060 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.115+0000 7fc1b3616800 1 --2- 172.21.15.132:0/3058741426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561f8934f710 0x561f89447180 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.115+0000 7fc1b3616800 1 -- 172.21.15.132:0/3058741426 >> 172.21.15.132:0/3058741426 conn(0x561f89349ea0 msgr2=0x561f894397f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.115+0000 7fc1b3616800 1 -- 172.21.15.132:0/3058741426 shutdown_connections 2024-05-08T18:50:45.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.115+0000 7fc1b3616800 1 -- 172.21.15.132:0/3058741426 wait complete. 2024-05-08T18:50:45.123 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:50:44.835566Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:44.835553Z', 'tags': [], 'group_ids': []} 2024-05-08T18:50:45.123 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-05-08T18:50:45.123 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-05-08T18:50:45.123 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-05-08T18:50:45.167 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:45.167 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:45.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.168+0000 7f6d0a935800 1 Processor -- start 2024-05-08T18:50:45.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.168+0000 7f6d0a935800 1 -- start start 2024-05-08T18:50:45.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.169+0000 7f6d0a935800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55effc843a70 0x55effc8d8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.169+0000 7f6d0a935800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55effc843fb0 con 0x55effc844e00 2024-05-08T18:50:45.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.169+0000 7f6d0a935800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55effc76fe20 con 0x55effc843a70 2024-05-08T18:50:45.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.169+0000 7f6cfddad640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55effc843a70 0x55effc8d8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.169+0000 7f6cfddad640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55effc843a70 0x55effc8d8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59874/0 (socket says 172.21.15.132:59874) 2024-05-08T18:50:45.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.169+0000 7f6d065ae640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55effc844e00 0x55effc843360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46726/0 (socket says 172.21.15.132:46726) 2024-05-08T18:50:45.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.169+0000 7f6cfddad640 1 -- 172.21.15.132:0/3737740333 learned_addr learned my addr 172.21.15.132:0/3737740333 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.169+0000 7f6cfddad640 1 -- 172.21.15.132:0/3737740333 >> v1:172.21.15.42:6789/0 conn(0x55effc844e00 legacy=0x55effc843360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.169+0000 7f6cfddad640 1 -- 172.21.15.132:0/3737740333 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55effc844180 con 0x55effc843a70 2024-05-08T18:50:45.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.171+0000 7f6cfddad640 1 --2- 172.21.15.132:0/3737740333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc843a70 0x55effc8d8130 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000a520 tx=0x7f6cf001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca685471e59a067 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.171+0000 7f6d05dad640 1 -- 172.21.15.132:0/3737740333 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf0057070 con 0x55effc843a70 2024-05-08T18:50:45.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.171+0000 7f6d05dad640 1 -- 172.21.15.132:0/3737740333 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf0052570 con 0x55effc843a70 2024-05-08T18:50:45.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.171+0000 7f6d05dad640 1 -- 172.21.15.132:0/3737740333 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf004ae60 con 0x55effc843a70 2024-05-08T18:50:45.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.172+0000 7f6d0a935800 1 -- 172.21.15.132:0/3737740333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc843a70 msgr2=0x55effc8d8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.172+0000 7f6d0a935800 1 --2- 172.21.15.132:0/3737740333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc843a70 0x55effc8d8130 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000a520 tx=0x7f6cf001d010 comp rx=0 tx=0).stop 2024-05-08T18:50:45.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.172+0000 7f6d0a935800 1 -- 172.21.15.132:0/3737740333 shutdown_connections 2024-05-08T18:50:45.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.172+0000 7f6d0a935800 1 --2- 172.21.15.132:0/3737740333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc843a70 0x55effc8d8130 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.172+0000 7f6d0a935800 1 -- 172.21.15.132:0/3737740333 >> 172.21.15.132:0/3737740333 conn(0x55effc8ca830 msgr2=0x55effc8ccc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.172+0000 7f6d0a935800 1 -- 172.21.15.132:0/3737740333 shutdown_connections 2024-05-08T18:50:45.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.172+0000 7f6d0a935800 1 -- 172.21.15.132:0/3737740333 wait complete. 2024-05-08T18:50:45.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.185+0000 7f6d0a935800 1 Processor -- start 2024-05-08T18:50:45.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.185+0000 7f6d0a935800 1 -- start start 2024-05-08T18:50:45.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.186+0000 7f6d0a935800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc843a70 0x55effc9c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.186+0000 7f6d0a935800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55effc81a5b0 con 0x55effc843a70 2024-05-08T18:50:45.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.186+0000 7f6d065ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc843a70 0x55effc9c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.186+0000 7f6d065ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc843a70 0x55effc9c27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59880/0 (socket says 172.21.15.132:59880) 2024-05-08T18:50:45.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.186+0000 7f6d065ae640 1 -- 172.21.15.132:0/3238728823 learned_addr learned my addr 172.21.15.132:0/3238728823 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.186+0000 7f6d065ae640 1 -- 172.21.15.132:0/3238728823 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55effc9c2da0 con 0x55effc843a70 2024-05-08T18:50:45.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.186+0000 7f6d065ae640 1 --2- 172.21.15.132:0/3238728823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc843a70 0x55effc9c27d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8001eb0 tx=0x7f6cf800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9efa3f7982d3f43c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.191 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.187+0000 7f6bf4608640 1 -- 172.21.15.132:0/3238728823 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf800e5c0 con 0x55effc843a70 2024-05-08T18:50:45.191 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.187+0000 7f6bf4608640 1 -- 172.21.15.132:0/3238728823 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf8006070 con 0x55effc843a70 2024-05-08T18:50:45.191 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.187+0000 7f6bf4608640 1 -- 172.21.15.132:0/3238728823 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf800e8b0 con 0x55effc843a70 2024-05-08T18:50:45.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.187+0000 7f6d0a935800 1 -- 172.21.15.132:0/3238728823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc843a70 msgr2=0x55effc9c27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.187+0000 7f6d0a935800 1 --2- 172.21.15.132:0/3238728823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc843a70 0x55effc9c27d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8001eb0 tx=0x7f6cf800b6c0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.187+0000 7f6d0a935800 1 -- 172.21.15.132:0/3238728823 shutdown_connections 2024-05-08T18:50:45.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.187+0000 7f6d0a935800 1 --2- 172.21.15.132:0/3238728823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc843a70 0x55effc9c27d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.187+0000 7f6d0a935800 1 -- 172.21.15.132:0/3238728823 >> 172.21.15.132:0/3238728823 conn(0x55effc8ca830 msgr2=0x55effc9be0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.187+0000 7f6d0a935800 1 -- 172.21.15.132:0/3238728823 shutdown_connections 2024-05-08T18:50:45.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.187+0000 7f6d0a935800 1 -- 172.21.15.132:0/3238728823 wait complete. 2024-05-08T18:50:45.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.188+0000 7f6d0a935800 1 Processor -- start 2024-05-08T18:50:45.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.188+0000 7f6d0a935800 1 -- start start 2024-05-08T18:50:45.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.188+0000 7f6d0a935800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc843a70 0x55effc9ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.188+0000 7f6d0a935800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55effc8d8970 con 0x55effc843a70 2024-05-08T18:50:45.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.188+0000 7f6d065ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc843a70 0x55effc9ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.188+0000 7f6d065ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc843a70 0x55effc9ca350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59890/0 (socket says 172.21.15.132:59890) 2024-05-08T18:50:45.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.188+0000 7f6d065ae640 1 -- 172.21.15.132:0/3255624912 learned_addr learned my addr 172.21.15.132:0/3255624912 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.188+0000 7f6d065ae640 1 -- 172.21.15.132:0/3255624912 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55effc9ca890 con 0x55effc843a70 2024-05-08T18:50:45.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.188+0000 7f6d065ae640 1 --2- 172.21.15.132:0/3255624912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc843a70 0x55effc9ca350 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800c010 tx=0x7f6cf8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.189+0000 7f6bf2e05640 1 -- 172.21.15.132:0/3255624912 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf801a7c0 con 0x55effc843a70 2024-05-08T18:50:45.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.189+0000 7f6bf2e05640 1 -- 172.21.15.132:0/3255624912 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf801a980 con 0x55effc843a70 2024-05-08T18:50:45.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.189+0000 7f6d0a935800 1 -- 172.21.15.132:0/3255624912 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55effc9cab20 con 0x55effc843a70 2024-05-08T18:50:45.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.189+0000 7f6bf2e05640 1 -- 172.21.15.132:0/3255624912 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf801ace0 con 0x55effc843a70 2024-05-08T18:50:45.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.189+0000 7f6d0a935800 1 -- 172.21.15.132:0/3255624912 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55effc9cd7d0 con 0x55effc843a70 2024-05-08T18:50:45.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.190+0000 7f6bf2e05640 1 -- 172.21.15.132:0/3255624912 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6cf8017070 con 0x55effc843a70 2024-05-08T18:50:45.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.190+0000 7f6bf2e05640 1 --2- 172.21.15.132:0/3255624912 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6bec03bba0 0x7f6bec03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.190+0000 7f6bf2e05640 1 -- 172.21.15.132:0/3255624912 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f6cf8015020 con 0x55effc843a70 2024-05-08T18:50:45.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.190+0000 7f6cfddad640 1 --2- 172.21.15.132:0/3255624912 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6bec03bba0 0x7f6bec03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.190+0000 7f6d0a935800 1 --2- 172.21.15.132:0/3255624912 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55effc844e00 0x55effc9d1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.190+0000 7f6d0a935800 1 -- 172.21.15.132:0/3255624912 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effc9d1b20 con 0x55effc844e00 2024-05-08T18:50:45.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.190+0000 7f6d06daf640 1 --2- 172.21.15.132:0/3255624912 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55effc844e00 0x55effc9d1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.190+0000 7f6cfddad640 1 --2- 172.21.15.132:0/3255624912 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6bec03bba0 0x7f6bec03e060 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000a520 tx=0x7f6cf004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.190+0000 7f6d06daf640 1 --2- 172.21.15.132:0/3255624912 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55effc844e00 0x55effc9d1590 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.191+0000 7f6d06daf640 1 -- 172.21.15.132:0/3255624912 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d0000a4a0 con 0x55effc844e00 2024-05-08T18:50:45.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.191+0000 7f6d0a935800 1 -- 172.21.15.132:0/3255624912 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effc9ceb60 con 0x55effc844e00 2024-05-08T18:50:45.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.191+0000 7f6d06daf640 1 -- 172.21.15.132:0/3255624912 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d0000a4a0 con 0x55effc844e00 2024-05-08T18:50:45.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.191+0000 7f6d0a935800 1 --2- 172.21.15.132:0/3255624912 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55effc9d3e70 0x55effc9d6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.191+0000 7f6d0a935800 1 -- 172.21.15.132:0/3255624912 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effc9d6950 con 0x55effc9d3e70 2024-05-08T18:50:45.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.191+0000 7f6d065ae640 1 --2- 172.21.15.132:0/3255624912 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55effc9d3e70 0x55effc9d6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.191+0000 7f6d065ae640 1 --2- 172.21.15.132:0/3255624912 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55effc9d3e70 0x55effc9d6260 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.192+0000 7f6d065ae640 1 -- 172.21.15.132:0/3255624912 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6cf802e070 con 0x55effc9d3e70 2024-05-08T18:50:45.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.192+0000 7f6d0a935800 1 -- 172.21.15.132:0/3255624912 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effc9d2d10 con 0x55effc844e00 2024-05-08T18:50:45.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.192+0000 7f6d06daf640 1 -- 172.21.15.132:0/3255624912 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d0000a4a0 con 0x55effc844e00 2024-05-08T18:50:45.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.192+0000 7f6d0a935800 1 -- 172.21.15.132:0/3255624912 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effc9d31f0 con 0x55effc844e00 2024-05-08T18:50:45.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.192+0000 7f6d06daf640 1 -- 172.21.15.132:0/3255624912 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6d0000a4a0 con 0x55effc844e00 2024-05-08T18:50:45.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.192+0000 7f6d0a935800 1 Processor -- start 2024-05-08T18:50:45.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.192+0000 7f6d0a935800 1 -- start start 2024-05-08T18:50:45.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.193+0000 7f6d0a935800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc9e5890 0x55effc9e5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.193+0000 7f6d0a935800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55effc7c0fc0 con 0x55effc9e5890 2024-05-08T18:50:45.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.193+0000 7f6d06daf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc9e5890 0x55effc9e5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.193+0000 7f6d06daf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc9e5890 0x55effc9e5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59894/0 (socket says 172.21.15.132:59894) 2024-05-08T18:50:45.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.193+0000 7f6d06daf640 1 -- 172.21.15.132:0/2767460979 learned_addr learned my addr 172.21.15.132:0/2767460979 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.193+0000 7f6d06daf640 1 -- 172.21.15.132:0/2767460979 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55effc9e61f0 con 0x55effc9e5890 2024-05-08T18:50:45.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.193+0000 7f6d06daf640 1 --2- 172.21.15.132:0/2767460979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc9e5890 0x55effc9e5cb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x55effc9d1f20 tx=0x7f6d00018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.194+0000 7f6bebfff640 1 -- 172.21.15.132:0/2767460979 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d00014450 con 0x55effc9e5890 2024-05-08T18:50:45.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.194+0000 7f6bebfff640 1 -- 172.21.15.132:0/2767460979 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d00014610 con 0x55effc9e5890 2024-05-08T18:50:45.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.194+0000 7f6d0a935800 1 -- 172.21.15.132:0/2767460979 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55effc9e6c60 con 0x55effc9e5890 2024-05-08T18:50:45.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.194+0000 7f6bebfff640 1 -- 172.21.15.132:0/2767460979 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d00014930 con 0x55effc9e5890 2024-05-08T18:50:45.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.194+0000 7f6d0a935800 1 -- 172.21.15.132:0/2767460979 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55effc9e7160 con 0x55effc9e5890 2024-05-08T18:50:45.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.194+0000 7f6bebfff640 1 -- 172.21.15.132:0/2767460979 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6d00011040 con 0x55effc9e5890 2024-05-08T18:50:45.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.195+0000 7f6bebfff640 1 --2- 172.21.15.132:0/2767460979 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6be003bba0 0x7f6be003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.195+0000 7f6bebfff640 1 -- 172.21.15.132:0/2767460979 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f6d0001e070 con 0x55effc9e5890 2024-05-08T18:50:45.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.195+0000 7f6d065ae640 1 --2- 172.21.15.132:0/2767460979 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6be003bba0 0x7f6be003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.195+0000 7f6d0a935800 1 Processor -- start 2024-05-08T18:50:45.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.195+0000 7f6d065ae640 1 --2- 172.21.15.132:0/2767460979 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6be003bba0 0x7f6be003e060 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55effc9d1fc0 tx=0x7f6cf8051740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.195+0000 7f6d0a935800 1 -- start start 2024-05-08T18:50:45.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.195+0000 7f6d0a935800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc9f2ba0 0x55effc9f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.195+0000 7f6d0a935800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55effc9c3120 con 0x55effc9f2ba0 2024-05-08T18:50:45.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.195+0000 7f6d06daf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc9f2ba0 0x55effc9f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.195+0000 7f6d06daf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc9f2ba0 0x55effc9f2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59906/0 (socket says 172.21.15.132:59906) 2024-05-08T18:50:45.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.195+0000 7f6d06daf640 1 -- 172.21.15.132:0/2551782758 learned_addr learned my addr 172.21.15.132:0/2551782758 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.196+0000 7f6d06daf640 1 -- 172.21.15.132:0/2551782758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55effc9f3590 con 0x55effc9f2ba0 2024-05-08T18:50:45.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.196+0000 7f6d06daf640 1 --2- 172.21.15.132:0/2551782758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc9f2ba0 0x55effc9f2fc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6d00052c50 tx=0x7f6d000118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c513cf721daafe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.196+0000 7f6be9ffb640 1 -- 172.21.15.132:0/2551782758 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d00044020 con 0x55effc9f2ba0 2024-05-08T18:50:45.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.196+0000 7f6be9ffb640 1 -- 172.21.15.132:0/2551782758 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d00047070 con 0x55effc9f2ba0 2024-05-08T18:50:45.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.196+0000 7f6be9ffb640 1 -- 172.21.15.132:0/2551782758 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d000167c0 con 0x55effc9f2ba0 2024-05-08T18:50:45.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.196+0000 7f6d0a935800 1 -- 172.21.15.132:0/2551782758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc9f2ba0 msgr2=0x55effc9f2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.196+0000 7f6d0a935800 1 --2- 172.21.15.132:0/2551782758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc9f2ba0 0x55effc9f2fc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6d00052c50 tx=0x7f6d000118e0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.196+0000 7f6d0a935800 1 -- 172.21.15.132:0/2551782758 shutdown_connections 2024-05-08T18:50:45.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.196+0000 7f6d0a935800 1 --2- 172.21.15.132:0/2551782758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc9f2ba0 0x55effc9f2fc0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.196+0000 7f6d0a935800 1 -- 172.21.15.132:0/2551782758 >> 172.21.15.132:0/2551782758 conn(0x55effc9eee70 msgr2=0x55effc9eced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.196+0000 7f6d0a935800 1 -- 172.21.15.132:0/2551782758 shutdown_connections 2024-05-08T18:50:45.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.196+0000 7f6d0a935800 1 -- 172.21.15.132:0/2551782758 wait complete. 2024-05-08T18:50:45.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.197+0000 7f6d0a935800 1 Processor -- start 2024-05-08T18:50:45.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.197+0000 7f6d0a935800 1 -- start start 2024-05-08T18:50:45.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.197+0000 7f6d0a935800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc9f2ba0 0x55effc9fa080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.197+0000 7f6d0a935800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55effc9f3ce0 con 0x55effc9f2ba0 2024-05-08T18:50:45.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.197+0000 7f6d06daf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc9f2ba0 0x55effc9fa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.197+0000 7f6d06daf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc9f2ba0 0x55effc9fa080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59912/0 (socket says 172.21.15.132:59912) 2024-05-08T18:50:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.197+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 learned_addr learned my addr 172.21.15.132:0/1278238848 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.197+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55effc9fa5c0 con 0x55effc9f2ba0 2024-05-08T18:50:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.198+0000 7f6d06daf640 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc9f2ba0 0x55effc9fa080 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6d00051b70 tx=0x7f6d00052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.198+0000 7f6bd7fff640 1 -- 172.21.15.132:0/1278238848 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d0002b560 con 0x55effc9f2ba0 2024-05-08T18:50:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.198+0000 7f6bd7fff640 1 -- 172.21.15.132:0/1278238848 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d0002b700 con 0x55effc9f2ba0 2024-05-08T18:50:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.198+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55effc9fa850 con 0x55effc9f2ba0 2024-05-08T18:50:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.198+0000 7f6bd7fff640 1 -- 172.21.15.132:0/1278238848 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d0003c060 con 0x55effc9f2ba0 2024-05-08T18:50:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.198+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55effc9fd500 con 0x55effc9f2ba0 2024-05-08T18:50:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.199+0000 7f6bd7fff640 1 -- 172.21.15.132:0/1278238848 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6d00054810 con 0x55effc9f2ba0 2024-05-08T18:50:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.199+0000 7f6bd7fff640 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6bd003bb50 0x7f6bd003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.199+0000 7f6bd7fff640 1 -- 172.21.15.132:0/1278238848 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f6d0000e040 con 0x55effc9f2ba0 2024-05-08T18:50:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.199+0000 7f6d065ae640 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6bd003bb50 0x7f6bd003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.199+0000 7f6d065ae640 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6bd003bb50 0x7f6bd003e010 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8050590 tx=0x7f6cf8019f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.199+0000 7f6d0a935800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.199+0000 7f6d0a935800 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55effca05d80 0x55effca08240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.199+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effca08990 con 0x55effca05d80 2024-05-08T18:50:45.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.200+0000 7f6cfddad640 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55effca05d80 0x55effca08240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.200+0000 7f6cfddad640 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55effca05d80 0x55effca08240 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.200+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6cf005a040 con 0x55effca05d80 2024-05-08T18:50:45.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.200+0000 7f6d0a935800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.200+0000 7f6d0a935800 20 realm 2024-05-08T18:50:45.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.200+0000 7f6d0a935800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.200+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effca08d60 con 0x55effca05d80 2024-05-08T18:50:45.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.200+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6cf005a040 con 0x55effca05d80 2024-05-08T18:50:45.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.200+0000 7f6d0a935800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.200+0000 7f6d0a935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:45.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.200+0000 7f6d0a935800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.200+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effca09630 con 0x55effca05d80 2024-05-08T18:50:45.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.201+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6cf005a040 con 0x55effca05d80 2024-05-08T18:50:45.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.201+0000 7f6d0a935800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.201+0000 7f6d0a935800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.201+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effca099d0 con 0x55effca05d80 2024-05-08T18:50:45.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.201+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6cf005a040 con 0x55effca05d80 2024-05-08T18:50:45.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.201+0000 7f6d0a935800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:45.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.201+0000 7f6d0a935800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.201+0000 7f6d0a935800 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55effca0a730 0x55effca0cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.201+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effca0d0e0 con 0x55effca0a730 2024-05-08T18:50:45.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.201+0000 7f6d06daf640 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55effca0a730 0x55effca0cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.201+0000 7f6d06daf640 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55effca0a730 0x55effca0cb20 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.201+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6d0002a070 con 0x55effca0a730 2024-05-08T18:50:45.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.201+0000 7f6d0a935800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:45.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.201+0000 7f6d0a935800 20 searching for the correct realm 2024-05-08T18:50:45.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.202+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effca0ea30 con 0x55effca0a730 2024-05-08T18:50:45.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.202+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0002a070 con 0x55effca0a730 2024-05-08T18:50:45.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.202+0000 7f6d06daf640 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6d00014070 0x7f6d000513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.202+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effca0ea30 con 0x7f6d00014070 2024-05-08T18:50:45.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.202+0000 7f6d065ae640 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6d00014070 0x7f6d000513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.202+0000 7f6d065ae640 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6d00014070 0x7f6d000513f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.203+0000 7f6d065ae640 1 -- 172.21.15.132:0/1278238848 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf802e070 con 0x7f6d00014070 2024-05-08T18:50:45.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.203+0000 7f6d065ae640 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f6cf800f070 0x7f6cf804a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.203+0000 7f6d065ae640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effca0ea30 con 0x7f6cf800f070 2024-05-08T18:50:45.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.203+0000 7f6cfddad640 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f6cf800f070 0x7f6cf804a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.203+0000 7f6cfddad640 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f6cf800f070 0x7f6cf804a680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.204+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf005a040 con 0x7f6cf800f070 2024-05-08T18:50:45.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.204+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effca0ea30 con 0x55effca05d80 2024-05-08T18:50:45.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.204+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf005a040 con 0x55effca05d80 2024-05-08T18:50:45.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.204+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effca0ea30 con 0x55effca05d80 2024-05-08T18:50:45.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.204+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf005a040 con 0x55effca05d80 2024-05-08T18:50:45.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.204+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effca0ea30 con 0x7f6cf800f070 2024-05-08T18:50:45.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.204+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf005a040 con 0x7f6cf800f070 2024-05-08T18:50:45.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.204+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effca0ea30 con 0x7f6cf800f070 2024-05-08T18:50:45.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.205+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf005a040 con 0x7f6cf800f070 2024-05-08T18:50:45.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.205+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effca0ea30 con 0x7f6d00014070 2024-05-08T18:50:45.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.205+0000 7f6d065ae640 1 -- 172.21.15.132:0/1278238848 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf802e070 con 0x7f6d00014070 2024-05-08T18:50:45.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.205+0000 7f6d065ae640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effca0ea30 con 0x55effca0a730 2024-05-08T18:50:45.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.205+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0002a070 con 0x55effca0a730 2024-05-08T18:50:45.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.205+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effca0ea30 con 0x55effca05d80 2024-05-08T18:50:45.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.205+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf005a040 con 0x55effca05d80 2024-05-08T18:50:45.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.205+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effca0ea30 con 0x7f6cf800f070 2024-05-08T18:50:45.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.206+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf005a040 con 0x7f6cf800f070 2024-05-08T18:50:45.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.206+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effca0ea30 con 0x55effca05d80 2024-05-08T18:50:45.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.206+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6cf005a040 con 0x55effca05d80 2024-05-08T18:50:45.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.206+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effca0ea30 con 0x7f6d00014070 2024-05-08T18:50:45.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.206+0000 7f6d065ae640 1 -- 172.21.15.132:0/1278238848 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6cf802e070 con 0x7f6d00014070 2024-05-08T18:50:45.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.206+0000 7f6d065ae640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f6cf8054060 con 0x55effca0a730 2024-05-08T18:50:45.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.206+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6d0002a070 con 0x55effca0a730 2024-05-08T18:50:45.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.206+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f6cf8054060 con 0x55effca0a730 2024-05-08T18:50:45.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.206+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0002a070 con 0x55effca0a730 2024-05-08T18:50:45.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.207+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f6cf8054060 con 0x7f6cf800f070 2024-05-08T18:50:45.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.207+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf005a040 con 0x7f6cf800f070 2024-05-08T18:50:45.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.207+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f6cf8054060 con 0x55effca0a730 2024-05-08T18:50:45.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.207+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0002a070 con 0x55effca0a730 2024-05-08T18:50:45.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.207+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f6cf8054060 con 0x55effca0a730 2024-05-08T18:50:45.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.207+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0002a070 con 0x55effca0a730 2024-05-08T18:50:45.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.207+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f6cf8054060 con 0x55effca05d80 2024-05-08T18:50:45.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.207+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf005a040 con 0x55effca05d80 2024-05-08T18:50:45.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.207+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f6cf8054060 con 0x55effca05d80 2024-05-08T18:50:45.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.208+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6cf005a040 con 0x55effca05d80 2024-05-08T18:50:45.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.208+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f6cf8054060 con 0x7f6cf800f070 2024-05-08T18:50:45.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.208+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf007d040 con 0x7f6cf800f070 2024-05-08T18:50:45.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.208+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f6cf8054060 con 0x55effca0a730 2024-05-08T18:50:45.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.208+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0002a070 con 0x55effca0a730 2024-05-08T18:50:45.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.208+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f6cf8054060 con 0x7f6d00014070 2024-05-08T18:50:45.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.208+0000 7f6d065ae640 1 -- 172.21.15.132:0/1278238848 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf802e070 con 0x7f6d00014070 2024-05-08T18:50:45.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.208+0000 7f6d065ae640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f6cf8054060 con 0x55effca05d80 2024-05-08T18:50:45.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.209+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf007d040 con 0x55effca05d80 2024-05-08T18:50:45.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.209+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f6cf8054060 con 0x7f6cf800f070 2024-05-08T18:50:45.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.209+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf007d040 con 0x7f6cf800f070 2024-05-08T18:50:45.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.209+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f6cf8054060 con 0x55effca0a730 2024-05-08T18:50:45.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.209+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0002a070 con 0x55effca0a730 2024-05-08T18:50:45.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.209+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f6cf8054060 con 0x7f6cf800f070 2024-05-08T18:50:45.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.209+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf007d040 con 0x7f6cf800f070 2024-05-08T18:50:45.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.209+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f6cf8054060 con 0x7f6d00014070 2024-05-08T18:50:45.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.210+0000 7f6d065ae640 1 -- 172.21.15.132:0/1278238848 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf802e070 con 0x7f6d00014070 2024-05-08T18:50:45.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.210+0000 7f6d065ae640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f6cf8054060 con 0x55effca0a730 2024-05-08T18:50:45.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.210+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0002a070 con 0x55effca0a730 2024-05-08T18:50:45.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.210+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f6cf8054060 con 0x7f6cf800f070 2024-05-08T18:50:45.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.210+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf007d040 con 0x7f6cf800f070 2024-05-08T18:50:45.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.210+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f6cf8054060 con 0x55effca05d80 2024-05-08T18:50:45.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.211+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6cf007d040 con 0x55effca05d80 2024-05-08T18:50:45.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.211+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f6cf8054060 con 0x7f6d00014070 2024-05-08T18:50:45.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.211+0000 7f6d065ae640 1 -- 172.21.15.132:0/1278238848 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6cf802e070 con 0x7f6d00014070 2024-05-08T18:50:45.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.211+0000 7f6d0a935800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:45.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.211+0000 7f6d0a935800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:45.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.211+0000 7f6d0a935800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:45.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.211+0000 7f6d0a935800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:45.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.211+0000 7f6d0a935800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:45.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.211+0000 7f6d0a935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:45.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.211+0000 7f6d0a935800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.211+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effca0dad0 con 0x55effca05d80 2024-05-08T18:50:45.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.211+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6cf007d040 con 0x55effca05d80 2024-05-08T18:50:45.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.211+0000 7f6d0a935800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.211+0000 7f6d0a935800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.211+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effca0e370 con 0x55effca05d80 2024-05-08T18:50:45.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.211+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6cf007d040 con 0x55effca05d80 2024-05-08T18:50:45.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.211+0000 7f6d0a935800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:45.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.211+0000 7f6d0a935800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.211+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effca0eeb0 con 0x55effca05d80 2024-05-08T18:50:45.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.212+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6cf007d040 con 0x55effca05d80 2024-05-08T18:50:45.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.212+0000 7f6d0a935800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:45.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.212+0000 7f6d0a935800 20 zone default found 2024-05-08T18:50:45.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.212+0000 7f6d0a935800 4 Realm: () 2024-05-08T18:50:45.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.212+0000 7f6d0a935800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:45.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.212+0000 7f6d0a935800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:45.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.212+0000 7f6d0a935800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:45.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.212+0000 7f6d0a935800 20 zonegroup default 2024-05-08T18:50:45.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.212+0000 7f6d0a935800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.212+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effca0f2c0 con 0x7f6cf800f070 2024-05-08T18:50:45.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.212+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6cf007d040 con 0x7f6cf800f070 2024-05-08T18:50:45.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.212+0000 7f6d0a935800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.212+0000 7f6d0a935800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.212+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effca110e0 con 0x55effca0a730 2024-05-08T18:50:45.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.212+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d0002a070 con 0x55effca0a730 2024-05-08T18:50:45.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.212+0000 7f6d0a935800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.212+0000 7f6d0a935800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.212+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effca114d0 con 0x55effca0a730 2024-05-08T18:50:45.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.212+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d0002a070 con 0x55effca0a730 2024-05-08T18:50:45.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.212+0000 7f6d0a935800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.212+0000 7f6d0a935800 20 started sync module instance, tier type = 2024-05-08T18:50:45.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.212+0000 7f6d0a935800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:45.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.213+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca10580 con 0x7f6d00014070 2024-05-08T18:50:45.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.214+0000 7f6d065ae640 1 -- 172.21.15.132:0/1278238848 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf802e070 con 0x7f6d00014070 2024-05-08T18:50:45.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.214+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94489223956848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca101e0 con 0x7f6d00014070 2024-05-08T18:50:45.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.214+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca122f0 con 0x55effca05d80 2024-05-08T18:50:45.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.215+0000 7f6d065ae640 1 -- 172.21.15.132:0/1278238848 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94489223956848] v25'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf802e070 con 0x7f6d00014070 2024-05-08T18:50:45.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.216+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf007d040 con 0x55effca05d80 2024-05-08T18:50:45.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.216+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94489223960880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca126e0 con 0x55effca05d80 2024-05-08T18:50:45.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.216+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca13120 con 0x55effca0a730 2024-05-08T18:50:45.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.217+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d0002a070 con 0x55effca0a730 2024-05-08T18:50:45.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.217+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94489223960880] v25'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf007d040 con 0x55effca05d80 2024-05-08T18:50:45.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.217+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94489223961936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca13120 con 0x55effca0a730 2024-05-08T18:50:45.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.217+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca13ba0 con 0x7f6d00014070 2024-05-08T18:50:45.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.218+0000 7f6d065ae640 1 -- 172.21.15.132:0/1278238848 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf802e070 con 0x7f6d00014070 2024-05-08T18:50:45.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.218+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94489223968432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca14470 con 0x7f6d00014070 2024-05-08T18:50:45.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.218+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca14f70 con 0x55effca05d80 2024-05-08T18:50:45.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.218+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94489223961936] v25'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d0002a070 con 0x55effca0a730 2024-05-08T18:50:45.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.219+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf007d040 con 0x55effca05d80 2024-05-08T18:50:45.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.219+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94489223973472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca14f30 con 0x55effca05d80 2024-05-08T18:50:45.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.219+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca15a20 con 0x7f6cf800f070 2024-05-08T18:50:45.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.219+0000 7f6d065ae640 1 -- 172.21.15.132:0/1278238848 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94489223968432] v25'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf802e070 con 0x7f6d00014070 2024-05-08T18:50:45.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.220+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf007d040 con 0x7f6cf800f070 2024-05-08T18:50:45.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.220+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94489223976240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca15a20 con 0x7f6cf800f070 2024-05-08T18:50:45.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.220+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94489223973472] v25'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf007d040 con 0x55effca05d80 2024-05-08T18:50:45.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.220+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca16460 con 0x7f6cf800f070 2024-05-08T18:50:45.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.221+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(56 notify.6 [create] v25'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf007d040 con 0x7f6cf800f070 2024-05-08T18:50:45.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.221+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94489223965680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca16460 con 0x7f6cf800f070 2024-05-08T18:50:45.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.221+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94489223976240] v25'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf007d040 con 0x7f6cf800f070 2024-05-08T18:50:45.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.221+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca13fc0 con 0x7f6cf800f070 2024-05-08T18:50:45.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.222+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94489223965680] v25'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf007d040 con 0x7f6cf800f070 2024-05-08T18:50:45.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.222+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf007d040 con 0x7f6cf800f070 2024-05-08T18:50:45.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.222+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94489223978928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca163d0 con 0x7f6cf800f070 2024-05-08T18:50:45.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.222+0000 7f6d0a935800 20 add_watcher() i=0 2024-05-08T18:50:45.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.222+0000 7f6d0a935800 20 add_watcher() i=1 2024-05-08T18:50:45.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.222+0000 7f6d0a935800 20 add_watcher() i=2 2024-05-08T18:50:45.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.222+0000 7f6d0a935800 20 add_watcher() i=3 2024-05-08T18:50:45.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.222+0000 7f6d0a935800 20 add_watcher() i=4 2024-05-08T18:50:45.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.222+0000 7f6d0a935800 20 add_watcher() i=5 2024-05-08T18:50:45.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.222+0000 7f6d0a935800 20 add_watcher() i=6 2024-05-08T18:50:45.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.223+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94489223978928] v25'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf007d040 con 0x7f6cf800f070 2024-05-08T18:50:45.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.223+0000 7f6d0a935800 20 add_watcher() i=7 2024-05-08T18:50:45.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.223+0000 7f6d0a935800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:45.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.223+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effca19e50 con 0x55effca05d80 2024-05-08T18:50:45.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.223+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6cf007d040 con 0x55effca05d80 2024-05-08T18:50:45.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.223+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94489223981424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca17270 con 0x55effca05d80 2024-05-08T18:50:45.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.225+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94489223981424] v25'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6cf007d040 con 0x55effca05d80 2024-05-08T18:50:45.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.225+0000 7f6bbcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:45.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.225+0000 7f6d0a935800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:45.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.225+0000 7f6d0a935800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:45.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.225+0000 7f6d0a935800 5 note: GC not initialized 2024-05-08T18:50:45.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.225+0000 7f6b377fe640 20 reqs_thread_entry: start 2024-05-08T18:50:45.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.225+0000 7f6d0a935800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:45.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.225+0000 7f6d0a935800 20 Filter name: none 2024-05-08T18:50:45.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.225+0000 7f6b357fa640 20 reqs_thread_entry: start 2024-05-08T18:50:45.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.225+0000 7f6d0a935800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:50:45.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.225+0000 7f6d0a935800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.225+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effca4d240 con 0x55effca05d80 2024-05-08T18:50:45.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.226+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6cf007d040 con 0x55effca05d80 2024-05-08T18:50:45.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.226+0000 7f6d0a935800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:45.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.226+0000 7f6d0a935800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:50:45.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.226+0000 7f6d0a935800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:45.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.226+0000 7f6d0a935800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:45.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.226+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effca4cd20 con 0x7f6d00014070 2024-05-08T18:50:45.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.226+0000 7f6d065ae640 1 -- 172.21.15.132:0/1278238848 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f6cf802e070 con 0x7f6d00014070 2024-05-08T18:50:45.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.226+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca53420 con 0x55effca05d80 2024-05-08T18:50:45.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.227+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v25'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6cf007d040 con 0x55effca05d80 2024-05-08T18:50:45.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.227+0000 7f6d0a935800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:45.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.227+0000 7f6d0a935800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:45.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.227+0000 7f6d0a935800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:50:45.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.227+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94489224228544 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effca50090 con 0x55effca05d80 2024-05-08T18:50:45.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.227+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== watch-notify(notify (1) cookie 94489223973472 notify 107374182401 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55effc844180 con 0x55effca05d80 2024-05-08T18:50:45.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.227+0000 7f6be9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182401 cookie 94489223973472 notifier 4305 bl.length()=567 2024-05-08T18:50:45.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.227+0000 7f6be9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:45.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.227+0000 7f6be9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:45.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.227+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(65 notify.4 [notify cookie 94489224228544 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6cf007d040 con 0x55effca05d80 2024-05-08T18:50:45.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.227+0000 7f6be9ffb640 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f6bcc003ea0 con 0x55effca05d80 2024-05-08T18:50:45.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.228+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf007d040 con 0x55effca05d80 2024-05-08T18:50:45.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.228+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== watch-notify(notify_complete (2) cookie 94489224228544 notify 107374182401 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6cf005db20 con 0x55effca05d80 2024-05-08T18:50:45.238 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:50:44.835566Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:44.835553Z","tags":[],"group_ids":[]} 2024-05-08T18:50:45.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.229+0000 7f6bbcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:45.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.229+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94489223981424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca01d60 con 0x55effca05d80 2024-05-08T18:50:45.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.230+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94489223981424] v25'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6cf007d040 con 0x55effca05d80 2024-05-08T18:50:45.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.230+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94489223956848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca16970 con 0x7f6d00014070 2024-05-08T18:50:45.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.231+0000 7f6d065ae640 1 -- 172.21.15.132:0/1278238848 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94489223956848] v25'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf802e070 con 0x7f6d00014070 2024-05-08T18:50:45.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.231+0000 7f6d0a935800 20 remove_watcher() i=0 2024-05-08T18:50:45.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.231+0000 7f6d0a935800 2 removed watcher, disabling cache 2024-05-08T18:50:45.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.231+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94489223960880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca16970 con 0x55effca05d80 2024-05-08T18:50:45.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.232+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94489223960880] v25'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf007d040 con 0x55effca05d80 2024-05-08T18:50:45.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.232+0000 7f6d0a935800 20 remove_watcher() i=1 2024-05-08T18:50:45.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.232+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94489223961936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca11930 con 0x55effca0a730 2024-05-08T18:50:45.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.233+0000 7f6d06daf640 1 -- 172.21.15.132:0/1278238848 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94489223961936] v25'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d0002a070 con 0x55effca0a730 2024-05-08T18:50:45.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.233+0000 7f6d0a935800 20 remove_watcher() i=2 2024-05-08T18:50:45.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.233+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94489223968432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca16970 con 0x7f6d00014070 2024-05-08T18:50:45.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.234+0000 7f6d065ae640 1 -- 172.21.15.132:0/1278238848 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94489223968432] v25'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf802e070 con 0x7f6d00014070 2024-05-08T18:50:45.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.234+0000 7f6d0a935800 20 remove_watcher() i=3 2024-05-08T18:50:45.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.234+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94489223973472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca16970 con 0x55effca05d80 2024-05-08T18:50:45.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.237+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94489223973472] v25'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf007d040 con 0x55effca05d80 2024-05-08T18:50:45.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.237+0000 7f6d0a935800 20 remove_watcher() i=4 2024-05-08T18:50:45.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.237+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94489223976240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca14a60 con 0x7f6cf800f070 2024-05-08T18:50:45.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.238+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94489223976240] v25'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf007d040 con 0x7f6cf800f070 2024-05-08T18:50:45.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.238+0000 7f6d0a935800 20 remove_watcher() i=5 2024-05-08T18:50:45.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.238+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94489223965680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca14a60 con 0x7f6cf800f070 2024-05-08T18:50:45.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.240+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94489223965680] v25'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf007d040 con 0x7f6cf800f070 2024-05-08T18:50:45.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.240+0000 7f6d0a935800 20 remove_watcher() i=6 2024-05-08T18:50:45.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.240+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94489223978928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effca14a60 con 0x7f6cf800f070 2024-05-08T18:50:45.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.241+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94489223978928] v25'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6cf007d040 con 0x7f6cf800f070 2024-05-08T18:50:45.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.241+0000 7f6d0a935800 20 remove_watcher() i=7 2024-05-08T18:50:45.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.241+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f6cf800f070 msgr2=0x7f6cf804a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.241+0000 7f6d0a935800 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f6cf800f070 0x7f6cf804a680 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.241+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55effca05d80 msgr2=0x55effca08240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.241+0000 7f6d0a935800 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55effca05d80 0x55effca08240 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.241+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6d00014070 msgr2=0x7f6d000513f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.241+0000 7f6d0a935800 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6d00014070 0x7f6d000513f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.241+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55effca0a730 msgr2=0x55effca0cb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.241+0000 7f6d0a935800 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55effca0a730 0x55effca0cb20 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.241+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6bd003bb50 msgr2=0x7f6bd003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.241+0000 7f6d0a935800 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6bd003bb50 0x7f6bd003e010 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8050590 tx=0x7f6cf8019f90 comp rx=0 tx=0).stop 2024-05-08T18:50:45.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.241+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc9f2ba0 msgr2=0x55effc9fa080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.241+0000 7f6cfddad640 1 -- 172.21.15.132:0/1278238848 reap_dead start 2024-05-08T18:50:45.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.241+0000 7f6d0a935800 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc9f2ba0 0x55effc9fa080 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6d00051b70 tx=0x7f6d00052be0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.241+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 shutdown_connections 2024-05-08T18:50:45.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.241+0000 7f6d0a935800 1 --2- 172.21.15.132:0/1278238848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc9f2ba0 0x55effc9fa080 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.241+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 >> 172.21.15.132:0/1278238848 conn(0x55effc9eee70 msgr2=0x55effc9ec4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 shutdown_connections 2024-05-08T18:50:45.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 -- 172.21.15.132:0/1278238848 wait complete. 2024-05-08T18:50:45.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 -- 172.21.15.132:0/2767460979 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6be003bba0 msgr2=0x7f6be003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 --2- 172.21.15.132:0/2767460979 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6be003bba0 0x7f6be003e060 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55effc9d1fc0 tx=0x7f6cf8051740 comp rx=0 tx=0).stop 2024-05-08T18:50:45.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 -- 172.21.15.132:0/2767460979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc9e5890 msgr2=0x55effc9e5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 --2- 172.21.15.132:0/2767460979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc9e5890 0x55effc9e5cb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x55effc9d1f20 tx=0x7f6d00018830 comp rx=0 tx=0).stop 2024-05-08T18:50:45.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 -- 172.21.15.132:0/2767460979 shutdown_connections 2024-05-08T18:50:45.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 --2- 172.21.15.132:0/2767460979 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6be003bba0 0x7f6be003e060 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 --2- 172.21.15.132:0/2767460979 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc9e5890 0x55effc9e5cb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 -- 172.21.15.132:0/2767460979 >> 172.21.15.132:0/2767460979 conn(0x55effc9d9930 msgr2=0x55effc9d9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 -- 172.21.15.132:0/2767460979 shutdown_connections 2024-05-08T18:50:45.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 -- 172.21.15.132:0/2767460979 wait complete. 2024-05-08T18:50:45.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 -- 172.21.15.132:0/3255624912 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55effc844e00 msgr2=0x55effc9d1590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 --2- 172.21.15.132:0/3255624912 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55effc844e00 0x55effc9d1590 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 -- 172.21.15.132:0/3255624912 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55effc9d3e70 msgr2=0x55effc9d6260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 --2- 172.21.15.132:0/3255624912 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55effc9d3e70 0x55effc9d6260 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 -- 172.21.15.132:0/3255624912 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6bec03bba0 msgr2=0x7f6bec03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 --2- 172.21.15.132:0/3255624912 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6bec03bba0 0x7f6bec03e060 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000a520 tx=0x7f6cf004e000 comp rx=0 tx=0).stop 2024-05-08T18:50:45.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 -- 172.21.15.132:0/3255624912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc843a70 msgr2=0x55effc9ca350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 --2- 172.21.15.132:0/3255624912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc843a70 0x55effc9ca350 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800c010 tx=0x7f6cf8000ed0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 -- 172.21.15.132:0/3255624912 shutdown_connections 2024-05-08T18:50:45.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 --2- 172.21.15.132:0/3255624912 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55effc9d3e70 0x55effc9d6260 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 --2- 172.21.15.132:0/3255624912 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55effc844e00 0x55effc9d1590 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 --2- 172.21.15.132:0/3255624912 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6bec03bba0 0x7f6bec03e060 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 --2- 172.21.15.132:0/3255624912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effc843a70 0x55effc9ca350 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 -- 172.21.15.132:0/3255624912 >> 172.21.15.132:0/3255624912 conn(0x55effc8ca830 msgr2=0x55effc9bc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.242+0000 7f6d0a935800 1 -- 172.21.15.132:0/3255624912 shutdown_connections 2024-05-08T18:50:45.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.243+0000 7f6d0a935800 1 -- 172.21.15.132:0/3255624912 wait complete. 2024-05-08T18:50:45.250 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:50:44.835566Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:44.835553Z', 'tags': [], 'group_ids': []} 2024-05-08T18:50:45.250 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:50:45.251 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:50:45.251 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:50:45.334 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:45.334 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:45.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.336+0000 7fb6b57a2800 1 Processor -- start 2024-05-08T18:50:45.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.336+0000 7fb6b57a2800 1 -- start start 2024-05-08T18:50:45.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.336+0000 7fb6b57a2800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x56219a97ab60 0x56219a97af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.336+0000 7fb6b57a2800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56219a8ef650 con 0x56219a97b4c0 2024-05-08T18:50:45.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.336+0000 7fb6b57a2800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x56219a81ce20 con 0x56219a97ab60 2024-05-08T18:50:45.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.336+0000 7fb6b32a1640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x56219a97ab60 0x56219a97af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.336+0000 7fb6b2aa0640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x56219a97b4c0 0x56219a97b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46738/0 (socket says 172.21.15.132:46738) 2024-05-08T18:50:45.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.336+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/2062711497 learned_addr learned my addr 172.21.15.132:0/2062711497 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:50:45.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.336+0000 7fb6b32a1640 1 -- 172.21.15.132:0/2062711497 >> v1:172.21.15.42:6789/0 conn(0x56219a97b4c0 legacy=0x56219a97b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.336+0000 7fb6b229f640 1 -- 172.21.15.132:0/2062711497 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1105279573 0 0) 0x56219a8ef650 con 0x56219a97b4c0 2024-05-08T18:50:45.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.336+0000 7fb6b32a1640 1 -- 172.21.15.132:0/2062711497 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56219a97c080 con 0x56219a97ab60 2024-05-08T18:50:45.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.338+0000 7fb6b32a1640 1 --2- 172.21.15.132:0/2062711497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219a97ab60 0x56219a97af80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400a470 tx=0x7fb6a401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af37f4a2486aace server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.338+0000 7fb6b229f640 1 -- 172.21.15.132:0/2062711497 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6a4057070 con 0x56219a97ab60 2024-05-08T18:50:45.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.339+0000 7fb6b229f640 1 -- 172.21.15.132:0/2062711497 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a4052570 con 0x56219a97ab60 2024-05-08T18:50:45.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.339+0000 7fb6b229f640 1 -- 172.21.15.132:0/2062711497 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6a4052870 con 0x56219a97ab60 2024-05-08T18:50:45.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.339+0000 7fb6b57a2800 1 -- 172.21.15.132:0/2062711497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219a97ab60 msgr2=0x56219a97af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.339+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/2062711497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219a97ab60 0x56219a97af80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400a470 tx=0x7fb6a401ce90 comp rx=0 tx=0).stop 2024-05-08T18:50:45.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.339+0000 7fb6b57a2800 1 -- 172.21.15.132:0/2062711497 shutdown_connections 2024-05-08T18:50:45.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.339+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/2062711497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219a97ab60 0x56219a97af80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.339+0000 7fb6b57a2800 1 -- 172.21.15.132:0/2062711497 >> 172.21.15.132:0/2062711497 conn(0x56219a976720 msgr2=0x56219a978b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.339+0000 7fb6b57a2800 1 -- 172.21.15.132:0/2062711497 shutdown_connections 2024-05-08T18:50:45.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.339+0000 7fb6b57a2800 1 -- 172.21.15.132:0/2062711497 wait complete. 2024-05-08T18:50:45.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.353+0000 7fb6b57a2800 1 Processor -- start 2024-05-08T18:50:45.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.353+0000 7fb6b57a2800 1 -- start start 2024-05-08T18:50:45.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.353+0000 7fb6b57a2800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219a97ab60 0x56219aa6f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.353+0000 7fb6b57a2800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56219a8c75b0 con 0x56219a97ab60 2024-05-08T18:50:45.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.353+0000 7fb6b32a1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219a97ab60 0x56219aa6f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.353+0000 7fb6b32a1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219a97ab60 0x56219aa6f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59920/0 (socket says 172.21.15.132:59920) 2024-05-08T18:50:45.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.353+0000 7fb6b32a1640 1 -- 172.21.15.132:0/3715213482 learned_addr learned my addr 172.21.15.132:0/3715213482 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.353+0000 7fb6b32a1640 1 -- 172.21.15.132:0/3715213482 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56219aa6fdd0 con 0x56219a97ab60 2024-05-08T18:50:45.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.354+0000 7fb6b32a1640 1 --2- 172.21.15.132:0/3715213482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219a97ab60 0x56219aa6f800 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4055040 tx=0x7fb6a404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334f29ffd760dbee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.354+0000 7fb5a160a640 1 -- 172.21.15.132:0/3715213482 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6a4062070 con 0x56219a97ab60 2024-05-08T18:50:45.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.354+0000 7fb5a160a640 1 -- 172.21.15.132:0/3715213482 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a40528d0 con 0x56219a97ab60 2024-05-08T18:50:45.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.354+0000 7fb5a160a640 1 -- 172.21.15.132:0/3715213482 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6a4057040 con 0x56219a97ab60 2024-05-08T18:50:45.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.354+0000 7fb6b57a2800 1 -- 172.21.15.132:0/3715213482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219a97ab60 msgr2=0x56219aa6f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.354+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/3715213482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219a97ab60 0x56219aa6f800 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4055040 tx=0x7fb6a404c000 comp rx=0 tx=0).stop 2024-05-08T18:50:45.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.355+0000 7fb6b57a2800 1 -- 172.21.15.132:0/3715213482 shutdown_connections 2024-05-08T18:50:45.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.355+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/3715213482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219a97ab60 0x56219aa6f800 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.355+0000 7fb6b57a2800 1 -- 172.21.15.132:0/3715213482 >> 172.21.15.132:0/3715213482 conn(0x56219a976720 msgr2=0x56219aa6b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.355+0000 7fb6b57a2800 1 -- 172.21.15.132:0/3715213482 shutdown_connections 2024-05-08T18:50:45.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.355+0000 7fb6b57a2800 1 -- 172.21.15.132:0/3715213482 wait complete. 2024-05-08T18:50:45.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.355+0000 7fb6b57a2800 1 Processor -- start 2024-05-08T18:50:45.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.355+0000 7fb6b57a2800 1 -- start start 2024-05-08T18:50:45.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.355+0000 7fb6b57a2800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219a97ab60 0x56219aa771c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.355+0000 7fb6b57a2800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56219a97c610 con 0x56219a97ab60 2024-05-08T18:50:45.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.355+0000 7fb6b32a1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219a97ab60 0x56219aa771c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.355+0000 7fb6b32a1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219a97ab60 0x56219aa771c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59922/0 (socket says 172.21.15.132:59922) 2024-05-08T18:50:45.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.355+0000 7fb6b32a1640 1 -- 172.21.15.132:0/1767648159 learned_addr learned my addr 172.21.15.132:0/1767648159 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.356+0000 7fb6b32a1640 1 -- 172.21.15.132:0/1767648159 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56219aa77700 con 0x56219a97ab60 2024-05-08T18:50:45.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.356+0000 7fb6b32a1640 1 --2- 172.21.15.132:0/1767648159 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219a97ab60 0x56219aa771c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4000c00 tx=0x7fb6a4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.356+0000 7fb59fe07640 1 -- 172.21.15.132:0/1767648159 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6a4057050 con 0x56219a97ab60 2024-05-08T18:50:45.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.356+0000 7fb59fe07640 1 -- 172.21.15.132:0/1767648159 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a4067660 con 0x56219a97ab60 2024-05-08T18:50:45.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.356+0000 7fb6b57a2800 1 -- 172.21.15.132:0/1767648159 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56219aa77990 con 0x56219a97ab60 2024-05-08T18:50:45.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.356+0000 7fb59fe07640 1 -- 172.21.15.132:0/1767648159 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6a4062040 con 0x56219a97ab60 2024-05-08T18:50:45.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.356+0000 7fb6b57a2800 1 -- 172.21.15.132:0/1767648159 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56219aa7a640 con 0x56219a97ab60 2024-05-08T18:50:45.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.357+0000 7fb59fe07640 1 -- 172.21.15.132:0/1767648159 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb6a4067940 con 0x56219a97ab60 2024-05-08T18:50:45.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.357+0000 7fb59fe07640 1 --2- 172.21.15.132:0/1767648159 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb59803bb50 0x7fb59803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.357+0000 7fb59fe07640 1 -- 172.21.15.132:0/1767648159 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fb6a4094770 con 0x56219a97ab60 2024-05-08T18:50:45.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.357+0000 7fb6b2aa0640 1 --2- 172.21.15.132:0/1767648159 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb59803bb50 0x7fb59803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.357+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/1767648159 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56219a97b4c0 0x56219aa7e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.357+0000 7fb6b57a2800 1 -- 172.21.15.132:0/1767648159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56219aa7e990 con 0x56219a97b4c0 2024-05-08T18:50:45.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.357+0000 7fb6b3aa2640 1 --2- 172.21.15.132:0/1767648159 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56219a97b4c0 0x56219aa7e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.358+0000 7fb6b2aa0640 1 --2- 172.21.15.132:0/1767648159 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb59803bb50 0x7fb59803e010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8000c00 tx=0x7fb6a80013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.358+0000 7fb6b3aa2640 1 --2- 172.21.15.132:0/1767648159 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56219a97b4c0 0x56219aa7e400 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.358+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/1767648159 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6ac00a4a0 con 0x56219a97b4c0 2024-05-08T18:50:45.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.358+0000 7fb6b57a2800 1 -- 172.21.15.132:0/1767648159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56219aa7b9b0 con 0x56219a97b4c0 2024-05-08T18:50:45.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.358+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/1767648159 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb6ac00a4a0 con 0x56219a97b4c0 2024-05-08T18:50:45.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.358+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/1767648159 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56219aa80cd0 0x56219aa830c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.358+0000 7fb6b57a2800 1 -- 172.21.15.132:0/1767648159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56219aa837b0 con 0x56219aa80cd0 2024-05-08T18:50:45.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.358+0000 7fb6b32a1640 1 --2- 172.21.15.132:0/1767648159 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56219aa80cd0 0x56219aa830c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.359+0000 7fb6b32a1640 1 --2- 172.21.15.132:0/1767648159 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56219aa80cd0 0x56219aa830c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.359+0000 7fb6b32a1640 1 -- 172.21.15.132:0/1767648159 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb6a4064070 con 0x56219aa80cd0 2024-05-08T18:50:45.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.359+0000 7fb6b57a2800 1 -- 172.21.15.132:0/1767648159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56219aa7fb70 con 0x56219a97b4c0 2024-05-08T18:50:45.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.359+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/1767648159 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb6ac00a4a0 con 0x56219a97b4c0 2024-05-08T18:50:45.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.359+0000 7fb6b57a2800 1 -- 172.21.15.132:0/1767648159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56219aa80050 con 0x56219a97b4c0 2024-05-08T18:50:45.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.360+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/1767648159 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb6ac00a4a0 con 0x56219a97b4c0 2024-05-08T18:50:45.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.360+0000 7fb6b57a2800 1 Processor -- start 2024-05-08T18:50:45.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.360+0000 7fb6b57a2800 1 -- start start 2024-05-08T18:50:45.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.360+0000 7fb6b57a2800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219aa926f0 0x56219aa92b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.360+0000 7fb6b57a2800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56219a86dfc0 con 0x56219aa926f0 2024-05-08T18:50:45.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.360+0000 7fb6b3aa2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219aa926f0 0x56219aa92b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.360+0000 7fb6b3aa2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219aa926f0 0x56219aa92b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59928/0 (socket says 172.21.15.132:59928) 2024-05-08T18:50:45.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.360+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/3000021301 learned_addr learned my addr 172.21.15.132:0/3000021301 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.361+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/3000021301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56219aa93050 con 0x56219aa926f0 2024-05-08T18:50:45.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.361+0000 7fb6b3aa2640 1 --2- 172.21.15.132:0/3000021301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219aa926f0 0x56219aa92b10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x56219aa7ed50 tx=0x7fb6ac018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.361+0000 7fb59d602640 1 -- 172.21.15.132:0/3000021301 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6ac014450 con 0x56219aa926f0 2024-05-08T18:50:45.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.361+0000 7fb59d602640 1 -- 172.21.15.132:0/3000021301 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6ac014610 con 0x56219aa926f0 2024-05-08T18:50:45.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.361+0000 7fb6b57a2800 1 -- 172.21.15.132:0/3000021301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56219aa93ac0 con 0x56219aa926f0 2024-05-08T18:50:45.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.361+0000 7fb59d602640 1 -- 172.21.15.132:0/3000021301 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6ac014930 con 0x56219aa926f0 2024-05-08T18:50:45.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.361+0000 7fb6b57a2800 1 -- 172.21.15.132:0/3000021301 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56219aa93fc0 con 0x56219aa926f0 2024-05-08T18:50:45.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.362+0000 7fb59d602640 1 -- 172.21.15.132:0/3000021301 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb6ac011040 con 0x56219aa926f0 2024-05-08T18:50:45.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.362+0000 7fb59d602640 1 --2- 172.21.15.132:0/3000021301 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb58c03bba0 0x7fb58c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.362+0000 7fb59d602640 1 -- 172.21.15.132:0/3000021301 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fb6ac01e070 con 0x56219aa926f0 2024-05-08T18:50:45.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.362+0000 7fb6b32a1640 1 --2- 172.21.15.132:0/3000021301 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb58c03bba0 0x7fb58c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.362+0000 7fb6b57a2800 1 Processor -- start 2024-05-08T18:50:45.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.362+0000 7fb6b32a1640 1 --2- 172.21.15.132:0/3000021301 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb58c03bba0 0x7fb58c03e060 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x56219aa7ee40 tx=0x7fb6a4067cb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.362+0000 7fb6b57a2800 1 -- start start 2024-05-08T18:50:45.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.362+0000 7fb6b57a2800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219aa9fa00 0x56219aa9fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.362+0000 7fb6b57a2800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56219aa70090 con 0x56219aa9fa00 2024-05-08T18:50:45.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.363+0000 7fb6b3aa2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219aa9fa00 0x56219aa9fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.363+0000 7fb6b3aa2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219aa9fa00 0x56219aa9fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59940/0 (socket says 172.21.15.132:59940) 2024-05-08T18:50:45.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.363+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/430432671 learned_addr learned my addr 172.21.15.132:0/430432671 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.363+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/430432671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56219aaa03f0 con 0x56219aa9fa00 2024-05-08T18:50:45.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.363+0000 7fb6b3aa2640 1 --2- 172.21.15.132:0/430432671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219aa9fa00 0x56219aa9fe20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac013fd0 tx=0x7fb6ac0451b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da66e8134a8480a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.363+0000 7fb596ffd640 1 -- 172.21.15.132:0/430432671 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6ac051070 con 0x56219aa9fa00 2024-05-08T18:50:45.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.363+0000 7fb596ffd640 1 -- 172.21.15.132:0/430432671 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6ac02bc50 con 0x56219aa9fa00 2024-05-08T18:50:45.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.363+0000 7fb596ffd640 1 -- 172.21.15.132:0/430432671 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6ac0167c0 con 0x56219aa9fa00 2024-05-08T18:50:45.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.364+0000 7fb6b57a2800 1 -- 172.21.15.132:0/430432671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219aa9fa00 msgr2=0x56219aa9fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.364+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/430432671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219aa9fa00 0x56219aa9fe20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac013fd0 tx=0x7fb6ac0451b0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.364+0000 7fb6b57a2800 1 -- 172.21.15.132:0/430432671 shutdown_connections 2024-05-08T18:50:45.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.364+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/430432671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219aa9fa00 0x56219aa9fe20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.364+0000 7fb6b57a2800 1 -- 172.21.15.132:0/430432671 >> 172.21.15.132:0/430432671 conn(0x56219aa9bcd0 msgr2=0x56219aa99d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.364+0000 7fb6b57a2800 1 -- 172.21.15.132:0/430432671 shutdown_connections 2024-05-08T18:50:45.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.364+0000 7fb6b57a2800 1 -- 172.21.15.132:0/430432671 wait complete. 2024-05-08T18:50:45.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.364+0000 7fb6b57a2800 1 Processor -- start 2024-05-08T18:50:45.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.364+0000 7fb6b57a2800 1 -- start start 2024-05-08T18:50:45.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.364+0000 7fb6b57a2800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219aa9fa00 0x56219aaa6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.364+0000 7fb6b57a2800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56219aaa0b40 con 0x56219aa9fa00 2024-05-08T18:50:45.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.365+0000 7fb6b3aa2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219aa9fa00 0x56219aaa6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.365+0000 7fb6b3aa2640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219aa9fa00 0x56219aaa6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59942/0 (socket says 172.21.15.132:59942) 2024-05-08T18:50:45.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.365+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 learned_addr learned my addr 172.21.15.132:0/62497283 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.365+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56219aaa7410 con 0x56219aa9fa00 2024-05-08T18:50:45.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.365+0000 7fb6b3aa2640 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219aa9fa00 0x56219aaa6ed0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac013fd0 tx=0x7fb6ac052d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.365+0000 7fb5957fa640 1 -- 172.21.15.132:0/62497283 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6ac02be00 con 0x56219aa9fa00 2024-05-08T18:50:45.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.365+0000 7fb5957fa640 1 -- 172.21.15.132:0/62497283 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6ac02b560 con 0x56219aa9fa00 2024-05-08T18:50:45.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.365+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56219aaa7700 con 0x56219aa9fa00 2024-05-08T18:50:45.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.365+0000 7fb5957fa640 1 -- 172.21.15.132:0/62497283 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6ac02b860 con 0x56219aa9fa00 2024-05-08T18:50:45.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.365+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56219aaaa350 con 0x56219aa9fa00 2024-05-08T18:50:45.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.366+0000 7fb5957fa640 1 -- 172.21.15.132:0/62497283 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb6ac054910 con 0x56219aa9fa00 2024-05-08T18:50:45.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.366+0000 7fb5957fa640 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb57c03bba0 0x7fb57c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.366+0000 7fb5957fa640 1 -- 172.21.15.132:0/62497283 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fb6ac00e040 con 0x56219aa9fa00 2024-05-08T18:50:45.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.366+0000 7fb6b32a1640 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb57c03bba0 0x7fb57c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.366+0000 7fb6b57a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.367+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56219aab2bf0 0x56219aab50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.367+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56219aab5800 con 0x56219aab2bf0 2024-05-08T18:50:45.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.367+0000 7fb6b2aa0640 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56219aab2bf0 0x56219aab50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.367+0000 7fb6b32a1640 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb57c03bba0 0x7fb57c03e060 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4052fd0 tx=0x7fb6a4087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.367+0000 7fb6b2aa0640 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56219aab2bf0 0x56219aab50b0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.367+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6a800f5f0 con 0x56219aab2bf0 2024-05-08T18:50:45.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.367+0000 7fb6b57a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.367+0000 7fb6b57a2800 20 realm 2024-05-08T18:50:45.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.367+0000 7fb6b57a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.367+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56219aab2040 con 0x56219aab2bf0 2024-05-08T18:50:45.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.367+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6a800f5f0 con 0x56219aab2bf0 2024-05-08T18:50:45.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.367+0000 7fb6b57a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.367+0000 7fb6b57a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:45.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.367+0000 7fb6b57a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.367+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56219aab62e0 con 0x56219aab2bf0 2024-05-08T18:50:45.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.368+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6a800f5f0 con 0x56219aab2bf0 2024-05-08T18:50:45.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.368+0000 7fb6b57a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.368+0000 7fb6b57a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.368+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56219aab6bb0 con 0x56219aab2bf0 2024-05-08T18:50:45.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.368+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb6a800f5f0 con 0x56219aab2bf0 2024-05-08T18:50:45.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.368+0000 7fb6b57a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:45.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.368+0000 7fb6b57a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.368+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56219aab74b0 0x56219aab98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.368+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56219aaba020 con 0x56219aab74b0 2024-05-08T18:50:45.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.368+0000 7fb6b3aa2640 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56219aab74b0 0x56219aab98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.368+0000 7fb6b3aa2640 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56219aab74b0 0x56219aab98c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.368+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb6ac03e070 con 0x56219aab74b0 2024-05-08T18:50:45.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.368+0000 7fb6b57a2800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:45.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.368+0000 7fb6b57a2800 20 searching for the correct realm 2024-05-08T18:50:45.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.369+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x56219aab74b0 2024-05-08T18:50:45.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.369+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6ac05e040 con 0x56219aab74b0 2024-05-08T18:50:45.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.369+0000 7fb6b3aa2640 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb6ac037020 0x7fb6ac051070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.369+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x7fb6ac037020 2024-05-08T18:50:45.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.369+0000 7fb6b32a1640 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb6ac037020 0x7fb6ac051070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.369+0000 7fb6b32a1640 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb6ac037020 0x7fb6ac051070 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.370+0000 7fb6b32a1640 1 -- 172.21.15.132:0/62497283 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6a4064070 con 0x7fb6ac037020 2024-05-08T18:50:45.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.370+0000 7fb6b32a1640 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb6a40913f0 0x7fb6a408b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.370+0000 7fb6b32a1640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x7fb6a40913f0 2024-05-08T18:50:45.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.370+0000 7fb6b2aa0640 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb6a40913f0 0x7fb6a408b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.370+0000 7fb6b2aa0640 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb6a40913f0 0x7fb6a408b420 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.371+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6a800f5f0 con 0x7fb6a40913f0 2024-05-08T18:50:45.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.371+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x56219aab2bf0 2024-05-08T18:50:45.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.371+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6a800f5f0 con 0x56219aab2bf0 2024-05-08T18:50:45.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.371+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x56219aab2bf0 2024-05-08T18:50:45.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.371+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6a802b040 con 0x56219aab2bf0 2024-05-08T18:50:45.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.371+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x7fb6a40913f0 2024-05-08T18:50:45.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.371+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6a802b040 con 0x7fb6a40913f0 2024-05-08T18:50:45.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.371+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x7fb6a40913f0 2024-05-08T18:50:45.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.372+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6a802b040 con 0x7fb6a40913f0 2024-05-08T18:50:45.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.372+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x7fb6ac037020 2024-05-08T18:50:45.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.372+0000 7fb6b32a1640 1 -- 172.21.15.132:0/62497283 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6a4064070 con 0x7fb6ac037020 2024-05-08T18:50:45.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.372+0000 7fb6b32a1640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x56219aab74b0 2024-05-08T18:50:45.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.372+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6ac05e040 con 0x56219aab74b0 2024-05-08T18:50:45.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.372+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x56219aab2bf0 2024-05-08T18:50:45.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.372+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6a802b040 con 0x56219aab2bf0 2024-05-08T18:50:45.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.372+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x7fb6a40913f0 2024-05-08T18:50:45.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.373+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6a802b040 con 0x7fb6a40913f0 2024-05-08T18:50:45.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.373+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x56219aab2bf0 2024-05-08T18:50:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.373+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb6a802b040 con 0x56219aab2bf0 2024-05-08T18:50:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.373+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x7fb6ac037020 2024-05-08T18:50:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.373+0000 7fb6b32a1640 1 -- 172.21.15.132:0/62497283 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb6a4064070 con 0x7fb6ac037020 2024-05-08T18:50:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.373+0000 7fb6b32a1640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x56219aab74b0 2024-05-08T18:50:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.373+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb6ac05e040 con 0x56219aab74b0 2024-05-08T18:50:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.373+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x56219aab74b0 2024-05-08T18:50:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.374+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6ac05e040 con 0x56219aab74b0 2024-05-08T18:50:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.374+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x7fb6a40913f0 2024-05-08T18:50:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.374+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6a802b040 con 0x7fb6a40913f0 2024-05-08T18:50:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.374+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x56219aab74b0 2024-05-08T18:50:45.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.374+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6ac05e040 con 0x56219aab74b0 2024-05-08T18:50:45.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.374+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x56219aab74b0 2024-05-08T18:50:45.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.374+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6ac05e040 con 0x56219aab74b0 2024-05-08T18:50:45.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.374+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x56219aab2bf0 2024-05-08T18:50:45.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.374+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6a802b040 con 0x56219aab2bf0 2024-05-08T18:50:45.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.374+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x56219aab2bf0 2024-05-08T18:50:45.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.375+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb6a802b040 con 0x56219aab2bf0 2024-05-08T18:50:45.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.375+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x7fb6a40913f0 2024-05-08T18:50:45.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.375+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6a802b040 con 0x7fb6a40913f0 2024-05-08T18:50:45.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.375+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x56219aab74b0 2024-05-08T18:50:45.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.375+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6ac05e040 con 0x56219aab74b0 2024-05-08T18:50:45.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.375+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x7fb6ac037020 2024-05-08T18:50:45.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.375+0000 7fb6b32a1640 1 -- 172.21.15.132:0/62497283 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6a4064070 con 0x7fb6ac037020 2024-05-08T18:50:45.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.375+0000 7fb6b32a1640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x56219aab2bf0 2024-05-08T18:50:45.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.376+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6a802b040 con 0x56219aab2bf0 2024-05-08T18:50:45.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.376+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x7fb6a40913f0 2024-05-08T18:50:45.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.376+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6a803b040 con 0x7fb6a40913f0 2024-05-08T18:50:45.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.376+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x56219aab74b0 2024-05-08T18:50:45.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.376+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6ac05e040 con 0x56219aab74b0 2024-05-08T18:50:45.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.376+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x7fb6a40913f0 2024-05-08T18:50:45.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.377+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6a803b040 con 0x7fb6a40913f0 2024-05-08T18:50:45.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.377+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x7fb6ac037020 2024-05-08T18:50:45.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.377+0000 7fb6b32a1640 1 -- 172.21.15.132:0/62497283 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6a4064070 con 0x7fb6ac037020 2024-05-08T18:50:45.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.377+0000 7fb6b32a1640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x56219aab74b0 2024-05-08T18:50:45.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.377+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6ac05e040 con 0x56219aab74b0 2024-05-08T18:50:45.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.377+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x7fb6a40913f0 2024-05-08T18:50:45.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.377+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6a803b040 con 0x7fb6a40913f0 2024-05-08T18:50:45.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.377+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x56219aab2bf0 2024-05-08T18:50:45.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.378+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb6a803b040 con 0x56219aab2bf0 2024-05-08T18:50:45.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.378+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x56219aabba00 con 0x7fb6ac037020 2024-05-08T18:50:45.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.378+0000 7fb6b32a1640 1 -- 172.21.15.132:0/62497283 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6a4064070 con 0x7fb6ac037020 2024-05-08T18:50:45.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.378+0000 7fb6b57a2800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:45.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.378+0000 7fb6b57a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:45.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.378+0000 7fb6b57a2800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:45.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.378+0000 7fb6b57a2800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:45.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.378+0000 7fb6b57a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:45.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.378+0000 7fb6b57a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:45.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.378+0000 7fb6b57a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.378+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56219aabaad0 con 0x56219aab2bf0 2024-05-08T18:50:45.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.378+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6a803b040 con 0x56219aab2bf0 2024-05-08T18:50:45.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.378+0000 7fb6b57a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.378+0000 7fb6b57a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.378+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56219aaba710 con 0x56219aab2bf0 2024-05-08T18:50:45.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.378+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb6a803b040 con 0x56219aab2bf0 2024-05-08T18:50:45.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.378+0000 7fb6b57a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:45.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.378+0000 7fb6b57a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.378+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56219aabb3f0 con 0x56219aab2bf0 2024-05-08T18:50:45.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.379+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb6a803b040 con 0x56219aab2bf0 2024-05-08T18:50:45.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.379+0000 7fb6b57a2800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:45.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.379+0000 7fb6b57a2800 20 zone default found 2024-05-08T18:50:45.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.379+0000 7fb6b57a2800 4 Realm: () 2024-05-08T18:50:45.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.379+0000 7fb6b57a2800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:45.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.379+0000 7fb6b57a2800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:45.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.379+0000 7fb6b57a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:45.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.379+0000 7fb6b57a2800 20 zonegroup default 2024-05-08T18:50:45.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.379+0000 7fb6b57a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.379+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56219aabbed0 con 0x7fb6a40913f0 2024-05-08T18:50:45.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.379+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb6a803b040 con 0x7fb6a40913f0 2024-05-08T18:50:45.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.379+0000 7fb6b57a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.379+0000 7fb6b57a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.379+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56219aabdd60 con 0x56219aab74b0 2024-05-08T18:50:45.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.379+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb6ac05e040 con 0x56219aab74b0 2024-05-08T18:50:45.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.379+0000 7fb6b57a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.379+0000 7fb6b57a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.380+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56219aabe100 con 0x56219aab74b0 2024-05-08T18:50:45.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.380+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb6ac05e040 con 0x56219aab74b0 2024-05-08T18:50:45.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.380+0000 7fb6b57a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.380+0000 7fb6b57a2800 20 started sync module instance, tier type = 2024-05-08T18:50:45.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.380+0000 7fb6b57a2800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:45.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.380+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aabd1a0 con 0x7fb6ac037020 2024-05-08T18:50:45.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.381+0000 7fb6b32a1640 1 -- 172.21.15.132:0/62497283 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6a4064070 con 0x7fb6ac037020 2024-05-08T18:50:45.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.381+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94702328859888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aabe100 con 0x7fb6ac037020 2024-05-08T18:50:45.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.381+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aabe950 con 0x56219aab2bf0 2024-05-08T18:50:45.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.382+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6a803b040 con 0x56219aab2bf0 2024-05-08T18:50:45.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.382+0000 7fb6b32a1640 1 -- 172.21.15.132:0/62497283 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94702328859888] v25'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6a4064070 con 0x7fb6ac037020 2024-05-08T18:50:45.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.382+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94702328865952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aabed70 con 0x56219aab2bf0 2024-05-08T18:50:45.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.382+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aabf730 con 0x56219aab74b0 2024-05-08T18:50:45.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.383+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6ac05e040 con 0x56219aab74b0 2024-05-08T18:50:45.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.383+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94702328865952] v25'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6a803b040 con 0x56219aab2bf0 2024-05-08T18:50:45.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.383+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94702328869504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aabf700 con 0x56219aab74b0 2024-05-08T18:50:45.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.383+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aabe8c0 con 0x7fb6ac037020 2024-05-08T18:50:45.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.385+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94702328869504] v25'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6ac05e040 con 0x56219aab74b0 2024-05-08T18:50:45.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.385+0000 7fb6b32a1640 1 -- 172.21.15.132:0/62497283 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6a4064070 con 0x7fb6ac037020 2024-05-08T18:50:45.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.385+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94702328871712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aac06a0 con 0x7fb6ac037020 2024-05-08T18:50:45.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.385+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aac1060 con 0x56219aab2bf0 2024-05-08T18:50:45.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.387+0000 7fb6b32a1640 1 -- 172.21.15.132:0/62497283 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94702328871712] v25'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6a4064070 con 0x7fb6ac037020 2024-05-08T18:50:45.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.390+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6a803b040 con 0x56219aab2bf0 2024-05-08T18:50:45.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.390+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94702328875952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aac1480 con 0x56219aab2bf0 2024-05-08T18:50:45.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.390+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aac1e40 con 0x7fb6a40913f0 2024-05-08T18:50:45.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.392+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94702328875952] v25'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6a803b040 con 0x56219aab2bf0 2024-05-08T18:50:45.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.393+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6a803b040 con 0x7fb6a40913f0 2024-05-08T18:50:45.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.393+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94702328879984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aac1480 con 0x7fb6a40913f0 2024-05-08T18:50:45.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.393+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aac2850 con 0x7fb6a40913f0 2024-05-08T18:50:45.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.394+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94702328879984] v25'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6a803b040 con 0x7fb6a40913f0 2024-05-08T18:50:45.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.394+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6a803b040 con 0x7fb6a40913f0 2024-05-08T18:50:45.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.394+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94702328877008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aac2a30 con 0x7fb6a40913f0 2024-05-08T18:50:45.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.394+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aac3280 con 0x7fb6a40913f0 2024-05-08T18:50:45.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.395+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94702328877008] v25'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6a803b040 con 0x7fb6a40913f0 2024-05-08T18:50:45.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.395+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6a803b040 con 0x7fb6a40913f0 2024-05-08T18:50:45.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.395+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94702328883040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aac3090 con 0x7fb6a40913f0 2024-05-08T18:50:45.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.395+0000 7fb6b57a2800 20 add_watcher() i=0 2024-05-08T18:50:45.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.395+0000 7fb6b57a2800 20 add_watcher() i=1 2024-05-08T18:50:45.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.395+0000 7fb6b57a2800 20 add_watcher() i=2 2024-05-08T18:50:45.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.395+0000 7fb6b57a2800 20 add_watcher() i=3 2024-05-08T18:50:45.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.395+0000 7fb6b57a2800 20 add_watcher() i=4 2024-05-08T18:50:45.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.395+0000 7fb6b57a2800 20 add_watcher() i=5 2024-05-08T18:50:45.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.395+0000 7fb6b57a2800 20 add_watcher() i=6 2024-05-08T18:50:45.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.396+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94702328883040] v25'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6a803b040 con 0x7fb6a40913f0 2024-05-08T18:50:45.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.396+0000 7fb6b57a2800 20 add_watcher() i=7 2024-05-08T18:50:45.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.396+0000 7fb6b57a2800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:45.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.396+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56219aac6600 con 0x56219aab2bf0 2024-05-08T18:50:45.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.397+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb6a803b040 con 0x56219aab2bf0 2024-05-08T18:50:45.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.397+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94702328884096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aac3ac0 con 0x56219aab2bf0 2024-05-08T18:50:45.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.397+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94702328884096] v25'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb6a803b040 con 0x56219aab2bf0 2024-05-08T18:50:45.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.398+0000 7fb569fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:45.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.398+0000 7fb6b57a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:45.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.398+0000 7fb6b57a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:45.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.398+0000 7fb6b57a2800 5 note: GC not initialized 2024-05-08T18:50:45.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.398+0000 7fb568fe1640 20 reqs_thread_entry: start 2024-05-08T18:50:45.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.398+0000 7fb6b57a2800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:45.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.398+0000 7fb6b57a2800 20 Filter name: none 2024-05-08T18:50:45.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.398+0000 7fb4e27fc640 20 reqs_thread_entry: start 2024-05-08T18:50:45.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.398+0000 7fb6b57a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.398+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x56219aaf9680 con 0x56219aab2bf0 2024-05-08T18:50:45.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.399+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb6a803b040 con 0x56219aab2bf0 2024-05-08T18:50:45.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.399+0000 7fb6b57a2800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:45.401 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:50:44.835566Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:44.835553Z","tags":[],"group_ids":[]} 2024-05-08T18:50:45.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.400+0000 7fb569fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:45.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.400+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94702328884096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aac5fe0 con 0x56219aab2bf0 2024-05-08T18:50:45.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.401+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94702328884096] v25'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb6a803b040 con 0x56219aab2bf0 2024-05-08T18:50:45.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.401+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94702328859888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aac2b80 con 0x7fb6ac037020 2024-05-08T18:50:45.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.402+0000 7fb6b32a1640 1 -- 172.21.15.132:0/62497283 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94702328859888] v25'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6a4064070 con 0x7fb6ac037020 2024-05-08T18:50:45.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.402+0000 7fb6b57a2800 20 remove_watcher() i=0 2024-05-08T18:50:45.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.402+0000 7fb6b57a2800 2 removed watcher, disabling cache 2024-05-08T18:50:45.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.402+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94702328865952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aac2b80 con 0x56219aab2bf0 2024-05-08T18:50:45.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.403+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94702328865952] v25'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6a803b040 con 0x56219aab2bf0 2024-05-08T18:50:45.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.403+0000 7fb6b57a2800 20 remove_watcher() i=1 2024-05-08T18:50:45.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.403+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94702328869504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aabe4a0 con 0x56219aab74b0 2024-05-08T18:50:45.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.404+0000 7fb6b3aa2640 1 -- 172.21.15.132:0/62497283 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94702328869504] v25'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6ac05e040 con 0x56219aab74b0 2024-05-08T18:50:45.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.404+0000 7fb6b57a2800 20 remove_watcher() i=2 2024-05-08T18:50:45.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.404+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94702328871712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aac2b80 con 0x7fb6ac037020 2024-05-08T18:50:45.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.405+0000 7fb6b32a1640 1 -- 172.21.15.132:0/62497283 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94702328871712] v25'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6a4064070 con 0x7fb6ac037020 2024-05-08T18:50:45.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.405+0000 7fb6b57a2800 20 remove_watcher() i=3 2024-05-08T18:50:45.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.405+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94702328875952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aabf280 con 0x56219aab2bf0 2024-05-08T18:50:45.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.406+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94702328875952] v25'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6a803b040 con 0x56219aab2bf0 2024-05-08T18:50:45.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.406+0000 7fb6b57a2800 20 remove_watcher() i=4 2024-05-08T18:50:45.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.406+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94702328879984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aabe4a0 con 0x7fb6a40913f0 2024-05-08T18:50:45.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.407+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94702328879984] v25'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6a803b040 con 0x7fb6a40913f0 2024-05-08T18:50:45.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.407+0000 7fb6b57a2800 20 remove_watcher() i=5 2024-05-08T18:50:45.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.407+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94702328877008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aabfb20 con 0x7fb6a40913f0 2024-05-08T18:50:45.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.408+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94702328877008] v25'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6a803b040 con 0x7fb6a40913f0 2024-05-08T18:50:45.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.408+0000 7fb6b57a2800 20 remove_watcher() i=6 2024-05-08T18:50:45.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.408+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94702328883040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x56219aac2b80 con 0x7fb6a40913f0 2024-05-08T18:50:45.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.409+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94702328883040] v25'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6a803b040 con 0x7fb6a40913f0 2024-05-08T18:50:45.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.409+0000 7fb6b57a2800 20 remove_watcher() i=7 2024-05-08T18:50:45.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.409+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb6a40913f0 msgr2=0x7fb6a408b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.409+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb6a40913f0 0x7fb6a408b420 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.409+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56219aab2bf0 msgr2=0x56219aab50b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.409+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56219aab2bf0 0x56219aab50b0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.409+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb6ac037020 msgr2=0x7fb6ac051070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.409+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb6ac037020 0x7fb6ac051070 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.409+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56219aab74b0 msgr2=0x56219aab98c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.409+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56219aab74b0 0x56219aab98c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.409+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb57c03bba0 msgr2=0x7fb57c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.409+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb57c03bba0 0x7fb57c03e060 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4052fd0 tx=0x7fb6a4087000 comp rx=0 tx=0).stop 2024-05-08T18:50:45.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.409+0000 7fb6b2aa0640 1 -- 172.21.15.132:0/62497283 reap_dead start 2024-05-08T18:50:45.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.409+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219aa9fa00 msgr2=0x56219aaa6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.409+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219aa9fa00 0x56219aaa6ed0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac013fd0 tx=0x7fb6ac052d20 comp rx=0 tx=0).stop 2024-05-08T18:50:45.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.409+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 shutdown_connections 2024-05-08T18:50:45.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.409+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/62497283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219aa9fa00 0x56219aaa6ed0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.409+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 >> 172.21.15.132:0/62497283 conn(0x56219aa9bcd0 msgr2=0x56219aa99330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.409+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 shutdown_connections 2024-05-08T18:50:45.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.409+0000 7fb6b57a2800 1 -- 172.21.15.132:0/62497283 wait complete. 2024-05-08T18:50:45.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 -- 172.21.15.132:0/3000021301 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb58c03bba0 msgr2=0x7fb58c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/3000021301 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb58c03bba0 0x7fb58c03e060 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x56219aa7ee40 tx=0x7fb6a4067cb0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 -- 172.21.15.132:0/3000021301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219aa926f0 msgr2=0x56219aa92b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/3000021301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219aa926f0 0x56219aa92b10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x56219aa7ed50 tx=0x7fb6ac018830 comp rx=0 tx=0).stop 2024-05-08T18:50:45.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 -- 172.21.15.132:0/3000021301 shutdown_connections 2024-05-08T18:50:45.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/3000021301 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb58c03bba0 0x7fb58c03e060 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/3000021301 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219aa926f0 0x56219aa92b10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 -- 172.21.15.132:0/3000021301 >> 172.21.15.132:0/3000021301 conn(0x56219aa86790 msgr2=0x56219aa86b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 -- 172.21.15.132:0/3000021301 shutdown_connections 2024-05-08T18:50:45.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 -- 172.21.15.132:0/3000021301 wait complete. 2024-05-08T18:50:45.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 -- 172.21.15.132:0/1767648159 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56219a97b4c0 msgr2=0x56219aa7e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/1767648159 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56219a97b4c0 0x56219aa7e400 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 -- 172.21.15.132:0/1767648159 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56219aa80cd0 msgr2=0x56219aa830c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/1767648159 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56219aa80cd0 0x56219aa830c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 -- 172.21.15.132:0/1767648159 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb59803bb50 msgr2=0x7fb59803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/1767648159 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb59803bb50 0x7fb59803e010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8000c00 tx=0x7fb6a80013b0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 -- 172.21.15.132:0/1767648159 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219a97ab60 msgr2=0x56219aa771c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/1767648159 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219a97ab60 0x56219aa771c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4000c00 tx=0x7fb6a4002fb0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 -- 172.21.15.132:0/1767648159 shutdown_connections 2024-05-08T18:50:45.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/1767648159 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56219aa80cd0 0x56219aa830c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/1767648159 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56219a97b4c0 0x56219aa7e400 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/1767648159 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb59803bb50 0x7fb59803e010 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 --2- 172.21.15.132:0/1767648159 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56219a97ab60 0x56219aa771c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 -- 172.21.15.132:0/1767648159 >> 172.21.15.132:0/1767648159 conn(0x56219a976720 msgr2=0x56219aa69920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 -- 172.21.15.132:0/1767648159 shutdown_connections 2024-05-08T18:50:45.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.410+0000 7fb6b57a2800 1 -- 172.21.15.132:0/1767648159 wait complete. 2024-05-08T18:50:45.418 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:50:44.835566Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:44.835553Z', 'tags': [], 'group_ids': []} 2024-05-08T18:50:45.418 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-05-08T18:50:45.418 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-05-08T18:50:45.418 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-05-08T18:50:45.462 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:45.462 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:45.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.463+0000 7fcdd0c85800 1 Processor -- start 2024-05-08T18:50:45.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.464+0000 7fcdd0c85800 1 -- start start 2024-05-08T18:50:45.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.464+0000 7fcdd0c85800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55e06c509140 0x55e06c509560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.464+0000 7fcdd0c85800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e06c509be0 con 0x55e06c50a3a0 2024-05-08T18:50:45.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.464+0000 7fcdd0c85800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55e06c3aae20 con 0x55e06c509140 2024-05-08T18:50:45.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.464+0000 7fcdce77d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55e06c509140 0x55e06c509560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.464+0000 7fcdce77d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55e06c509140 0x55e06c509560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59958/0 (socket says 172.21.15.132:59958) 2024-05-08T18:50:45.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.464+0000 7fcdcdf7c640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55e06c50a3a0 0x55e06c50a820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46742/0 (socket says 172.21.15.132:46742) 2024-05-08T18:50:45.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.464+0000 7fcdce77d640 1 -- 172.21.15.132:0/3500449444 learned_addr learned my addr 172.21.15.132:0/3500449444 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.464+0000 7fcdce77d640 1 -- 172.21.15.132:0/3500449444 >> v1:172.21.15.42:6789/0 conn(0x55e06c50a3a0 legacy=0x55e06c50a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.464+0000 7fcdce77d640 1 -- 172.21.15.132:0/3500449444 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e06c50af60 con 0x55e06c509140 2024-05-08T18:50:45.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.466+0000 7fcdce77d640 1 --2- 172.21.15.132:0/3500449444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c509140 0x55e06c509560 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0005fd0 tx=0x7fcdc001cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7459ec7ba63590f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.466+0000 7fcdcd77b640 1 -- 172.21.15.132:0/3500449444 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc0052540 con 0x55e06c509140 2024-05-08T18:50:45.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.466+0000 7fcdcd77b640 1 -- 172.21.15.132:0/3500449444 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc004e070 con 0x55e06c509140 2024-05-08T18:50:45.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.466+0000 7fcdcd77b640 1 -- 172.21.15.132:0/3500449444 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc0052890 con 0x55e06c509140 2024-05-08T18:50:45.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.467+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3500449444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c509140 msgr2=0x55e06c509560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.467+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/3500449444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c509140 0x55e06c509560 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0005fd0 tx=0x7fcdc001cd80 comp rx=0 tx=0).stop 2024-05-08T18:50:45.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.467+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3500449444 shutdown_connections 2024-05-08T18:50:45.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.467+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/3500449444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c509140 0x55e06c509560 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.467+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3500449444 >> 172.21.15.132:0/3500449444 conn(0x55e06c504720 msgr2=0x55e06c506b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.467+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3500449444 shutdown_connections 2024-05-08T18:50:45.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.467+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3500449444 wait complete. 2024-05-08T18:50:45.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.481+0000 7fcdd0c85800 1 Processor -- start 2024-05-08T18:50:45.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.481+0000 7fcdd0c85800 1 -- start start 2024-05-08T18:50:45.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.481+0000 7fcdd0c85800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c509140 0x55e06c47d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.481+0000 7fcdd0c85800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e06c4555b0 con 0x55e06c509140 2024-05-08T18:50:45.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.481+0000 7fcdce77d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c509140 0x55e06c47d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.481+0000 7fcdce77d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c509140 0x55e06c47d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59964/0 (socket says 172.21.15.132:59964) 2024-05-08T18:50:45.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.481+0000 7fcdce77d640 1 -- 172.21.15.132:0/3542030276 learned_addr learned my addr 172.21.15.132:0/3542030276 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.481+0000 7fcdce77d640 1 -- 172.21.15.132:0/3542030276 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e06c5fe440 con 0x55e06c509140 2024-05-08T18:50:45.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.482+0000 7fcdce77d640 1 --2- 172.21.15.132:0/3542030276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c509140 0x55e06c47d2c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000a190 tx=0x7fcdc004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0de982e883b9226 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.482+0000 7fccbc608640 1 -- 172.21.15.132:0/3542030276 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc0052410 con 0x55e06c509140 2024-05-08T18:50:45.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.482+0000 7fccbc608640 1 -- 172.21.15.132:0/3542030276 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc0062070 con 0x55e06c509140 2024-05-08T18:50:45.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.482+0000 7fccbc608640 1 -- 172.21.15.132:0/3542030276 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc0052700 con 0x55e06c509140 2024-05-08T18:50:45.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.483+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3542030276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c509140 msgr2=0x55e06c47d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.483+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/3542030276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c509140 0x55e06c47d2c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000a190 tx=0x7fcdc004c000 comp rx=0 tx=0).stop 2024-05-08T18:50:45.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.483+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3542030276 shutdown_connections 2024-05-08T18:50:45.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.483+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/3542030276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c509140 0x55e06c47d2c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.483+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3542030276 >> 172.21.15.132:0/3542030276 conn(0x55e06c504720 msgr2=0x55e06c5f5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.483+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3542030276 shutdown_connections 2024-05-08T18:50:45.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.483+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3542030276 wait complete. 2024-05-08T18:50:45.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.483+0000 7fcdd0c85800 1 Processor -- start 2024-05-08T18:50:45.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.483+0000 7fcdd0c85800 1 -- start start 2024-05-08T18:50:45.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.483+0000 7fcdd0c85800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c509140 0x55e06c603130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.483+0000 7fcdd0c85800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e06c512870 con 0x55e06c509140 2024-05-08T18:50:45.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.483+0000 7fcdce77d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c509140 0x55e06c603130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.483+0000 7fcdce77d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c509140 0x55e06c603130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59968/0 (socket says 172.21.15.132:59968) 2024-05-08T18:50:45.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.483+0000 7fcdce77d640 1 -- 172.21.15.132:0/2674503225 learned_addr learned my addr 172.21.15.132:0/2674503225 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.484+0000 7fcdce77d640 1 -- 172.21.15.132:0/2674503225 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e06c603670 con 0x55e06c509140 2024-05-08T18:50:45.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.484+0000 7fcdce77d640 1 --2- 172.21.15.132:0/2674503225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c509140 0x55e06c603130 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcdc005f040 tx=0x7fcdc0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.484+0000 7fccbae05640 1 -- 172.21.15.132:0/2674503225 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc005d630 con 0x55e06c509140 2024-05-08T18:50:45.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.484+0000 7fccbae05640 1 -- 172.21.15.132:0/2674503225 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc0058040 con 0x55e06c509140 2024-05-08T18:50:45.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.484+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2674503225 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e06c603900 con 0x55e06c509140 2024-05-08T18:50:45.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.484+0000 7fccbae05640 1 -- 172.21.15.132:0/2674503225 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc005d900 con 0x55e06c509140 2024-05-08T18:50:45.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.484+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2674503225 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e06c6065b0 con 0x55e06c509140 2024-05-08T18:50:45.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.485+0000 7fccbae05640 1 -- 172.21.15.132:0/2674503225 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fcdc0050070 con 0x55e06c509140 2024-05-08T18:50:45.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.485+0000 7fccbae05640 1 --2- 172.21.15.132:0/2674503225 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fccb403bb50 0x7fccb403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.485+0000 7fccbae05640 1 -- 172.21.15.132:0/2674503225 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fcdc00948a0 con 0x55e06c509140 2024-05-08T18:50:45.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.485+0000 7fcdcdf7c640 1 --2- 172.21.15.132:0/2674503225 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fccb403bb50 0x7fccb403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.485+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/2674503225 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e06c50a3a0 0x55e06c60a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.485+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2674503225 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e06c60a8f0 con 0x55e06c50a3a0 2024-05-08T18:50:45.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.485+0000 7fcdcef7e640 1 --2- 172.21.15.132:0/2674503225 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e06c50a3a0 0x55e06c60a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.486+0000 7fcdcdf7c640 1 --2- 172.21.15.132:0/2674503225 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fccb403bb50 0x7fccb403e010 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4000f60 tx=0x7fcdc4001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.486+0000 7fcdcef7e640 1 --2- 172.21.15.132:0/2674503225 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e06c50a3a0 0x55e06c60a370 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.486+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2674503225 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcdc80083e0 con 0x55e06c50a3a0 2024-05-08T18:50:45.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.486+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2674503225 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e06c607900 con 0x55e06c50a3a0 2024-05-08T18:50:45.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.486+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2674503225 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcdc80083e0 con 0x55e06c50a3a0 2024-05-08T18:50:45.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.486+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/2674503225 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e06c60cc30 0x55e06c60f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.486+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2674503225 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e06c60f6f0 con 0x55e06c60cc30 2024-05-08T18:50:45.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.486+0000 7fcdce77d640 1 --2- 172.21.15.132:0/2674503225 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e06c60cc30 0x55e06c60f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.486+0000 7fcdce77d640 1 --2- 172.21.15.132:0/2674503225 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e06c60cc30 0x55e06c60f020 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.487+0000 7fcdce77d640 1 -- 172.21.15.132:0/2674503225 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcdc0077020 con 0x55e06c60cc30 2024-05-08T18:50:45.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.487+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2674503225 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e06c60baa0 con 0x55e06c50a3a0 2024-05-08T18:50:45.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.487+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2674503225 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcdc80083e0 con 0x55e06c50a3a0 2024-05-08T18:50:45.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.487+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2674503225 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e06c60bf40 con 0x55e06c50a3a0 2024-05-08T18:50:45.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.487+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2674503225 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcdc80083e0 con 0x55e06c50a3a0 2024-05-08T18:50:45.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.488+0000 7fcdd0c85800 1 Processor -- start 2024-05-08T18:50:45.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.488+0000 7fcdd0c85800 1 -- start start 2024-05-08T18:50:45.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.488+0000 7fcdd0c85800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c61e640 0x55e06c61ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.488+0000 7fcdd0c85800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e06c3fbfc0 con 0x55e06c61e640 2024-05-08T18:50:45.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.488+0000 7fcdcef7e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c61e640 0x55e06c61ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.488+0000 7fcdcef7e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c61e640 0x55e06c61ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59970/0 (socket says 172.21.15.132:59970) 2024-05-08T18:50:45.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.488+0000 7fcdcef7e640 1 -- 172.21.15.132:0/3658669208 learned_addr learned my addr 172.21.15.132:0/3658669208 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.488+0000 7fcdcef7e640 1 -- 172.21.15.132:0/3658669208 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e06c61efa0 con 0x55e06c61e640 2024-05-08T18:50:45.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.489+0000 7fcdcef7e640 1 --2- 172.21.15.132:0/3658669208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c61e640 0x55e06c61ea60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55e06c604000 tx=0x7fcdc8008f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.489+0000 7fccb3fff640 1 -- 172.21.15.132:0/3658669208 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc8007ca0 con 0x55e06c61e640 2024-05-08T18:50:45.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.489+0000 7fccb3fff640 1 -- 172.21.15.132:0/3658669208 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc801e020 con 0x55e06c61e640 2024-05-08T18:50:45.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.489+0000 7fccb3fff640 1 -- 172.21.15.132:0/3658669208 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc8019420 con 0x55e06c61e640 2024-05-08T18:50:45.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.489+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3658669208 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e06c61fa10 con 0x55e06c61e640 2024-05-08T18:50:45.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.489+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3658669208 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e06c61ff10 con 0x55e06c61e640 2024-05-08T18:50:45.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.489+0000 7fccb3fff640 1 -- 172.21.15.132:0/3658669208 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fcdc8016040 con 0x55e06c61e640 2024-05-08T18:50:45.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.490+0000 7fccb3fff640 1 --2- 172.21.15.132:0/3658669208 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcca803bb50 0x7fcca803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.490+0000 7fccb3fff640 1 -- 172.21.15.132:0/3658669208 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fcdc801f030 con 0x55e06c61e640 2024-05-08T18:50:45.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.490+0000 7fcdce77d640 1 --2- 172.21.15.132:0/3658669208 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcca803bb50 0x7fcca803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.490+0000 7fcdd0c85800 1 Processor -- start 2024-05-08T18:50:45.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.490+0000 7fcdce77d640 1 --2- 172.21.15.132:0/3658669208 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcca803bb50 0x7fcca803e010 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0092f00 tx=0x7fcdc0092dd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.490+0000 7fcdd0c85800 1 -- start start 2024-05-08T18:50:45.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.490+0000 7fcdd0c85800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c62ba40 0x55e06c62be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.490+0000 7fcdd0c85800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e06c5fe6d0 con 0x55e06c62ba40 2024-05-08T18:50:45.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.490+0000 7fcdcef7e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c62ba40 0x55e06c62be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.490+0000 7fcdcef7e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c62ba40 0x55e06c62be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59976/0 (socket says 172.21.15.132:59976) 2024-05-08T18:50:45.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.490+0000 7fcdcef7e640 1 -- 172.21.15.132:0/3636690016 learned_addr learned my addr 172.21.15.132:0/3636690016 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.491+0000 7fcdcef7e640 1 -- 172.21.15.132:0/3636690016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e06c62c430 con 0x55e06c62ba40 2024-05-08T18:50:45.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.491+0000 7fcdcef7e640 1 --2- 172.21.15.132:0/3636690016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c62ba40 0x55e06c62be60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8052ee0 tx=0x7fcdc80530e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a248886886c79b5c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.491+0000 7fccb1ffb640 1 -- 172.21.15.132:0/3636690016 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc801d040 con 0x55e06c62ba40 2024-05-08T18:50:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.491+0000 7fccb1ffb640 1 -- 172.21.15.132:0/3636690016 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc8023410 con 0x55e06c62ba40 2024-05-08T18:50:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.491+0000 7fccb1ffb640 1 -- 172.21.15.132:0/3636690016 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc8019b30 con 0x55e06c62ba40 2024-05-08T18:50:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.491+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3636690016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c62ba40 msgr2=0x55e06c62be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.491+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/3636690016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c62ba40 0x55e06c62be60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcdc8052ee0 tx=0x7fcdc80530e0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.491+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3636690016 shutdown_connections 2024-05-08T18:50:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.491+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/3636690016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c62ba40 0x55e06c62be60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.491+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3636690016 >> 172.21.15.132:0/3636690016 conn(0x55e06c627cc0 msgr2=0x55e06c625d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.492+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3636690016 shutdown_connections 2024-05-08T18:50:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.492+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3636690016 wait complete. 2024-05-08T18:50:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.492+0000 7fcdd0c85800 1 Processor -- start 2024-05-08T18:50:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.492+0000 7fcdd0c85800 1 -- start start 2024-05-08T18:50:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.492+0000 7fcdd0c85800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c62ba40 0x55e06c632f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.492+0000 7fcdd0c85800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e06c62cb60 con 0x55e06c62ba40 2024-05-08T18:50:45.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.492+0000 7fcdcef7e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c62ba40 0x55e06c632f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.492+0000 7fcdcef7e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c62ba40 0x55e06c632f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59988/0 (socket says 172.21.15.132:59988) 2024-05-08T18:50:45.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.492+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 learned_addr learned my addr 172.21.15.132:0/2043292033 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.492+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e06c633490 con 0x55e06c62ba40 2024-05-08T18:50:45.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.493+0000 7fcdcef7e640 1 --2- 172.21.15.132:0/2043292033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c62ba40 0x55e06c632f50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80186f0 tx=0x7fcdc8052e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.493+0000 7fcc9ffff640 1 -- 172.21.15.132:0/2043292033 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc801d030 con 0x55e06c62ba40 2024-05-08T18:50:45.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.493+0000 7fcc9ffff640 1 -- 172.21.15.132:0/2043292033 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc804c040 con 0x55e06c62ba40 2024-05-08T18:50:45.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.493+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e06c633720 con 0x55e06c62ba40 2024-05-08T18:50:45.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.493+0000 7fcc9ffff640 1 -- 172.21.15.132:0/2043292033 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdc80544e0 con 0x55e06c62ba40 2024-05-08T18:50:45.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.493+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e06c6363d0 con 0x55e06c62ba40 2024-05-08T18:50:45.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.493+0000 7fcc9ffff640 1 -- 172.21.15.132:0/2043292033 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fcdc8054680 con 0x55e06c62ba40 2024-05-08T18:50:45.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.494+0000 7fcc9ffff640 1 --2- 172.21.15.132:0/2043292033 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcc9803bba0 0x7fcc9803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.494+0000 7fcc9ffff640 1 -- 172.21.15.132:0/2043292033 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fcdc8038ae0 con 0x55e06c62ba40 2024-05-08T18:50:45.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.494+0000 7fcdce77d640 1 --2- 172.21.15.132:0/2043292033 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcc9803bba0 0x7fcc9803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.494+0000 7fcdce77d640 1 --2- 172.21.15.132:0/2043292033 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcc9803bba0 0x7fcc9803e060 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000a170 tx=0x7fcdc0083000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.494+0000 7fcdd0c85800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.494+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/2043292033 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e06c63ea50 0x55e06c640f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.494+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e06c641660 con 0x55e06c63ea50 2024-05-08T18:50:45.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.495+0000 7fcdcdf7c640 1 --2- 172.21.15.132:0/2043292033 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e06c63ea50 0x55e06c640f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.495+0000 7fcdcdf7c640 1 --2- 172.21.15.132:0/2043292033 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e06c63ea50 0x55e06c640f10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.495+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcdc400f610 con 0x55e06c63ea50 2024-05-08T18:50:45.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.495+0000 7fcdd0c85800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.495+0000 7fcdd0c85800 20 realm 2024-05-08T18:50:45.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.495+0000 7fcdd0c85800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.495+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e06c63dea0 con 0x55e06c63ea50 2024-05-08T18:50:45.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.495+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcdc400f610 con 0x55e06c63ea50 2024-05-08T18:50:45.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.495+0000 7fcdd0c85800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.495+0000 7fcdd0c85800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:45.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.495+0000 7fcdd0c85800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.495+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e06c642150 con 0x55e06c63ea50 2024-05-08T18:50:45.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.496+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcdc400f610 con 0x55e06c63ea50 2024-05-08T18:50:45.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.496+0000 7fcdd0c85800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.496+0000 7fcdd0c85800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.496+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e06c642a20 con 0x55e06c63ea50 2024-05-08T18:50:45.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.496+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcdc400f610 con 0x55e06c63ea50 2024-05-08T18:50:45.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.496+0000 7fcdd0c85800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:45.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.496+0000 7fcdd0c85800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.496+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/2043292033 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e06c643440 0x55e06c645830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.496+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e06c645f20 con 0x55e06c643440 2024-05-08T18:50:45.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.496+0000 7fcdcef7e640 1 --2- 172.21.15.132:0/2043292033 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e06c643440 0x55e06c645830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.496+0000 7fcdcef7e640 1 --2- 172.21.15.132:0/2043292033 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e06c643440 0x55e06c645830 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.496+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcdc803e070 con 0x55e06c643440 2024-05-08T18:50:45.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.496+0000 7fcdd0c85800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:45.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.496+0000 7fcdd0c85800 20 searching for the correct realm 2024-05-08T18:50:45.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.496+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x55e06c643440 2024-05-08T18:50:45.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.497+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc805e040 con 0x55e06c643440 2024-05-08T18:50:45.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.497+0000 7fcdcef7e640 1 --2- 172.21.15.132:0/2043292033 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fcdc8046030 0x7fcdc8047a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.497+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x7fcdc8046030 2024-05-08T18:50:45.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.497+0000 7fcdce77d640 1 --2- 172.21.15.132:0/2043292033 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fcdc8046030 0x7fcdc8047a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.497+0000 7fcdce77d640 1 --2- 172.21.15.132:0/2043292033 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fcdc8046030 0x7fcdc8047a00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.498+0000 7fcdce77d640 1 -- 172.21.15.132:0/2043292033 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc009b040 con 0x7fcdc8046030 2024-05-08T18:50:45.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.498+0000 7fcdce77d640 1 --2- 172.21.15.132:0/2043292033 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fcdc0052030 0x7fcdc00657e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.498+0000 7fcdce77d640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x7fcdc0052030 2024-05-08T18:50:45.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.498+0000 7fcdcdf7c640 1 --2- 172.21.15.132:0/2043292033 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fcdc0052030 0x7fcdc00657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.498+0000 7fcdcdf7c640 1 --2- 172.21.15.132:0/2043292033 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fcdc0052030 0x7fcdc00657e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.499+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc400f610 con 0x7fcdc0052030 2024-05-08T18:50:45.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.499+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x55e06c63ea50 2024-05-08T18:50:45.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.499+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc400f610 con 0x55e06c63ea50 2024-05-08T18:50:45.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.499+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x55e06c63ea50 2024-05-08T18:50:45.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.499+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc402b040 con 0x55e06c63ea50 2024-05-08T18:50:45.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.499+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x7fcdc0052030 2024-05-08T18:50:45.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.499+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc402b040 con 0x7fcdc0052030 2024-05-08T18:50:45.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.499+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x7fcdc0052030 2024-05-08T18:50:45.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.499+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc402b040 con 0x7fcdc0052030 2024-05-08T18:50:45.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.500+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x7fcdc8046030 2024-05-08T18:50:45.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.500+0000 7fcdce77d640 1 -- 172.21.15.132:0/2043292033 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc009b040 con 0x7fcdc8046030 2024-05-08T18:50:45.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.500+0000 7fcdce77d640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x55e06c643440 2024-05-08T18:50:45.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.500+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc805e040 con 0x55e06c643440 2024-05-08T18:50:45.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.500+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x55e06c63ea50 2024-05-08T18:50:45.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.500+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc402b040 con 0x55e06c63ea50 2024-05-08T18:50:45.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.500+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x7fcdc0052030 2024-05-08T18:50:45.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.500+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc402b040 con 0x7fcdc0052030 2024-05-08T18:50:45.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.500+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x55e06c63ea50 2024-05-08T18:50:45.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.501+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcdc402b040 con 0x55e06c63ea50 2024-05-08T18:50:45.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.501+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x7fcdc8046030 2024-05-08T18:50:45.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.501+0000 7fcdce77d640 1 -- 172.21.15.132:0/2043292033 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcdc009b040 con 0x7fcdc8046030 2024-05-08T18:50:45.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.501+0000 7fcdce77d640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x55e06c643440 2024-05-08T18:50:45.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.501+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcdc805e040 con 0x55e06c643440 2024-05-08T18:50:45.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.501+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x55e06c643440 2024-05-08T18:50:45.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.501+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc805e040 con 0x55e06c643440 2024-05-08T18:50:45.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.501+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x7fcdc0052030 2024-05-08T18:50:45.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.502+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc402b040 con 0x7fcdc0052030 2024-05-08T18:50:45.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.502+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x55e06c643440 2024-05-08T18:50:45.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.502+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc805e040 con 0x55e06c643440 2024-05-08T18:50:45.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.502+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x55e06c643440 2024-05-08T18:50:45.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.502+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc805e040 con 0x55e06c643440 2024-05-08T18:50:45.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.502+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x55e06c63ea50 2024-05-08T18:50:45.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.502+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc402b040 con 0x55e06c63ea50 2024-05-08T18:50:45.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.502+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x55e06c63ea50 2024-05-08T18:50:45.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.503+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcdc402b040 con 0x55e06c63ea50 2024-05-08T18:50:45.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.503+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x7fcdc0052030 2024-05-08T18:50:45.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.503+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc402b040 con 0x7fcdc0052030 2024-05-08T18:50:45.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.503+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x55e06c643440 2024-05-08T18:50:45.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.503+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc805e040 con 0x55e06c643440 2024-05-08T18:50:45.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.503+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x7fcdc8046030 2024-05-08T18:50:45.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.503+0000 7fcdce77d640 1 -- 172.21.15.132:0/2043292033 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc009b040 con 0x7fcdc8046030 2024-05-08T18:50:45.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.503+0000 7fcdce77d640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x55e06c63ea50 2024-05-08T18:50:45.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.504+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc402b040 con 0x55e06c63ea50 2024-05-08T18:50:45.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.504+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x7fcdc0052030 2024-05-08T18:50:45.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.504+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc403b040 con 0x7fcdc0052030 2024-05-08T18:50:45.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.504+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x55e06c643440 2024-05-08T18:50:45.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.504+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc805e040 con 0x55e06c643440 2024-05-08T18:50:45.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.504+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x7fcdc0052030 2024-05-08T18:50:45.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.504+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc403b040 con 0x7fcdc0052030 2024-05-08T18:50:45.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.504+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x7fcdc8046030 2024-05-08T18:50:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.505+0000 7fcdce77d640 1 -- 172.21.15.132:0/2043292033 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc009b040 con 0x7fcdc8046030 2024-05-08T18:50:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.505+0000 7fcdce77d640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x55e06c643440 2024-05-08T18:50:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.505+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc805e040 con 0x55e06c643440 2024-05-08T18:50:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.505+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x7fcdc0052030 2024-05-08T18:50:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.505+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc403b040 con 0x7fcdc0052030 2024-05-08T18:50:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.505+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x55e06c63ea50 2024-05-08T18:50:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.506+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcdc403b040 con 0x55e06c63ea50 2024-05-08T18:50:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.506+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647870 con 0x7fcdc8046030 2024-05-08T18:50:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.506+0000 7fcdce77d640 1 -- 172.21.15.132:0/2043292033 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcdc009b040 con 0x7fcdc8046030 2024-05-08T18:50:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.506+0000 7fcdd0c85800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.506+0000 7fcdd0c85800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.506+0000 7fcdd0c85800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.506+0000 7fcdd0c85800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.506+0000 7fcdd0c85800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:45.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.506+0000 7fcdd0c85800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:45.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.506+0000 7fcdd0c85800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.506+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e06c646910 con 0x55e06c63ea50 2024-05-08T18:50:45.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.506+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcdc403b040 con 0x55e06c63ea50 2024-05-08T18:50:45.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.506+0000 7fcdd0c85800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.506+0000 7fcdd0c85800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.506+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e06c6471b0 con 0x55e06c63ea50 2024-05-08T18:50:45.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.506+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcdc403b040 con 0x55e06c63ea50 2024-05-08T18:50:45.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.506+0000 7fcdd0c85800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:45.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.506+0000 7fcdd0c85800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.506+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647cf0 con 0x55e06c63ea50 2024-05-08T18:50:45.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcdc403b040 con 0x55e06c63ea50 2024-05-08T18:50:45.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdd0c85800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:45.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdd0c85800 20 zone default found 2024-05-08T18:50:45.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdd0c85800 4 Realm: () 2024-05-08T18:50:45.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdd0c85800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:45.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdd0c85800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:45.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdd0c85800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:45.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdd0c85800 20 zonegroup default 2024-05-08T18:50:45.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdd0c85800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e06c647d30 con 0x7fcdc0052030 2024-05-08T18:50:45.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcdc403b040 con 0x7fcdc0052030 2024-05-08T18:50:45.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdd0c85800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdd0c85800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e06c649b50 con 0x55e06c643440 2024-05-08T18:50:45.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcdc805e040 con 0x55e06c643440 2024-05-08T18:50:45.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdd0c85800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdd0c85800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e06c649f40 con 0x55e06c643440 2024-05-08T18:50:45.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcdc805e040 con 0x55e06c643440 2024-05-08T18:50:45.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdd0c85800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdd0c85800 20 started sync module instance, tier type = 2024-05-08T18:50:45.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdd0c85800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:45.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.507+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c648ff0 con 0x7fcdc8046030 2024-05-08T18:50:45.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.509+0000 7fcdce77d640 1 -- 172.21.15.132:0/2043292033 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc009b040 con 0x7fcdc8046030 2024-05-08T18:50:45.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.509+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94422379563840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64a370 con 0x7fcdc8046030 2024-05-08T18:50:45.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.509+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64abc0 con 0x55e06c63ea50 2024-05-08T18:50:45.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.510+0000 7fcdce77d640 1 -- 172.21.15.132:0/2043292033 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94422379563840] v25'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc009b040 con 0x7fcdc8046030 2024-05-08T18:50:45.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.510+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc403b040 con 0x55e06c63ea50 2024-05-08T18:50:45.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.510+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94422379570960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64afe0 con 0x55e06c63ea50 2024-05-08T18:50:45.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.510+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64b830 con 0x55e06c643440 2024-05-08T18:50:45.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.511+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94422379570960] v25'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc403b040 con 0x55e06c63ea50 2024-05-08T18:50:45.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.511+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc805e040 con 0x55e06c643440 2024-05-08T18:50:45.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.511+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94422379572496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64b720 con 0x55e06c643440 2024-05-08T18:50:45.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.511+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64c2a0 con 0x7fcdc8046030 2024-05-08T18:50:45.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.512+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94422379572496] v25'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc805e040 con 0x55e06c643440 2024-05-08T18:50:45.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.512+0000 7fcdce77d640 1 -- 172.21.15.132:0/2043292033 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc009b040 con 0x7fcdc8046030 2024-05-08T18:50:45.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.512+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94422379576720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64c690 con 0x7fcdc8046030 2024-05-08T18:50:45.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.512+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64d090 con 0x55e06c63ea50 2024-05-08T18:50:45.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.513+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc403b040 con 0x55e06c63ea50 2024-05-08T18:50:45.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.513+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94422379580320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64d930 con 0x55e06c63ea50 2024-05-08T18:50:45.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.513+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64e430 con 0x7fcdc0052030 2024-05-08T18:50:45.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.513+0000 7fcdce77d640 1 -- 172.21.15.132:0/2043292033 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94422379576720] v25'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc009b040 con 0x7fcdc8046030 2024-05-08T18:50:45.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.514+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94422379580320] v25'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc403b040 con 0x55e06c63ea50 2024-05-08T18:50:45.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.514+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc403b040 con 0x7fcdc0052030 2024-05-08T18:50:45.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.514+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94422379585312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64d430 con 0x7fcdc0052030 2024-05-08T18:50:45.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.514+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64ecd0 con 0x7fcdc0052030 2024-05-08T18:50:45.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.515+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94422379585312] v25'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc403b040 con 0x7fcdc0052030 2024-05-08T18:50:45.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.515+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc403b040 con 0x7fcdc0052030 2024-05-08T18:50:45.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.515+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94422379573616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64d430 con 0x7fcdc0052030 2024-05-08T18:50:45.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.516+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64f2b0 con 0x7fcdc0052030 2024-05-08T18:50:45.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.516+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94422379573616] v25'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc403b040 con 0x7fcdc0052030 2024-05-08T18:50:45.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.517+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc403b040 con 0x7fcdc0052030 2024-05-08T18:50:45.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.517+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94422379589024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64f270 con 0x7fcdc0052030 2024-05-08T18:50:45.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.517+0000 7fcdd0c85800 20 add_watcher() i=0 2024-05-08T18:50:45.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.517+0000 7fcdd0c85800 20 add_watcher() i=1 2024-05-08T18:50:45.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.517+0000 7fcdd0c85800 20 add_watcher() i=2 2024-05-08T18:50:45.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.517+0000 7fcdd0c85800 20 add_watcher() i=3 2024-05-08T18:50:45.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.517+0000 7fcdd0c85800 20 add_watcher() i=4 2024-05-08T18:50:45.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.517+0000 7fcdd0c85800 20 add_watcher() i=5 2024-05-08T18:50:45.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.517+0000 7fcdd0c85800 20 add_watcher() i=6 2024-05-08T18:50:45.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.517+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94422379589024] v25'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc403b040 con 0x7fcdc0052030 2024-05-08T18:50:45.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.518+0000 7fcdd0c85800 20 add_watcher() i=7 2024-05-08T18:50:45.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.518+0000 7fcdd0c85800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:45.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.518+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e06c6526d0 con 0x55e06c63ea50 2024-05-08T18:50:45.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.518+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcdc403b040 con 0x55e06c63ea50 2024-05-08T18:50:45.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.518+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94422379587360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64fb80 con 0x55e06c63ea50 2024-05-08T18:50:45.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.519+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94422379587360] v25'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcdc403b040 con 0x55e06c63ea50 2024-05-08T18:50:45.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.519+0000 7fcc84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:45.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.519+0000 7fcdd0c85800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:45.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.519+0000 7fcdd0c85800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:45.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.519+0000 7fcdd0c85800 5 note: GC not initialized 2024-05-08T18:50:45.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.519+0000 7fcbff7fe640 20 reqs_thread_entry: start 2024-05-08T18:50:45.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.519+0000 7fcdd0c85800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:45.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.519+0000 7fcdd0c85800 20 Filter name: none 2024-05-08T18:50:45.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.520+0000 7fcbfd7fa640 20 reqs_thread_entry: start 2024-05-08T18:50:45.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.520+0000 7fcdd0c85800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:50:45.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.520+0000 7fcdd0c85800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.520+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e06c685ba0 con 0x55e06c63ea50 2024-05-08T18:50:45.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.520+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fcdc403b040 con 0x55e06c63ea50 2024-05-08T18:50:45.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.520+0000 7fcdd0c85800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:45.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.520+0000 7fcdd0c85800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:50:45.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.520+0000 7fcdd0c85800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:45.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.520+0000 7fcdd0c85800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:45.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.520+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e06c6884d0 con 0x7fcdc8046030 2024-05-08T18:50:45.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.520+0000 7fcdce77d640 1 -- 172.21.15.132:0/2043292033 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fcdc009b040 con 0x7fcdc8046030 2024-05-08T18:50:45.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.520+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c68bdb0 con 0x55e06c63ea50 2024-05-08T18:50:45.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.522+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v25'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fcdc403b040 con 0x55e06c63ea50 2024-05-08T18:50:45.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.522+0000 7fcdd0c85800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:45.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.522+0000 7fcdd0c85800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:45.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.522+0000 7fcdd0c85800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:50:45.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.522+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94422379837296 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e06c6874c0 con 0x55e06c63ea50 2024-05-08T18:50:45.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.522+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== watch-notify(notify (1) cookie 94422379580320 notify 107374182402 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fcdc4018040 con 0x55e06c63ea50 2024-05-08T18:50:45.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.522+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(65 notify.4 [notify cookie 94422379837296 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcdc403b040 con 0x55e06c63ea50 2024-05-08T18:50:45.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.522+0000 7fccb1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182402 cookie 94422379580320 notifier 4319 bl.length()=567 2024-05-08T18:50:45.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.522+0000 7fccb1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:45.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.522+0000 7fccb1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:45.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.522+0000 7fccb1ffb640 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7fcc94003ea0 con 0x55e06c63ea50 2024-05-08T18:50:45.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.522+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc403b040 con 0x55e06c63ea50 2024-05-08T18:50:45.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.522+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== watch-notify(notify_complete (2) cookie 94422379837296 notify 107374182402 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcdc4009050 con 0x55e06c63ea50 2024-05-08T18:50:45.531 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:50:44.835566Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:44.835553Z","tags":[],"group_ids":[]} 2024-05-08T18:50:45.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.523+0000 7fcc84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.523+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94422379587360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c687bf0 con 0x55e06c63ea50 2024-05-08T18:50:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.524+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94422379587360] v25'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcdc403b040 con 0x55e06c63ea50 2024-05-08T18:50:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.524+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94422379563840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64e720 con 0x7fcdc8046030 2024-05-08T18:50:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.525+0000 7fcdce77d640 1 -- 172.21.15.132:0/2043292033 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94422379563840] v25'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc009b040 con 0x7fcdc8046030 2024-05-08T18:50:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.525+0000 7fcdd0c85800 20 remove_watcher() i=0 2024-05-08T18:50:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.525+0000 7fcdd0c85800 2 removed watcher, disabling cache 2024-05-08T18:50:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.525+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94422379570960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64e720 con 0x55e06c63ea50 2024-05-08T18:50:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.526+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94422379570960] v25'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc403b040 con 0x55e06c63ea50 2024-05-08T18:50:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.526+0000 7fcdd0c85800 20 remove_watcher() i=1 2024-05-08T18:50:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.526+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94422379572496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64a710 con 0x55e06c643440 2024-05-08T18:50:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.527+0000 7fcdcef7e640 1 -- 172.21.15.132:0/2043292033 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94422379572496] v25'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc805e040 con 0x55e06c643440 2024-05-08T18:50:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.527+0000 7fcdd0c85800 20 remove_watcher() i=2 2024-05-08T18:50:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.527+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94422379576720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64e720 con 0x7fcdc8046030 2024-05-08T18:50:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.528+0000 7fcdce77d640 1 -- 172.21.15.132:0/2043292033 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94422379576720] v25'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc009b040 con 0x7fcdc8046030 2024-05-08T18:50:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.528+0000 7fcdd0c85800 20 remove_watcher() i=3 2024-05-08T18:50:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.528+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94422379580320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64a710 con 0x55e06c63ea50 2024-05-08T18:50:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.529+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94422379580320] v25'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc403b040 con 0x55e06c63ea50 2024-05-08T18:50:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.529+0000 7fcdd0c85800 20 remove_watcher() i=4 2024-05-08T18:50:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.529+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94422379585312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64bd90 con 0x7fcdc0052030 2024-05-08T18:50:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.530+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94422379585312] v25'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc403b040 con 0x7fcdc0052030 2024-05-08T18:50:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.530+0000 7fcdd0c85800 20 remove_watcher() i=5 2024-05-08T18:50:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.530+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94422379573616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64bd90 con 0x7fcdc0052030 2024-05-08T18:50:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.531+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94422379573616] v25'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc403b040 con 0x7fcdc0052030 2024-05-08T18:50:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.531+0000 7fcdd0c85800 20 remove_watcher() i=6 2024-05-08T18:50:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.531+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94422379589024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e06c64bd90 con 0x7fcdc0052030 2024-05-08T18:50:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94422379589024] v25'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcdc403b040 con 0x7fcdc0052030 2024-05-08T18:50:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 20 remove_watcher() i=7 2024-05-08T18:50:45.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fcdc0052030 msgr2=0x7fcdc00657e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/2043292033 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fcdc0052030 0x7fcdc00657e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e06c63ea50 msgr2=0x55e06c640f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/2043292033 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e06c63ea50 0x55e06c640f10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fcdc8046030 msgr2=0x7fcdc8047a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/2043292033 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fcdc8046030 0x7fcdc8047a00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e06c643440 msgr2=0x55e06c645830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/2043292033 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e06c643440 0x55e06c645830 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcc9803bba0 msgr2=0x7fcc9803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/2043292033 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcc9803bba0 0x7fcc9803e060 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000a170 tx=0x7fcdc0083000 comp rx=0 tx=0).stop 2024-05-08T18:50:45.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c62ba40 msgr2=0x55e06c632f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/2043292033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c62ba40 0x55e06c632f50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80186f0 tx=0x7fcdc8052e70 comp rx=0 tx=0).stop 2024-05-08T18:50:45.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 reap_dead start 2024-05-08T18:50:45.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdcdf7c640 1 -- 172.21.15.132:0/2043292033 reap_dead start 2024-05-08T18:50:45.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 shutdown_connections 2024-05-08T18:50:45.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 >> 172.21.15.132:0/2043292033 conn(0x55e06c627cc0 msgr2=0x55e06c625340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 shutdown_connections 2024-05-08T18:50:45.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2043292033 wait complete. 2024-05-08T18:50:45.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3658669208 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcca803bb50 msgr2=0x7fcca803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/3658669208 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcca803bb50 0x7fcca803e010 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0092f00 tx=0x7fcdc0092dd0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3658669208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c61e640 msgr2=0x55e06c61ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/3658669208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c61e640 0x55e06c61ea60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55e06c604000 tx=0x7fcdc8008f90 comp rx=0 tx=0).stop 2024-05-08T18:50:45.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3658669208 shutdown_connections 2024-05-08T18:50:45.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/3658669208 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcca803bb50 0x7fcca803e010 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/3658669208 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c61e640 0x55e06c61ea60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3658669208 >> 172.21.15.132:0/3658669208 conn(0x55e06c6126e0 msgr2=0x55e06c612ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3658669208 shutdown_connections 2024-05-08T18:50:45.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.533+0000 7fcdd0c85800 1 -- 172.21.15.132:0/3658669208 wait complete. 2024-05-08T18:50:45.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.534+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2674503225 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e06c50a3a0 msgr2=0x55e06c60a370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.534+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/2674503225 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e06c50a3a0 0x55e06c60a370 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.534+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2674503225 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e06c60cc30 msgr2=0x55e06c60f020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.534+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/2674503225 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e06c60cc30 0x55e06c60f020 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.534+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2674503225 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fccb403bb50 msgr2=0x7fccb403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.534+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/2674503225 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fccb403bb50 0x7fccb403e010 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4000f60 tx=0x7fcdc4001370 comp rx=0 tx=0).stop 2024-05-08T18:50:45.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.534+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2674503225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c509140 msgr2=0x55e06c603130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.534+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/2674503225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c509140 0x55e06c603130 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcdc005f040 tx=0x7fcdc0003330 comp rx=0 tx=0).stop 2024-05-08T18:50:45.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.534+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2674503225 shutdown_connections 2024-05-08T18:50:45.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.534+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/2674503225 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e06c60cc30 0x55e06c60f020 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.534+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/2674503225 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e06c50a3a0 0x55e06c60a370 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.534+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/2674503225 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fccb403bb50 0x7fccb403e010 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.534+0000 7fcdd0c85800 1 --2- 172.21.15.132:0/2674503225 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e06c509140 0x55e06c603130 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.534+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2674503225 >> 172.21.15.132:0/2674503225 conn(0x55e06c504720 msgr2=0x55e06c5f4730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.534+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2674503225 shutdown_connections 2024-05-08T18:50:45.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.534+0000 7fcdd0c85800 1 -- 172.21.15.132:0/2674503225 wait complete. 2024-05-08T18:50:45.543 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:50:44.835566Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:44.835553Z', 'tags': [], 'group_ids': []} 2024-05-08T18:50:45.543 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:50:45.543 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:50:45.543 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:50:45.587 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:45.587 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:45.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.588+0000 7fa83143f800 1 Processor -- start 2024-05-08T18:50:45.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.588+0000 7fa83143f800 1 -- start start 2024-05-08T18:50:45.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.588+0000 7fa83143f800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55a1630e37e0 0x55a1630e5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.588+0000 7fa83143f800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a1630e6110 con 0x55a1630dfcd0 2024-05-08T18:50:45.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.588+0000 7fa83143f800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55a162f7fe20 con 0x55a1630e37e0 2024-05-08T18:50:45.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.589+0000 7fa82e736640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55a1630e37e0 0x55a1630e5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.589+0000 7fa82e736640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55a1630e37e0 0x55a1630e5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59996/0 (socket says 172.21.15.132:59996) 2024-05-08T18:50:45.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.589+0000 7fa82e736640 1 -- 172.21.15.132:0/2069867218 learned_addr learned my addr 172.21.15.132:0/2069867218 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.589+0000 7fa82ef37640 1 --1- 172.21.15.132:0/2069867218 >> v1:172.21.15.42:6789/0 conn(0x55a1630dfcd0 0x55a1630e20c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46746/0 (socket says 172.21.15.132:46746) 2024-05-08T18:50:45.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.589+0000 7fa82e736640 1 -- 172.21.15.132:0/2069867218 >> v1:172.21.15.42:6789/0 conn(0x55a1630dfcd0 legacy=0x55a1630e20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.589+0000 7fa82e736640 1 -- 172.21.15.132:0/2069867218 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1630e72f0 con 0x55a1630e37e0 2024-05-08T18:50:45.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.591+0000 7fa82e736640 1 --2- 172.21.15.132:0/2069867218 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1630e37e0 0x55a1630e5bd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa82400a520 tx=0x7fa82401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbff7e3a159f08 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.591+0000 7fa82df35640 1 -- 172.21.15.132:0/2069867218 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa824057070 con 0x55a1630e37e0 2024-05-08T18:50:45.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.591+0000 7fa82df35640 1 -- 172.21.15.132:0/2069867218 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa824052570 con 0x55a1630e37e0 2024-05-08T18:50:45.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.591+0000 7fa82df35640 1 -- 172.21.15.132:0/2069867218 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa82404ae60 con 0x55a1630e37e0 2024-05-08T18:50:45.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.591+0000 7fa83143f800 1 -- 172.21.15.132:0/2069867218 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1630e37e0 msgr2=0x55a1630e5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.591+0000 7fa83143f800 1 --2- 172.21.15.132:0/2069867218 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1630e37e0 0x55a1630e5bd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa82400a520 tx=0x7fa82401d010 comp rx=0 tx=0).stop 2024-05-08T18:50:45.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.591+0000 7fa83143f800 1 -- 172.21.15.132:0/2069867218 shutdown_connections 2024-05-08T18:50:45.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.591+0000 7fa83143f800 1 --2- 172.21.15.132:0/2069867218 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1630e37e0 0x55a1630e5bd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.591+0000 7fa83143f800 1 -- 172.21.15.132:0/2069867218 >> 172.21.15.132:0/2069867218 conn(0x55a1630d9720 msgr2=0x55a1630dbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.592+0000 7fa83143f800 1 -- 172.21.15.132:0/2069867218 shutdown_connections 2024-05-08T18:50:45.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.592+0000 7fa83143f800 1 -- 172.21.15.132:0/2069867218 wait complete. 2024-05-08T18:50:45.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.605+0000 7fa83143f800 1 Processor -- start 2024-05-08T18:50:45.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.605+0000 7fa83143f800 1 -- start start 2024-05-08T18:50:45.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.606+0000 7fa83143f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1630dfcd0 0x55a1630df610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.606+0000 7fa83143f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a16302a5b0 con 0x55a1630dfcd0 2024-05-08T18:50:45.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.606+0000 7fa82ef37640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1630dfcd0 0x55a1630df610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.606+0000 7fa82ef37640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1630dfcd0 0x55a1630df610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:59998/0 (socket says 172.21.15.132:59998) 2024-05-08T18:50:45.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.606+0000 7fa82ef37640 1 -- 172.21.15.132:0/1865282449 learned_addr learned my addr 172.21.15.132:0/1865282449 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.606+0000 7fa82ef37640 1 -- 172.21.15.132:0/1865282449 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1630ddbd0 con 0x55a1630dfcd0 2024-05-08T18:50:45.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.606+0000 7fa82ef37640 1 --2- 172.21.15.132:0/1865282449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1630dfcd0 0x55a1630df610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa820001610 tx=0x7fa820006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1107826343e4ee62 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.607+0000 7fa71ce09640 1 -- 172.21.15.132:0/1865282449 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa820013420 con 0x55a1630dfcd0 2024-05-08T18:50:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.607+0000 7fa71ce09640 1 -- 172.21.15.132:0/1865282449 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8200135e0 con 0x55a1630dfcd0 2024-05-08T18:50:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.607+0000 7fa71ce09640 1 -- 172.21.15.132:0/1865282449 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa820013940 con 0x55a1630dfcd0 2024-05-08T18:50:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.607+0000 7fa83143f800 1 -- 172.21.15.132:0/1865282449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1630dfcd0 msgr2=0x55a1630df610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.607+0000 7fa83143f800 1 --2- 172.21.15.132:0/1865282449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1630dfcd0 0x55a1630df610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa820001610 tx=0x7fa820006f90 comp rx=0 tx=0).stop 2024-05-08T18:50:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.607+0000 7fa83143f800 1 -- 172.21.15.132:0/1865282449 shutdown_connections 2024-05-08T18:50:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.607+0000 7fa83143f800 1 --2- 172.21.15.132:0/1865282449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1630dfcd0 0x55a1630df610 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.607+0000 7fa83143f800 1 -- 172.21.15.132:0/1865282449 >> 172.21.15.132:0/1865282449 conn(0x55a1630d9720 msgr2=0x55a1631cbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.607+0000 7fa83143f800 1 -- 172.21.15.132:0/1865282449 shutdown_connections 2024-05-08T18:50:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.607+0000 7fa83143f800 1 -- 172.21.15.132:0/1865282449 wait complete. 2024-05-08T18:50:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.608+0000 7fa83143f800 1 Processor -- start 2024-05-08T18:50:45.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.608+0000 7fa83143f800 1 -- start start 2024-05-08T18:50:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.608+0000 7fa83143f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1630dfcd0 0x55a1631da340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.608+0000 7fa83143f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a1630e65e0 con 0x55a1630dfcd0 2024-05-08T18:50:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.608+0000 7fa82ef37640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1630dfcd0 0x55a1631da340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.608+0000 7fa82ef37640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1630dfcd0 0x55a1631da340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60008/0 (socket says 172.21.15.132:60008) 2024-05-08T18:50:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.608+0000 7fa82ef37640 1 -- 172.21.15.132:0/703845725 learned_addr learned my addr 172.21.15.132:0/703845725 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.608+0000 7fa82ef37640 1 -- 172.21.15.132:0/703845725 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1631da880 con 0x55a1630dfcd0 2024-05-08T18:50:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.608+0000 7fa82ef37640 1 --2- 172.21.15.132:0/703845725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1630dfcd0 0x55a1631da340 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa82000f000 tx=0x7fa820000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.609+0000 7fa71b606640 1 -- 172.21.15.132:0/703845725 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa820022020 con 0x55a1630dfcd0 2024-05-08T18:50:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.609+0000 7fa71b606640 1 -- 172.21.15.132:0/703845725 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa820019040 con 0x55a1630dfcd0 2024-05-08T18:50:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.609+0000 7fa83143f800 1 -- 172.21.15.132:0/703845725 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a1631dab10 con 0x55a1630dfcd0 2024-05-08T18:50:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.609+0000 7fa71b606640 1 -- 172.21.15.132:0/703845725 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa820004a40 con 0x55a1630dfcd0 2024-05-08T18:50:45.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.609+0000 7fa83143f800 1 -- 172.21.15.132:0/703845725 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1631dd7c0 con 0x55a1630dfcd0 2024-05-08T18:50:45.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.610+0000 7fa71b606640 1 -- 172.21.15.132:0/703845725 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa820025020 con 0x55a1630dfcd0 2024-05-08T18:50:45.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.610+0000 7fa71b606640 1 --2- 172.21.15.132:0/703845725 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa71403bb50 0x7fa71403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.610+0000 7fa71b606640 1 -- 172.21.15.132:0/703845725 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fa820052800 con 0x55a1630dfcd0 2024-05-08T18:50:45.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.610+0000 7fa82e736640 1 --2- 172.21.15.132:0/703845725 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa71403bb50 0x7fa71403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.610+0000 7fa83143f800 1 --2- 172.21.15.132:0/703845725 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a1630e37e0 0x55a1631e1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.610+0000 7fa83143f800 1 -- 172.21.15.132:0/703845725 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55a1631e1b50 con 0x55a1630e37e0 2024-05-08T18:50:45.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.610+0000 7fa82f738640 1 --2- 172.21.15.132:0/703845725 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a1630e37e0 0x55a1631e1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.610+0000 7fa82e736640 1 --2- 172.21.15.132:0/703845725 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa71403bb50 0x7fa71403e010 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa824054000 tx=0x7fa82404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.610+0000 7fa82f738640 1 --2- 172.21.15.132:0/703845725 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a1630e37e0 0x55a1631e1580 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.611+0000 7fa82f738640 1 -- 172.21.15.132:0/703845725 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa8280083e0 con 0x55a1630e37e0 2024-05-08T18:50:45.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.611+0000 7fa83143f800 1 -- 172.21.15.132:0/703845725 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55a1631deb10 con 0x55a1630e37e0 2024-05-08T18:50:45.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.611+0000 7fa82f738640 1 -- 172.21.15.132:0/703845725 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa8280083e0 con 0x55a1630e37e0 2024-05-08T18:50:45.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.611+0000 7fa83143f800 1 --2- 172.21.15.132:0/703845725 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a1631e3e80 0x55a1631e6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.611+0000 7fa83143f800 1 -- 172.21.15.132:0/703845725 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55a1631e6940 con 0x55a1631e3e80 2024-05-08T18:50:45.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.611+0000 7fa82ef37640 1 --2- 172.21.15.132:0/703845725 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a1631e3e80 0x55a1631e6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.611+0000 7fa82ef37640 1 --2- 172.21.15.132:0/703845725 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a1631e3e80 0x55a1631e6270 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.612+0000 7fa82ef37640 1 -- 172.21.15.132:0/703845725 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa82000f030 con 0x55a1631e3e80 2024-05-08T18:50:45.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.612+0000 7fa83143f800 1 -- 172.21.15.132:0/703845725 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55a1631e2cf0 con 0x55a1630e37e0 2024-05-08T18:50:45.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.612+0000 7fa82f738640 1 -- 172.21.15.132:0/703845725 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa8280083e0 con 0x55a1630e37e0 2024-05-08T18:50:45.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.612+0000 7fa83143f800 1 -- 172.21.15.132:0/703845725 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55a1631e31b0 con 0x55a1630e37e0 2024-05-08T18:50:45.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.612+0000 7fa82f738640 1 -- 172.21.15.132:0/703845725 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa8280083e0 con 0x55a1630e37e0 2024-05-08T18:50:45.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.612+0000 7fa83143f800 1 Processor -- start 2024-05-08T18:50:45.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.612+0000 7fa83143f800 1 -- start start 2024-05-08T18:50:45.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.613+0000 7fa83143f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1631f58a0 0x55a1631f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.613+0000 7fa83143f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a162fd0fc0 con 0x55a1631f58a0 2024-05-08T18:50:45.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.613+0000 7fa82f738640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1631f58a0 0x55a1631f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.613+0000 7fa82f738640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1631f58a0 0x55a1631f5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60020/0 (socket says 172.21.15.132:60020) 2024-05-08T18:50:45.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.613+0000 7fa82f738640 1 -- 172.21.15.132:0/3321386873 learned_addr learned my addr 172.21.15.132:0/3321386873 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.613+0000 7fa82f738640 1 -- 172.21.15.132:0/3321386873 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1631f6200 con 0x55a1631f58a0 2024-05-08T18:50:45.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.613+0000 7fa82f738640 1 --2- 172.21.15.132:0/3321386873 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1631f58a0 0x55a1631f5cc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55a1631db560 tx=0x7fa82800aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.614+0000 7fa718e01640 1 -- 172.21.15.132:0/3321386873 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa828007d00 con 0x55a1631f58a0 2024-05-08T18:50:45.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.614+0000 7fa718e01640 1 -- 172.21.15.132:0/3321386873 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa82801e020 con 0x55a1631f58a0 2024-05-08T18:50:45.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.614+0000 7fa83143f800 1 -- 172.21.15.132:0/3321386873 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a1631f6c70 con 0x55a1631f58a0 2024-05-08T18:50:45.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.614+0000 7fa718e01640 1 -- 172.21.15.132:0/3321386873 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa828019420 con 0x55a1631f58a0 2024-05-08T18:50:45.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.614+0000 7fa83143f800 1 -- 172.21.15.132:0/3321386873 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1631f7170 con 0x55a1631f58a0 2024-05-08T18:50:45.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.614+0000 7fa718e01640 1 -- 172.21.15.132:0/3321386873 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa828016040 con 0x55a1631f58a0 2024-05-08T18:50:45.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.615+0000 7fa718e01640 1 --2- 172.21.15.132:0/3321386873 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa70803bba0 0x7fa70803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.615+0000 7fa718e01640 1 -- 172.21.15.132:0/3321386873 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fa82801f030 con 0x55a1631f58a0 2024-05-08T18:50:45.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.615+0000 7fa82ef37640 1 --2- 172.21.15.132:0/3321386873 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa70803bba0 0x7fa70803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.615+0000 7fa83143f800 1 Processor -- start 2024-05-08T18:50:45.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.615+0000 7fa82ef37640 1 --2- 172.21.15.132:0/3321386873 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa70803bba0 0x7fa70803e060 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa8200108d0 tx=0x7fa820050d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.615+0000 7fa83143f800 1 -- start start 2024-05-08T18:50:45.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.615+0000 7fa83143f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a163202b20 0x55a163202f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.615+0000 7fa83143f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a1630ddf50 con 0x55a163202b20 2024-05-08T18:50:45.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.615+0000 7fa82f738640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a163202b20 0x55a163202f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.615+0000 7fa82f738640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a163202b20 0x55a163202f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60036/0 (socket says 172.21.15.132:60036) 2024-05-08T18:50:45.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.615+0000 7fa82f738640 1 -- 172.21.15.132:0/2138593850 learned_addr learned my addr 172.21.15.132:0/2138593850 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.616+0000 7fa82f738640 1 -- 172.21.15.132:0/2138593850 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a163203510 con 0x55a163202b20 2024-05-08T18:50:45.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.616+0000 7fa82f738640 1 --2- 172.21.15.132:0/2138593850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a163202b20 0x55a163202f40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa828052c60 tx=0x7fa828014c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc40833c2dd15767 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.616+0000 7fa7127fc640 1 -- 172.21.15.132:0/2138593850 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa82801d070 con 0x55a163202b20 2024-05-08T18:50:45.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.616+0000 7fa7127fc640 1 -- 172.21.15.132:0/2138593850 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa828017cd0 con 0x55a163202b20 2024-05-08T18:50:45.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.616+0000 7fa7127fc640 1 -- 172.21.15.132:0/2138593850 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa828014340 con 0x55a163202b20 2024-05-08T18:50:45.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.616+0000 7fa83143f800 1 -- 172.21.15.132:0/2138593850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a163202b20 msgr2=0x55a163202f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.616+0000 7fa83143f800 1 --2- 172.21.15.132:0/2138593850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a163202b20 0x55a163202f40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa828052c60 tx=0x7fa828014c10 comp rx=0 tx=0).stop 2024-05-08T18:50:45.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.616+0000 7fa83143f800 1 -- 172.21.15.132:0/2138593850 shutdown_connections 2024-05-08T18:50:45.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.616+0000 7fa83143f800 1 --2- 172.21.15.132:0/2138593850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a163202b20 0x55a163202f40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.616+0000 7fa83143f800 1 -- 172.21.15.132:0/2138593850 >> 172.21.15.132:0/2138593850 conn(0x55a1631fee30 msgr2=0x55a1631fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.616+0000 7fa83143f800 1 -- 172.21.15.132:0/2138593850 shutdown_connections 2024-05-08T18:50:45.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.616+0000 7fa83143f800 1 -- 172.21.15.132:0/2138593850 wait complete. 2024-05-08T18:50:45.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.617+0000 7fa83143f800 1 Processor -- start 2024-05-08T18:50:45.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.617+0000 7fa83143f800 1 -- start start 2024-05-08T18:50:45.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.617+0000 7fa83143f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a163202b20 0x55a16320a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.617+0000 7fa83143f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a163203ce0 con 0x55a163202b20 2024-05-08T18:50:45.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.617+0000 7fa82f738640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a163202b20 0x55a16320a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.617+0000 7fa82f738640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a163202b20 0x55a16320a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60052/0 (socket says 172.21.15.132:60052) 2024-05-08T18:50:45.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.617+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 learned_addr learned my addr 172.21.15.132:0/1684334367 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.617+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a16320a660 con 0x55a163202b20 2024-05-08T18:50:45.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.617+0000 7fa82f738640 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a163202b20 0x55a16320a120 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa828014c50 tx=0x7fa828052bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.618+0000 7fa710ff9640 1 -- 172.21.15.132:0/1684334367 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa828052e30 con 0x55a163202b20 2024-05-08T18:50:45.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.618+0000 7fa710ff9640 1 -- 172.21.15.132:0/1684334367 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa828045030 con 0x55a163202b20 2024-05-08T18:50:45.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.618+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a16320a8f0 con 0x55a163202b20 2024-05-08T18:50:45.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.618+0000 7fa710ff9640 1 -- 172.21.15.132:0/1684334367 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa828016330 con 0x55a163202b20 2024-05-08T18:50:45.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.618+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a16320d5a0 con 0x55a163202b20 2024-05-08T18:50:45.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.618+0000 7fa710ff9640 1 -- 172.21.15.132:0/1684334367 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa828033020 con 0x55a163202b20 2024-05-08T18:50:45.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.619+0000 7fa710ff9640 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa6f803bb30 0x7fa6f803dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.619+0000 7fa710ff9640 1 -- 172.21.15.132:0/1684334367 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fa828031020 con 0x55a163202b20 2024-05-08T18:50:45.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.619+0000 7fa82ef37640 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa6f803bb30 0x7fa6f803dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.619+0000 7fa82ef37640 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa6f803bb30 0x7fa6f803dff0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa8200046b0 tx=0x7fa820033000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.619+0000 7fa83143f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.619+0000 7fa83143f800 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a163215ca0 0x55a163218160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.619+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55a1632188b0 con 0x55a163215ca0 2024-05-08T18:50:45.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.619+0000 7fa82e736640 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a163215ca0 0x55a163218160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.620+0000 7fa82e736640 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a163215ca0 0x55a163218160 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.620+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.620+0000 7fa83143f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.620+0000 7fa83143f800 20 realm 2024-05-08T18:50:45.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.620+0000 7fa83143f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.620+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55a163218c80 con 0x55a163215ca0 2024-05-08T18:50:45.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.620+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.620+0000 7fa83143f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.620+0000 7fa83143f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:45.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.620+0000 7fa83143f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.620+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55a163219550 con 0x55a163215ca0 2024-05-08T18:50:45.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.620+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.620+0000 7fa83143f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.620+0000 7fa83143f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.620+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55a1632198f0 con 0x55a163215ca0 2024-05-08T18:50:45.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.621+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.621+0000 7fa83143f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:45.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.621+0000 7fa83143f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.621+0000 7fa83143f800 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a16321a3a0 0x55a16321c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.621+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55a16321cef0 con 0x55a16321a3a0 2024-05-08T18:50:45.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.621+0000 7fa82f738640 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a16321a3a0 0x55a16321c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.621+0000 7fa82f738640 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a16321a3a0 0x55a16321c790 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.621+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa828049050 con 0x55a16321a3a0 2024-05-08T18:50:45.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.621+0000 7fa83143f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:45.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.621+0000 7fa83143f800 20 searching for the correct realm 2024-05-08T18:50:45.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.621+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55a16321e7c0 con 0x55a16321a3a0 2024-05-08T18:50:45.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.622+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa828049050 con 0x55a16321a3a0 2024-05-08T18:50:45.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.622+0000 7fa82f738640 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa828019040 0x7fa8280547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.622+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x7fa828019040 2024-05-08T18:50:45.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.622+0000 7fa82ef37640 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa828019040 0x7fa8280547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.622+0000 7fa82ef37640 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa828019040 0x7fa8280547f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.622+0000 7fa82ef37640 1 -- 172.21.15.132:0/1684334367 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa82000f030 con 0x7fa828019040 2024-05-08T18:50:45.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.622+0000 7fa82ef37640 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa820027020 0x7fa8200493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.622+0000 7fa82ef37640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x7fa820027020 2024-05-08T18:50:45.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.623+0000 7fa82e736640 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa820027020 0x7fa8200493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.623+0000 7fa82e736640 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa820027020 0x7fa8200493f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.623+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa82405a040 con 0x7fa820027020 2024-05-08T18:50:45.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.623+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x55a163215ca0 2024-05-08T18:50:45.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.623+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.623+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x55a163215ca0 2024-05-08T18:50:45.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.624+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.624+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x7fa820027020 2024-05-08T18:50:45.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.624+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa82405a040 con 0x7fa820027020 2024-05-08T18:50:45.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.624+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x7fa820027020 2024-05-08T18:50:45.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.624+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa82405a040 con 0x7fa820027020 2024-05-08T18:50:45.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.624+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x7fa828019040 2024-05-08T18:50:45.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.624+0000 7fa82ef37640 1 -- 172.21.15.132:0/1684334367 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa82000f030 con 0x7fa828019040 2024-05-08T18:50:45.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.624+0000 7fa82ef37640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x55a16321a3a0 2024-05-08T18:50:45.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.625+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa828049050 con 0x55a16321a3a0 2024-05-08T18:50:45.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.625+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x55a163215ca0 2024-05-08T18:50:45.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.625+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.625+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x7fa820027020 2024-05-08T18:50:45.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.625+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa82405a040 con 0x7fa820027020 2024-05-08T18:50:45.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.625+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x55a163215ca0 2024-05-08T18:50:45.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.625+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.625+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x7fa828019040 2024-05-08T18:50:45.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.626+0000 7fa82ef37640 1 -- 172.21.15.132:0/1684334367 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa82000f030 con 0x7fa828019040 2024-05-08T18:50:45.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.626+0000 7fa82ef37640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x55a16321a3a0 2024-05-08T18:50:45.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.626+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa828049050 con 0x55a16321a3a0 2024-05-08T18:50:45.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.626+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x55a16321a3a0 2024-05-08T18:50:45.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.626+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa828049050 con 0x55a16321a3a0 2024-05-08T18:50:45.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.626+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x7fa820027020 2024-05-08T18:50:45.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.626+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa82405a040 con 0x7fa820027020 2024-05-08T18:50:45.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.626+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x55a16321a3a0 2024-05-08T18:50:45.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.627+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa828049050 con 0x55a16321a3a0 2024-05-08T18:50:45.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.627+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x55a16321a3a0 2024-05-08T18:50:45.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.627+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa828049050 con 0x55a16321a3a0 2024-05-08T18:50:45.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.627+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x55a163215ca0 2024-05-08T18:50:45.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.627+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.627+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x55a163215ca0 2024-05-08T18:50:45.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.627+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.627+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x7fa820027020 2024-05-08T18:50:45.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.628+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa82405a040 con 0x7fa820027020 2024-05-08T18:50:45.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.628+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x55a16321a3a0 2024-05-08T18:50:45.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.628+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa828049050 con 0x55a16321a3a0 2024-05-08T18:50:45.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.628+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x7fa828019040 2024-05-08T18:50:45.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.628+0000 7fa82ef37640 1 -- 172.21.15.132:0/1684334367 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa82000f030 con 0x7fa828019040 2024-05-08T18:50:45.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.628+0000 7fa82ef37640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x55a163215ca0 2024-05-08T18:50:45.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.628+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.628+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x7fa820027020 2024-05-08T18:50:45.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.629+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa82405a040 con 0x7fa820027020 2024-05-08T18:50:45.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.629+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x55a16321a3a0 2024-05-08T18:50:45.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.629+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa828049050 con 0x55a16321a3a0 2024-05-08T18:50:45.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.629+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x7fa820027020 2024-05-08T18:50:45.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.629+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa82405a040 con 0x7fa820027020 2024-05-08T18:50:45.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.629+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x7fa828019040 2024-05-08T18:50:45.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.629+0000 7fa82ef37640 1 -- 172.21.15.132:0/1684334367 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa82000f030 con 0x7fa828019040 2024-05-08T18:50:45.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.629+0000 7fa82ef37640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x55a16321a3a0 2024-05-08T18:50:45.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.629+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa828049050 con 0x55a16321a3a0 2024-05-08T18:50:45.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.630+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x7fa820027020 2024-05-08T18:50:45.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.630+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa82405a040 con 0x7fa820027020 2024-05-08T18:50:45.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.630+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x55a163215ca0 2024-05-08T18:50:45.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.630+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.630+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fa828035070 con 0x7fa828019040 2024-05-08T18:50:45.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.630+0000 7fa82ef37640 1 -- 172.21.15.132:0/1684334367 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa82000f030 con 0x7fa828019040 2024-05-08T18:50:45.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.630+0000 7fa83143f800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:45.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.630+0000 7fa83143f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:45.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.630+0000 7fa83143f800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:45.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.630+0000 7fa83143f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:45.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.630+0000 7fa83143f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:45.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.630+0000 7fa83143f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:45.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.630+0000 7fa83143f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.630+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55a16321d7b0 con 0x55a163215ca0 2024-05-08T18:50:45.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.631+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.631+0000 7fa83143f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.631+0000 7fa83143f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.631+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55a16321d3f0 con 0x55a163215ca0 2024-05-08T18:50:45.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.631+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.631+0000 7fa83143f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:45.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.631+0000 7fa83143f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.631+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55a16321e080 con 0x55a163215ca0 2024-05-08T18:50:45.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.631+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.631+0000 7fa83143f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:45.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.631+0000 7fa83143f800 20 zone default found 2024-05-08T18:50:45.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.631+0000 7fa83143f800 4 Realm: () 2024-05-08T18:50:45.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.631+0000 7fa83143f800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:45.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.631+0000 7fa83143f800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:45.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.631+0000 7fa83143f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:45.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.631+0000 7fa83143f800 20 zonegroup default 2024-05-08T18:50:45.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.631+0000 7fa83143f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.631+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55a16321e960 con 0x7fa820027020 2024-05-08T18:50:45.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.631+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa82405a040 con 0x7fa820027020 2024-05-08T18:50:45.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.631+0000 7fa83143f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.631+0000 7fa83143f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.631+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55a163220520 con 0x55a16321a3a0 2024-05-08T18:50:45.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.632+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa828049050 con 0x55a16321a3a0 2024-05-08T18:50:45.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.632+0000 7fa83143f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.632+0000 7fa83143f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.632+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55a163220a40 con 0x55a16321a3a0 2024-05-08T18:50:45.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.632+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa828049050 con 0x55a16321a3a0 2024-05-08T18:50:45.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.632+0000 7fa83143f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.632+0000 7fa83143f800 20 started sync module instance, tier type = 2024-05-08T18:50:45.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.632+0000 7fa83143f800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:45.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.632+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a16321f420 con 0x7fa828019040 2024-05-08T18:50:45.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.633+0000 7fa82ef37640 1 -- 172.21.15.132:0/1684334367 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa82000f030 con 0x7fa828019040 2024-05-08T18:50:45.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.633+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94151641263984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a163220ea0 con 0x7fa828019040 2024-05-08T18:50:45.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.633+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a1632216f0 con 0x55a163215ca0 2024-05-08T18:50:45.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.634+0000 7fa82ef37640 1 -- 172.21.15.132:0/1684334367 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94151641263984] v25'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa82000f030 con 0x7fa828019040 2024-05-08T18:50:45.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.634+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.634+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94151641272896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a163221b10 con 0x55a163215ca0 2024-05-08T18:50:45.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.634+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a1632223a0 con 0x55a16321a3a0 2024-05-08T18:50:45.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.635+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa828049050 con 0x55a16321a3a0 2024-05-08T18:50:45.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.635+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94151641275152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a163221fb0 con 0x55a16321a3a0 2024-05-08T18:50:45.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.635+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a163223370 con 0x7fa828019040 2024-05-08T18:50:45.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.637+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94151641272896] v25'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.637+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94151641275152] v25'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa828049050 con 0x55a16321a3a0 2024-05-08T18:50:45.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.637+0000 7fa82ef37640 1 -- 172.21.15.132:0/1684334367 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa82000f030 con 0x7fa828019040 2024-05-08T18:50:45.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.637+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94151641278352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a163221660 con 0x7fa828019040 2024-05-08T18:50:45.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.637+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a163223c10 con 0x55a163215ca0 2024-05-08T18:50:45.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.638+0000 7fa82ef37640 1 -- 172.21.15.132:0/1684334367 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94151641278352] v25'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa82000f030 con 0x7fa828019040 2024-05-08T18:50:45.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.638+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.638+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94151641280096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a163223c10 con 0x55a163215ca0 2024-05-08T18:50:45.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.638+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a163224680 con 0x7fa820027020 2024-05-08T18:50:45.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.639+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa82405a040 con 0x7fa820027020 2024-05-08T18:50:45.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.639+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94151641284976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a163224640 con 0x7fa820027020 2024-05-08T18:50:45.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.639+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a1632255c0 con 0x7fa820027020 2024-05-08T18:50:45.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.640+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94151641280096] v25'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.640+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94151641284976] v25'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa82405a040 con 0x7fa820027020 2024-05-08T18:50:45.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.641+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa82405a040 con 0x7fa820027020 2024-05-08T18:50:45.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.641+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94151641287328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a163223760 con 0x7fa820027020 2024-05-08T18:50:45.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.641+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a163225a70 con 0x7fa820027020 2024-05-08T18:50:45.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.642+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(58 notify.7 [create] v25'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa82405a040 con 0x7fa820027020 2024-05-08T18:50:45.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.642+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94151641287328] v25'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa82405a040 con 0x7fa820027020 2024-05-08T18:50:45.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.642+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94151641290176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a163225e90 con 0x7fa820027020 2024-05-08T18:50:45.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.642+0000 7fa83143f800 20 add_watcher() i=0 2024-05-08T18:50:45.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.642+0000 7fa83143f800 20 add_watcher() i=1 2024-05-08T18:50:45.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.642+0000 7fa83143f800 20 add_watcher() i=2 2024-05-08T18:50:45.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.642+0000 7fa83143f800 20 add_watcher() i=3 2024-05-08T18:50:45.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.642+0000 7fa83143f800 20 add_watcher() i=4 2024-05-08T18:50:45.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.642+0000 7fa83143f800 20 add_watcher() i=5 2024-05-08T18:50:45.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.642+0000 7fa83143f800 20 add_watcher() i=6 2024-05-08T18:50:45.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.643+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94151641290176] v25'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa82405a040 con 0x7fa820027020 2024-05-08T18:50:45.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.643+0000 7fa83143f800 20 add_watcher() i=7 2024-05-08T18:50:45.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.643+0000 7fa83143f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:45.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.643+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55a163225e90 con 0x55a163215ca0 2024-05-08T18:50:45.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.644+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.644+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94151641291232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a163225e70 con 0x55a163215ca0 2024-05-08T18:50:45.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.645+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94151641291232] v25'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.645+0000 7fa6e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:45.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.645+0000 7fa83143f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:45.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.645+0000 7fa83143f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:45.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.645+0000 7fa83143f800 5 note: GC not initialized 2024-05-08T18:50:45.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.645+0000 7fa65ffff640 20 reqs_thread_entry: start 2024-05-08T18:50:45.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.645+0000 7fa83143f800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:45.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.645+0000 7fa83143f800 20 Filter name: none 2024-05-08T18:50:45.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.645+0000 7fa65dffb640 20 reqs_thread_entry: start 2024-05-08T18:50:45.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.645+0000 7fa83143f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.646+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55a16325bea0 con 0x55a163215ca0 2024-05-08T18:50:45.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.646+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.646+0000 7fa83143f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:45.661 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:50:44.835566Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:44.835553Z","tags":[],"group_ids":[]} 2024-05-08T18:50:45.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.647+0000 7fa6e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:45.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.647+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94151641291232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a163210cd0 con 0x55a163215ca0 2024-05-08T18:50:45.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.648+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94151641291232] v25'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.648+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94151641263984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a1632259e0 con 0x7fa828019040 2024-05-08T18:50:45.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.649+0000 7fa82ef37640 1 -- 172.21.15.132:0/1684334367 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94151641263984] v25'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa82000f030 con 0x7fa828019040 2024-05-08T18:50:45.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.649+0000 7fa83143f800 20 remove_watcher() i=0 2024-05-08T18:50:45.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.649+0000 7fa83143f800 2 removed watcher, disabling cache 2024-05-08T18:50:45.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.649+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94151641272896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a1632259e0 con 0x55a163215ca0 2024-05-08T18:50:45.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.650+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94151641272896] v25'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.650+0000 7fa83143f800 20 remove_watcher() i=1 2024-05-08T18:50:45.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.650+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94151641275152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a163221240 con 0x55a16321a3a0 2024-05-08T18:50:45.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.651+0000 7fa82f738640 1 -- 172.21.15.132:0/1684334367 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94151641275152] v25'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa828049050 con 0x55a16321a3a0 2024-05-08T18:50:45.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.651+0000 7fa83143f800 20 remove_watcher() i=2 2024-05-08T18:50:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.651+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94151641278352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a1632259e0 con 0x7fa828019040 2024-05-08T18:50:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.652+0000 7fa82ef37640 1 -- 172.21.15.132:0/1684334367 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94151641278352] v25'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa82000f030 con 0x7fa828019040 2024-05-08T18:50:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.652+0000 7fa83143f800 20 remove_watcher() i=3 2024-05-08T18:50:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.652+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94151641280096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a163221b10 con 0x55a163215ca0 2024-05-08T18:50:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.653+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94151641280096] v25'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa82405a040 con 0x55a163215ca0 2024-05-08T18:50:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.653+0000 7fa83143f800 20 remove_watcher() i=4 2024-05-08T18:50:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.653+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94151641284976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a163221240 con 0x7fa820027020 2024-05-08T18:50:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.654+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94151641284976] v25'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa82405a040 con 0x7fa820027020 2024-05-08T18:50:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.654+0000 7fa83143f800 20 remove_watcher() i=5 2024-05-08T18:50:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.654+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94151641287328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a163222790 con 0x7fa820027020 2024-05-08T18:50:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.655+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94151641287328] v25'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa82405a040 con 0x7fa820027020 2024-05-08T18:50:45.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.655+0000 7fa83143f800 20 remove_watcher() i=6 2024-05-08T18:50:45.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.655+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94151641290176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55a1632259e0 con 0x7fa820027020 2024-05-08T18:50:45.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.656+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94151641290176] v25'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa82405a040 con 0x7fa820027020 2024-05-08T18:50:45.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.656+0000 7fa83143f800 20 remove_watcher() i=7 2024-05-08T18:50:45.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.656+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa820027020 msgr2=0x7fa8200493f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.656+0000 7fa83143f800 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa820027020 0x7fa8200493f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.656+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a163215ca0 msgr2=0x55a163218160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.656+0000 7fa83143f800 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a163215ca0 0x55a163218160 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.656+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa828019040 msgr2=0x7fa8280547f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.656+0000 7fa83143f800 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa828019040 0x7fa8280547f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.656+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a16321a3a0 msgr2=0x55a16321c790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.656+0000 7fa83143f800 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a16321a3a0 0x55a16321c790 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.656+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa6f803bb30 msgr2=0x7fa6f803dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.656+0000 7fa83143f800 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa6f803bb30 0x7fa6f803dff0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa8200046b0 tx=0x7fa820033000 comp rx=0 tx=0).stop 2024-05-08T18:50:45.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.656+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a163202b20 msgr2=0x55a16320a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.656+0000 7fa83143f800 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a163202b20 0x55a16320a120 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa828014c50 tx=0x7fa828052bc0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.656+0000 7fa82e736640 1 -- 172.21.15.132:0/1684334367 reap_dead start 2024-05-08T18:50:45.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.656+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 shutdown_connections 2024-05-08T18:50:45.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.656+0000 7fa83143f800 1 --2- 172.21.15.132:0/1684334367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a163202b20 0x55a16320a120 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.656+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 >> 172.21.15.132:0/1684334367 conn(0x55a1631fee30 msgr2=0x55a1631fc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.656+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 shutdown_connections 2024-05-08T18:50:45.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.656+0000 7fa83143f800 1 -- 172.21.15.132:0/1684334367 wait complete. 2024-05-08T18:50:45.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 -- 172.21.15.132:0/3321386873 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa70803bba0 msgr2=0x7fa70803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 --2- 172.21.15.132:0/3321386873 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa70803bba0 0x7fa70803e060 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa8200108d0 tx=0x7fa820050d30 comp rx=0 tx=0).stop 2024-05-08T18:50:45.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 -- 172.21.15.132:0/3321386873 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1631f58a0 msgr2=0x55a1631f5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 --2- 172.21.15.132:0/3321386873 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1631f58a0 0x55a1631f5cc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55a1631db560 tx=0x7fa82800aec0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 -- 172.21.15.132:0/3321386873 shutdown_connections 2024-05-08T18:50:45.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 --2- 172.21.15.132:0/3321386873 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa70803bba0 0x7fa70803e060 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 --2- 172.21.15.132:0/3321386873 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1631f58a0 0x55a1631f5cc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 -- 172.21.15.132:0/3321386873 >> 172.21.15.132:0/3321386873 conn(0x55a1631e9940 msgr2=0x55a1631e9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 -- 172.21.15.132:0/3321386873 shutdown_connections 2024-05-08T18:50:45.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 -- 172.21.15.132:0/3321386873 wait complete. 2024-05-08T18:50:45.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 -- 172.21.15.132:0/703845725 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a1630e37e0 msgr2=0x55a1631e1580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 --2- 172.21.15.132:0/703845725 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a1630e37e0 0x55a1631e1580 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 -- 172.21.15.132:0/703845725 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a1631e3e80 msgr2=0x55a1631e6270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 --2- 172.21.15.132:0/703845725 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a1631e3e80 0x55a1631e6270 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 -- 172.21.15.132:0/703845725 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa71403bb50 msgr2=0x7fa71403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 --2- 172.21.15.132:0/703845725 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa71403bb50 0x7fa71403e010 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa824054000 tx=0x7fa82404e000 comp rx=0 tx=0).stop 2024-05-08T18:50:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 -- 172.21.15.132:0/703845725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1630dfcd0 msgr2=0x55a1631da340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 --2- 172.21.15.132:0/703845725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1630dfcd0 0x55a1631da340 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa82000f000 tx=0x7fa820000f40 comp rx=0 tx=0).stop 2024-05-08T18:50:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 -- 172.21.15.132:0/703845725 shutdown_connections 2024-05-08T18:50:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 --2- 172.21.15.132:0/703845725 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a1631e3e80 0x55a1631e6270 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 --2- 172.21.15.132:0/703845725 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a1630e37e0 0x55a1631e1580 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 --2- 172.21.15.132:0/703845725 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa71403bb50 0x7fa71403e010 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 --2- 172.21.15.132:0/703845725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1630dfcd0 0x55a1631da340 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 -- 172.21.15.132:0/703845725 >> 172.21.15.132:0/703845725 conn(0x55a1630d9720 msgr2=0x55a1630de4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 -- 172.21.15.132:0/703845725 shutdown_connections 2024-05-08T18:50:45.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.657+0000 7fa83143f800 1 -- 172.21.15.132:0/703845725 wait complete. 2024-05-08T18:50:45.674 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:50:44.835566Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:44.835553Z', 'tags': [], 'group_ids': []} 2024-05-08T18:50:45.674 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-05-08T18:50:45.674 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-05-08T18:50:45.674 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-05-08T18:50:45.756 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:45.756 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:45.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.758+0000 7f05c93a2800 1 Processor -- start 2024-05-08T18:50:45.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.758+0000 7f05c93a2800 1 -- start start 2024-05-08T18:50:45.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.758+0000 7f05c93a2800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5555a06446c0 0x5555a064d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.758+0000 7f05c93a2800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5555a05b7dc0 con 0x5555a0642b80 2024-05-08T18:50:45.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.758+0000 7f05c93a2800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x5555a04e4e20 con 0x5555a06446c0 2024-05-08T18:50:45.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.758+0000 7f05bffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5555a06446c0 0x5555a064d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.758+0000 7f05c6e9a640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x5555a0642b80 0x5555a0642fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46762/0 (socket says 172.21.15.132:46762) 2024-05-08T18:50:45.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.758+0000 7f05c6e9a640 1 -- 172.21.15.132:0/537264446 learned_addr learned my addr 172.21.15.132:0/537264446 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:50:45.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.759+0000 7f05bffff640 1 -- 172.21.15.132:0/537264446 >> v1:172.21.15.42:6789/0 conn(0x5555a0642b80 legacy=0x5555a0642fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.759+0000 7f05bffff640 1 -- 172.21.15.132:0/537264446 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555a064e710 con 0x5555a06446c0 2024-05-08T18:50:45.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.760+0000 7f05bffff640 1 --2- 172.21.15.132:0/537264446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a06446c0 0x5555a064d1c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f05b000a470 tx=0x7f05b001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82383223e5e8f9e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.761+0000 7f05c6699640 1 -- 172.21.15.132:0/537264446 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b0057070 con 0x5555a06446c0 2024-05-08T18:50:45.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.761+0000 7f05c6699640 1 -- 172.21.15.132:0/537264446 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b004adc0 con 0x5555a06446c0 2024-05-08T18:50:45.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.761+0000 7f05c6699640 1 -- 172.21.15.132:0/537264446 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b0052590 con 0x5555a06446c0 2024-05-08T18:50:45.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.761+0000 7f05c93a2800 1 -- 172.21.15.132:0/537264446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a06446c0 msgr2=0x5555a064d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.761+0000 7f05c93a2800 1 --2- 172.21.15.132:0/537264446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a06446c0 0x5555a064d1c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f05b000a470 tx=0x7f05b001ce90 comp rx=0 tx=0).stop 2024-05-08T18:50:45.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.761+0000 7f05c93a2800 1 -- 172.21.15.132:0/537264446 shutdown_connections 2024-05-08T18:50:45.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.761+0000 7f05c93a2800 1 --2- 172.21.15.132:0/537264446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a06446c0 0x5555a064d1c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.761+0000 7f05c93a2800 1 -- 172.21.15.132:0/537264446 >> 172.21.15.132:0/537264446 conn(0x5555a063e6c0 msgr2=0x5555a0640b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.761+0000 7f05c93a2800 1 -- 172.21.15.132:0/537264446 shutdown_connections 2024-05-08T18:50:45.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.761+0000 7f05c93a2800 1 -- 172.21.15.132:0/537264446 wait complete. 2024-05-08T18:50:45.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.775+0000 7f05c93a2800 1 Processor -- start 2024-05-08T18:50:45.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.775+0000 7f05c93a2800 1 -- start start 2024-05-08T18:50:45.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.775+0000 7f05c93a2800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0642b80 0x5555a0737a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.775+0000 7f05c93a2800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5555a058f5d0 con 0x5555a0642b80 2024-05-08T18:50:45.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.775+0000 7f05c6e9a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0642b80 0x5555a0737a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.775+0000 7f05c6e9a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0642b80 0x5555a0737a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60064/0 (socket says 172.21.15.132:60064) 2024-05-08T18:50:45.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.775+0000 7f05c6e9a640 1 -- 172.21.15.132:0/3854217676 learned_addr learned my addr 172.21.15.132:0/3854217676 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.776+0000 7f05c6e9a640 1 -- 172.21.15.132:0/3854217676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555a0738020 con 0x5555a0642b80 2024-05-08T18:50:45.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.776+0000 7f05c6e9a640 1 --2- 172.21.15.132:0/3854217676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0642b80 0x5555a0737a50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f05b8001de0 tx=0x7f05b800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=273f6058c6a3242 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.776+0000 7f04b4e09640 1 -- 172.21.15.132:0/3854217676 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b8012020 con 0x5555a0642b80 2024-05-08T18:50:45.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.776+0000 7f04b4e09640 1 -- 172.21.15.132:0/3854217676 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b800e5a0 con 0x5555a0642b80 2024-05-08T18:50:45.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.776+0000 7f04b4e09640 1 -- 172.21.15.132:0/3854217676 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b800e8c0 con 0x5555a0642b80 2024-05-08T18:50:45.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.777+0000 7f05c93a2800 1 -- 172.21.15.132:0/3854217676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0642b80 msgr2=0x5555a0737a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.777+0000 7f05c93a2800 1 --2- 172.21.15.132:0/3854217676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0642b80 0x5555a0737a50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f05b8001de0 tx=0x7f05b800b6c0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.777+0000 7f05c93a2800 1 -- 172.21.15.132:0/3854217676 shutdown_connections 2024-05-08T18:50:45.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.777+0000 7f05c93a2800 1 --2- 172.21.15.132:0/3854217676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0642b80 0x5555a0737a50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.777+0000 7f05c93a2800 1 -- 172.21.15.132:0/3854217676 >> 172.21.15.132:0/3854217676 conn(0x5555a063e6c0 msgr2=0x5555a0733370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.777+0000 7f05c93a2800 1 -- 172.21.15.132:0/3854217676 shutdown_connections 2024-05-08T18:50:45.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.777+0000 7f05c93a2800 1 -- 172.21.15.132:0/3854217676 wait complete. 2024-05-08T18:50:45.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.777+0000 7f05c93a2800 1 Processor -- start 2024-05-08T18:50:45.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.777+0000 7f05c93a2800 1 -- start start 2024-05-08T18:50:45.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.777+0000 7f05c93a2800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0642b80 0x5555a073f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.777+0000 7f05c93a2800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5555a064d9d0 con 0x5555a0642b80 2024-05-08T18:50:45.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.778+0000 7f05c6e9a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0642b80 0x5555a073f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.778+0000 7f05c6e9a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0642b80 0x5555a073f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60068/0 (socket says 172.21.15.132:60068) 2024-05-08T18:50:45.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.778+0000 7f05c6e9a640 1 -- 172.21.15.132:0/1180455348 learned_addr learned my addr 172.21.15.132:0/1180455348 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.778+0000 7f05c6e9a640 1 -- 172.21.15.132:0/1180455348 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555a073fb30 con 0x5555a0642b80 2024-05-08T18:50:45.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.778+0000 7f05c6e9a640 1 --2- 172.21.15.132:0/1180455348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0642b80 0x5555a073f5f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f05b8001de0 tx=0x7f05b8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.778+0000 7f04b3606640 1 -- 172.21.15.132:0/1180455348 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b8012030 con 0x5555a0642b80 2024-05-08T18:50:45.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.778+0000 7f04b3606640 1 -- 172.21.15.132:0/1180455348 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b801a7a0 con 0x5555a0642b80 2024-05-08T18:50:45.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.778+0000 7f05c93a2800 1 -- 172.21.15.132:0/1180455348 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555a073fdc0 con 0x5555a0642b80 2024-05-08T18:50:45.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.778+0000 7f04b3606640 1 -- 172.21.15.132:0/1180455348 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05b801aac0 con 0x5555a0642b80 2024-05-08T18:50:45.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.778+0000 7f05c93a2800 1 -- 172.21.15.132:0/1180455348 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555a0742a20 con 0x5555a0642b80 2024-05-08T18:50:45.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.779+0000 7f04b3606640 1 -- 172.21.15.132:0/1180455348 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f05b8015020 con 0x5555a0642b80 2024-05-08T18:50:45.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.779+0000 7f04b3606640 1 --2- 172.21.15.132:0/1180455348 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f04ac03bb50 0x7f04ac03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.779+0000 7f04b3606640 1 -- 172.21.15.132:0/1180455348 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f05b8020070 con 0x5555a0642b80 2024-05-08T18:50:45.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.780+0000 7f05bffff640 1 --2- 172.21.15.132:0/1180455348 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f04ac03bb50 0x7f04ac03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.780+0000 7f05c93a2800 1 --2- 172.21.15.132:0/1180455348 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5555a06446c0 0x5555a07467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.780+0000 7f05c93a2800 1 -- 172.21.15.132:0/1180455348 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5555a0746d20 con 0x5555a06446c0 2024-05-08T18:50:45.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.780+0000 7f05c769b640 1 --2- 172.21.15.132:0/1180455348 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5555a06446c0 0x5555a07467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.780+0000 7f05bffff640 1 --2- 172.21.15.132:0/1180455348 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f04ac03bb50 0x7f04ac03e010 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f05b0054000 tx=0x7f05b004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.780+0000 7f05c769b640 1 --2- 172.21.15.132:0/1180455348 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5555a06446c0 0x5555a07467e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.780+0000 7f05c769b640 1 -- 172.21.15.132:0/1180455348 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05c000a4a0 con 0x5555a06446c0 2024-05-08T18:50:45.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.780+0000 7f05c93a2800 1 -- 172.21.15.132:0/1180455348 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5555a0743db0 con 0x5555a06446c0 2024-05-08T18:50:45.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.781+0000 7f05c769b640 1 -- 172.21.15.132:0/1180455348 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05c000a4a0 con 0x5555a06446c0 2024-05-08T18:50:45.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.781+0000 7f05c93a2800 1 --2- 172.21.15.132:0/1180455348 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5555a0749070 0x5555a074b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.781+0000 7f05c93a2800 1 -- 172.21.15.132:0/1180455348 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5555a074bb50 con 0x5555a0749070 2024-05-08T18:50:45.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.781+0000 7f05c6e9a640 1 --2- 172.21.15.132:0/1180455348 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5555a0749070 0x5555a074b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.781+0000 7f05c6e9a640 1 --2- 172.21.15.132:0/1180455348 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5555a0749070 0x5555a074b460 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.781+0000 7f05c6e9a640 1 -- 172.21.15.132:0/1180455348 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f05b801ac60 con 0x5555a0749070 2024-05-08T18:50:45.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.781+0000 7f05c93a2800 1 -- 172.21.15.132:0/1180455348 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5555a0747f10 con 0x5555a06446c0 2024-05-08T18:50:45.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.782+0000 7f05c769b640 1 -- 172.21.15.132:0/1180455348 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05c000a4a0 con 0x5555a06446c0 2024-05-08T18:50:45.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.782+0000 7f05c93a2800 1 -- 172.21.15.132:0/1180455348 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5555a07483f0 con 0x5555a06446c0 2024-05-08T18:50:45.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.782+0000 7f05c769b640 1 -- 172.21.15.132:0/1180455348 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f05c000a4a0 con 0x5555a06446c0 2024-05-08T18:50:45.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.782+0000 7f05c93a2800 1 Processor -- start 2024-05-08T18:50:45.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.782+0000 7f05c93a2800 1 -- start start 2024-05-08T18:50:45.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.783+0000 7f05c93a2800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a075aad0 0x5555a075aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.783+0000 7f05c93a2800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5555a0535fc0 con 0x5555a075aad0 2024-05-08T18:50:45.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.783+0000 7f05c769b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a075aad0 0x5555a075aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.783+0000 7f05c769b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a075aad0 0x5555a075aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60082/0 (socket says 172.21.15.132:60082) 2024-05-08T18:50:45.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.783+0000 7f05c769b640 1 -- 172.21.15.132:0/2112942581 learned_addr learned my addr 172.21.15.132:0/2112942581 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.783+0000 7f05c769b640 1 -- 172.21.15.132:0/2112942581 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555a075b430 con 0x5555a075aad0 2024-05-08T18:50:45.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.783+0000 7f05c769b640 1 --2- 172.21.15.132:0/2112942581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a075aad0 0x5555a075aef0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x5555a0747120 tx=0x7f05c0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.784+0000 7f04b0e01640 1 -- 172.21.15.132:0/2112942581 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05c0014450 con 0x5555a075aad0 2024-05-08T18:50:45.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.784+0000 7f04b0e01640 1 -- 172.21.15.132:0/2112942581 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c0014610 con 0x5555a075aad0 2024-05-08T18:50:45.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.784+0000 7f04b0e01640 1 -- 172.21.15.132:0/2112942581 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05c0014930 con 0x5555a075aad0 2024-05-08T18:50:45.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.784+0000 7f05c93a2800 1 -- 172.21.15.132:0/2112942581 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555a075bea0 con 0x5555a075aad0 2024-05-08T18:50:45.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.784+0000 7f05c93a2800 1 -- 172.21.15.132:0/2112942581 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555a075c3a0 con 0x5555a075aad0 2024-05-08T18:50:45.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.784+0000 7f04b0e01640 1 -- 172.21.15.132:0/2112942581 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f05c0011040 con 0x5555a075aad0 2024-05-08T18:50:45.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.785+0000 7f04b0e01640 1 --2- 172.21.15.132:0/2112942581 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f04a003bba0 0x7f04a003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.785+0000 7f04b0e01640 1 -- 172.21.15.132:0/2112942581 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f05c001e070 con 0x5555a075aad0 2024-05-08T18:50:45.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.785+0000 7f05c6e9a640 1 --2- 172.21.15.132:0/2112942581 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f04a003bba0 0x7f04a003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.785+0000 7f05c93a2800 1 Processor -- start 2024-05-08T18:50:45.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.785+0000 7f05c93a2800 1 -- start start 2024-05-08T18:50:45.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.785+0000 7f05c6e9a640 1 --2- 172.21.15.132:0/2112942581 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f04a003bba0 0x7f04a003e060 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x5555a07471c0 tx=0x7f05b8018e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.785+0000 7f05c93a2800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0767d70 0x5555a0768190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.785+0000 7f05c93a2800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5555a07383a0 con 0x5555a0767d70 2024-05-08T18:50:45.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.785+0000 7f05c769b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0767d70 0x5555a0768190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.785+0000 7f05c769b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0767d70 0x5555a0768190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60090/0 (socket says 172.21.15.132:60090) 2024-05-08T18:50:45.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.785+0000 7f05c769b640 1 -- 172.21.15.132:0/196724286 learned_addr learned my addr 172.21.15.132:0/196724286 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.786+0000 7f05c769b640 1 -- 172.21.15.132:0/196724286 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555a0768760 con 0x5555a0767d70 2024-05-08T18:50:45.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.786+0000 7f05c769b640 1 --2- 172.21.15.132:0/196724286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0767d70 0x5555a0768190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f05c0052c50 tx=0x7f05c0011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0ab1307dc6cecd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.786+0000 7f04aa7fc640 1 -- 172.21.15.132:0/196724286 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05c0047070 con 0x5555a0767d70 2024-05-08T18:50:45.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.786+0000 7f04aa7fc640 1 -- 172.21.15.132:0/196724286 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c002b350 con 0x5555a0767d70 2024-05-08T18:50:45.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.786+0000 7f04aa7fc640 1 -- 172.21.15.132:0/196724286 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05c0028070 con 0x5555a0767d70 2024-05-08T18:50:45.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.786+0000 7f05c93a2800 1 -- 172.21.15.132:0/196724286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0767d70 msgr2=0x5555a0768190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.786+0000 7f05c93a2800 1 --2- 172.21.15.132:0/196724286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0767d70 0x5555a0768190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f05c0052c50 tx=0x7f05c0011a80 comp rx=0 tx=0).stop 2024-05-08T18:50:45.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.786+0000 7f05c93a2800 1 -- 172.21.15.132:0/196724286 shutdown_connections 2024-05-08T18:50:45.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.786+0000 7f05c93a2800 1 --2- 172.21.15.132:0/196724286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0767d70 0x5555a0768190 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.786+0000 7f05c93a2800 1 -- 172.21.15.132:0/196724286 >> 172.21.15.132:0/196724286 conn(0x5555a0764080 msgr2=0x5555a07620e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.786+0000 7f05c93a2800 1 -- 172.21.15.132:0/196724286 shutdown_connections 2024-05-08T18:50:45.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.786+0000 7f05c93a2800 1 -- 172.21.15.132:0/196724286 wait complete. 2024-05-08T18:50:45.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.787+0000 7f05c93a2800 1 Processor -- start 2024-05-08T18:50:45.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.787+0000 7f05c93a2800 1 -- start start 2024-05-08T18:50:45.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.787+0000 7f05c93a2800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0767d70 0x5555a076f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.787+0000 7f05c93a2800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5555a0768eb0 con 0x5555a0767d70 2024-05-08T18:50:45.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.787+0000 7f05c769b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0767d70 0x5555a076f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.787+0000 7f05c769b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0767d70 0x5555a076f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60098/0 (socket says 172.21.15.132:60098) 2024-05-08T18:50:45.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.787+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 learned_addr learned my addr 172.21.15.132:0/740442333 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.788+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555a076f850 con 0x5555a0767d70 2024-05-08T18:50:45.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.788+0000 7f05c769b640 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0767d70 0x5555a076f310 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f05c0051b70 tx=0x7f05c0052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.788+0000 7f04a8ff9640 1 -- 172.21.15.132:0/740442333 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05c0044030 con 0x5555a0767d70 2024-05-08T18:50:45.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.788+0000 7f04a8ff9640 1 -- 172.21.15.132:0/740442333 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05c0011330 con 0x5555a0767d70 2024-05-08T18:50:45.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.788+0000 7f04a8ff9640 1 -- 172.21.15.132:0/740442333 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05c0047040 con 0x5555a0767d70 2024-05-08T18:50:45.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.788+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555a076fae0 con 0x5555a0767d70 2024-05-08T18:50:45.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.788+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555a0772790 con 0x5555a0767d70 2024-05-08T18:50:45.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.789+0000 7f04a8ff9640 1 -- 172.21.15.132:0/740442333 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f05c0034020 con 0x5555a0767d70 2024-05-08T18:50:45.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.789+0000 7f04a8ff9640 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f049003bb50 0x7f049003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.789+0000 7f04a8ff9640 1 -- 172.21.15.132:0/740442333 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f05c0032020 con 0x5555a0767d70 2024-05-08T18:50:45.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.789+0000 7f05c6e9a640 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f049003bb50 0x7f049003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.789+0000 7f05c6e9a640 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f049003bb50 0x7f049003e010 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f05b8000c00 tx=0x7f05b8047000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.789+0000 7f05c93a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.790+0000 7f05c93a2800 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5555a077b030 0x5555a077d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.790+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5555a077dc40 con 0x5555a077b030 2024-05-08T18:50:45.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.790+0000 7f05bffff640 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5555a077b030 0x5555a077d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.790+0000 7f05bffff640 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5555a077b030 0x5555a077d4f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.790+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.790+0000 7f05c93a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.790+0000 7f05c93a2800 20 realm 2024-05-08T18:50:45.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.790+0000 7f05c93a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.790+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5555a077e070 con 0x5555a077b030 2024-05-08T18:50:45.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.790+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.790+0000 7f05c93a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.790+0000 7f05c93a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:45.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.790+0000 7f05c93a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.790+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5555a077e940 con 0x5555a077b030 2024-05-08T18:50:45.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.791+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.791+0000 7f05c93a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.791+0000 7f05c93a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.791+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5555a077ece0 con 0x5555a077b030 2024-05-08T18:50:45.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.791+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.791+0000 7f05c93a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:45.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.791+0000 7f05c93a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.791+0000 7f05c93a2800 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5555a077fa40 0x5555a0781e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.791+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x5555a077fa40 2024-05-08T18:50:45.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.791+0000 7f05c769b640 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5555a077fa40 0x5555a0781e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.791+0000 7f05c769b640 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5555a077fa40 0x5555a0781e30 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.791+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f05c004a040 con 0x5555a077fa40 2024-05-08T18:50:45.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.792+0000 7f05c93a2800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:45.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.792+0000 7f05c93a2800 20 searching for the correct realm 2024-05-08T18:50:45.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.792+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0783d90 con 0x5555a077fa40 2024-05-08T18:50:45.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.792+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c004a040 con 0x5555a077fa40 2024-05-08T18:50:45.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.792+0000 7f05c769b640 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f05c0014070 0x7f05c0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.792+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x7f05c0014070 2024-05-08T18:50:45.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.792+0000 7f05c6e9a640 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f05c0014070 0x7f05c0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.792+0000 7f05c6e9a640 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f05c0014070 0x7f05c0036410 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.793+0000 7f05c6e9a640 1 -- 172.21.15.132:0/740442333 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b801ac60 con 0x7f05c0014070 2024-05-08T18:50:45.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.793+0000 7f05c6e9a640 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f05b8017050 0x7f05b8052550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.793+0000 7f05c6e9a640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x7f05b8017050 2024-05-08T18:50:45.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.793+0000 7f05bffff640 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f05b8017050 0x7f05b8052550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.793+0000 7f05bffff640 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f05b8017050 0x7f05b8052550 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.794+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b005a040 con 0x7f05b8017050 2024-05-08T18:50:45.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.794+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x5555a077b030 2024-05-08T18:50:45.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.794+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.794+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x5555a077b030 2024-05-08T18:50:45.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.794+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.794+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x7f05b8017050 2024-05-08T18:50:45.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.794+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b005a040 con 0x7f05b8017050 2024-05-08T18:50:45.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.794+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x7f05b8017050 2024-05-08T18:50:45.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.795+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b005a040 con 0x7f05b8017050 2024-05-08T18:50:45.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.795+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x7f05c0014070 2024-05-08T18:50:45.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.795+0000 7f05c6e9a640 1 -- 172.21.15.132:0/740442333 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b801ac60 con 0x7f05c0014070 2024-05-08T18:50:45.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.795+0000 7f05c6e9a640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x5555a077fa40 2024-05-08T18:50:45.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.795+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c004a040 con 0x5555a077fa40 2024-05-08T18:50:45.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.795+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x5555a077b030 2024-05-08T18:50:45.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.795+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.795+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x7f05b8017050 2024-05-08T18:50:45.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.795+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b005a040 con 0x7f05b8017050 2024-05-08T18:50:45.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.795+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x5555a077b030 2024-05-08T18:50:45.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.796+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.796+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x7f05c0014070 2024-05-08T18:50:45.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.796+0000 7f05c6e9a640 1 -- 172.21.15.132:0/740442333 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f05b801ac60 con 0x7f05c0014070 2024-05-08T18:50:45.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.796+0000 7f05c6e9a640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x5555a077fa40 2024-05-08T18:50:45.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.796+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f05c004a040 con 0x5555a077fa40 2024-05-08T18:50:45.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.796+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x5555a077fa40 2024-05-08T18:50:45.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.796+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c0062040 con 0x5555a077fa40 2024-05-08T18:50:45.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.796+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x7f05b8017050 2024-05-08T18:50:45.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.797+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b005a040 con 0x7f05b8017050 2024-05-08T18:50:45.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.797+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x5555a077fa40 2024-05-08T18:50:45.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.797+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c0062040 con 0x5555a077fa40 2024-05-08T18:50:45.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.797+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x5555a077fa40 2024-05-08T18:50:45.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.797+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c0062040 con 0x5555a077fa40 2024-05-08T18:50:45.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.797+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x5555a077b030 2024-05-08T18:50:45.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.797+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.797+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x5555a077b030 2024-05-08T18:50:45.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.798+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.798+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x7f05b8017050 2024-05-08T18:50:45.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.798+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b005a040 con 0x7f05b8017050 2024-05-08T18:50:45.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.798+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x5555a077fa40 2024-05-08T18:50:45.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.798+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c0062040 con 0x5555a077fa40 2024-05-08T18:50:45.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.798+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x7f05c0014070 2024-05-08T18:50:45.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.799+0000 7f05c6e9a640 1 -- 172.21.15.132:0/740442333 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b801ac60 con 0x7f05c0014070 2024-05-08T18:50:45.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.799+0000 7f05c6e9a640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x5555a077b030 2024-05-08T18:50:45.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.799+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.799+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x7f05b8017050 2024-05-08T18:50:45.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.799+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b005a040 con 0x7f05b8017050 2024-05-08T18:50:45.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.799+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x5555a077fa40 2024-05-08T18:50:45.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.800+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c0062040 con 0x5555a077fa40 2024-05-08T18:50:45.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.800+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x7f05b8017050 2024-05-08T18:50:45.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.800+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b005a040 con 0x7f05b8017050 2024-05-08T18:50:45.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.800+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x7f05c0014070 2024-05-08T18:50:45.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.800+0000 7f05c6e9a640 1 -- 172.21.15.132:0/740442333 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b801ac60 con 0x7f05c0014070 2024-05-08T18:50:45.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.800+0000 7f05c6e9a640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x5555a077fa40 2024-05-08T18:50:45.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.800+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c0062040 con 0x5555a077fa40 2024-05-08T18:50:45.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.800+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x7f05b8017050 2024-05-08T18:50:45.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.801+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b005a040 con 0x7f05b8017050 2024-05-08T18:50:45.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.801+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x5555a077b030 2024-05-08T18:50:45.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.801+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.801+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782440 con 0x7f05c0014070 2024-05-08T18:50:45.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.801+0000 7f05c6e9a640 1 -- 172.21.15.132:0/740442333 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05b801ac60 con 0x7f05c0014070 2024-05-08T18:50:45.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.801+0000 7f05c93a2800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:45.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.801+0000 7f05c93a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:45.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.801+0000 7f05c93a2800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:45.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.801+0000 7f05c93a2800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:45.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.801+0000 7f05c93a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:45.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.801+0000 7f05c93a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:45.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.801+0000 7f05c93a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.801+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5555a0782d00 con 0x5555a077b030 2024-05-08T18:50:45.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.801+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.801+0000 7f05c93a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.801+0000 7f05c93a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.801+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5555a07830f0 con 0x5555a077b030 2024-05-08T18:50:45.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.802+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.802+0000 7f05c93a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:45.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.802+0000 7f05c93a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.802+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5555a07830f0 con 0x5555a077b030 2024-05-08T18:50:45.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.802+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.802+0000 7f05c93a2800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:45.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.802+0000 7f05c93a2800 20 zone default found 2024-05-08T18:50:45.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.802+0000 7f05c93a2800 4 Realm: () 2024-05-08T18:50:45.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.802+0000 7f05c93a2800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:45.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.802+0000 7f05c93a2800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:45.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.802+0000 7f05c93a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:45.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.802+0000 7f05c93a2800 20 zonegroup default 2024-05-08T18:50:45.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.802+0000 7f05c93a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.802+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5555a07835c0 con 0x7f05b8017050 2024-05-08T18:50:45.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.802+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x7f05b8017050 2024-05-08T18:50:45.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.802+0000 7f05c93a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.802+0000 7f05c93a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.802+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5555a07835c0 con 0x5555a077fa40 2024-05-08T18:50:45.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.802+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05c0062040 con 0x5555a077fa40 2024-05-08T18:50:45.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.802+0000 7f05c93a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.802+0000 7f05c93a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.802+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5555a0785ce0 con 0x5555a077fa40 2024-05-08T18:50:45.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.803+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05c0062040 con 0x5555a077fa40 2024-05-08T18:50:45.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.803+0000 7f05c93a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.803+0000 7f05c93a2800 20 started sync module instance, tier type = 2024-05-08T18:50:45.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.803+0000 7f05c93a2800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:45.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.803+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a0785090 con 0x7f05c0014070 2024-05-08T18:50:45.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.804+0000 7f05c6e9a640 1 -- 172.21.15.132:0/740442333 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b801ac60 con 0x7f05c0014070 2024-05-08T18:50:45.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.804+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93826252819424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a0786140 con 0x7f05c0014070 2024-05-08T18:50:45.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.804+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a0786990 con 0x5555a077b030 2024-05-08T18:50:45.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.805+0000 7f05c6e9a640 1 -- 172.21.15.132:0/740442333 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93826252819424] v25'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b801ac60 con 0x7f05c0014070 2024-05-08T18:50:45.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.805+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.805+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93826252825824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a0786db0 con 0x5555a077b030 2024-05-08T18:50:45.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.805+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a0787600 con 0x5555a077fa40 2024-05-08T18:50:45.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.806+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93826252825824] v25'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.806+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c0062040 con 0x5555a077fa40 2024-05-08T18:50:45.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.806+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93826252827360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a07874f0 con 0x5555a077fa40 2024-05-08T18:50:45.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.806+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a0788070 con 0x7f05c0014070 2024-05-08T18:50:45.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.807+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93826252827360] v25'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c0062040 con 0x5555a077fa40 2024-05-08T18:50:45.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.807+0000 7f05c6e9a640 1 -- 172.21.15.132:0/740442333 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b801ac60 con 0x7f05c0014070 2024-05-08T18:50:45.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.807+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93826252831584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a0788460 con 0x7f05c0014070 2024-05-08T18:50:45.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.807+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a0788e90 con 0x5555a077b030 2024-05-08T18:50:45.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.809+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.809+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93826252835232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a0789760 con 0x5555a077b030 2024-05-08T18:50:45.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.809+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a078a250 con 0x7f05b8017050 2024-05-08T18:50:45.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.809+0000 7f05c6e9a640 1 -- 172.21.15.132:0/740442333 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93826252831584] v25'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b801ac60 con 0x7f05c0014070 2024-05-08T18:50:45.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.812+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93826252835232] v25'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.812+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x7f05b8017050 2024-05-08T18:50:45.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.812+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93826252840224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a07891f0 con 0x7f05b8017050 2024-05-08T18:50:45.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.812+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a078aaf0 con 0x7f05b8017050 2024-05-08T18:50:45.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.815+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(56 notify.6 [create] v25'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x7f05b8017050 2024-05-08T18:50:45.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.815+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93826252842560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a0789780 con 0x7f05b8017050 2024-05-08T18:50:45.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.815+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a078b5a0 con 0x7f05b8017050 2024-05-08T18:50:45.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.817+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v25'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x7f05b8017050 2024-05-08T18:50:45.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.817+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93826252845232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a078ba50 con 0x7f05b8017050 2024-05-08T18:50:45.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.817+0000 7f05c93a2800 20 add_watcher() i=0 2024-05-08T18:50:45.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.817+0000 7f05c93a2800 20 add_watcher() i=1 2024-05-08T18:50:45.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.817+0000 7f05c93a2800 20 add_watcher() i=2 2024-05-08T18:50:45.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.817+0000 7f05c93a2800 20 add_watcher() i=3 2024-05-08T18:50:45.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.817+0000 7f05c93a2800 20 add_watcher() i=4 2024-05-08T18:50:45.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.817+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93826252840224] v25'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x7f05b8017050 2024-05-08T18:50:45.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.817+0000 7f05c93a2800 20 add_watcher() i=5 2024-05-08T18:50:45.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.820+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93826252845232] v25'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x7f05b8017050 2024-05-08T18:50:45.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.823+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93826252842560] v25'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x7f05b8017050 2024-05-08T18:50:45.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.823+0000 7f05c93a2800 20 add_watcher() i=6 2024-05-08T18:50:45.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.823+0000 7f05c93a2800 20 add_watcher() i=7 2024-05-08T18:50:45.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.823+0000 7f05c93a2800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:45.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.823+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5555a078b5a0 con 0x5555a077b030 2024-05-08T18:50:45.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.824+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.824+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93826252843616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a078b5a0 con 0x5555a077b030 2024-05-08T18:50:45.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.825+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93826252843616] v25'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.825+0000 7f047d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:45.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.825+0000 7f05c93a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:45.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.825+0000 7f05c93a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:45.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.825+0000 7f05c93a2800 5 note: GC not initialized 2024-05-08T18:50:45.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.825+0000 7f03f7fff640 20 reqs_thread_entry: start 2024-05-08T18:50:45.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.825+0000 7f05c93a2800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:45.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.825+0000 7f05c93a2800 20 Filter name: none 2024-05-08T18:50:45.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.825+0000 7f03f5ffb640 20 reqs_thread_entry: start 2024-05-08T18:50:45.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.825+0000 7f05c93a2800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:50:45.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.825+0000 7f05c93a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.825+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5555a07c19f0 con 0x5555a077b030 2024-05-08T18:50:45.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.826+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.826+0000 7f05c93a2800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:45.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.826+0000 7f05c93a2800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:50:45.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.826+0000 7f05c93a2800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:45.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.826+0000 7f05c93a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:45.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.826+0000 7f05c93a2800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-08T18:50:45.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.826+0000 7f05c93a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.826+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5555a07c2300 con 0x7f05b8017050 2024-05-08T18:50:45.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.826+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x7f05b8017050 2024-05-08T18:50:45.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.826+0000 7f05c93a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.826+0000 7f05c93a2800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-08T18:50:45.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.826+0000 7f05c93a2800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:50:45.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.826+0000 7f05c93a2800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T18:50:45.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.826+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a07c7d60 con 0x5555a077b030 2024-05-08T18:50:45.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.827+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v25'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.827+0000 7f05c93a2800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:45.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.827+0000 7f05c93a2800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:45.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.827+0000 7f05c93a2800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:50:45.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.827+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93826253092640 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5555a07c33a0 con 0x5555a077b030 2024-05-08T18:50:45.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.828+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== watch-notify(notify (1) cookie 93826252835232 notify 107374182403 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7f05b0080040 con 0x5555a077b030 2024-05-08T18:50:45.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.828+0000 7f04aa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182403 cookie 93826252835232 notifier 4333 bl.length()=678 2024-05-08T18:50:45.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.828+0000 7f04aa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:45.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.828+0000 7f04aa7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:45.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.828+0000 7f04aa7fc640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f048c003ea0 con 0x5555a077b030 2024-05-08T18:50:45.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.828+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(65 notify.4 [notify cookie 93826253092640 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.828+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.828+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== watch-notify(notify_complete (2) cookie 93826253092640 notify 107374182403 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5555a064e710 con 0x5555a077b030 2024-05-08T18:50:45.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.828+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a07c7720 con 0x7f05b8017050 2024-05-08T18:50:45.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.829+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v25'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x7f05b8017050 2024-05-08T18:50:45.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.829+0000 7f05c93a2800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:50:45.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.829+0000 7f05c93a2800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:50:45.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.829+0000 7f05c93a2800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:50:45.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.829+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93826253092640 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5555a07c2ef0 con 0x5555a077fa40 2024-05-08T18:50:45.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.829+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== watch-notify(notify (1) cookie 93826252827360 notify 107374182400 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5555a0772790 con 0x5555a077fa40 2024-05-08T18:50:45.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.829+0000 7f04a9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182400 cookie 93826252827360 notifier 4333 bl.length()=177 2024-05-08T18:50:45.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.830+0000 7f04a9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:50:45.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.830+0000 7f04a9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:50:45.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.830+0000 7f04a9ffb640 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f03fc003400 con 0x5555a077fa40 2024-05-08T18:50:45.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.830+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(68 notify.2 [notify cookie 93826253092640 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f05c0062040 con 0x5555a077fa40 2024-05-08T18:50:45.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.830+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c0062040 con 0x5555a077fa40 2024-05-08T18:50:45.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.830+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== watch-notify(notify_complete (2) cookie 93826253092640 notify 107374182400 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f05c006d040 con 0x5555a077fa40 2024-05-08T18:50:45.854 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:50:44.835566Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-08T18:50:45.827734Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:44.835553Z","tags":[],"group_ids":[]} 2024-05-08T18:50:45.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.831+0000 7f047d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:45.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.831+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93826252843616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a07c2ef0 con 0x5555a077b030 2024-05-08T18:50:45.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.832+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93826252843616] v25'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.832+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93826252819424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a07c2ef0 con 0x7f05c0014070 2024-05-08T18:50:45.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.833+0000 7f05c6e9a640 1 -- 172.21.15.132:0/740442333 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93826252819424] v25'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b801ac60 con 0x7f05c0014070 2024-05-08T18:50:45.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.833+0000 7f05c93a2800 20 remove_watcher() i=0 2024-05-08T18:50:45.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.833+0000 7f05c93a2800 2 removed watcher, disabling cache 2024-05-08T18:50:45.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.833+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93826252825824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a07c2ef0 con 0x5555a077b030 2024-05-08T18:50:45.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.834+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93826252825824] v25'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.834+0000 7f05c93a2800 20 remove_watcher() i=1 2024-05-08T18:50:45.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.834+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93826252827360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a07c2ef0 con 0x5555a077fa40 2024-05-08T18:50:45.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.835+0000 7f05c769b640 1 -- 172.21.15.132:0/740442333 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93826252827360] v25'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c0062040 con 0x5555a077fa40 2024-05-08T18:50:45.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.835+0000 7f05c93a2800 20 remove_watcher() i=2 2024-05-08T18:50:45.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.835+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93826252831584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a07c2ef0 con 0x7f05c0014070 2024-05-08T18:50:45.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.836+0000 7f05c6e9a640 1 -- 172.21.15.132:0/740442333 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93826252831584] v25'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b801ac60 con 0x7f05c0014070 2024-05-08T18:50:45.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.836+0000 7f05c93a2800 20 remove_watcher() i=3 2024-05-08T18:50:45.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.836+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93826252835232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a07c2ef0 con 0x5555a077b030 2024-05-08T18:50:45.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.839+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93826252835232] v25'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x5555a077b030 2024-05-08T18:50:45.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.839+0000 7f05c93a2800 20 remove_watcher() i=4 2024-05-08T18:50:45.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.839+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93826252840224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a07c2ef0 con 0x7f05b8017050 2024-05-08T18:50:45.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.840+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93826252840224] v25'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x7f05b8017050 2024-05-08T18:50:45.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.840+0000 7f05c93a2800 20 remove_watcher() i=5 2024-05-08T18:50:45.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.840+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93826252842560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a07c2ef0 con 0x7f05b8017050 2024-05-08T18:50:45.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.843+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93826252842560] v25'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x7f05b8017050 2024-05-08T18:50:45.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.843+0000 7f05c93a2800 20 remove_watcher() i=6 2024-05-08T18:50:45.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.843+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93826252845232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5555a07c2ef0 con 0x7f05b8017050 2024-05-08T18:50:45.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.844+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93826252845232] v25'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05b005a040 con 0x7f05b8017050 2024-05-08T18:50:45.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.844+0000 7f05c93a2800 20 remove_watcher() i=7 2024-05-08T18:50:45.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.844+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f05b8017050 msgr2=0x7f05b8052550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.844+0000 7f05c93a2800 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f05b8017050 0x7f05b8052550 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.844+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5555a077b030 msgr2=0x5555a077d4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.844+0000 7f05c93a2800 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5555a077b030 0x5555a077d4f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.844+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f05c0014070 msgr2=0x7f05c0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.844+0000 7f05c93a2800 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f05c0014070 0x7f05c0036410 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.844+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5555a077fa40 msgr2=0x5555a0781e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.844+0000 7f05c93a2800 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5555a077fa40 0x5555a0781e30 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.844+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f049003bb50 msgr2=0x7f049003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.844+0000 7f05c93a2800 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f049003bb50 0x7f049003e010 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f05b8000c00 tx=0x7f05b8047000 comp rx=0 tx=0).stop 2024-05-08T18:50:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.844+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0767d70 msgr2=0x5555a076f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.844+0000 7f05bffff640 1 -- 172.21.15.132:0/740442333 reap_dead start 2024-05-08T18:50:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.844+0000 7f05c93a2800 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0767d70 0x5555a076f310 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f05c0051b70 tx=0x7f05c0052be0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 shutdown_connections 2024-05-08T18:50:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 --2- 172.21.15.132:0/740442333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0767d70 0x5555a076f310 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 >> 172.21.15.132:0/740442333 conn(0x5555a0764080 msgr2=0x5555a07616e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 shutdown_connections 2024-05-08T18:50:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 -- 172.21.15.132:0/740442333 wait complete. 2024-05-08T18:50:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 -- 172.21.15.132:0/2112942581 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f04a003bba0 msgr2=0x7f04a003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 --2- 172.21.15.132:0/2112942581 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f04a003bba0 0x7f04a003e060 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x5555a07471c0 tx=0x7f05b8018e70 comp rx=0 tx=0).stop 2024-05-08T18:50:45.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 -- 172.21.15.132:0/2112942581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a075aad0 msgr2=0x5555a075aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 --2- 172.21.15.132:0/2112942581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a075aad0 0x5555a075aef0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x5555a0747120 tx=0x7f05c0018830 comp rx=0 tx=0).stop 2024-05-08T18:50:45.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 -- 172.21.15.132:0/2112942581 shutdown_connections 2024-05-08T18:50:45.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 --2- 172.21.15.132:0/2112942581 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f04a003bba0 0x7f04a003e060 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 --2- 172.21.15.132:0/2112942581 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a075aad0 0x5555a075aef0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 -- 172.21.15.132:0/2112942581 >> 172.21.15.132:0/2112942581 conn(0x5555a074eb70 msgr2=0x5555a074ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 -- 172.21.15.132:0/2112942581 shutdown_connections 2024-05-08T18:50:45.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 -- 172.21.15.132:0/2112942581 wait complete. 2024-05-08T18:50:45.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 -- 172.21.15.132:0/1180455348 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5555a06446c0 msgr2=0x5555a07467e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 --2- 172.21.15.132:0/1180455348 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5555a06446c0 0x5555a07467e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 -- 172.21.15.132:0/1180455348 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5555a0749070 msgr2=0x5555a074b460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 --2- 172.21.15.132:0/1180455348 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5555a0749070 0x5555a074b460 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 -- 172.21.15.132:0/1180455348 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f04ac03bb50 msgr2=0x7f04ac03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 --2- 172.21.15.132:0/1180455348 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f04ac03bb50 0x7f04ac03e010 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f05b0054000 tx=0x7f05b004e000 comp rx=0 tx=0).stop 2024-05-08T18:50:45.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 -- 172.21.15.132:0/1180455348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0642b80 msgr2=0x5555a073f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 --2- 172.21.15.132:0/1180455348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0642b80 0x5555a073f5f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f05b8001de0 tx=0x7f05b8000ed0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.845+0000 7f05c93a2800 1 -- 172.21.15.132:0/1180455348 shutdown_connections 2024-05-08T18:50:45.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.846+0000 7f05c93a2800 1 --2- 172.21.15.132:0/1180455348 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5555a0749070 0x5555a074b460 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.846+0000 7f05c93a2800 1 --2- 172.21.15.132:0/1180455348 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5555a06446c0 0x5555a07467e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.846+0000 7f05c93a2800 1 --2- 172.21.15.132:0/1180455348 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f04ac03bb50 0x7f04ac03e010 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.846+0000 7f05c93a2800 1 --2- 172.21.15.132:0/1180455348 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5555a0642b80 0x5555a073f5f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.846+0000 7f05c93a2800 1 -- 172.21.15.132:0/1180455348 >> 172.21.15.132:0/1180455348 conn(0x5555a063e6c0 msgr2=0x5555a0731b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.846+0000 7f05c93a2800 1 -- 172.21.15.132:0/1180455348 shutdown_connections 2024-05-08T18:50:45.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.846+0000 7f05c93a2800 1 -- 172.21.15.132:0/1180455348 wait complete. 2024-05-08T18:50:45.865 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:50:44.835566Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-08T18:50:45.827734Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:44.835553Z', 'tags': [], 'group_ids': []} 2024-05-08T18:50:45.865 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:50:45.866 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:50:45.866 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:50:45.910 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:45.910 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:45.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.911+0000 7faeffa0f800 1 Processor -- start 2024-05-08T18:50:45.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.911+0000 7faeffa0f800 1 -- start start 2024-05-08T18:50:45.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.911+0000 7faeffa0f800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x559d66c9f8c0 0x559d66c9fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.911+0000 7faeffa0f800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559d66ca0360 con 0x559d66ca0b20 2024-05-08T18:50:45.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.911+0000 7faeffa0f800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x559d66b41e20 con 0x559d66c9f8c0 2024-05-08T18:50:45.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.912+0000 7faefb00d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x559d66c9f8c0 0x559d66c9fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.912+0000 7faefb00d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x559d66c9f8c0 0x559d66c9fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60102/0 (socket says 172.21.15.132:60102) 2024-05-08T18:50:45.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.912+0000 7faefb00d640 1 -- 172.21.15.132:0/2219291200 learned_addr learned my addr 172.21.15.132:0/2219291200 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.912+0000 7faef3fff640 1 --1- 172.21.15.132:0/2219291200 >> v1:172.21.15.42:6789/0 conn(0x559d66ca0b20 0x559d66ca0fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46776/0 (socket says 172.21.15.132:46776) 2024-05-08T18:50:45.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.912+0000 7faefb00d640 1 -- 172.21.15.132:0/2219291200 >> v1:172.21.15.42:6789/0 conn(0x559d66ca0b20 legacy=0x559d66ca0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.912+0000 7faefb00d640 1 -- 172.21.15.132:0/2219291200 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d66ca16e0 con 0x559d66c9f8c0 2024-05-08T18:50:45.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.914+0000 7faefb00d640 1 --2- 172.21.15.132:0/2219291200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66c9f8c0 0x559d66c9fce0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faeec0095b0 tx=0x7faeec01ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e316d0f654a01c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.914+0000 7faefa80c640 1 -- 172.21.15.132:0/2219291200 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeec009200 con 0x559d66c9f8c0 2024-05-08T18:50:45.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.914+0000 7faefa80c640 1 -- 172.21.15.132:0/2219291200 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeec007490 con 0x559d66c9f8c0 2024-05-08T18:50:45.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.914+0000 7faefa80c640 1 -- 172.21.15.132:0/2219291200 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeec007790 con 0x559d66c9f8c0 2024-05-08T18:50:45.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.915+0000 7faeffa0f800 1 -- 172.21.15.132:0/2219291200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66c9f8c0 msgr2=0x559d66c9fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.915+0000 7faeffa0f800 1 --2- 172.21.15.132:0/2219291200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66c9f8c0 0x559d66c9fce0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faeec0095b0 tx=0x7faeec01ddd0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.915+0000 7faeffa0f800 1 -- 172.21.15.132:0/2219291200 shutdown_connections 2024-05-08T18:50:45.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.915+0000 7faeffa0f800 1 --2- 172.21.15.132:0/2219291200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66c9f8c0 0x559d66c9fce0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.915+0000 7faeffa0f800 1 -- 172.21.15.132:0/2219291200 >> 172.21.15.132:0/2219291200 conn(0x559d66c9aea0 msgr2=0x559d66c9d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.915+0000 7faeffa0f800 1 -- 172.21.15.132:0/2219291200 shutdown_connections 2024-05-08T18:50:45.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.915+0000 7faeffa0f800 1 -- 172.21.15.132:0/2219291200 wait complete. 2024-05-08T18:50:45.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.928+0000 7faeffa0f800 1 Processor -- start 2024-05-08T18:50:45.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.928+0000 7faeffa0f800 1 -- start start 2024-05-08T18:50:45.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.928+0000 7faeffa0f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66c9f8c0 0x559d66d926e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.928+0000 7faeffa0f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559d66bec5b0 con 0x559d66c9f8c0 2024-05-08T18:50:45.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.929+0000 7faefb00d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66c9f8c0 0x559d66d926e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.929+0000 7faefb00d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66c9f8c0 0x559d66d926e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60112/0 (socket says 172.21.15.132:60112) 2024-05-08T18:50:45.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.929+0000 7faefb00d640 1 -- 172.21.15.132:0/2530587432 learned_addr learned my addr 172.21.15.132:0/2530587432 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.929+0000 7faefb00d640 1 -- 172.21.15.132:0/2530587432 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d66d92cb0 con 0x559d66c9f8c0 2024-05-08T18:50:45.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.929+0000 7faefb00d640 1 --2- 172.21.15.132:0/2530587432 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66c9f8c0 0x559d66d926e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faeec055040 tx=0x7faeec04d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2018a71f64a5d02e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.929+0000 7fade960a640 1 -- 172.21.15.132:0/2530587432 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeec009200 con 0x559d66c9f8c0 2024-05-08T18:50:45.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.929+0000 7fade960a640 1 -- 172.21.15.132:0/2530587432 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeec063070 con 0x559d66c9f8c0 2024-05-08T18:50:45.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.930+0000 7fade960a640 1 -- 172.21.15.132:0/2530587432 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeec0077b0 con 0x559d66c9f8c0 2024-05-08T18:50:45.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.930+0000 7faeffa0f800 1 -- 172.21.15.132:0/2530587432 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66c9f8c0 msgr2=0x559d66d926e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.930+0000 7faeffa0f800 1 --2- 172.21.15.132:0/2530587432 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66c9f8c0 0x559d66d926e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faeec055040 tx=0x7faeec04d000 comp rx=0 tx=0).stop 2024-05-08T18:50:45.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.930+0000 7faeffa0f800 1 -- 172.21.15.132:0/2530587432 shutdown_connections 2024-05-08T18:50:45.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.930+0000 7faeffa0f800 1 --2- 172.21.15.132:0/2530587432 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66c9f8c0 0x559d66d926e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.930+0000 7faeffa0f800 1 -- 172.21.15.132:0/2530587432 >> 172.21.15.132:0/2530587432 conn(0x559d66c9aea0 msgr2=0x559d66d8bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.930+0000 7faeffa0f800 1 -- 172.21.15.132:0/2530587432 shutdown_connections 2024-05-08T18:50:45.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.930+0000 7faeffa0f800 1 -- 172.21.15.132:0/2530587432 wait complete. 2024-05-08T18:50:45.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.930+0000 7faeffa0f800 1 Processor -- start 2024-05-08T18:50:45.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.931+0000 7faeffa0f800 1 -- start start 2024-05-08T18:50:45.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.931+0000 7faeffa0f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66c9f8c0 0x559d66d9a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.931+0000 7faeffa0f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559d66c04720 con 0x559d66c9f8c0 2024-05-08T18:50:45.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.931+0000 7faefb00d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66c9f8c0 0x559d66d9a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.931+0000 7faefb00d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66c9f8c0 0x559d66d9a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60114/0 (socket says 172.21.15.132:60114) 2024-05-08T18:50:45.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.931+0000 7faefb00d640 1 -- 172.21.15.132:0/3505221116 learned_addr learned my addr 172.21.15.132:0/3505221116 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.931+0000 7faefb00d640 1 -- 172.21.15.132:0/3505221116 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d66d9a670 con 0x559d66c9f8c0 2024-05-08T18:50:45.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.931+0000 7faefb00d640 1 --2- 172.21.15.132:0/3505221116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66c9f8c0 0x559d66d9a130 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faeec060040 tx=0x7faeec002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.931+0000 7fade7e07640 1 -- 172.21.15.132:0/3505221116 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeec06b070 con 0x559d66c9f8c0 2024-05-08T18:50:45.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.932+0000 7fade7e07640 1 -- 172.21.15.132:0/3505221116 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeec007e20 con 0x559d66c9f8c0 2024-05-08T18:50:45.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.932+0000 7faeffa0f800 1 -- 172.21.15.132:0/3505221116 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d66d9a900 con 0x559d66c9f8c0 2024-05-08T18:50:45.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.932+0000 7fade7e07640 1 -- 172.21.15.132:0/3505221116 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeec070590 con 0x559d66c9f8c0 2024-05-08T18:50:45.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.932+0000 7faeffa0f800 1 -- 172.21.15.132:0/3505221116 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d66d9d5b0 con 0x559d66c9f8c0 2024-05-08T18:50:45.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.932+0000 7fade7e07640 1 -- 172.21.15.132:0/3505221116 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7faeec070730 con 0x559d66c9f8c0 2024-05-08T18:50:45.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.933+0000 7fade7e07640 1 --2- 172.21.15.132:0/3505221116 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fade003bb50 0x7fade003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.933+0000 7fade7e07640 1 -- 172.21.15.132:0/3505221116 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7faeec059040 con 0x559d66c9f8c0 2024-05-08T18:50:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.933+0000 7faef3fff640 1 --2- 172.21.15.132:0/3505221116 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fade003bb50 0x7fade003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.933+0000 7faeffa0f800 1 --2- 172.21.15.132:0/3505221116 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x559d66ca0b20 0x559d66da1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.933+0000 7faeffa0f800 1 -- 172.21.15.132:0/3505221116 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x559d66da18f0 con 0x559d66ca0b20 2024-05-08T18:50:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.933+0000 7faefb80e640 1 --2- 172.21.15.132:0/3505221116 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x559d66ca0b20 0x559d66da1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.933+0000 7faef3fff640 1 --2- 172.21.15.132:0/3505221116 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fade003bb50 0x7fade003e010 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faee4000f60 tx=0x7faee4001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.933+0000 7faefb80e640 1 --2- 172.21.15.132:0/3505221116 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x559d66ca0b20 0x559d66da1370 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.934+0000 7faefb80e640 1 -- 172.21.15.132:0/3505221116 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faef400a4a0 con 0x559d66ca0b20 2024-05-08T18:50:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.934+0000 7faeffa0f800 1 -- 172.21.15.132:0/3505221116 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x559d66d9e940 con 0x559d66ca0b20 2024-05-08T18:50:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.934+0000 7faefb80e640 1 -- 172.21.15.132:0/3505221116 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faef400a4a0 con 0x559d66ca0b20 2024-05-08T18:50:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.934+0000 7faeffa0f800 1 --2- 172.21.15.132:0/3505221116 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x559d66da3c20 0x559d66da6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.934+0000 7faeffa0f800 1 -- 172.21.15.132:0/3505221116 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x559d66da6700 con 0x559d66da3c20 2024-05-08T18:50:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.934+0000 7faefb00d640 1 --2- 172.21.15.132:0/3505221116 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x559d66da3c20 0x559d66da6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.934+0000 7faefb00d640 1 --2- 172.21.15.132:0/3505221116 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x559d66da3c20 0x559d66da6010 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.935+0000 7faefb00d640 1 -- 172.21.15.132:0/3505221116 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faeec05d970 con 0x559d66da3c20 2024-05-08T18:50:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.935+0000 7faeffa0f800 1 -- 172.21.15.132:0/3505221116 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x559d66da2ac0 con 0x559d66ca0b20 2024-05-08T18:50:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.935+0000 7faefb80e640 1 -- 172.21.15.132:0/3505221116 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faef400a4a0 con 0x559d66ca0b20 2024-05-08T18:50:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.935+0000 7faeffa0f800 1 -- 172.21.15.132:0/3505221116 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x559d66da2fa0 con 0x559d66ca0b20 2024-05-08T18:50:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.935+0000 7faefb80e640 1 -- 172.21.15.132:0/3505221116 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faef400a4a0 con 0x559d66ca0b20 2024-05-08T18:50:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.935+0000 7faeffa0f800 1 Processor -- start 2024-05-08T18:50:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.935+0000 7faeffa0f800 1 -- start start 2024-05-08T18:50:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.936+0000 7faeffa0f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66db5640 0x559d66db5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.936+0000 7faeffa0f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559d66b92fc0 con 0x559d66db5640 2024-05-08T18:50:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.936+0000 7faefb80e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66db5640 0x559d66db5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.936+0000 7faefb80e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66db5640 0x559d66db5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60120/0 (socket says 172.21.15.132:60120) 2024-05-08T18:50:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.936+0000 7faefb80e640 1 -- 172.21.15.132:0/828787190 learned_addr learned my addr 172.21.15.132:0/828787190 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.936+0000 7faefb80e640 1 -- 172.21.15.132:0/828787190 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d66db5fa0 con 0x559d66db5640 2024-05-08T18:50:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.936+0000 7faefb80e640 1 --2- 172.21.15.132:0/828787190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66db5640 0x559d66db5a60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x559d66da1cd0 tx=0x7faef4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.936+0000 7fade5602640 1 -- 172.21.15.132:0/828787190 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faef4014450 con 0x559d66db5640 2024-05-08T18:50:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.937+0000 7fade5602640 1 -- 172.21.15.132:0/828787190 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef4014610 con 0x559d66db5640 2024-05-08T18:50:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.937+0000 7faeffa0f800 1 -- 172.21.15.132:0/828787190 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d66db6a10 con 0x559d66db5640 2024-05-08T18:50:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.937+0000 7fade5602640 1 -- 172.21.15.132:0/828787190 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faef4014930 con 0x559d66db5640 2024-05-08T18:50:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.937+0000 7faeffa0f800 1 -- 172.21.15.132:0/828787190 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d66db6f10 con 0x559d66db5640 2024-05-08T18:50:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.937+0000 7fade5602640 1 -- 172.21.15.132:0/828787190 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7faef4011040 con 0x559d66db5640 2024-05-08T18:50:45.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.937+0000 7fade5602640 1 --2- 172.21.15.132:0/828787190 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fadd403bba0 0x7fadd403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.938+0000 7fade5602640 1 -- 172.21.15.132:0/828787190 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7faef401e070 con 0x559d66db5640 2024-05-08T18:50:45.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.938+0000 7faefb00d640 1 --2- 172.21.15.132:0/828787190 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fadd403bba0 0x7fadd403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.938+0000 7faeffa0f800 1 Processor -- start 2024-05-08T18:50:45.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.938+0000 7faefb00d640 1 --2- 172.21.15.132:0/828787190 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fadd403bba0 0x7fadd403e060 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x559d66da1d70 tx=0x7faeec05df20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.938+0000 7faeffa0f800 1 -- start start 2024-05-08T18:50:45.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.938+0000 7faeffa0f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66dc28c0 0x559d66dc2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.938+0000 7faeffa0f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559d66d92f70 con 0x559d66dc28c0 2024-05-08T18:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.938+0000 7faefb80e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66dc28c0 0x559d66dc2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.938+0000 7faefb80e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66dc28c0 0x559d66dc2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60136/0 (socket says 172.21.15.132:60136) 2024-05-08T18:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.938+0000 7faefb80e640 1 -- 172.21.15.132:0/2523321213 learned_addr learned my addr 172.21.15.132:0/2523321213 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.939+0000 7faefb80e640 1 -- 172.21.15.132:0/2523321213 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d66dc32b0 con 0x559d66dc28c0 2024-05-08T18:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.939+0000 7faefb80e640 1 --2- 172.21.15.132:0/2523321213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66dc28c0 0x559d66dc2ce0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faef4052c80 tx=0x7faef4016570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c3e5df6144322b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.939+0000 7faddeffd640 1 -- 172.21.15.132:0/2523321213 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faef4028030 con 0x559d66dc28c0 2024-05-08T18:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.939+0000 7faddeffd640 1 -- 172.21.15.132:0/2523321213 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef404c000 con 0x559d66dc28c0 2024-05-08T18:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.939+0000 7faddeffd640 1 -- 172.21.15.132:0/2523321213 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faef4016930 con 0x559d66dc28c0 2024-05-08T18:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.939+0000 7faeffa0f800 1 -- 172.21.15.132:0/2523321213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66dc28c0 msgr2=0x559d66dc2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.939+0000 7faeffa0f800 1 --2- 172.21.15.132:0/2523321213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66dc28c0 0x559d66dc2ce0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faef4052c80 tx=0x7faef4016570 comp rx=0 tx=0).stop 2024-05-08T18:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.939+0000 7faeffa0f800 1 -- 172.21.15.132:0/2523321213 shutdown_connections 2024-05-08T18:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.939+0000 7faeffa0f800 1 --2- 172.21.15.132:0/2523321213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66dc28c0 0x559d66dc2ce0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.939+0000 7faeffa0f800 1 -- 172.21.15.132:0/2523321213 >> 172.21.15.132:0/2523321213 conn(0x559d66dbec20 msgr2=0x559d66dbcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.939+0000 7faeffa0f800 1 -- 172.21.15.132:0/2523321213 shutdown_connections 2024-05-08T18:50:45.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.939+0000 7faeffa0f800 1 -- 172.21.15.132:0/2523321213 wait complete. 2024-05-08T18:50:45.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.940+0000 7faeffa0f800 1 Processor -- start 2024-05-08T18:50:45.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.940+0000 7faeffa0f800 1 -- start start 2024-05-08T18:50:45.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.940+0000 7faeffa0f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66dc28c0 0x559d66d91c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.940+0000 7faeffa0f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x559d66dc3a20 con 0x559d66dc28c0 2024-05-08T18:50:45.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.940+0000 7faefb80e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66dc28c0 0x559d66d91c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.940+0000 7faefb80e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66dc28c0 0x559d66d91c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60148/0 (socket says 172.21.15.132:60148) 2024-05-08T18:50:45.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.940+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 learned_addr learned my addr 172.21.15.132:0/1228258760 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:45.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.940+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d66d90320 con 0x559d66dc28c0 2024-05-08T18:50:45.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.940+0000 7faefb80e640 1 --2- 172.21.15.132:0/1228258760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66dc28c0 0x559d66d91c30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faef4001700 tx=0x7faef4052c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.941+0000 7faddd7fa640 1 -- 172.21.15.132:0/1228258760 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faef402b350 con 0x559d66dc28c0 2024-05-08T18:50:45.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.941+0000 7faddd7fa640 1 -- 172.21.15.132:0/1228258760 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef4051470 con 0x559d66dc28c0 2024-05-08T18:50:45.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.941+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d66d905b0 con 0x559d66dc28c0 2024-05-08T18:50:45.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.941+0000 7faddd7fa640 1 -- 172.21.15.132:0/1228258760 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faef4051790 con 0x559d66dc28c0 2024-05-08T18:50:45.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.941+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d66d90ab0 con 0x559d66dc28c0 2024-05-08T18:50:45.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.941+0000 7faddd7fa640 1 -- 172.21.15.132:0/1228258760 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7faef404b370 con 0x559d66dc28c0 2024-05-08T18:50:45.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.942+0000 7faddd7fa640 1 --2- 172.21.15.132:0/1228258760 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fadc403bba0 0x7fadc403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.942+0000 7faddd7fa640 1 -- 172.21.15.132:0/1228258760 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7faef400e040 con 0x559d66dc28c0 2024-05-08T18:50:45.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.942+0000 7faefb00d640 1 --2- 172.21.15.132:0/1228258760 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fadc403bba0 0x7fadc403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.942+0000 7faeffa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.942+0000 7faeffa0f800 1 --2- 172.21.15.132:0/1228258760 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x559d66dd7ba0 0x559d66dda060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.942+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x559d66dda7b0 con 0x559d66dd7ba0 2024-05-08T18:50:45.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.942+0000 7faef3fff640 1 --2- 172.21.15.132:0/1228258760 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x559d66dd7ba0 0x559d66dda060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.942+0000 7faefb00d640 1 --2- 172.21.15.132:0/1228258760 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fadc403bba0 0x7fadc403e060 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faeec05dc80 tx=0x7faeec07d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.942+0000 7faef3fff640 1 --2- 172.21.15.132:0/1228258760 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x559d66dd7ba0 0x559d66dda060 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.942+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faee400f610 con 0x559d66dd7ba0 2024-05-08T18:50:45.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.942+0000 7faeffa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.942+0000 7faeffa0f800 20 realm 2024-05-08T18:50:45.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.942+0000 7faeffa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.942+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x559d66dd6ff0 con 0x559d66dd7ba0 2024-05-08T18:50:45.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.943+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faee400f610 con 0x559d66dd7ba0 2024-05-08T18:50:45.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.943+0000 7faeffa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.943+0000 7faeffa0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:45.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.943+0000 7faeffa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.943+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x559d66ddb290 con 0x559d66dd7ba0 2024-05-08T18:50:45.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.943+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faee400f610 con 0x559d66dd7ba0 2024-05-08T18:50:45.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.943+0000 7faeffa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.943+0000 7faeffa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.943+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x559d66ddbb60 con 0x559d66dd7ba0 2024-05-08T18:50:45.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.943+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faee400f610 con 0x559d66dd7ba0 2024-05-08T18:50:45.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.943+0000 7faeffa0f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:45.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.943+0000 7faeffa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.943+0000 7faeffa0f800 1 --2- 172.21.15.132:0/1228258760 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x559d66ddc410 0x559d66dde820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.943+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x559d66ddef80 con 0x559d66ddc410 2024-05-08T18:50:45.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.943+0000 7faefb80e640 1 --2- 172.21.15.132:0/1228258760 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x559d66ddc410 0x559d66dde820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.943+0000 7faefb80e640 1 --2- 172.21.15.132:0/1228258760 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x559d66ddc410 0x559d66dde820 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.944+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faef403e070 con 0x559d66ddc410 2024-05-08T18:50:45.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.944+0000 7faeffa0f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:45.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.944+0000 7faeffa0f800 20 searching for the correct realm 2024-05-08T18:50:45.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.944+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x559d66ddc410 2024-05-08T18:50:45.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.944+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef405e040 con 0x559d66ddc410 2024-05-08T18:50:45.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.944+0000 7faefb80e640 1 --2- 172.21.15.132:0/1228258760 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7faef4014070 0x7faef4019000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.944+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x7faef4014070 2024-05-08T18:50:45.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.945+0000 7faefb00d640 1 --2- 172.21.15.132:0/1228258760 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7faef4014070 0x7faef4019000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.945+0000 7faefb00d640 1 --2- 172.21.15.132:0/1228258760 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7faef4014070 0x7faef4019000 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.945+0000 7faefb00d640 1 -- 172.21.15.132:0/1228258760 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeec083030 con 0x7faef4014070 2024-05-08T18:50:45.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.945+0000 7faefb00d640 1 --2- 172.21.15.132:0/1228258760 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7faeec05d070 0x7faeec067610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:45.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.945+0000 7faefb00d640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x7faeec05d070 2024-05-08T18:50:45.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.945+0000 7faef3fff640 1 --2- 172.21.15.132:0/1228258760 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7faeec05d070 0x7faeec067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:45.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.946+0000 7faef3fff640 1 --2- 172.21.15.132:0/1228258760 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7faeec05d070 0x7faeec067610 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:45.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.946+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee400f610 con 0x7faeec05d070 2024-05-08T18:50:45.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.946+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x559d66dd7ba0 2024-05-08T18:50:45.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.946+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee400f610 con 0x559d66dd7ba0 2024-05-08T18:50:45.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.946+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x559d66dd7ba0 2024-05-08T18:50:45.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.946+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee402b040 con 0x559d66dd7ba0 2024-05-08T18:50:45.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.946+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x7faeec05d070 2024-05-08T18:50:45.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.947+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee402b040 con 0x7faeec05d070 2024-05-08T18:50:45.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.947+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x7faeec05d070 2024-05-08T18:50:45.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.947+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee402b040 con 0x7faeec05d070 2024-05-08T18:50:45.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.947+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x7faef4014070 2024-05-08T18:50:45.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.947+0000 7faefb00d640 1 -- 172.21.15.132:0/1228258760 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeec083030 con 0x7faef4014070 2024-05-08T18:50:45.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.947+0000 7faefb00d640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x559d66ddc410 2024-05-08T18:50:45.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.947+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef405e040 con 0x559d66ddc410 2024-05-08T18:50:45.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.947+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x559d66dd7ba0 2024-05-08T18:50:45.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.948+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee402b040 con 0x559d66dd7ba0 2024-05-08T18:50:45.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.948+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x7faeec05d070 2024-05-08T18:50:45.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.948+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee402b040 con 0x7faeec05d070 2024-05-08T18:50:45.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.948+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x559d66dd7ba0 2024-05-08T18:50:45.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.948+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7faee402b040 con 0x559d66dd7ba0 2024-05-08T18:50:45.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.948+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x7faef4014070 2024-05-08T18:50:45.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.948+0000 7faefb00d640 1 -- 172.21.15.132:0/1228258760 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faeec083030 con 0x7faef4014070 2024-05-08T18:50:45.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.948+0000 7faefb00d640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x559d66ddc410 2024-05-08T18:50:45.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.949+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faef405e040 con 0x559d66ddc410 2024-05-08T18:50:45.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.949+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x559d66ddc410 2024-05-08T18:50:45.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.949+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef405e040 con 0x559d66ddc410 2024-05-08T18:50:45.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.949+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x7faeec05d070 2024-05-08T18:50:45.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.949+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee402b040 con 0x7faeec05d070 2024-05-08T18:50:45.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.949+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x559d66ddc410 2024-05-08T18:50:45.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.950+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef405e040 con 0x559d66ddc410 2024-05-08T18:50:45.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.950+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x559d66ddc410 2024-05-08T18:50:45.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.950+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef405e040 con 0x559d66ddc410 2024-05-08T18:50:45.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.950+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x559d66dd7ba0 2024-05-08T18:50:45.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.950+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee402b040 con 0x559d66dd7ba0 2024-05-08T18:50:45.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.950+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x559d66dd7ba0 2024-05-08T18:50:45.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.950+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faee402b040 con 0x559d66dd7ba0 2024-05-08T18:50:45.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.950+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x7faeec05d070 2024-05-08T18:50:45.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.951+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee402b040 con 0x7faeec05d070 2024-05-08T18:50:45.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.951+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x559d66ddc410 2024-05-08T18:50:45.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.951+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef405e040 con 0x559d66ddc410 2024-05-08T18:50:45.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.951+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x7faef4014070 2024-05-08T18:50:45.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.951+0000 7faefb00d640 1 -- 172.21.15.132:0/1228258760 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeec083030 con 0x7faef4014070 2024-05-08T18:50:45.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.951+0000 7faefb00d640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x559d66dd7ba0 2024-05-08T18:50:45.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.951+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee402b040 con 0x559d66dd7ba0 2024-05-08T18:50:45.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.951+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x7faeec05d070 2024-05-08T18:50:45.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.952+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee403b040 con 0x7faeec05d070 2024-05-08T18:50:45.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.952+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x559d66ddc410 2024-05-08T18:50:45.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.952+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef405e040 con 0x559d66ddc410 2024-05-08T18:50:45.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.952+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x7faeec05d070 2024-05-08T18:50:45.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.952+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee403b040 con 0x7faeec05d070 2024-05-08T18:50:45.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.952+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x7faef4014070 2024-05-08T18:50:45.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.952+0000 7faefb00d640 1 -- 172.21.15.132:0/1228258760 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeec083030 con 0x7faef4014070 2024-05-08T18:50:45.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.952+0000 7faefb00d640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x559d66ddc410 2024-05-08T18:50:45.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.953+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faef405e040 con 0x559d66ddc410 2024-05-08T18:50:45.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.953+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x7faeec05d070 2024-05-08T18:50:45.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.953+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faee403b040 con 0x7faeec05d070 2024-05-08T18:50:45.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.953+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x559d66dd7ba0 2024-05-08T18:50:45.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.953+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faee403b040 con 0x559d66dd7ba0 2024-05-08T18:50:45.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.953+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x559d66de09b0 con 0x7faef4014070 2024-05-08T18:50:45.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faefb00d640 1 -- 172.21.15.132:0/1228258760 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeec083030 con 0x7faef4014070 2024-05-08T18:50:45.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faeffa0f800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:45.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faeffa0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:45.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faeffa0f800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:45.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faeffa0f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:45.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faeffa0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:45.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faeffa0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:45.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faeffa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x559d66ddfab0 con 0x559d66dd7ba0 2024-05-08T18:50:45.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faee403b040 con 0x559d66dd7ba0 2024-05-08T18:50:45.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faeffa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faeffa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x559d66de0350 con 0x559d66dd7ba0 2024-05-08T18:50:45.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faee403b040 con 0x559d66dd7ba0 2024-05-08T18:50:45.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faeffa0f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:45.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faeffa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x559d66ddf6f0 con 0x559d66dd7ba0 2024-05-08T18:50:45.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faee403b040 con 0x559d66dd7ba0 2024-05-08T18:50:45.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faeffa0f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:45.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faeffa0f800 20 zone default found 2024-05-08T18:50:45.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faeffa0f800 4 Realm: () 2024-05-08T18:50:45.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faeffa0f800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:45.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.954+0000 7faeffa0f800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:45.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.955+0000 7faeffa0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:45.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.955+0000 7faeffa0f800 20 zonegroup default 2024-05-08T18:50:45.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.955+0000 7faeffa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.955+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x559d66de0e80 con 0x7faeec05d070 2024-05-08T18:50:45.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.955+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faee403b040 con 0x7faeec05d070 2024-05-08T18:50:45.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.955+0000 7faeffa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.955+0000 7faeffa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.955+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x559d66de2d10 con 0x559d66ddc410 2024-05-08T18:50:45.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.955+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faef405e040 con 0x559d66ddc410 2024-05-08T18:50:45.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.955+0000 7faeffa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.955+0000 7faeffa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.955+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x559d66de30b0 con 0x559d66ddc410 2024-05-08T18:50:45.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.955+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faef405e040 con 0x559d66ddc410 2024-05-08T18:50:45.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.955+0000 7faeffa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:45.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.955+0000 7faeffa0f800 20 started sync module instance, tier type = 2024-05-08T18:50:45.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.955+0000 7faeffa0f800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:45.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.955+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de2150 con 0x7faef4014070 2024-05-08T18:50:45.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.956+0000 7faefb00d640 1 -- 172.21.15.132:0/1228258760 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeec083030 con 0x7faef4014070 2024-05-08T18:50:45.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.956+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94134524058784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de30b0 con 0x7faef4014070 2024-05-08T18:50:45.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.956+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de3a70 con 0x559d66dd7ba0 2024-05-08T18:50:45.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.959+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee403b040 con 0x559d66dd7ba0 2024-05-08T18:50:45.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.959+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94134524065696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de4270 con 0x559d66dd7ba0 2024-05-08T18:50:45.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.959+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de4d90 con 0x559d66ddc410 2024-05-08T18:50:45.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.960+0000 7faefb00d640 1 -- 172.21.15.132:0/1228258760 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94134524058784] v25'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeec083030 con 0x7faef4014070 2024-05-08T18:50:45.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.962+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faef405e040 con 0x559d66ddc410 2024-05-08T18:50:45.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.962+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94134524069984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de4d50 con 0x559d66ddc410 2024-05-08T18:50:45.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.962+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de5810 con 0x7faef4014070 2024-05-08T18:50:45.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.963+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94134524065696] v25'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee403b040 con 0x559d66dd7ba0 2024-05-08T18:50:45.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.963+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94134524069984] v25'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faef405e040 con 0x559d66ddc410 2024-05-08T18:50:45.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.963+0000 7faefb00d640 1 -- 172.21.15.132:0/1228258760 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeec083030 con 0x7faef4014070 2024-05-08T18:50:45.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.963+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94134524061104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de3cc0 con 0x7faef4014070 2024-05-08T18:50:45.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.963+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de6220 con 0x559d66dd7ba0 2024-05-08T18:50:45.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.964+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee403b040 con 0x559d66dd7ba0 2024-05-08T18:50:45.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.964+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94134524075680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de6950 con 0x559d66dd7ba0 2024-05-08T18:50:45.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.964+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de7470 con 0x7faeec05d070 2024-05-08T18:50:45.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.967+0000 7faefb00d640 1 -- 172.21.15.132:0/1228258760 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94134524061104] v25'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeec083030 con 0x7faef4014070 2024-05-08T18:50:45.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.967+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee403b040 con 0x7faeec05d070 2024-05-08T18:50:45.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.967+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94134524079936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de7430 con 0x7faeec05d070 2024-05-08T18:50:45.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.967+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de7e80 con 0x7faeec05d070 2024-05-08T18:50:45.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.969+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94134524075680] v25'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee403b040 con 0x559d66dd7ba0 2024-05-08T18:50:45.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.969+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(56 notify.6 [create] v25'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee403b040 con 0x7faeec05d070 2024-05-08T18:50:45.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.970+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94134524076960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de7e80 con 0x7faeec05d070 2024-05-08T18:50:45.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.970+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de8880 con 0x7faeec05d070 2024-05-08T18:50:45.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.972+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v25'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee403b040 con 0x7faeec05d070 2024-05-08T18:50:45.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.972+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94134524079936] v25'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee403b040 con 0x7faeec05d070 2024-05-08T18:50:45.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.972+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94134524085136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de8ce0 con 0x7faeec05d070 2024-05-08T18:50:45.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.972+0000 7faeffa0f800 20 add_watcher() i=0 2024-05-08T18:50:45.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.972+0000 7faeffa0f800 20 add_watcher() i=1 2024-05-08T18:50:45.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.972+0000 7faeffa0f800 20 add_watcher() i=2 2024-05-08T18:50:45.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.972+0000 7faeffa0f800 20 add_watcher() i=3 2024-05-08T18:50:45.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.972+0000 7faeffa0f800 20 add_watcher() i=4 2024-05-08T18:50:45.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.972+0000 7faeffa0f800 20 add_watcher() i=5 2024-05-08T18:50:45.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.975+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94134524085136] v25'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee403b040 con 0x7faeec05d070 2024-05-08T18:50:45.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.975+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94134524076960] v25'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee403b040 con 0x7faeec05d070 2024-05-08T18:50:45.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.975+0000 7faeffa0f800 20 add_watcher() i=6 2024-05-08T18:50:45.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.975+0000 7faeffa0f800 20 add_watcher() i=7 2024-05-08T18:50:45.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.975+0000 7faeffa0f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:45.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.975+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x559d66de53b0 con 0x559d66dd7ba0 2024-05-08T18:50:45.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.975+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faee403b040 con 0x559d66dd7ba0 2024-05-08T18:50:45.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.975+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94134524082640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de53b0 con 0x559d66dd7ba0 2024-05-08T18:50:45.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.977+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94134524082640] v25'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faee403b040 con 0x559d66dd7ba0 2024-05-08T18:50:45.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.977+0000 7fadb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:45.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.977+0000 7faeffa0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:45.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.977+0000 7faeffa0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:45.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.977+0000 7faeffa0f800 5 note: GC not initialized 2024-05-08T18:50:45.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.978+0000 7fadb0fe1640 20 reqs_thread_entry: start 2024-05-08T18:50:45.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.978+0000 7faeffa0f800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:45.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.978+0000 7faeffa0f800 20 Filter name: none 2024-05-08T18:50:45.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.978+0000 7fad2a7fc640 20 reqs_thread_entry: start 2024-05-08T18:50:45.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.978+0000 7faeffa0f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:45.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.978+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x559d66e1e760 con 0x559d66dd7ba0 2024-05-08T18:50:45.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.978+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7faee403b040 con 0x559d66dd7ba0 2024-05-08T18:50:45.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.978+0000 7faeffa0f800 20 rados_obj.operate() r=0 bl.length=502 2024-05-08T18:50:45.979 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:50:44.835566Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-08T18:50:45.827734Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:44.835553Z","tags":[],"group_ids":[]} 2024-05-08T18:50:45.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.979+0000 7fadb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:45.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.979+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94134524082640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66e1d350 con 0x559d66dd7ba0 2024-05-08T18:50:45.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.980+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94134524082640] v25'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faee403b040 con 0x559d66dd7ba0 2024-05-08T18:50:45.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.980+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94134524058784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de79d0 con 0x7faef4014070 2024-05-08T18:50:45.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.981+0000 7faefb00d640 1 -- 172.21.15.132:0/1228258760 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94134524058784] v25'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeec083030 con 0x7faef4014070 2024-05-08T18:50:45.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.981+0000 7faeffa0f800 20 remove_watcher() i=0 2024-05-08T18:50:45.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.981+0000 7faeffa0f800 2 removed watcher, disabling cache 2024-05-08T18:50:45.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.981+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94134524065696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de79d0 con 0x559d66dd7ba0 2024-05-08T18:50:45.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.982+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94134524065696] v25'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee403b040 con 0x559d66dd7ba0 2024-05-08T18:50:45.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.982+0000 7faeffa0f800 20 remove_watcher() i=1 2024-05-08T18:50:45.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.982+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94134524069984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de79d0 con 0x559d66ddc410 2024-05-08T18:50:45.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.983+0000 7faefb80e640 1 -- 172.21.15.132:0/1228258760 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94134524069984] v25'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faef405e040 con 0x559d66ddc410 2024-05-08T18:50:45.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.983+0000 7faeffa0f800 20 remove_watcher() i=2 2024-05-08T18:50:45.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.983+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94134524061104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de79d0 con 0x7faef4014070 2024-05-08T18:50:45.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.984+0000 7faefb00d640 1 -- 172.21.15.132:0/1228258760 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94134524061104] v25'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeec083030 con 0x7faef4014070 2024-05-08T18:50:45.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.984+0000 7faeffa0f800 20 remove_watcher() i=3 2024-05-08T18:50:45.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.984+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94134524075680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de79d0 con 0x559d66dd7ba0 2024-05-08T18:50:45.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.986+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94134524075680] v25'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee403b040 con 0x559d66dd7ba0 2024-05-08T18:50:45.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.986+0000 7faeffa0f800 20 remove_watcher() i=4 2024-05-08T18:50:45.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.986+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94134524079936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de79d0 con 0x7faeec05d070 2024-05-08T18:50:45.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.987+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94134524079936] v25'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee403b040 con 0x7faeec05d070 2024-05-08T18:50:45.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.987+0000 7faeffa0f800 20 remove_watcher() i=5 2024-05-08T18:50:45.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.987+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94134524076960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de6f40 con 0x7faeec05d070 2024-05-08T18:50:45.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.989+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94134524076960] v25'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee403b040 con 0x7faeec05d070 2024-05-08T18:50:45.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.989+0000 7faeffa0f800 20 remove_watcher() i=6 2024-05-08T18:50:45.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.989+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94134524085136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x559d66de6f40 con 0x7faeec05d070 2024-05-08T18:50:45.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.990+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94134524085136] v25'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faee403b040 con 0x7faeec05d070 2024-05-08T18:50:45.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.990+0000 7faeffa0f800 20 remove_watcher() i=7 2024-05-08T18:50:45.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.990+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7faeec05d070 msgr2=0x7faeec067610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.990+0000 7faeffa0f800 1 --2- 172.21.15.132:0/1228258760 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7faeec05d070 0x7faeec067610 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.990+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x559d66dd7ba0 msgr2=0x559d66dda060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.990+0000 7faeffa0f800 1 --2- 172.21.15.132:0/1228258760 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x559d66dd7ba0 0x559d66dda060 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.990+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7faef4014070 msgr2=0x7faef4019000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.990+0000 7faeffa0f800 1 --2- 172.21.15.132:0/1228258760 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7faef4014070 0x7faef4019000 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.990+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x559d66ddc410 msgr2=0x559d66dde820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.990+0000 7faeffa0f800 1 --2- 172.21.15.132:0/1228258760 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x559d66ddc410 0x559d66dde820 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.990+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fadc403bba0 msgr2=0x7fadc403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.990+0000 7faeffa0f800 1 --2- 172.21.15.132:0/1228258760 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fadc403bba0 0x7fadc403e060 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faeec05dc80 tx=0x7faeec07d000 comp rx=0 tx=0).stop 2024-05-08T18:50:45.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.990+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66dc28c0 msgr2=0x559d66d91c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.990+0000 7faeffa0f800 1 --2- 172.21.15.132:0/1228258760 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66dc28c0 0x559d66d91c30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faef4001700 tx=0x7faef4052c10 comp rx=0 tx=0).stop 2024-05-08T18:50:45.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.990+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 reap_dead start 2024-05-08T18:50:45.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.990+0000 7faef3fff640 1 -- 172.21.15.132:0/1228258760 reap_dead start 2024-05-08T18:50:45.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.990+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 shutdown_connections 2024-05-08T18:50:45.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.990+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 >> 172.21.15.132:0/1228258760 conn(0x559d66dbec20 msgr2=0x559d66dbc280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.990+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 shutdown_connections 2024-05-08T18:50:45.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.990+0000 7faeffa0f800 1 -- 172.21.15.132:0/1228258760 wait complete. 2024-05-08T18:50:45.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 -- 172.21.15.132:0/828787190 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fadd403bba0 msgr2=0x7fadd403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 --2- 172.21.15.132:0/828787190 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fadd403bba0 0x7fadd403e060 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x559d66da1d70 tx=0x7faeec05df20 comp rx=0 tx=0).stop 2024-05-08T18:50:45.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 -- 172.21.15.132:0/828787190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66db5640 msgr2=0x559d66db5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 --2- 172.21.15.132:0/828787190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66db5640 0x559d66db5a60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x559d66da1cd0 tx=0x7faef4018830 comp rx=0 tx=0).stop 2024-05-08T18:50:45.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 -- 172.21.15.132:0/828787190 shutdown_connections 2024-05-08T18:50:45.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 --2- 172.21.15.132:0/828787190 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fadd403bba0 0x7fadd403e060 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 --2- 172.21.15.132:0/828787190 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66db5640 0x559d66db5a60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 -- 172.21.15.132:0/828787190 >> 172.21.15.132:0/828787190 conn(0x559d66da96e0 msgr2=0x559d66da9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 -- 172.21.15.132:0/828787190 shutdown_connections 2024-05-08T18:50:45.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 -- 172.21.15.132:0/828787190 wait complete. 2024-05-08T18:50:45.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 -- 172.21.15.132:0/3505221116 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x559d66ca0b20 msgr2=0x559d66da1370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 --2- 172.21.15.132:0/3505221116 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x559d66ca0b20 0x559d66da1370 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 -- 172.21.15.132:0/3505221116 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x559d66da3c20 msgr2=0x559d66da6010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 --2- 172.21.15.132:0/3505221116 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x559d66da3c20 0x559d66da6010 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 -- 172.21.15.132:0/3505221116 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fade003bb50 msgr2=0x7fade003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 --2- 172.21.15.132:0/3505221116 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fade003bb50 0x7fade003e010 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faee4000f60 tx=0x7faee4001370 comp rx=0 tx=0).stop 2024-05-08T18:50:45.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 -- 172.21.15.132:0/3505221116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66c9f8c0 msgr2=0x559d66d9a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:45.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 --2- 172.21.15.132:0/3505221116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66c9f8c0 0x559d66d9a130 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faeec060040 tx=0x7faeec002fb0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 -- 172.21.15.132:0/3505221116 shutdown_connections 2024-05-08T18:50:45.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 --2- 172.21.15.132:0/3505221116 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x559d66da3c20 0x559d66da6010 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 --2- 172.21.15.132:0/3505221116 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x559d66ca0b20 0x559d66da1370 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 --2- 172.21.15.132:0/3505221116 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fade003bb50 0x7fade003e010 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 --2- 172.21.15.132:0/3505221116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559d66c9f8c0 0x559d66d9a130 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:45.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 -- 172.21.15.132:0/3505221116 >> 172.21.15.132:0/3505221116 conn(0x559d66c9aea0 msgr2=0x559d66d8a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:45.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 -- 172.21.15.132:0/3505221116 shutdown_connections 2024-05-08T18:50:45.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:45.991+0000 7faeffa0f800 1 -- 172.21.15.132:0/3505221116 wait complete. 2024-05-08T18:50:45.999 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:50:44.835566Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-08T18:50:45.827734Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:44.835553Z', 'tags': [], 'group_ids': []} 2024-05-08T18:50:46.000 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-05-08T18:50:46.000 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-05-08T18:50:46.000 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-05-08T18:50:46.086 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:46.086 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:46.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.088+0000 7f1784812800 1 Processor -- start 2024-05-08T18:50:46.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.088+0000 7f1784812800 1 -- start start 2024-05-08T18:50:46.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.088+0000 7f1784812800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x555df13d7150 0x555df13d7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.088+0000 7f1784812800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555df13d7bf0 con 0x555df13d83b0 2024-05-08T18:50:46.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.088+0000 7f1784812800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x555df1278e20 con 0x555df13d7150 2024-05-08T18:50:46.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.088+0000 7f177ff55640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x555df13d7150 0x555df13d7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.088+0000 7f177ff55640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x555df13d7150 0x555df13d7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60160/0 (socket says 172.21.15.132:60160) 2024-05-08T18:50:46.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.088+0000 7f177ff55640 1 -- 172.21.15.132:0/1921863211 learned_addr learned my addr 172.21.15.132:0/1921863211 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.088+0000 7f1777fff640 1 --1- 172.21.15.132:0/1921863211 >> v1:172.21.15.42:6789/0 conn(0x555df13d83b0 0x555df13d8830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46788/0 (socket says 172.21.15.132:46788) 2024-05-08T18:50:46.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.089+0000 7f177ff55640 1 -- 172.21.15.132:0/1921863211 >> v1:172.21.15.42:6789/0 conn(0x555df13d83b0 legacy=0x555df13d8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.089+0000 7f177ff55640 1 -- 172.21.15.132:0/1921863211 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555df13d8f70 con 0x555df13d7150 2024-05-08T18:50:46.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.091+0000 7f177ff55640 1 --2- 172.21.15.132:0/1921863211 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df13d7150 0x555df13d7570 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f177000a520 tx=0x7f177001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c1794172f9ed81 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.091+0000 7f177f754640 1 -- 172.21.15.132:0/1921863211 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1770057070 con 0x555df13d7150 2024-05-08T18:50:46.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.091+0000 7f177f754640 1 -- 172.21.15.132:0/1921863211 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1770052570 con 0x555df13d7150 2024-05-08T18:50:46.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.091+0000 7f177f754640 1 -- 172.21.15.132:0/1921863211 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1770052870 con 0x555df13d7150 2024-05-08T18:50:46.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.091+0000 7f1784812800 1 -- 172.21.15.132:0/1921863211 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df13d7150 msgr2=0x555df13d7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.091+0000 7f1784812800 1 --2- 172.21.15.132:0/1921863211 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df13d7150 0x555df13d7570 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f177000a520 tx=0x7f177001d010 comp rx=0 tx=0).stop 2024-05-08T18:50:46.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.091+0000 7f1784812800 1 -- 172.21.15.132:0/1921863211 shutdown_connections 2024-05-08T18:50:46.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.091+0000 7f1784812800 1 --2- 172.21.15.132:0/1921863211 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df13d7150 0x555df13d7570 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.091+0000 7f1784812800 1 -- 172.21.15.132:0/1921863211 >> 172.21.15.132:0/1921863211 conn(0x555df13d2730 msgr2=0x555df13d4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.091+0000 7f1784812800 1 -- 172.21.15.132:0/1921863211 shutdown_connections 2024-05-08T18:50:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.091+0000 7f1784812800 1 -- 172.21.15.132:0/1921863211 wait complete. 2024-05-08T18:50:46.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.104+0000 7f1784812800 1 Processor -- start 2024-05-08T18:50:46.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.104+0000 7f1784812800 1 -- start start 2024-05-08T18:50:46.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.105+0000 7f1784812800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df13d7150 0x555df13e2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.105+0000 7f1784812800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555df13235c0 con 0x555df13d7150 2024-05-08T18:50:46.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.105+0000 7f177ff55640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df13d7150 0x555df13e2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.105+0000 7f177ff55640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df13d7150 0x555df13e2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60170/0 (socket says 172.21.15.132:60170) 2024-05-08T18:50:46.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.105+0000 7f177ff55640 1 -- 172.21.15.132:0/443203922 learned_addr learned my addr 172.21.15.132:0/443203922 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.105+0000 7f177ff55640 1 -- 172.21.15.132:0/443203922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555df13e0720 con 0x555df13d7150 2024-05-08T18:50:46.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.105+0000 7f177ff55640 1 --2- 172.21.15.132:0/443203922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df13d7150 0x555df13e2160 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f177001d050 tx=0x7f177004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f598a326999faaaf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.105+0000 7f166de0b640 1 -- 172.21.15.132:0/443203922 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1770057040 con 0x555df13d7150 2024-05-08T18:50:46.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.106+0000 7f166de0b640 1 -- 172.21.15.132:0/443203922 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1770052850 con 0x555df13d7150 2024-05-08T18:50:46.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.106+0000 7f166de0b640 1 -- 172.21.15.132:0/443203922 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1770052b70 con 0x555df13d7150 2024-05-08T18:50:46.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.106+0000 7f1784812800 1 -- 172.21.15.132:0/443203922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df13d7150 msgr2=0x555df13e2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.106+0000 7f1784812800 1 --2- 172.21.15.132:0/443203922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df13d7150 0x555df13e2160 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f177001d050 tx=0x7f177004c000 comp rx=0 tx=0).stop 2024-05-08T18:50:46.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.106+0000 7f1784812800 1 -- 172.21.15.132:0/443203922 shutdown_connections 2024-05-08T18:50:46.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.106+0000 7f1784812800 1 --2- 172.21.15.132:0/443203922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df13d7150 0x555df13e2160 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.106+0000 7f1784812800 1 -- 172.21.15.132:0/443203922 >> 172.21.15.132:0/443203922 conn(0x555df13d2730 msgr2=0x555df14c5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.106+0000 7f1784812800 1 -- 172.21.15.132:0/443203922 shutdown_connections 2024-05-08T18:50:46.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.106+0000 7f1784812800 1 -- 172.21.15.132:0/443203922 wait complete. 2024-05-08T18:50:46.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.107+0000 7f1784812800 1 Processor -- start 2024-05-08T18:50:46.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.107+0000 7f1784812800 1 -- start start 2024-05-08T18:50:46.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.107+0000 7f1784812800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df13d7150 0x555df14d33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.107+0000 7f1784812800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555df134a9d0 con 0x555df13d7150 2024-05-08T18:50:46.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.107+0000 7f177ff55640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df13d7150 0x555df14d33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.107+0000 7f177ff55640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df13d7150 0x555df14d33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60182/0 (socket says 172.21.15.132:60182) 2024-05-08T18:50:46.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.107+0000 7f177ff55640 1 -- 172.21.15.132:0/1556623180 learned_addr learned my addr 172.21.15.132:0/1556623180 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.107+0000 7f177ff55640 1 -- 172.21.15.132:0/1556623180 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555df14d3900 con 0x555df13d7150 2024-05-08T18:50:46.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.107+0000 7f177ff55640 1 --2- 172.21.15.132:0/1556623180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df13d7150 0x555df14d33c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1770052820 tx=0x7f1770003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.108+0000 7f1667fff640 1 -- 172.21.15.132:0/1556623180 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1770073070 con 0x555df13d7150 2024-05-08T18:50:46.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.108+0000 7f1667fff640 1 -- 172.21.15.132:0/1556623180 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177005d570 con 0x555df13d7150 2024-05-08T18:50:46.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.108+0000 7f1784812800 1 -- 172.21.15.132:0/1556623180 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555df14d3b90 con 0x555df13d7150 2024-05-08T18:50:46.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.108+0000 7f1667fff640 1 -- 172.21.15.132:0/1556623180 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1770057070 con 0x555df13d7150 2024-05-08T18:50:46.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.108+0000 7f1784812800 1 -- 172.21.15.132:0/1556623180 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555df14d6840 con 0x555df13d7150 2024-05-08T18:50:46.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.109+0000 7f1667fff640 1 -- 172.21.15.132:0/1556623180 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1770076070 con 0x555df13d7150 2024-05-08T18:50:46.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.109+0000 7f1667fff640 1 --2- 172.21.15.132:0/1556623180 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f166803bb50 0x7f166803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.109+0000 7f1667fff640 1 -- 172.21.15.132:0/1556623180 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f1770094050 con 0x555df13d7150 2024-05-08T18:50:46.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.109+0000 7f1777fff640 1 --2- 172.21.15.132:0/1556623180 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f166803bb50 0x7f166803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.109+0000 7f1784812800 1 --2- 172.21.15.132:0/1556623180 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555df13d83b0 0x555df14da600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.109+0000 7f1784812800 1 -- 172.21.15.132:0/1556623180 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555df14dabe0 con 0x555df13d83b0 2024-05-08T18:50:46.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.109+0000 7f1780756640 1 --2- 172.21.15.132:0/1556623180 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555df13d83b0 0x555df14da600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.109+0000 7f1777fff640 1 --2- 172.21.15.132:0/1556623180 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f166803bb50 0x7f166803e010 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1768001e40 tx=0x7f17680013a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.109+0000 7f1780756640 1 --2- 172.21.15.132:0/1556623180 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555df13d83b0 0x555df14da600 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.110+0000 7f1780756640 1 -- 172.21.15.132:0/1556623180 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f177800a4a0 con 0x555df13d83b0 2024-05-08T18:50:46.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.110+0000 7f1784812800 1 -- 172.21.15.132:0/1556623180 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555df14db480 con 0x555df13d83b0 2024-05-08T18:50:46.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.110+0000 7f1780756640 1 -- 172.21.15.132:0/1556623180 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f177800a4a0 con 0x555df13d83b0 2024-05-08T18:50:46.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.110+0000 7f1784812800 1 --2- 172.21.15.132:0/1556623180 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555df14dcd90 0x555df14df220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.110+0000 7f1784812800 1 -- 172.21.15.132:0/1556623180 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555df14df9b0 con 0x555df14dcd90 2024-05-08T18:50:46.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.110+0000 7f177ff55640 1 --2- 172.21.15.132:0/1556623180 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555df14dcd90 0x555df14df220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.110+0000 7f177ff55640 1 --2- 172.21.15.132:0/1556623180 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555df14dcd90 0x555df14df220 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.111+0000 7f177ff55640 1 -- 172.21.15.132:0/1556623180 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1770075030 con 0x555df14dcd90 2024-05-08T18:50:46.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.111+0000 7f1784812800 1 -- 172.21.15.132:0/1556623180 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555df14dbcd0 con 0x555df13d83b0 2024-05-08T18:50:46.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.111+0000 7f1780756640 1 -- 172.21.15.132:0/1556623180 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f177800a4a0 con 0x555df13d83b0 2024-05-08T18:50:46.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.111+0000 7f1784812800 1 -- 172.21.15.132:0/1556623180 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555df14dc0b0 con 0x555df13d83b0 2024-05-08T18:50:46.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.111+0000 7f1780756640 1 -- 172.21.15.132:0/1556623180 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f177800a4a0 con 0x555df13d83b0 2024-05-08T18:50:46.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.112+0000 7f1784812800 1 Processor -- start 2024-05-08T18:50:46.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.112+0000 7f1784812800 1 -- start start 2024-05-08T18:50:46.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.112+0000 7f1784812800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df14ee930 0x555df14eed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.112+0000 7f1784812800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555df12c9fc0 con 0x555df14ee930 2024-05-08T18:50:46.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.112+0000 7f1780756640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df14ee930 0x555df14eed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.112+0000 7f1780756640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df14ee930 0x555df14eed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60198/0 (socket says 172.21.15.132:60198) 2024-05-08T18:50:46.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.112+0000 7f1780756640 1 -- 172.21.15.132:0/4185330874 learned_addr learned my addr 172.21.15.132:0/4185330874 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.112+0000 7f1780756640 1 -- 172.21.15.132:0/4185330874 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555df14ef290 con 0x555df14ee930 2024-05-08T18:50:46.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.112+0000 7f1780756640 1 --2- 172.21.15.132:0/4185330874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df14ee930 0x555df14eed50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x555df14d4290 tx=0x7f17780188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.113+0000 7f16657fa640 1 -- 172.21.15.132:0/4185330874 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1778014450 con 0x555df14ee930 2024-05-08T18:50:46.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.113+0000 7f16657fa640 1 -- 172.21.15.132:0/4185330874 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17780145f0 con 0x555df14ee930 2024-05-08T18:50:46.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.113+0000 7f1784812800 1 -- 172.21.15.132:0/4185330874 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555df14efd00 con 0x555df14ee930 2024-05-08T18:50:46.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.113+0000 7f16657fa640 1 -- 172.21.15.132:0/4185330874 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17780148d0 con 0x555df14ee930 2024-05-08T18:50:46.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.113+0000 7f1784812800 1 -- 172.21.15.132:0/4185330874 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555df14f0200 con 0x555df14ee930 2024-05-08T18:50:46.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.113+0000 7f16657fa640 1 -- 172.21.15.132:0/4185330874 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1778011040 con 0x555df14ee930 2024-05-08T18:50:46.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.114+0000 7f16657fa640 1 --2- 172.21.15.132:0/4185330874 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f165803bb50 0x7f165803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.114+0000 7f16657fa640 1 -- 172.21.15.132:0/4185330874 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f177801e070 con 0x555df14ee930 2024-05-08T18:50:46.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.114+0000 7f177ff55640 1 --2- 172.21.15.132:0/4185330874 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f165803bb50 0x7f165803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.114+0000 7f1784812800 1 Processor -- start 2024-05-08T18:50:46.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.114+0000 7f177ff55640 1 --2- 172.21.15.132:0/4185330874 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f165803bb50 0x7f165803e010 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x555df14d7cd0 tx=0x7f1770092580 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.114+0000 7f1784812800 1 -- start start 2024-05-08T18:50:46.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.114+0000 7f1784812800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df14fbc30 0x555df14fc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.114+0000 7f1784812800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555df13e09e0 con 0x555df14fbc30 2024-05-08T18:50:46.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.114+0000 7f1780756640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df14fbc30 0x555df14fc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.114+0000 7f1780756640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df14fbc30 0x555df14fc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60212/0 (socket says 172.21.15.132:60212) 2024-05-08T18:50:46.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.115+0000 7f1780756640 1 -- 172.21.15.132:0/3166091310 learned_addr learned my addr 172.21.15.132:0/3166091310 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.115+0000 7f1780756640 1 -- 172.21.15.132:0/3166091310 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555df14fc620 con 0x555df14fbc30 2024-05-08T18:50:46.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.115+0000 7f1780756640 1 --2- 172.21.15.132:0/3166091310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df14fbc30 0x555df14fc050 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1778005a80 tx=0x7f17780118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4270fe2106b5a34a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.115+0000 7f165effd640 1 -- 172.21.15.132:0/3166091310 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f177802bc50 con 0x555df14fbc30 2024-05-08T18:50:46.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.115+0000 7f165effd640 1 -- 172.21.15.132:0/3166091310 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1778047070 con 0x555df14fbc30 2024-05-08T18:50:46.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.115+0000 7f165effd640 1 -- 172.21.15.132:0/3166091310 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1778014a70 con 0x555df14fbc30 2024-05-08T18:50:46.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.115+0000 7f1784812800 1 -- 172.21.15.132:0/3166091310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df14fbc30 msgr2=0x555df14fc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.115+0000 7f1784812800 1 --2- 172.21.15.132:0/3166091310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df14fbc30 0x555df14fc050 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1778005a80 tx=0x7f17780118e0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.115+0000 7f1784812800 1 -- 172.21.15.132:0/3166091310 shutdown_connections 2024-05-08T18:50:46.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.115+0000 7f1784812800 1 --2- 172.21.15.132:0/3166091310 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df14fbc30 0x555df14fc050 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.115+0000 7f1784812800 1 -- 172.21.15.132:0/3166091310 >> 172.21.15.132:0/3166091310 conn(0x555df14f7f40 msgr2=0x555df14f5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.116+0000 7f1784812800 1 -- 172.21.15.132:0/3166091310 shutdown_connections 2024-05-08T18:50:46.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.116+0000 7f1784812800 1 -- 172.21.15.132:0/3166091310 wait complete. 2024-05-08T18:50:46.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.116+0000 7f1784812800 1 Processor -- start 2024-05-08T18:50:46.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.116+0000 7f1784812800 1 -- start start 2024-05-08T18:50:46.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.116+0000 7f1784812800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df14fbc30 0x555df1503170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.116+0000 7f1784812800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555df14fcdf0 con 0x555df14fbc30 2024-05-08T18:50:46.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.116+0000 7f1780756640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df14fbc30 0x555df1503170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.116+0000 7f1780756640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df14fbc30 0x555df1503170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60224/0 (socket says 172.21.15.132:60224) 2024-05-08T18:50:46.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.116+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 learned_addr learned my addr 172.21.15.132:0/2270674045 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.116+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555df15036b0 con 0x555df14fbc30 2024-05-08T18:50:46.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.117+0000 7f1780756640 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df14fbc30 0x555df1503170 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1778052bb0 tx=0x7f1778052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.117+0000 7f165d7fa640 1 -- 172.21.15.132:0/2270674045 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17780543b0 con 0x555df14fbc30 2024-05-08T18:50:46.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.117+0000 7f165d7fa640 1 -- 172.21.15.132:0/2270674045 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f177802b350 con 0x555df14fbc30 2024-05-08T18:50:46.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.117+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555df1503940 con 0x555df14fbc30 2024-05-08T18:50:46.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.117+0000 7f165d7fa640 1 -- 172.21.15.132:0/2270674045 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f177802b630 con 0x555df14fbc30 2024-05-08T18:50:46.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.117+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555df15065f0 con 0x555df14fbc30 2024-05-08T18:50:46.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.118+0000 7f165d7fa640 1 -- 172.21.15.132:0/2270674045 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f177802b7d0 con 0x555df14fbc30 2024-05-08T18:50:46.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.118+0000 7f165d7fa640 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f164803bba0 0x7f164803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.118+0000 7f165d7fa640 1 -- 172.21.15.132:0/2270674045 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f177800e040 con 0x555df14fbc30 2024-05-08T18:50:46.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.118+0000 7f177ff55640 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f164803bba0 0x7f164803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.118+0000 7f177ff55640 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f164803bba0 0x7f164803e060 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x555df14dfdb0 tx=0x7f1770082000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.119+0000 7f1784812800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.119+0000 7f1784812800 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555df150ee70 0x555df1511330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.119+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555df1511a80 con 0x555df150ee70 2024-05-08T18:50:46.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.119+0000 7f1777fff640 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555df150ee70 0x555df1511330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.119+0000 7f1777fff640 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555df150ee70 0x555df1511330 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.119+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f176800f670 con 0x555df150ee70 2024-05-08T18:50:46.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.119+0000 7f1784812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.119+0000 7f1784812800 20 realm 2024-05-08T18:50:46.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.119+0000 7f1784812800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.119+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555df150e2c0 con 0x555df150ee70 2024-05-08T18:50:46.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.119+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f176800f670 con 0x555df150ee70 2024-05-08T18:50:46.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.119+0000 7f1784812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.119+0000 7f1784812800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:46.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.119+0000 7f1784812800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.119+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555df1512570 con 0x555df150ee70 2024-05-08T18:50:46.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.120+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f176800f670 con 0x555df150ee70 2024-05-08T18:50:46.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.120+0000 7f1784812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.120+0000 7f1784812800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.120+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555df1512e40 con 0x555df150ee70 2024-05-08T18:50:46.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.120+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f176800f670 con 0x555df150ee70 2024-05-08T18:50:46.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.120+0000 7f1784812800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:46.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.120+0000 7f1784812800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.120+0000 7f1784812800 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555df1513780 0x555df1515b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.120+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555df1516320 con 0x555df1513780 2024-05-08T18:50:46.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.120+0000 7f1780756640 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555df1513780 0x555df1515b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.120+0000 7f1780756640 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555df1513780 0x555df1515b90 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.120+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f177803c020 con 0x555df1513780 2024-05-08T18:50:46.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.120+0000 7f1784812800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:46.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.120+0000 7f1784812800 20 searching for the correct realm 2024-05-08T18:50:46.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.120+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x555df1513780 2024-05-08T18:50:46.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.121+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177803c020 con 0x555df1513780 2024-05-08T18:50:46.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.121+0000 7f1780756640 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1778014070 0x7f177802e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.121+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x7f1778014070 2024-05-08T18:50:46.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.121+0000 7f177ff55640 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1778014070 0x7f177802e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.121+0000 7f177ff55640 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1778014070 0x7f177802e980 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.122+0000 7f177ff55640 1 -- 172.21.15.132:0/2270674045 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1770075030 con 0x7f1778014070 2024-05-08T18:50:46.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.122+0000 7f177ff55640 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1770078060 0x7f177005b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.122+0000 7f177ff55640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x7f1770078060 2024-05-08T18:50:46.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.122+0000 7f1777fff640 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1770078060 0x7f177005b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.122+0000 7f1777fff640 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1770078060 0x7f177005b7a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.123+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176800f670 con 0x7f1770078060 2024-05-08T18:50:46.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.123+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x555df150ee70 2024-05-08T18:50:46.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.123+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176800f670 con 0x555df150ee70 2024-05-08T18:50:46.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.123+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x555df150ee70 2024-05-08T18:50:46.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.123+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176802b040 con 0x555df150ee70 2024-05-08T18:50:46.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.123+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x7f1770078060 2024-05-08T18:50:46.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.123+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176802b040 con 0x7f1770078060 2024-05-08T18:50:46.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.123+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x7f1770078060 2024-05-08T18:50:46.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.123+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176802b040 con 0x7f1770078060 2024-05-08T18:50:46.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.123+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x7f1778014070 2024-05-08T18:50:46.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.124+0000 7f177ff55640 1 -- 172.21.15.132:0/2270674045 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1770075030 con 0x7f1778014070 2024-05-08T18:50:46.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.124+0000 7f177ff55640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x555df1513780 2024-05-08T18:50:46.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.124+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177803c020 con 0x555df1513780 2024-05-08T18:50:46.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.124+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x555df150ee70 2024-05-08T18:50:46.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.124+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176802b040 con 0x555df150ee70 2024-05-08T18:50:46.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.124+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x7f1770078060 2024-05-08T18:50:46.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.124+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176802b040 con 0x7f1770078060 2024-05-08T18:50:46.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.124+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x555df150ee70 2024-05-08T18:50:46.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.125+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f176802b040 con 0x555df150ee70 2024-05-08T18:50:46.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.125+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x7f1778014070 2024-05-08T18:50:46.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.125+0000 7f177ff55640 1 -- 172.21.15.132:0/2270674045 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1770075030 con 0x7f1778014070 2024-05-08T18:50:46.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.125+0000 7f177ff55640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x555df1513780 2024-05-08T18:50:46.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.125+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f177803c020 con 0x555df1513780 2024-05-08T18:50:46.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.125+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x555df1513780 2024-05-08T18:50:46.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.125+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177803c020 con 0x555df1513780 2024-05-08T18:50:46.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.125+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x7f1770078060 2024-05-08T18:50:46.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.126+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176802b040 con 0x7f1770078060 2024-05-08T18:50:46.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.126+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x555df1513780 2024-05-08T18:50:46.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.126+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177803c020 con 0x555df1513780 2024-05-08T18:50:46.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.126+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x555df1513780 2024-05-08T18:50:46.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.126+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177803c020 con 0x555df1513780 2024-05-08T18:50:46.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.126+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x555df150ee70 2024-05-08T18:50:46.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.126+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176802b040 con 0x555df150ee70 2024-05-08T18:50:46.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.126+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x555df150ee70 2024-05-08T18:50:46.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.127+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f176802b040 con 0x555df150ee70 2024-05-08T18:50:46.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.127+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x7f1770078060 2024-05-08T18:50:46.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.127+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176802b040 con 0x7f1770078060 2024-05-08T18:50:46.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.127+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x555df1513780 2024-05-08T18:50:46.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.127+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177803c020 con 0x555df1513780 2024-05-08T18:50:46.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.127+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x7f1778014070 2024-05-08T18:50:46.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.128+0000 7f177ff55640 1 -- 172.21.15.132:0/2270674045 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1770075030 con 0x7f1778014070 2024-05-08T18:50:46.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.128+0000 7f177ff55640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x555df150ee70 2024-05-08T18:50:46.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.128+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176802b040 con 0x555df150ee70 2024-05-08T18:50:46.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.128+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x7f1770078060 2024-05-08T18:50:46.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.128+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176803b040 con 0x7f1770078060 2024-05-08T18:50:46.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.128+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x555df1513780 2024-05-08T18:50:46.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.128+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177803c020 con 0x555df1513780 2024-05-08T18:50:46.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.128+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x7f1770078060 2024-05-08T18:50:46.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.129+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176803b040 con 0x7f1770078060 2024-05-08T18:50:46.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.129+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x7f1778014070 2024-05-08T18:50:46.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.129+0000 7f177ff55640 1 -- 172.21.15.132:0/2270674045 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1770075030 con 0x7f1778014070 2024-05-08T18:50:46.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.129+0000 7f177ff55640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x555df1513780 2024-05-08T18:50:46.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.129+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f177803c020 con 0x555df1513780 2024-05-08T18:50:46.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.129+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x7f1770078060 2024-05-08T18:50:46.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.129+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f176803b040 con 0x7f1770078060 2024-05-08T18:50:46.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.129+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x555df150ee70 2024-05-08T18:50:46.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.130+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f176803b040 con 0x555df150ee70 2024-05-08T18:50:46.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.130+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555df1517c70 con 0x7f1778014070 2024-05-08T18:50:46.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.130+0000 7f177ff55640 1 -- 172.21.15.132:0/2270674045 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1770075030 con 0x7f1778014070 2024-05-08T18:50:46.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.130+0000 7f1784812800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:46.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.130+0000 7f1784812800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:46.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.130+0000 7f1784812800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:46.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.130+0000 7f1784812800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:46.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.130+0000 7f1784812800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:46.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.130+0000 7f1784812800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:46.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.130+0000 7f1784812800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.130+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555df1516d10 con 0x555df150ee70 2024-05-08T18:50:46.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.130+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f176803b040 con 0x555df150ee70 2024-05-08T18:50:46.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.130+0000 7f1784812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.130+0000 7f1784812800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.130+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555df15175b0 con 0x555df150ee70 2024-05-08T18:50:46.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.130+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f176803b040 con 0x555df150ee70 2024-05-08T18:50:46.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.130+0000 7f1784812800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:46.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.130+0000 7f1784812800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.131+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555df15180f0 con 0x555df150ee70 2024-05-08T18:50:46.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.131+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f176803b040 con 0x555df150ee70 2024-05-08T18:50:46.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.131+0000 7f1784812800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:46.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.131+0000 7f1784812800 20 zone default found 2024-05-08T18:50:46.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.131+0000 7f1784812800 4 Realm: () 2024-05-08T18:50:46.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.131+0000 7f1784812800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:46.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.131+0000 7f1784812800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:46.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.131+0000 7f1784812800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:46.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.131+0000 7f1784812800 20 zonegroup default 2024-05-08T18:50:46.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.131+0000 7f1784812800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.131+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555df1518130 con 0x7f1770078060 2024-05-08T18:50:46.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.131+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f176803b040 con 0x7f1770078060 2024-05-08T18:50:46.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.131+0000 7f1784812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.131+0000 7f1784812800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.131+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555df1519f50 con 0x555df1513780 2024-05-08T18:50:46.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.131+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f177803c020 con 0x555df1513780 2024-05-08T18:50:46.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.131+0000 7f1784812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.131+0000 7f1784812800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.132+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555df151a340 con 0x555df1513780 2024-05-08T18:50:46.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.132+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f177803c020 con 0x555df1513780 2024-05-08T18:50:46.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.132+0000 7f1784812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.132+0000 7f1784812800 20 started sync module instance, tier type = 2024-05-08T18:50:46.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.132+0000 7f1784812800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:46.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.132+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df15193f0 con 0x7f1778014070 2024-05-08T18:50:46.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.133+0000 7f177ff55640 1 -- 172.21.15.132:0/2270674045 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1770075030 con 0x7f1778014070 2024-05-08T18:50:46.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.133+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93861968973632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151a7d0 con 0x7f1778014070 2024-05-08T18:50:46.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.133+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151b020 con 0x555df150ee70 2024-05-08T18:50:46.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.135+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176803b040 con 0x555df150ee70 2024-05-08T18:50:46.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.135+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93861968980848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151b640 con 0x555df150ee70 2024-05-08T18:50:46.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.135+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151c160 con 0x555df1513780 2024-05-08T18:50:46.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.135+0000 7f177ff55640 1 -- 172.21.15.132:0/2270674045 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93861968973632] v25'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1770075030 con 0x7f1778014070 2024-05-08T18:50:46.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.136+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f177803c020 con 0x555df1513780 2024-05-08T18:50:46.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.136+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93861968985136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151c120 con 0x555df1513780 2024-05-08T18:50:46.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.136+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151cc20 con 0x7f1778014070 2024-05-08T18:50:46.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.137+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93861968980848] v25'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176803b040 con 0x555df150ee70 2024-05-08T18:50:46.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.139+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93861968985136] v25'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f177803c020 con 0x555df1513780 2024-05-08T18:50:46.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.139+0000 7f177ff55640 1 -- 172.21.15.132:0/2270674045 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1770075030 con 0x7f1778014070 2024-05-08T18:50:46.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.139+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93861968975840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151b090 con 0x7f1778014070 2024-05-08T18:50:46.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.139+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151d630 con 0x555df150ee70 2024-05-08T18:50:46.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.141+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176803b040 con 0x555df150ee70 2024-05-08T18:50:46.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.141+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93861968991072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151dd90 con 0x555df150ee70 2024-05-08T18:50:46.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.141+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151e8b0 con 0x7f1770078060 2024-05-08T18:50:46.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.144+0000 7f177ff55640 1 -- 172.21.15.132:0/2270674045 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93861968975840] v25'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1770075030 con 0x7f1778014070 2024-05-08T18:50:46.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.144+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176803b040 con 0x7f1770078060 2024-05-08T18:50:46.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.144+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93861968995200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151e870 con 0x7f1770078060 2024-05-08T18:50:46.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.144+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151f310 con 0x7f1770078060 2024-05-08T18:50:46.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.146+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93861968991072] v25'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176803b040 con 0x555df150ee70 2024-05-08T18:50:46.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.146+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93861968995200] v25'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176803b040 con 0x7f1770078060 2024-05-08T18:50:46.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.147+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176803b040 con 0x7f1770078060 2024-05-08T18:50:46.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.147+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93861968987984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151f310 con 0x7f1770078060 2024-05-08T18:50:46.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.147+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151fbb0 con 0x7f1770078060 2024-05-08T18:50:46.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.148+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(58 notify.7 [create] v25'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176803b040 con 0x7f1770078060 2024-05-08T18:50:46.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.148+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93861968987984] v25'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176803b040 con 0x7f1770078060 2024-05-08T18:50:46.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.148+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93861969000192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151f310 con 0x7f1770078060 2024-05-08T18:50:46.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.148+0000 7f1784812800 20 add_watcher() i=0 2024-05-08T18:50:46.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.148+0000 7f1784812800 20 add_watcher() i=1 2024-05-08T18:50:46.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.148+0000 7f1784812800 20 add_watcher() i=2 2024-05-08T18:50:46.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.148+0000 7f1784812800 20 add_watcher() i=3 2024-05-08T18:50:46.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.148+0000 7f1784812800 20 add_watcher() i=4 2024-05-08T18:50:46.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.148+0000 7f1784812800 20 add_watcher() i=5 2024-05-08T18:50:46.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.148+0000 7f1784812800 20 add_watcher() i=6 2024-05-08T18:50:46.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.148+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93861969000192] v25'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176803b040 con 0x7f1770078060 2024-05-08T18:50:46.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.148+0000 7f1784812800 20 add_watcher() i=7 2024-05-08T18:50:46.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.148+0000 7f1784812800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:46.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.148+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555df151eed0 con 0x555df150ee70 2024-05-08T18:50:46.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.149+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f176803b040 con 0x555df150ee70 2024-05-08T18:50:46.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.149+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93861969001248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df15204d0 con 0x555df150ee70 2024-05-08T18:50:46.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.150+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93861969001248] v25'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f176803b040 con 0x555df150ee70 2024-05-08T18:50:46.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.150+0000 7f1635fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:46.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.150+0000 7f1784812800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:46.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.150+0000 7f1784812800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:46.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.150+0000 7f1784812800 5 note: GC not initialized 2024-05-08T18:50:46.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.150+0000 7f1634fe1640 20 reqs_thread_entry: start 2024-05-08T18:50:46.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.151+0000 7f1784812800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:46.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.151+0000 7f1784812800 20 Filter name: none 2024-05-08T18:50:46.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.151+0000 7f15ae7fc640 20 reqs_thread_entry: start 2024-05-08T18:50:46.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.151+0000 7f1784812800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:50:46.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.151+0000 7f1784812800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.151+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555df1556100 con 0x555df150ee70 2024-05-08T18:50:46.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.151+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f176803b040 con 0x555df150ee70 2024-05-08T18:50:46.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.151+0000 7f1784812800 20 rados_obj.operate() r=0 bl.length=502 2024-05-08T18:50:46.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.151+0000 7f1784812800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:50:46.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.151+0000 7f1784812800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:46.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.151+0000 7f1784812800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:46.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.151+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df155c6e0 con 0x555df150ee70 2024-05-08T18:50:46.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.152+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v25'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f176803b040 con 0x555df150ee70 2024-05-08T18:50:46.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.152+0000 7f1784812800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:46.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.152+0000 7f1784812800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:46.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.152+0000 7f1784812800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:50:46.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.152+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93861969248416 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555df1557d20 con 0x555df150ee70 2024-05-08T18:50:46.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.153+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== watch-notify(notify (1) cookie 93861968991072 notify 107374182404 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f1768018040 con 0x555df150ee70 2024-05-08T18:50:46.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.153+0000 7f165effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182404 cookie 93861968991072 notifier 4347 bl.length()=567 2024-05-08T18:50:46.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.153+0000 7f165effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:46.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.153+0000 7f165effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:46.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.153+0000 7f165effd640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f1644003ea0 con 0x555df150ee70 2024-05-08T18:50:46.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.153+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(64 notify.4 [notify cookie 93861969248416 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f176803b040 con 0x555df150ee70 2024-05-08T18:50:46.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.153+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176803b040 con 0x555df150ee70 2024-05-08T18:50:46.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.153+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== watch-notify(notify_complete (2) cookie 93861969248416 notify 107374182404 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1768009050 con 0x555df150ee70 2024-05-08T18:50:46.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.153+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df155c0a0 con 0x7f1770078060 2024-05-08T18:50:46.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.154+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v25'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f176803b040 con 0x7f1770078060 2024-05-08T18:50:46.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.154+0000 7f1784812800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:50:46.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.154+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 93861969248416 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555df1557870 con 0x555df1513780 2024-05-08T18:50:46.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.154+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== watch-notify(notify (1) cookie 93861968985136 notify 107374182401 ret 0) ==== 212+0+0 (crc 0 0 0) 0x555df15065f0 con 0x555df1513780 2024-05-08T18:50:46.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.154+0000 7f165e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182401 cookie 93861968985136 notifier 4347 bl.length()=170 2024-05-08T18:50:46.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.155+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 notify.2 [notify cookie 93861969248416 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f177803c020 con 0x555df1513780 2024-05-08T18:50:46.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.155+0000 7f165e7fc640 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f15b40032c0 con 0x555df1513780 2024-05-08T18:50:46.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.155+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f177803c020 con 0x555df1513780 2024-05-08T18:50:46.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.155+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== watch-notify(notify_complete (2) cookie 93861969248416 notify 107374182401 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555df1503940 con 0x555df1513780 2024-05-08T18:50:46.159 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:50:44.835566Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:44.835553Z","tags":[],"group_ids":[]} 2024-05-08T18:50:46.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.156+0000 7f1635fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:46.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.156+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93861969001248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df15547e0 con 0x555df150ee70 2024-05-08T18:50:46.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.157+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93861969001248] v25'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f176803b040 con 0x555df150ee70 2024-05-08T18:50:46.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.157+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93861968973632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151fb20 con 0x7f1778014070 2024-05-08T18:50:46.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.158+0000 7f177ff55640 1 -- 172.21.15.132:0/2270674045 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93861968973632] v25'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1770075030 con 0x7f1778014070 2024-05-08T18:50:46.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.158+0000 7f1784812800 20 remove_watcher() i=0 2024-05-08T18:50:46.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.158+0000 7f1784812800 2 removed watcher, disabling cache 2024-05-08T18:50:46.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.158+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93861968980848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151fb20 con 0x555df150ee70 2024-05-08T18:50:46.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.159+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93861968980848] v25'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176803b040 con 0x555df150ee70 2024-05-08T18:50:46.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.159+0000 7f1784812800 20 remove_watcher() i=1 2024-05-08T18:50:46.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.159+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93861968985136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151fb20 con 0x555df1513780 2024-05-08T18:50:46.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.160+0000 7f1780756640 1 -- 172.21.15.132:0/2270674045 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93861968985136] v25'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f177803c020 con 0x555df1513780 2024-05-08T18:50:46.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.160+0000 7f1784812800 20 remove_watcher() i=2 2024-05-08T18:50:46.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.160+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93861968975840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151bc30 con 0x7f1778014070 2024-05-08T18:50:46.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.160+0000 7f177ff55640 1 -- 172.21.15.132:0/2270674045 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93861968975840] v25'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1770075030 con 0x7f1778014070 2024-05-08T18:50:46.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.160+0000 7f1784812800 20 remove_watcher() i=3 2024-05-08T18:50:46.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.160+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93861968991072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151fb20 con 0x555df150ee70 2024-05-08T18:50:46.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.161+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93861968991072] v25'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176803b040 con 0x555df150ee70 2024-05-08T18:50:46.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.161+0000 7f1784812800 20 remove_watcher() i=4 2024-05-08T18:50:46.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.161+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93861968995200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151bc30 con 0x7f1770078060 2024-05-08T18:50:46.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.162+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93861968995200] v25'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176803b040 con 0x7f1770078060 2024-05-08T18:50:46.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.162+0000 7f1784812800 20 remove_watcher() i=5 2024-05-08T18:50:46.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.162+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93861968987984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151d360 con 0x7f1770078060 2024-05-08T18:50:46.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.163+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93861968987984] v25'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176803b040 con 0x7f1770078060 2024-05-08T18:50:46.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.163+0000 7f1784812800 20 remove_watcher() i=6 2024-05-08T18:50:46.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.163+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93861969000192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555df151fb20 con 0x7f1770078060 2024-05-08T18:50:46.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.164+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93861969000192] v25'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f176803b040 con 0x7f1770078060 2024-05-08T18:50:46.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.164+0000 7f1784812800 20 remove_watcher() i=7 2024-05-08T18:50:46.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1770078060 msgr2=0x7f177005b7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1770078060 0x7f177005b7a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555df150ee70 msgr2=0x555df1511330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555df150ee70 0x555df1511330 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1778014070 msgr2=0x7f177802e980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1778014070 0x7f177802e980 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555df1513780 msgr2=0x555df1515b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555df1513780 0x555df1515b90 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f164803bba0 msgr2=0x7f164803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f164803bba0 0x7f164803e060 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x555df14dfdb0 tx=0x7f1770082000 comp rx=0 tx=0).stop 2024-05-08T18:50:46.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df14fbc30 msgr2=0x555df1503170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df14fbc30 0x555df1503170 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1778052bb0 tx=0x7f1778052be0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1777fff640 1 -- 172.21.15.132:0/2270674045 reap_dead start 2024-05-08T18:50:46.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 shutdown_connections 2024-05-08T18:50:46.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 --2- 172.21.15.132:0/2270674045 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df14fbc30 0x555df1503170 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 >> 172.21.15.132:0/2270674045 conn(0x555df14f7f40 msgr2=0x555df14f55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 shutdown_connections 2024-05-08T18:50:46.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 -- 172.21.15.132:0/2270674045 wait complete. 2024-05-08T18:50:46.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 -- 172.21.15.132:0/4185330874 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f165803bb50 msgr2=0x7f165803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 --2- 172.21.15.132:0/4185330874 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f165803bb50 0x7f165803e010 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x555df14d7cd0 tx=0x7f1770092580 comp rx=0 tx=0).stop 2024-05-08T18:50:46.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 -- 172.21.15.132:0/4185330874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df14ee930 msgr2=0x555df14eed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 --2- 172.21.15.132:0/4185330874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df14ee930 0x555df14eed50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x555df14d4290 tx=0x7f17780188f0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 -- 172.21.15.132:0/4185330874 shutdown_connections 2024-05-08T18:50:46.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 --2- 172.21.15.132:0/4185330874 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f165803bb50 0x7f165803e010 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 --2- 172.21.15.132:0/4185330874 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df14ee930 0x555df14eed50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 -- 172.21.15.132:0/4185330874 >> 172.21.15.132:0/4185330874 conn(0x555df14e29d0 msgr2=0x555df14e2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 -- 172.21.15.132:0/4185330874 shutdown_connections 2024-05-08T18:50:46.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.165+0000 7f1784812800 1 -- 172.21.15.132:0/4185330874 wait complete. 2024-05-08T18:50:46.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.166+0000 7f1784812800 1 -- 172.21.15.132:0/1556623180 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555df13d83b0 msgr2=0x555df14da600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.166+0000 7f1784812800 1 --2- 172.21.15.132:0/1556623180 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555df13d83b0 0x555df14da600 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.166+0000 7f1784812800 1 -- 172.21.15.132:0/1556623180 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555df14dcd90 msgr2=0x555df14df220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.166+0000 7f1784812800 1 --2- 172.21.15.132:0/1556623180 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555df14dcd90 0x555df14df220 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.166+0000 7f1784812800 1 -- 172.21.15.132:0/1556623180 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f166803bb50 msgr2=0x7f166803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.166+0000 7f1784812800 1 --2- 172.21.15.132:0/1556623180 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f166803bb50 0x7f166803e010 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1768001e40 tx=0x7f17680013a0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.166+0000 7f1784812800 1 -- 172.21.15.132:0/1556623180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df13d7150 msgr2=0x555df14d33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.166+0000 7f1784812800 1 --2- 172.21.15.132:0/1556623180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df13d7150 0x555df14d33c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1770052820 tx=0x7f1770003020 comp rx=0 tx=0).stop 2024-05-08T18:50:46.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.166+0000 7f1784812800 1 -- 172.21.15.132:0/1556623180 shutdown_connections 2024-05-08T18:50:46.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.166+0000 7f1784812800 1 --2- 172.21.15.132:0/1556623180 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555df14dcd90 0x555df14df220 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.166+0000 7f1784812800 1 --2- 172.21.15.132:0/1556623180 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555df13d83b0 0x555df14da600 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.166+0000 7f1784812800 1 --2- 172.21.15.132:0/1556623180 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f166803bb50 0x7f166803e010 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.166+0000 7f1784812800 1 --2- 172.21.15.132:0/1556623180 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555df13d7150 0x555df14d33c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.166+0000 7f1784812800 1 -- 172.21.15.132:0/1556623180 >> 172.21.15.132:0/1556623180 conn(0x555df13d2730 msgr2=0x555df14c4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.166+0000 7f1784812800 1 -- 172.21.15.132:0/1556623180 shutdown_connections 2024-05-08T18:50:46.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.166+0000 7f1784812800 1 -- 172.21.15.132:0/1556623180 wait complete. 2024-05-08T18:50:46.174 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:50:44.835566Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:44.835553Z', 'tags': [], 'group_ids': []} 2024-05-08T18:50:46.174 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-05-08T18:50:46.174 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-05-08T18:50:46.175 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-05-08T18:50:46.220 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:46.221 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:46.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.222+0000 7efd2cd0c800 1 Processor -- start 2024-05-08T18:50:46.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.222+0000 7efd2cd0c800 1 -- start start 2024-05-08T18:50:46.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.222+0000 7efd2cd0c800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x564803aa55e0 0x564803aa79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.222+0000 7efd2cd0c800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564803aa7fa0 con 0x564803aa1150 2024-05-08T18:50:46.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.222+0000 7efd2cd0c800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x564803942e20 con 0x564803aa55e0 2024-05-08T18:50:46.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.223+0000 7efd2a003640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x564803aa55e0 0x564803aa79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.223+0000 7efd2a003640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x564803aa55e0 0x564803aa79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60230/0 (socket says 172.21.15.132:60230) 2024-05-08T18:50:46.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.223+0000 7efd2a003640 1 -- 172.21.15.132:0/248551213 learned_addr learned my addr 172.21.15.132:0/248551213 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.223+0000 7efd2a003640 1 -- 172.21.15.132:0/248551213 >> v1:172.21.15.42:6789/0 conn(0x564803aa1150 legacy=0x564803aa1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.223+0000 7efd2a003640 1 -- 172.21.15.132:0/248551213 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564803aa91d0 con 0x564803aa55e0 2024-05-08T18:50:46.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.225+0000 7efd2a003640 1 --2- 172.21.15.132:0/248551213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803aa55e0 0x564803aa79d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efd2000a520 tx=0x7efd2001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd562f64554173e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.225+0000 7efd29802640 1 -- 172.21.15.132:0/248551213 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd20057070 con 0x564803aa55e0 2024-05-08T18:50:46.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.225+0000 7efd29802640 1 -- 172.21.15.132:0/248551213 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd20052570 con 0x564803aa55e0 2024-05-08T18:50:46.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.225+0000 7efd29802640 1 -- 172.21.15.132:0/248551213 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd2004ae60 con 0x564803aa55e0 2024-05-08T18:50:46.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.225+0000 7efd2cd0c800 1 -- 172.21.15.132:0/248551213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803aa55e0 msgr2=0x564803aa79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.225+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/248551213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803aa55e0 0x564803aa79d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efd2000a520 tx=0x7efd2001d010 comp rx=0 tx=0).stop 2024-05-08T18:50:46.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.226+0000 7efd2cd0c800 1 -- 172.21.15.132:0/248551213 shutdown_connections 2024-05-08T18:50:46.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.226+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/248551213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803aa55e0 0x564803aa79d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.226+0000 7efd2cd0c800 1 -- 172.21.15.132:0/248551213 >> 172.21.15.132:0/248551213 conn(0x564803a9c730 msgr2=0x564803a9eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.226+0000 7efd2cd0c800 1 -- 172.21.15.132:0/248551213 shutdown_connections 2024-05-08T18:50:46.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.226+0000 7efd2cd0c800 1 -- 172.21.15.132:0/248551213 wait complete. 2024-05-08T18:50:46.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.239+0000 7efd2cd0c800 1 Processor -- start 2024-05-08T18:50:46.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.239+0000 7efd2cd0c800 1 -- start start 2024-05-08T18:50:46.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.239+0000 7efd2cd0c800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803aa1150 0x564803a152d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.239+0000 7efd2cd0c800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5648039ed5c0 con 0x564803aa1150 2024-05-08T18:50:46.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.240+0000 7efd2a804640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803aa1150 0x564803a152d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.240+0000 7efd2a804640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803aa1150 0x564803a152d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60242/0 (socket says 172.21.15.132:60242) 2024-05-08T18:50:46.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.240+0000 7efd2a804640 1 -- 172.21.15.132:0/3870531810 learned_addr learned my addr 172.21.15.132:0/3870531810 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.240+0000 7efd2a804640 1 -- 172.21.15.132:0/3870531810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564803b96320 con 0x564803aa1150 2024-05-08T18:50:46.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.240+0000 7efd2a804640 1 --2- 172.21.15.132:0/3870531810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803aa1150 0x564803a152d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efd1c001610 tx=0x7efd1c001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9890ca663172710 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.240+0000 7efc18e09640 1 -- 172.21.15.132:0/3870531810 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd1c017070 con 0x564803aa1150 2024-05-08T18:50:46.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.240+0000 7efc18e09640 1 -- 172.21.15.132:0/3870531810 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1c00f660 con 0x564803aa1150 2024-05-08T18:50:46.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.240+0000 7efc18e09640 1 -- 172.21.15.132:0/3870531810 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd1c00f980 con 0x564803aa1150 2024-05-08T18:50:46.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.241+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3870531810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803aa1150 msgr2=0x564803a152d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.241+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/3870531810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803aa1150 0x564803a152d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efd1c001610 tx=0x7efd1c001ad0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.241+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3870531810 shutdown_connections 2024-05-08T18:50:46.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.241+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/3870531810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803aa1150 0x564803a152d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.241+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3870531810 >> 172.21.15.132:0/3870531810 conn(0x564803a9c730 msgr2=0x564803b8de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.241+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3870531810 shutdown_connections 2024-05-08T18:50:46.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.241+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3870531810 wait complete. 2024-05-08T18:50:46.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.241+0000 7efd2cd0c800 1 Processor -- start 2024-05-08T18:50:46.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.241+0000 7efd2cd0c800 1 -- start start 2024-05-08T18:50:46.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.242+0000 7efd2cd0c800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803aa1150 0x564803b9b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.242+0000 7efd2cd0c800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564803aa8470 con 0x564803aa1150 2024-05-08T18:50:46.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.242+0000 7efd2a804640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803aa1150 0x564803b9b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.242+0000 7efd2a804640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803aa1150 0x564803b9b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60248/0 (socket says 172.21.15.132:60248) 2024-05-08T18:50:46.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.242+0000 7efd2a804640 1 -- 172.21.15.132:0/631169642 learned_addr learned my addr 172.21.15.132:0/631169642 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.242+0000 7efd2a804640 1 -- 172.21.15.132:0/631169642 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564803b9b6b0 con 0x564803aa1150 2024-05-08T18:50:46.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.242+0000 7efd2a804640 1 --2- 172.21.15.132:0/631169642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803aa1150 0x564803b9b170 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efd1c003000 tx=0x7efd1c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.242+0000 7efc17606640 1 -- 172.21.15.132:0/631169642 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd1c017070 con 0x564803aa1150 2024-05-08T18:50:46.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.242+0000 7efc17606640 1 -- 172.21.15.132:0/631169642 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1c023070 con 0x564803aa1150 2024-05-08T18:50:46.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.242+0000 7efd2cd0c800 1 -- 172.21.15.132:0/631169642 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564803b9b940 con 0x564803aa1150 2024-05-08T18:50:46.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.242+0000 7efc17606640 1 -- 172.21.15.132:0/631169642 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd1c011c40 con 0x564803aa1150 2024-05-08T18:50:46.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.242+0000 7efd2cd0c800 1 -- 172.21.15.132:0/631169642 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564803b9e5f0 con 0x564803aa1150 2024-05-08T18:50:46.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.243+0000 7efc17606640 1 -- 172.21.15.132:0/631169642 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7efd1c028460 con 0x564803aa1150 2024-05-08T18:50:46.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.243+0000 7efc17606640 1 --2- 172.21.15.132:0/631169642 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efc1003bb50 0x7efc1003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.243+0000 7efc17606640 1 -- 172.21.15.132:0/631169642 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7efd1c052530 con 0x564803aa1150 2024-05-08T18:50:46.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.243+0000 7efd2a003640 1 --2- 172.21.15.132:0/631169642 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efc1003bb50 0x7efc1003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.244+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/631169642 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564803aa55e0 0x564803ba23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.244+0000 7efd2cd0c800 1 -- 172.21.15.132:0/631169642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564803ba28f0 con 0x564803aa55e0 2024-05-08T18:50:46.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.244+0000 7efd2b005640 1 --2- 172.21.15.132:0/631169642 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564803aa55e0 0x564803ba23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.244+0000 7efd2a003640 1 --2- 172.21.15.132:0/631169642 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efc1003bb50 0x7efc1003e010 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efd20054000 tx=0x7efd2004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.244+0000 7efd2b005640 1 --2- 172.21.15.132:0/631169642 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564803aa55e0 0x564803ba23b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.244+0000 7efd2b005640 1 -- 172.21.15.132:0/631169642 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd240083e0 con 0x564803aa55e0 2024-05-08T18:50:46.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.244+0000 7efd2cd0c800 1 -- 172.21.15.132:0/631169642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564803b9f960 con 0x564803aa55e0 2024-05-08T18:50:46.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.244+0000 7efd2b005640 1 -- 172.21.15.132:0/631169642 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efd240083e0 con 0x564803aa55e0 2024-05-08T18:50:46.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.245+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/631169642 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564803ba4be0 0x564803ba6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.245+0000 7efd2cd0c800 1 -- 172.21.15.132:0/631169642 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564803ba76c0 con 0x564803ba4be0 2024-05-08T18:50:46.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.245+0000 7efd2a804640 1 --2- 172.21.15.132:0/631169642 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564803ba4be0 0x564803ba6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.245+0000 7efd2a804640 1 --2- 172.21.15.132:0/631169642 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564803ba4be0 0x564803ba6fd0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.245+0000 7efd2a804640 1 -- 172.21.15.132:0/631169642 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efd1c003030 con 0x564803ba4be0 2024-05-08T18:50:46.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.245+0000 7efd2cd0c800 1 -- 172.21.15.132:0/631169642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564803ba3a80 con 0x564803aa55e0 2024-05-08T18:50:46.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.245+0000 7efd2b005640 1 -- 172.21.15.132:0/631169642 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efd240083e0 con 0x564803aa55e0 2024-05-08T18:50:46.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.245+0000 7efd2cd0c800 1 -- 172.21.15.132:0/631169642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564803ba3f40 con 0x564803aa55e0 2024-05-08T18:50:46.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.246+0000 7efd2b005640 1 -- 172.21.15.132:0/631169642 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efd240083e0 con 0x564803aa55e0 2024-05-08T18:50:46.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.246+0000 7efd2cd0c800 1 Processor -- start 2024-05-08T18:50:46.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.246+0000 7efd2cd0c800 1 -- start start 2024-05-08T18:50:46.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.246+0000 7efd2cd0c800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803bb6660 0x564803bb6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.246+0000 7efd2cd0c800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564803993fc0 con 0x564803bb6660 2024-05-08T18:50:46.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.247+0000 7efd2b005640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803bb6660 0x564803bb6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.247+0000 7efd2b005640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803bb6660 0x564803bb6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60262/0 (socket says 172.21.15.132:60262) 2024-05-08T18:50:46.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.247+0000 7efd2b005640 1 -- 172.21.15.132:0/2463336735 learned_addr learned my addr 172.21.15.132:0/2463336735 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.247+0000 7efd2b005640 1 -- 172.21.15.132:0/2463336735 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564803bb6fc0 con 0x564803bb6660 2024-05-08T18:50:46.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.247+0000 7efd2b005640 1 --2- 172.21.15.132:0/2463336735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803bb6660 0x564803bb6a80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x564803b9c570 tx=0x7efd2400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.247+0000 7efc14e01640 1 -- 172.21.15.132:0/2463336735 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd24007d00 con 0x564803bb6660 2024-05-08T18:50:46.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.247+0000 7efc14e01640 1 -- 172.21.15.132:0/2463336735 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd2401e020 con 0x564803bb6660 2024-05-08T18:50:46.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.247+0000 7efd2cd0c800 1 -- 172.21.15.132:0/2463336735 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564803bb7a30 con 0x564803bb6660 2024-05-08T18:50:46.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.247+0000 7efc14e01640 1 -- 172.21.15.132:0/2463336735 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd24019420 con 0x564803bb6660 2024-05-08T18:50:46.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.247+0000 7efd2cd0c800 1 -- 172.21.15.132:0/2463336735 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564803bb7f30 con 0x564803bb6660 2024-05-08T18:50:46.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.248+0000 7efc14e01640 1 -- 172.21.15.132:0/2463336735 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7efd24016040 con 0x564803bb6660 2024-05-08T18:50:46.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.248+0000 7efc14e01640 1 --2- 172.21.15.132:0/2463336735 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efc0403bba0 0x7efc0403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.248+0000 7efc14e01640 1 -- 172.21.15.132:0/2463336735 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7efd2401f030 con 0x564803bb6660 2024-05-08T18:50:46.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.248+0000 7efd2a804640 1 --2- 172.21.15.132:0/2463336735 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efc0403bba0 0x7efc0403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.249+0000 7efd2cd0c800 1 Processor -- start 2024-05-08T18:50:46.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.249+0000 7efd2a804640 1 --2- 172.21.15.132:0/2463336735 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efc0403bba0 0x7efc0403e060 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x564803ba2d50 tx=0x7efd1c044040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.249+0000 7efd2cd0c800 1 -- start start 2024-05-08T18:50:46.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.249+0000 7efd2cd0c800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803bc3920 0x564803bc3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.249+0000 7efd2cd0c800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564803b96670 con 0x564803bc3920 2024-05-08T18:50:46.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.249+0000 7efd2b005640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803bc3920 0x564803bc3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.249+0000 7efd2b005640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803bc3920 0x564803bc3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60276/0 (socket says 172.21.15.132:60276) 2024-05-08T18:50:46.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.249+0000 7efd2b005640 1 -- 172.21.15.132:0/123953235 learned_addr learned my addr 172.21.15.132:0/123953235 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.249+0000 7efd2b005640 1 -- 172.21.15.132:0/123953235 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564803bc4310 con 0x564803bc3920 2024-05-08T18:50:46.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.250+0000 7efd2b005640 1 --2- 172.21.15.132:0/123953235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803bc3920 0x564803bc3d40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efd24052c50 tx=0x7efd24015e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581631d1d1ea3da8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.250+0000 7efc0e7fc640 1 -- 172.21.15.132:0/123953235 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd2401d070 con 0x564803bc3920 2024-05-08T18:50:46.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.250+0000 7efc0e7fc640 1 -- 172.21.15.132:0/123953235 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd240183b0 con 0x564803bc3920 2024-05-08T18:50:46.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.250+0000 7efc0e7fc640 1 -- 172.21.15.132:0/123953235 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd240173b0 con 0x564803bc3920 2024-05-08T18:50:46.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.250+0000 7efd2cd0c800 1 -- 172.21.15.132:0/123953235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803bc3920 msgr2=0x564803bc3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.250+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/123953235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803bc3920 0x564803bc3d40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efd24052c50 tx=0x7efd24015e60 comp rx=0 tx=0).stop 2024-05-08T18:50:46.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.250+0000 7efd2cd0c800 1 -- 172.21.15.132:0/123953235 shutdown_connections 2024-05-08T18:50:46.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.250+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/123953235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803bc3920 0x564803bc3d40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.250+0000 7efd2cd0c800 1 -- 172.21.15.132:0/123953235 >> 172.21.15.132:0/123953235 conn(0x564803bbfc80 msgr2=0x564803bbdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.250+0000 7efd2cd0c800 1 -- 172.21.15.132:0/123953235 shutdown_connections 2024-05-08T18:50:46.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.250+0000 7efd2cd0c800 1 -- 172.21.15.132:0/123953235 wait complete. 2024-05-08T18:50:46.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.251+0000 7efd2cd0c800 1 Processor -- start 2024-05-08T18:50:46.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.251+0000 7efd2cd0c800 1 -- start start 2024-05-08T18:50:46.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.251+0000 7efd2cd0c800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803bc3920 0x564803bcaf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.251+0000 7efd2cd0c800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564803bc4a80 con 0x564803bc3920 2024-05-08T18:50:46.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.251+0000 7efd2b005640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803bc3920 0x564803bcaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.251+0000 7efd2b005640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803bc3920 0x564803bcaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60282/0 (socket says 172.21.15.132:60282) 2024-05-08T18:50:46.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.251+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 learned_addr learned my addr 172.21.15.132:0/3201505475 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.251+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564803bcb440 con 0x564803bc3920 2024-05-08T18:50:46.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.251+0000 7efd2b005640 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803bc3920 0x564803bcaf00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efd24022590 tx=0x7efd24052bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.252+0000 7efc0cff9640 1 -- 172.21.15.132:0/3201505475 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd24030020 con 0x564803bc3920 2024-05-08T18:50:46.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.252+0000 7efc0cff9640 1 -- 172.21.15.132:0/3201505475 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd24045030 con 0x564803bc3920 2024-05-08T18:50:46.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.252+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564803bcb6d0 con 0x564803bc3920 2024-05-08T18:50:46.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.252+0000 7efc0cff9640 1 -- 172.21.15.132:0/3201505475 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd24016ca0 con 0x564803bc3920 2024-05-08T18:50:46.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.252+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564803bce380 con 0x564803bc3920 2024-05-08T18:50:46.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.252+0000 7efc0cff9640 1 -- 172.21.15.132:0/3201505475 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7efd24033020 con 0x564803bc3920 2024-05-08T18:50:46.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.253+0000 7efc0cff9640 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efbf403bba0 0x7efbf403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.253+0000 7efc0cff9640 1 -- 172.21.15.132:0/3201505475 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7efd24036ab0 con 0x564803bc3920 2024-05-08T18:50:46.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.253+0000 7efd2a804640 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efbf403bba0 0x7efbf403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.253+0000 7efd2a804640 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efbf403bba0 0x7efbf403e060 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efd1c011fd0 tx=0x7efd1c017f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.253+0000 7efd2cd0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.253+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564803bd6a10 0x564803bd8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.253+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564803bd9620 con 0x564803bd6a10 2024-05-08T18:50:46.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.253+0000 7efd2a003640 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564803bd6a10 0x564803bd8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.254+0000 7efd2a003640 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564803bd6a10 0x564803bd8ed0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.254+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.254+0000 7efd2cd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.254+0000 7efd2cd0c800 20 realm 2024-05-08T18:50:46.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.254+0000 7efd2cd0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.254+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564803bd99f0 con 0x564803bd6a10 2024-05-08T18:50:46.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.254+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.254+0000 7efd2cd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.254+0000 7efd2cd0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:46.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.254+0000 7efd2cd0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.254+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564803bda2c0 con 0x564803bd6a10 2024-05-08T18:50:46.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.254+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.254+0000 7efd2cd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.254+0000 7efd2cd0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.254+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564803bda660 con 0x564803bd6a10 2024-05-08T18:50:46.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.255+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.255+0000 7efd2cd0c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:46.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.255+0000 7efd2cd0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.255+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564803bdb3c0 0x564803bdd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.255+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564803bddd70 con 0x564803bdb3c0 2024-05-08T18:50:46.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.255+0000 7efd2b005640 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564803bdb3c0 0x564803bdd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.255+0000 7efd2b005640 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564803bdb3c0 0x564803bdd7b0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.255+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efd2404a050 con 0x564803bdb3c0 2024-05-08T18:50:46.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.255+0000 7efd2cd0c800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:46.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.255+0000 7efd2cd0c800 20 searching for the correct realm 2024-05-08T18:50:46.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.255+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x564803bdb3c0 2024-05-08T18:50:46.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.256+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd2404a050 con 0x564803bdb3c0 2024-05-08T18:50:46.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.256+0000 7efd2b005640 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7efd24035020 0x7efd2402c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.256+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x7efd24035020 2024-05-08T18:50:46.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.256+0000 7efd2a804640 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7efd24035020 0x7efd2402c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.256+0000 7efd2a804640 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7efd24035020 0x7efd2402c430 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.256+0000 7efd2a804640 1 -- 172.21.15.132:0/3201505475 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1c03d070 con 0x7efd24035020 2024-05-08T18:50:46.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.257+0000 7efd2a804640 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7efd1c04f150 0x7efd1c026360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.257+0000 7efd2a804640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x7efd1c04f150 2024-05-08T18:50:46.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.257+0000 7efd2a003640 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7efd1c04f150 0x7efd1c026360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.257+0000 7efd2a003640 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7efd1c04f150 0x7efd1c026360 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.257+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd2005a040 con 0x7efd1c04f150 2024-05-08T18:50:46.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.257+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x564803bd6a10 2024-05-08T18:50:46.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.258+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.258+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x564803bd6a10 2024-05-08T18:50:46.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.258+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.258+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x7efd1c04f150 2024-05-08T18:50:46.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.258+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd2005a040 con 0x7efd1c04f150 2024-05-08T18:50:46.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.258+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x7efd1c04f150 2024-05-08T18:50:46.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.258+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd2005a040 con 0x7efd1c04f150 2024-05-08T18:50:46.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.258+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x7efd24035020 2024-05-08T18:50:46.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.259+0000 7efd2a804640 1 -- 172.21.15.132:0/3201505475 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1c03d070 con 0x7efd24035020 2024-05-08T18:50:46.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.259+0000 7efd2a804640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x564803bdb3c0 2024-05-08T18:50:46.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.259+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd2404a050 con 0x564803bdb3c0 2024-05-08T18:50:46.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.259+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x564803bd6a10 2024-05-08T18:50:46.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.259+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.259+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x7efd1c04f150 2024-05-08T18:50:46.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.259+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd2005a040 con 0x7efd1c04f150 2024-05-08T18:50:46.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.259+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x564803bd6a10 2024-05-08T18:50:46.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.259+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.259+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x7efd24035020 2024-05-08T18:50:46.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.260+0000 7efd2a804640 1 -- 172.21.15.132:0/3201505475 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efd1c03d070 con 0x7efd24035020 2024-05-08T18:50:46.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.260+0000 7efd2a804640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x564803bdb3c0 2024-05-08T18:50:46.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.260+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efd2404a050 con 0x564803bdb3c0 2024-05-08T18:50:46.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.260+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x564803bdb3c0 2024-05-08T18:50:46.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.260+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd2404a050 con 0x564803bdb3c0 2024-05-08T18:50:46.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.260+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x7efd1c04f150 2024-05-08T18:50:46.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.260+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd2005a040 con 0x7efd1c04f150 2024-05-08T18:50:46.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.260+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x564803bdb3c0 2024-05-08T18:50:46.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.261+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd2404a050 con 0x564803bdb3c0 2024-05-08T18:50:46.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.261+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x564803bdb3c0 2024-05-08T18:50:46.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.261+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd2404a050 con 0x564803bdb3c0 2024-05-08T18:50:46.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.261+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x564803bd6a10 2024-05-08T18:50:46.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.261+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.261+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x564803bd6a10 2024-05-08T18:50:46.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.261+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.261+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x7efd1c04f150 2024-05-08T18:50:46.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.262+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd2005a040 con 0x7efd1c04f150 2024-05-08T18:50:46.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.262+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x564803bdb3c0 2024-05-08T18:50:46.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.262+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd2404a050 con 0x564803bdb3c0 2024-05-08T18:50:46.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.262+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x7efd24035020 2024-05-08T18:50:46.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.262+0000 7efd2a804640 1 -- 172.21.15.132:0/3201505475 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1c03d070 con 0x7efd24035020 2024-05-08T18:50:46.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.262+0000 7efd2a804640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x564803bd6a10 2024-05-08T18:50:46.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.262+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.262+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x7efd1c04f150 2024-05-08T18:50:46.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.263+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd2005a040 con 0x7efd1c04f150 2024-05-08T18:50:46.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.263+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x564803bdb3c0 2024-05-08T18:50:46.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.263+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd2404a050 con 0x564803bdb3c0 2024-05-08T18:50:46.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.263+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x7efd1c04f150 2024-05-08T18:50:46.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.263+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd2005a040 con 0x7efd1c04f150 2024-05-08T18:50:46.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.263+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x7efd24035020 2024-05-08T18:50:46.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.264+0000 7efd2a804640 1 -- 172.21.15.132:0/3201505475 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1c03d070 con 0x7efd24035020 2024-05-08T18:50:46.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.264+0000 7efd2a804640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x564803bdb3c0 2024-05-08T18:50:46.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.264+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd2404a050 con 0x564803bdb3c0 2024-05-08T18:50:46.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.264+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x7efd1c04f150 2024-05-08T18:50:46.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.264+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd2005a040 con 0x7efd1c04f150 2024-05-08T18:50:46.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.264+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x564803bd6a10 2024-05-08T18:50:46.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.264+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.264+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564803bdf6c0 con 0x7efd24035020 2024-05-08T18:50:46.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2a804640 1 -- 172.21.15.132:0/3201505475 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd1c03d070 con 0x7efd24035020 2024-05-08T18:50:46.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:46.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:46.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:46.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:46.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:46.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:46.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564803bde730 con 0x564803bd6a10 2024-05-08T18:50:46.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564803bdefd0 con 0x564803bd6a10 2024-05-08T18:50:46.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:46.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564803bde370 con 0x564803bd6a10 2024-05-08T18:50:46.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:46.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 20 zone default found 2024-05-08T18:50:46.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 4 Realm: () 2024-05-08T18:50:46.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:46.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:46.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:46.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 20 zonegroup default 2024-05-08T18:50:46.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.265+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564803bdfff0 con 0x7efd1c04f150 2024-05-08T18:50:46.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.266+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x7efd1c04f150 2024-05-08T18:50:46.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.266+0000 7efd2cd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.266+0000 7efd2cd0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.266+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564803be1c50 con 0x564803bdb3c0 2024-05-08T18:50:46.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.266+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efd2404a050 con 0x564803bdb3c0 2024-05-08T18:50:46.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.266+0000 7efd2cd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.266+0000 7efd2cd0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.266+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564803be2160 con 0x564803bdb3c0 2024-05-08T18:50:46.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.267+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efd2404a050 con 0x564803bdb3c0 2024-05-08T18:50:46.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.267+0000 7efd2cd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.267+0000 7efd2cd0c800 20 started sync module instance, tier type = 2024-05-08T18:50:46.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.267+0000 7efd2cd0c800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:46.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.267+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be0b00 con 0x7efd24035020 2024-05-08T18:50:46.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.268+0000 7efd2a804640 1 -- 172.21.15.132:0/3201505475 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd1c03d070 con 0x7efd24035020 2024-05-08T18:50:46.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.268+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94867300419152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be25c0 con 0x7efd24035020 2024-05-08T18:50:46.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.268+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be2e10 con 0x564803bd6a10 2024-05-08T18:50:46.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.268+0000 7efd2a804640 1 -- 172.21.15.132:0/3201505475 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94867300419152] v25'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd1c03d070 con 0x7efd24035020 2024-05-08T18:50:46.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.269+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.269+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94867300421360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be2f10 con 0x564803bd6a10 2024-05-08T18:50:46.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.269+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be3a00 con 0x564803bdb3c0 2024-05-08T18:50:46.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.269+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94867300421360] v25'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.270+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd2404a050 con 0x564803bdb3c0 2024-05-08T18:50:46.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.270+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94867300431056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be39c0 con 0x564803bdb3c0 2024-05-08T18:50:46.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.270+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be44b0 con 0x7efd24035020 2024-05-08T18:50:46.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.271+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94867300431056] v25'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd2404a050 con 0x564803bdb3c0 2024-05-08T18:50:46.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.271+0000 7efd2a804640 1 -- 172.21.15.132:0/3201505475 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd1c03d070 con 0x7efd24035020 2024-05-08T18:50:46.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.271+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94867300433856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be48a0 con 0x7efd24035020 2024-05-08T18:50:46.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.271+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be52e0 con 0x564803bd6a10 2024-05-08T18:50:46.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.272+0000 7efd2a804640 1 -- 172.21.15.132:0/3201505475 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94867300433856] v25'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd1c03d070 con 0x7efd24035020 2024-05-08T18:50:46.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.272+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.272+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94867300437424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be56d0 con 0x564803bd6a10 2024-05-08T18:50:46.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.272+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be6100 con 0x7efd1c04f150 2024-05-08T18:50:46.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.273+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94867300437424] v25'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.273+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x7efd1c04f150 2024-05-08T18:50:46.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.273+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94867300441104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be6100 con 0x7efd1c04f150 2024-05-08T18:50:46.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.273+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be6b40 con 0x7efd1c04f150 2024-05-08T18:50:46.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.275+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(56 notify.6 [create] v25'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x7efd1c04f150 2024-05-08T18:50:46.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.275+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94867300443792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be6f60 con 0x7efd1c04f150 2024-05-08T18:50:46.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.275+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be7a30 con 0x7efd1c04f150 2024-05-08T18:50:46.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.276+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94867300441104] v25'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x7efd1c04f150 2024-05-08T18:50:46.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.276+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(58 notify.7 [create] v25'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x7efd1c04f150 2024-05-08T18:50:46.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.276+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94867300443792] v25'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x7efd1c04f150 2024-05-08T18:50:46.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.276+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94867300447520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be79f0 con 0x7efd1c04f150 2024-05-08T18:50:46.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.276+0000 7efd2cd0c800 20 add_watcher() i=0 2024-05-08T18:50:46.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.276+0000 7efd2cd0c800 20 add_watcher() i=1 2024-05-08T18:50:46.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.277+0000 7efd2cd0c800 20 add_watcher() i=2 2024-05-08T18:50:46.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.277+0000 7efd2cd0c800 20 add_watcher() i=3 2024-05-08T18:50:46.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.277+0000 7efd2cd0c800 20 add_watcher() i=4 2024-05-08T18:50:46.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.277+0000 7efd2cd0c800 20 add_watcher() i=5 2024-05-08T18:50:46.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.277+0000 7efd2cd0c800 20 add_watcher() i=6 2024-05-08T18:50:46.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.277+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94867300447520] v25'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x7efd1c04f150 2024-05-08T18:50:46.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.277+0000 7efd2cd0c800 20 add_watcher() i=7 2024-05-08T18:50:46.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.277+0000 7efd2cd0c800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:46.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.277+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564803beaa20 con 0x564803bd6a10 2024-05-08T18:50:46.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.278+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.278+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94867300428128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be7ea0 con 0x564803bd6a10 2024-05-08T18:50:46.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.279+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94867300428128] v25'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.279+0000 7efbe17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:46.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.279+0000 7efd2cd0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:46.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.279+0000 7efd2cd0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:46.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.279+0000 7efd2cd0c800 5 note: GC not initialized 2024-05-08T18:50:46.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.279+0000 7efb5bfff640 20 reqs_thread_entry: start 2024-05-08T18:50:46.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.279+0000 7efd2cd0c800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:46.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.279+0000 7efd2cd0c800 20 Filter name: none 2024-05-08T18:50:46.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.280+0000 7efb59ffb640 20 reqs_thread_entry: start 2024-05-08T18:50:46.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.280+0000 7efd2cd0c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:50:46.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.280+0000 7efd2cd0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.280+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564803c1dda0 con 0x564803bd6a10 2024-05-08T18:50:46.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.280+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.280+0000 7efd2cd0c800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:46.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.280+0000 7efd2cd0c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:50:46.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.280+0000 7efd2cd0c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:46.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.280+0000 7efd2cd0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:46.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.280+0000 7efd2cd0c800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-05-08T18:50:46.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.280+0000 7efd2cd0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.280+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564803c1d900 con 0x564803bd6a10 2024-05-08T18:50:46.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.280+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.280+0000 7efd2cd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.280+0000 7efd2cd0c800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-05-08T18:50:46.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.280+0000 7efd2cd0c800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-05-08T18:50:46.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.280+0000 7efd2cd0c800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-05-08T18:50:46.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.280+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803c24120 con 0x564803bd6a10 2024-05-08T18:50:46.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.281+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v25'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.282+0000 7efd2cd0c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:46.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.282+0000 7efd2cd0c800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:46.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.282+0000 7efd2cd0c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:50:46.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.282+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94867300694784 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564803c20c00 con 0x564803bd6a10 2024-05-08T18:50:46.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.282+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== watch-notify(notify (1) cookie 94867300437424 notify 107374182405 ret 0) ==== 774+0+0 (crc 0 0 0) 0x564803aa91d0 con 0x564803bd6a10 2024-05-08T18:50:46.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.282+0000 7efc0e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182405 cookie 94867300437424 notifier 4354 bl.length()=732 2024-05-08T18:50:46.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.282+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(65 notify.4 [notify cookie 94867300694784 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.282+0000 7efc0e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:46.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.282+0000 7efc0e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:46.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.282+0000 7efc0e7fc640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7efbf0003ea0 con 0x564803bd6a10 2024-05-08T18:50:46.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.282+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.282+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== watch-notify(notify_complete (2) cookie 94867300694784 notify 107374182405 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7efd2005d850 con 0x564803bd6a10 2024-05-08T18:50:46.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.282+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803c23b00 con 0x564803bd6a10 2024-05-08T18:50:46.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.284+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v25'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.284+0000 7efd2cd0c800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-05-08T18:50:46.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.284+0000 7efd2cd0c800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-05-08T18:50:46.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.284+0000 7efd2cd0c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-05-08T18:50:46.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.284+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94867300694784 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564803c1e6e0 con 0x7efd24035020 2024-05-08T18:50:46.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.284+0000 7efd2a804640 1 -- 172.21.15.132:0/3201505475 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== watch-notify(notify (1) cookie 94867300419152 notify 107374182402 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7efd1c05b060 con 0x7efd24035020 2024-05-08T18:50:46.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.284+0000 7efc0e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182402 cookie 94867300419152 notifier 4354 bl.length()=166 2024-05-08T18:50:46.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.284+0000 7efc0e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-05-08T18:50:46.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.284+0000 7efc0e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-05-08T18:50:46.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.284+0000 7efd2a804640 1 -- 172.21.15.132:0/3201505475 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(68 notify.0 [notify cookie 94867300694784 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efd1c03d070 con 0x7efd24035020 2024-05-08T18:50:46.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.284+0000 7efc0e7fc640 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7efbf0003ea0 con 0x7efd24035020 2024-05-08T18:50:46.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.285+0000 7efd2a804640 1 -- 172.21.15.132:0/3201505475 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd1c03d070 con 0x7efd24035020 2024-05-08T18:50:46.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.285+0000 7efd2a804640 1 -- 172.21.15.132:0/3201505475 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== watch-notify(notify_complete (2) cookie 94867300694784 notify 107374182402 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564803b9e5f0 con 0x7efd24035020 2024-05-08T18:50:46.296 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:50:44.835566Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"hy5GZmKahuME6Pb5pEtgoHtmbn2tvQ9DDhrXnD2p","active":true,"create_date":"2024-05-08T18:50:46.281976Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:44.835553Z","tags":[],"group_ids":[]} 2024-05-08T18:50:46.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.286+0000 7efbe17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:46.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.286+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94867300428128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803c1cce0 con 0x564803bd6a10 2024-05-08T18:50:46.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.287+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94867300428128] v25'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.287+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94867300419152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be2960 con 0x7efd24035020 2024-05-08T18:50:46.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.288+0000 7efd2a804640 1 -- 172.21.15.132:0/3201505475 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94867300419152] v25'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd1c03d070 con 0x7efd24035020 2024-05-08T18:50:46.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.288+0000 7efd2cd0c800 20 remove_watcher() i=0 2024-05-08T18:50:46.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.288+0000 7efd2cd0c800 2 removed watcher, disabling cache 2024-05-08T18:50:46.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.288+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94867300421360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be2960 con 0x564803bd6a10 2024-05-08T18:50:46.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.289+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94867300421360] v25'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.290+0000 7efd2cd0c800 20 remove_watcher() i=1 2024-05-08T18:50:46.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.290+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94867300431056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be0ef0 con 0x564803bdb3c0 2024-05-08T18:50:46.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.290+0000 7efd2b005640 1 -- 172.21.15.132:0/3201505475 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94867300431056] v25'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd2404a050 con 0x564803bdb3c0 2024-05-08T18:50:46.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.291+0000 7efd2cd0c800 20 remove_watcher() i=2 2024-05-08T18:50:46.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.291+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94867300433856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be2960 con 0x7efd24035020 2024-05-08T18:50:46.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.291+0000 7efd2a804640 1 -- 172.21.15.132:0/3201505475 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94867300433856] v25'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd1c03d070 con 0x7efd24035020 2024-05-08T18:50:46.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.291+0000 7efd2cd0c800 20 remove_watcher() i=3 2024-05-08T18:50:46.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.291+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94867300437424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be0ef0 con 0x564803bd6a10 2024-05-08T18:50:46.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.292+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.1 v2:172.21.15.132:6800/3697320277 32 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94867300437424] v25'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x564803bd6a10 2024-05-08T18:50:46.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.292+0000 7efd2cd0c800 20 remove_watcher() i=4 2024-05-08T18:50:46.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.293+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94867300441104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be2960 con 0x7efd1c04f150 2024-05-08T18:50:46.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.293+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94867300441104] v25'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x7efd1c04f150 2024-05-08T18:50:46.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.293+0000 7efd2cd0c800 20 remove_watcher() i=5 2024-05-08T18:50:46.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.294+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94867300443792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be4db0 con 0x7efd1c04f150 2024-05-08T18:50:46.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.294+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94867300443792] v25'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x7efd1c04f150 2024-05-08T18:50:46.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.295+0000 7efd2cd0c800 20 remove_watcher() i=6 2024-05-08T18:50:46.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.295+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94867300447520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564803be0ef0 con 0x7efd1c04f150 2024-05-08T18:50:46.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.295+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94867300447520] v25'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd2005a040 con 0x7efd1c04f150 2024-05-08T18:50:46.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.295+0000 7efd2cd0c800 20 remove_watcher() i=7 2024-05-08T18:50:46.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7efd1c04f150 msgr2=0x7efd1c026360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7efd1c04f150 0x7efd1c026360 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564803bd6a10 msgr2=0x564803bd8ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564803bd6a10 0x564803bd8ed0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7efd24035020 msgr2=0x7efd2402c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7efd24035020 0x7efd2402c430 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564803bdb3c0 msgr2=0x564803bdd7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564803bdb3c0 0x564803bdd7b0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efbf403bba0 msgr2=0x7efbf403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efbf403bba0 0x7efbf403e060 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efd1c011fd0 tx=0x7efd1c017f90 comp rx=0 tx=0).stop 2024-05-08T18:50:46.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803bc3920 msgr2=0x564803bcaf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2a003640 1 -- 172.21.15.132:0/3201505475 reap_dead start 2024-05-08T18:50:46.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803bc3920 0x564803bcaf00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efd24022590 tx=0x7efd24052bb0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 shutdown_connections 2024-05-08T18:50:46.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/3201505475 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803bc3920 0x564803bcaf00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 >> 172.21.15.132:0/3201505475 conn(0x564803bbfc80 msgr2=0x564803bbd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 shutdown_connections 2024-05-08T18:50:46.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 -- 172.21.15.132:0/3201505475 wait complete. 2024-05-08T18:50:46.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 -- 172.21.15.132:0/2463336735 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efc0403bba0 msgr2=0x7efc0403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/2463336735 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efc0403bba0 0x7efc0403e060 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x564803ba2d50 tx=0x7efd1c044040 comp rx=0 tx=0).stop 2024-05-08T18:50:46.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 -- 172.21.15.132:0/2463336735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803bb6660 msgr2=0x564803bb6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/2463336735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803bb6660 0x564803bb6a80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x564803b9c570 tx=0x7efd2400aec0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 -- 172.21.15.132:0/2463336735 shutdown_connections 2024-05-08T18:50:46.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/2463336735 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efc0403bba0 0x7efc0403e060 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/2463336735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803bb6660 0x564803bb6a80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 -- 172.21.15.132:0/2463336735 >> 172.21.15.132:0/2463336735 conn(0x564803baa700 msgr2=0x564803baab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 -- 172.21.15.132:0/2463336735 shutdown_connections 2024-05-08T18:50:46.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.296+0000 7efd2cd0c800 1 -- 172.21.15.132:0/2463336735 wait complete. 2024-05-08T18:50:46.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.297+0000 7efd2cd0c800 1 -- 172.21.15.132:0/631169642 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564803aa55e0 msgr2=0x564803ba23b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.297+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/631169642 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564803aa55e0 0x564803ba23b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.297+0000 7efd2cd0c800 1 -- 172.21.15.132:0/631169642 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564803ba4be0 msgr2=0x564803ba6fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.297+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/631169642 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564803ba4be0 0x564803ba6fd0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.297+0000 7efd2cd0c800 1 -- 172.21.15.132:0/631169642 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efc1003bb50 msgr2=0x7efc1003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.297+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/631169642 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efc1003bb50 0x7efc1003e010 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efd20054000 tx=0x7efd2004e000 comp rx=0 tx=0).stop 2024-05-08T18:50:46.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.297+0000 7efd2cd0c800 1 -- 172.21.15.132:0/631169642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803aa1150 msgr2=0x564803b9b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.297+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/631169642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803aa1150 0x564803b9b170 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efd1c003000 tx=0x7efd1c000f40 comp rx=0 tx=0).stop 2024-05-08T18:50:46.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.297+0000 7efd2cd0c800 1 -- 172.21.15.132:0/631169642 shutdown_connections 2024-05-08T18:50:46.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.297+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/631169642 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564803ba4be0 0x564803ba6fd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.297+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/631169642 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564803aa55e0 0x564803ba23b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.297+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/631169642 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efc1003bb50 0x7efc1003e010 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.297+0000 7efd2cd0c800 1 --2- 172.21.15.132:0/631169642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564803aa1150 0x564803b9b170 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.297+0000 7efd2cd0c800 1 -- 172.21.15.132:0/631169642 >> 172.21.15.132:0/631169642 conn(0x564803a9c730 msgr2=0x564803b8c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.297+0000 7efd2cd0c800 1 -- 172.21.15.132:0/631169642 shutdown_connections 2024-05-08T18:50:46.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.297+0000 7efd2cd0c800 1 -- 172.21.15.132:0/631169642 wait complete. 2024-05-08T18:50:46.307 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:50:44.835566Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'hy5GZmKahuME6Pb5pEtgoHtmbn2tvQ9DDhrXnD2p', 'active': True, 'create_date': '2024-05-08T18:50:46.281976Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:44.835553Z', 'tags': [], 'group_ids': []} 2024-05-08T18:50:46.307 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-05-08T18:50:46.308 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-05-08T18:50:46.308 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-05-08T18:50:46.356 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:46.356 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:46.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.357+0000 7f2f22662800 1 Processor -- start 2024-05-08T18:50:46.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.358+0000 7f2f22662800 1 -- start start 2024-05-08T18:50:46.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.358+0000 7f2f22662800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55cff3da12d0 0x55cff3da16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.358+0000 7f2f22662800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cff3da1d70 con 0x55cff3da2490 2024-05-08T18:50:46.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.358+0000 7f2f22662800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55cff3c41e20 con 0x55cff3da12d0 2024-05-08T18:50:46.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.358+0000 7f2f2015a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55cff3da12d0 0x55cff3da16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.358+0000 7f2f2015a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55cff3da12d0 0x55cff3da16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60294/0 (socket says 172.21.15.132:60294) 2024-05-08T18:50:46.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.358+0000 7f2f2015a640 1 -- 172.21.15.132:0/3367653674 learned_addr learned my addr 172.21.15.132:0/3367653674 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.358+0000 7f2f17959640 1 --1- 172.21.15.132:0/3367653674 >> v1:172.21.15.42:6789/0 conn(0x55cff3da2490 0x55cff3da2910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46806/0 (socket says 172.21.15.132:46806) 2024-05-08T18:50:46.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.358+0000 7f2f2015a640 1 -- 172.21.15.132:0/3367653674 >> v1:172.21.15.42:6789/0 conn(0x55cff3da2490 legacy=0x55cff3da2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.358+0000 7f2f2015a640 1 -- 172.21.15.132:0/3367653674 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff3da3050 con 0x55cff3da12d0 2024-05-08T18:50:46.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.360+0000 7f2f2015a640 1 --2- 172.21.15.132:0/3367653674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3da12d0 0x55cff3da16f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000a520 tx=0x7f2f1001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1656e66aef80db server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.360+0000 7f2f1f959640 1 -- 172.21.15.132:0/3367653674 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f10057070 con 0x55cff3da12d0 2024-05-08T18:50:46.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.360+0000 7f2f1f959640 1 -- 172.21.15.132:0/3367653674 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f10052570 con 0x55cff3da12d0 2024-05-08T18:50:46.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.360+0000 7f2f1f959640 1 -- 172.21.15.132:0/3367653674 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f10052870 con 0x55cff3da12d0 2024-05-08T18:50:46.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.361+0000 7f2f22662800 1 -- 172.21.15.132:0/3367653674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3da12d0 msgr2=0x55cff3da16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.361+0000 7f2f22662800 1 --2- 172.21.15.132:0/3367653674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3da12d0 0x55cff3da16f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000a520 tx=0x7f2f1001d010 comp rx=0 tx=0).stop 2024-05-08T18:50:46.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.361+0000 7f2f22662800 1 -- 172.21.15.132:0/3367653674 shutdown_connections 2024-05-08T18:50:46.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.361+0000 7f2f22662800 1 --2- 172.21.15.132:0/3367653674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3da12d0 0x55cff3da16f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.361+0000 7f2f22662800 1 -- 172.21.15.132:0/3367653674 >> 172.21.15.132:0/3367653674 conn(0x55cff3d9c850 msgr2=0x55cff3d9ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.361+0000 7f2f22662800 1 -- 172.21.15.132:0/3367653674 shutdown_connections 2024-05-08T18:50:46.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.361+0000 7f2f22662800 1 -- 172.21.15.132:0/3367653674 wait complete. 2024-05-08T18:50:46.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.375+0000 7f2f22662800 1 Processor -- start 2024-05-08T18:50:46.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.375+0000 7f2f22662800 1 -- start start 2024-05-08T18:50:46.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.375+0000 7f2f22662800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3da12d0 0x55cff3e927a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.375+0000 7f2f22662800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cff3cec5d0 con 0x55cff3da12d0 2024-05-08T18:50:46.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.375+0000 7f2f2015a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3da12d0 0x55cff3e927a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.375+0000 7f2f2015a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3da12d0 0x55cff3e927a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60306/0 (socket says 172.21.15.132:60306) 2024-05-08T18:50:46.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.375+0000 7f2f2015a640 1 -- 172.21.15.132:0/2302958996 learned_addr learned my addr 172.21.15.132:0/2302958996 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.376+0000 7f2f2015a640 1 -- 172.21.15.132:0/2302958996 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff3e92d70 con 0x55cff3da12d0 2024-05-08T18:50:46.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.376+0000 7f2f2015a640 1 --2- 172.21.15.132:0/2302958996 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3da12d0 0x55cff3e927a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2f1001d050 tx=0x7f2f1004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c892c55b17e0b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.376+0000 7f2e0e60c640 1 -- 172.21.15.132:0/2302958996 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f10057040 con 0x55cff3da12d0 2024-05-08T18:50:46.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.376+0000 7f2e0e60c640 1 -- 172.21.15.132:0/2302958996 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f10052850 con 0x55cff3da12d0 2024-05-08T18:50:46.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.376+0000 7f2e0e60c640 1 -- 172.21.15.132:0/2302958996 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f10052b70 con 0x55cff3da12d0 2024-05-08T18:50:46.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.377+0000 7f2f22662800 1 -- 172.21.15.132:0/2302958996 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3da12d0 msgr2=0x55cff3e927a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.377+0000 7f2f22662800 1 --2- 172.21.15.132:0/2302958996 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3da12d0 0x55cff3e927a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2f1001d050 tx=0x7f2f1004c000 comp rx=0 tx=0).stop 2024-05-08T18:50:46.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.377+0000 7f2f22662800 1 -- 172.21.15.132:0/2302958996 shutdown_connections 2024-05-08T18:50:46.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.377+0000 7f2f22662800 1 --2- 172.21.15.132:0/2302958996 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3da12d0 0x55cff3e927a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.377+0000 7f2f22662800 1 -- 172.21.15.132:0/2302958996 >> 172.21.15.132:0/2302958996 conn(0x55cff3d9c850 msgr2=0x55cff3e8e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.377+0000 7f2f22662800 1 -- 172.21.15.132:0/2302958996 shutdown_connections 2024-05-08T18:50:46.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.377+0000 7f2f22662800 1 -- 172.21.15.132:0/2302958996 wait complete. 2024-05-08T18:50:46.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.377+0000 7f2f22662800 1 Processor -- start 2024-05-08T18:50:46.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.377+0000 7f2f22662800 1 -- start start 2024-05-08T18:50:46.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.377+0000 7f2f22662800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3da12d0 0x55cff3d16c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.377+0000 7f2f22662800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cff3daa960 con 0x55cff3da12d0 2024-05-08T18:50:46.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.378+0000 7f2f2015a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3da12d0 0x55cff3d16c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.378+0000 7f2f2015a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3da12d0 0x55cff3d16c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60314/0 (socket says 172.21.15.132:60314) 2024-05-08T18:50:46.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.378+0000 7f2f2015a640 1 -- 172.21.15.132:0/1901152206 learned_addr learned my addr 172.21.15.132:0/1901152206 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.378+0000 7f2f2015a640 1 -- 172.21.15.132:0/1901152206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff3d15380 con 0x55cff3da12d0 2024-05-08T18:50:46.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.378+0000 7f2f2015a640 1 --2- 172.21.15.132:0/1901152206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3da12d0 0x55cff3d16c90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2f1001d050 tx=0x7f2f10003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.378+0000 7f2e0ce09640 1 -- 172.21.15.132:0/1901152206 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f10073070 con 0x55cff3da12d0 2024-05-08T18:50:46.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.378+0000 7f2e0ce09640 1 -- 172.21.15.132:0/1901152206 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f1005d650 con 0x55cff3da12d0 2024-05-08T18:50:46.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.378+0000 7f2e0ce09640 1 -- 172.21.15.132:0/1901152206 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f10057070 con 0x55cff3da12d0 2024-05-08T18:50:46.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.378+0000 7f2f22662800 1 -- 172.21.15.132:0/1901152206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cff3d15610 con 0x55cff3da12d0 2024-05-08T18:50:46.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.378+0000 7f2f22662800 1 -- 172.21.15.132:0/1901152206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cff3d15b90 con 0x55cff3da12d0 2024-05-08T18:50:46.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.379+0000 7f2e0ce09640 1 -- 172.21.15.132:0/1901152206 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2f10076070 con 0x55cff3da12d0 2024-05-08T18:50:46.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.379+0000 7f2e0ce09640 1 --2- 172.21.15.132:0/1901152206 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2e0803bb50 0x7f2e0803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.379+0000 7f2e0ce09640 1 -- 172.21.15.132:0/1901152206 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f2f10094170 con 0x55cff3da12d0 2024-05-08T18:50:46.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.380+0000 7f2f17959640 1 --2- 172.21.15.132:0/1901152206 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2e0803bb50 0x7f2e0803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.380+0000 7f2f22662800 1 --2- 172.21.15.132:0/1901152206 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cff3da2490 0x55cff3ea36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.380+0000 7f2f22662800 1 -- 172.21.15.132:0/1901152206 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ea3c00 con 0x55cff3da2490 2024-05-08T18:50:46.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.380+0000 7f2f2095b640 1 --2- 172.21.15.132:0/1901152206 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cff3da2490 0x55cff3ea36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.380+0000 7f2f17959640 1 --2- 172.21.15.132:0/1901152206 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2e0803bb50 0x7f2e0803e010 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2f08000f60 tx=0x7f2f08001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.380+0000 7f2f2095b640 1 --2- 172.21.15.132:0/1901152206 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cff3da2490 0x55cff3ea36c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.380+0000 7f2f2095b640 1 -- 172.21.15.132:0/1901152206 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f1800a4a0 con 0x55cff3da2490 2024-05-08T18:50:46.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.380+0000 7f2f22662800 1 -- 172.21.15.132:0/1901152206 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ea4480 con 0x55cff3da2490 2024-05-08T18:50:46.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.381+0000 7f2f2095b640 1 -- 172.21.15.132:0/1901152206 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f1800a4a0 con 0x55cff3da2490 2024-05-08T18:50:46.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.381+0000 7f2f22662800 1 --2- 172.21.15.132:0/1901152206 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cff3ea5eb0 0x55cff3ea8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.381+0000 7f2f22662800 1 -- 172.21.15.132:0/1901152206 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ea8b00 con 0x55cff3ea5eb0 2024-05-08T18:50:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.381+0000 7f2f2015a640 1 --2- 172.21.15.132:0/1901152206 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cff3ea5eb0 0x55cff3ea8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.381+0000 7f2f2015a640 1 --2- 172.21.15.132:0/1901152206 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cff3ea5eb0 0x55cff3ea8370 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.381+0000 7f2f2015a640 1 -- 172.21.15.132:0/1901152206 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2f10075030 con 0x55cff3ea5eb0 2024-05-08T18:50:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.381+0000 7f2f22662800 1 -- 172.21.15.132:0/1901152206 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ea4cd0 con 0x55cff3da2490 2024-05-08T18:50:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.382+0000 7f2f2095b640 1 -- 172.21.15.132:0/1901152206 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f1800a4a0 con 0x55cff3da2490 2024-05-08T18:50:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.382+0000 7f2f22662800 1 -- 172.21.15.132:0/1901152206 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ea50b0 con 0x55cff3da2490 2024-05-08T18:50:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.382+0000 7f2f2095b640 1 -- 172.21.15.132:0/1901152206 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2f1800a4a0 con 0x55cff3da2490 2024-05-08T18:50:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.382+0000 7f2f22662800 1 Processor -- start 2024-05-08T18:50:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.382+0000 7f2f22662800 1 -- start start 2024-05-08T18:50:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.382+0000 7f2f22662800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3eb7ad0 0x55cff3eb7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.382+0000 7f2f22662800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cff3d171d0 con 0x55cff3eb7ad0 2024-05-08T18:50:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.383+0000 7f2f2095b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3eb7ad0 0x55cff3eb7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.383+0000 7f2f2095b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3eb7ad0 0x55cff3eb7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60322/0 (socket says 172.21.15.132:60322) 2024-05-08T18:50:46.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.383+0000 7f2f2095b640 1 -- 172.21.15.132:0/2205111497 learned_addr learned my addr 172.21.15.132:0/2205111497 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.383+0000 7f2f2095b640 1 -- 172.21.15.132:0/2205111497 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff3eb8430 con 0x55cff3eb7ad0 2024-05-08T18:50:46.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.383+0000 7f2f2095b640 1 --2- 172.21.15.132:0/2205111497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3eb7ad0 0x55cff3eb7ef0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55cff3ea3fa0 tx=0x7f2f18018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.383+0000 7f2e05ffb640 1 -- 172.21.15.132:0/2205111497 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f18014450 con 0x55cff3eb7ad0 2024-05-08T18:50:46.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.383+0000 7f2e05ffb640 1 -- 172.21.15.132:0/2205111497 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f180145f0 con 0x55cff3eb7ad0 2024-05-08T18:50:46.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.383+0000 7f2f22662800 1 -- 172.21.15.132:0/2205111497 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cff3eb8ea0 con 0x55cff3eb7ad0 2024-05-08T18:50:46.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.383+0000 7f2e05ffb640 1 -- 172.21.15.132:0/2205111497 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f180148d0 con 0x55cff3eb7ad0 2024-05-08T18:50:46.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.383+0000 7f2f22662800 1 -- 172.21.15.132:0/2205111497 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cff3eb93a0 con 0x55cff3eb7ad0 2024-05-08T18:50:46.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.384+0000 7f2e05ffb640 1 -- 172.21.15.132:0/2205111497 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2f18011040 con 0x55cff3eb7ad0 2024-05-08T18:50:46.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.384+0000 7f2e05ffb640 1 --2- 172.21.15.132:0/2205111497 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2df803bba0 0x7f2df803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.384+0000 7f2e05ffb640 1 -- 172.21.15.132:0/2205111497 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f2f1801e070 con 0x55cff3eb7ad0 2024-05-08T18:50:46.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.384+0000 7f2f2015a640 1 --2- 172.21.15.132:0/2205111497 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2df803bba0 0x7f2df803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.385+0000 7f2f22662800 1 Processor -- start 2024-05-08T18:50:46.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.385+0000 7f2f22662800 1 -- start start 2024-05-08T18:50:46.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.385+0000 7f2f2015a640 1 --2- 172.21.15.132:0/2205111497 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2df803bba0 0x7f2df803e060 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55cff3d16170 tx=0x7f2f100925e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.385+0000 7f2f22662800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3ec4d50 0x55cff3ec5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.385+0000 7f2f22662800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cff3c92fc0 con 0x55cff3ec4d50 2024-05-08T18:50:46.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.385+0000 7f2f2095b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3ec4d50 0x55cff3ec5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.385+0000 7f2f2095b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3ec4d50 0x55cff3ec5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60336/0 (socket says 172.21.15.132:60336) 2024-05-08T18:50:46.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.385+0000 7f2f2095b640 1 -- 172.21.15.132:0/1407560434 learned_addr learned my addr 172.21.15.132:0/1407560434 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.385+0000 7f2f2095b640 1 -- 172.21.15.132:0/1407560434 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff3ec5740 con 0x55cff3ec4d50 2024-05-08T18:50:46.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.385+0000 7f2f2095b640 1 --2- 172.21.15.132:0/1407560434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3ec4d50 0x55cff3ec5170 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2f18013fd0 tx=0x7f2f180118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca82d7057ddd584e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.386+0000 7f2dff7fe640 1 -- 172.21.15.132:0/1407560434 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f18044020 con 0x55cff3ec4d50 2024-05-08T18:50:46.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.386+0000 7f2dff7fe640 1 -- 172.21.15.132:0/1407560434 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f18011d30 con 0x55cff3ec4d50 2024-05-08T18:50:46.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.386+0000 7f2dff7fe640 1 -- 172.21.15.132:0/1407560434 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f18022db0 con 0x55cff3ec4d50 2024-05-08T18:50:46.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.386+0000 7f2f22662800 1 -- 172.21.15.132:0/1407560434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3ec4d50 msgr2=0x55cff3ec5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.386+0000 7f2f22662800 1 --2- 172.21.15.132:0/1407560434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3ec4d50 0x55cff3ec5170 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2f18013fd0 tx=0x7f2f180118e0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.386+0000 7f2f22662800 1 -- 172.21.15.132:0/1407560434 shutdown_connections 2024-05-08T18:50:46.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.386+0000 7f2f22662800 1 --2- 172.21.15.132:0/1407560434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3ec4d50 0x55cff3ec5170 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.386+0000 7f2f22662800 1 -- 172.21.15.132:0/1407560434 >> 172.21.15.132:0/1407560434 conn(0x55cff3ec10b0 msgr2=0x55cff3ebf110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.386+0000 7f2f22662800 1 -- 172.21.15.132:0/1407560434 shutdown_connections 2024-05-08T18:50:46.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.386+0000 7f2f22662800 1 -- 172.21.15.132:0/1407560434 wait complete. 2024-05-08T18:50:46.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.386+0000 7f2f22662800 1 Processor -- start 2024-05-08T18:50:46.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.386+0000 7f2f22662800 1 -- start start 2024-05-08T18:50:46.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.387+0000 7f2f22662800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3ec4d50 0x55cff3ecc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.387+0000 7f2f22662800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cff3ec5d30 con 0x55cff3ec4d50 2024-05-08T18:50:46.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.387+0000 7f2f2095b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3ec4d50 0x55cff3ecc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.387+0000 7f2f2095b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3ec4d50 0x55cff3ecc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60352/0 (socket says 172.21.15.132:60352) 2024-05-08T18:50:46.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.387+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 learned_addr learned my addr 172.21.15.132:0/1520244204 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.387+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff3ecc6a0 con 0x55cff3ec4d50 2024-05-08T18:50:46.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.387+0000 7f2f2095b640 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3ec4d50 0x55cff3ecc160 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2f18013fd0 tx=0x7f2f18052cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.388+0000 7f2dfdffb640 1 -- 172.21.15.132:0/1520244204 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f18040890 con 0x55cff3ec4d50 2024-05-08T18:50:46.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.388+0000 7f2dfdffb640 1 -- 172.21.15.132:0/1520244204 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f18040a30 con 0x55cff3ec4d50 2024-05-08T18:50:46.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.388+0000 7f2dfdffb640 1 -- 172.21.15.132:0/1520244204 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f18040d50 con 0x55cff3ec4d50 2024-05-08T18:50:46.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.388+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cff3ecc930 con 0x55cff3ec4d50 2024-05-08T18:50:46.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.388+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cff3ecf5e0 con 0x55cff3ec4d50 2024-05-08T18:50:46.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.388+0000 7f2dfdffb640 1 -- 172.21.15.132:0/1520244204 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2f18051170 con 0x55cff3ec4d50 2024-05-08T18:50:46.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.389+0000 7f2dfdffb640 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2df003bba0 0x7f2df003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.389+0000 7f2dfdffb640 1 -- 172.21.15.132:0/1520244204 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f2f1800e040 con 0x55cff3ec4d50 2024-05-08T18:50:46.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.389+0000 7f2f2015a640 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2df003bba0 0x7f2df003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.389+0000 7f2f2015a640 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2df003bba0 0x7f2df003e060 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2f10092970 tx=0x7f2f100913f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.389+0000 7f2f22662800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.389+0000 7f2f22662800 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cff3ed7ec0 0x55cff3eda380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.389+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cff3edaad0 con 0x55cff3ed7ec0 2024-05-08T18:50:46.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.389+0000 7f2f17959640 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cff3ed7ec0 0x55cff3eda380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.390+0000 7f2f17959640 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cff3ed7ec0 0x55cff3eda380 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.390+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f0800f610 con 0x55cff3ed7ec0 2024-05-08T18:50:46.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.390+0000 7f2f22662800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.390+0000 7f2f22662800 20 realm 2024-05-08T18:50:46.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.390+0000 7f2f22662800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.390+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ed7310 con 0x55cff3ed7ec0 2024-05-08T18:50:46.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.390+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f0800f610 con 0x55cff3ed7ec0 2024-05-08T18:50:46.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.390+0000 7f2f22662800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.390+0000 7f2f22662800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:46.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.390+0000 7f2f22662800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.390+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cff3edb5c0 con 0x55cff3ed7ec0 2024-05-08T18:50:46.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.390+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f0800f610 con 0x55cff3ed7ec0 2024-05-08T18:50:46.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.390+0000 7f2f22662800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.390+0000 7f2f22662800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.390+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cff3edbe90 con 0x55cff3ed7ec0 2024-05-08T18:50:46.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.391+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f0800f610 con 0x55cff3ed7ec0 2024-05-08T18:50:46.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.391+0000 7f2f22662800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:46.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.391+0000 7f2f22662800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.391+0000 7f2f22662800 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cff3edc8b0 0x55cff3edeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.391+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cff3edf390 con 0x55cff3edc8b0 2024-05-08T18:50:46.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.391+0000 7f2f2095b640 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cff3edc8b0 0x55cff3edeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.391+0000 7f2f2095b640 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cff3edc8b0 0x55cff3edeca0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.391+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2f1803d020 con 0x55cff3edc8b0 2024-05-08T18:50:46.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.391+0000 7f2f22662800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:46.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.391+0000 7f2f22662800 20 searching for the correct realm 2024-05-08T18:50:46.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.391+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x55cff3edc8b0 2024-05-08T18:50:46.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.392+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1803d020 con 0x55cff3edc8b0 2024-05-08T18:50:46.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.392+0000 7f2f2095b640 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2f18014070 0x7f2f18041070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.392+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x7f2f18014070 2024-05-08T18:50:46.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.392+0000 7f2f2015a640 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2f18014070 0x7f2f18041070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.392+0000 7f2f2015a640 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2f18014070 0x7f2f18041070 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.392+0000 7f2f2015a640 1 -- 172.21.15.132:0/1520244204 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f10075030 con 0x7f2f18014070 2024-05-08T18:50:46.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.392+0000 7f2f2015a640 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2f100a1040 0x7f2f1005b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.392+0000 7f2f2015a640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x7f2f100a1040 2024-05-08T18:50:46.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.393+0000 7f2f17959640 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2f100a1040 0x7f2f1005b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.393+0000 7f2f17959640 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2f100a1040 0x7f2f1005b550 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.393+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0800f610 con 0x7f2f100a1040 2024-05-08T18:50:46.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.393+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x55cff3ed7ec0 2024-05-08T18:50:46.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.393+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0800f610 con 0x55cff3ed7ec0 2024-05-08T18:50:46.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.394+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x55cff3ed7ec0 2024-05-08T18:50:46.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.394+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0802b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.394+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x7f2f100a1040 2024-05-08T18:50:46.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.394+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0802b040 con 0x7f2f100a1040 2024-05-08T18:50:46.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.394+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x7f2f100a1040 2024-05-08T18:50:46.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.394+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0802b040 con 0x7f2f100a1040 2024-05-08T18:50:46.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.394+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x7f2f18014070 2024-05-08T18:50:46.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.394+0000 7f2f2015a640 1 -- 172.21.15.132:0/1520244204 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f10075030 con 0x7f2f18014070 2024-05-08T18:50:46.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.394+0000 7f2f2015a640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x55cff3edc8b0 2024-05-08T18:50:46.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.395+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1803d020 con 0x55cff3edc8b0 2024-05-08T18:50:46.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.395+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x55cff3ed7ec0 2024-05-08T18:50:46.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.395+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0802b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.395+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x7f2f100a1040 2024-05-08T18:50:46.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.395+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0802b040 con 0x7f2f100a1040 2024-05-08T18:50:46.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.395+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x55cff3ed7ec0 2024-05-08T18:50:46.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.395+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2f0802b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.396+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x7f2f18014070 2024-05-08T18:50:46.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.396+0000 7f2f2015a640 1 -- 172.21.15.132:0/1520244204 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2f10075030 con 0x7f2f18014070 2024-05-08T18:50:46.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.396+0000 7f2f2015a640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x55cff3edc8b0 2024-05-08T18:50:46.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.396+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2f1803d020 con 0x55cff3edc8b0 2024-05-08T18:50:46.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.396+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x55cff3edc8b0 2024-05-08T18:50:46.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.396+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1803d020 con 0x55cff3edc8b0 2024-05-08T18:50:46.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.396+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x7f2f100a1040 2024-05-08T18:50:46.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.396+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0802b040 con 0x7f2f100a1040 2024-05-08T18:50:46.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.396+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x55cff3edc8b0 2024-05-08T18:50:46.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.397+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1803d020 con 0x55cff3edc8b0 2024-05-08T18:50:46.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.397+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x55cff3edc8b0 2024-05-08T18:50:46.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.397+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1803d020 con 0x55cff3edc8b0 2024-05-08T18:50:46.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.397+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x55cff3ed7ec0 2024-05-08T18:50:46.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.397+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0802b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.397+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x55cff3ed7ec0 2024-05-08T18:50:46.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.397+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2f0802b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.397+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x7f2f100a1040 2024-05-08T18:50:46.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.398+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0802b040 con 0x7f2f100a1040 2024-05-08T18:50:46.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.398+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x55cff3edc8b0 2024-05-08T18:50:46.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.398+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1803d020 con 0x55cff3edc8b0 2024-05-08T18:50:46.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.398+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x7f2f18014070 2024-05-08T18:50:46.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.398+0000 7f2f2015a640 1 -- 172.21.15.132:0/1520244204 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f10075030 con 0x7f2f18014070 2024-05-08T18:50:46.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.399+0000 7f2f2015a640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x55cff3ed7ec0 2024-05-08T18:50:46.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.399+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0802b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.399+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x7f2f100a1040 2024-05-08T18:50:46.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.399+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0803b040 con 0x7f2f100a1040 2024-05-08T18:50:46.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.399+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x55cff3edc8b0 2024-05-08T18:50:46.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.399+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1803d020 con 0x55cff3edc8b0 2024-05-08T18:50:46.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.399+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x7f2f100a1040 2024-05-08T18:50:46.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.400+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0803b040 con 0x7f2f100a1040 2024-05-08T18:50:46.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.400+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x7f2f18014070 2024-05-08T18:50:46.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.400+0000 7f2f2015a640 1 -- 172.21.15.132:0/1520244204 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f10075030 con 0x7f2f18014070 2024-05-08T18:50:46.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.400+0000 7f2f2015a640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x55cff3edc8b0 2024-05-08T18:50:46.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.400+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f1803d020 con 0x55cff3edc8b0 2024-05-08T18:50:46.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.400+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x7f2f100a1040 2024-05-08T18:50:46.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.400+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f0803b040 con 0x7f2f100a1040 2024-05-08T18:50:46.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.400+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x55cff3ed7ec0 2024-05-08T18:50:46.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.401+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2f0803b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.401+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0ce0 con 0x7f2f18014070 2024-05-08T18:50:46.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.401+0000 7f2f2015a640 1 -- 172.21.15.132:0/1520244204 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f10075030 con 0x7f2f18014070 2024-05-08T18:50:46.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.401+0000 7f2f22662800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:46.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.401+0000 7f2f22662800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:46.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.401+0000 7f2f22662800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:46.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.401+0000 7f2f22662800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:46.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.401+0000 7f2f22662800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:46.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.401+0000 7f2f22662800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:46.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.401+0000 7f2f22662800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.401+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cff3edfd80 con 0x55cff3ed7ec0 2024-05-08T18:50:46.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.401+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f0803b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.401+0000 7f2f22662800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.401+0000 7f2f22662800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.401+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee0620 con 0x55cff3ed7ec0 2024-05-08T18:50:46.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.401+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f0803b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.401+0000 7f2f22662800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:46.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.401+0000 7f2f22662800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.401+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee1160 con 0x55cff3ed7ec0 2024-05-08T18:50:46.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.402+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2f0803b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.402+0000 7f2f22662800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:46.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.402+0000 7f2f22662800 20 zone default found 2024-05-08T18:50:46.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.402+0000 7f2f22662800 4 Realm: () 2024-05-08T18:50:46.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.402+0000 7f2f22662800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:46.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.402+0000 7f2f22662800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:46.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.402+0000 7f2f22662800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:46.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.402+0000 7f2f22662800 20 zonegroup default 2024-05-08T18:50:46.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.402+0000 7f2f22662800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.402+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee1180 con 0x7f2f100a1040 2024-05-08T18:50:46.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.402+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2f0803b040 con 0x7f2f100a1040 2024-05-08T18:50:46.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.402+0000 7f2f22662800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.402+0000 7f2f22662800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.402+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee2fa0 con 0x55cff3edc8b0 2024-05-08T18:50:46.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.402+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f1803d020 con 0x55cff3edc8b0 2024-05-08T18:50:46.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.403+0000 7f2f22662800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.403+0000 7f2f22662800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.403+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee3390 con 0x55cff3edc8b0 2024-05-08T18:50:46.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.403+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f1803d020 con 0x55cff3edc8b0 2024-05-08T18:50:46.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.403+0000 7f2f22662800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.403+0000 7f2f22662800 20 started sync module instance, tier type = 2024-05-08T18:50:46.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.403+0000 7f2f22662800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:46.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.403+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee2440 con 0x7f2f18014070 2024-05-08T18:50:46.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.404+0000 7f2f2015a640 1 -- 172.21.15.132:0/1520244204 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f10075030 con 0x7f2f18014070 2024-05-08T18:50:46.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.404+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94351639060368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee3820 con 0x7f2f18014070 2024-05-08T18:50:46.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.404+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee4070 con 0x55cff3ed7ec0 2024-05-08T18:50:46.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.405+0000 7f2f2015a640 1 -- 172.21.15.132:0/1520244204 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94351639060368] v25'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f10075030 con 0x7f2f18014070 2024-05-08T18:50:46.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.405+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0803b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.405+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94351639062576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee4130 con 0x55cff3ed7ec0 2024-05-08T18:50:46.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.405+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee4c50 con 0x55cff3edc8b0 2024-05-08T18:50:46.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.406+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1803d020 con 0x55cff3edc8b0 2024-05-08T18:50:46.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.406+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94351639070496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee4c50 con 0x55cff3edc8b0 2024-05-08T18:50:46.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.406+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee5c40 con 0x7f2f18014070 2024-05-08T18:50:46.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.406+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94351639062576] v25'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0803b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.407+0000 7f2f2015a640 1 -- 172.21.15.132:0/1520244204 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f10075030 con 0x7f2f18014070 2024-05-08T18:50:46.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.407+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94351639074576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee6030 con 0x7f2f18014070 2024-05-08T18:50:46.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.407+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94351639070496] v25'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1803d020 con 0x55cff3edc8b0 2024-05-08T18:50:46.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.407+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee6570 con 0x55cff3ed7ec0 2024-05-08T18:50:46.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.408+0000 7f2f2015a640 1 -- 172.21.15.132:0/1520244204 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94351639074576] v25'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f10075030 con 0x7f2f18014070 2024-05-08T18:50:46.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.408+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0803b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.408+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94351639072832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee6960 con 0x55cff3ed7ec0 2024-05-08T18:50:46.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.408+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee7360 con 0x7f2f100a1040 2024-05-08T18:50:46.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.409+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0803b040 con 0x7f2f100a1040 2024-05-08T18:50:46.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.409+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94351639080560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee72d0 con 0x7f2f100a1040 2024-05-08T18:50:46.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.409+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee8330 con 0x7f2f100a1040 2024-05-08T18:50:46.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.410+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94351639072832] v25'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0803b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.410+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94351639080560] v25'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0803b040 con 0x7f2f100a1040 2024-05-08T18:50:46.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.411+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0803b040 con 0x7f2f100a1040 2024-05-08T18:50:46.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.411+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94351639084576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee7700 con 0x7f2f100a1040 2024-05-08T18:50:46.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.411+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee87a0 con 0x7f2f100a1040 2024-05-08T18:50:46.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.412+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(58 notify.7 [create] v25'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0803b040 con 0x7f2f100a1040 2024-05-08T18:50:46.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.412+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94351639085808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee8bc0 con 0x7f2f100a1040 2024-05-08T18:50:46.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.412+0000 7f2f22662800 20 add_watcher() i=0 2024-05-08T18:50:46.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.412+0000 7f2f22662800 20 add_watcher() i=1 2024-05-08T18:50:46.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.412+0000 7f2f22662800 20 add_watcher() i=2 2024-05-08T18:50:46.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.412+0000 7f2f22662800 20 add_watcher() i=3 2024-05-08T18:50:46.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.412+0000 7f2f22662800 20 add_watcher() i=4 2024-05-08T18:50:46.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.412+0000 7f2f22662800 20 add_watcher() i=5 2024-05-08T18:50:46.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.412+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94351639084576] v25'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0803b040 con 0x7f2f100a1040 2024-05-08T18:50:46.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.412+0000 7f2f22662800 20 add_watcher() i=6 2024-05-08T18:50:46.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.412+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94351639085808] v25'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0803b040 con 0x7f2f100a1040 2024-05-08T18:50:46.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.413+0000 7f2f22662800 20 add_watcher() i=7 2024-05-08T18:50:46.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.413+0000 7f2f22662800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:46.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.413+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee8bc0 con 0x55cff3ed7ec0 2024-05-08T18:50:46.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.413+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2f0803b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.413+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94351639086864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee8b30 con 0x55cff3ed7ec0 2024-05-08T18:50:46.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.414+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94351639086864] v25'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f0803b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.414+0000 7f2dd6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:46.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.414+0000 7f2f22662800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:46.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.414+0000 7f2f22662800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:46.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.414+0000 7f2f22662800 5 note: GC not initialized 2024-05-08T18:50:46.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.414+0000 7f2dd5fe3640 20 reqs_thread_entry: start 2024-05-08T18:50:46.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.414+0000 7f2f22662800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:46.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.414+0000 7f2f22662800 20 Filter name: none 2024-05-08T18:50:46.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.414+0000 7f2dcf7fe640 20 reqs_thread_entry: start 2024-05-08T18:50:46.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.415+0000 7f2f22662800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:50:46.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.415+0000 7f2f22662800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.415+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cff3f1f140 con 0x55cff3ed7ec0 2024-05-08T18:50:46.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.415+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f2f0803b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.415+0000 7f2f22662800 20 rados_obj.operate() r=0 bl.length=556 2024-05-08T18:50:46.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.415+0000 7f2f22662800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:50:46.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.415+0000 7f2f22662800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:46.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.415+0000 7f2f22662800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:46.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.415+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3f257c0 con 0x55cff3ed7ec0 2024-05-08T18:50:46.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.416+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v25'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f2f0803b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.416+0000 7f2f22662800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:46.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.416+0000 7f2f22662800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:46.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.416+0000 7f2f22662800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:50:46.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.416+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94351639335296 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cff3f20e60 con 0x55cff3ed7ec0 2024-05-08T18:50:46.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.417+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== watch-notify(notify (1) cookie 94351639072832 notify 107374182406 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f2f08018040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.417+0000 7f2dff7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182406 cookie 94351639072832 notifier 4361 bl.length()=732 2024-05-08T18:50:46.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.417+0000 7f2dff7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:46.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.417+0000 7f2dff7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:46.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.417+0000 7f2dff7fe640 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f2de4003ea0 con 0x55cff3ed7ec0 2024-05-08T18:50:46.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.417+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(64 notify.4 [notify cookie 94351639335296 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f0803b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.417+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0803b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.417+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== watch-notify(notify_complete (2) cookie 94351639335296 notify 107374182406 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2f08009050 con 0x55cff3ed7ec0 2024-05-08T18:50:46.425 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:50:44.835566Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:44.835553Z","tags":[],"group_ids":[]} 2024-05-08T18:50:46.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.418+0000 7f2dd6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:46.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.418+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94351639086864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3f209b0 con 0x55cff3ed7ec0 2024-05-08T18:50:46.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.419+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94351639086864] v25'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f0803b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.419+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94351639060368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3f20e60 con 0x7f2f18014070 2024-05-08T18:50:46.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.420+0000 7f2f2015a640 1 -- 172.21.15.132:0/1520244204 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94351639060368] v25'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f10075030 con 0x7f2f18014070 2024-05-08T18:50:46.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.420+0000 7f2f22662800 20 remove_watcher() i=0 2024-05-08T18:50:46.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.420+0000 7f2f22662800 2 removed watcher, disabling cache 2024-05-08T18:50:46.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.420+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94351639062576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee1f90 con 0x55cff3ed7ec0 2024-05-08T18:50:46.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.421+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94351639062576] v25'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0803b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.421+0000 7f2f22662800 20 remove_watcher() i=1 2024-05-08T18:50:46.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.421+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94351639070496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee2830 con 0x55cff3edc8b0 2024-05-08T18:50:46.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.422+0000 7f2f2095b640 1 -- 172.21.15.132:0/1520244204 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94351639070496] v25'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f1803d020 con 0x55cff3edc8b0 2024-05-08T18:50:46.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.422+0000 7f2f22662800 20 remove_watcher() i=2 2024-05-08T18:50:46.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.422+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94351639074576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee1f90 con 0x7f2f18014070 2024-05-08T18:50:46.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.423+0000 7f2f2015a640 1 -- 172.21.15.132:0/1520244204 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94351639074576] v25'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f10075030 con 0x7f2f18014070 2024-05-08T18:50:46.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.423+0000 7f2f22662800 20 remove_watcher() i=3 2024-05-08T18:50:46.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.423+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94351639072832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee2830 con 0x55cff3ed7ec0 2024-05-08T18:50:46.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.424+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94351639072832] v25'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0803b040 con 0x55cff3ed7ec0 2024-05-08T18:50:46.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.424+0000 7f2f22662800 20 remove_watcher() i=4 2024-05-08T18:50:46.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.424+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94351639080560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee5710 con 0x7f2f100a1040 2024-05-08T18:50:46.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.425+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94351639080560] v25'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0803b040 con 0x7f2f100a1040 2024-05-08T18:50:46.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.425+0000 7f2f22662800 20 remove_watcher() i=5 2024-05-08T18:50:46.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.425+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94351639084576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee1f90 con 0x7f2f100a1040 2024-05-08T18:50:46.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.426+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94351639084576] v25'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0803b040 con 0x7f2f100a1040 2024-05-08T18:50:46.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.426+0000 7f2f22662800 20 remove_watcher() i=6 2024-05-08T18:50:46.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.426+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94351639085808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cff3ee2830 con 0x7f2f100a1040 2024-05-08T18:50:46.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.427+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94351639085808] v25'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f0803b040 con 0x7f2f100a1040 2024-05-08T18:50:46.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.427+0000 7f2f22662800 20 remove_watcher() i=7 2024-05-08T18:50:46.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.427+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2f100a1040 msgr2=0x7f2f1005b550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.427+0000 7f2f22662800 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2f100a1040 0x7f2f1005b550 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.427+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cff3ed7ec0 msgr2=0x55cff3eda380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.427+0000 7f2f22662800 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cff3ed7ec0 0x55cff3eda380 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.427+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2f18014070 msgr2=0x7f2f18041070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.427+0000 7f2f22662800 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2f18014070 0x7f2f18041070 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.427+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cff3edc8b0 msgr2=0x55cff3edeca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.427+0000 7f2f22662800 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cff3edc8b0 0x55cff3edeca0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.427+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2df003bba0 msgr2=0x7f2df003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.427+0000 7f2f22662800 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2df003bba0 0x7f2df003e060 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2f10092970 tx=0x7f2f100913f0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.427+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3ec4d50 msgr2=0x55cff3ecc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.427+0000 7f2f17959640 1 -- 172.21.15.132:0/1520244204 reap_dead start 2024-05-08T18:50:46.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.427+0000 7f2f22662800 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3ec4d50 0x55cff3ecc160 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2f18013fd0 tx=0x7f2f18052cd0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 shutdown_connections 2024-05-08T18:50:46.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 --2- 172.21.15.132:0/1520244204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3ec4d50 0x55cff3ecc160 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 >> 172.21.15.132:0/1520244204 conn(0x55cff3ec10b0 msgr2=0x55cff3ebe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 shutdown_connections 2024-05-08T18:50:46.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 -- 172.21.15.132:0/1520244204 wait complete. 2024-05-08T18:50:46.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 -- 172.21.15.132:0/2205111497 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2df803bba0 msgr2=0x7f2df803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 --2- 172.21.15.132:0/2205111497 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2df803bba0 0x7f2df803e060 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55cff3d16170 tx=0x7f2f100925e0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 -- 172.21.15.132:0/2205111497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3eb7ad0 msgr2=0x55cff3eb7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 --2- 172.21.15.132:0/2205111497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3eb7ad0 0x55cff3eb7ef0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x55cff3ea3fa0 tx=0x7f2f18018830 comp rx=0 tx=0).stop 2024-05-08T18:50:46.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 -- 172.21.15.132:0/2205111497 shutdown_connections 2024-05-08T18:50:46.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 --2- 172.21.15.132:0/2205111497 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2df803bba0 0x7f2df803e060 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 --2- 172.21.15.132:0/2205111497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3eb7ad0 0x55cff3eb7ef0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 -- 172.21.15.132:0/2205111497 >> 172.21.15.132:0/2205111497 conn(0x55cff3eabb70 msgr2=0x55cff3eabf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 -- 172.21.15.132:0/2205111497 shutdown_connections 2024-05-08T18:50:46.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 -- 172.21.15.132:0/2205111497 wait complete. 2024-05-08T18:50:46.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 -- 172.21.15.132:0/1901152206 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cff3da2490 msgr2=0x55cff3ea36c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 --2- 172.21.15.132:0/1901152206 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cff3da2490 0x55cff3ea36c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 -- 172.21.15.132:0/1901152206 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cff3ea5eb0 msgr2=0x55cff3ea8370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 --2- 172.21.15.132:0/1901152206 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cff3ea5eb0 0x55cff3ea8370 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 -- 172.21.15.132:0/1901152206 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2e0803bb50 msgr2=0x7f2e0803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 --2- 172.21.15.132:0/1901152206 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2e0803bb50 0x7f2e0803e010 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2f08000f60 tx=0x7f2f08001370 comp rx=0 tx=0).stop 2024-05-08T18:50:46.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 -- 172.21.15.132:0/1901152206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3da12d0 msgr2=0x55cff3d16c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.428+0000 7f2f22662800 1 --2- 172.21.15.132:0/1901152206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3da12d0 0x55cff3d16c90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2f1001d050 tx=0x7f2f10003020 comp rx=0 tx=0).stop 2024-05-08T18:50:46.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.429+0000 7f2f22662800 1 -- 172.21.15.132:0/1901152206 shutdown_connections 2024-05-08T18:50:46.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.429+0000 7f2f22662800 1 --2- 172.21.15.132:0/1901152206 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cff3ea5eb0 0x55cff3ea8370 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.429+0000 7f2f22662800 1 --2- 172.21.15.132:0/1901152206 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cff3da2490 0x55cff3ea36c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.429+0000 7f2f22662800 1 --2- 172.21.15.132:0/1901152206 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2e0803bb50 0x7f2e0803e010 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.429+0000 7f2f22662800 1 --2- 172.21.15.132:0/1901152206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cff3da12d0 0x55cff3d16c90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.429+0000 7f2f22662800 1 -- 172.21.15.132:0/1901152206 >> 172.21.15.132:0/1901152206 conn(0x55cff3d9c850 msgr2=0x55cff3e8c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.429+0000 7f2f22662800 1 -- 172.21.15.132:0/1901152206 shutdown_connections 2024-05-08T18:50:46.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.429+0000 7f2f22662800 1 -- 172.21.15.132:0/1901152206 wait complete. 2024-05-08T18:50:46.436 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:50:44.835566Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:44.835553Z', 'tags': [], 'group_ids': []} 2024-05-08T18:50:46.437 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:50:46.437 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:50:46.437 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:50:46.481 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:46.481 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:46.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.482+0000 7fbe7c742800 1 Processor -- start 2024-05-08T18:50:46.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.482+0000 7fbe7c742800 1 -- start start 2024-05-08T18:50:46.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.482+0000 7fbe7c742800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x564e0e74a7e0 0x564e0e74cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.482+0000 7fbe7c742800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564e0e74d110 con 0x564e0e746cd0 2024-05-08T18:50:46.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.482+0000 7fbe7c742800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x564e0e5e6e20 con 0x564e0e74a7e0 2024-05-08T18:50:46.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.483+0000 7fbe79a39640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x564e0e74a7e0 0x564e0e74cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.483+0000 7fbe79a39640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x564e0e74a7e0 0x564e0e74cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60360/0 (socket says 172.21.15.132:60360) 2024-05-08T18:50:46.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.483+0000 7fbe79a39640 1 -- 172.21.15.132:0/2473143194 learned_addr learned my addr 172.21.15.132:0/2473143194 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.483+0000 7fbe7a23a640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x564e0e746cd0 0x564e0e7490c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46820/0 (socket says 172.21.15.132:46820) 2024-05-08T18:50:46.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.483+0000 7fbe79a39640 1 -- 172.21.15.132:0/2473143194 >> v1:172.21.15.42:6789/0 conn(0x564e0e746cd0 legacy=0x564e0e7490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.483+0000 7fbe79a39640 1 -- 172.21.15.132:0/2473143194 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e0e74e2f0 con 0x564e0e74a7e0 2024-05-08T18:50:46.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.485+0000 7fbe79a39640 1 --2- 172.21.15.132:0/2473143194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e74a7e0 0x564e0e74cbd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000a520 tx=0x7fbe7001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb9a8a882fbba9f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.485+0000 7fbe79238640 1 -- 172.21.15.132:0/2473143194 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe70057070 con 0x564e0e74a7e0 2024-05-08T18:50:46.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.485+0000 7fbe79238640 1 -- 172.21.15.132:0/2473143194 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe70052570 con 0x564e0e74a7e0 2024-05-08T18:50:46.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.485+0000 7fbe79238640 1 -- 172.21.15.132:0/2473143194 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe7004ae60 con 0x564e0e74a7e0 2024-05-08T18:50:46.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.485+0000 7fbe7c742800 1 -- 172.21.15.132:0/2473143194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e74a7e0 msgr2=0x564e0e74cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.485+0000 7fbe7c742800 1 --2- 172.21.15.132:0/2473143194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e74a7e0 0x564e0e74cbd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbe7000a520 tx=0x7fbe7001d010 comp rx=0 tx=0).stop 2024-05-08T18:50:46.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.485+0000 7fbe7c742800 1 -- 172.21.15.132:0/2473143194 shutdown_connections 2024-05-08T18:50:46.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.485+0000 7fbe7c742800 1 --2- 172.21.15.132:0/2473143194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e74a7e0 0x564e0e74cbd0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.485+0000 7fbe7c742800 1 -- 172.21.15.132:0/2473143194 >> 172.21.15.132:0/2473143194 conn(0x564e0e740720 msgr2=0x564e0e742b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.485+0000 7fbe7c742800 1 -- 172.21.15.132:0/2473143194 shutdown_connections 2024-05-08T18:50:46.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.485+0000 7fbe7c742800 1 -- 172.21.15.132:0/2473143194 wait complete. 2024-05-08T18:50:46.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.500+0000 7fbe7c742800 1 Processor -- start 2024-05-08T18:50:46.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.500+0000 7fbe7c742800 1 -- start start 2024-05-08T18:50:46.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.500+0000 7fbe7c742800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e746cd0 0x564e0e837660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.500+0000 7fbe7c742800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564e0e6915b0 con 0x564e0e746cd0 2024-05-08T18:50:46.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.500+0000 7fbe7a23a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e746cd0 0x564e0e837660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.500+0000 7fbe7a23a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e746cd0 0x564e0e837660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60362/0 (socket says 172.21.15.132:60362) 2024-05-08T18:50:46.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.500+0000 7fbe7a23a640 1 -- 172.21.15.132:0/3490015316 learned_addr learned my addr 172.21.15.132:0/3490015316 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.501+0000 7fbe7a23a640 1 -- 172.21.15.132:0/3490015316 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e0e837c30 con 0x564e0e746cd0 2024-05-08T18:50:46.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.501+0000 7fbe7a23a640 1 --2- 172.21.15.132:0/3490015316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e746cd0 0x564e0e837660 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c001e90 tx=0x7fbe6c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1180a0f3e18bb623 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.501+0000 7fbd68608640 1 -- 172.21.15.132:0/3490015316 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe6c00e5c0 con 0x564e0e746cd0 2024-05-08T18:50:46.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.501+0000 7fbd68608640 1 -- 172.21.15.132:0/3490015316 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe6c006070 con 0x564e0e746cd0 2024-05-08T18:50:46.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.501+0000 7fbd68608640 1 -- 172.21.15.132:0/3490015316 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe6c00e890 con 0x564e0e746cd0 2024-05-08T18:50:46.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.502+0000 7fbe7c742800 1 -- 172.21.15.132:0/3490015316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e746cd0 msgr2=0x564e0e837660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.502+0000 7fbe7c742800 1 --2- 172.21.15.132:0/3490015316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e746cd0 0x564e0e837660 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c001e90 tx=0x7fbe6c00b6c0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.502+0000 7fbe7c742800 1 -- 172.21.15.132:0/3490015316 shutdown_connections 2024-05-08T18:50:46.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.502+0000 7fbe7c742800 1 --2- 172.21.15.132:0/3490015316 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e746cd0 0x564e0e837660 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.502+0000 7fbe7c742800 1 -- 172.21.15.132:0/3490015316 >> 172.21.15.132:0/3490015316 conn(0x564e0e740720 msgr2=0x564e0e832f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.502+0000 7fbe7c742800 1 -- 172.21.15.132:0/3490015316 shutdown_connections 2024-05-08T18:50:46.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.502+0000 7fbe7c742800 1 -- 172.21.15.132:0/3490015316 wait complete. 2024-05-08T18:50:46.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.502+0000 7fbe7c742800 1 Processor -- start 2024-05-08T18:50:46.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.502+0000 7fbe7c742800 1 -- start start 2024-05-08T18:50:46.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.502+0000 7fbe7c742800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e746cd0 0x564e0e83f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.502+0000 7fbe7c742800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564e0e74d5e0 con 0x564e0e746cd0 2024-05-08T18:50:46.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.502+0000 7fbe7a23a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e746cd0 0x564e0e83f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.502+0000 7fbe7a23a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e746cd0 0x564e0e83f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60368/0 (socket says 172.21.15.132:60368) 2024-05-08T18:50:46.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.502+0000 7fbe7a23a640 1 -- 172.21.15.132:0/1507765721 learned_addr learned my addr 172.21.15.132:0/1507765721 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.503+0000 7fbe7a23a640 1 -- 172.21.15.132:0/1507765721 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e0e83f720 con 0x564e0e746cd0 2024-05-08T18:50:46.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.503+0000 7fbe7a23a640 1 --2- 172.21.15.132:0/1507765721 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e746cd0 0x564e0e83f1e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00c010 tx=0x7fbe6c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.503+0000 7fbd66e05640 1 -- 172.21.15.132:0/1507765721 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe6c00f8d0 con 0x564e0e746cd0 2024-05-08T18:50:46.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.503+0000 7fbd66e05640 1 -- 172.21.15.132:0/1507765721 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe6c00fa90 con 0x564e0e746cd0 2024-05-08T18:50:46.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.503+0000 7fbe7c742800 1 -- 172.21.15.132:0/1507765721 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e0e83f9b0 con 0x564e0e746cd0 2024-05-08T18:50:46.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.503+0000 7fbd66e05640 1 -- 172.21.15.132:0/1507765721 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe6c00fdb0 con 0x564e0e746cd0 2024-05-08T18:50:46.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.503+0000 7fbe7c742800 1 -- 172.21.15.132:0/1507765721 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e0e842660 con 0x564e0e746cd0 2024-05-08T18:50:46.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.504+0000 7fbd66e05640 1 -- 172.21.15.132:0/1507765721 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fbe6c017070 con 0x564e0e746cd0 2024-05-08T18:50:46.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.504+0000 7fbd66e05640 1 --2- 172.21.15.132:0/1507765721 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd6003bb50 0x7fbd6003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.504+0000 7fbd66e05640 1 -- 172.21.15.132:0/1507765721 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fbe6c015020 con 0x564e0e746cd0 2024-05-08T18:50:46.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.504+0000 7fbe79a39640 1 --2- 172.21.15.132:0/1507765721 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd6003bb50 0x7fbd6003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.504+0000 7fbe7c742800 1 --2- 172.21.15.132:0/1507765721 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564e0e74a7e0 0x564e0e846420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.504+0000 7fbe7c742800 1 -- 172.21.15.132:0/1507765721 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564e0e8469a0 con 0x564e0e74a7e0 2024-05-08T18:50:46.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.504+0000 7fbe7aa3b640 1 --2- 172.21.15.132:0/1507765721 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564e0e74a7e0 0x564e0e846420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.505+0000 7fbe79a39640 1 --2- 172.21.15.132:0/1507765721 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd6003bb50 0x7fbd6003e010 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbe70054000 tx=0x7fbe7004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.505+0000 7fbe7aa3b640 1 --2- 172.21.15.132:0/1507765721 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564e0e74a7e0 0x564e0e846420 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.505+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/1507765721 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe7400a4a0 con 0x564e0e74a7e0 2024-05-08T18:50:46.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.505+0000 7fbe7c742800 1 -- 172.21.15.132:0/1507765721 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564e0e8439d0 con 0x564e0e74a7e0 2024-05-08T18:50:46.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.505+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/1507765721 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe7400a4a0 con 0x564e0e74a7e0 2024-05-08T18:50:46.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.505+0000 7fbe7c742800 1 --2- 172.21.15.132:0/1507765721 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564e0e848d00 0x564e0e84b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.505+0000 7fbe7c742800 1 -- 172.21.15.132:0/1507765721 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564e0e84b790 con 0x564e0e848d00 2024-05-08T18:50:46.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.505+0000 7fbe7a23a640 1 --2- 172.21.15.132:0/1507765721 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564e0e848d00 0x564e0e84b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.506+0000 7fbe7a23a640 1 --2- 172.21.15.132:0/1507765721 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564e0e848d00 0x564e0e84b0f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.506+0000 7fbe7a23a640 1 -- 172.21.15.132:0/1507765721 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbe6c02e070 con 0x564e0e848d00 2024-05-08T18:50:46.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.506+0000 7fbe7c742800 1 -- 172.21.15.132:0/1507765721 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564e0e847b70 con 0x564e0e74a7e0 2024-05-08T18:50:46.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.506+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/1507765721 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe7400a4a0 con 0x564e0e74a7e0 2024-05-08T18:50:46.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.506+0000 7fbe7c742800 1 -- 172.21.15.132:0/1507765721 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564e0e848050 con 0x564e0e74a7e0 2024-05-08T18:50:46.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.506+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/1507765721 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbe7400a4a0 con 0x564e0e74a7e0 2024-05-08T18:50:46.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.507+0000 7fbe7c742800 1 Processor -- start 2024-05-08T18:50:46.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.507+0000 7fbe7c742800 1 -- start start 2024-05-08T18:50:46.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.507+0000 7fbe7c742800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e85a6e0 0x564e0e85ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.507+0000 7fbe7c742800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564e0e637fc0 con 0x564e0e85a6e0 2024-05-08T18:50:46.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.507+0000 7fbe7aa3b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e85a6e0 0x564e0e85ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.507+0000 7fbe7aa3b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e85a6e0 0x564e0e85ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60382/0 (socket says 172.21.15.132:60382) 2024-05-08T18:50:46.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.507+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/3458272615 learned_addr learned my addr 172.21.15.132:0/3458272615 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.507+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/3458272615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e0e85b040 con 0x564e0e85a6e0 2024-05-08T18:50:46.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.508+0000 7fbe7aa3b640 1 --2- 172.21.15.132:0/3458272615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e85a6e0 0x564e0e85ab00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x564e0e846d80 tx=0x7fbe74018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.508+0000 7fbd5ffff640 1 -- 172.21.15.132:0/3458272615 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe74014450 con 0x564e0e85a6e0 2024-05-08T18:50:46.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.508+0000 7fbd5ffff640 1 -- 172.21.15.132:0/3458272615 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe740145f0 con 0x564e0e85a6e0 2024-05-08T18:50:46.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.508+0000 7fbd5ffff640 1 -- 172.21.15.132:0/3458272615 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe740148d0 con 0x564e0e85a6e0 2024-05-08T18:50:46.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.508+0000 7fbe7c742800 1 -- 172.21.15.132:0/3458272615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e0e85bab0 con 0x564e0e85a6e0 2024-05-08T18:50:46.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.508+0000 7fbe7c742800 1 -- 172.21.15.132:0/3458272615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e0e85bfb0 con 0x564e0e85a6e0 2024-05-08T18:50:46.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.509+0000 7fbd5ffff640 1 -- 172.21.15.132:0/3458272615 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fbe74011040 con 0x564e0e85a6e0 2024-05-08T18:50:46.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.509+0000 7fbd5ffff640 1 --2- 172.21.15.132:0/3458272615 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd5403bb50 0x7fbd5403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.509+0000 7fbd5ffff640 1 -- 172.21.15.132:0/3458272615 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fbe7401e070 con 0x564e0e85a6e0 2024-05-08T18:50:46.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.509+0000 7fbe7a23a640 1 --2- 172.21.15.132:0/3458272615 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd5403bb50 0x7fbd5403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.509+0000 7fbe7c742800 1 Processor -- start 2024-05-08T18:50:46.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.509+0000 7fbe7a23a640 1 --2- 172.21.15.132:0/3458272615 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd5403bb50 0x7fbd5403e010 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c051950 tx=0x7fbe6c021fb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.509+0000 7fbe7c742800 1 -- start start 2024-05-08T18:50:46.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.510+0000 7fbe7c742800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e867a30 0x564e0e867e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.510+0000 7fbe7c742800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564e0e837fb0 con 0x564e0e867a30 2024-05-08T18:50:46.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.510+0000 7fbe7aa3b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e867a30 0x564e0e867e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.510+0000 7fbe7aa3b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e867a30 0x564e0e867e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60384/0 (socket says 172.21.15.132:60384) 2024-05-08T18:50:46.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.510+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/3163058327 learned_addr learned my addr 172.21.15.132:0/3163058327 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.510+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/3163058327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e0e868420 con 0x564e0e867a30 2024-05-08T18:50:46.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.510+0000 7fbe7aa3b640 1 --2- 172.21.15.132:0/3163058327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e867a30 0x564e0e867e50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbe74018430 tx=0x7fbe74052f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6cf4bb16be88d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.510+0000 7fbd5dffb640 1 -- 172.21.15.132:0/3163058327 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe74022db0 con 0x564e0e867a30 2024-05-08T18:50:46.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.510+0000 7fbd5dffb640 1 -- 172.21.15.132:0/3163058327 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe740167c0 con 0x564e0e867a30 2024-05-08T18:50:46.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.510+0000 7fbd5dffb640 1 -- 172.21.15.132:0/3163058327 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe74016aa0 con 0x564e0e867a30 2024-05-08T18:50:46.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.511+0000 7fbe7c742800 1 -- 172.21.15.132:0/3163058327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e867a30 msgr2=0x564e0e867e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.511+0000 7fbe7c742800 1 --2- 172.21.15.132:0/3163058327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e867a30 0x564e0e867e50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbe74018430 tx=0x7fbe74052f90 comp rx=0 tx=0).stop 2024-05-08T18:50:46.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.511+0000 7fbe7c742800 1 -- 172.21.15.132:0/3163058327 shutdown_connections 2024-05-08T18:50:46.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.511+0000 7fbe7c742800 1 --2- 172.21.15.132:0/3163058327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e867a30 0x564e0e867e50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.511+0000 7fbe7c742800 1 -- 172.21.15.132:0/3163058327 >> 172.21.15.132:0/3163058327 conn(0x564e0e863d00 msgr2=0x564e0e861d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.511+0000 7fbe7c742800 1 -- 172.21.15.132:0/3163058327 shutdown_connections 2024-05-08T18:50:46.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.511+0000 7fbe7c742800 1 -- 172.21.15.132:0/3163058327 wait complete. 2024-05-08T18:50:46.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.511+0000 7fbe7c742800 1 Processor -- start 2024-05-08T18:50:46.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.511+0000 7fbe7c742800 1 -- start start 2024-05-08T18:50:46.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.511+0000 7fbe7c742800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e867a30 0x564e0e86eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.511+0000 7fbe7c742800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564e0e868be0 con 0x564e0e867a30 2024-05-08T18:50:46.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.511+0000 7fbe7aa3b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e867a30 0x564e0e86eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.511+0000 7fbe7aa3b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e867a30 0x564e0e86eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60390/0 (socket says 172.21.15.132:60390) 2024-05-08T18:50:46.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.511+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 learned_addr learned my addr 172.21.15.132:0/4123119488 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.512+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e0e86f400 con 0x564e0e867a30 2024-05-08T18:50:46.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.512+0000 7fbe7aa3b640 1 --2- 172.21.15.132:0/4123119488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e867a30 0x564e0e86eec0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbe74022a80 tx=0x7fbe74052d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.512+0000 7fbd4bfff640 1 -- 172.21.15.132:0/4123119488 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe74054310 con 0x564e0e867a30 2024-05-08T18:50:46.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.512+0000 7fbd4bfff640 1 -- 172.21.15.132:0/4123119488 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe740544b0 con 0x564e0e867a30 2024-05-08T18:50:46.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.512+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e0e86f690 con 0x564e0e867a30 2024-05-08T18:50:46.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.512+0000 7fbd4bfff640 1 -- 172.21.15.132:0/4123119488 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe740408e0 con 0x564e0e867a30 2024-05-08T18:50:46.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.512+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e0e872340 con 0x564e0e867a30 2024-05-08T18:50:46.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.513+0000 7fbd4bfff640 1 -- 172.21.15.132:0/4123119488 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fbe74040a80 con 0x564e0e867a30 2024-05-08T18:50:46.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.513+0000 7fbd4bfff640 1 --2- 172.21.15.132:0/4123119488 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd4403bba0 0x7fbd4403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.513+0000 7fbd4bfff640 1 -- 172.21.15.132:0/4123119488 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fbe7400e040 con 0x564e0e867a30 2024-05-08T18:50:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.513+0000 7fbe7a23a640 1 --2- 172.21.15.132:0/4123119488 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd4403bba0 0x7fbd4403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.513+0000 7fbe7c742800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.513+0000 7fbe7c742800 1 --2- 172.21.15.132:0/4123119488 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564e0e87abd0 0x564e0e87d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.513+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564e0e87d7e0 con 0x564e0e87abd0 2024-05-08T18:50:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.513+0000 7fbe79a39640 1 --2- 172.21.15.132:0/4123119488 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564e0e87abd0 0x564e0e87d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.514+0000 7fbe7a23a640 1 --2- 172.21.15.132:0/4123119488 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd4403bba0 0x7fbd4403e060 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c019fd0 tx=0x7fbe6c053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.514+0000 7fbe79a39640 1 --2- 172.21.15.132:0/4123119488 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564e0e87abd0 0x564e0e87d090 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.514+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.514+0000 7fbe7c742800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.514+0000 7fbe7c742800 20 realm 2024-05-08T18:50:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.514+0000 7fbe7c742800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.514+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564e0e87dbb0 con 0x564e0e87abd0 2024-05-08T18:50:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.514+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.514+0000 7fbe7c742800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.514+0000 7fbe7c742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.514+0000 7fbe7c742800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.514+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564e0e87e450 con 0x564e0e87abd0 2024-05-08T18:50:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.514+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.514+0000 7fbe7c742800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.514+0000 7fbe7c742800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.514+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564e0e87e7f0 con 0x564e0e87abd0 2024-05-08T18:50:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.515+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.515+0000 7fbe7c742800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.515+0000 7fbe7c742800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.515+0000 7fbe7c742800 1 --2- 172.21.15.132:0/4123119488 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564e0e87f550 0x564e0e881940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.515+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564e0e881e80 con 0x564e0e87f550 2024-05-08T18:50:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.515+0000 7fbe7aa3b640 1 --2- 172.21.15.132:0/4123119488 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564e0e87f550 0x564e0e881940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.515+0000 7fbe7aa3b640 1 --2- 172.21.15.132:0/4123119488 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564e0e87f550 0x564e0e881940 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.515+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbe7403c020 con 0x564e0e87f550 2024-05-08T18:50:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.515+0000 7fbe7c742800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.515+0000 7fbe7c742800 20 searching for the correct realm 2024-05-08T18:50:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.515+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x564e0e87f550 2024-05-08T18:50:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.516+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7403c020 con 0x564e0e87f550 2024-05-08T18:50:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.516+0000 7fbe7aa3b640 1 --2- 172.21.15.132:0/4123119488 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fbe74014070 0x7fbe7402d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.516+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x7fbe74014070 2024-05-08T18:50:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.516+0000 7fbe7a23a640 1 --2- 172.21.15.132:0/4123119488 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fbe74014070 0x7fbe7402d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.516+0000 7fbe7a23a640 1 --2- 172.21.15.132:0/4123119488 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fbe74014070 0x7fbe7402d8b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.517+0000 7fbe7a23a640 1 -- 172.21.15.132:0/4123119488 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6c044d70 con 0x7fbe74014070 2024-05-08T18:50:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.517+0000 7fbe7a23a640 1 --2- 172.21.15.132:0/4123119488 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fbe6c00f070 0x7fbe6c01d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.517+0000 7fbe7a23a640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x7fbe6c00f070 2024-05-08T18:50:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.517+0000 7fbe79a39640 1 --2- 172.21.15.132:0/4123119488 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fbe6c00f070 0x7fbe6c01d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.517+0000 7fbe79a39640 1 --2- 172.21.15.132:0/4123119488 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fbe6c00f070 0x7fbe6c01d820 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.518+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7005a040 con 0x7fbe6c00f070 2024-05-08T18:50:46.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.518+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x564e0e87abd0 2024-05-08T18:50:46.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.518+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.518+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x564e0e87abd0 2024-05-08T18:50:46.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.518+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.518+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x7fbe6c00f070 2024-05-08T18:50:46.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.518+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7005a040 con 0x7fbe6c00f070 2024-05-08T18:50:46.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.518+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x7fbe6c00f070 2024-05-08T18:50:46.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.519+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7005a040 con 0x7fbe6c00f070 2024-05-08T18:50:46.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.519+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x7fbe74014070 2024-05-08T18:50:46.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.519+0000 7fbe7a23a640 1 -- 172.21.15.132:0/4123119488 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6c044d70 con 0x7fbe74014070 2024-05-08T18:50:46.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.519+0000 7fbe7a23a640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x564e0e87f550 2024-05-08T18:50:46.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.519+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7403c020 con 0x564e0e87f550 2024-05-08T18:50:46.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.519+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x564e0e87abd0 2024-05-08T18:50:46.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.519+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.519+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x7fbe6c00f070 2024-05-08T18:50:46.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.520+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7005a040 con 0x7fbe6c00f070 2024-05-08T18:50:46.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.520+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x564e0e87abd0 2024-05-08T18:50:46.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.520+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.520+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x7fbe74014070 2024-05-08T18:50:46.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.520+0000 7fbe7a23a640 1 -- 172.21.15.132:0/4123119488 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbe6c044d70 con 0x7fbe74014070 2024-05-08T18:50:46.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.520+0000 7fbe7a23a640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x564e0e87f550 2024-05-08T18:50:46.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.520+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbe7403c020 con 0x564e0e87f550 2024-05-08T18:50:46.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.520+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x564e0e87f550 2024-05-08T18:50:46.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.521+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7403c020 con 0x564e0e87f550 2024-05-08T18:50:46.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.521+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x7fbe6c00f070 2024-05-08T18:50:46.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.521+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7005a040 con 0x7fbe6c00f070 2024-05-08T18:50:46.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.521+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x564e0e87f550 2024-05-08T18:50:46.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.521+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7403c020 con 0x564e0e87f550 2024-05-08T18:50:46.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.521+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x564e0e87f550 2024-05-08T18:50:46.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.521+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7403c020 con 0x564e0e87f550 2024-05-08T18:50:46.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.521+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x564e0e87abd0 2024-05-08T18:50:46.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.522+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.522+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x564e0e87abd0 2024-05-08T18:50:46.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.522+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.522+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x7fbe6c00f070 2024-05-08T18:50:46.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.522+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7005a040 con 0x7fbe6c00f070 2024-05-08T18:50:46.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.522+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x564e0e87f550 2024-05-08T18:50:46.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.523+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7403c020 con 0x564e0e87f550 2024-05-08T18:50:46.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.523+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x7fbe74014070 2024-05-08T18:50:46.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.523+0000 7fbe7a23a640 1 -- 172.21.15.132:0/4123119488 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6c044d70 con 0x7fbe74014070 2024-05-08T18:50:46.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.523+0000 7fbe7a23a640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x564e0e87abd0 2024-05-08T18:50:46.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.523+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.523+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x7fbe6c00f070 2024-05-08T18:50:46.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.523+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7005a040 con 0x7fbe6c00f070 2024-05-08T18:50:46.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.523+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x564e0e87f550 2024-05-08T18:50:46.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.524+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7403c020 con 0x564e0e87f550 2024-05-08T18:50:46.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.524+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x7fbe6c00f070 2024-05-08T18:50:46.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.524+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7005a040 con 0x7fbe6c00f070 2024-05-08T18:50:46.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.524+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x7fbe74014070 2024-05-08T18:50:46.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.524+0000 7fbe7a23a640 1 -- 172.21.15.132:0/4123119488 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6c044d70 con 0x7fbe74014070 2024-05-08T18:50:46.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.524+0000 7fbe7a23a640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x564e0e87f550 2024-05-08T18:50:46.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.524+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7403c020 con 0x564e0e87f550 2024-05-08T18:50:46.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.524+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x7fbe6c00f070 2024-05-08T18:50:46.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.525+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7005a040 con 0x7fbe6c00f070 2024-05-08T18:50:46.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.525+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x564e0e87abd0 2024-05-08T18:50:46.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.525+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.525+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564e0e883830 con 0x7fbe74014070 2024-05-08T18:50:46.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.525+0000 7fbe7a23a640 1 -- 172.21.15.132:0/4123119488 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe6c044d70 con 0x7fbe74014070 2024-05-08T18:50:46.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.525+0000 7fbe7c742800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:46.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.525+0000 7fbe7c742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:46.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.525+0000 7fbe7c742800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:46.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.525+0000 7fbe7c742800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:46.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.525+0000 7fbe7c742800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:46.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.525+0000 7fbe7c742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:46.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.525+0000 7fbe7c742800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.525+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564e0e882930 con 0x564e0e87abd0 2024-05-08T18:50:46.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.525+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.525+0000 7fbe7c742800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.525+0000 7fbe7c742800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.525+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564e0e8831d0 con 0x564e0e87abd0 2024-05-08T18:50:46.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.526+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.526+0000 7fbe7c742800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:46.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.526+0000 7fbe7c742800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.526+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564e0e882570 con 0x564e0e87abd0 2024-05-08T18:50:46.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.526+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.526+0000 7fbe7c742800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:46.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.526+0000 7fbe7c742800 20 zone default found 2024-05-08T18:50:46.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.526+0000 7fbe7c742800 4 Realm: () 2024-05-08T18:50:46.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.526+0000 7fbe7c742800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:46.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.526+0000 7fbe7c742800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:46.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.526+0000 7fbe7c742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:46.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.526+0000 7fbe7c742800 20 zonegroup default 2024-05-08T18:50:46.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.526+0000 7fbe7c742800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.526+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564e0e8841b0 con 0x7fbe6c00f070 2024-05-08T18:50:46.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.526+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbe7005a040 con 0x7fbe6c00f070 2024-05-08T18:50:46.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.526+0000 7fbe7c742800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.526+0000 7fbe7c742800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.526+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564e0e885bf0 con 0x564e0e87f550 2024-05-08T18:50:46.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.526+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe7403c020 con 0x564e0e87f550 2024-05-08T18:50:46.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.527+0000 7fbe7c742800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.527+0000 7fbe7c742800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.527+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564e0e8860e0 con 0x564e0e87f550 2024-05-08T18:50:46.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.527+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe7403c020 con 0x564e0e87f550 2024-05-08T18:50:46.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.527+0000 7fbe7c742800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.527+0000 7fbe7c742800 20 started sync module instance, tier type = 2024-05-08T18:50:46.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.527+0000 7fbe7c742800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:46.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.527+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e885020 con 0x7fbe74014070 2024-05-08T18:50:46.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.528+0000 7fbe7a23a640 1 -- 172.21.15.132:0/4123119488 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6c044d70 con 0x7fbe74014070 2024-05-08T18:50:46.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.528+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94893251253264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e884c80 con 0x7fbe74014070 2024-05-08T18:50:46.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.528+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e887010 con 0x564e0e87abd0 2024-05-08T18:50:46.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.529+0000 7fbe7a23a640 1 -- 172.21.15.132:0/4123119488 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94893251253264] v25'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6c044d70 con 0x7fbe74014070 2024-05-08T18:50:46.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.529+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.529+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94893251259232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e887430 con 0x564e0e87abd0 2024-05-08T18:50:46.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.529+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e887df0 con 0x564e0e87f550 2024-05-08T18:50:46.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.530+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94893251259232] v25'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.530+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7403c020 con 0x564e0e87f550 2024-05-08T18:50:46.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.530+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94893251260768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e887df0 con 0x564e0e87f550 2024-05-08T18:50:46.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.530+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e888810 con 0x7fbe74014070 2024-05-08T18:50:46.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.531+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94893251260768] v25'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7403c020 con 0x564e0e87f550 2024-05-08T18:50:46.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.531+0000 7fbe7a23a640 1 -- 172.21.15.132:0/4123119488 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6c044d70 con 0x7fbe74014070 2024-05-08T18:50:46.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.531+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94893251262784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e887d60 con 0x7fbe74014070 2024-05-08T18:50:46.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.531+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e889700 con 0x564e0e87abd0 2024-05-08T18:50:46.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.532+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.532+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94893251269712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e889fa0 con 0x564e0e87abd0 2024-05-08T18:50:46.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.532+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e88aa50 con 0x7fbe6c00f070 2024-05-08T18:50:46.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.533+0000 7fbe7a23a640 1 -- 172.21.15.132:0/4123119488 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94893251262784] v25'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6c044d70 con 0x7fbe74014070 2024-05-08T18:50:46.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.534+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94893251269712] v25'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.534+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7005a040 con 0x7fbe6c00f070 2024-05-08T18:50:46.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.534+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94893251267632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e8899f0 con 0x7fbe6c00f070 2024-05-08T18:50:46.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.534+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e88b2f0 con 0x7fbe6c00f070 2024-05-08T18:50:46.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.535+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94893251267632] v25'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7005a040 con 0x7fbe6c00f070 2024-05-08T18:50:46.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.540+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7005a040 con 0x7fbe6c00f070 2024-05-08T18:50:46.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.540+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94893251274032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e8899d0 con 0x7fbe6c00f070 2024-05-08T18:50:46.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.540+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e88b8f0 con 0x7fbe6c00f070 2024-05-08T18:50:46.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.542+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(58 notify.7 [create] v25'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7005a040 con 0x7fbe6c00f070 2024-05-08T18:50:46.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.542+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94893251274032] v25'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7005a040 con 0x7fbe6c00f070 2024-05-08T18:50:46.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.542+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94893251277792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e88bd60 con 0x7fbe6c00f070 2024-05-08T18:50:46.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.542+0000 7fbe7c742800 20 add_watcher() i=0 2024-05-08T18:50:46.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.542+0000 7fbe7c742800 20 add_watcher() i=1 2024-05-08T18:50:46.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.542+0000 7fbe7c742800 20 add_watcher() i=2 2024-05-08T18:50:46.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.542+0000 7fbe7c742800 20 add_watcher() i=3 2024-05-08T18:50:46.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.542+0000 7fbe7c742800 20 add_watcher() i=4 2024-05-08T18:50:46.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.542+0000 7fbe7c742800 20 add_watcher() i=5 2024-05-08T18:50:46.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.542+0000 7fbe7c742800 20 add_watcher() i=6 2024-05-08T18:50:46.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.545+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94893251277792] v25'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7005a040 con 0x7fbe6c00f070 2024-05-08T18:50:46.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.545+0000 7fbe7c742800 20 add_watcher() i=7 2024-05-08T18:50:46.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.545+0000 7fbe7c742800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:46.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.545+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564e0e88bd60 con 0x564e0e87abd0 2024-05-08T18:50:46.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.545+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.545+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94893251279024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e88c600 con 0x564e0e87abd0 2024-05-08T18:50:46.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.546+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94893251279024] v25'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.546+0000 7fbd30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:46.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.546+0000 7fbe7c742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:46.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.546+0000 7fbe7c742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:46.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.546+0000 7fbe7c742800 5 note: GC not initialized 2024-05-08T18:50:46.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.546+0000 7fbcab7fe640 20 reqs_thread_entry: start 2024-05-08T18:50:46.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.546+0000 7fbe7c742800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:46.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.547+0000 7fbe7c742800 20 Filter name: none 2024-05-08T18:50:46.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.547+0000 7fbca97fa640 20 reqs_thread_entry: start 2024-05-08T18:50:46.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.547+0000 7fbe7c742800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.547+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564e0e8c1d30 con 0x564e0e87abd0 2024-05-08T18:50:46.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.547+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.547+0000 7fbe7c742800 20 rados_obj.operate() r=0 bl.length=556 2024-05-08T18:50:46.548 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:50:44.835566Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:44.835553Z","tags":[],"group_ids":[]} 2024-05-08T18:50:46.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.548+0000 7fbd30fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:46.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.548+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94893251279024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e8c0900 con 0x564e0e87abd0 2024-05-08T18:50:46.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.549+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94893251279024] v25'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.549+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94893251253264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e88b8b0 con 0x7fbe74014070 2024-05-08T18:50:46.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.550+0000 7fbe7a23a640 1 -- 172.21.15.132:0/4123119488 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94893251253264] v25'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6c044d70 con 0x7fbe74014070 2024-05-08T18:50:46.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.550+0000 7fbe7c742800 20 remove_watcher() i=0 2024-05-08T18:50:46.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.550+0000 7fbe7c742800 2 removed watcher, disabling cache 2024-05-08T18:50:46.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.550+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94893251259232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e88b8b0 con 0x564e0e87abd0 2024-05-08T18:50:46.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.551+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94893251259232] v25'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.551+0000 7fbe7c742800 20 remove_watcher() i=1 2024-05-08T18:50:46.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.551+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94893251260768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e886b60 con 0x564e0e87f550 2024-05-08T18:50:46.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.552+0000 7fbe7aa3b640 1 -- 172.21.15.132:0/4123119488 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94893251260768] v25'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7403c020 con 0x564e0e87f550 2024-05-08T18:50:46.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.552+0000 7fbe7c742800 20 remove_watcher() i=2 2024-05-08T18:50:46.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.552+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94893251262784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e88b8b0 con 0x7fbe74014070 2024-05-08T18:50:46.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.553+0000 7fbe7a23a640 1 -- 172.21.15.132:0/4123119488 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94893251262784] v25'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe6c044d70 con 0x7fbe74014070 2024-05-08T18:50:46.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.553+0000 7fbe7c742800 20 remove_watcher() i=3 2024-05-08T18:50:46.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.553+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94893251269712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e887160 con 0x564e0e87abd0 2024-05-08T18:50:46.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.554+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94893251269712] v25'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7005a040 con 0x564e0e87abd0 2024-05-08T18:50:46.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.554+0000 7fbe7c742800 20 remove_watcher() i=4 2024-05-08T18:50:46.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.554+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94893251267632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e886b60 con 0x7fbe6c00f070 2024-05-08T18:50:46.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.555+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94893251267632] v25'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7005a040 con 0x7fbe6c00f070 2024-05-08T18:50:46.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.555+0000 7fbe7c742800 20 remove_watcher() i=5 2024-05-08T18:50:46.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.555+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94893251274032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e887940 con 0x7fbe6c00f070 2024-05-08T18:50:46.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.558+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94893251274032] v25'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7005a040 con 0x7fbe6c00f070 2024-05-08T18:50:46.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.558+0000 7fbe7c742800 20 remove_watcher() i=6 2024-05-08T18:50:46.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.558+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94893251277792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564e0e887940 con 0x7fbe6c00f070 2024-05-08T18:50:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.559+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94893251277792] v25'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7005a040 con 0x7fbe6c00f070 2024-05-08T18:50:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.559+0000 7fbe7c742800 20 remove_watcher() i=7 2024-05-08T18:50:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.559+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fbe6c00f070 msgr2=0x7fbe6c01d820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.559+0000 7fbe7c742800 1 --2- 172.21.15.132:0/4123119488 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fbe6c00f070 0x7fbe6c01d820 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.559+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564e0e87abd0 msgr2=0x564e0e87d090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.559+0000 7fbe7c742800 1 --2- 172.21.15.132:0/4123119488 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564e0e87abd0 0x564e0e87d090 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.559+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fbe74014070 msgr2=0x7fbe7402d8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.559+0000 7fbe7c742800 1 --2- 172.21.15.132:0/4123119488 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fbe74014070 0x7fbe7402d8b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.559+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564e0e87f550 msgr2=0x564e0e881940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.559+0000 7fbe7c742800 1 --2- 172.21.15.132:0/4123119488 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564e0e87f550 0x564e0e881940 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd4403bba0 msgr2=0x7fbd4403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe7c742800 1 --2- 172.21.15.132:0/4123119488 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd4403bba0 0x7fbd4403e060 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c019fd0 tx=0x7fbe6c053000 comp rx=0 tx=0).stop 2024-05-08T18:50:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e867a30 msgr2=0x564e0e86eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe7c742800 1 --2- 172.21.15.132:0/4123119488 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e867a30 0x564e0e86eec0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbe74022a80 tx=0x7fbe74052d20 comp rx=0 tx=0).stop 2024-05-08T18:50:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 reap_dead start 2024-05-08T18:50:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe79a39640 1 -- 172.21.15.132:0/4123119488 reap_dead start 2024-05-08T18:50:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 shutdown_connections 2024-05-08T18:50:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 >> 172.21.15.132:0/4123119488 conn(0x564e0e863d00 msgr2=0x564e0e861380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 shutdown_connections 2024-05-08T18:50:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe7c742800 1 -- 172.21.15.132:0/4123119488 wait complete. 2024-05-08T18:50:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe7c742800 1 -- 172.21.15.132:0/3458272615 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd5403bb50 msgr2=0x7fbd5403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe7c742800 1 --2- 172.21.15.132:0/3458272615 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd5403bb50 0x7fbd5403e010 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c051950 tx=0x7fbe6c021fb0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe7c742800 1 -- 172.21.15.132:0/3458272615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e85a6e0 msgr2=0x564e0e85ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe7c742800 1 --2- 172.21.15.132:0/3458272615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e85a6e0 0x564e0e85ab00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x564e0e846d80 tx=0x7fbe74018830 comp rx=0 tx=0).stop 2024-05-08T18:50:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe7c742800 1 -- 172.21.15.132:0/3458272615 shutdown_connections 2024-05-08T18:50:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe7c742800 1 --2- 172.21.15.132:0/3458272615 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd5403bb50 0x7fbd5403e010 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe7c742800 1 --2- 172.21.15.132:0/3458272615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e85a6e0 0x564e0e85ab00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe7c742800 1 -- 172.21.15.132:0/3458272615 >> 172.21.15.132:0/3458272615 conn(0x564e0e84e780 msgr2=0x564e0e84eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe7c742800 1 -- 172.21.15.132:0/3458272615 shutdown_connections 2024-05-08T18:50:46.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe7c742800 1 -- 172.21.15.132:0/3458272615 wait complete. 2024-05-08T18:50:46.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe7c742800 1 -- 172.21.15.132:0/1507765721 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564e0e74a7e0 msgr2=0x564e0e846420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe7c742800 1 --2- 172.21.15.132:0/1507765721 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564e0e74a7e0 0x564e0e846420 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe7c742800 1 -- 172.21.15.132:0/1507765721 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564e0e848d00 msgr2=0x564e0e84b0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.560+0000 7fbe7c742800 1 --2- 172.21.15.132:0/1507765721 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564e0e848d00 0x564e0e84b0f0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.561+0000 7fbe7c742800 1 -- 172.21.15.132:0/1507765721 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd6003bb50 msgr2=0x7fbd6003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.561+0000 7fbe7c742800 1 --2- 172.21.15.132:0/1507765721 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd6003bb50 0x7fbd6003e010 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbe70054000 tx=0x7fbe7004e000 comp rx=0 tx=0).stop 2024-05-08T18:50:46.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.561+0000 7fbe7c742800 1 -- 172.21.15.132:0/1507765721 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e746cd0 msgr2=0x564e0e83f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.561+0000 7fbe7c742800 1 --2- 172.21.15.132:0/1507765721 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e746cd0 0x564e0e83f1e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00c010 tx=0x7fbe6c000ed0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.561+0000 7fbe7c742800 1 -- 172.21.15.132:0/1507765721 shutdown_connections 2024-05-08T18:50:46.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.561+0000 7fbe7c742800 1 --2- 172.21.15.132:0/1507765721 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564e0e848d00 0x564e0e84b0f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.561+0000 7fbe7c742800 1 --2- 172.21.15.132:0/1507765721 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564e0e74a7e0 0x564e0e846420 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.561+0000 7fbe7c742800 1 --2- 172.21.15.132:0/1507765721 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd6003bb50 0x7fbd6003e010 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.561+0000 7fbe7c742800 1 --2- 172.21.15.132:0/1507765721 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564e0e746cd0 0x564e0e83f1e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.561+0000 7fbe7c742800 1 -- 172.21.15.132:0/1507765721 >> 172.21.15.132:0/1507765721 conn(0x564e0e740720 msgr2=0x564e0e831780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.561+0000 7fbe7c742800 1 -- 172.21.15.132:0/1507765721 shutdown_connections 2024-05-08T18:50:46.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.561+0000 7fbe7c742800 1 -- 172.21.15.132:0/1507765721 wait complete. 2024-05-08T18:50:46.569 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:50:44.835566Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:44.835553Z', 'tags': [], 'group_ids': []} 2024-05-08T18:50:46.569 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:50:46.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:50:46.569 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:50:46.613 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:46.613 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:46.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.614+0000 7fad38e13800 1 Processor -- start 2024-05-08T18:50:46.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.615+0000 7fad38e13800 1 -- start start 2024-05-08T18:50:46.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.615+0000 7fad38e13800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55f0444ab5d0 0x55f0444ad9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.615+0000 7fad38e13800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f0444adf90 con 0x55f0444a7140 2024-05-08T18:50:46.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.615+0000 7fad38e13800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55f044348e20 con 0x55f0444ab5d0 2024-05-08T18:50:46.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.615+0000 7fad2bfff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55f0444ab5d0 0x55f0444ad9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.615+0000 7fad2bfff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55f0444ab5d0 0x55f0444ad9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60400/0 (socket says 172.21.15.132:60400) 2024-05-08T18:50:46.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.615+0000 7fad2bfff640 1 -- 172.21.15.132:0/207231952 learned_addr learned my addr 172.21.15.132:0/207231952 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.615+0000 7fad2bfff640 1 -- 172.21.15.132:0/207231952 >> v1:172.21.15.42:6789/0 conn(0x55f0444a7140 legacy=0x55f0444a7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.615+0000 7fad2bfff640 1 -- 172.21.15.132:0/207231952 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0444af1c0 con 0x55f0444ab5d0 2024-05-08T18:50:46.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.617+0000 7fad2bfff640 1 --2- 172.21.15.132:0/207231952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0444ab5d0 0x55f0444ad9c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00a520 tx=0x7fad1c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344345f6083fd404 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.617+0000 7fad33c19640 1 -- 172.21.15.132:0/207231952 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad1c057070 con 0x55f0444ab5d0 2024-05-08T18:50:46.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.617+0000 7fad33c19640 1 -- 172.21.15.132:0/207231952 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad1c052570 con 0x55f0444ab5d0 2024-05-08T18:50:46.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.617+0000 7fad33c19640 1 -- 172.21.15.132:0/207231952 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad1c04ae60 con 0x55f0444ab5d0 2024-05-08T18:50:46.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.618+0000 7fad38e13800 1 -- 172.21.15.132:0/207231952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0444ab5d0 msgr2=0x55f0444ad9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.618+0000 7fad38e13800 1 --2- 172.21.15.132:0/207231952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0444ab5d0 0x55f0444ad9c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00a520 tx=0x7fad1c01d010 comp rx=0 tx=0).stop 2024-05-08T18:50:46.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.618+0000 7fad38e13800 1 -- 172.21.15.132:0/207231952 shutdown_connections 2024-05-08T18:50:46.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.618+0000 7fad38e13800 1 --2- 172.21.15.132:0/207231952 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0444ab5d0 0x55f0444ad9c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.618+0000 7fad38e13800 1 -- 172.21.15.132:0/207231952 >> 172.21.15.132:0/207231952 conn(0x55f0444a2720 msgr2=0x55f0444a4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.618+0000 7fad38e13800 1 -- 172.21.15.132:0/207231952 shutdown_connections 2024-05-08T18:50:46.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.618+0000 7fad38e13800 1 -- 172.21.15.132:0/207231952 wait complete. 2024-05-08T18:50:46.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.631+0000 7fad38e13800 1 Processor -- start 2024-05-08T18:50:46.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.631+0000 7fad38e13800 1 -- start start 2024-05-08T18:50:46.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.632+0000 7fad38e13800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0444a7140 0x55f044598540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.632+0000 7fad38e13800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f0443f35b0 con 0x55f0444a7140 2024-05-08T18:50:46.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.632+0000 7fad3441a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0444a7140 0x55f044598540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.632+0000 7fad3441a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0444a7140 0x55f044598540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60416/0 (socket says 172.21.15.132:60416) 2024-05-08T18:50:46.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.632+0000 7fad3441a640 1 -- 172.21.15.132:0/604712400 learned_addr learned my addr 172.21.15.132:0/604712400 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.632+0000 7fad3441a640 1 -- 172.21.15.132:0/604712400 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f044598b10 con 0x55f0444a7140 2024-05-08T18:50:46.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.632+0000 7fad3441a640 1 --2- 172.21.15.132:0/604712400 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0444a7140 0x55f044598540 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fad24001d50 tx=0x7fad2400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d42369197113e57 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.633+0000 7fac2260c640 1 -- 172.21.15.132:0/604712400 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2400f400 con 0x55f0444a7140 2024-05-08T18:50:46.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.633+0000 7fac2260c640 1 -- 172.21.15.132:0/604712400 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2400f5a0 con 0x55f0444a7140 2024-05-08T18:50:46.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.633+0000 7fac2260c640 1 -- 172.21.15.132:0/604712400 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2400f7d0 con 0x55f0444a7140 2024-05-08T18:50:46.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.633+0000 7fad38e13800 1 -- 172.21.15.132:0/604712400 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0444a7140 msgr2=0x55f044598540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.633+0000 7fad38e13800 1 --2- 172.21.15.132:0/604712400 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0444a7140 0x55f044598540 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fad24001d50 tx=0x7fad2400b5b0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.633+0000 7fad38e13800 1 -- 172.21.15.132:0/604712400 shutdown_connections 2024-05-08T18:50:46.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.633+0000 7fad38e13800 1 --2- 172.21.15.132:0/604712400 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0444a7140 0x55f044598540 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.633+0000 7fad38e13800 1 -- 172.21.15.132:0/604712400 >> 172.21.15.132:0/604712400 conn(0x55f0444a2720 msgr2=0x55f044593e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.633+0000 7fad38e13800 1 -- 172.21.15.132:0/604712400 shutdown_connections 2024-05-08T18:50:46.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.633+0000 7fad38e13800 1 -- 172.21.15.132:0/604712400 wait complete. 2024-05-08T18:50:46.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.634+0000 7fad38e13800 1 Processor -- start 2024-05-08T18:50:46.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.634+0000 7fad38e13800 1 -- start start 2024-05-08T18:50:46.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.634+0000 7fad38e13800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0444a7140 0x55f04441b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.634+0000 7fad38e13800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f0444ae460 con 0x55f0444a7140 2024-05-08T18:50:46.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.634+0000 7fad3441a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0444a7140 0x55f04441b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.634+0000 7fad3441a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0444a7140 0x55f04441b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60428/0 (socket says 172.21.15.132:60428) 2024-05-08T18:50:46.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.634+0000 7fad3441a640 1 -- 172.21.15.132:0/1128874758 learned_addr learned my addr 172.21.15.132:0/1128874758 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.634+0000 7fad3441a640 1 -- 172.21.15.132:0/1128874758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0445a3e10 con 0x55f0444a7140 2024-05-08T18:50:46.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.635+0000 7fad3441a640 1 --2- 172.21.15.132:0/1128874758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0444a7140 0x55f04441b300 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fad2400b5f0 tx=0x7fad24000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.635+0000 7fac20e09640 1 -- 172.21.15.132:0/1128874758 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2401a7c0 con 0x55f0444a7140 2024-05-08T18:50:46.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.635+0000 7fac20e09640 1 -- 172.21.15.132:0/1128874758 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2401a960 con 0x55f0444a7140 2024-05-08T18:50:46.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.635+0000 7fad38e13800 1 -- 172.21.15.132:0/1128874758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0445a3fe0 con 0x55f0444a7140 2024-05-08T18:50:46.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.635+0000 7fac20e09640 1 -- 172.21.15.132:0/1128874758 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2401ac40 con 0x55f0444a7140 2024-05-08T18:50:46.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.635+0000 7fad38e13800 1 -- 172.21.15.132:0/1128874758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0445a4560 con 0x55f0444a7140 2024-05-08T18:50:46.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.636+0000 7fac20e09640 1 -- 172.21.15.132:0/1128874758 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fad24017070 con 0x55f0444a7140 2024-05-08T18:50:46.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.636+0000 7fac20e09640 1 --2- 172.21.15.132:0/1128874758 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac1c03bb50 0x7fac1c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.636+0000 7fac20e09640 1 -- 172.21.15.132:0/1128874758 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fad24015020 con 0x55f0444a7140 2024-05-08T18:50:46.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.636+0000 7fad2bfff640 1 --2- 172.21.15.132:0/1128874758 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac1c03bb50 0x7fac1c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.636+0000 7fad38e13800 1 --2- 172.21.15.132:0/1128874758 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f0444ab5d0 0x55f0445a8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.636+0000 7fad38e13800 1 -- 172.21.15.132:0/1128874758 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0445a8900 con 0x55f0444ab5d0 2024-05-08T18:50:46.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.636+0000 7fad34c1b640 1 --2- 172.21.15.132:0/1128874758 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f0444ab5d0 0x55f0445a8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.636+0000 7fad2bfff640 1 --2- 172.21.15.132:0/1128874758 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac1c03bb50 0x7fac1c03e010 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fad1c054000 tx=0x7fad1c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.636+0000 7fad34c1b640 1 --2- 172.21.15.132:0/1128874758 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f0444ab5d0 0x55f0445a8380 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.637+0000 7fad34c1b640 1 -- 172.21.15.132:0/1128874758 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad2c00a4a0 con 0x55f0444ab5d0 2024-05-08T18:50:46.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.637+0000 7fad38e13800 1 -- 172.21.15.132:0/1128874758 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0445a5950 con 0x55f0444ab5d0 2024-05-08T18:50:46.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.637+0000 7fad34c1b640 1 -- 172.21.15.132:0/1128874758 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fad2c00a4a0 con 0x55f0444ab5d0 2024-05-08T18:50:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.637+0000 7fad38e13800 1 --2- 172.21.15.132:0/1128874758 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f0445aac50 0x55f0445ad040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.637+0000 7fad38e13800 1 -- 172.21.15.132:0/1128874758 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0445ad6e0 con 0x55f0445aac50 2024-05-08T18:50:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.637+0000 7fad3441a640 1 --2- 172.21.15.132:0/1128874758 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f0445aac50 0x55f0445ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.637+0000 7fad3441a640 1 --2- 172.21.15.132:0/1128874758 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f0445aac50 0x55f0445ad040 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.638+0000 7fad3441a640 1 -- 172.21.15.132:0/1128874758 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fad2402e070 con 0x55f0445aac50 2024-05-08T18:50:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.638+0000 7fad38e13800 1 -- 172.21.15.132:0/1128874758 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0445a9af0 con 0x55f0444ab5d0 2024-05-08T18:50:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.638+0000 7fad34c1b640 1 -- 172.21.15.132:0/1128874758 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fad2c00a4a0 con 0x55f0444ab5d0 2024-05-08T18:50:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.638+0000 7fad38e13800 1 -- 172.21.15.132:0/1128874758 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0445a9fd0 con 0x55f0444ab5d0 2024-05-08T18:50:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.638+0000 7fad34c1b640 1 -- 172.21.15.132:0/1128874758 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fad2c00a4a0 con 0x55f0444ab5d0 2024-05-08T18:50:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.639+0000 7fad38e13800 1 Processor -- start 2024-05-08T18:50:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.639+0000 7fad38e13800 1 -- start start 2024-05-08T18:50:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.639+0000 7fad38e13800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0445bc660 0x55f0445bca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.639+0000 7fad38e13800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f044399fc0 con 0x55f0445bc660 2024-05-08T18:50:46.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.639+0000 7fad34c1b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0445bc660 0x55f0445bca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.639+0000 7fad34c1b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0445bc660 0x55f0445bca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60438/0 (socket says 172.21.15.132:60438) 2024-05-08T18:50:46.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.639+0000 7fad34c1b640 1 -- 172.21.15.132:0/3560432658 learned_addr learned my addr 172.21.15.132:0/3560432658 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.639+0000 7fad34c1b640 1 -- 172.21.15.132:0/3560432658 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0445bcfc0 con 0x55f0445bc660 2024-05-08T18:50:46.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.639+0000 7fad34c1b640 1 --2- 172.21.15.132:0/3560432658 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0445bc660 0x55f0445bca80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55f0445a8d00 tx=0x7fad2c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.640+0000 7fac19ffb640 1 -- 172.21.15.132:0/3560432658 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2c014450 con 0x55f0445bc660 2024-05-08T18:50:46.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.640+0000 7fac19ffb640 1 -- 172.21.15.132:0/3560432658 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2c014610 con 0x55f0445bc660 2024-05-08T18:50:46.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.640+0000 7fad38e13800 1 -- 172.21.15.132:0/3560432658 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0445bda30 con 0x55f0445bc660 2024-05-08T18:50:46.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.640+0000 7fac19ffb640 1 -- 172.21.15.132:0/3560432658 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2c014930 con 0x55f0445bc660 2024-05-08T18:50:46.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.640+0000 7fad38e13800 1 -- 172.21.15.132:0/3560432658 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0445bdf30 con 0x55f0445bc660 2024-05-08T18:50:46.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.640+0000 7fac19ffb640 1 -- 172.21.15.132:0/3560432658 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fad2c011040 con 0x55f0445bc660 2024-05-08T18:50:46.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.641+0000 7fac19ffb640 1 --2- 172.21.15.132:0/3560432658 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac0c03bba0 0x7fac0c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.641+0000 7fac19ffb640 1 -- 172.21.15.132:0/3560432658 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fad2c01e070 con 0x55f0445bc660 2024-05-08T18:50:46.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.641+0000 7fad3441a640 1 --2- 172.21.15.132:0/3560432658 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac0c03bba0 0x7fac0c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.641+0000 7fad38e13800 1 Processor -- start 2024-05-08T18:50:46.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.641+0000 7fad3441a640 1 --2- 172.21.15.132:0/3560432658 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac0c03bba0 0x7fac0c03e060 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x55f0445a8d70 tx=0x7fad24045040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.641+0000 7fad38e13800 1 -- start start 2024-05-08T18:50:46.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.641+0000 7fad38e13800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0445c9970 0x55f0445c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.641+0000 7fad38e13800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f044598e90 con 0x55f0445c9970 2024-05-08T18:50:46.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.641+0000 7fad34c1b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0445c9970 0x55f0445c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.641+0000 7fad34c1b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0445c9970 0x55f0445c9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60450/0 (socket says 172.21.15.132:60450) 2024-05-08T18:50:46.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.641+0000 7fad34c1b640 1 -- 172.21.15.132:0/885990104 learned_addr learned my addr 172.21.15.132:0/885990104 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.642+0000 7fad34c1b640 1 -- 172.21.15.132:0/885990104 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0445ca360 con 0x55f0445c9970 2024-05-08T18:50:46.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.642+0000 7fad34c1b640 1 --2- 172.21.15.132:0/885990104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0445c9970 0x55f0445c9d90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fad2c052c80 tx=0x7fad2c052f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe7f56eeba8353f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.642+0000 7fac137fe640 1 -- 172.21.15.132:0/885990104 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2c044020 con 0x55f0445c9970 2024-05-08T18:50:46.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.642+0000 7fac137fe640 1 -- 172.21.15.132:0/885990104 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2c047070 con 0x55f0445c9970 2024-05-08T18:50:46.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.642+0000 7fac137fe640 1 -- 172.21.15.132:0/885990104 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2c014c20 con 0x55f0445c9970 2024-05-08T18:50:46.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.642+0000 7fad38e13800 1 -- 172.21.15.132:0/885990104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0445c9970 msgr2=0x55f0445c9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.642+0000 7fad38e13800 1 --2- 172.21.15.132:0/885990104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0445c9970 0x55f0445c9d90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fad2c052c80 tx=0x7fad2c052f00 comp rx=0 tx=0).stop 2024-05-08T18:50:46.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.642+0000 7fad38e13800 1 -- 172.21.15.132:0/885990104 shutdown_connections 2024-05-08T18:50:46.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.642+0000 7fad38e13800 1 --2- 172.21.15.132:0/885990104 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0445c9970 0x55f0445c9d90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.642+0000 7fad38e13800 1 -- 172.21.15.132:0/885990104 >> 172.21.15.132:0/885990104 conn(0x55f0445c5c40 msgr2=0x55f0445c3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.643+0000 7fad38e13800 1 -- 172.21.15.132:0/885990104 shutdown_connections 2024-05-08T18:50:46.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.643+0000 7fad38e13800 1 -- 172.21.15.132:0/885990104 wait complete. 2024-05-08T18:50:46.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.643+0000 7fad38e13800 1 Processor -- start 2024-05-08T18:50:46.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.643+0000 7fad38e13800 1 -- start start 2024-05-08T18:50:46.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.643+0000 7fad38e13800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0445c9970 0x55f0445d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.643+0000 7fad38e13800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f0445caaf0 con 0x55f0445c9970 2024-05-08T18:50:46.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.643+0000 7fad34c1b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0445c9970 0x55f0445d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.643+0000 7fad34c1b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0445c9970 0x55f0445d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60454/0 (socket says 172.21.15.132:60454) 2024-05-08T18:50:46.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.643+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 learned_addr learned my addr 172.21.15.132:0/513088987 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.643+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0445d14a0 con 0x55f0445c9970 2024-05-08T18:50:46.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.644+0000 7fad34c1b640 1 --2- 172.21.15.132:0/513088987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0445c9970 0x55f0445d0f60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fad2c051b70 tx=0x7fad2c052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.644+0000 7fac11ffb640 1 -- 172.21.15.132:0/513088987 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2c040710 con 0x55f0445c9970 2024-05-08T18:50:46.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.644+0000 7fac11ffb640 1 -- 172.21.15.132:0/513088987 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2c0408b0 con 0x55f0445c9970 2024-05-08T18:50:46.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.644+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0445d1730 con 0x55f0445c9970 2024-05-08T18:50:46.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.644+0000 7fac11ffb640 1 -- 172.21.15.132:0/513088987 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2c040b90 con 0x55f0445c9970 2024-05-08T18:50:46.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.644+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0445d43e0 con 0x55f0445c9970 2024-05-08T18:50:46.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.644+0000 7fac11ffb640 1 -- 172.21.15.132:0/513088987 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fad2c051070 con 0x55f0445c9970 2024-05-08T18:50:46.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.645+0000 7fac11ffb640 1 --2- 172.21.15.132:0/513088987 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac0403bba0 0x7fac0403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.645+0000 7fac11ffb640 1 -- 172.21.15.132:0/513088987 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fad2c00e040 con 0x55f0445c9970 2024-05-08T18:50:46.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.645+0000 7fad3441a640 1 --2- 172.21.15.132:0/513088987 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac0403bba0 0x7fac0403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.645+0000 7fad38e13800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.645+0000 7fad38e13800 1 --2- 172.21.15.132:0/513088987 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f0445dcbf0 0x55f0445df0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.645+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0445df800 con 0x55f0445dcbf0 2024-05-08T18:50:46.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.645+0000 7fad2bfff640 1 --2- 172.21.15.132:0/513088987 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f0445dcbf0 0x55f0445df0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.645+0000 7fad3441a640 1 --2- 172.21.15.132:0/513088987 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac0403bba0 0x7fac0403e060 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fad2400c010 tx=0x7fad24047000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.645+0000 7fad2bfff640 1 --2- 172.21.15.132:0/513088987 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f0445dcbf0 0x55f0445df0b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.646+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.646+0000 7fad38e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.646+0000 7fad38e13800 20 realm 2024-05-08T18:50:46.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.646+0000 7fad38e13800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.646+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0445dfbd0 con 0x55f0445dcbf0 2024-05-08T18:50:46.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.646+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.646+0000 7fad38e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.646+0000 7fad38e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:46.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.646+0000 7fad38e13800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.646+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e04a0 con 0x55f0445dcbf0 2024-05-08T18:50:46.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.646+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.646+0000 7fad38e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.646+0000 7fad38e13800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.646+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e0840 con 0x55f0445dcbf0 2024-05-08T18:50:46.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.646+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.646+0000 7fad38e13800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:46.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.646+0000 7fad38e13800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.646+0000 7fad38e13800 1 --2- 172.21.15.132:0/513088987 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f0445e12f0 0x55f0445e3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.646+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e3e80 con 0x55f0445e12f0 2024-05-08T18:50:46.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.646+0000 7fad34c1b640 1 --2- 172.21.15.132:0/513088987 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f0445e12f0 0x55f0445e3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.647+0000 7fad34c1b640 1 --2- 172.21.15.132:0/513088987 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f0445e12f0 0x55f0445e3720 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.647+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fad2c03d070 con 0x55f0445e12f0 2024-05-08T18:50:46.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.647+0000 7fad38e13800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:46.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.647+0000 7fad38e13800 20 searching for the correct realm 2024-05-08T18:50:46.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.647+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x55f0445e12f0 2024-05-08T18:50:46.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.647+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c03d070 con 0x55f0445e12f0 2024-05-08T18:50:46.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.647+0000 7fad34c1b640 1 --2- 172.21.15.132:0/513088987 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fad2c014070 0x7fad2c04b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.647+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x7fad2c014070 2024-05-08T18:50:46.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.648+0000 7fad3441a640 1 --2- 172.21.15.132:0/513088987 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fad2c014070 0x7fad2c04b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.648+0000 7fad3441a640 1 --2- 172.21.15.132:0/513088987 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fad2c014070 0x7fad2c04b430 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.648+0000 7fad3441a640 1 -- 172.21.15.132:0/513088987 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2402e070 con 0x7fad2c014070 2024-05-08T18:50:46.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.648+0000 7fad3441a640 1 --2- 172.21.15.132:0/513088987 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fad2404a220 0x7fad24043820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.648+0000 7fad3441a640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x7fad2404a220 2024-05-08T18:50:46.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.648+0000 7fad2bfff640 1 --2- 172.21.15.132:0/513088987 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fad2404a220 0x7fad24043820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.649+0000 7fad2bfff640 1 --2- 172.21.15.132:0/513088987 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fad2404a220 0x7fad24043820 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.649+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c05a040 con 0x7fad2404a220 2024-05-08T18:50:46.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.649+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x55f0445dcbf0 2024-05-08T18:50:46.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.649+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.649+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x55f0445dcbf0 2024-05-08T18:50:46.663 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.649+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.649+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x7fad2404a220 2024-05-08T18:50:46.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.650+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c05a040 con 0x7fad2404a220 2024-05-08T18:50:46.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.650+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x7fad2404a220 2024-05-08T18:50:46.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.650+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c05a040 con 0x7fad2404a220 2024-05-08T18:50:46.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.650+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x7fad2c014070 2024-05-08T18:50:46.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.650+0000 7fad3441a640 1 -- 172.21.15.132:0/513088987 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2402e070 con 0x7fad2c014070 2024-05-08T18:50:46.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.650+0000 7fad3441a640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x55f0445e12f0 2024-05-08T18:50:46.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.650+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c03d070 con 0x55f0445e12f0 2024-05-08T18:50:46.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.650+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x55f0445dcbf0 2024-05-08T18:50:46.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.651+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.651+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x7fad2404a220 2024-05-08T18:50:46.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.651+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c05a040 con 0x7fad2404a220 2024-05-08T18:50:46.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.651+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x55f0445dcbf0 2024-05-08T18:50:46.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.651+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.651+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x7fad2c014070 2024-05-08T18:50:46.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.651+0000 7fad3441a640 1 -- 172.21.15.132:0/513088987 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fad2402e070 con 0x7fad2c014070 2024-05-08T18:50:46.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.651+0000 7fad3441a640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x55f0445e12f0 2024-05-08T18:50:46.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.652+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fad2c03d070 con 0x55f0445e12f0 2024-05-08T18:50:46.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.652+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x55f0445e12f0 2024-05-08T18:50:46.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.652+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c03d070 con 0x55f0445e12f0 2024-05-08T18:50:46.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.652+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x7fad2404a220 2024-05-08T18:50:46.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.652+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c05a040 con 0x7fad2404a220 2024-05-08T18:50:46.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.652+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x55f0445e12f0 2024-05-08T18:50:46.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.652+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c03d070 con 0x55f0445e12f0 2024-05-08T18:50:46.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.652+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x55f0445e12f0 2024-05-08T18:50:46.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.653+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c03d070 con 0x55f0445e12f0 2024-05-08T18:50:46.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.653+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x55f0445dcbf0 2024-05-08T18:50:46.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.653+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.653+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x55f0445dcbf0 2024-05-08T18:50:46.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.653+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.653+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x7fad2404a220 2024-05-08T18:50:46.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.653+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c05a040 con 0x7fad2404a220 2024-05-08T18:50:46.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.653+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x55f0445e12f0 2024-05-08T18:50:46.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.654+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c06b040 con 0x55f0445e12f0 2024-05-08T18:50:46.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.654+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x7fad2c014070 2024-05-08T18:50:46.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.654+0000 7fad3441a640 1 -- 172.21.15.132:0/513088987 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2402e070 con 0x7fad2c014070 2024-05-08T18:50:46.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.654+0000 7fad3441a640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x55f0445dcbf0 2024-05-08T18:50:46.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.654+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.654+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x7fad2404a220 2024-05-08T18:50:46.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.654+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c05a040 con 0x7fad2404a220 2024-05-08T18:50:46.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.654+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x55f0445e12f0 2024-05-08T18:50:46.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.655+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c06b040 con 0x55f0445e12f0 2024-05-08T18:50:46.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.655+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x7fad2404a220 2024-05-08T18:50:46.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.655+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c05a040 con 0x7fad2404a220 2024-05-08T18:50:46.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.655+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x7fad2c014070 2024-05-08T18:50:46.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.655+0000 7fad3441a640 1 -- 172.21.15.132:0/513088987 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2402e070 con 0x7fad2c014070 2024-05-08T18:50:46.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.655+0000 7fad3441a640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x55f0445e12f0 2024-05-08T18:50:46.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.656+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c06b040 con 0x55f0445e12f0 2024-05-08T18:50:46.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.656+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x7fad2404a220 2024-05-08T18:50:46.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.656+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad1c05a040 con 0x7fad2404a220 2024-05-08T18:50:46.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.656+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x55f0445dcbf0 2024-05-08T18:50:46.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.656+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.656+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5860 con 0x7fad2c014070 2024-05-08T18:50:46.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.657+0000 7fad3441a640 1 -- 172.21.15.132:0/513088987 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2402e070 con 0x7fad2c014070 2024-05-08T18:50:46.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.657+0000 7fad38e13800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:46.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.657+0000 7fad38e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:46.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.657+0000 7fad38e13800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:46.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.657+0000 7fad38e13800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:46.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.657+0000 7fad38e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:46.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.657+0000 7fad38e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:46.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.657+0000 7fad38e13800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.657+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e4960 con 0x55f0445dcbf0 2024-05-08T18:50:46.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.657+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.657+0000 7fad38e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.657+0000 7fad38e13800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.657+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e5200 con 0x55f0445dcbf0 2024-05-08T18:50:46.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.657+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.657+0000 7fad38e13800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:46.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.657+0000 7fad38e13800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.657+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e45a0 con 0x55f0445dcbf0 2024-05-08T18:50:46.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.657+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.658+0000 7fad38e13800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:46.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.658+0000 7fad38e13800 20 zone default found 2024-05-08T18:50:46.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.658+0000 7fad38e13800 4 Realm: () 2024-05-08T18:50:46.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.658+0000 7fad38e13800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:46.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.658+0000 7fad38e13800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:46.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.658+0000 7fad38e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:46.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.658+0000 7fad38e13800 20 zonegroup default 2024-05-08T18:50:46.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.658+0000 7fad38e13800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.658+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e61e0 con 0x7fad2404a220 2024-05-08T18:50:46.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.658+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fad1c05a040 con 0x7fad2404a220 2024-05-08T18:50:46.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.658+0000 7fad38e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.658+0000 7fad38e13800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.658+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e7c20 con 0x55f0445e12f0 2024-05-08T18:50:46.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.658+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fad2c06b040 con 0x55f0445e12f0 2024-05-08T18:50:46.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.658+0000 7fad38e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.658+0000 7fad38e13800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.658+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e80b0 con 0x55f0445e12f0 2024-05-08T18:50:46.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.658+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fad2c06b040 con 0x55f0445e12f0 2024-05-08T18:50:46.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.658+0000 7fad38e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.658+0000 7fad38e13800 20 started sync module instance, tier type = 2024-05-08T18:50:46.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.659+0000 7fad38e13800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:46.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.659+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e7050 con 0x7fad2c014070 2024-05-08T18:50:46.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.659+0000 7fad3441a640 1 -- 172.21.15.132:0/513088987 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2402e070 con 0x7fad2c014070 2024-05-08T18:50:46.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.660+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94490427552832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e89c0 con 0x7fad2c014070 2024-05-08T18:50:46.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.660+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e9210 con 0x55f0445dcbf0 2024-05-08T18:50:46.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.661+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.661+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94490427559536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e9840 con 0x55f0445dcbf0 2024-05-08T18:50:46.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.661+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445ea360 con 0x55f0445e12f0 2024-05-08T18:50:46.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.662+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94490427559536] v25'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.662+0000 7fad3441a640 1 -- 172.21.15.132:0/513088987 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94490427552832] v25'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2402e070 con 0x7fad2c014070 2024-05-08T18:50:46.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.665+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c06b040 con 0x55f0445e12f0 2024-05-08T18:50:46.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.665+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94490427557136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445ea320 con 0x55f0445e12f0 2024-05-08T18:50:46.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.665+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445eac00 con 0x7fad2c014070 2024-05-08T18:50:46.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.666+0000 7fad3441a640 1 -- 172.21.15.132:0/513088987 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2402e070 con 0x7fad2c014070 2024-05-08T18:50:46.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.666+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94490427565904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445eb450 con 0x7fad2c014070 2024-05-08T18:50:46.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.666+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445ebca0 con 0x55f0445dcbf0 2024-05-08T18:50:46.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.666+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94490427557136] v25'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c06b040 con 0x55f0445e12f0 2024-05-08T18:50:46.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.667+0000 7fad3441a640 1 -- 172.21.15.132:0/513088987 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94490427565904] v25'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2402e070 con 0x7fad2c014070 2024-05-08T18:50:46.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.667+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.667+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94490427563568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445ebca0 con 0x55f0445dcbf0 2024-05-08T18:50:46.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.667+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445ec4f0 con 0x7fad2404a220 2024-05-08T18:50:46.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.668+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94490427563568] v25'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.668+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad1c05a040 con 0x7fad2404a220 2024-05-08T18:50:46.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.668+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94490427570640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445ec360 con 0x7fad2404a220 2024-05-08T18:50:46.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.668+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445ece80 con 0x7fad2404a220 2024-05-08T18:50:46.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.671+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94490427570640] v25'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad1c05a040 con 0x7fad2404a220 2024-05-08T18:50:46.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.671+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad1c05a040 con 0x7fad2404a220 2024-05-08T18:50:46.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.671+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94490427574608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445ece40 con 0x7fad2404a220 2024-05-08T18:50:46.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.671+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445ed880 con 0x7fad2404a220 2024-05-08T18:50:46.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.674+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(58 notify.7 [create] v25'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad1c05a040 con 0x7fad2404a220 2024-05-08T18:50:46.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.674+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94490427574608] v25'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad1c05a040 con 0x7fad2404a220 2024-05-08T18:50:46.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.674+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94490427577168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445edcf0 con 0x7fad2404a220 2024-05-08T18:50:46.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.674+0000 7fad38e13800 20 add_watcher() i=0 2024-05-08T18:50:46.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.674+0000 7fad38e13800 20 add_watcher() i=1 2024-05-08T18:50:46.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.674+0000 7fad38e13800 20 add_watcher() i=2 2024-05-08T18:50:46.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.674+0000 7fad38e13800 20 add_watcher() i=3 2024-05-08T18:50:46.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.674+0000 7fad38e13800 20 add_watcher() i=4 2024-05-08T18:50:46.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.674+0000 7fad38e13800 20 add_watcher() i=5 2024-05-08T18:50:46.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.674+0000 7fad38e13800 20 add_watcher() i=6 2024-05-08T18:50:46.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.676+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94490427577168] v25'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad1c05a040 con 0x7fad2404a220 2024-05-08T18:50:46.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.676+0000 7fad38e13800 20 add_watcher() i=7 2024-05-08T18:50:46.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.676+0000 7fad38e13800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:46.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.676+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0445edcf0 con 0x55f0445dcbf0 2024-05-08T18:50:46.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.677+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.677+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94490427578432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445edc60 con 0x55f0445dcbf0 2024-05-08T18:50:46.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.678+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94490427578432] v25'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.678+0000 7fabea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:46.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.678+0000 7fad38e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:46.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.678+0000 7fad38e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:46.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.678+0000 7fad38e13800 5 note: GC not initialized 2024-05-08T18:50:46.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.678+0000 7fabe97e2640 20 reqs_thread_entry: start 2024-05-08T18:50:46.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.678+0000 7fad38e13800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:46.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.678+0000 7fad38e13800 20 Filter name: none 2024-05-08T18:50:46.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.678+0000 7fab5affd640 20 reqs_thread_entry: start 2024-05-08T18:50:46.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.678+0000 7fad38e13800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.679+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f044623bf0 con 0x55f0445dcbf0 2024-05-08T18:50:46.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.679+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.679+0000 7fad38e13800 20 rados_obj.operate() r=0 bl.length=556 2024-05-08T18:50:46.681 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:50:44.835566Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:44.835553Z","tags":[],"group_ids":[]} 2024-05-08T18:50:46.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.680+0000 7fabea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:46.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.680+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94490427578432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0446227c0 con 0x55f0445dcbf0 2024-05-08T18:50:46.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.681+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94490427578432] v25'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.681+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94490427552832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445ed840 con 0x7fad2c014070 2024-05-08T18:50:46.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.682+0000 7fad3441a640 1 -- 172.21.15.132:0/513088987 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94490427552832] v25'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2402e070 con 0x7fad2c014070 2024-05-08T18:50:46.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.682+0000 7fad38e13800 20 remove_watcher() i=0 2024-05-08T18:50:46.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.682+0000 7fad38e13800 2 removed watcher, disabling cache 2024-05-08T18:50:46.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.682+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94490427559536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e7440 con 0x55f0445dcbf0 2024-05-08T18:50:46.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.683+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94490427559536] v25'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.683+0000 7fad38e13800 20 remove_watcher() i=1 2024-05-08T18:50:46.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.683+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94490427557136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e7440 con 0x55f0445e12f0 2024-05-08T18:50:46.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.684+0000 7fad34c1b640 1 -- 172.21.15.132:0/513088987 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94490427557136] v25'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c06b040 con 0x55f0445e12f0 2024-05-08T18:50:46.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.684+0000 7fad38e13800 20 remove_watcher() i=2 2024-05-08T18:50:46.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.684+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94490427565904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e8510 con 0x7fad2c014070 2024-05-08T18:50:46.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.685+0000 7fad3441a640 1 -- 172.21.15.132:0/513088987 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94490427565904] v25'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2402e070 con 0x7fad2c014070 2024-05-08T18:50:46.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.685+0000 7fad38e13800 20 remove_watcher() i=3 2024-05-08T18:50:46.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.685+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94490427563568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e7440 con 0x55f0445dcbf0 2024-05-08T18:50:46.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.686+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94490427563568] v25'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad1c05a040 con 0x55f0445dcbf0 2024-05-08T18:50:46.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.686+0000 7fad38e13800 20 remove_watcher() i=4 2024-05-08T18:50:46.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.686+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94490427570640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445ea750 con 0x7fad2404a220 2024-05-08T18:50:46.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.687+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94490427570640] v25'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad1c05a040 con 0x7fad2404a220 2024-05-08T18:50:46.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.687+0000 7fad38e13800 20 remove_watcher() i=5 2024-05-08T18:50:46.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.687+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94490427574608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e9e30 con 0x7fad2404a220 2024-05-08T18:50:46.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.688+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94490427574608] v25'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad1c05a040 con 0x7fad2404a220 2024-05-08T18:50:46.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.688+0000 7fad38e13800 20 remove_watcher() i=6 2024-05-08T18:50:46.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.688+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94490427577168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0445e7440 con 0x7fad2404a220 2024-05-08T18:50:46.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94490427577168] v25'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad1c05a040 con 0x7fad2404a220 2024-05-08T18:50:46.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 20 remove_watcher() i=7 2024-05-08T18:50:46.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fad2404a220 msgr2=0x7fad24043820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 --2- 172.21.15.132:0/513088987 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fad2404a220 0x7fad24043820 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f0445dcbf0 msgr2=0x55f0445df0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 --2- 172.21.15.132:0/513088987 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f0445dcbf0 0x55f0445df0b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fad2c014070 msgr2=0x7fad2c04b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 --2- 172.21.15.132:0/513088987 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fad2c014070 0x7fad2c04b430 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f0445e12f0 msgr2=0x55f0445e3720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 --2- 172.21.15.132:0/513088987 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f0445e12f0 0x55f0445e3720 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac0403bba0 msgr2=0x7fac0403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 --2- 172.21.15.132:0/513088987 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac0403bba0 0x7fac0403e060 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fad2400c010 tx=0x7fad24047000 comp rx=0 tx=0).stop 2024-05-08T18:50:46.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0445c9970 msgr2=0x55f0445d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 --2- 172.21.15.132:0/513088987 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0445c9970 0x55f0445d0f60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fad2c051b70 tx=0x7fad2c052be0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad2bfff640 1 -- 172.21.15.132:0/513088987 reap_dead start 2024-05-08T18:50:46.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 shutdown_connections 2024-05-08T18:50:46.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 >> 172.21.15.132:0/513088987 conn(0x55f0445c5c40 msgr2=0x55f0445c32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 shutdown_connections 2024-05-08T18:50:46.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 -- 172.21.15.132:0/513088987 wait complete. 2024-05-08T18:50:46.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 -- 172.21.15.132:0/3560432658 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac0c03bba0 msgr2=0x7fac0c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 --2- 172.21.15.132:0/3560432658 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac0c03bba0 0x7fac0c03e060 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x55f0445a8d70 tx=0x7fad24045040 comp rx=0 tx=0).stop 2024-05-08T18:50:46.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 -- 172.21.15.132:0/3560432658 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0445bc660 msgr2=0x55f0445bca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 --2- 172.21.15.132:0/3560432658 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0445bc660 0x55f0445bca80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55f0445a8d00 tx=0x7fad2c018830 comp rx=0 tx=0).stop 2024-05-08T18:50:46.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 -- 172.21.15.132:0/3560432658 shutdown_connections 2024-05-08T18:50:46.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 --2- 172.21.15.132:0/3560432658 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac0c03bba0 0x7fac0c03e060 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 --2- 172.21.15.132:0/3560432658 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0445bc660 0x55f0445bca80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.689+0000 7fad38e13800 1 -- 172.21.15.132:0/3560432658 >> 172.21.15.132:0/3560432658 conn(0x55f0445b0700 msgr2=0x55f0445b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.690+0000 7fad38e13800 1 -- 172.21.15.132:0/3560432658 shutdown_connections 2024-05-08T18:50:46.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.690+0000 7fad38e13800 1 -- 172.21.15.132:0/3560432658 wait complete. 2024-05-08T18:50:46.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.690+0000 7fad38e13800 1 -- 172.21.15.132:0/1128874758 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f0444ab5d0 msgr2=0x55f0445a8380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.690+0000 7fad38e13800 1 --2- 172.21.15.132:0/1128874758 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f0444ab5d0 0x55f0445a8380 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.690+0000 7fad38e13800 1 -- 172.21.15.132:0/1128874758 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f0445aac50 msgr2=0x55f0445ad040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.690+0000 7fad38e13800 1 --2- 172.21.15.132:0/1128874758 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f0445aac50 0x55f0445ad040 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.690+0000 7fad38e13800 1 -- 172.21.15.132:0/1128874758 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac1c03bb50 msgr2=0x7fac1c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.690+0000 7fad38e13800 1 --2- 172.21.15.132:0/1128874758 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac1c03bb50 0x7fac1c03e010 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fad1c054000 tx=0x7fad1c04e000 comp rx=0 tx=0).stop 2024-05-08T18:50:46.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.690+0000 7fad38e13800 1 -- 172.21.15.132:0/1128874758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0444a7140 msgr2=0x55f04441b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.690+0000 7fad38e13800 1 --2- 172.21.15.132:0/1128874758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0444a7140 0x55f04441b300 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fad2400b5f0 tx=0x7fad24000ed0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.690+0000 7fad38e13800 1 -- 172.21.15.132:0/1128874758 shutdown_connections 2024-05-08T18:50:46.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.690+0000 7fad38e13800 1 --2- 172.21.15.132:0/1128874758 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f0445aac50 0x55f0445ad040 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.690+0000 7fad38e13800 1 --2- 172.21.15.132:0/1128874758 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f0444ab5d0 0x55f0445a8380 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.690+0000 7fad38e13800 1 --2- 172.21.15.132:0/1128874758 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac1c03bb50 0x7fac1c03e010 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.690+0000 7fad38e13800 1 --2- 172.21.15.132:0/1128874758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0444a7140 0x55f04441b300 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.690+0000 7fad38e13800 1 -- 172.21.15.132:0/1128874758 >> 172.21.15.132:0/1128874758 conn(0x55f0444a2720 msgr2=0x55f044592660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.690+0000 7fad38e13800 1 -- 172.21.15.132:0/1128874758 shutdown_connections 2024-05-08T18:50:46.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.690+0000 7fad38e13800 1 -- 172.21.15.132:0/1128874758 wait complete. 2024-05-08T18:50:46.698 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:50:44.835566Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:44.835553Z', 'tags': [], 'group_ids': []} 2024-05-08T18:50:46.698 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-05-08T18:50:46.699 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-05-08T18:50:46.699 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-05-08T18:50:46.746 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:46.747 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:46.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.748+0000 7f83fdb28800 1 Processor -- start 2024-05-08T18:50:46.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.748+0000 7f83fdb28800 1 -- start start 2024-05-08T18:50:46.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.748+0000 7f83fdb28800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55c36680d7f0 0x55c36680dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.748+0000 7f83fdb28800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c366816300 con 0x55c36680e150 2024-05-08T18:50:46.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.748+0000 7f83fdb28800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55c3666ade20 con 0x55c36680d7f0 2024-05-08T18:50:46.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.749+0000 7f83f9821640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55c36680d7f0 0x55c36680dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.749+0000 7f83f9821640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55c36680d7f0 0x55c36680dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60468/0 (socket says 172.21.15.132:60468) 2024-05-08T18:50:46.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.749+0000 7f83f9821640 1 -- 172.21.15.132:0/1580979674 learned_addr learned my addr 172.21.15.132:0/1580979674 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.749+0000 7f83f9821640 1 -- 172.21.15.132:0/1580979674 >> v1:172.21.15.42:6789/0 conn(0x55c36680e150 legacy=0x55c366814aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.749+0000 7f83f9821640 1 -- 172.21.15.132:0/1580979674 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c366817530 con 0x55c36680d7f0 2024-05-08T18:50:46.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.751+0000 7f83f9821640 1 --2- 172.21.15.132:0/1580979674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c36680d7f0 0x55c36680dc10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f83ec005fd0 tx=0x7f83ec01cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cfd620c2a6b2cea server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.751+0000 7f83f881f640 1 -- 172.21.15.132:0/1580979674 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ec052540 con 0x55c36680d7f0 2024-05-08T18:50:46.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.751+0000 7f83f881f640 1 -- 172.21.15.132:0/1580979674 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ec04e070 con 0x55c36680d7f0 2024-05-08T18:50:46.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.751+0000 7f83f881f640 1 -- 172.21.15.132:0/1580979674 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ec052890 con 0x55c36680d7f0 2024-05-08T18:50:46.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.751+0000 7f83fdb28800 1 -- 172.21.15.132:0/1580979674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c36680d7f0 msgr2=0x55c36680dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.751+0000 7f83fdb28800 1 --2- 172.21.15.132:0/1580979674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c36680d7f0 0x55c36680dc10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f83ec005fd0 tx=0x7f83ec01cd80 comp rx=0 tx=0).stop 2024-05-08T18:50:46.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.751+0000 7f83fdb28800 1 -- 172.21.15.132:0/1580979674 shutdown_connections 2024-05-08T18:50:46.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.751+0000 7f83fdb28800 1 --2- 172.21.15.132:0/1580979674 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c36680d7f0 0x55c36680dc10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.751+0000 7f83fdb28800 1 -- 172.21.15.132:0/1580979674 >> 172.21.15.132:0/1580979674 conn(0x55c366806ec0 msgr2=0x55c3668092e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.751+0000 7f83fdb28800 1 -- 172.21.15.132:0/1580979674 shutdown_connections 2024-05-08T18:50:46.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.751+0000 7f83fdb28800 1 -- 172.21.15.132:0/1580979674 wait complete. 2024-05-08T18:50:46.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.765+0000 7f83fdb28800 1 Processor -- start 2024-05-08T18:50:46.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.765+0000 7f83fdb28800 1 -- start start 2024-05-08T18:50:46.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.766+0000 7f83fdb28800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c36680d7f0 0x55c366900890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.766+0000 7f83fdb28800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c3667585d0 con 0x55c36680d7f0 2024-05-08T18:50:46.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.766+0000 7f83f9821640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c36680d7f0 0x55c366900890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.766+0000 7f83f9821640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c36680d7f0 0x55c366900890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60478/0 (socket says 172.21.15.132:60478) 2024-05-08T18:50:46.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.766+0000 7f83f9821640 1 -- 172.21.15.132:0/908249568 learned_addr learned my addr 172.21.15.132:0/908249568 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.766+0000 7f83f9821640 1 -- 172.21.15.132:0/908249568 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c366900e60 con 0x55c36680d7f0 2024-05-08T18:50:46.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.766+0000 7f83f9821640 1 --2- 172.21.15.132:0/908249568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c36680d7f0 0x55c366900890 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f83ec01ba70 tx=0x7f83ec04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9b826042ab81d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.767+0000 7f82e7e07640 1 -- 172.21.15.132:0/908249568 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ec052820 con 0x55c36680d7f0 2024-05-08T18:50:46.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.767+0000 7f82e7e07640 1 -- 172.21.15.132:0/908249568 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ec062070 con 0x55c36680d7f0 2024-05-08T18:50:46.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.767+0000 7f82e7e07640 1 -- 172.21.15.132:0/908249568 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ec052b10 con 0x55c36680d7f0 2024-05-08T18:50:46.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.767+0000 7f83fdb28800 1 -- 172.21.15.132:0/908249568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c36680d7f0 msgr2=0x55c366900890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.767+0000 7f83fdb28800 1 --2- 172.21.15.132:0/908249568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c36680d7f0 0x55c366900890 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f83ec01ba70 tx=0x7f83ec04c000 comp rx=0 tx=0).stop 2024-05-08T18:50:46.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.767+0000 7f83fdb28800 1 -- 172.21.15.132:0/908249568 shutdown_connections 2024-05-08T18:50:46.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.767+0000 7f83fdb28800 1 --2- 172.21.15.132:0/908249568 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c36680d7f0 0x55c366900890 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.767+0000 7f83fdb28800 1 -- 172.21.15.132:0/908249568 >> 172.21.15.132:0/908249568 conn(0x55c366806ec0 msgr2=0x55c3668fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.767+0000 7f83fdb28800 1 -- 172.21.15.132:0/908249568 shutdown_connections 2024-05-08T18:50:46.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.767+0000 7f83fdb28800 1 -- 172.21.15.132:0/908249568 wait complete. 2024-05-08T18:50:46.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.768+0000 7f83fdb28800 1 Processor -- start 2024-05-08T18:50:46.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.768+0000 7f83fdb28800 1 -- start start 2024-05-08T18:50:46.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.768+0000 7f83fdb28800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c36680d7f0 0x55c3669082e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.768+0000 7f83fdb28800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c366816770 con 0x55c36680d7f0 2024-05-08T18:50:46.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.768+0000 7f83f9821640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c36680d7f0 0x55c3669082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.768+0000 7f83f9821640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c36680d7f0 0x55c3669082e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60482/0 (socket says 172.21.15.132:60482) 2024-05-08T18:50:46.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.768+0000 7f83f9821640 1 -- 172.21.15.132:0/1517271115 learned_addr learned my addr 172.21.15.132:0/1517271115 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.768+0000 7f83f9821640 1 -- 172.21.15.132:0/1517271115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c366908820 con 0x55c36680d7f0 2024-05-08T18:50:46.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.769+0000 7f83f9821640 1 --2- 172.21.15.132:0/1517271115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c36680d7f0 0x55c3669082e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f83ec00a190 tx=0x7f83ec003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.769+0000 7f82e6604640 1 -- 172.21.15.132:0/1517271115 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ec071570 con 0x55c36680d7f0 2024-05-08T18:50:46.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.769+0000 7f82e6604640 1 -- 172.21.15.132:0/1517271115 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ec058040 con 0x55c36680d7f0 2024-05-08T18:50:46.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.769+0000 7f83fdb28800 1 -- 172.21.15.132:0/1517271115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c366908ab0 con 0x55c36680d7f0 2024-05-08T18:50:46.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.769+0000 7f82e6604640 1 -- 172.21.15.132:0/1517271115 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ec071840 con 0x55c36680d7f0 2024-05-08T18:50:46.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.769+0000 7f83fdb28800 1 -- 172.21.15.132:0/1517271115 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c36690b760 con 0x55c36680d7f0 2024-05-08T18:50:46.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.770+0000 7f82e6604640 1 -- 172.21.15.132:0/1517271115 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f83ec050070 con 0x55c36680d7f0 2024-05-08T18:50:46.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.770+0000 7f82e6604640 1 --2- 172.21.15.132:0/1517271115 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f82e003bb50 0x7f82e003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.770+0000 7f82e6604640 1 -- 172.21.15.132:0/1517271115 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f83ec0948d0 con 0x55c36680d7f0 2024-05-08T18:50:46.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.770+0000 7f83f9020640 1 --2- 172.21.15.132:0/1517271115 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f82e003bb50 0x7f82e003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.770+0000 7f83fdb28800 1 --2- 172.21.15.132:0/1517271115 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c36680e150 0x55c36690f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.770+0000 7f83fdb28800 1 -- 172.21.15.132:0/1517271115 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c36690faa0 con 0x55c36680e150 2024-05-08T18:50:46.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.770+0000 7f83fa022640 1 --2- 172.21.15.132:0/1517271115 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c36680e150 0x55c36690f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.770+0000 7f83f9020640 1 --2- 172.21.15.132:0/1517271115 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f82e003bb50 0x7f82e003e010 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f83f0001e10 tx=0x7f83f0001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.770+0000 7f83fa022640 1 --2- 172.21.15.132:0/1517271115 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c36680e150 0x55c36690f520 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.771+0000 7f83fa022640 1 -- 172.21.15.132:0/1517271115 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83f40083e0 con 0x55c36680e150 2024-05-08T18:50:46.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.771+0000 7f83fdb28800 1 -- 172.21.15.132:0/1517271115 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c36690caf0 con 0x55c36680e150 2024-05-08T18:50:46.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.771+0000 7f83fa022640 1 -- 172.21.15.132:0/1517271115 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83f40083e0 con 0x55c36680e150 2024-05-08T18:50:46.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.771+0000 7f83fdb28800 1 --2- 172.21.15.132:0/1517271115 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c366911e40 0x55c366914230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.771+0000 7f83fdb28800 1 -- 172.21.15.132:0/1517271115 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c366914920 con 0x55c366911e40 2024-05-08T18:50:46.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.771+0000 7f83f9821640 1 --2- 172.21.15.132:0/1517271115 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c366911e40 0x55c366914230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.771+0000 7f83f9821640 1 --2- 172.21.15.132:0/1517271115 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c366911e40 0x55c366914230 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.772+0000 7f83f9821640 1 -- 172.21.15.132:0/1517271115 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f83ec077020 con 0x55c366911e40 2024-05-08T18:50:46.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.772+0000 7f83fdb28800 1 -- 172.21.15.132:0/1517271115 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c366910ce0 con 0x55c36680e150 2024-05-08T18:50:46.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.772+0000 7f83fa022640 1 -- 172.21.15.132:0/1517271115 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83f40083e0 con 0x55c36680e150 2024-05-08T18:50:46.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.772+0000 7f83fdb28800 1 -- 172.21.15.132:0/1517271115 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c366911180 con 0x55c36680e150 2024-05-08T18:50:46.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.772+0000 7f83fa022640 1 -- 172.21.15.132:0/1517271115 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f83f40083e0 con 0x55c36680e150 2024-05-08T18:50:46.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.773+0000 7f83fdb28800 1 Processor -- start 2024-05-08T18:50:46.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.773+0000 7f83fdb28800 1 -- start start 2024-05-08T18:50:46.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.773+0000 7f83fdb28800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c3669238b0 0x55c366923cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.773+0000 7f83fdb28800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c3666fefc0 con 0x55c3669238b0 2024-05-08T18:50:46.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.773+0000 7f83fa022640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c3669238b0 0x55c366923cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.773+0000 7f83fa022640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c3669238b0 0x55c366923cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60486/0 (socket says 172.21.15.132:60486) 2024-05-08T18:50:46.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.773+0000 7f83fa022640 1 -- 172.21.15.132:0/2519342740 learned_addr learned my addr 172.21.15.132:0/2519342740 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.773+0000 7f83fa022640 1 -- 172.21.15.132:0/2519342740 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c366924210 con 0x55c3669238b0 2024-05-08T18:50:46.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.773+0000 7f83fa022640 1 --2- 172.21.15.132:0/2519342740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c3669238b0 0x55c366923cd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55c3669091b0 tx=0x7f83f400aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.774+0000 7f82df7fe640 1 -- 172.21.15.132:0/2519342740 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83f4007d00 con 0x55c3669238b0 2024-05-08T18:50:46.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.774+0000 7f82df7fe640 1 -- 172.21.15.132:0/2519342740 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f401e020 con 0x55c3669238b0 2024-05-08T18:50:46.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.774+0000 7f82df7fe640 1 -- 172.21.15.132:0/2519342740 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83f4019420 con 0x55c3669238b0 2024-05-08T18:50:46.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.774+0000 7f83fdb28800 1 -- 172.21.15.132:0/2519342740 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c366924c80 con 0x55c3669238b0 2024-05-08T18:50:46.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.774+0000 7f83fdb28800 1 -- 172.21.15.132:0/2519342740 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c366925180 con 0x55c3669238b0 2024-05-08T18:50:46.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.774+0000 7f82df7fe640 1 -- 172.21.15.132:0/2519342740 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f83f4016040 con 0x55c3669238b0 2024-05-08T18:50:46.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.775+0000 7f82df7fe640 1 --2- 172.21.15.132:0/2519342740 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f82d403bba0 0x7f82d403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.775+0000 7f82df7fe640 1 -- 172.21.15.132:0/2519342740 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f83f401f030 con 0x55c3669238b0 2024-05-08T18:50:46.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.775+0000 7f83f9821640 1 --2- 172.21.15.132:0/2519342740 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f82d403bba0 0x7f82d403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.775+0000 7f83fdb28800 1 Processor -- start 2024-05-08T18:50:46.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.775+0000 7f83fdb28800 1 -- start start 2024-05-08T18:50:46.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.775+0000 7f83f9821640 1 --2- 172.21.15.132:0/2519342740 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f82d403bba0 0x7f82d403e060 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55c36690ff90 tx=0x7f83ec065380 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.775+0000 7f83fdb28800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c366930be0 0x55c366931000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.775+0000 7f83fdb28800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c366901120 con 0x55c366930be0 2024-05-08T18:50:46.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.775+0000 7f83fa022640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c366930be0 0x55c366931000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.775+0000 7f83fa022640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c366930be0 0x55c366931000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60490/0 (socket says 172.21.15.132:60490) 2024-05-08T18:50:46.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.775+0000 7f83fa022640 1 -- 172.21.15.132:0/3147694089 learned_addr learned my addr 172.21.15.132:0/3147694089 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.776+0000 7f83fa022640 1 -- 172.21.15.132:0/3147694089 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3669315d0 con 0x55c366930be0 2024-05-08T18:50:46.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.776+0000 7f83fa022640 1 --2- 172.21.15.132:0/3147694089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c366930be0 0x55c366931000 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f83f4052bb0 tx=0x7f83f4017b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4996822d4a51b9f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.776+0000 7f82dd7fa640 1 -- 172.21.15.132:0/3147694089 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83f401d030 con 0x55c366930be0 2024-05-08T18:50:46.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.776+0000 7f82dd7fa640 1 -- 172.21.15.132:0/3147694089 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f4015e50 con 0x55c366930be0 2024-05-08T18:50:46.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.776+0000 7f82dd7fa640 1 -- 172.21.15.132:0/3147694089 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83f40173b0 con 0x55c366930be0 2024-05-08T18:50:46.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.776+0000 7f83fdb28800 1 -- 172.21.15.132:0/3147694089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c366930be0 msgr2=0x55c366931000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.776+0000 7f83fdb28800 1 --2- 172.21.15.132:0/3147694089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c366930be0 0x55c366931000 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f83f4052bb0 tx=0x7f83f4017b10 comp rx=0 tx=0).stop 2024-05-08T18:50:46.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.776+0000 7f83fdb28800 1 -- 172.21.15.132:0/3147694089 shutdown_connections 2024-05-08T18:50:46.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.776+0000 7f83fdb28800 1 --2- 172.21.15.132:0/3147694089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c366930be0 0x55c366931000 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.776+0000 7f83fdb28800 1 -- 172.21.15.132:0/3147694089 >> 172.21.15.132:0/3147694089 conn(0x55c36692cef0 msgr2=0x55c36692af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.776+0000 7f83fdb28800 1 -- 172.21.15.132:0/3147694089 shutdown_connections 2024-05-08T18:50:46.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.776+0000 7f83fdb28800 1 -- 172.21.15.132:0/3147694089 wait complete. 2024-05-08T18:50:46.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.777+0000 7f83fdb28800 1 Processor -- start 2024-05-08T18:50:46.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.777+0000 7f83fdb28800 1 -- start start 2024-05-08T18:50:46.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.777+0000 7f83fdb28800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c366930be0 0x55c3669381c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.777+0000 7f83fdb28800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c366931d20 con 0x55c366930be0 2024-05-08T18:50:46.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.777+0000 7f83fa022640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c366930be0 0x55c3669381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.777+0000 7f83fa022640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c366930be0 0x55c3669381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60504/0 (socket says 172.21.15.132:60504) 2024-05-08T18:50:46.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.777+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 learned_addr learned my addr 172.21.15.132:0/895163539 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.777+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c366938700 con 0x55c366930be0 2024-05-08T18:50:46.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.778+0000 7f83fa022640 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c366930be0 0x55c3669381c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f83f4022560 tx=0x7f83f4052b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.778+0000 7f82cb7fe640 1 -- 172.21.15.132:0/895163539 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83f4032070 con 0x55c366930be0 2024-05-08T18:50:46.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.778+0000 7f82cb7fe640 1 -- 172.21.15.132:0/895163539 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f4045070 con 0x55c366930be0 2024-05-08T18:50:46.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.778+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c366938990 con 0x55c366930be0 2024-05-08T18:50:46.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.778+0000 7f82cb7fe640 1 -- 172.21.15.132:0/895163539 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83f4016540 con 0x55c366930be0 2024-05-08T18:50:46.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.778+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c36693b640 con 0x55c366930be0 2024-05-08T18:50:46.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.779+0000 7f82cb7fe640 1 -- 172.21.15.132:0/895163539 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f83f404f070 con 0x55c366930be0 2024-05-08T18:50:46.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.779+0000 7f82cb7fe640 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f82c403bba0 0x7f82c403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.779+0000 7f82cb7fe640 1 -- 172.21.15.132:0/895163539 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f83f402e000 con 0x55c366930be0 2024-05-08T18:50:46.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.779+0000 7f83f9821640 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f82c403bba0 0x7f82c403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.779+0000 7f83f9821640 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f82c403bba0 0x7f82c403e060 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f83ec093110 tx=0x7f83ec08c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.780+0000 7f83fdb28800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.780+0000 7f83fdb28800 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c366943cc0 0x55c366946180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.780+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c3669468d0 con 0x55c366943cc0 2024-05-08T18:50:46.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.780+0000 7f83f9020640 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c366943cc0 0x55c366946180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.780+0000 7f83f9020640 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c366943cc0 0x55c366946180 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.780+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83f000bdb0 con 0x55c366943cc0 2024-05-08T18:50:46.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.780+0000 7f83fdb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.780+0000 7f83fdb28800 20 realm 2024-05-08T18:50:46.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.780+0000 7f83fdb28800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.780+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c366943110 con 0x55c366943cc0 2024-05-08T18:50:46.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.780+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83f000bdb0 con 0x55c366943cc0 2024-05-08T18:50:46.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.780+0000 7f83fdb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.780+0000 7f83fdb28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:46.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.781+0000 7f83fdb28800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.781+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c3669473c0 con 0x55c366943cc0 2024-05-08T18:50:46.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.781+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83f000bdb0 con 0x55c366943cc0 2024-05-08T18:50:46.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.781+0000 7f83fdb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.781+0000 7f83fdb28800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.781+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c366947c90 con 0x55c366943cc0 2024-05-08T18:50:46.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.781+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83f000bdb0 con 0x55c366943cc0 2024-05-08T18:50:46.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.781+0000 7f83fdb28800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:46.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.781+0000 7f83fdb28800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.781+0000 7f83fdb28800 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c3669485d0 0x55c36694aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.781+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c36694b190 con 0x55c3669485d0 2024-05-08T18:50:46.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.781+0000 7f83fa022640 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c3669485d0 0x55c36694aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.781+0000 7f83fa022640 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c3669485d0 0x55c36694aa00 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.782+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f83f40083e0 con 0x55c3669485d0 2024-05-08T18:50:46.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.782+0000 7f83fdb28800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:46.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.782+0000 7f83fdb28800 20 searching for the correct realm 2024-05-08T18:50:46.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.782+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x55c3669485d0 2024-05-08T18:50:46.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.782+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f40083e0 con 0x55c3669485d0 2024-05-08T18:50:46.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.782+0000 7f83fa022640 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f83f4019040 0x7f83f402c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.782+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x7f83f4019040 2024-05-08T18:50:46.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.782+0000 7f83f9821640 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f83f4019040 0x7f83f402c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.782+0000 7f83f9821640 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f83f4019040 0x7f83f402c3f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.783+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83ec077020 con 0x7f83f4019040 2024-05-08T18:50:46.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.783+0000 7f83f9821640 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f83ec052030 0x7f83ec0941d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.783+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x7f83ec052030 2024-05-08T18:50:46.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.783+0000 7f83f9020640 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f83ec052030 0x7f83ec0941d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.783+0000 7f83f9020640 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f83ec052030 0x7f83ec0941d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.783+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f000bdb0 con 0x7f83ec052030 2024-05-08T18:50:46.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.783+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x55c366943cc0 2024-05-08T18:50:46.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.784+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f000bdb0 con 0x55c366943cc0 2024-05-08T18:50:46.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.784+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x55c366943cc0 2024-05-08T18:50:46.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.784+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.784+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x7f83ec052030 2024-05-08T18:50:46.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.784+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f002a040 con 0x7f83ec052030 2024-05-08T18:50:46.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.784+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x7f83ec052030 2024-05-08T18:50:46.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.784+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f002a040 con 0x7f83ec052030 2024-05-08T18:50:46.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.784+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x7f83f4019040 2024-05-08T18:50:46.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.785+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83ec077020 con 0x7f83f4019040 2024-05-08T18:50:46.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.785+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x55c3669485d0 2024-05-08T18:50:46.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.785+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f40083e0 con 0x55c3669485d0 2024-05-08T18:50:46.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.785+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x55c366943cc0 2024-05-08T18:50:46.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.785+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.785+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x7f83ec052030 2024-05-08T18:50:46.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.786+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f002a040 con 0x7f83ec052030 2024-05-08T18:50:46.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.786+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x55c366943cc0 2024-05-08T18:50:46.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.786+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.786+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x7f83f4019040 2024-05-08T18:50:46.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.786+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f83ec077020 con 0x7f83f4019040 2024-05-08T18:50:46.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.786+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x55c3669485d0 2024-05-08T18:50:46.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.786+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f83f40083e0 con 0x55c3669485d0 2024-05-08T18:50:46.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.786+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x55c3669485d0 2024-05-08T18:50:46.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.787+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f40083e0 con 0x55c3669485d0 2024-05-08T18:50:46.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.787+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x7f83ec052030 2024-05-08T18:50:46.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.787+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f002a040 con 0x7f83ec052030 2024-05-08T18:50:46.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.787+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x55c3669485d0 2024-05-08T18:50:46.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.787+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f40083e0 con 0x55c3669485d0 2024-05-08T18:50:46.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.787+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x55c3669485d0 2024-05-08T18:50:46.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.787+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f40083e0 con 0x55c3669485d0 2024-05-08T18:50:46.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.787+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x55c366943cc0 2024-05-08T18:50:46.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.788+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.788+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x55c366943cc0 2024-05-08T18:50:46.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.788+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.788+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x7f83ec052030 2024-05-08T18:50:46.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.788+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f002a040 con 0x7f83ec052030 2024-05-08T18:50:46.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.788+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x55c3669485d0 2024-05-08T18:50:46.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.789+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f40083e0 con 0x55c3669485d0 2024-05-08T18:50:46.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.789+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x7f83f4019040 2024-05-08T18:50:46.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.789+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83ec077020 con 0x7f83f4019040 2024-05-08T18:50:46.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.789+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x55c366943cc0 2024-05-08T18:50:46.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.789+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.789+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x7f83ec052030 2024-05-08T18:50:46.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.789+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f002a040 con 0x7f83ec052030 2024-05-08T18:50:46.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.789+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x55c3669485d0 2024-05-08T18:50:46.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.790+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f40083e0 con 0x55c3669485d0 2024-05-08T18:50:46.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.790+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x7f83ec052030 2024-05-08T18:50:46.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.790+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f002a040 con 0x7f83ec052030 2024-05-08T18:50:46.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.790+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x7f83f4019040 2024-05-08T18:50:46.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.790+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83ec077020 con 0x7f83f4019040 2024-05-08T18:50:46.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.790+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x55c3669485d0 2024-05-08T18:50:46.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.790+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f40083e0 con 0x55c3669485d0 2024-05-08T18:50:46.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.790+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x7f83ec052030 2024-05-08T18:50:46.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.791+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83f002a040 con 0x7f83ec052030 2024-05-08T18:50:46.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.791+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x55c366943cc0 2024-05-08T18:50:46.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.791+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.791+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cac0 con 0x7f83f4019040 2024-05-08T18:50:46.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.791+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83ec077020 con 0x7f83f4019040 2024-05-08T18:50:46.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.791+0000 7f83fdb28800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:46.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.791+0000 7f83fdb28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:46.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.791+0000 7f83fdb28800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:46.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.791+0000 7f83fdb28800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:46.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.791+0000 7f83fdb28800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:46.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.791+0000 7f83fdb28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:46.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.791+0000 7f83fdb28800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.791+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c36694bb80 con 0x55c366943cc0 2024-05-08T18:50:46.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.791+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.791+0000 7f83fdb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.791+0000 7f83fdb28800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.791+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c36694c420 con 0x55c366943cc0 2024-05-08T18:50:46.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.792+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.792+0000 7f83fdb28800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:46.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.792+0000 7f83fdb28800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.792+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cf40 con 0x55c366943cc0 2024-05-08T18:50:46.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.792+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.792+0000 7f83fdb28800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:46.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.792+0000 7f83fdb28800 20 zone default found 2024-05-08T18:50:46.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.792+0000 7f83fdb28800 4 Realm: () 2024-05-08T18:50:46.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.792+0000 7f83fdb28800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:46.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.792+0000 7f83fdb28800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:46.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.792+0000 7f83fdb28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:46.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.792+0000 7f83fdb28800 20 zonegroup default 2024-05-08T18:50:46.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.792+0000 7f83fdb28800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.792+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c36694cfb0 con 0x7f83ec052030 2024-05-08T18:50:46.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.792+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f83f002a040 con 0x7f83ec052030 2024-05-08T18:50:46.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.792+0000 7f83fdb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.792+0000 7f83fdb28800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.792+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c36694edd0 con 0x55c3669485d0 2024-05-08T18:50:46.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.792+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83f40083e0 con 0x55c3669485d0 2024-05-08T18:50:46.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.793+0000 7f83fdb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.793+0000 7f83fdb28800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.793+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c36694f1f0 con 0x55c3669485d0 2024-05-08T18:50:46.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.793+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83f40083e0 con 0x55c3669485d0 2024-05-08T18:50:46.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.793+0000 7f83fdb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.793+0000 7f83fdb28800 20 started sync module instance, tier type = 2024-05-08T18:50:46.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.793+0000 7f83fdb28800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:46.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.793+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c36694e270 con 0x7f83f4019040 2024-05-08T18:50:46.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.794+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83ec077020 con 0x7f83f4019040 2024-05-08T18:50:46.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.794+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94297728015808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c36694f650 con 0x7f83f4019040 2024-05-08T18:50:46.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.794+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c36694fea0 con 0x55c366943cc0 2024-05-08T18:50:46.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.795+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94297728015808] v25'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83ec077020 con 0x7f83f4019040 2024-05-08T18:50:46.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.795+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.795+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94297728018064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c36694ffa0 con 0x55c366943cc0 2024-05-08T18:50:46.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.795+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c366950a90 con 0x55c3669485d0 2024-05-08T18:50:46.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.796+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f40083e0 con 0x55c3669485d0 2024-05-08T18:50:46.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.796+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94297728018064] v25'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.796+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94297728025952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c366950a90 con 0x55c3669485d0 2024-05-08T18:50:46.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.796+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c36694fa50 con 0x7f83f4019040 2024-05-08T18:50:46.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.797+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83ec077020 con 0x7f83f4019040 2024-05-08T18:50:46.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.797+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94297728025952] v25'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f40083e0 con 0x55c3669485d0 2024-05-08T18:50:46.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.797+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94297728030080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c366951e50 con 0x7f83f4019040 2024-05-08T18:50:46.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.797+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c366950ea0 con 0x55c366943cc0 2024-05-08T18:50:46.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.798+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.798+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94297728033680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c366952c60 con 0x55c366943cc0 2024-05-08T18:50:46.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.798+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c366953680 con 0x7f83ec052030 2024-05-08T18:50:46.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.798+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94297728030080] v25'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83ec077020 con 0x7f83f4019040 2024-05-08T18:50:46.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.799+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f002a040 con 0x7f83ec052030 2024-05-08T18:50:46.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.799+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94297728037232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c366953640 con 0x7f83ec052030 2024-05-08T18:50:46.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.799+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c3669540c0 con 0x7f83ec052030 2024-05-08T18:50:46.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.799+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94297728033680] v25'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.800+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94297728037232] v25'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f002a040 con 0x7f83ec052030 2024-05-08T18:50:46.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.800+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f002a040 con 0x7f83ec052030 2024-05-08T18:50:46.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.800+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94297728031136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c366953c10 con 0x7f83ec052030 2024-05-08T18:50:46.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.800+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c3669545d0 con 0x7f83ec052030 2024-05-08T18:50:46.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.801+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94297728031136] v25'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f002a040 con 0x7f83ec052030 2024-05-08T18:50:46.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.802+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f002a040 con 0x7f83ec052030 2024-05-08T18:50:46.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.802+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94297728034736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c3669545d0 con 0x7f83ec052030 2024-05-08T18:50:46.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.802+0000 7f83fdb28800 20 add_watcher() i=0 2024-05-08T18:50:46.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.802+0000 7f83fdb28800 20 add_watcher() i=1 2024-05-08T18:50:46.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.802+0000 7f83fdb28800 20 add_watcher() i=2 2024-05-08T18:50:46.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.802+0000 7f83fdb28800 20 add_watcher() i=3 2024-05-08T18:50:46.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.802+0000 7f83fdb28800 20 add_watcher() i=4 2024-05-08T18:50:46.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.802+0000 7f83fdb28800 20 add_watcher() i=5 2024-05-08T18:50:46.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.802+0000 7f83fdb28800 20 add_watcher() i=6 2024-05-08T18:50:46.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.802+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94297728034736] v25'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f002a040 con 0x7f83ec052030 2024-05-08T18:50:46.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.802+0000 7f83fdb28800 20 add_watcher() i=7 2024-05-08T18:50:46.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.802+0000 7f83fdb28800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:46.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.802+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c366957910 con 0x55c366943cc0 2024-05-08T18:50:46.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.803+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.803+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94297728041616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c366954b60 con 0x55c366943cc0 2024-05-08T18:50:46.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.804+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94297728041616] v25'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.804+0000 7f82a37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:46.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.804+0000 7f83fdb28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:46.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.804+0000 7f83fdb28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:46.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.804+0000 7f83fdb28800 5 note: GC not initialized 2024-05-08T18:50:46.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.804+0000 7f82a27fc640 20 reqs_thread_entry: start 2024-05-08T18:50:46.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.804+0000 7f83fdb28800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:46.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.804+0000 7f83fdb28800 20 Filter name: none 2024-05-08T18:50:46.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.804+0000 7f821bfff640 20 reqs_thread_entry: start 2024-05-08T18:50:46.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.804+0000 7f83fdb28800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:50:46.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.805+0000 7f83fdb28800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.805+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c36698aed0 con 0x55c366943cc0 2024-05-08T18:50:46.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.805+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.805+0000 7f83fdb28800 20 rados_obj.operate() r=0 bl.length=556 2024-05-08T18:50:46.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.805+0000 7f83fdb28800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:50:46.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.805+0000 7f83fdb28800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:46.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.805+0000 7f83fdb28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:46.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.805+0000 7f83fdb28800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-05-08T18:50:46.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.805+0000 7f83fdb28800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.805+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c36698bae0 con 0x7f83f4019040 2024-05-08T18:50:46.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.805+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f83ec077020 con 0x7f83f4019040 2024-05-08T18:50:46.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.805+0000 7f83fdb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.805+0000 7f83fdb28800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-05-08T18:50:46.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.805+0000 7f83fdb28800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-05-08T18:50:46.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.805+0000 7f83fdb28800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-05-08T18:50:46.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.805+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c366991cf0 con 0x55c366943cc0 2024-05-08T18:50:46.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.806+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v25'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.806+0000 7f83fdb28800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:46.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.806+0000 7f83fdb28800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:46.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.806+0000 7f83fdb28800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:50:46.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.806+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94297728292528 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c366990790 con 0x55c366943cc0 2024-05-08T18:50:46.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.806+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== watch-notify(notify (1) cookie 94297728033680 notify 107374182407 ret 0) ==== 891+0+0 (crc 0 0 0) 0x55c366816300 con 0x55c366943cc0 2024-05-08T18:50:46.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.807+0000 7f82dd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182407 cookie 94297728033680 notifier 4382 bl.length()=849 2024-05-08T18:50:46.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.807+0000 7f82dd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:46.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.807+0000 7f82dd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:46.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.807+0000 7f82dd7fa640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f82bc003ea0 con 0x55c366943cc0 2024-05-08T18:50:46.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.807+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(65 notify.4 [notify cookie 94297728292528 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.807+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.807+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== watch-notify(notify_complete (2) cookie 94297728292528 notify 107374182407 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f83f001dca0 con 0x55c366943cc0 2024-05-08T18:50:46.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.807+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c3669916b0 con 0x7f83f4019040 2024-05-08T18:50:46.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.808+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v25'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f83ec077020 con 0x7f83f4019040 2024-05-08T18:50:46.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.808+0000 7f83fdb28800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-05-08T18:50:46.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.808+0000 7f83fdb28800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-05-08T18:50:46.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.808+0000 7f83fdb28800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-05-08T18:50:46.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.809+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94297728292528 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c36698d3c0 con 0x7f83f4019040 2024-05-08T18:50:46.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.809+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== watch-notify(notify (1) cookie 94297728015808 notify 107374182403 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f83ec0a7040 con 0x7f83f4019040 2024-05-08T18:50:46.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.809+0000 7f82dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182403 cookie 94297728015808 notifier 4382 bl.length()=166 2024-05-08T18:50:46.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.809+0000 7f82dcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-05-08T18:50:46.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.809+0000 7f82dcff9640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-05-08T18:50:46.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.809+0000 7f82dcff9640 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f8224003400 con 0x7f83f4019040 2024-05-08T18:50:46.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.809+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(68 notify.0 [notify cookie 94297728292528 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f83ec077020 con 0x7f83f4019040 2024-05-08T18:50:46.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.809+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83ec077020 con 0x7f83f4019040 2024-05-08T18:50:46.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.809+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== watch-notify(notify_complete (2) cookie 94297728292528 notify 107374182403 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c36690b760 con 0x7f83f4019040 2024-05-08T18:50:46.829 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:50:44.835566Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-08T18:50:46.806723Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:44.835553Z","tags":[],"group_ids":[]} 2024-05-08T18:50:46.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.810+0000 7f82a37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:46.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.810+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94297728041616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c366956af0 con 0x55c366943cc0 2024-05-08T18:50:46.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.811+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94297728041616] v25'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.811+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94297728015808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c366954290 con 0x7f83f4019040 2024-05-08T18:50:46.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.812+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94297728015808] v25'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83ec077020 con 0x7f83f4019040 2024-05-08T18:50:46.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.812+0000 7f83fdb28800 20 remove_watcher() i=0 2024-05-08T18:50:46.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.812+0000 7f83fdb28800 2 removed watcher, disabling cache 2024-05-08T18:50:46.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.812+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94297728018064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c366954290 con 0x55c366943cc0 2024-05-08T18:50:46.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.813+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94297728018064] v25'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.813+0000 7f83fdb28800 20 remove_watcher() i=1 2024-05-08T18:50:46.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.813+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94297728025952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c36694e690 con 0x55c3669485d0 2024-05-08T18:50:46.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.814+0000 7f83fa022640 1 -- 172.21.15.132:0/895163539 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94297728025952] v25'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f40083e0 con 0x55c3669485d0 2024-05-08T18:50:46.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.814+0000 7f83fdb28800 20 remove_watcher() i=2 2024-05-08T18:50:46.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.814+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94297728030080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c366954290 con 0x7f83f4019040 2024-05-08T18:50:46.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.815+0000 7f83f9821640 1 -- 172.21.15.132:0/895163539 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94297728030080] v25'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83ec077020 con 0x7f83f4019040 2024-05-08T18:50:46.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.815+0000 7f83fdb28800 20 remove_watcher() i=3 2024-05-08T18:50:46.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.815+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94297728033680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c36694e690 con 0x55c366943cc0 2024-05-08T18:50:46.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.816+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94297728033680] v25'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f002a040 con 0x55c366943cc0 2024-05-08T18:50:46.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.816+0000 7f83fdb28800 20 remove_watcher() i=4 2024-05-08T18:50:46.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.816+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94297728037232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c366951580 con 0x7f83ec052030 2024-05-08T18:50:46.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.817+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94297728037232] v25'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f002a040 con 0x7f83ec052030 2024-05-08T18:50:46.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.817+0000 7f83fdb28800 20 remove_watcher() i=5 2024-05-08T18:50:46.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.817+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94297728031136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c366954290 con 0x7f83ec052030 2024-05-08T18:50:46.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.818+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94297728031136] v25'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f002a040 con 0x7f83ec052030 2024-05-08T18:50:46.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.818+0000 7f83fdb28800 20 remove_watcher() i=6 2024-05-08T18:50:46.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.818+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94297728034736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c366952390 con 0x7f83ec052030 2024-05-08T18:50:46.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.819+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94297728034736] v25'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83f002a040 con 0x7f83ec052030 2024-05-08T18:50:46.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.819+0000 7f83fdb28800 20 remove_watcher() i=7 2024-05-08T18:50:46.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.819+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f83ec052030 msgr2=0x7f83ec0941d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.819+0000 7f83fdb28800 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f83ec052030 0x7f83ec0941d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.819+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c366943cc0 msgr2=0x55c366946180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.819+0000 7f83fdb28800 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c366943cc0 0x55c366946180 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.819+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f83f4019040 msgr2=0x7f83f402c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.819+0000 7f83fdb28800 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f83f4019040 0x7f83f402c3f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.819+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c3669485d0 msgr2=0x55c36694aa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.819+0000 7f83fdb28800 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c3669485d0 0x55c36694aa00 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.819+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f82c403bba0 msgr2=0x7f82c403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.819+0000 7f83fdb28800 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f82c403bba0 0x7f82c403e060 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f83ec093110 tx=0x7f83ec08c000 comp rx=0 tx=0).stop 2024-05-08T18:50:46.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.819+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c366930be0 msgr2=0x55c3669381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.819+0000 7f83f9020640 1 -- 172.21.15.132:0/895163539 reap_dead start 2024-05-08T18:50:46.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.819+0000 7f83fdb28800 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c366930be0 0x55c3669381c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f83f4022560 tx=0x7f83f4052b10 comp rx=0 tx=0).stop 2024-05-08T18:50:46.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.819+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 shutdown_connections 2024-05-08T18:50:46.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.819+0000 7f83fdb28800 1 --2- 172.21.15.132:0/895163539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c366930be0 0x55c3669381c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.819+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 >> 172.21.15.132:0/895163539 conn(0x55c36692cef0 msgr2=0x55c36692a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.819+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 shutdown_connections 2024-05-08T18:50:46.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.819+0000 7f83fdb28800 1 -- 172.21.15.132:0/895163539 wait complete. 2024-05-08T18:50:46.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 -- 172.21.15.132:0/2519342740 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f82d403bba0 msgr2=0x7f82d403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 --2- 172.21.15.132:0/2519342740 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f82d403bba0 0x7f82d403e060 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55c36690ff90 tx=0x7f83ec065380 comp rx=0 tx=0).stop 2024-05-08T18:50:46.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 -- 172.21.15.132:0/2519342740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c3669238b0 msgr2=0x55c366923cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 --2- 172.21.15.132:0/2519342740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c3669238b0 0x55c366923cd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55c3669091b0 tx=0x7f83f400aea0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 -- 172.21.15.132:0/2519342740 shutdown_connections 2024-05-08T18:50:46.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 --2- 172.21.15.132:0/2519342740 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f82d403bba0 0x7f82d403e060 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 --2- 172.21.15.132:0/2519342740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c3669238b0 0x55c366923cd0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 -- 172.21.15.132:0/2519342740 >> 172.21.15.132:0/2519342740 conn(0x55c366917950 msgr2=0x55c366917d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 -- 172.21.15.132:0/2519342740 shutdown_connections 2024-05-08T18:50:46.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 -- 172.21.15.132:0/2519342740 wait complete. 2024-05-08T18:50:46.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 -- 172.21.15.132:0/1517271115 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c36680e150 msgr2=0x55c36690f520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 --2- 172.21.15.132:0/1517271115 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c36680e150 0x55c36690f520 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 -- 172.21.15.132:0/1517271115 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c366911e40 msgr2=0x55c366914230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 --2- 172.21.15.132:0/1517271115 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c366911e40 0x55c366914230 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 -- 172.21.15.132:0/1517271115 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f82e003bb50 msgr2=0x7f82e003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 --2- 172.21.15.132:0/1517271115 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f82e003bb50 0x7f82e003e010 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f83f0001e10 tx=0x7f83f0001390 comp rx=0 tx=0).stop 2024-05-08T18:50:46.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 -- 172.21.15.132:0/1517271115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c36680d7f0 msgr2=0x55c3669082e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 --2- 172.21.15.132:0/1517271115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c36680d7f0 0x55c3669082e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f83ec00a190 tx=0x7f83ec003330 comp rx=0 tx=0).stop 2024-05-08T18:50:46.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 -- 172.21.15.132:0/1517271115 shutdown_connections 2024-05-08T18:50:46.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 --2- 172.21.15.132:0/1517271115 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c366911e40 0x55c366914230 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 --2- 172.21.15.132:0/1517271115 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c36680e150 0x55c36690f520 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 --2- 172.21.15.132:0/1517271115 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f82e003bb50 0x7f82e003e010 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 --2- 172.21.15.132:0/1517271115 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c36680d7f0 0x55c3669082e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 -- 172.21.15.132:0/1517271115 >> 172.21.15.132:0/1517271115 conn(0x55c366806ec0 msgr2=0x55c3668fa9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 -- 172.21.15.132:0/1517271115 shutdown_connections 2024-05-08T18:50:46.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.820+0000 7f83fdb28800 1 -- 172.21.15.132:0/1517271115 wait complete. 2024-05-08T18:50:46.840 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:50:44.835566Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-08T18:50:46.806723Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:44.835553Z', 'tags': [], 'group_ids': []} 2024-05-08T18:50:46.840 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:50:46.841 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:50:46.841 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:50:46.886 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:46.887 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:46.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.886+0000 7fc347719800 1 Processor -- start 2024-05-08T18:50:46.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.886+0000 7fc347719800 1 -- start start 2024-05-08T18:50:46.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.886+0000 7fc347719800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55c17f7a2b60 0x55c17f7a2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.886+0000 7fc347719800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c17f717ee0 con 0x55c17f7a34c0 2024-05-08T18:50:46.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.886+0000 7fc347719800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55c17f644e20 con 0x55c17f7a2b60 2024-05-08T18:50:46.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.886+0000 7fc345211640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55c17f7a2b60 0x55c17f7a2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.886+0000 7fc345211640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55c17f7a2b60 0x55c17f7a2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60516/0 (socket says 172.21.15.132:60516) 2024-05-08T18:50:46.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.887+0000 7fc345211640 1 -- 172.21.15.132:0/646645265 learned_addr learned my addr 172.21.15.132:0/646645265 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.886+0000 7fc344a10640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55c17f7a34c0 0x55c17f7a3970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46854/0 (socket says 172.21.15.132:46854) 2024-05-08T18:50:46.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.887+0000 7fc345211640 1 -- 172.21.15.132:0/646645265 >> v1:172.21.15.42:6789/0 conn(0x55c17f7a34c0 legacy=0x55c17f7a3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.887+0000 7fc345211640 1 -- 172.21.15.132:0/646645265 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c17f7a4080 con 0x55c17f7a2b60 2024-05-08T18:50:46.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.889+0000 7fc345211640 1 --2- 172.21.15.132:0/646645265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f7a2b60 0x55c17f7a2f80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc33800a520 tx=0x7fc33801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cddf604cd0dca0ec server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.889+0000 7fc337fff640 1 -- 172.21.15.132:0/646645265 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc338057070 con 0x55c17f7a2b60 2024-05-08T18:50:46.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.889+0000 7fc337fff640 1 -- 172.21.15.132:0/646645265 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc338052570 con 0x55c17f7a2b60 2024-05-08T18:50:46.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.889+0000 7fc337fff640 1 -- 172.21.15.132:0/646645265 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33804ae60 con 0x55c17f7a2b60 2024-05-08T18:50:46.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.889+0000 7fc347719800 1 -- 172.21.15.132:0/646645265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f7a2b60 msgr2=0x55c17f7a2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.889+0000 7fc347719800 1 --2- 172.21.15.132:0/646645265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f7a2b60 0x55c17f7a2f80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc33800a520 tx=0x7fc33801d010 comp rx=0 tx=0).stop 2024-05-08T18:50:46.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.889+0000 7fc347719800 1 -- 172.21.15.132:0/646645265 shutdown_connections 2024-05-08T18:50:46.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.889+0000 7fc347719800 1 --2- 172.21.15.132:0/646645265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f7a2b60 0x55c17f7a2f80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.889+0000 7fc347719800 1 -- 172.21.15.132:0/646645265 >> 172.21.15.132:0/646645265 conn(0x55c17f79e6a0 msgr2=0x55c17f7a0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.889+0000 7fc347719800 1 -- 172.21.15.132:0/646645265 shutdown_connections 2024-05-08T18:50:46.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.889+0000 7fc347719800 1 -- 172.21.15.132:0/646645265 wait complete. 2024-05-08T18:50:46.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.903+0000 7fc347719800 1 Processor -- start 2024-05-08T18:50:46.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.903+0000 7fc347719800 1 -- start start 2024-05-08T18:50:46.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.903+0000 7fc347719800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f7a2b60 0x55c17f897a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.903+0000 7fc347719800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c17f6ef5b0 con 0x55c17f7a2b60 2024-05-08T18:50:46.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.904+0000 7fc345211640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f7a2b60 0x55c17f897a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.904+0000 7fc345211640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f7a2b60 0x55c17f897a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60530/0 (socket says 172.21.15.132:60530) 2024-05-08T18:50:46.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.904+0000 7fc345211640 1 -- 172.21.15.132:0/1158356289 learned_addr learned my addr 172.21.15.132:0/1158356289 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.904+0000 7fc345211640 1 -- 172.21.15.132:0/1158356289 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c17f897fd0 con 0x55c17f7a2b60 2024-05-08T18:50:46.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.904+0000 7fc345211640 1 --2- 172.21.15.132:0/1158356289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f7a2b60 0x55c17f897a00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc33801d050 tx=0x7fc33804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b588f777903c7671 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.904+0000 7fc233606640 1 -- 172.21.15.132:0/1158356289 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc338057040 con 0x55c17f7a2b60 2024-05-08T18:50:46.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.904+0000 7fc233606640 1 -- 172.21.15.132:0/1158356289 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc338052720 con 0x55c17f7a2b60 2024-05-08T18:50:46.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.904+0000 7fc233606640 1 -- 172.21.15.132:0/1158356289 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc338052a40 con 0x55c17f7a2b60 2024-05-08T18:50:46.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.905+0000 7fc347719800 1 -- 172.21.15.132:0/1158356289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f7a2b60 msgr2=0x55c17f897a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.905+0000 7fc347719800 1 --2- 172.21.15.132:0/1158356289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f7a2b60 0x55c17f897a00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc33801d050 tx=0x7fc33804c000 comp rx=0 tx=0).stop 2024-05-08T18:50:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.905+0000 7fc347719800 1 -- 172.21.15.132:0/1158356289 shutdown_connections 2024-05-08T18:50:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.905+0000 7fc347719800 1 --2- 172.21.15.132:0/1158356289 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f7a2b60 0x55c17f897a00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.905+0000 7fc347719800 1 -- 172.21.15.132:0/1158356289 >> 172.21.15.132:0/1158356289 conn(0x55c17f79e6a0 msgr2=0x55c17f893320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.905+0000 7fc347719800 1 -- 172.21.15.132:0/1158356289 shutdown_connections 2024-05-08T18:50:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.905+0000 7fc347719800 1 -- 172.21.15.132:0/1158356289 wait complete. 2024-05-08T18:50:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.905+0000 7fc347719800 1 Processor -- start 2024-05-08T18:50:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.905+0000 7fc347719800 1 -- start start 2024-05-08T18:50:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.906+0000 7fc347719800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f7a2b60 0x55c17f89f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.906+0000 7fc347719800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c17f7a45b0 con 0x55c17f7a2b60 2024-05-08T18:50:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.906+0000 7fc345211640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f7a2b60 0x55c17f89f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.906+0000 7fc345211640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f7a2b60 0x55c17f89f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60542/0 (socket says 172.21.15.132:60542) 2024-05-08T18:50:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.906+0000 7fc345211640 1 -- 172.21.15.132:0/881402027 learned_addr learned my addr 172.21.15.132:0/881402027 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.906+0000 7fc345211640 1 -- 172.21.15.132:0/881402027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c17f89f9c0 con 0x55c17f7a2b60 2024-05-08T18:50:46.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.906+0000 7fc345211640 1 --2- 172.21.15.132:0/881402027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f7a2b60 0x55c17f89f480 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc338000c00 tx=0x7fc338003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.906+0000 7fc231e03640 1 -- 172.21.15.132:0/881402027 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc338073070 con 0x55c17f7a2b60 2024-05-08T18:50:46.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.906+0000 7fc231e03640 1 -- 172.21.15.132:0/881402027 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33805d440 con 0x55c17f7a2b60 2024-05-08T18:50:46.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.906+0000 7fc347719800 1 -- 172.21.15.132:0/881402027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c17f89fc50 con 0x55c17f7a2b60 2024-05-08T18:50:46.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.906+0000 7fc231e03640 1 -- 172.21.15.132:0/881402027 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc338057070 con 0x55c17f7a2b60 2024-05-08T18:50:46.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.907+0000 7fc347719800 1 -- 172.21.15.132:0/881402027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c17f8a2900 con 0x55c17f7a2b60 2024-05-08T18:50:46.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.907+0000 7fc231e03640 1 -- 172.21.15.132:0/881402027 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc338076070 con 0x55c17f7a2b60 2024-05-08T18:50:46.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.908+0000 7fc231e03640 1 --2- 172.21.15.132:0/881402027 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc22c03bb50 0x7fc22c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.908+0000 7fc231e03640 1 -- 172.21.15.132:0/881402027 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fc338093ea0 con 0x55c17f7a2b60 2024-05-08T18:50:46.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.908+0000 7fc344a10640 1 --2- 172.21.15.132:0/881402027 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc22c03bb50 0x7fc22c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.908+0000 7fc347719800 1 --2- 172.21.15.132:0/881402027 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c17f7a34c0 0x55c17f8a66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.908+0000 7fc347719800 1 -- 172.21.15.132:0/881402027 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8a6c40 con 0x55c17f7a34c0 2024-05-08T18:50:46.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.908+0000 7fc345a12640 1 --2- 172.21.15.132:0/881402027 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c17f7a34c0 0x55c17f8a66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.908+0000 7fc344a10640 1 --2- 172.21.15.132:0/881402027 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc22c03bb50 0x7fc22c03e010 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc33c000f60 tx=0x7fc33c001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.908+0000 7fc345a12640 1 --2- 172.21.15.132:0/881402027 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c17f7a34c0 0x55c17f8a66c0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.908+0000 7fc345a12640 1 -- 172.21.15.132:0/881402027 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc34000a4a0 con 0x55c17f7a34c0 2024-05-08T18:50:46.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.909+0000 7fc347719800 1 -- 172.21.15.132:0/881402027 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8a3c90 con 0x55c17f7a34c0 2024-05-08T18:50:46.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.909+0000 7fc345a12640 1 -- 172.21.15.132:0/881402027 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc34000a4a0 con 0x55c17f7a34c0 2024-05-08T18:50:46.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.909+0000 7fc347719800 1 --2- 172.21.15.132:0/881402027 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c17f8a8f70 0x55c17f8ab360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.909+0000 7fc347719800 1 -- 172.21.15.132:0/881402027 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8aba50 con 0x55c17f8a8f70 2024-05-08T18:50:46.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.909+0000 7fc345211640 1 --2- 172.21.15.132:0/881402027 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c17f8a8f70 0x55c17f8ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.909+0000 7fc345211640 1 --2- 172.21.15.132:0/881402027 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c17f8a8f70 0x55c17f8ab360 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.910+0000 7fc345211640 1 -- 172.21.15.132:0/881402027 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc338075030 con 0x55c17f8a8f70 2024-05-08T18:50:46.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.910+0000 7fc347719800 1 -- 172.21.15.132:0/881402027 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8a7e10 con 0x55c17f7a34c0 2024-05-08T18:50:46.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.910+0000 7fc345a12640 1 -- 172.21.15.132:0/881402027 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc34000a4a0 con 0x55c17f7a34c0 2024-05-08T18:50:46.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.910+0000 7fc347719800 1 -- 172.21.15.132:0/881402027 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8a82f0 con 0x55c17f7a34c0 2024-05-08T18:50:46.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.910+0000 7fc345a12640 1 -- 172.21.15.132:0/881402027 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc34000a4a0 con 0x55c17f7a34c0 2024-05-08T18:50:46.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.910+0000 7fc347719800 1 Processor -- start 2024-05-08T18:50:46.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.910+0000 7fc347719800 1 -- start start 2024-05-08T18:50:46.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.911+0000 7fc347719800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f8ba990 0x55c17f8badb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.911+0000 7fc347719800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c17f695fc0 con 0x55c17f8ba990 2024-05-08T18:50:46.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.911+0000 7fc345a12640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f8ba990 0x55c17f8badb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.911+0000 7fc345a12640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f8ba990 0x55c17f8badb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60544/0 (socket says 172.21.15.132:60544) 2024-05-08T18:50:46.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.911+0000 7fc345a12640 1 -- 172.21.15.132:0/2851588593 learned_addr learned my addr 172.21.15.132:0/2851588593 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.911+0000 7fc345a12640 1 -- 172.21.15.132:0/2851588593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c17f8bb2f0 con 0x55c17f8ba990 2024-05-08T18:50:46.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.911+0000 7fc345a12640 1 --2- 172.21.15.132:0/2851588593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f8ba990 0x55c17f8badb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55c17f8a7020 tx=0x7fc340018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.911+0000 7fc22affd640 1 -- 172.21.15.132:0/2851588593 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc340014450 con 0x55c17f8ba990 2024-05-08T18:50:46.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.911+0000 7fc22affd640 1 -- 172.21.15.132:0/2851588593 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc340014610 con 0x55c17f8ba990 2024-05-08T18:50:46.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.911+0000 7fc22affd640 1 -- 172.21.15.132:0/2851588593 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc340014930 con 0x55c17f8ba990 2024-05-08T18:50:46.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.911+0000 7fc347719800 1 -- 172.21.15.132:0/2851588593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c17f8bbd60 con 0x55c17f8ba990 2024-05-08T18:50:46.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.912+0000 7fc347719800 1 -- 172.21.15.132:0/2851588593 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c17f8bc260 con 0x55c17f8ba990 2024-05-08T18:50:46.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.912+0000 7fc22affd640 1 -- 172.21.15.132:0/2851588593 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc340011040 con 0x55c17f8ba990 2024-05-08T18:50:46.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.912+0000 7fc22affd640 1 --2- 172.21.15.132:0/2851588593 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc21c03bba0 0x7fc21c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.912+0000 7fc22affd640 1 -- 172.21.15.132:0/2851588593 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fc34001e070 con 0x55c17f8ba990 2024-05-08T18:50:46.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.913+0000 7fc345211640 1 --2- 172.21.15.132:0/2851588593 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc21c03bba0 0x7fc21c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.913+0000 7fc347719800 1 Processor -- start 2024-05-08T18:50:46.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.913+0000 7fc345211640 1 --2- 172.21.15.132:0/2851588593 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc21c03bba0 0x7fc21c03e060 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55c17f8a70c0 tx=0x7fc33805df70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.913+0000 7fc347719800 1 -- start start 2024-05-08T18:50:46.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.913+0000 7fc347719800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f8c7be0 0x55c17f8c8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.913+0000 7fc347719800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c17f898290 con 0x55c17f8c7be0 2024-05-08T18:50:46.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.913+0000 7fc345a12640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f8c7be0 0x55c17f8c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.913+0000 7fc345a12640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f8c7be0 0x55c17f8c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60550/0 (socket says 172.21.15.132:60550) 2024-05-08T18:50:46.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.913+0000 7fc345a12640 1 -- 172.21.15.132:0/2153865888 learned_addr learned my addr 172.21.15.132:0/2153865888 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.914+0000 7fc345a12640 1 -- 172.21.15.132:0/2153865888 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c17f8c85d0 con 0x55c17f8c7be0 2024-05-08T18:50:46.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.914+0000 7fc345a12640 1 --2- 172.21.15.132:0/2153865888 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f8c7be0 0x55c17f8c8000 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc340013fd0 tx=0x7fc340011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2779e0a3c72f458d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.914+0000 7fc228ff9640 1 -- 172.21.15.132:0/2153865888 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc34002bc50 con 0x55c17f8c7be0 2024-05-08T18:50:46.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.914+0000 7fc228ff9640 1 -- 172.21.15.132:0/2153865888 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc340047070 con 0x55c17f8c7be0 2024-05-08T18:50:46.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.914+0000 7fc228ff9640 1 -- 172.21.15.132:0/2153865888 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3400167c0 con 0x55c17f8c7be0 2024-05-08T18:50:46.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.914+0000 7fc347719800 1 -- 172.21.15.132:0/2153865888 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f8c7be0 msgr2=0x55c17f8c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.914+0000 7fc347719800 1 --2- 172.21.15.132:0/2153865888 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f8c7be0 0x55c17f8c8000 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc340013fd0 tx=0x7fc340011b50 comp rx=0 tx=0).stop 2024-05-08T18:50:46.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.914+0000 7fc347719800 1 -- 172.21.15.132:0/2153865888 shutdown_connections 2024-05-08T18:50:46.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.914+0000 7fc347719800 1 --2- 172.21.15.132:0/2153865888 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f8c7be0 0x55c17f8c8000 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.914+0000 7fc347719800 1 -- 172.21.15.132:0/2153865888 >> 172.21.15.132:0/2153865888 conn(0x55c17f8c3f90 msgr2=0x55c17f8c1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.914+0000 7fc347719800 1 -- 172.21.15.132:0/2153865888 shutdown_connections 2024-05-08T18:50:46.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.914+0000 7fc347719800 1 -- 172.21.15.132:0/2153865888 wait complete. 2024-05-08T18:50:46.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.915+0000 7fc347719800 1 Processor -- start 2024-05-08T18:50:46.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.915+0000 7fc347719800 1 -- start start 2024-05-08T18:50:46.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.915+0000 7fc347719800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f8c7be0 0x55c17f8cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.915+0000 7fc347719800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c17f8c8d30 con 0x55c17f8c7be0 2024-05-08T18:50:46.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.915+0000 7fc345a12640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f8c7be0 0x55c17f8cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.915+0000 7fc345a12640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f8c7be0 0x55c17f8cf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60564/0 (socket says 172.21.15.132:60564) 2024-05-08T18:50:46.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.915+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 learned_addr learned my addr 172.21.15.132:0/2808408193 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:46.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.915+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c17f8cf6e0 con 0x55c17f8c7be0 2024-05-08T18:50:46.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.916+0000 7fc345a12640 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f8c7be0 0x55c17f8cf1a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc340011b90 tx=0x7fc340052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.916+0000 7fc21affd640 1 -- 172.21.15.132:0/2808408193 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc340016ac0 con 0x55c17f8c7be0 2024-05-08T18:50:46.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.916+0000 7fc21affd640 1 -- 172.21.15.132:0/2808408193 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc34002b350 con 0x55c17f8c7be0 2024-05-08T18:50:46.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.916+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c17f8cf970 con 0x55c17f8c7be0 2024-05-08T18:50:46.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.916+0000 7fc21affd640 1 -- 172.21.15.132:0/2808408193 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc34002b630 con 0x55c17f8c7be0 2024-05-08T18:50:46.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.916+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c17f8d2620 con 0x55c17f8c7be0 2024-05-08T18:50:46.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.916+0000 7fc21affd640 1 -- 172.21.15.132:0/2808408193 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc34002b7d0 con 0x55c17f8c7be0 2024-05-08T18:50:46.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.917+0000 7fc21affd640 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc21003bba0 0x7fc21003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.917+0000 7fc21affd640 1 -- 172.21.15.132:0/2808408193 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fc34000e040 con 0x55c17f8c7be0 2024-05-08T18:50:46.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.917+0000 7fc345211640 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc21003bba0 0x7fc21003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.917+0000 7fc347719800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.917+0000 7fc347719800 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c17f8dadb0 0x55c17f8dd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.917+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8dd9c0 con 0x55c17f8dadb0 2024-05-08T18:50:46.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.917+0000 7fc344a10640 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c17f8dadb0 0x55c17f8dd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.917+0000 7fc345211640 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc21003bba0 0x7fc21003e060 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc338076f90 tx=0x7fc33808c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.917+0000 7fc344a10640 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c17f8dadb0 0x55c17f8dd270 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.918+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc33c00f610 con 0x55c17f8dadb0 2024-05-08T18:50:46.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.918+0000 7fc347719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.918+0000 7fc347719800 20 realm 2024-05-08T18:50:46.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.918+0000 7fc347719800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.918+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8da200 con 0x55c17f8dadb0 2024-05-08T18:50:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.918+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc33c00f610 con 0x55c17f8dadb0 2024-05-08T18:50:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.918+0000 7fc347719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.918+0000 7fc347719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.918+0000 7fc347719800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.918+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8de4a0 con 0x55c17f8dadb0 2024-05-08T18:50:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.918+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc33c00f610 con 0x55c17f8dadb0 2024-05-08T18:50:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.918+0000 7fc347719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.918+0000 7fc347719800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.918+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8ded70 con 0x55c17f8dadb0 2024-05-08T18:50:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.918+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc33c00f610 con 0x55c17f8dadb0 2024-05-08T18:50:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.918+0000 7fc347719800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.918+0000 7fc347719800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.918+0000 7fc347719800 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c17f8df620 0x55c17f8e1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.918+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e2190 con 0x55c17f8df620 2024-05-08T18:50:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.919+0000 7fc345a12640 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c17f8df620 0x55c17f8e1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.919+0000 7fc345a12640 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c17f8df620 0x55c17f8e1a30 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.919+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc34003f070 con 0x55c17f8df620 2024-05-08T18:50:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.919+0000 7fc347719800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.919+0000 7fc347719800 20 searching for the correct realm 2024-05-08T18:50:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.919+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x55c17f8df620 2024-05-08T18:50:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.920+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34003f070 con 0x55c17f8df620 2024-05-08T18:50:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.920+0000 7fc345a12640 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fc340038020 0x7fc340001520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.920+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x7fc340038020 2024-05-08T18:50:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.920+0000 7fc345211640 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fc340038020 0x7fc340001520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.920+0000 7fc345211640 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fc340038020 0x7fc340001520 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.920+0000 7fc345211640 1 -- 172.21.15.132:0/2808408193 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc338075030 con 0x7fc340038020 2024-05-08T18:50:46.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.920+0000 7fc345211640 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fc338078060 0x7fc3380773b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:46.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.920+0000 7fc345211640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x7fc338078060 2024-05-08T18:50:46.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.921+0000 7fc344a10640 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fc338078060 0x7fc3380773b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:46.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.921+0000 7fc344a10640 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fc338078060 0x7fc3380773b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:46.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.921+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c00f610 con 0x7fc338078060 2024-05-08T18:50:46.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.921+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x55c17f8dadb0 2024-05-08T18:50:46.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.921+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c00f610 con 0x55c17f8dadb0 2024-05-08T18:50:46.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.921+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x55c17f8dadb0 2024-05-08T18:50:46.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.922+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c02b040 con 0x55c17f8dadb0 2024-05-08T18:50:46.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.922+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x7fc338078060 2024-05-08T18:50:46.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.922+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c02b040 con 0x7fc338078060 2024-05-08T18:50:46.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.922+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x7fc338078060 2024-05-08T18:50:46.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.922+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c02b040 con 0x7fc338078060 2024-05-08T18:50:46.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.922+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x7fc340038020 2024-05-08T18:50:46.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.922+0000 7fc345211640 1 -- 172.21.15.132:0/2808408193 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc338075030 con 0x7fc340038020 2024-05-08T18:50:46.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.922+0000 7fc345211640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x55c17f8df620 2024-05-08T18:50:46.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.923+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34003f070 con 0x55c17f8df620 2024-05-08T18:50:46.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.923+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x55c17f8dadb0 2024-05-08T18:50:46.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.923+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c02b040 con 0x55c17f8dadb0 2024-05-08T18:50:46.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.923+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x7fc338078060 2024-05-08T18:50:46.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.923+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c02b040 con 0x7fc338078060 2024-05-08T18:50:46.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.923+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x55c17f8dadb0 2024-05-08T18:50:46.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.923+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc33c02b040 con 0x55c17f8dadb0 2024-05-08T18:50:46.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.923+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x7fc340038020 2024-05-08T18:50:46.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.924+0000 7fc345211640 1 -- 172.21.15.132:0/2808408193 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc338075030 con 0x7fc340038020 2024-05-08T18:50:46.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.924+0000 7fc345211640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x55c17f8df620 2024-05-08T18:50:46.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.924+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc34003f070 con 0x55c17f8df620 2024-05-08T18:50:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.924+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x55c17f8df620 2024-05-08T18:50:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.924+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34003f070 con 0x55c17f8df620 2024-05-08T18:50:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.924+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x7fc338078060 2024-05-08T18:50:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.924+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c02b040 con 0x7fc338078060 2024-05-08T18:50:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.924+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x55c17f8df620 2024-05-08T18:50:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.925+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34003f070 con 0x55c17f8df620 2024-05-08T18:50:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.925+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x55c17f8df620 2024-05-08T18:50:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.925+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34003f070 con 0x55c17f8df620 2024-05-08T18:50:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.925+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x55c17f8dadb0 2024-05-08T18:50:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.925+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c02b040 con 0x55c17f8dadb0 2024-05-08T18:50:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.925+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x55c17f8dadb0 2024-05-08T18:50:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.925+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc33c02b040 con 0x55c17f8dadb0 2024-05-08T18:50:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.925+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x7fc338078060 2024-05-08T18:50:46.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.926+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c02b040 con 0x7fc338078060 2024-05-08T18:50:46.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.926+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x55c17f8df620 2024-05-08T18:50:46.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.926+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34003f070 con 0x55c17f8df620 2024-05-08T18:50:46.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.926+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x7fc340038020 2024-05-08T18:50:46.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.926+0000 7fc345211640 1 -- 172.21.15.132:0/2808408193 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc338075030 con 0x7fc340038020 2024-05-08T18:50:46.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.926+0000 7fc345211640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x55c17f8dadb0 2024-05-08T18:50:46.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.926+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c02b040 con 0x55c17f8dadb0 2024-05-08T18:50:46.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.926+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x7fc338078060 2024-05-08T18:50:46.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.927+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c03b040 con 0x7fc338078060 2024-05-08T18:50:46.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.927+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x55c17f8df620 2024-05-08T18:50:46.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.927+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34003f070 con 0x55c17f8df620 2024-05-08T18:50:46.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.927+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x7fc338078060 2024-05-08T18:50:46.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.927+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c03b040 con 0x7fc338078060 2024-05-08T18:50:46.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.927+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x7fc340038020 2024-05-08T18:50:46.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.927+0000 7fc345211640 1 -- 172.21.15.132:0/2808408193 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc338075030 con 0x7fc340038020 2024-05-08T18:50:46.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.927+0000 7fc345211640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x55c17f8df620 2024-05-08T18:50:46.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.928+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34003f070 con 0x55c17f8df620 2024-05-08T18:50:46.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.928+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x7fc338078060 2024-05-08T18:50:46.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.928+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c03b040 con 0x7fc338078060 2024-05-08T18:50:46.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.928+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x55c17f8dadb0 2024-05-08T18:50:46.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.928+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc33c03b040 con 0x55c17f8dadb0 2024-05-08T18:50:46.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.928+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3bc0 con 0x7fc340038020 2024-05-08T18:50:46.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc345211640 1 -- 172.21.15.132:0/2808408193 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc338075030 con 0x7fc340038020 2024-05-08T18:50:46.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:46.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:46.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:46.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:46.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:46.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:46.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e2cc0 con 0x55c17f8dadb0 2024-05-08T18:50:46.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc33c03b040 con 0x55c17f8dadb0 2024-05-08T18:50:46.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e3560 con 0x55c17f8dadb0 2024-05-08T18:50:46.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc33c03b040 con 0x55c17f8dadb0 2024-05-08T18:50:46.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:46.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e2900 con 0x55c17f8dadb0 2024-05-08T18:50:46.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc33c03b040 con 0x55c17f8dadb0 2024-05-08T18:50:46.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:46.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 20 zone default found 2024-05-08T18:50:46.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 4 Realm: () 2024-05-08T18:50:46.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:46.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:46.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:46.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 20 zonegroup default 2024-05-08T18:50:46.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.929+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e4090 con 0x7fc338078060 2024-05-08T18:50:46.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.930+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc33c03b040 con 0x7fc338078060 2024-05-08T18:50:46.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.930+0000 7fc347719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.930+0000 7fc347719800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.930+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e5f20 con 0x55c17f8df620 2024-05-08T18:50:46.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.930+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc34003f070 con 0x55c17f8df620 2024-05-08T18:50:46.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.930+0000 7fc347719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.930+0000 7fc347719800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.930+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e62c0 con 0x55c17f8df620 2024-05-08T18:50:46.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.930+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc34003f070 con 0x55c17f8df620 2024-05-08T18:50:46.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.930+0000 7fc347719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:46.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.930+0000 7fc347719800 20 started sync module instance, tier type = 2024-05-08T18:50:46.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.930+0000 7fc347719800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:46.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.930+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e5360 con 0x7fc340038020 2024-05-08T18:50:46.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.931+0000 7fc345211640 1 -- 172.21.15.132:0/2808408193 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc338075030 con 0x7fc340038020 2024-05-08T18:50:46.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.931+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94289557083984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e5b70 con 0x7fc340038020 2024-05-08T18:50:46.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.931+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e6fc0 con 0x55c17f8dadb0 2024-05-08T18:50:46.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.932+0000 7fc345211640 1 -- 172.21.15.132:0/2808408193 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94289557083984] v25'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc338075030 con 0x7fc340038020 2024-05-08T18:50:46.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.933+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c03b040 con 0x55c17f8dadb0 2024-05-08T18:50:46.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.933+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94289557088320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e73b0 con 0x55c17f8dadb0 2024-05-08T18:50:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.933+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e7dd0 con 0x55c17f8df620 2024-05-08T18:50:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.934+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94289557088320] v25'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c03b040 con 0x55c17f8dadb0 2024-05-08T18:50:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.934+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc34003f070 con 0x55c17f8df620 2024-05-08T18:50:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.934+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94289557092544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e7d90 con 0x55c17f8df620 2024-05-08T18:50:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.934+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e8840 con 0x7fc340038020 2024-05-08T18:50:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.935+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94289557092544] v25'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc34003f070 con 0x55c17f8df620 2024-05-08T18:50:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.935+0000 7fc345211640 1 -- 172.21.15.132:0/2808408193 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc338075030 con 0x7fc340038020 2024-05-08T18:50:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.935+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94289557095312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e8c60 con 0x7fc340038020 2024-05-08T18:50:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.935+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e96e0 con 0x55c17f8dadb0 2024-05-08T18:50:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.936+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c03b040 con 0x55c17f8dadb0 2024-05-08T18:50:46.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.936+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94289557098960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e9f80 con 0x55c17f8dadb0 2024-05-08T18:50:46.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.936+0000 7fc345211640 1 -- 172.21.15.132:0/2808408193 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94289557095312] v25'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc338075030 con 0x7fc340038020 2024-05-08T18:50:46.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.936+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8eaa80 con 0x7fc338078060 2024-05-08T18:50:46.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.937+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94289557098960] v25'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c03b040 con 0x55c17f8dadb0 2024-05-08T18:50:46.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.937+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c03b040 con 0x7fc338078060 2024-05-08T18:50:46.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.937+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94289557103984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e9f30 con 0x7fc338078060 2024-05-08T18:50:46.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.937+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8eaef0 con 0x7fc338078060 2024-05-08T18:50:46.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.938+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94289557103984] v25'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c03b040 con 0x7fc338078060 2024-05-08T18:50:46.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.938+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c03b040 con 0x7fc338078060 2024-05-08T18:50:46.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.938+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94289557101184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8eaef0 con 0x7fc338078060 2024-05-08T18:50:46.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.938+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8eb8f0 con 0x7fc338078060 2024-05-08T18:50:46.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.939+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94289557101184] v25'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c03b040 con 0x7fc338078060 2024-05-08T18:50:46.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.939+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c03b040 con 0x7fc338078060 2024-05-08T18:50:46.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.939+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94289557105216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8eba90 con 0x7fc338078060 2024-05-08T18:50:46.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.939+0000 7fc347719800 20 add_watcher() i=0 2024-05-08T18:50:46.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.939+0000 7fc347719800 20 add_watcher() i=1 2024-05-08T18:50:46.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.939+0000 7fc347719800 20 add_watcher() i=2 2024-05-08T18:50:46.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.939+0000 7fc347719800 20 add_watcher() i=3 2024-05-08T18:50:46.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.939+0000 7fc347719800 20 add_watcher() i=4 2024-05-08T18:50:46.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.939+0000 7fc347719800 20 add_watcher() i=5 2024-05-08T18:50:46.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.939+0000 7fc347719800 20 add_watcher() i=6 2024-05-08T18:50:46.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.940+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94289557105216] v25'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c03b040 con 0x7fc338078060 2024-05-08T18:50:46.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.940+0000 7fc347719800 20 add_watcher() i=7 2024-05-08T18:50:46.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.940+0000 7fc347719800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:46.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.940+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8eeca0 con 0x55c17f8dadb0 2024-05-08T18:50:46.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.940+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc33c03b040 con 0x55c17f8dadb0 2024-05-08T18:50:46.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.941+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94289557108288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8ebf10 con 0x55c17f8dadb0 2024-05-08T18:50:46.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.942+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94289557108288] v25'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc33c03b040 con 0x55c17f8dadb0 2024-05-08T18:50:46.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.942+0000 7fc1fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:46.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.942+0000 7fc347719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:46.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.942+0000 7fc347719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:46.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.942+0000 7fc347719800 5 note: GC not initialized 2024-05-08T18:50:46.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.942+0000 7fc1fa7e4640 20 reqs_thread_entry: start 2024-05-08T18:50:46.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.942+0000 7fc347719800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:46.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.942+0000 7fc347719800 20 Filter name: none 2024-05-08T18:50:46.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.942+0000 7fc16bfff640 20 reqs_thread_entry: start 2024-05-08T18:50:46.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.942+0000 7fc347719800 20 rados->read ofs=0 len=0 2024-05-08T18:50:46.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.942+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c17f921cf0 con 0x55c17f8dadb0 2024-05-08T18:50:46.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.944+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7fc33c03b040 con 0x55c17f8dadb0 2024-05-08T18:50:46.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.944+0000 7fc347719800 20 rados_obj.operate() r=0 bl.length=673 2024-05-08T18:50:46.955 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:50:44.835566Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-08T18:50:46.806723Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:44.835553Z","tags":[],"group_ids":[]} 2024-05-08T18:50:46.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.945+0000 7fc1fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:46.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.945+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94289557108288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f9220d0 con 0x55c17f8dadb0 2024-05-08T18:50:46.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.946+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94289557108288] v25'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc33c03b040 con 0x55c17f8dadb0 2024-05-08T18:50:46.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.946+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94289557083984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8eb640 con 0x7fc340038020 2024-05-08T18:50:46.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.947+0000 7fc345211640 1 -- 172.21.15.132:0/2808408193 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94289557083984] v25'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc338075030 con 0x7fc340038020 2024-05-08T18:50:46.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.947+0000 7fc347719800 20 remove_watcher() i=0 2024-05-08T18:50:46.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.947+0000 7fc347719800 2 removed watcher, disabling cache 2024-05-08T18:50:46.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.947+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94289557088320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e5750 con 0x55c17f8dadb0 2024-05-08T18:50:46.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.948+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94289557088320] v25'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c03b040 con 0x55c17f8dadb0 2024-05-08T18:50:46.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.948+0000 7fc347719800 20 remove_watcher() i=1 2024-05-08T18:50:46.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.948+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94289557092544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e5750 con 0x55c17f8df620 2024-05-08T18:50:46.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.949+0000 7fc345a12640 1 -- 172.21.15.132:0/2808408193 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94289557092544] v25'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc34003f070 con 0x55c17f8df620 2024-05-08T18:50:46.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.949+0000 7fc347719800 20 remove_watcher() i=2 2024-05-08T18:50:46.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.949+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94289557095312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e5750 con 0x7fc340038020 2024-05-08T18:50:46.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.950+0000 7fc345211640 1 -- 172.21.15.132:0/2808408193 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94289557095312] v25'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc338075030 con 0x7fc340038020 2024-05-08T18:50:46.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.950+0000 7fc347719800 20 remove_watcher() i=3 2024-05-08T18:50:46.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.950+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94289557098960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e8390 con 0x55c17f8dadb0 2024-05-08T18:50:46.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.951+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94289557098960] v25'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c03b040 con 0x55c17f8dadb0 2024-05-08T18:50:46.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.951+0000 7fc347719800 20 remove_watcher() i=4 2024-05-08T18:50:46.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.951+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94289557103984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e8390 con 0x7fc338078060 2024-05-08T18:50:46.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.952+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94289557103984] v25'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c03b040 con 0x7fc338078060 2024-05-08T18:50:46.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.952+0000 7fc347719800 20 remove_watcher() i=5 2024-05-08T18:50:46.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.952+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94289557101184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e8390 con 0x7fc338078060 2024-05-08T18:50:46.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.953+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94289557101184] v25'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c03b040 con 0x7fc338078060 2024-05-08T18:50:46.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.953+0000 7fc347719800 20 remove_watcher() i=6 2024-05-08T18:50:46.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.953+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94289557105216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c17f8e9a80 con 0x7fc338078060 2024-05-08T18:50:46.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94289557105216] v25'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c03b040 con 0x7fc338078060 2024-05-08T18:50:46.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc347719800 20 remove_watcher() i=7 2024-05-08T18:50:46.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fc338078060 msgr2=0x7fc3380773b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc347719800 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fc338078060 0x7fc3380773b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c17f8dadb0 msgr2=0x55c17f8dd270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc347719800 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c17f8dadb0 0x55c17f8dd270 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fc340038020 msgr2=0x7fc340001520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc347719800 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fc340038020 0x7fc340001520 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c17f8df620 msgr2=0x55c17f8e1a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc347719800 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c17f8df620 0x55c17f8e1a30 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc21003bba0 msgr2=0x7fc21003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc347719800 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc21003bba0 0x7fc21003e060 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc338076f90 tx=0x7fc33808c000 comp rx=0 tx=0).stop 2024-05-08T18:50:46.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f8c7be0 msgr2=0x55c17f8cf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc344a10640 1 -- 172.21.15.132:0/2808408193 reap_dead start 2024-05-08T18:50:46.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc347719800 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f8c7be0 0x55c17f8cf1a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc340011b90 tx=0x7fc340052be0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 shutdown_connections 2024-05-08T18:50:46.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc347719800 1 --2- 172.21.15.132:0/2808408193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f8c7be0 0x55c17f8cf1a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 >> 172.21.15.132:0/2808408193 conn(0x55c17f8c3f90 msgr2=0x55c17f8c9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 shutdown_connections 2024-05-08T18:50:46.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc347719800 1 -- 172.21.15.132:0/2808408193 wait complete. 2024-05-08T18:50:46.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc347719800 1 -- 172.21.15.132:0/2851588593 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc21c03bba0 msgr2=0x7fc21c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc347719800 1 --2- 172.21.15.132:0/2851588593 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc21c03bba0 0x7fc21c03e060 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55c17f8a70c0 tx=0x7fc33805df70 comp rx=0 tx=0).stop 2024-05-08T18:50:46.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc347719800 1 -- 172.21.15.132:0/2851588593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f8ba990 msgr2=0x55c17f8badb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.954+0000 7fc347719800 1 --2- 172.21.15.132:0/2851588593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f8ba990 0x55c17f8badb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55c17f8a7020 tx=0x7fc340018830 comp rx=0 tx=0).stop 2024-05-08T18:50:46.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.955+0000 7fc347719800 1 -- 172.21.15.132:0/2851588593 shutdown_connections 2024-05-08T18:50:46.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.955+0000 7fc347719800 1 --2- 172.21.15.132:0/2851588593 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc21c03bba0 0x7fc21c03e060 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.955+0000 7fc347719800 1 --2- 172.21.15.132:0/2851588593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f8ba990 0x55c17f8badb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.955+0000 7fc347719800 1 -- 172.21.15.132:0/2851588593 >> 172.21.15.132:0/2851588593 conn(0x55c17f8aea30 msgr2=0x55c17f8aee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.955+0000 7fc347719800 1 -- 172.21.15.132:0/2851588593 shutdown_connections 2024-05-08T18:50:46.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.955+0000 7fc347719800 1 -- 172.21.15.132:0/2851588593 wait complete. 2024-05-08T18:50:46.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.955+0000 7fc347719800 1 -- 172.21.15.132:0/881402027 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c17f7a34c0 msgr2=0x55c17f8a66c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.955+0000 7fc347719800 1 --2- 172.21.15.132:0/881402027 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c17f7a34c0 0x55c17f8a66c0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.955+0000 7fc347719800 1 -- 172.21.15.132:0/881402027 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c17f8a8f70 msgr2=0x55c17f8ab360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.955+0000 7fc347719800 1 --2- 172.21.15.132:0/881402027 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c17f8a8f70 0x55c17f8ab360 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.955+0000 7fc347719800 1 -- 172.21.15.132:0/881402027 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc22c03bb50 msgr2=0x7fc22c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.955+0000 7fc347719800 1 --2- 172.21.15.132:0/881402027 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc22c03bb50 0x7fc22c03e010 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc33c000f60 tx=0x7fc33c001370 comp rx=0 tx=0).stop 2024-05-08T18:50:46.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.955+0000 7fc347719800 1 -- 172.21.15.132:0/881402027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f7a2b60 msgr2=0x55c17f89f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:46.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.955+0000 7fc347719800 1 --2- 172.21.15.132:0/881402027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f7a2b60 0x55c17f89f480 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc338000c00 tx=0x7fc338003020 comp rx=0 tx=0).stop 2024-05-08T18:50:46.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.955+0000 7fc347719800 1 -- 172.21.15.132:0/881402027 shutdown_connections 2024-05-08T18:50:46.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.955+0000 7fc347719800 1 --2- 172.21.15.132:0/881402027 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c17f8a8f70 0x55c17f8ab360 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.955+0000 7fc347719800 1 --2- 172.21.15.132:0/881402027 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c17f7a34c0 0x55c17f8a66c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.955+0000 7fc347719800 1 --2- 172.21.15.132:0/881402027 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc22c03bb50 0x7fc22c03e010 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.955+0000 7fc347719800 1 --2- 172.21.15.132:0/881402027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c17f7a2b60 0x55c17f89f480 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:46.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.955+0000 7fc347719800 1 -- 172.21.15.132:0/881402027 >> 172.21.15.132:0/881402027 conn(0x55c17f79e6a0 msgr2=0x55c17f891b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:46.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.955+0000 7fc347719800 1 -- 172.21.15.132:0/881402027 shutdown_connections 2024-05-08T18:50:46.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:46.955+0000 7fc347719800 1 -- 172.21.15.132:0/881402027 wait complete. 2024-05-08T18:50:46.969 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:50:44.835566Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-08T18:50:46.806723Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:44.835553Z', 'tags': [], 'group_ids': []} 2024-05-08T18:50:46.969 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-05-08T18:50:46.969 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-05-08T18:50:46.969 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-05-08T18:50:47.055 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:47.055 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:47.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.056+0000 7fda9da06800 1 Processor -- start 2024-05-08T18:50:47.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.056+0000 7fda9da06800 1 -- start start 2024-05-08T18:50:47.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.057+0000 7fda9da06800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5595c82b9a30 0x5595c82bbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.057+0000 7fda9da06800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5595c82bc360 con 0x5595c82b37e0 2024-05-08T18:50:47.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.057+0000 7fda9da06800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x5595c8153e20 con 0x5595c82b9a30 2024-05-08T18:50:47.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.057+0000 7fda92cfd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5595c82b9a30 0x5595c82bbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.057+0000 7fda92cfd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5595c82b9a30 0x5595c82bbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60572/0 (socket says 172.21.15.132:60572) 2024-05-08T18:50:47.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.057+0000 7fda9b4fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x5595c82b37e0 0x5595c82b3c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46866/0 (socket says 172.21.15.132:46866) 2024-05-08T18:50:47.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.057+0000 7fda92cfd640 1 -- 172.21.15.132:0/2109248943 learned_addr learned my addr 172.21.15.132:0/2109248943 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.057+0000 7fda92cfd640 1 -- 172.21.15.132:0/2109248943 >> v1:172.21.15.42:6789/0 conn(0x5595c82b37e0 legacy=0x5595c82b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.057+0000 7fda92cfd640 1 -- 172.21.15.132:0/2109248943 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595c82bd540 con 0x5595c82b9a30 2024-05-08T18:50:47.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.059+0000 7fda92cfd640 1 --2- 172.21.15.132:0/2109248943 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c82b9a30 0x5595c82bbe20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fda8400a520 tx=0x7fda8401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb37b5ff80401dc4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.059+0000 7fda9acfd640 1 -- 172.21.15.132:0/2109248943 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda84057070 con 0x5595c82b9a30 2024-05-08T18:50:47.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.059+0000 7fda9acfd640 1 -- 172.21.15.132:0/2109248943 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda84052570 con 0x5595c82b9a30 2024-05-08T18:50:47.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.059+0000 7fda9acfd640 1 -- 172.21.15.132:0/2109248943 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda8404ae60 con 0x5595c82b9a30 2024-05-08T18:50:47.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.060+0000 7fda9da06800 1 -- 172.21.15.132:0/2109248943 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c82b9a30 msgr2=0x5595c82bbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.060+0000 7fda9da06800 1 --2- 172.21.15.132:0/2109248943 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c82b9a30 0x5595c82bbe20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fda8400a520 tx=0x7fda8401d010 comp rx=0 tx=0).stop 2024-05-08T18:50:47.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.060+0000 7fda9da06800 1 -- 172.21.15.132:0/2109248943 shutdown_connections 2024-05-08T18:50:47.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.060+0000 7fda9da06800 1 --2- 172.21.15.132:0/2109248943 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c82b9a30 0x5595c82bbe20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.060+0000 7fda9da06800 1 -- 172.21.15.132:0/2109248943 >> 172.21.15.132:0/2109248943 conn(0x5595c82aceb0 msgr2=0x5595c82af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.060+0000 7fda9da06800 1 -- 172.21.15.132:0/2109248943 shutdown_connections 2024-05-08T18:50:47.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.060+0000 7fda9da06800 1 -- 172.21.15.132:0/2109248943 wait complete. 2024-05-08T18:50:47.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.074+0000 7fda9da06800 1 Processor -- start 2024-05-08T18:50:47.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.074+0000 7fda9da06800 1 -- start start 2024-05-08T18:50:47.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.074+0000 7fda9da06800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c82b37e0 0x5595c83a67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.074+0000 7fda9da06800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5595c81fe5c0 con 0x5595c82b37e0 2024-05-08T18:50:47.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.074+0000 7fda9b4fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c82b37e0 0x5595c83a67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.074+0000 7fda9b4fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c82b37e0 0x5595c83a67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60586/0 (socket says 172.21.15.132:60586) 2024-05-08T18:50:47.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.074+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1355956278 learned_addr learned my addr 172.21.15.132:0/1355956278 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.075+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1355956278 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595c83a6d80 con 0x5595c82b37e0 2024-05-08T18:50:47.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.075+0000 7fda9b4fe640 1 --2- 172.21.15.132:0/1355956278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c82b37e0 0x5595c83a67b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fda8c001e40 tx=0x7fda8c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a006550180b513 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.075+0000 7fd98960a640 1 -- 172.21.15.132:0/1355956278 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda8c00e5c0 con 0x5595c82b37e0 2024-05-08T18:50:47.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.075+0000 7fd98960a640 1 -- 172.21.15.132:0/1355956278 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8c006070 con 0x5595c82b37e0 2024-05-08T18:50:47.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.075+0000 7fd98960a640 1 -- 172.21.15.132:0/1355956278 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda8c00e910 con 0x5595c82b37e0 2024-05-08T18:50:47.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.076+0000 7fda9da06800 1 -- 172.21.15.132:0/1355956278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c82b37e0 msgr2=0x5595c83a67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.076+0000 7fda9da06800 1 --2- 172.21.15.132:0/1355956278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c82b37e0 0x5595c83a67b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fda8c001e40 tx=0x7fda8c001e70 comp rx=0 tx=0).stop 2024-05-08T18:50:47.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.076+0000 7fda9da06800 1 -- 172.21.15.132:0/1355956278 shutdown_connections 2024-05-08T18:50:47.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.076+0000 7fda9da06800 1 --2- 172.21.15.132:0/1355956278 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c82b37e0 0x5595c83a67b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.076+0000 7fda9da06800 1 -- 172.21.15.132:0/1355956278 >> 172.21.15.132:0/1355956278 conn(0x5595c82aceb0 msgr2=0x5595c83a20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.076+0000 7fda9da06800 1 -- 172.21.15.132:0/1355956278 shutdown_connections 2024-05-08T18:50:47.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.076+0000 7fda9da06800 1 -- 172.21.15.132:0/1355956278 wait complete. 2024-05-08T18:50:47.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.076+0000 7fda9da06800 1 Processor -- start 2024-05-08T18:50:47.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.076+0000 7fda9da06800 1 -- start start 2024-05-08T18:50:47.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.076+0000 7fda9da06800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c82b37e0 0x5595c83ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.076+0000 7fda9da06800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5595c82bc830 con 0x5595c82b37e0 2024-05-08T18:50:47.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.076+0000 7fda9b4fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c82b37e0 0x5595c83ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.076+0000 7fda9b4fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c82b37e0 0x5595c83ae320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60598/0 (socket says 172.21.15.132:60598) 2024-05-08T18:50:47.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.076+0000 7fda9b4fe640 1 -- 172.21.15.132:0/2166616664 learned_addr learned my addr 172.21.15.132:0/2166616664 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.077+0000 7fda9b4fe640 1 -- 172.21.15.132:0/2166616664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595c83ae860 con 0x5595c82b37e0 2024-05-08T18:50:47.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.077+0000 7fda9b4fe640 1 --2- 172.21.15.132:0/2166616664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c82b37e0 0x5595c83ae320 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fda8c000f60 tx=0x7fda8c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.077+0000 7fd987e07640 1 -- 172.21.15.132:0/2166616664 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda8c00f8d0 con 0x5595c82b37e0 2024-05-08T18:50:47.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.077+0000 7fd987e07640 1 -- 172.21.15.132:0/2166616664 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8c00fa70 con 0x5595c82b37e0 2024-05-08T18:50:47.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.077+0000 7fd987e07640 1 -- 172.21.15.132:0/2166616664 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda8c00fd90 con 0x5595c82b37e0 2024-05-08T18:50:47.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.077+0000 7fda9da06800 1 -- 172.21.15.132:0/2166616664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595c83aeaf0 con 0x5595c82b37e0 2024-05-08T18:50:47.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.077+0000 7fda9da06800 1 -- 172.21.15.132:0/2166616664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595c83b17a0 con 0x5595c82b37e0 2024-05-08T18:50:47.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.078+0000 7fd987e07640 1 -- 172.21.15.132:0/2166616664 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fda8c017070 con 0x5595c82b37e0 2024-05-08T18:50:47.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.078+0000 7fd987e07640 1 --2- 172.21.15.132:0/2166616664 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd98003bb00 0x7fd98003dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.078+0000 7fd987e07640 1 -- 172.21.15.132:0/2166616664 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fda8c015020 con 0x5595c82b37e0 2024-05-08T18:50:47.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.078+0000 7fda92cfd640 1 --2- 172.21.15.132:0/2166616664 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd98003bb00 0x7fd98003dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.078+0000 7fda9da06800 1 --2- 172.21.15.132:0/2166616664 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5595c82b9a30 0x5595c83b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.078+0000 7fda9da06800 1 -- 172.21.15.132:0/2166616664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5595c83b5ae0 con 0x5595c82b9a30 2024-05-08T18:50:47.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.079+0000 7fda9bcff640 1 --2- 172.21.15.132:0/2166616664 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5595c82b9a30 0x5595c83b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.079+0000 7fda92cfd640 1 --2- 172.21.15.132:0/2166616664 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd98003bb00 0x7fd98003dfc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fda8400a520 tx=0x7fda8404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.079+0000 7fda9bcff640 1 --2- 172.21.15.132:0/2166616664 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5595c82b9a30 0x5595c83b5560 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.079+0000 7fda9bcff640 1 -- 172.21.15.132:0/2166616664 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda9400a4a0 con 0x5595c82b9a30 2024-05-08T18:50:47.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.079+0000 7fda9da06800 1 -- 172.21.15.132:0/2166616664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5595c83b2b30 con 0x5595c82b9a30 2024-05-08T18:50:47.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.079+0000 7fda9bcff640 1 -- 172.21.15.132:0/2166616664 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda9400a4a0 con 0x5595c82b9a30 2024-05-08T18:50:47.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.079+0000 7fda9da06800 1 --2- 172.21.15.132:0/2166616664 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5595c83b7e10 0x5595c83ba200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.079+0000 7fda9da06800 1 -- 172.21.15.132:0/2166616664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5595c83ba8f0 con 0x5595c83b7e10 2024-05-08T18:50:47.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.079+0000 7fda9b4fe640 1 --2- 172.21.15.132:0/2166616664 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5595c83b7e10 0x5595c83ba200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.080+0000 7fda9b4fe640 1 --2- 172.21.15.132:0/2166616664 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5595c83b7e10 0x5595c83ba200 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.080+0000 7fda9b4fe640 1 -- 172.21.15.132:0/2166616664 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fda8c02e070 con 0x5595c83b7e10 2024-05-08T18:50:47.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.080+0000 7fda9da06800 1 -- 172.21.15.132:0/2166616664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5595c83b6cb0 con 0x5595c82b9a30 2024-05-08T18:50:47.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.080+0000 7fda9bcff640 1 -- 172.21.15.132:0/2166616664 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda9400a4a0 con 0x5595c82b9a30 2024-05-08T18:50:47.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.080+0000 7fda9da06800 1 -- 172.21.15.132:0/2166616664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5595c83b7120 con 0x5595c82b9a30 2024-05-08T18:50:47.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.081+0000 7fda9bcff640 1 -- 172.21.15.132:0/2166616664 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fda9400a4a0 con 0x5595c82b9a30 2024-05-08T18:50:47.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.081+0000 7fda9da06800 1 Processor -- start 2024-05-08T18:50:47.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.081+0000 7fda9da06800 1 -- start start 2024-05-08T18:50:47.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.081+0000 7fda9da06800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c83c9880 0x5595c83c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.081+0000 7fda9da06800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5595c81a4fc0 con 0x5595c83c9880 2024-05-08T18:50:47.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.082+0000 7fda9bcff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c83c9880 0x5595c83c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.082+0000 7fda9bcff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c83c9880 0x5595c83c9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60612/0 (socket says 172.21.15.132:60612) 2024-05-08T18:50:47.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.082+0000 7fda9bcff640 1 -- 172.21.15.132:0/4120580519 learned_addr learned my addr 172.21.15.132:0/4120580519 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.082+0000 7fda9bcff640 1 -- 172.21.15.132:0/4120580519 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595c83ca1e0 con 0x5595c83c9880 2024-05-08T18:50:47.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.082+0000 7fda9bcff640 1 --2- 172.21.15.132:0/4120580519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c83c9880 0x5595c83c9ca0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x5595c83af720 tx=0x7fda94012fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.082+0000 7fd985602640 1 -- 172.21.15.132:0/4120580519 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda94014450 con 0x5595c83c9880 2024-05-08T18:50:47.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.082+0000 7fd985602640 1 -- 172.21.15.132:0/4120580519 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda94014610 con 0x5595c83c9880 2024-05-08T18:50:47.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.082+0000 7fda9da06800 1 -- 172.21.15.132:0/4120580519 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595c83cac50 con 0x5595c83c9880 2024-05-08T18:50:47.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.082+0000 7fd985602640 1 -- 172.21.15.132:0/4120580519 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda94014930 con 0x5595c83c9880 2024-05-08T18:50:47.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.082+0000 7fda9da06800 1 -- 172.21.15.132:0/4120580519 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595c83cb150 con 0x5595c83c9880 2024-05-08T18:50:47.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.083+0000 7fd985602640 1 -- 172.21.15.132:0/4120580519 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fda94011040 con 0x5595c83c9880 2024-05-08T18:50:47.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.083+0000 7fd985602640 1 --2- 172.21.15.132:0/4120580519 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd97403bba0 0x7fd97403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.083+0000 7fd985602640 1 -- 172.21.15.132:0/4120580519 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fda9401e070 con 0x5595c83c9880 2024-05-08T18:50:47.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.083+0000 7fda9b4fe640 1 --2- 172.21.15.132:0/4120580519 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd97403bba0 0x7fd97403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.084+0000 7fda9da06800 1 Processor -- start 2024-05-08T18:50:47.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.084+0000 7fda9b4fe640 1 --2- 172.21.15.132:0/4120580519 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd97403bba0 0x7fd97403e060 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x5595c83b5f60 tx=0x7fda8c051800 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.084+0000 7fda9da06800 1 -- start start 2024-05-08T18:50:47.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.084+0000 7fda9da06800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c83d6b40 0x5595c83d6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.084+0000 7fda9da06800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5595c83a7100 con 0x5595c83d6b40 2024-05-08T18:50:47.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.084+0000 7fda9bcff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c83d6b40 0x5595c83d6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.084+0000 7fda9bcff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c83d6b40 0x5595c83d6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60624/0 (socket says 172.21.15.132:60624) 2024-05-08T18:50:47.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.084+0000 7fda9bcff640 1 -- 172.21.15.132:0/1384546405 learned_addr learned my addr 172.21.15.132:0/1384546405 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.084+0000 7fda9bcff640 1 -- 172.21.15.132:0/1384546405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595c83d7530 con 0x5595c83d6b40 2024-05-08T18:50:47.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.084+0000 7fda9bcff640 1 --2- 172.21.15.132:0/1384546405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c83d6b40 0x5595c83d6f60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fda940113e0 tx=0x7fda940118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d244a593e940cb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.085+0000 7fd97effd640 1 -- 172.21.15.132:0/1384546405 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda94001310 con 0x5595c83d6b40 2024-05-08T18:50:47.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.085+0000 7fd97effd640 1 -- 172.21.15.132:0/1384546405 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda940167c0 con 0x5595c83d6b40 2024-05-08T18:50:47.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.085+0000 7fd97effd640 1 -- 172.21.15.132:0/1384546405 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda94014ad0 con 0x5595c83d6b40 2024-05-08T18:50:47.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.085+0000 7fda9da06800 1 -- 172.21.15.132:0/1384546405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c83d6b40 msgr2=0x5595c83d6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.085+0000 7fda9da06800 1 --2- 172.21.15.132:0/1384546405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c83d6b40 0x5595c83d6f60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fda940113e0 tx=0x7fda940118e0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.085+0000 7fda9da06800 1 -- 172.21.15.132:0/1384546405 shutdown_connections 2024-05-08T18:50:47.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.085+0000 7fda9da06800 1 --2- 172.21.15.132:0/1384546405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c83d6b40 0x5595c83d6f60 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.085+0000 7fda9da06800 1 -- 172.21.15.132:0/1384546405 >> 172.21.15.132:0/1384546405 conn(0x5595c83d2ea0 msgr2=0x5595c83d0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.085+0000 7fda9da06800 1 -- 172.21.15.132:0/1384546405 shutdown_connections 2024-05-08T18:50:47.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.085+0000 7fda9da06800 1 -- 172.21.15.132:0/1384546405 wait complete. 2024-05-08T18:50:47.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.085+0000 7fda9da06800 1 Processor -- start 2024-05-08T18:50:47.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.085+0000 7fda9da06800 1 -- start start 2024-05-08T18:50:47.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.086+0000 7fda9da06800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c83d6b40 0x5595c83de140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.086+0000 7fda9da06800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5595c83d7ca0 con 0x5595c83d6b40 2024-05-08T18:50:47.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.086+0000 7fda9bcff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c83d6b40 0x5595c83de140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.086+0000 7fda9bcff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c83d6b40 0x5595c83de140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60638/0 (socket says 172.21.15.132:60638) 2024-05-08T18:50:47.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.086+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 learned_addr learned my addr 172.21.15.132:0/1906851113 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.086+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595c83de680 con 0x5595c83d6b40 2024-05-08T18:50:47.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.086+0000 7fda9bcff640 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c83d6b40 0x5595c83de140 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fda94011f60 tx=0x7fda94052cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.086+0000 7fd97d7fa640 1 -- 172.21.15.132:0/1906851113 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda94001310 con 0x5595c83d6b40 2024-05-08T18:50:47.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.086+0000 7fd97d7fa640 1 -- 172.21.15.132:0/1906851113 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda94042110 con 0x5595c83d6b40 2024-05-08T18:50:47.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.086+0000 7fd97d7fa640 1 -- 172.21.15.132:0/1906851113 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda94042410 con 0x5595c83d6b40 2024-05-08T18:50:47.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.086+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595c83de910 con 0x5595c83d6b40 2024-05-08T18:50:47.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.086+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595c83e15c0 con 0x5595c83d6b40 2024-05-08T18:50:47.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.087+0000 7fd97d7fa640 1 -- 172.21.15.132:0/1906851113 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fda940425b0 con 0x5595c83d6b40 2024-05-08T18:50:47.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.088+0000 7fd97d7fa640 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd96403bba0 0x7fd96403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.088+0000 7fd97d7fa640 1 -- 172.21.15.132:0/1906851113 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fda9400e040 con 0x5595c83d6b40 2024-05-08T18:50:47.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.088+0000 7fda9b4fe640 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd96403bba0 0x7fd96403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.088+0000 7fda9b4fe640 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd96403bba0 0x7fd96403e060 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fda8c017d00 tx=0x7fda8c047000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.088+0000 7fda9da06800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.088+0000 7fda9da06800 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5595c83e9df0 0x5595c83ec2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.088+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5595c83eca00 con 0x5595c83e9df0 2024-05-08T18:50:47.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.088+0000 7fda92cfd640 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5595c83e9df0 0x5595c83ec2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.089+0000 7fda92cfd640 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5595c83e9df0 0x5595c83ec2b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.089+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda8405a040 con 0x5595c83e9df0 2024-05-08T18:50:47.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.089+0000 7fda9da06800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.089+0000 7fda9da06800 20 realm 2024-05-08T18:50:47.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.089+0000 7fda9da06800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.089+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5595c83ecdd0 con 0x5595c83e9df0 2024-05-08T18:50:47.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.089+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda8405a040 con 0x5595c83e9df0 2024-05-08T18:50:47.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.089+0000 7fda9da06800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.089+0000 7fda9da06800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:47.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.089+0000 7fda9da06800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.089+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5595c83ed6a0 con 0x5595c83e9df0 2024-05-08T18:50:47.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.089+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda8405a040 con 0x5595c83e9df0 2024-05-08T18:50:47.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.089+0000 7fda9da06800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.089+0000 7fda9da06800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.089+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5595c83eda40 con 0x5595c83e9df0 2024-05-08T18:50:47.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.090+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda8405a040 con 0x5595c83e9df0 2024-05-08T18:50:47.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.090+0000 7fda9da06800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:47.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.090+0000 7fda9da06800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.090+0000 7fda9da06800 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5595c83ee7a0 0x5595c83f0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.090+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f11a0 con 0x5595c83ee7a0 2024-05-08T18:50:47.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.090+0000 7fda9bcff640 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5595c83ee7a0 0x5595c83f0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.090+0000 7fda9bcff640 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5595c83ee7a0 0x5595c83f0b90 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.090+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fda9403f070 con 0x5595c83ee7a0 2024-05-08T18:50:47.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.090+0000 7fda9da06800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:47.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.090+0000 7fda9da06800 20 searching for the correct realm 2024-05-08T18:50:47.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.090+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x5595c83ee7a0 2024-05-08T18:50:47.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.091+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9403f070 con 0x5595c83ee7a0 2024-05-08T18:50:47.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.091+0000 7fda9bcff640 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fda94038020 0x7fda94017030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.091+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x7fda94038020 2024-05-08T18:50:47.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.091+0000 7fda9b4fe640 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fda94038020 0x7fda94017030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.091+0000 7fda9b4fe640 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fda94038020 0x7fda94017030 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.091+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1906851113 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8c02e070 con 0x7fda94038020 2024-05-08T18:50:47.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.091+0000 7fda9b4fe640 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fda8c00f070 0x7fda8c01d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.091+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x7fda8c00f070 2024-05-08T18:50:47.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.092+0000 7fda92cfd640 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fda8c00f070 0x7fda8c01d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.092+0000 7fda92cfd640 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fda8c00f070 0x7fda8c01d810 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.092+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8405a040 con 0x7fda8c00f070 2024-05-08T18:50:47.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.092+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x5595c83e9df0 2024-05-08T18:50:47.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.093+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8405a040 con 0x5595c83e9df0 2024-05-08T18:50:47.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.093+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x5595c83e9df0 2024-05-08T18:50:47.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.093+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8405a040 con 0x5595c83e9df0 2024-05-08T18:50:47.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.093+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x7fda8c00f070 2024-05-08T18:50:47.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.093+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8405a040 con 0x7fda8c00f070 2024-05-08T18:50:47.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.093+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x7fda8c00f070 2024-05-08T18:50:47.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.093+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8405a040 con 0x7fda8c00f070 2024-05-08T18:50:47.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.093+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x7fda94038020 2024-05-08T18:50:47.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.093+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1906851113 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8c02e070 con 0x7fda94038020 2024-05-08T18:50:47.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.093+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x5595c83ee7a0 2024-05-08T18:50:47.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.094+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9403f070 con 0x5595c83ee7a0 2024-05-08T18:50:47.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.094+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x5595c83e9df0 2024-05-08T18:50:47.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.094+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8405a040 con 0x5595c83e9df0 2024-05-08T18:50:47.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.094+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x7fda8c00f070 2024-05-08T18:50:47.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.094+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8405a040 con 0x7fda8c00f070 2024-05-08T18:50:47.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.094+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x5595c83e9df0 2024-05-08T18:50:47.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.094+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fda8405a040 con 0x5595c83e9df0 2024-05-08T18:50:47.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.094+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x7fda94038020 2024-05-08T18:50:47.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.095+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1906851113 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fda8c02e070 con 0x7fda94038020 2024-05-08T18:50:47.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.095+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x5595c83ee7a0 2024-05-08T18:50:47.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.095+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fda9403f070 con 0x5595c83ee7a0 2024-05-08T18:50:47.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.095+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x5595c83ee7a0 2024-05-08T18:50:47.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.095+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9403f070 con 0x5595c83ee7a0 2024-05-08T18:50:47.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.095+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x7fda8c00f070 2024-05-08T18:50:47.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.095+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8405a040 con 0x7fda8c00f070 2024-05-08T18:50:47.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.095+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x5595c83ee7a0 2024-05-08T18:50:47.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.096+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9403f070 con 0x5595c83ee7a0 2024-05-08T18:50:47.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.096+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x5595c83ee7a0 2024-05-08T18:50:47.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.096+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9403f070 con 0x5595c83ee7a0 2024-05-08T18:50:47.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.096+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x5595c83e9df0 2024-05-08T18:50:47.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.096+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8405a040 con 0x5595c83e9df0 2024-05-08T18:50:47.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.096+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x5595c83e9df0 2024-05-08T18:50:47.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.096+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fda8405a040 con 0x5595c83e9df0 2024-05-08T18:50:47.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.096+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x7fda8c00f070 2024-05-08T18:50:47.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.096+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8407d040 con 0x7fda8c00f070 2024-05-08T18:50:47.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.097+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x5595c83ee7a0 2024-05-08T18:50:47.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.097+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9403f070 con 0x5595c83ee7a0 2024-05-08T18:50:47.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.097+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x7fda94038020 2024-05-08T18:50:47.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.097+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1906851113 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8c02e070 con 0x7fda94038020 2024-05-08T18:50:47.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.097+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x5595c83e9df0 2024-05-08T18:50:47.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.097+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8407d040 con 0x5595c83e9df0 2024-05-08T18:50:47.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.097+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x7fda8c00f070 2024-05-08T18:50:47.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.097+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8407d040 con 0x7fda8c00f070 2024-05-08T18:50:47.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.098+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x5595c83ee7a0 2024-05-08T18:50:47.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.098+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9403f070 con 0x5595c83ee7a0 2024-05-08T18:50:47.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.098+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x7fda8c00f070 2024-05-08T18:50:47.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.098+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8407d040 con 0x7fda8c00f070 2024-05-08T18:50:47.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.098+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x7fda94038020 2024-05-08T18:50:47.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.098+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1906851113 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8c02e070 con 0x7fda94038020 2024-05-08T18:50:47.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.098+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x5595c83ee7a0 2024-05-08T18:50:47.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.098+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda9403f070 con 0x5595c83ee7a0 2024-05-08T18:50:47.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.098+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x7fda8c00f070 2024-05-08T18:50:47.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.099+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8407d040 con 0x7fda8c00f070 2024-05-08T18:50:47.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.099+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x5595c83e9df0 2024-05-08T18:50:47.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.099+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fda8407d040 con 0x5595c83e9df0 2024-05-08T18:50:47.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.099+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2ab0 con 0x7fda94038020 2024-05-08T18:50:47.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.099+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1906851113 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda8c02e070 con 0x7fda94038020 2024-05-08T18:50:47.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:47.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:47.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:47.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:47.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:47.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:47.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f19f0 con 0x5595c83e9df0 2024-05-08T18:50:47.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda8407d040 con 0x5595c83e9df0 2024-05-08T18:50:47.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f1de0 con 0x5595c83e9df0 2024-05-08T18:50:47.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda8407d040 con 0x5595c83e9df0 2024-05-08T18:50:47.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:47.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f2f30 con 0x5595c83e9df0 2024-05-08T18:50:47.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fda8407d040 con 0x5595c83e9df0 2024-05-08T18:50:47.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:47.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 20 zone default found 2024-05-08T18:50:47.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 4 Realm: () 2024-05-08T18:50:47.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:47.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:47.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:47.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 20 zonegroup default 2024-05-08T18:50:47.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.100+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f32f0 con 0x7fda8c00f070 2024-05-08T18:50:47.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.101+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fda8407d040 con 0x7fda8c00f070 2024-05-08T18:50:47.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.101+0000 7fda9da06800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.101+0000 7fda9da06800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.101+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f5110 con 0x5595c83ee7a0 2024-05-08T18:50:47.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.101+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fda9403f070 con 0x5595c83ee7a0 2024-05-08T18:50:47.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.101+0000 7fda9da06800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.101+0000 7fda9da06800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.101+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f5540 con 0x5595c83ee7a0 2024-05-08T18:50:47.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.101+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fda9403f070 con 0x5595c83ee7a0 2024-05-08T18:50:47.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.101+0000 7fda9da06800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.101+0000 7fda9da06800 20 started sync module instance, tier type = 2024-05-08T18:50:47.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.101+0000 7fda9da06800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:47.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.101+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f45b0 con 0x7fda94038020 2024-05-08T18:50:47.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.102+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1906851113 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x7fda94038020 2024-05-08T18:50:47.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.102+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94101798076672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f59a0 con 0x7fda94038020 2024-05-08T18:50:47.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.102+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f61f0 con 0x5595c83e9df0 2024-05-08T18:50:47.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.103+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1906851113 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94101798076672] v25'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x7fda94038020 2024-05-08T18:50:47.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.104+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8407d040 con 0x5595c83e9df0 2024-05-08T18:50:47.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.104+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94101798083904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f6610 con 0x5595c83e9df0 2024-05-08T18:50:47.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.104+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f6ea0 con 0x5595c83ee7a0 2024-05-08T18:50:47.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.105+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda9403f070 con 0x5595c83ee7a0 2024-05-08T18:50:47.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.105+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94101798086160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f6ad0 con 0x5595c83ee7a0 2024-05-08T18:50:47.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.105+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f7e90 con 0x7fda94038020 2024-05-08T18:50:47.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.105+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94101798083904] v25'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8407d040 con 0x5595c83e9df0 2024-05-08T18:50:47.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.106+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1906851113 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x7fda94038020 2024-05-08T18:50:47.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.106+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94101798091104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f8280 con 0x7fda94038020 2024-05-08T18:50:47.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.106+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f8ca0 con 0x5595c83e9df0 2024-05-08T18:50:47.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.106+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94101798086160] v25'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda9403f070 con 0x5595c83ee7a0 2024-05-08T18:50:47.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.107+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8407d040 con 0x5595c83e9df0 2024-05-08T18:50:47.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.107+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94101798094736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f90c0 con 0x5595c83e9df0 2024-05-08T18:50:47.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.107+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f9ae0 con 0x7fda8c00f070 2024-05-08T18:50:47.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.107+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1906851113 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94101798091104] v25'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x7fda94038020 2024-05-08T18:50:47.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.108+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8407d040 con 0x7fda8c00f070 2024-05-08T18:50:47.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.108+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94101798098384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f9aa0 con 0x7fda8c00f070 2024-05-08T18:50:47.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.108+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83fa4f0 con 0x7fda8c00f070 2024-05-08T18:50:47.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.108+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94101798094736] v25'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8407d040 con 0x5595c83e9df0 2024-05-08T18:50:47.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.109+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94101798098384] v25'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8407d040 con 0x7fda8c00f070 2024-05-08T18:50:47.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.109+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8407d040 con 0x7fda8c00f070 2024-05-08T18:50:47.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.109+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94101798084960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83fa040 con 0x7fda8c00f070 2024-05-08T18:50:47.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.109+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83fa8f0 con 0x7fda8c00f070 2024-05-08T18:50:47.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.110+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94101798084960] v25'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8407d040 con 0x7fda8c00f070 2024-05-08T18:50:47.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.110+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8407d040 con 0x7fda8c00f070 2024-05-08T18:50:47.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.110+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94101798089360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83faad0 con 0x7fda8c00f070 2024-05-08T18:50:47.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.110+0000 7fda9da06800 20 add_watcher() i=0 2024-05-08T18:50:47.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.110+0000 7fda9da06800 20 add_watcher() i=1 2024-05-08T18:50:47.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.110+0000 7fda9da06800 20 add_watcher() i=2 2024-05-08T18:50:47.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.110+0000 7fda9da06800 20 add_watcher() i=3 2024-05-08T18:50:47.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.110+0000 7fda9da06800 20 add_watcher() i=4 2024-05-08T18:50:47.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.110+0000 7fda9da06800 20 add_watcher() i=5 2024-05-08T18:50:47.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.110+0000 7fda9da06800 20 add_watcher() i=6 2024-05-08T18:50:47.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.111+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94101798089360] v25'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8407d040 con 0x7fda8c00f070 2024-05-08T18:50:47.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.111+0000 7fda9da06800 20 add_watcher() i=7 2024-05-08T18:50:47.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.111+0000 7fda9da06800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:47.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.111+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5595c83fdea0 con 0x5595c83e9df0 2024-05-08T18:50:47.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.111+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fda8407d040 con 0x5595c83e9df0 2024-05-08T18:50:47.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.111+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94101798103488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83fb290 con 0x5595c83e9df0 2024-05-08T18:50:47.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.112+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94101798103488] v25'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda8407d040 con 0x5595c83e9df0 2024-05-08T18:50:47.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.112+0000 7fd951fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:47.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.113+0000 7fda9da06800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:47.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.113+0000 7fda9da06800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:47.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.113+0000 7fda9da06800 5 note: GC not initialized 2024-05-08T18:50:47.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.113+0000 7fd950fe1640 20 reqs_thread_entry: start 2024-05-08T18:50:47.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.113+0000 7fda9da06800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:47.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.113+0000 7fda9da06800 20 Filter name: none 2024-05-08T18:50:47.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.113+0000 7fd8ca7fc640 20 reqs_thread_entry: start 2024-05-08T18:50:47.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.113+0000 7fda9da06800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:50:47.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.113+0000 7fda9da06800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.113+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5595c84311f0 con 0x5595c83e9df0 2024-05-08T18:50:47.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.113+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7fda8407d040 con 0x5595c83e9df0 2024-05-08T18:50:47.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.113+0000 7fda9da06800 20 rados_obj.operate() r=0 bl.length=673 2024-05-08T18:50:47.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.113+0000 7fda9da06800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:50:47.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.113+0000 7fda9da06800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:47.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.113+0000 7fda9da06800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:47.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.114+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c8437d30 con 0x5595c83e9df0 2024-05-08T18:50:47.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.115+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v25'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fda8407d040 con 0x5595c83e9df0 2024-05-08T18:50:47.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.115+0000 7fda9da06800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:47.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.115+0000 7fda9da06800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:47.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.115+0000 7fda9da06800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:50:47.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.115+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94101798352624 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5595c8433390 con 0x5595c83e9df0 2024-05-08T18:50:47.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.115+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== watch-notify(notify (1) cookie 94101798094736 notify 107374182408 ret 0) ==== 800+0+0 (crc 0 0 0) 0x5595c82bd540 con 0x5595c83e9df0 2024-05-08T18:50:47.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.115+0000 7fd97effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182408 cookie 94101798094736 notifier 4396 bl.length()=758 2024-05-08T18:50:47.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.115+0000 7fd97effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:47.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.115+0000 7fd97effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:47.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.115+0000 7fd97effd640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7fd960003ea0 con 0x5595c83e9df0 2024-05-08T18:50:47.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.115+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(64 notify.4 [notify cookie 94101798352624 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fda8407d040 con 0x5595c83e9df0 2024-05-08T18:50:47.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.115+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8407d040 con 0x5595c83e9df0 2024-05-08T18:50:47.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.115+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== watch-notify(notify_complete (2) cookie 94101798352624 notify 107374182408 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fda8405db60 con 0x5595c83e9df0 2024-05-08T18:50:47.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.115+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c84376f0 con 0x5595c83e9df0 2024-05-08T18:50:47.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.116+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(66 foo:foo1 [delete] v25'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8407d040 con 0x5595c83e9df0 2024-05-08T18:50:47.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.116+0000 7fda9da06800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-05-08T18:50:47.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.116+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94101798352624 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5595c8432ee0 con 0x7fda94038020 2024-05-08T18:50:47.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.117+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1906851113 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== watch-notify(notify (1) cookie 94101798076672 notify 107374182404 ret 0) ==== 201+0+0 (crc 0 0 0) 0x5595c83b17a0 con 0x7fda94038020 2024-05-08T18:50:47.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.117+0000 7fd97e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182404 cookie 94101798076672 notifier 4396 bl.length()=159 2024-05-08T18:50:47.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.117+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1906851113 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(67 notify.0 [notify cookie 94101798352624 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fda8c02e070 con 0x7fda94038020 2024-05-08T18:50:47.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.117+0000 7fd97e7fc640 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7fd8d00032c0 con 0x7fda94038020 2024-05-08T18:50:47.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.117+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1906851113 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== watch-notify(notify_complete (2) cookie 94101798352624 notify 107374182404 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5595c83aeaf0 con 0x7fda94038020 2024-05-08T18:50:47.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.117+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1906851113 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x7fda94038020 2024-05-08T18:50:47.138 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:50:44.835566Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-08T18:50:46.806723Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:44.835553Z","tags":[],"group_ids":[]} 2024-05-08T18:50:47.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.118+0000 7fd951fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:47.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.118+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94101798103488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c842f8d0 con 0x5595c83e9df0 2024-05-08T18:50:47.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.119+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94101798103488] v25'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda8407d040 con 0x5595c83e9df0 2024-05-08T18:50:47.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.119+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94101798076672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c842f8d0 con 0x7fda94038020 2024-05-08T18:50:47.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.120+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1906851113 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94101798076672] v25'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x7fda94038020 2024-05-08T18:50:47.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.120+0000 7fda9da06800 20 remove_watcher() i=0 2024-05-08T18:50:47.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.120+0000 7fda9da06800 2 removed watcher, disabling cache 2024-05-08T18:50:47.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.120+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94101798083904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f4100 con 0x5595c83e9df0 2024-05-08T18:50:47.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.121+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94101798083904] v25'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8407d040 con 0x5595c83e9df0 2024-05-08T18:50:47.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.121+0000 7fda9da06800 20 remove_watcher() i=1 2024-05-08T18:50:47.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.121+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94101798086160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f4100 con 0x5595c83ee7a0 2024-05-08T18:50:47.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.122+0000 7fda9bcff640 1 -- 172.21.15.132:0/1906851113 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94101798086160] v25'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda9403f070 con 0x5595c83ee7a0 2024-05-08T18:50:47.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.122+0000 7fda9da06800 20 remove_watcher() i=2 2024-05-08T18:50:47.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.122+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94101798091104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f6610 con 0x7fda94038020 2024-05-08T18:50:47.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.123+0000 7fda9b4fe640 1 -- 172.21.15.132:0/1906851113 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94101798091104] v25'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8c02e070 con 0x7fda94038020 2024-05-08T18:50:47.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.123+0000 7fda9da06800 20 remove_watcher() i=3 2024-05-08T18:50:47.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.123+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94101798094736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f4100 con 0x5595c83e9df0 2024-05-08T18:50:47.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.124+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94101798094736] v25'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8407d040 con 0x5595c83e9df0 2024-05-08T18:50:47.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.124+0000 7fda9da06800 20 remove_watcher() i=4 2024-05-08T18:50:47.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.124+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94101798098384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f7960 con 0x7fda8c00f070 2024-05-08T18:50:47.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.125+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94101798098384] v25'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8407d040 con 0x7fda8c00f070 2024-05-08T18:50:47.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.125+0000 7fda9da06800 20 remove_watcher() i=5 2024-05-08T18:50:47.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.125+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94101798084960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f6610 con 0x7fda8c00f070 2024-05-08T18:50:47.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.126+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94101798084960] v25'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8407d040 con 0x7fda8c00f070 2024-05-08T18:50:47.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.126+0000 7fda9da06800 20 remove_watcher() i=6 2024-05-08T18:50:47.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.126+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94101798089360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5595c83f8790 con 0x7fda8c00f070 2024-05-08T18:50:47.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.127+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94101798089360] v25'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda8407d040 con 0x7fda8c00f070 2024-05-08T18:50:47.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.127+0000 7fda9da06800 20 remove_watcher() i=7 2024-05-08T18:50:47.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fda8c00f070 msgr2=0x7fda8c01d810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fda8c00f070 0x7fda8c01d810 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5595c83e9df0 msgr2=0x5595c83ec2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5595c83e9df0 0x5595c83ec2b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fda94038020 msgr2=0x7fda94017030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fda94038020 0x7fda94017030 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5595c83ee7a0 msgr2=0x5595c83f0b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5595c83ee7a0 0x5595c83f0b90 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd96403bba0 msgr2=0x7fd96403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd96403bba0 0x7fd96403e060 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fda8c017d00 tx=0x7fda8c047000 comp rx=0 tx=0).stop 2024-05-08T18:50:47.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c83d6b40 msgr2=0x5595c83de140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda92cfd640 1 -- 172.21.15.132:0/1906851113 reap_dead start 2024-05-08T18:50:47.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c83d6b40 0x5595c83de140 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fda94011f60 tx=0x7fda94052cd0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 shutdown_connections 2024-05-08T18:50:47.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 --2- 172.21.15.132:0/1906851113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c83d6b40 0x5595c83de140 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 >> 172.21.15.132:0/1906851113 conn(0x5595c83d2ea0 msgr2=0x5595c83d0500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 shutdown_connections 2024-05-08T18:50:47.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 -- 172.21.15.132:0/1906851113 wait complete. 2024-05-08T18:50:47.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 -- 172.21.15.132:0/4120580519 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd97403bba0 msgr2=0x7fd97403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 --2- 172.21.15.132:0/4120580519 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd97403bba0 0x7fd97403e060 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x5595c83b5f60 tx=0x7fda8c051800 comp rx=0 tx=0).stop 2024-05-08T18:50:47.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 -- 172.21.15.132:0/4120580519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c83c9880 msgr2=0x5595c83c9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 --2- 172.21.15.132:0/4120580519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c83c9880 0x5595c83c9ca0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x5595c83af720 tx=0x7fda94012fd0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 -- 172.21.15.132:0/4120580519 shutdown_connections 2024-05-08T18:50:47.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 --2- 172.21.15.132:0/4120580519 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd97403bba0 0x7fd97403e060 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 --2- 172.21.15.132:0/4120580519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c83c9880 0x5595c83c9ca0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 -- 172.21.15.132:0/4120580519 >> 172.21.15.132:0/4120580519 conn(0x5595c83bd920 msgr2=0x5595c83bdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 -- 172.21.15.132:0/4120580519 shutdown_connections 2024-05-08T18:50:47.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.128+0000 7fda9da06800 1 -- 172.21.15.132:0/4120580519 wait complete. 2024-05-08T18:50:47.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.129+0000 7fda9da06800 1 -- 172.21.15.132:0/2166616664 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5595c82b9a30 msgr2=0x5595c83b5560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.129+0000 7fda9da06800 1 --2- 172.21.15.132:0/2166616664 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5595c82b9a30 0x5595c83b5560 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.129+0000 7fda9da06800 1 -- 172.21.15.132:0/2166616664 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5595c83b7e10 msgr2=0x5595c83ba200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.129+0000 7fda9da06800 1 --2- 172.21.15.132:0/2166616664 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5595c83b7e10 0x5595c83ba200 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.129+0000 7fda9da06800 1 -- 172.21.15.132:0/2166616664 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd98003bb00 msgr2=0x7fd98003dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.129+0000 7fda9da06800 1 --2- 172.21.15.132:0/2166616664 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd98003bb00 0x7fd98003dfc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fda8400a520 tx=0x7fda8404e000 comp rx=0 tx=0).stop 2024-05-08T18:50:47.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.129+0000 7fda9da06800 1 -- 172.21.15.132:0/2166616664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c82b37e0 msgr2=0x5595c83ae320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.129+0000 7fda9da06800 1 --2- 172.21.15.132:0/2166616664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c82b37e0 0x5595c83ae320 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fda8c000f60 tx=0x7fda8c000bc0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.129+0000 7fda9da06800 1 -- 172.21.15.132:0/2166616664 shutdown_connections 2024-05-08T18:50:47.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.129+0000 7fda9da06800 1 --2- 172.21.15.132:0/2166616664 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5595c83b7e10 0x5595c83ba200 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.129+0000 7fda9da06800 1 --2- 172.21.15.132:0/2166616664 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5595c82b9a30 0x5595c83b5560 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.129+0000 7fda9da06800 1 --2- 172.21.15.132:0/2166616664 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd98003bb00 0x7fd98003dfc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.129+0000 7fda9da06800 1 --2- 172.21.15.132:0/2166616664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5595c82b37e0 0x5595c83ae320 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.129+0000 7fda9da06800 1 -- 172.21.15.132:0/2166616664 >> 172.21.15.132:0/2166616664 conn(0x5595c82aceb0 msgr2=0x5595c83a08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.129+0000 7fda9da06800 1 -- 172.21.15.132:0/2166616664 shutdown_connections 2024-05-08T18:50:47.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.129+0000 7fda9da06800 1 -- 172.21.15.132:0/2166616664 wait complete. 2024-05-08T18:50:47.151 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:50:44.835566Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-08T18:50:46.806723Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:44.835553Z', 'tags': [], 'group_ids': []} 2024-05-08T18:50:47.152 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-05-08T18:50:47.152 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-05-08T18:50:47.152 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-05-08T18:50:47.196 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:47.196 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:47.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.198+0000 7fc177415800 1 Processor -- start 2024-05-08T18:50:47.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.198+0000 7fc177415800 1 -- start start 2024-05-08T18:50:47.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.198+0000 7fc177415800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x562d1e706140 0x562d1e706560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.198+0000 7fc177415800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562d1e706be0 con 0x562d1e7073a0 2024-05-08T18:50:47.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.198+0000 7fc177415800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x562d1e5a7e20 con 0x562d1e706140 2024-05-08T18:50:47.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.198+0000 7fc1729d5640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x562d1e706140 0x562d1e706560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.198+0000 7fc1729d5640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x562d1e706140 0x562d1e706560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60648/0 (socket says 172.21.15.132:60648) 2024-05-08T18:50:47.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.198+0000 7fc16bfff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x562d1e7073a0 0x562d1e707820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46872/0 (socket says 172.21.15.132:46872) 2024-05-08T18:50:47.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.198+0000 7fc1729d5640 1 -- 172.21.15.132:0/3228993303 learned_addr learned my addr 172.21.15.132:0/3228993303 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.199+0000 7fc1729d5640 1 -- 172.21.15.132:0/3228993303 >> v1:172.21.15.42:6789/0 conn(0x562d1e7073a0 legacy=0x562d1e707820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.199+0000 7fc1729d5640 1 -- 172.21.15.132:0/3228993303 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d1e707f60 con 0x562d1e706140 2024-05-08T18:50:47.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.200+0000 7fc1729d5640 1 --2- 172.21.15.132:0/3228993303 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e706140 0x562d1e706560 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc16400a520 tx=0x7fc16401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99536c6402f277 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.201+0000 7fc1721d4640 1 -- 172.21.15.132:0/3228993303 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc164057070 con 0x562d1e706140 2024-05-08T18:50:47.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.201+0000 7fc1721d4640 1 -- 172.21.15.132:0/3228993303 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc164052570 con 0x562d1e706140 2024-05-08T18:50:47.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.201+0000 7fc1721d4640 1 -- 172.21.15.132:0/3228993303 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc164052870 con 0x562d1e706140 2024-05-08T18:50:47.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.201+0000 7fc177415800 1 -- 172.21.15.132:0/3228993303 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e706140 msgr2=0x562d1e706560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.201+0000 7fc177415800 1 --2- 172.21.15.132:0/3228993303 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e706140 0x562d1e706560 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc16400a520 tx=0x7fc16401d010 comp rx=0 tx=0).stop 2024-05-08T18:50:47.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.201+0000 7fc177415800 1 -- 172.21.15.132:0/3228993303 shutdown_connections 2024-05-08T18:50:47.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.201+0000 7fc177415800 1 --2- 172.21.15.132:0/3228993303 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e706140 0x562d1e706560 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.201+0000 7fc177415800 1 -- 172.21.15.132:0/3228993303 >> 172.21.15.132:0/3228993303 conn(0x562d1e701720 msgr2=0x562d1e703b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.201+0000 7fc177415800 1 -- 172.21.15.132:0/3228993303 shutdown_connections 2024-05-08T18:50:47.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.201+0000 7fc177415800 1 -- 172.21.15.132:0/3228993303 wait complete. 2024-05-08T18:50:47.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.215+0000 7fc177415800 1 Processor -- start 2024-05-08T18:50:47.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.215+0000 7fc177415800 1 -- start start 2024-05-08T18:50:47.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.215+0000 7fc177415800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e706140 0x562d1e67a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.215+0000 7fc177415800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562d1e6525b0 con 0x562d1e706140 2024-05-08T18:50:47.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.215+0000 7fc1729d5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e706140 0x562d1e67a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.215+0000 7fc1729d5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e706140 0x562d1e67a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60660/0 (socket says 172.21.15.132:60660) 2024-05-08T18:50:47.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.215+0000 7fc1729d5640 1 -- 172.21.15.132:0/3005548469 learned_addr learned my addr 172.21.15.132:0/3005548469 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.216+0000 7fc1729d5640 1 -- 172.21.15.132:0/3005548469 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d1e7fb4b0 con 0x562d1e706140 2024-05-08T18:50:47.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.216+0000 7fc1729d5640 1 --2- 172.21.15.132:0/3005548469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e706140 0x562d1e67a2c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc164055040 tx=0x7fc16404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f5c43d3c77a176 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.216+0000 7fc060e09640 1 -- 172.21.15.132:0/3005548469 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc164057040 con 0x562d1e706140 2024-05-08T18:50:47.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.216+0000 7fc060e09640 1 -- 172.21.15.132:0/3005548469 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc164052850 con 0x562d1e706140 2024-05-08T18:50:47.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.216+0000 7fc060e09640 1 -- 172.21.15.132:0/3005548469 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc164052b50 con 0x562d1e706140 2024-05-08T18:50:47.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.217+0000 7fc177415800 1 -- 172.21.15.132:0/3005548469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e706140 msgr2=0x562d1e67a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.217+0000 7fc177415800 1 --2- 172.21.15.132:0/3005548469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e706140 0x562d1e67a2c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc164055040 tx=0x7fc16404c000 comp rx=0 tx=0).stop 2024-05-08T18:50:47.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.217+0000 7fc177415800 1 -- 172.21.15.132:0/3005548469 shutdown_connections 2024-05-08T18:50:47.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.217+0000 7fc177415800 1 --2- 172.21.15.132:0/3005548469 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e706140 0x562d1e67a2c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.217+0000 7fc177415800 1 -- 172.21.15.132:0/3005548469 >> 172.21.15.132:0/3005548469 conn(0x562d1e701720 msgr2=0x562d1e7f2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.217+0000 7fc177415800 1 -- 172.21.15.132:0/3005548469 shutdown_connections 2024-05-08T18:50:47.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.217+0000 7fc177415800 1 -- 172.21.15.132:0/3005548469 wait complete. 2024-05-08T18:50:47.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.217+0000 7fc177415800 1 Processor -- start 2024-05-08T18:50:47.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.217+0000 7fc177415800 1 -- start start 2024-05-08T18:50:47.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.217+0000 7fc177415800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e706140 0x562d1e8001a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.217+0000 7fc177415800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562d1e70f870 con 0x562d1e706140 2024-05-08T18:50:47.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.218+0000 7fc1729d5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e706140 0x562d1e8001a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.218+0000 7fc1729d5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e706140 0x562d1e8001a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60670/0 (socket says 172.21.15.132:60670) 2024-05-08T18:50:47.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.218+0000 7fc1729d5640 1 -- 172.21.15.132:0/2104266179 learned_addr learned my addr 172.21.15.132:0/2104266179 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.218+0000 7fc1729d5640 1 -- 172.21.15.132:0/2104266179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d1e8006e0 con 0x562d1e706140 2024-05-08T18:50:47.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.218+0000 7fc1729d5640 1 --2- 172.21.15.132:0/2104266179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e706140 0x562d1e8001a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc16400a520 tx=0x7fc164003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.218+0000 7fc05f606640 1 -- 172.21.15.132:0/2104266179 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc164073070 con 0x562d1e706140 2024-05-08T18:50:47.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.218+0000 7fc177415800 1 -- 172.21.15.132:0/2104266179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d1e800970 con 0x562d1e706140 2024-05-08T18:50:47.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.218+0000 7fc05f606640 1 -- 172.21.15.132:0/2104266179 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc16405d650 con 0x562d1e706140 2024-05-08T18:50:47.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.218+0000 7fc05f606640 1 -- 172.21.15.132:0/2104266179 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc164057070 con 0x562d1e706140 2024-05-08T18:50:47.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.218+0000 7fc177415800 1 -- 172.21.15.132:0/2104266179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d1e803620 con 0x562d1e706140 2024-05-08T18:50:47.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.219+0000 7fc05f606640 1 -- 172.21.15.132:0/2104266179 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc164076070 con 0x562d1e706140 2024-05-08T18:50:47.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.219+0000 7fc05f606640 1 --2- 172.21.15.132:0/2104266179 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc05803bb50 0x7fc05803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.220+0000 7fc05f606640 1 -- 172.21.15.132:0/2104266179 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fc164094060 con 0x562d1e706140 2024-05-08T18:50:47.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.220+0000 7fc16bfff640 1 --2- 172.21.15.132:0/2104266179 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc05803bb50 0x7fc05803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.220+0000 7fc177415800 1 --2- 172.21.15.132:0/2104266179 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562d1e7073a0 0x562d1e8073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.220+0000 7fc177415800 1 -- 172.21.15.132:0/2104266179 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562d1e807960 con 0x562d1e7073a0 2024-05-08T18:50:47.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.220+0000 7fc1731d6640 1 --2- 172.21.15.132:0/2104266179 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562d1e7073a0 0x562d1e8073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.220+0000 7fc16bfff640 1 --2- 172.21.15.132:0/2104266179 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc05803bb50 0x7fc05803e010 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc15c000f60 tx=0x7fc15c001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.220+0000 7fc1731d6640 1 --2- 172.21.15.132:0/2104266179 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562d1e7073a0 0x562d1e8073e0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.220+0000 7fc1731d6640 1 -- 172.21.15.132:0/2104266179 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc16c00a4a0 con 0x562d1e7073a0 2024-05-08T18:50:47.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.220+0000 7fc177415800 1 -- 172.21.15.132:0/2104266179 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562d1e8049b0 con 0x562d1e7073a0 2024-05-08T18:50:47.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.221+0000 7fc1731d6640 1 -- 172.21.15.132:0/2104266179 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc16c00a4a0 con 0x562d1e7073a0 2024-05-08T18:50:47.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.221+0000 7fc177415800 1 --2- 172.21.15.132:0/2104266179 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562d1e809c90 0x562d1e80c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.221+0000 7fc177415800 1 -- 172.21.15.132:0/2104266179 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562d1e80c770 con 0x562d1e809c90 2024-05-08T18:50:47.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.221+0000 7fc1729d5640 1 --2- 172.21.15.132:0/2104266179 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562d1e809c90 0x562d1e80c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.221+0000 7fc1729d5640 1 --2- 172.21.15.132:0/2104266179 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562d1e809c90 0x562d1e80c080 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.221+0000 7fc1729d5640 1 -- 172.21.15.132:0/2104266179 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc164075030 con 0x562d1e809c90 2024-05-08T18:50:47.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.221+0000 7fc177415800 1 -- 172.21.15.132:0/2104266179 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562d1e808b30 con 0x562d1e7073a0 2024-05-08T18:50:47.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.222+0000 7fc1731d6640 1 -- 172.21.15.132:0/2104266179 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc16c00a4a0 con 0x562d1e7073a0 2024-05-08T18:50:47.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.222+0000 7fc177415800 1 -- 172.21.15.132:0/2104266179 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562d1e809010 con 0x562d1e7073a0 2024-05-08T18:50:47.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.222+0000 7fc1731d6640 1 -- 172.21.15.132:0/2104266179 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc16c00a4a0 con 0x562d1e7073a0 2024-05-08T18:50:47.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.222+0000 7fc177415800 1 Processor -- start 2024-05-08T18:50:47.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.222+0000 7fc177415800 1 -- start start 2024-05-08T18:50:47.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.222+0000 7fc177415800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e7f9040 0x562d1e7f74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.222+0000 7fc177415800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562d1e5f8fc0 con 0x562d1e7f9040 2024-05-08T18:50:47.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.223+0000 7fc1731d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e7f9040 0x562d1e7f74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.223+0000 7fc1731d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e7f9040 0x562d1e7f74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60686/0 (socket says 172.21.15.132:60686) 2024-05-08T18:50:47.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.223+0000 7fc1731d6640 1 -- 172.21.15.132:0/1789555315 learned_addr learned my addr 172.21.15.132:0/1789555315 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.223+0000 7fc1731d6640 1 -- 172.21.15.132:0/1789555315 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d1e7f79f0 con 0x562d1e7f9040 2024-05-08T18:50:47.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.223+0000 7fc1731d6640 1 --2- 172.21.15.132:0/1789555315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e7f9040 0x562d1e7f74b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x562d1e807d40 tx=0x7fc16c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.223+0000 7fc05ce01640 1 -- 172.21.15.132:0/1789555315 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc16c014450 con 0x562d1e7f9040 2024-05-08T18:50:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.223+0000 7fc05ce01640 1 -- 172.21.15.132:0/1789555315 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc16c014610 con 0x562d1e7f9040 2024-05-08T18:50:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.223+0000 7fc177415800 1 -- 172.21.15.132:0/1789555315 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d1e7f7c80 con 0x562d1e7f9040 2024-05-08T18:50:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.223+0000 7fc05ce01640 1 -- 172.21.15.132:0/1789555315 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc16c014930 con 0x562d1e7f9040 2024-05-08T18:50:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.223+0000 7fc177415800 1 -- 172.21.15.132:0/1789555315 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d1e7f8180 con 0x562d1e7f9040 2024-05-08T18:50:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.224+0000 7fc05ce01640 1 -- 172.21.15.132:0/1789555315 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc16c011040 con 0x562d1e7f9040 2024-05-08T18:50:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.224+0000 7fc05ce01640 1 --2- 172.21.15.132:0/1789555315 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc04c03bba0 0x7fc04c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.224+0000 7fc05ce01640 1 -- 172.21.15.132:0/1789555315 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fc16c01e070 con 0x562d1e7f9040 2024-05-08T18:50:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.224+0000 7fc1729d5640 1 --2- 172.21.15.132:0/1789555315 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc04c03bba0 0x7fc04c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.225+0000 7fc177415800 1 Processor -- start 2024-05-08T18:50:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.225+0000 7fc177415800 1 -- start start 2024-05-08T18:50:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.225+0000 7fc1729d5640 1 --2- 172.21.15.132:0/1789555315 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc04c03bba0 0x7fc04c03e060 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x562d1e807de0 tx=0x7fc164005330 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.225+0000 7fc177415800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e82ab40 0x562d1e82af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.225+0000 7fc177415800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562d1e7fb740 con 0x562d1e82ab40 2024-05-08T18:50:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.225+0000 7fc1731d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e82ab40 0x562d1e82af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.225+0000 7fc1731d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e82ab40 0x562d1e82af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60694/0 (socket says 172.21.15.132:60694) 2024-05-08T18:50:47.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.225+0000 7fc1731d6640 1 -- 172.21.15.132:0/187200280 learned_addr learned my addr 172.21.15.132:0/187200280 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.225+0000 7fc1731d6640 1 -- 172.21.15.132:0/187200280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d1e82b530 con 0x562d1e82ab40 2024-05-08T18:50:47.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.226+0000 7fc1731d6640 1 --2- 172.21.15.132:0/187200280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e82ab40 0x562d1e82af60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc16c052c80 tx=0x7fc16c016570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502a7c0c69c399f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.226+0000 7fc0567fc640 1 -- 172.21.15.132:0/187200280 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc16c028070 con 0x562d1e82ab40 2024-05-08T18:50:47.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.226+0000 7fc0567fc640 1 -- 172.21.15.132:0/187200280 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc16c054550 con 0x562d1e82ab40 2024-05-08T18:50:47.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.226+0000 7fc0567fc640 1 -- 172.21.15.132:0/187200280 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc16c016930 con 0x562d1e82ab40 2024-05-08T18:50:47.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.226+0000 7fc177415800 1 -- 172.21.15.132:0/187200280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e82ab40 msgr2=0x562d1e82af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.226+0000 7fc177415800 1 --2- 172.21.15.132:0/187200280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e82ab40 0x562d1e82af60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc16c052c80 tx=0x7fc16c016570 comp rx=0 tx=0).stop 2024-05-08T18:50:47.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.226+0000 7fc177415800 1 -- 172.21.15.132:0/187200280 shutdown_connections 2024-05-08T18:50:47.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.226+0000 7fc177415800 1 --2- 172.21.15.132:0/187200280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e82ab40 0x562d1e82af60 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.226+0000 7fc177415800 1 -- 172.21.15.132:0/187200280 >> 172.21.15.132:0/187200280 conn(0x562d1e826ea0 msgr2=0x562d1e824f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.226+0000 7fc177415800 1 -- 172.21.15.132:0/187200280 shutdown_connections 2024-05-08T18:50:47.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.226+0000 7fc177415800 1 -- 172.21.15.132:0/187200280 wait complete. 2024-05-08T18:50:47.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.226+0000 7fc177415800 1 Processor -- start 2024-05-08T18:50:47.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.227+0000 7fc177415800 1 -- start start 2024-05-08T18:50:47.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.227+0000 7fc177415800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e82ab40 0x562d1e832130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.227+0000 7fc177415800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562d1e82bca0 con 0x562d1e82ab40 2024-05-08T18:50:47.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.227+0000 7fc1731d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e82ab40 0x562d1e832130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.227+0000 7fc1731d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e82ab40 0x562d1e832130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60700/0 (socket says 172.21.15.132:60700) 2024-05-08T18:50:47.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.227+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 learned_addr learned my addr 172.21.15.132:0/276585412 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.227+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d1e832670 con 0x562d1e82ab40 2024-05-08T18:50:47.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.227+0000 7fc1731d6640 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e82ab40 0x562d1e832130 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc16c001700 tx=0x7fc16c052c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.227+0000 7fc054ff9640 1 -- 172.21.15.132:0/276585412 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc16c02b350 con 0x562d1e82ab40 2024-05-08T18:50:47.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.227+0000 7fc054ff9640 1 -- 172.21.15.132:0/276585412 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc16c031070 con 0x562d1e82ab40 2024-05-08T18:50:47.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.227+0000 7fc054ff9640 1 -- 172.21.15.132:0/276585412 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc16c014ad0 con 0x562d1e82ab40 2024-05-08T18:50:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.227+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d1e832900 con 0x562d1e82ab40 2024-05-08T18:50:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.228+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d1e8355b0 con 0x562d1e82ab40 2024-05-08T18:50:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.228+0000 7fc054ff9640 1 -- 172.21.15.132:0/276585412 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc16c001770 con 0x562d1e82ab40 2024-05-08T18:50:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.229+0000 7fc054ff9640 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc03c03bba0 0x7fc03c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.229+0000 7fc054ff9640 1 -- 172.21.15.132:0/276585412 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fc16c00e040 con 0x562d1e82ab40 2024-05-08T18:50:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.229+0000 7fc1729d5640 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc03c03bba0 0x7fc03c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.229+0000 7fc1729d5640 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc03c03bba0 0x7fc03c03e060 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc164066700 tx=0x7fc16408d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.229+0000 7fc177415800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.229+0000 7fc177415800 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562d1e83dc10 0x562d1e8400d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.229+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562d1e840820 con 0x562d1e83dc10 2024-05-08T18:50:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.229+0000 7fc16bfff640 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562d1e83dc10 0x562d1e8400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.230+0000 7fc16bfff640 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562d1e83dc10 0x562d1e8400d0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.230+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc15c00f610 con 0x562d1e83dc10 2024-05-08T18:50:47.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.230+0000 7fc177415800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.230+0000 7fc177415800 20 realm 2024-05-08T18:50:47.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.230+0000 7fc177415800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.230+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562d1e83d060 con 0x562d1e83dc10 2024-05-08T18:50:47.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.230+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc15c00f610 con 0x562d1e83dc10 2024-05-08T18:50:47.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.230+0000 7fc177415800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.230+0000 7fc177415800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:47.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.230+0000 7fc177415800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.230+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562d1e841310 con 0x562d1e83dc10 2024-05-08T18:50:47.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.230+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc15c00f610 con 0x562d1e83dc10 2024-05-08T18:50:47.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.230+0000 7fc177415800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.230+0000 7fc177415800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.230+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562d1e841be0 con 0x562d1e83dc10 2024-05-08T18:50:47.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.231+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc15c00f610 con 0x562d1e83dc10 2024-05-08T18:50:47.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.231+0000 7fc177415800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:47.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.231+0000 7fc177415800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.231+0000 7fc177415800 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562d1e842600 0x562d1e8449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.231+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562d1e8450e0 con 0x562d1e842600 2024-05-08T18:50:47.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.231+0000 7fc1731d6640 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562d1e842600 0x562d1e8449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.231+0000 7fc1731d6640 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562d1e842600 0x562d1e8449f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.231+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc16c03d070 con 0x562d1e842600 2024-05-08T18:50:47.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.231+0000 7fc177415800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:47.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.231+0000 7fc177415800 20 searching for the correct realm 2024-05-08T18:50:47.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.231+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x562d1e842600 2024-05-08T18:50:47.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.232+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc16c03d070 con 0x562d1e842600 2024-05-08T18:50:47.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.232+0000 7fc1731d6640 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fc16c014070 0x7fc16c0389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.232+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x7fc16c014070 2024-05-08T18:50:47.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.232+0000 7fc1729d5640 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fc16c014070 0x7fc16c0389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.232+0000 7fc1729d5640 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fc16c014070 0x7fc16c0389c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.232+0000 7fc1729d5640 1 -- 172.21.15.132:0/276585412 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc16408b030 con 0x7fc16c014070 2024-05-08T18:50:47.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.233+0000 7fc1729d5640 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fc1640a2040 0x7fc164076580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.233+0000 7fc1729d5640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x7fc1640a2040 2024-05-08T18:50:47.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.233+0000 7fc16bfff640 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fc1640a2040 0x7fc164076580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.233+0000 7fc16bfff640 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fc1640a2040 0x7fc164076580 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.234+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c00f610 con 0x7fc1640a2040 2024-05-08T18:50:47.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.234+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x562d1e83dc10 2024-05-08T18:50:47.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.234+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c00f610 con 0x562d1e83dc10 2024-05-08T18:50:47.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.234+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x562d1e83dc10 2024-05-08T18:50:47.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.234+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c02b040 con 0x562d1e83dc10 2024-05-08T18:50:47.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.234+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x7fc1640a2040 2024-05-08T18:50:47.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.235+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c02b040 con 0x7fc1640a2040 2024-05-08T18:50:47.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.235+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x7fc1640a2040 2024-05-08T18:50:47.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.235+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c02b040 con 0x7fc1640a2040 2024-05-08T18:50:47.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.235+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x7fc16c014070 2024-05-08T18:50:47.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.235+0000 7fc1729d5640 1 -- 172.21.15.132:0/276585412 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc16408b030 con 0x7fc16c014070 2024-05-08T18:50:47.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.235+0000 7fc1729d5640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x562d1e842600 2024-05-08T18:50:47.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.235+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc16c03d070 con 0x562d1e842600 2024-05-08T18:50:47.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.235+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x562d1e83dc10 2024-05-08T18:50:47.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.235+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c02b040 con 0x562d1e83dc10 2024-05-08T18:50:47.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.235+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x7fc1640a2040 2024-05-08T18:50:47.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.236+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c02b040 con 0x7fc1640a2040 2024-05-08T18:50:47.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.236+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x562d1e83dc10 2024-05-08T18:50:47.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.236+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc15c02b040 con 0x562d1e83dc10 2024-05-08T18:50:47.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.236+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x7fc16c014070 2024-05-08T18:50:47.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.236+0000 7fc1729d5640 1 -- 172.21.15.132:0/276585412 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc16408b030 con 0x7fc16c014070 2024-05-08T18:50:47.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.236+0000 7fc1729d5640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x562d1e842600 2024-05-08T18:50:47.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.237+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc16c03d070 con 0x562d1e842600 2024-05-08T18:50:47.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.237+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x562d1e842600 2024-05-08T18:50:47.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.237+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc16c03d070 con 0x562d1e842600 2024-05-08T18:50:47.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.237+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x7fc1640a2040 2024-05-08T18:50:47.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.237+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c02b040 con 0x7fc1640a2040 2024-05-08T18:50:47.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.237+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x562d1e842600 2024-05-08T18:50:47.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.237+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc16c03d070 con 0x562d1e842600 2024-05-08T18:50:47.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.237+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x562d1e842600 2024-05-08T18:50:47.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.238+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc16c03d070 con 0x562d1e842600 2024-05-08T18:50:47.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.238+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x562d1e83dc10 2024-05-08T18:50:47.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.238+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c02b040 con 0x562d1e83dc10 2024-05-08T18:50:47.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.238+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x562d1e83dc10 2024-05-08T18:50:47.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.238+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc15c02b040 con 0x562d1e83dc10 2024-05-08T18:50:47.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.238+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x7fc1640a2040 2024-05-08T18:50:47.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.238+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c02b040 con 0x7fc1640a2040 2024-05-08T18:50:47.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.238+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x562d1e842600 2024-05-08T18:50:47.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.239+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc16c03d070 con 0x562d1e842600 2024-05-08T18:50:47.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.239+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x7fc16c014070 2024-05-08T18:50:47.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.239+0000 7fc1729d5640 1 -- 172.21.15.132:0/276585412 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc16408b030 con 0x7fc16c014070 2024-05-08T18:50:47.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.239+0000 7fc1729d5640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x562d1e83dc10 2024-05-08T18:50:47.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.239+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c02b040 con 0x562d1e83dc10 2024-05-08T18:50:47.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.239+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x7fc1640a2040 2024-05-08T18:50:47.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.239+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c03b040 con 0x7fc1640a2040 2024-05-08T18:50:47.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.239+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x562d1e842600 2024-05-08T18:50:47.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.240+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc16c03d070 con 0x562d1e842600 2024-05-08T18:50:47.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.240+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x7fc1640a2040 2024-05-08T18:50:47.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.240+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c03b040 con 0x7fc1640a2040 2024-05-08T18:50:47.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.240+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x7fc16c014070 2024-05-08T18:50:47.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.240+0000 7fc1729d5640 1 -- 172.21.15.132:0/276585412 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc16408b030 con 0x7fc16c014070 2024-05-08T18:50:47.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.240+0000 7fc1729d5640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x562d1e842600 2024-05-08T18:50:47.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.240+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc16c03d070 con 0x562d1e842600 2024-05-08T18:50:47.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.240+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x7fc1640a2040 2024-05-08T18:50:47.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.241+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c03b040 con 0x7fc1640a2040 2024-05-08T18:50:47.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.241+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x562d1e83dc10 2024-05-08T18:50:47.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.241+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc15c03b040 con 0x562d1e83dc10 2024-05-08T18:50:47.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.241+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846a10 con 0x7fc16c014070 2024-05-08T18:50:47.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.241+0000 7fc1729d5640 1 -- 172.21.15.132:0/276585412 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc16408b030 con 0x7fc16c014070 2024-05-08T18:50:47.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.241+0000 7fc177415800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:47.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.241+0000 7fc177415800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:47.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.241+0000 7fc177415800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:47.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.241+0000 7fc177415800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:47.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.241+0000 7fc177415800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:47.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.241+0000 7fc177415800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:47.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.241+0000 7fc177415800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.241+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562d1e845ad0 con 0x562d1e83dc10 2024-05-08T18:50:47.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.242+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc15c03b040 con 0x562d1e83dc10 2024-05-08T18:50:47.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.242+0000 7fc177415800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.242+0000 7fc177415800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.242+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846370 con 0x562d1e83dc10 2024-05-08T18:50:47.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.242+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc15c03b040 con 0x562d1e83dc10 2024-05-08T18:50:47.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.242+0000 7fc177415800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:47.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.242+0000 7fc177415800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.242+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846e90 con 0x562d1e83dc10 2024-05-08T18:50:47.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.242+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc15c03b040 con 0x562d1e83dc10 2024-05-08T18:50:47.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.242+0000 7fc177415800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:47.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.242+0000 7fc177415800 20 zone default found 2024-05-08T18:50:47.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.242+0000 7fc177415800 4 Realm: () 2024-05-08T18:50:47.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.242+0000 7fc177415800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:47.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.242+0000 7fc177415800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:47.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.242+0000 7fc177415800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:47.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.242+0000 7fc177415800 20 zonegroup default 2024-05-08T18:50:47.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.242+0000 7fc177415800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.242+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562d1e846ed0 con 0x7fc1640a2040 2024-05-08T18:50:47.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.243+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc15c03b040 con 0x7fc1640a2040 2024-05-08T18:50:47.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.243+0000 7fc177415800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.243+0000 7fc177415800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.243+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562d1e848cf0 con 0x562d1e842600 2024-05-08T18:50:47.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.243+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc16c03d070 con 0x562d1e842600 2024-05-08T18:50:47.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.243+0000 7fc177415800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.243+0000 7fc177415800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.243+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562d1e8490c0 con 0x562d1e842600 2024-05-08T18:50:47.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.243+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc16c03d070 con 0x562d1e842600 2024-05-08T18:50:47.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.243+0000 7fc177415800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.243+0000 7fc177415800 20 started sync module instance, tier type = 2024-05-08T18:50:47.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.243+0000 7fc177415800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:47.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.243+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e848190 con 0x7fc16c014070 2024-05-08T18:50:47.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.244+0000 7fc1729d5640 1 -- 172.21.15.132:0/276585412 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc16408b030 con 0x7fc16c014070 2024-05-08T18:50:47.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.244+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94751785516256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e849520 con 0x7fc16c014070 2024-05-08T18:50:47.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.244+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e849d70 con 0x562d1e83dc10 2024-05-08T18:50:47.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.245+0000 7fc1729d5640 1 -- 172.21.15.132:0/276585412 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94751785516256] v25'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc16408b030 con 0x7fc16c014070 2024-05-08T18:50:47.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.245+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c03b040 con 0x562d1e83dc10 2024-05-08T18:50:47.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.245+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94751785523392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e84a190 con 0x562d1e83dc10 2024-05-08T18:50:47.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.246+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e84ab50 con 0x562d1e842600 2024-05-08T18:50:47.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.246+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94751785523392] v25'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c03b040 con 0x562d1e83dc10 2024-05-08T18:50:47.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.247+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc16c03d070 con 0x562d1e842600 2024-05-08T18:50:47.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.247+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94751785524928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e84ab50 con 0x562d1e842600 2024-05-08T18:50:47.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.247+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e84b510 con 0x7fc16c014070 2024-05-08T18:50:47.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.248+0000 7fc1729d5640 1 -- 172.21.15.132:0/276585412 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc16408b030 con 0x7fc16c014070 2024-05-08T18:50:47.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.248+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94751785524928] v25'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc16c03d070 con 0x562d1e842600 2024-05-08T18:50:47.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.248+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94751785526944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e84aac0 con 0x7fc16c014070 2024-05-08T18:50:47.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.248+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e84c3d0 con 0x562d1e83dc10 2024-05-08T18:50:47.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.249+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c03b040 con 0x562d1e83dc10 2024-05-08T18:50:47.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.249+0000 7fc1729d5640 1 -- 172.21.15.132:0/276585412 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94751785526944] v25'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc16408b030 con 0x7fc16c014070 2024-05-08T18:50:47.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.249+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94751785533696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e84cb70 con 0x562d1e83dc10 2024-05-08T18:50:47.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.249+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e84d160 con 0x7fc1640a2040 2024-05-08T18:50:47.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.250+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94751785533696] v25'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c03b040 con 0x562d1e83dc10 2024-05-08T18:50:47.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.250+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c03b040 con 0x7fc1640a2040 2024-05-08T18:50:47.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.250+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94751785531648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e84d160 con 0x7fc1640a2040 2024-05-08T18:50:47.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.250+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e84db70 con 0x7fc1640a2040 2024-05-08T18:50:47.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.251+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(56 notify.6 [create] v25'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c03b040 con 0x7fc1640a2040 2024-05-08T18:50:47.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.251+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94751785539264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e84df90 con 0x7fc1640a2040 2024-05-08T18:50:47.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.251+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e84ea90 con 0x7fc1640a2040 2024-05-08T18:50:47.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.251+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94751785531648] v25'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c03b040 con 0x7fc1640a2040 2024-05-08T18:50:47.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.252+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(58 notify.7 [create] v25'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c03b040 con 0x7fc1640a2040 2024-05-08T18:50:47.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.252+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94751785543040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e84ea50 con 0x7fc1640a2040 2024-05-08T18:50:47.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.252+0000 7fc177415800 20 add_watcher() i=0 2024-05-08T18:50:47.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.252+0000 7fc177415800 20 add_watcher() i=1 2024-05-08T18:50:47.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.252+0000 7fc177415800 20 add_watcher() i=2 2024-05-08T18:50:47.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.252+0000 7fc177415800 20 add_watcher() i=3 2024-05-08T18:50:47.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.252+0000 7fc177415800 20 add_watcher() i=4 2024-05-08T18:50:47.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.252+0000 7fc177415800 20 add_watcher() i=5 2024-05-08T18:50:47.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.252+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94751785539264] v25'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c03b040 con 0x7fc1640a2040 2024-05-08T18:50:47.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.252+0000 7fc177415800 20 add_watcher() i=6 2024-05-08T18:50:47.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.253+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94751785543040] v25'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c03b040 con 0x7fc1640a2040 2024-05-08T18:50:47.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.253+0000 7fc177415800 20 add_watcher() i=7 2024-05-08T18:50:47.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.253+0000 7fc177415800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:47.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.253+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562d1e84dae0 con 0x562d1e83dc10 2024-05-08T18:50:47.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.253+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc15c03b040 con 0x562d1e83dc10 2024-05-08T18:50:47.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.253+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94751785534912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e84dae0 con 0x562d1e83dc10 2024-05-08T18:50:47.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.254+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94751785534912] v25'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc15c03b040 con 0x562d1e83dc10 2024-05-08T18:50:47.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.254+0000 7fc0297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:47.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.254+0000 7fc177415800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:47.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.254+0000 7fc177415800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:47.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.254+0000 7fc177415800 5 note: GC not initialized 2024-05-08T18:50:47.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.254+0000 7fbfa3fff640 20 reqs_thread_entry: start 2024-05-08T18:50:47.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.255+0000 7fc177415800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:47.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.255+0000 7fc177415800 20 Filter name: none 2024-05-08T18:50:47.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.255+0000 7fbfa1ffb640 20 reqs_thread_entry: start 2024-05-08T18:50:47.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.255+0000 7fc177415800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:50:47.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.255+0000 7fc177415800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.255+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562d1e884eb0 con 0x562d1e83dc10 2024-05-08T18:50:47.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.255+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7fc15c03b040 con 0x562d1e83dc10 2024-05-08T18:50:47.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.255+0000 7fc177415800 20 rados_obj.operate() r=0 bl.length=582 2024-05-08T18:50:47.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.255+0000 7fc177415800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:50:47.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.255+0000 7fc177415800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:47.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.255+0000 7fc177415800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:47.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.255+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e88b3f0 con 0x562d1e83dc10 2024-05-08T18:50:47.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.257+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v25'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc15c03b040 con 0x562d1e83dc10 2024-05-08T18:50:47.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.257+0000 7fc177415800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:47.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.257+0000 7fc177415800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:47.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.257+0000 7fc177415800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:50:47.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.257+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94751785790896 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562d1e886d00 con 0x562d1e83dc10 2024-05-08T18:50:47.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.257+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== watch-notify(notify (1) cookie 94751785533696 notify 107374182409 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7fc15c018040 con 0x562d1e83dc10 2024-05-08T18:50:47.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.257+0000 7fc0567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182409 cookie 94751785533696 notifier 4403 bl.length()=732 2024-05-08T18:50:47.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.257+0000 7fc0567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:47.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.257+0000 7fc0567fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:47.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.257+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(64 notify.4 [notify cookie 94751785790896 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc15c03b040 con 0x562d1e83dc10 2024-05-08T18:50:47.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.257+0000 7fc0567fc640 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7fc038003ea0 con 0x562d1e83dc10 2024-05-08T18:50:47.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.257+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c03b040 con 0x562d1e83dc10 2024-05-08T18:50:47.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.257+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== watch-notify(notify_complete (2) cookie 94751785790896 notify 107374182409 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc15c009050 con 0x562d1e83dc10 2024-05-08T18:50:47.270 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:50:44.835566Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-08T18:50:46.806723Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:44.835553Z","tags":[],"group_ids":[]} 2024-05-08T18:50:47.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.258+0000 7fc0297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:47.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.258+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94751785534912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e8856a0 con 0x562d1e83dc10 2024-05-08T18:50:47.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.259+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94751785534912] v25'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc15c03b040 con 0x562d1e83dc10 2024-05-08T18:50:47.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.259+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94751785516256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e84c5c0 con 0x7fc16c014070 2024-05-08T18:50:47.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.260+0000 7fc1729d5640 1 -- 172.21.15.132:0/276585412 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94751785516256] v25'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc16408b030 con 0x7fc16c014070 2024-05-08T18:50:47.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.260+0000 7fc177415800 20 remove_watcher() i=0 2024-05-08T18:50:47.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.260+0000 7fc177415800 2 removed watcher, disabling cache 2024-05-08T18:50:47.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.260+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94751785523392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e847ce0 con 0x562d1e83dc10 2024-05-08T18:50:47.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.261+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94751785523392] v25'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c03b040 con 0x562d1e83dc10 2024-05-08T18:50:47.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.261+0000 7fc177415800 20 remove_watcher() i=1 2024-05-08T18:50:47.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.261+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94751785524928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e8498c0 con 0x562d1e842600 2024-05-08T18:50:47.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.262+0000 7fc1731d6640 1 -- 172.21.15.132:0/276585412 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94751785524928] v25'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc16c03d070 con 0x562d1e842600 2024-05-08T18:50:47.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.262+0000 7fc177415800 20 remove_watcher() i=2 2024-05-08T18:50:47.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.262+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94751785526944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e8498c0 con 0x7fc16c014070 2024-05-08T18:50:47.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.263+0000 7fc1729d5640 1 -- 172.21.15.132:0/276585412 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94751785526944] v25'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc16408b030 con 0x7fc16c014070 2024-05-08T18:50:47.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.263+0000 7fc177415800 20 remove_watcher() i=3 2024-05-08T18:50:47.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.263+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94751785533696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e8498c0 con 0x562d1e83dc10 2024-05-08T18:50:47.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.264+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94751785533696] v25'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c03b040 con 0x562d1e83dc10 2024-05-08T18:50:47.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.264+0000 7fc177415800 20 remove_watcher() i=4 2024-05-08T18:50:47.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.264+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94751785531648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e84c100 con 0x7fc1640a2040 2024-05-08T18:50:47.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.265+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94751785531648] v25'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c03b040 con 0x7fc1640a2040 2024-05-08T18:50:47.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.265+0000 7fc177415800 20 remove_watcher() i=5 2024-05-08T18:50:47.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.265+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94751785539264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e8498c0 con 0x7fc1640a2040 2024-05-08T18:50:47.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.266+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94751785539264] v25'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c03b040 con 0x7fc1640a2040 2024-05-08T18:50:47.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.266+0000 7fc177415800 20 remove_watcher() i=6 2024-05-08T18:50:47.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.266+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94751785543040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562d1e84b900 con 0x7fc1640a2040 2024-05-08T18:50:47.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.267+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94751785543040] v25'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c03b040 con 0x7fc1640a2040 2024-05-08T18:50:47.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.267+0000 7fc177415800 20 remove_watcher() i=7 2024-05-08T18:50:47.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.267+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fc1640a2040 msgr2=0x7fc164076580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.267+0000 7fc177415800 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fc1640a2040 0x7fc164076580 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.267+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562d1e83dc10 msgr2=0x562d1e8400d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.267+0000 7fc177415800 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562d1e83dc10 0x562d1e8400d0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.267+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fc16c014070 msgr2=0x7fc16c0389c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.267+0000 7fc177415800 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fc16c014070 0x7fc16c0389c0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.267+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562d1e842600 msgr2=0x562d1e8449f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.267+0000 7fc177415800 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562d1e842600 0x562d1e8449f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc03c03bba0 msgr2=0x7fc03c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc03c03bba0 0x7fc03c03e060 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc164066700 tx=0x7fc16408d000 comp rx=0 tx=0).stop 2024-05-08T18:50:47.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e82ab40 msgr2=0x562d1e832130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc16bfff640 1 -- 172.21.15.132:0/276585412 reap_dead start 2024-05-08T18:50:47.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e82ab40 0x562d1e832130 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc16c001700 tx=0x7fc16c052c10 comp rx=0 tx=0).stop 2024-05-08T18:50:47.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 shutdown_connections 2024-05-08T18:50:47.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 --2- 172.21.15.132:0/276585412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e82ab40 0x562d1e832130 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 >> 172.21.15.132:0/276585412 conn(0x562d1e826ea0 msgr2=0x562d1e824500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 shutdown_connections 2024-05-08T18:50:47.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 -- 172.21.15.132:0/276585412 wait complete. 2024-05-08T18:50:47.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 -- 172.21.15.132:0/1789555315 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc04c03bba0 msgr2=0x7fc04c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 --2- 172.21.15.132:0/1789555315 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc04c03bba0 0x7fc04c03e060 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x562d1e807de0 tx=0x7fc164005330 comp rx=0 tx=0).stop 2024-05-08T18:50:47.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 -- 172.21.15.132:0/1789555315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e7f9040 msgr2=0x562d1e7f74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 --2- 172.21.15.132:0/1789555315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e7f9040 0x562d1e7f74b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x562d1e807d40 tx=0x7fc16c018830 comp rx=0 tx=0).stop 2024-05-08T18:50:47.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 -- 172.21.15.132:0/1789555315 shutdown_connections 2024-05-08T18:50:47.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 --2- 172.21.15.132:0/1789555315 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc04c03bba0 0x7fc04c03e060 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 --2- 172.21.15.132:0/1789555315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e7f9040 0x562d1e7f74b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 -- 172.21.15.132:0/1789555315 >> 172.21.15.132:0/1789555315 conn(0x562d1e80f750 msgr2=0x562d1e80fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 -- 172.21.15.132:0/1789555315 shutdown_connections 2024-05-08T18:50:47.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 -- 172.21.15.132:0/1789555315 wait complete. 2024-05-08T18:50:47.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 -- 172.21.15.132:0/2104266179 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562d1e7073a0 msgr2=0x562d1e8073e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 --2- 172.21.15.132:0/2104266179 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562d1e7073a0 0x562d1e8073e0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 -- 172.21.15.132:0/2104266179 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562d1e809c90 msgr2=0x562d1e80c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.268+0000 7fc177415800 1 --2- 172.21.15.132:0/2104266179 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562d1e809c90 0x562d1e80c080 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.269+0000 7fc177415800 1 -- 172.21.15.132:0/2104266179 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc05803bb50 msgr2=0x7fc05803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.269+0000 7fc177415800 1 --2- 172.21.15.132:0/2104266179 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc05803bb50 0x7fc05803e010 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc15c000f60 tx=0x7fc15c001370 comp rx=0 tx=0).stop 2024-05-08T18:50:47.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.269+0000 7fc177415800 1 -- 172.21.15.132:0/2104266179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e706140 msgr2=0x562d1e8001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.269+0000 7fc177415800 1 --2- 172.21.15.132:0/2104266179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e706140 0x562d1e8001a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc16400a520 tx=0x7fc164003020 comp rx=0 tx=0).stop 2024-05-08T18:50:47.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.269+0000 7fc177415800 1 -- 172.21.15.132:0/2104266179 shutdown_connections 2024-05-08T18:50:47.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.269+0000 7fc177415800 1 --2- 172.21.15.132:0/2104266179 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562d1e809c90 0x562d1e80c080 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.269+0000 7fc177415800 1 --2- 172.21.15.132:0/2104266179 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562d1e7073a0 0x562d1e8073e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.269+0000 7fc177415800 1 --2- 172.21.15.132:0/2104266179 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc05803bb50 0x7fc05803e010 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.269+0000 7fc177415800 1 --2- 172.21.15.132:0/2104266179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562d1e706140 0x562d1e8001a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.269+0000 7fc177415800 1 -- 172.21.15.132:0/2104266179 >> 172.21.15.132:0/2104266179 conn(0x562d1e701720 msgr2=0x562d1e7f17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.269+0000 7fc177415800 1 -- 172.21.15.132:0/2104266179 shutdown_connections 2024-05-08T18:50:47.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.269+0000 7fc177415800 1 -- 172.21.15.132:0/2104266179 wait complete. 2024-05-08T18:50:47.282 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:50:44.835566Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-08T18:50:46.806723Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:44.835553Z', 'tags': [], 'group_ids': []} 2024-05-08T18:50:47.282 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-05-08T18:50:47.282 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-05-08T18:50:47.282 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-05-08T18:50:47.330 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:47.330 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:47.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.331+0000 7f9add262800 1 Processor -- start 2024-05-08T18:50:47.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.331+0000 7f9add262800 1 -- start start 2024-05-08T18:50:47.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.331+0000 7f9add262800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55f3bd453b80 0x55f3bd453fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.331+0000 7f9add262800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f3bd3c8f00 con 0x55f3bd4544e0 2024-05-08T18:50:47.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.331+0000 7f9add262800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55f3bd2f5e20 con 0x55f3bd453b80 2024-05-08T18:50:47.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.332+0000 7f9adad5a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55f3bd453b80 0x55f3bd453fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.332+0000 7f9adad5a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55f3bd453b80 0x55f3bd453fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60712/0 (socket says 172.21.15.132:60712) 2024-05-08T18:50:47.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.332+0000 7f9adad5a640 1 -- 172.21.15.132:0/2242658044 learned_addr learned my addr 172.21.15.132:0/2242658044 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.332+0000 7f9ad2559640 1 --1- 172.21.15.132:0/2242658044 >> v1:172.21.15.42:6789/0 conn(0x55f3bd4544e0 0x55f3bd454990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46888/0 (socket says 172.21.15.132:46888) 2024-05-08T18:50:47.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.332+0000 7f9adad5a640 1 -- 172.21.15.132:0/2242658044 >> v1:172.21.15.42:6789/0 conn(0x55f3bd4544e0 legacy=0x55f3bd454990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.332+0000 7f9adad5a640 1 -- 172.21.15.132:0/2242658044 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3bd4550a0 con 0x55f3bd453b80 2024-05-08T18:50:47.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.334+0000 7f9adad5a640 1 --2- 172.21.15.132:0/2242658044 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd453b80 0x55f3bd453fa0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00a520 tx=0x7f9acc01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f6dfa0e3cc5eb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.334+0000 7f9ada559640 1 -- 172.21.15.132:0/2242658044 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9acc057070 con 0x55f3bd453b80 2024-05-08T18:50:47.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.334+0000 7f9ada559640 1 -- 172.21.15.132:0/2242658044 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9acc052570 con 0x55f3bd453b80 2024-05-08T18:50:47.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.334+0000 7f9ada559640 1 -- 172.21.15.132:0/2242658044 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9acc04ae60 con 0x55f3bd453b80 2024-05-08T18:50:47.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.334+0000 7f9add262800 1 -- 172.21.15.132:0/2242658044 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd453b80 msgr2=0x55f3bd453fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.334+0000 7f9add262800 1 --2- 172.21.15.132:0/2242658044 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd453b80 0x55f3bd453fa0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00a520 tx=0x7f9acc01d010 comp rx=0 tx=0).stop 2024-05-08T18:50:47.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.335+0000 7f9add262800 1 -- 172.21.15.132:0/2242658044 shutdown_connections 2024-05-08T18:50:47.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.335+0000 7f9add262800 1 --2- 172.21.15.132:0/2242658044 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd453b80 0x55f3bd453fa0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.335+0000 7f9add262800 1 -- 172.21.15.132:0/2242658044 >> 172.21.15.132:0/2242658044 conn(0x55f3bd44f6c0 msgr2=0x55f3bd451b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.335+0000 7f9add262800 1 -- 172.21.15.132:0/2242658044 shutdown_connections 2024-05-08T18:50:47.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.335+0000 7f9add262800 1 -- 172.21.15.132:0/2242658044 wait complete. 2024-05-08T18:50:47.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.348+0000 7f9add262800 1 Processor -- start 2024-05-08T18:50:47.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.348+0000 7f9add262800 1 -- start start 2024-05-08T18:50:47.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.348+0000 7f9add262800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd453b80 0x55f3bd548a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.348+0000 7f9add262800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f3bd3a05d0 con 0x55f3bd453b80 2024-05-08T18:50:47.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.349+0000 7f9adad5a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd453b80 0x55f3bd548a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.349+0000 7f9adad5a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd453b80 0x55f3bd548a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60720/0 (socket says 172.21.15.132:60720) 2024-05-08T18:50:47.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.349+0000 7f9adad5a640 1 -- 172.21.15.132:0/3384054506 learned_addr learned my addr 172.21.15.132:0/3384054506 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.349+0000 7f9adad5a640 1 -- 172.21.15.132:0/3384054506 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3bd549050 con 0x55f3bd453b80 2024-05-08T18:50:47.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.349+0000 7f9adad5a640 1 --2- 172.21.15.132:0/3384054506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd453b80 0x55f3bd548a80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9acc055040 tx=0x7f9acc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1581714bf464fbae server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.349+0000 7f99c8e09640 1 -- 172.21.15.132:0/3384054506 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9acc057040 con 0x55f3bd453b80 2024-05-08T18:50:47.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.349+0000 7f99c8e09640 1 -- 172.21.15.132:0/3384054506 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9acc052720 con 0x55f3bd453b80 2024-05-08T18:50:47.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.349+0000 7f99c8e09640 1 -- 172.21.15.132:0/3384054506 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9acc052a20 con 0x55f3bd453b80 2024-05-08T18:50:47.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.350+0000 7f9add262800 1 -- 172.21.15.132:0/3384054506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd453b80 msgr2=0x55f3bd548a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.350+0000 7f9add262800 1 --2- 172.21.15.132:0/3384054506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd453b80 0x55f3bd548a80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9acc055040 tx=0x7f9acc04c000 comp rx=0 tx=0).stop 2024-05-08T18:50:47.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.350+0000 7f9add262800 1 -- 172.21.15.132:0/3384054506 shutdown_connections 2024-05-08T18:50:47.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.350+0000 7f9add262800 1 --2- 172.21.15.132:0/3384054506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd453b80 0x55f3bd548a80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.350+0000 7f9add262800 1 -- 172.21.15.132:0/3384054506 >> 172.21.15.132:0/3384054506 conn(0x55f3bd44f6c0 msgr2=0x55f3bd5443a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.350+0000 7f9add262800 1 -- 172.21.15.132:0/3384054506 shutdown_connections 2024-05-08T18:50:47.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.350+0000 7f9add262800 1 -- 172.21.15.132:0/3384054506 wait complete. 2024-05-08T18:50:47.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.350+0000 7f9add262800 1 Processor -- start 2024-05-08T18:50:47.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.351+0000 7f9add262800 1 -- start start 2024-05-08T18:50:47.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.351+0000 7f9add262800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd453b80 0x55f3bd550420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.351+0000 7f9add262800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f3bd4555d0 con 0x55f3bd453b80 2024-05-08T18:50:47.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.351+0000 7f9adad5a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd453b80 0x55f3bd550420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.351+0000 7f9adad5a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd453b80 0x55f3bd550420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60736/0 (socket says 172.21.15.132:60736) 2024-05-08T18:50:47.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.351+0000 7f9adad5a640 1 -- 172.21.15.132:0/2667172231 learned_addr learned my addr 172.21.15.132:0/2667172231 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.351+0000 7f9adad5a640 1 -- 172.21.15.132:0/2667172231 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3bd550960 con 0x55f3bd453b80 2024-05-08T18:50:47.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.351+0000 7f9adad5a640 1 --2- 172.21.15.132:0/2667172231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd453b80 0x55f3bd550420 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0524f0 tx=0x7f9acc003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.351+0000 7f99c7606640 1 -- 172.21.15.132:0/2667172231 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9acc073070 con 0x55f3bd453b80 2024-05-08T18:50:47.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.351+0000 7f99c7606640 1 -- 172.21.15.132:0/2667172231 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9acc05d440 con 0x55f3bd453b80 2024-05-08T18:50:47.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.351+0000 7f9add262800 1 -- 172.21.15.132:0/2667172231 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f3bd550bf0 con 0x55f3bd453b80 2024-05-08T18:50:47.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.352+0000 7f99c7606640 1 -- 172.21.15.132:0/2667172231 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9acc057070 con 0x55f3bd453b80 2024-05-08T18:50:47.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.352+0000 7f9add262800 1 -- 172.21.15.132:0/2667172231 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3bd5538a0 con 0x55f3bd453b80 2024-05-08T18:50:47.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.352+0000 7f99c7606640 1 -- 172.21.15.132:0/2667172231 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9acc076070 con 0x55f3bd453b80 2024-05-08T18:50:47.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.353+0000 7f99c7606640 1 --2- 172.21.15.132:0/2667172231 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f99c003bb50 0x7f99c003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.353+0000 7f99c7606640 1 -- 172.21.15.132:0/2667172231 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f9acc093fe0 con 0x55f3bd453b80 2024-05-08T18:50:47.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.353+0000 7f9ad2559640 1 --2- 172.21.15.132:0/2667172231 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f99c003bb50 0x7f99c003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.353+0000 7f9add262800 1 --2- 172.21.15.132:0/2667172231 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f3bd4544e0 0x55f3bd557660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.353+0000 7f9add262800 1 -- 172.21.15.132:0/2667172231 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd557bf0 con 0x55f3bd4544e0 2024-05-08T18:50:47.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.353+0000 7f9adb55b640 1 --2- 172.21.15.132:0/2667172231 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f3bd4544e0 0x55f3bd557660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.353+0000 7f9ad2559640 1 --2- 172.21.15.132:0/2667172231 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f99c003bb50 0x7f99c003e010 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4001e40 tx=0x7f9ac40013a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.353+0000 7f9adb55b640 1 --2- 172.21.15.132:0/2667172231 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f3bd4544e0 0x55f3bd557660 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.353+0000 7f9adb55b640 1 -- 172.21.15.132:0/2667172231 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ad400a4a0 con 0x55f3bd4544e0 2024-05-08T18:50:47.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.353+0000 7f9add262800 1 -- 172.21.15.132:0/2667172231 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd558490 con 0x55f3bd4544e0 2024-05-08T18:50:47.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.354+0000 7f9adb55b640 1 -- 172.21.15.132:0/2667172231 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ad400a4a0 con 0x55f3bd4544e0 2024-05-08T18:50:47.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.354+0000 7f9add262800 1 --2- 172.21.15.132:0/2667172231 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f3bd559da0 0x55f3bd55c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.354+0000 7f9add262800 1 -- 172.21.15.132:0/2667172231 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd55c9c0 con 0x55f3bd559da0 2024-05-08T18:50:47.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.354+0000 7f9adad5a640 1 --2- 172.21.15.132:0/2667172231 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f3bd559da0 0x55f3bd55c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.354+0000 7f9adad5a640 1 --2- 172.21.15.132:0/2667172231 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f3bd559da0 0x55f3bd55c230 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.354+0000 7f9adad5a640 1 -- 172.21.15.132:0/2667172231 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9acc075030 con 0x55f3bd559da0 2024-05-08T18:50:47.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.354+0000 7f9add262800 1 -- 172.21.15.132:0/2667172231 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd558ce0 con 0x55f3bd4544e0 2024-05-08T18:50:47.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.355+0000 7f9adb55b640 1 -- 172.21.15.132:0/2667172231 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ad400a4a0 con 0x55f3bd4544e0 2024-05-08T18:50:47.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.355+0000 7f9add262800 1 -- 172.21.15.132:0/2667172231 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd5590c0 con 0x55f3bd4544e0 2024-05-08T18:50:47.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.355+0000 7f9adb55b640 1 -- 172.21.15.132:0/2667172231 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9ad400a4a0 con 0x55f3bd4544e0 2024-05-08T18:50:47.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.355+0000 7f9add262800 1 Processor -- start 2024-05-08T18:50:47.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.355+0000 7f9add262800 1 -- start start 2024-05-08T18:50:47.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.355+0000 7f9add262800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd56b940 0x55f3bd56bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.355+0000 7f9add262800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f3bd346fc0 con 0x55f3bd56b940 2024-05-08T18:50:47.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.356+0000 7f9adb55b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd56b940 0x55f3bd56bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.356+0000 7f9adb55b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd56b940 0x55f3bd56bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60750/0 (socket says 172.21.15.132:60750) 2024-05-08T18:50:47.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.356+0000 7f9adb55b640 1 -- 172.21.15.132:0/474193354 learned_addr learned my addr 172.21.15.132:0/474193354 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.356+0000 7f9adb55b640 1 -- 172.21.15.132:0/474193354 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3bd56c2a0 con 0x55f3bd56b940 2024-05-08T18:50:47.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.356+0000 7f9adb55b640 1 --2- 172.21.15.132:0/474193354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd56b940 0x55f3bd56bd60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55f3bd5512f0 tx=0x7f9ad40188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.356+0000 7f99c4e01640 1 -- 172.21.15.132:0/474193354 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ad4014450 con 0x55f3bd56b940 2024-05-08T18:50:47.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.356+0000 7f99c4e01640 1 -- 172.21.15.132:0/474193354 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad40145f0 con 0x55f3bd56b940 2024-05-08T18:50:47.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.356+0000 7f9add262800 1 -- 172.21.15.132:0/474193354 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f3bd56cd10 con 0x55f3bd56b940 2024-05-08T18:50:47.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.357+0000 7f99c4e01640 1 -- 172.21.15.132:0/474193354 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ad40148d0 con 0x55f3bd56b940 2024-05-08T18:50:47.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.357+0000 7f9add262800 1 -- 172.21.15.132:0/474193354 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3bd56d210 con 0x55f3bd56b940 2024-05-08T18:50:47.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.357+0000 7f99c4e01640 1 -- 172.21.15.132:0/474193354 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9ad4011040 con 0x55f3bd56b940 2024-05-08T18:50:47.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.358+0000 7f99c4e01640 1 --2- 172.21.15.132:0/474193354 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f99b403bba0 0x7f99b403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.358+0000 7f99c4e01640 1 -- 172.21.15.132:0/474193354 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f9ad401e070 con 0x55f3bd56b940 2024-05-08T18:50:47.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.358+0000 7f9adad5a640 1 --2- 172.21.15.132:0/474193354 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f99b403bba0 0x7f99b403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.358+0000 7f9add262800 1 Processor -- start 2024-05-08T18:50:47.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.358+0000 7f9add262800 1 -- start start 2024-05-08T18:50:47.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.358+0000 7f9adad5a640 1 --2- 172.21.15.132:0/474193354 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f99b403bba0 0x7f99b403e060 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55f3bd554d30 tx=0x7f9acc05d820 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.358+0000 7f9add262800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd578c00 0x55f3bd579020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.358+0000 7f9add262800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f3bd549310 con 0x55f3bd578c00 2024-05-08T18:50:47.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.358+0000 7f9adb55b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd578c00 0x55f3bd579020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.358+0000 7f9adb55b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd578c00 0x55f3bd579020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60766/0 (socket says 172.21.15.132:60766) 2024-05-08T18:50:47.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.358+0000 7f9adb55b640 1 -- 172.21.15.132:0/545217845 learned_addr learned my addr 172.21.15.132:0/545217845 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.359+0000 7f9adb55b640 1 -- 172.21.15.132:0/545217845 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3bd5795f0 con 0x55f3bd578c00 2024-05-08T18:50:47.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.359+0000 7f9adb55b640 1 --2- 172.21.15.132:0/545217845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd578c00 0x55f3bd579020 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4052c50 tx=0x7f9ad40118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2654f5949247f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.359+0000 7f99be7fc640 1 -- 172.21.15.132:0/545217845 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ad4044020 con 0x55f3bd578c00 2024-05-08T18:50:47.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.359+0000 7f99be7fc640 1 -- 172.21.15.132:0/545217845 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad4011c00 con 0x55f3bd578c00 2024-05-08T18:50:47.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.359+0000 7f99be7fc640 1 -- 172.21.15.132:0/545217845 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ad4014a70 con 0x55f3bd578c00 2024-05-08T18:50:47.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.359+0000 7f9add262800 1 -- 172.21.15.132:0/545217845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd578c00 msgr2=0x55f3bd579020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.359+0000 7f9add262800 1 --2- 172.21.15.132:0/545217845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd578c00 0x55f3bd579020 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4052c50 tx=0x7f9ad40118e0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.359+0000 7f9add262800 1 -- 172.21.15.132:0/545217845 shutdown_connections 2024-05-08T18:50:47.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.359+0000 7f9add262800 1 --2- 172.21.15.132:0/545217845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd578c00 0x55f3bd579020 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.359+0000 7f9add262800 1 -- 172.21.15.132:0/545217845 >> 172.21.15.132:0/545217845 conn(0x55f3bd574f60 msgr2=0x55f3bd572fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.359+0000 7f9add262800 1 -- 172.21.15.132:0/545217845 shutdown_connections 2024-05-08T18:50:47.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.359+0000 7f9add262800 1 -- 172.21.15.132:0/545217845 wait complete. 2024-05-08T18:50:47.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.360+0000 7f9add262800 1 Processor -- start 2024-05-08T18:50:47.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.360+0000 7f9add262800 1 -- start start 2024-05-08T18:50:47.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.360+0000 7f9add262800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd578c00 0x55f3bd580190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.360+0000 7f9add262800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f3bd579d60 con 0x55f3bd578c00 2024-05-08T18:50:47.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.360+0000 7f9adb55b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd578c00 0x55f3bd580190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.360+0000 7f9adb55b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd578c00 0x55f3bd580190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60778/0 (socket says 172.21.15.132:60778) 2024-05-08T18:50:47.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.360+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 learned_addr learned my addr 172.21.15.132:0/3992670699 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.360+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3bd5806d0 con 0x55f3bd578c00 2024-05-08T18:50:47.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.361+0000 7f9adb55b640 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd578c00 0x55f3bd580190 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4022a80 tx=0x7f9ad4052bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.361+0000 7f99bcff9640 1 -- 172.21.15.132:0/3992670699 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ad40409b0 con 0x55f3bd578c00 2024-05-08T18:50:47.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.361+0000 7f99bcff9640 1 -- 172.21.15.132:0/3992670699 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ad4040b50 con 0x55f3bd578c00 2024-05-08T18:50:47.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.361+0000 7f99bcff9640 1 -- 172.21.15.132:0/3992670699 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ad4040e50 con 0x55f3bd578c00 2024-05-08T18:50:47.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.361+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f3bd580960 con 0x55f3bd578c00 2024-05-08T18:50:47.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.361+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3bd583610 con 0x55f3bd578c00 2024-05-08T18:50:47.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.361+0000 7f99bcff9640 1 -- 172.21.15.132:0/3992670699 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9ad404e040 con 0x55f3bd578c00 2024-05-08T18:50:47.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.362+0000 7f99bcff9640 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f99a403bd40 0x7f99a403e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.362+0000 7f99bcff9640 1 -- 172.21.15.132:0/3992670699 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f9ad400e040 con 0x55f3bd578c00 2024-05-08T18:50:47.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.362+0000 7f9adad5a640 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f99a403bd40 0x7f99a403e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.362+0000 7f9adad5a640 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f99a403bd40 0x7f99a403e200 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9acc092680 tx=0x7f9acc083000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.362+0000 7f9add262800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.362+0000 7f9add262800 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f3bd58be50 0x55f3bd58e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.362+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd58ea60 con 0x55f3bd58be50 2024-05-08T18:50:47.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.363+0000 7f9ad2559640 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f3bd58be50 0x55f3bd58e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.363+0000 7f9ad2559640 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f3bd58be50 0x55f3bd58e310 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.363+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ac400f670 con 0x55f3bd58be50 2024-05-08T18:50:47.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.363+0000 7f9add262800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.363+0000 7f9add262800 20 realm 2024-05-08T18:50:47.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.363+0000 7f9add262800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.363+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd58b2a0 con 0x55f3bd58be50 2024-05-08T18:50:47.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.363+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ac400f670 con 0x55f3bd58be50 2024-05-08T18:50:47.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.363+0000 7f9add262800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.363+0000 7f9add262800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:47.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.363+0000 7f9add262800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.363+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd58f550 con 0x55f3bd58be50 2024-05-08T18:50:47.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.363+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ac400f670 con 0x55f3bd58be50 2024-05-08T18:50:47.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.363+0000 7f9add262800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.363+0000 7f9add262800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.363+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd58fe20 con 0x55f3bd58be50 2024-05-08T18:50:47.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.364+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ac400f670 con 0x55f3bd58be50 2024-05-08T18:50:47.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.364+0000 7f9add262800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:47.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.364+0000 7f9add262800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.364+0000 7f9add262800 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f3bd590720 0x55f3bd592b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.364+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd5932e0 con 0x55f3bd590720 2024-05-08T18:50:47.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.364+0000 7f9adb55b640 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f3bd590720 0x55f3bd592b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.364+0000 7f9adb55b640 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f3bd590720 0x55f3bd592b50 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.364+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9ad403e070 con 0x55f3bd590720 2024-05-08T18:50:47.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.364+0000 7f9add262800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:47.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.364+0000 7f9add262800 20 searching for the correct realm 2024-05-08T18:50:47.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.364+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x55f3bd590720 2024-05-08T18:50:47.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.365+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ad403e070 con 0x55f3bd590720 2024-05-08T18:50:47.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.365+0000 7f9adb55b640 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9ad4014070 0x7f9ad402d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.365+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x7f9ad4014070 2024-05-08T18:50:47.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.365+0000 7f9adad5a640 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9ad4014070 0x7f9ad402d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.365+0000 7f9adad5a640 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9ad4014070 0x7f9ad402d450 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.366+0000 7f9adad5a640 1 -- 172.21.15.132:0/3992670699 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9acc075030 con 0x7f9ad4014070 2024-05-08T18:50:47.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.366+0000 7f9adad5a640 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f9acc078060 0x7f9acc092700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.366+0000 7f9adad5a640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x7f9acc078060 2024-05-08T18:50:47.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.366+0000 7f9ad2559640 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f9acc078060 0x7f9acc092700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.366+0000 7f9ad2559640 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f9acc078060 0x7f9acc092700 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.367+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac400f670 con 0x7f9acc078060 2024-05-08T18:50:47.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.367+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x55f3bd58be50 2024-05-08T18:50:47.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.367+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac400f670 con 0x55f3bd58be50 2024-05-08T18:50:47.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.367+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x55f3bd58be50 2024-05-08T18:50:47.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.367+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac402b040 con 0x55f3bd58be50 2024-05-08T18:50:47.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.367+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x7f9acc078060 2024-05-08T18:50:47.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.367+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac402b040 con 0x7f9acc078060 2024-05-08T18:50:47.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.367+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x7f9acc078060 2024-05-08T18:50:47.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.368+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac402b040 con 0x7f9acc078060 2024-05-08T18:50:47.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.368+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x7f9ad4014070 2024-05-08T18:50:47.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.368+0000 7f9adad5a640 1 -- 172.21.15.132:0/3992670699 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9acc075030 con 0x7f9ad4014070 2024-05-08T18:50:47.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.368+0000 7f9adad5a640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x55f3bd590720 2024-05-08T18:50:47.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.368+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ad403e070 con 0x55f3bd590720 2024-05-08T18:50:47.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.368+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x55f3bd58be50 2024-05-08T18:50:47.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.368+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac402b040 con 0x55f3bd58be50 2024-05-08T18:50:47.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.368+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x7f9acc078060 2024-05-08T18:50:47.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.369+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac402b040 con 0x7f9acc078060 2024-05-08T18:50:47.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.369+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x55f3bd58be50 2024-05-08T18:50:47.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.369+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9ac402b040 con 0x55f3bd58be50 2024-05-08T18:50:47.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.369+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x7f9ad4014070 2024-05-08T18:50:47.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.369+0000 7f9adad5a640 1 -- 172.21.15.132:0/3992670699 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9acc075030 con 0x7f9ad4014070 2024-05-08T18:50:47.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.369+0000 7f9adad5a640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x55f3bd590720 2024-05-08T18:50:47.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.369+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9ad403e070 con 0x55f3bd590720 2024-05-08T18:50:47.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.369+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x55f3bd590720 2024-05-08T18:50:47.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.370+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ad403e070 con 0x55f3bd590720 2024-05-08T18:50:47.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.370+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x7f9acc078060 2024-05-08T18:50:47.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.370+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac402b040 con 0x7f9acc078060 2024-05-08T18:50:47.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.370+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x55f3bd590720 2024-05-08T18:50:47.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.371+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ad403e070 con 0x55f3bd590720 2024-05-08T18:50:47.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.371+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x55f3bd590720 2024-05-08T18:50:47.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.371+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ad403e070 con 0x55f3bd590720 2024-05-08T18:50:47.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.371+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x55f3bd58be50 2024-05-08T18:50:47.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.371+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac402b040 con 0x55f3bd58be50 2024-05-08T18:50:47.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.371+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x55f3bd58be50 2024-05-08T18:50:47.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.371+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9ac402b040 con 0x55f3bd58be50 2024-05-08T18:50:47.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.371+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x7f9acc078060 2024-05-08T18:50:47.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.371+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac402b040 con 0x7f9acc078060 2024-05-08T18:50:47.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.371+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x55f3bd590720 2024-05-08T18:50:47.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.372+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ad403e070 con 0x55f3bd590720 2024-05-08T18:50:47.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.372+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x7f9ad4014070 2024-05-08T18:50:47.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.372+0000 7f9adad5a640 1 -- 172.21.15.132:0/3992670699 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9acc075030 con 0x7f9ad4014070 2024-05-08T18:50:47.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.372+0000 7f9adad5a640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x55f3bd58be50 2024-05-08T18:50:47.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.372+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac402b040 con 0x55f3bd58be50 2024-05-08T18:50:47.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.372+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x7f9acc078060 2024-05-08T18:50:47.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.372+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac403b040 con 0x7f9acc078060 2024-05-08T18:50:47.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.372+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x55f3bd590720 2024-05-08T18:50:47.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.373+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ad403e070 con 0x55f3bd590720 2024-05-08T18:50:47.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.373+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x7f9acc078060 2024-05-08T18:50:47.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.373+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac403b040 con 0x7f9acc078060 2024-05-08T18:50:47.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.373+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x7f9ad4014070 2024-05-08T18:50:47.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.373+0000 7f9adad5a640 1 -- 172.21.15.132:0/3992670699 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9acc075030 con 0x7f9ad4014070 2024-05-08T18:50:47.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.373+0000 7f9adad5a640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x55f3bd590720 2024-05-08T18:50:47.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.373+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ad403e070 con 0x55f3bd590720 2024-05-08T18:50:47.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.373+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x7f9acc078060 2024-05-08T18:50:47.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.374+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ac403b040 con 0x7f9acc078060 2024-05-08T18:50:47.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.374+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x55f3bd58be50 2024-05-08T18:50:47.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.374+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9ac403b040 con 0x55f3bd58be50 2024-05-08T18:50:47.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.374+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594c10 con 0x7f9ad4014070 2024-05-08T18:50:47.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.374+0000 7f9adad5a640 1 -- 172.21.15.132:0/3992670699 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9acc075030 con 0x7f9ad4014070 2024-05-08T18:50:47.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.374+0000 7f9add262800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:47.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.374+0000 7f9add262800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:47.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.374+0000 7f9add262800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:47.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.374+0000 7f9add262800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:47.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.374+0000 7f9add262800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:47.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.374+0000 7f9add262800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:47.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.374+0000 7f9add262800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.374+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd593cd0 con 0x55f3bd58be50 2024-05-08T18:50:47.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.374+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ac403b040 con 0x55f3bd58be50 2024-05-08T18:50:47.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.374+0000 7f9add262800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.374+0000 7f9add262800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.374+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd594570 con 0x55f3bd58be50 2024-05-08T18:50:47.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.375+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ac403b040 con 0x55f3bd58be50 2024-05-08T18:50:47.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.375+0000 7f9add262800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:47.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.375+0000 7f9add262800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.375+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd595090 con 0x55f3bd58be50 2024-05-08T18:50:47.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.375+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9ac403b040 con 0x55f3bd58be50 2024-05-08T18:50:47.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.375+0000 7f9add262800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:47.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.375+0000 7f9add262800 20 zone default found 2024-05-08T18:50:47.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.375+0000 7f9add262800 4 Realm: () 2024-05-08T18:50:47.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.375+0000 7f9add262800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:47.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.375+0000 7f9add262800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:47.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.375+0000 7f9add262800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:47.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.375+0000 7f9add262800 20 zonegroup default 2024-05-08T18:50:47.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.375+0000 7f9add262800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.375+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd595100 con 0x7f9acc078060 2024-05-08T18:50:47.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.375+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9ac403b040 con 0x7f9acc078060 2024-05-08T18:50:47.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.375+0000 7f9add262800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.375+0000 7f9add262800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.375+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd596f20 con 0x55f3bd590720 2024-05-08T18:50:47.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.375+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9ad403e070 con 0x55f3bd590720 2024-05-08T18:50:47.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.376+0000 7f9add262800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.376+0000 7f9add262800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.376+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd597370 con 0x55f3bd590720 2024-05-08T18:50:47.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.376+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9ad403e070 con 0x55f3bd590720 2024-05-08T18:50:47.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.376+0000 7f9add262800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.376+0000 7f9add262800 20 started sync module instance, tier type = 2024-05-08T18:50:47.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.376+0000 7f9add262800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:47.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.376+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd5963c0 con 0x7f9ad4014070 2024-05-08T18:50:47.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.377+0000 7f9adad5a640 1 -- 172.21.15.132:0/3992670699 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9acc075030 con 0x7f9ad4014070 2024-05-08T18:50:47.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.377+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94505342166960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd596020 con 0x7f9ad4014070 2024-05-08T18:50:47.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.377+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd598190 con 0x55f3bd58be50 2024-05-08T18:50:47.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.378+0000 7f9adad5a640 1 -- 172.21.15.132:0/3992670699 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94505342166960] v25'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9acc075030 con 0x7f9ad4014070 2024-05-08T18:50:47.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.378+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403b040 con 0x55f3bd58be50 2024-05-08T18:50:47.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.378+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94505342171088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd598580 con 0x55f3bd58be50 2024-05-08T18:50:47.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.378+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd598c00 con 0x55f3bd590720 2024-05-08T18:50:47.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.379+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94505342171088] v25'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403b040 con 0x55f3bd58be50 2024-05-08T18:50:47.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.379+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ad403e070 con 0x55f3bd590720 2024-05-08T18:50:47.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.379+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94505342174960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd599020 con 0x55f3bd590720 2024-05-08T18:50:47.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.379+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd599a70 con 0x7f9ad4014070 2024-05-08T18:50:47.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.380+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94505342174960] v25'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ad403e070 con 0x55f3bd590720 2024-05-08T18:50:47.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.380+0000 7f9adad5a640 1 -- 172.21.15.132:0/3992670699 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9acc075030 con 0x7f9ad4014070 2024-05-08T18:50:47.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.380+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94505342178656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd599e60 con 0x7f9ad4014070 2024-05-08T18:50:47.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.380+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd59a880 con 0x55f3bd58be50 2024-05-08T18:50:47.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.381+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403b040 con 0x55f3bd58be50 2024-05-08T18:50:47.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.381+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94505342182256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd59b120 con 0x55f3bd58be50 2024-05-08T18:50:47.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.381+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd59bbe0 con 0x7f9acc078060 2024-05-08T18:50:47.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.381+0000 7f9adad5a640 1 -- 172.21.15.132:0/3992670699 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94505342178656] v25'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9acc075030 con 0x7f9ad4014070 2024-05-08T18:50:47.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.382+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403b040 con 0x7f9acc078060 2024-05-08T18:50:47.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.382+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94505342187280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd59bbe0 con 0x7f9acc078060 2024-05-08T18:50:47.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.382+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd59c620 con 0x7f9acc078060 2024-05-08T18:50:47.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.382+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94505342182256] v25'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403b040 con 0x55f3bd58be50 2024-05-08T18:50:47.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.383+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94505342187280] v25'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403b040 con 0x7f9acc078060 2024-05-08T18:50:47.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.383+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403b040 con 0x7f9acc078060 2024-05-08T18:50:47.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.384+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94505342172144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd59c170 con 0x7f9acc078060 2024-05-08T18:50:47.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.384+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd59cb30 con 0x7f9acc078060 2024-05-08T18:50:47.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.384+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94505342172144] v25'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403b040 con 0x7f9acc078060 2024-05-08T18:50:47.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.384+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403b040 con 0x7f9acc078060 2024-05-08T18:50:47.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.384+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94505342184480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd59cb30 con 0x7f9acc078060 2024-05-08T18:50:47.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.385+0000 7f9add262800 20 add_watcher() i=0 2024-05-08T18:50:47.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.385+0000 7f9add262800 20 add_watcher() i=1 2024-05-08T18:50:47.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.385+0000 7f9add262800 20 add_watcher() i=2 2024-05-08T18:50:47.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.385+0000 7f9add262800 20 add_watcher() i=3 2024-05-08T18:50:47.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.385+0000 7f9add262800 20 add_watcher() i=4 2024-05-08T18:50:47.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.385+0000 7f9add262800 20 add_watcher() i=5 2024-05-08T18:50:47.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.385+0000 7f9add262800 20 add_watcher() i=6 2024-05-08T18:50:47.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.386+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94505342184480] v25'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403b040 con 0x7f9acc078060 2024-05-08T18:50:47.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.386+0000 7f9add262800 20 add_watcher() i=7 2024-05-08T18:50:47.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.386+0000 7f9add262800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:47.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.386+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd59fe50 con 0x55f3bd58be50 2024-05-08T18:50:47.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.386+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9ac403b040 con 0x55f3bd58be50 2024-05-08T18:50:47.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.386+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94505342191600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd59d0c0 con 0x55f3bd58be50 2024-05-08T18:50:47.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.387+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94505342191600] v25'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ac403b040 con 0x55f3bd58be50 2024-05-08T18:50:47.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.387+0000 7f99917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:47.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.387+0000 7f9add262800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:47.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.387+0000 7f9add262800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:47.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.387+0000 7f9add262800 5 note: GC not initialized 2024-05-08T18:50:47.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.387+0000 7f990bfff640 20 reqs_thread_entry: start 2024-05-08T18:50:47.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.387+0000 7f9add262800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:47.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.388+0000 7f9add262800 20 Filter name: none 2024-05-08T18:50:47.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.388+0000 7f9909ffb640 20 reqs_thread_entry: start 2024-05-08T18:50:47.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.388+0000 7f9add262800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:50:47.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.388+0000 7f9add262800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.388+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd5d33d0 con 0x55f3bd58be50 2024-05-08T18:50:47.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.388+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f9ac403b040 con 0x55f3bd58be50 2024-05-08T18:50:47.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.388+0000 7f9add262800 20 rados_obj.operate() r=0 bl.length=556 2024-05-08T18:50:47.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.388+0000 7f9add262800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:50:47.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.388+0000 7f9add262800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:47.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.388+0000 7f9add262800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:47.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.388+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd5d9a70 con 0x55f3bd58be50 2024-05-08T18:50:47.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.389+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v25'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9ac403b040 con 0x55f3bd58be50 2024-05-08T18:50:47.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.389+0000 7f9add262800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:47.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.389+0000 7f9add262800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:47.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.389+0000 7f9add262800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:50:47.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.389+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94505342440496 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd5d50b0 con 0x55f3bd58be50 2024-05-08T18:50:47.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.390+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== watch-notify(notify (1) cookie 94505342182256 notify 107374182410 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f9ac4018040 con 0x55f3bd58be50 2024-05-08T18:50:47.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.390+0000 7f99be7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182410 cookie 94505342182256 notifier 4410 bl.length()=567 2024-05-08T18:50:47.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.390+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(64 notify.4 [notify cookie 94505342440496 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9ac403b040 con 0x55f3bd58be50 2024-05-08T18:50:47.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.390+0000 7f99be7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:47.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.390+0000 7f99be7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:47.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.390+0000 7f99be7fc640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f99a0003ea0 con 0x55f3bd58be50 2024-05-08T18:50:47.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.390+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403b040 con 0x55f3bd58be50 2024-05-08T18:50:47.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.390+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== watch-notify(notify_complete (2) cookie 94505342440496 notify 107374182410 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9ac4009050 con 0x55f3bd58be50 2024-05-08T18:50:47.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.390+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd5d9430 con 0x7f9ad4014070 2024-05-08T18:50:47.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.391+0000 7f9adad5a640 1 -- 172.21.15.132:0/3992670699 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(66 foo:foo2 [delete] v25'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9acc075030 con 0x7f9ad4014070 2024-05-08T18:50:47.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.391+0000 7f9add262800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-05-08T18:50:47.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.391+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94505342424288 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd5d50b0 con 0x7f9ad4014070 2024-05-08T18:50:47.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.392+0000 7f9adad5a640 1 -- 172.21.15.132:0/3992670699 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== watch-notify(notify (1) cookie 94505342166960 notify 107374182405 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f9acc0a6040 con 0x7f9ad4014070 2024-05-08T18:50:47.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.392+0000 7f99be7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182405 cookie 94505342166960 notifier 4410 bl.length()=159 2024-05-08T18:50:47.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.392+0000 7f99be7fc640 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f99a0003ea0 con 0x7f9ad4014070 2024-05-08T18:50:47.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.392+0000 7f9adad5a640 1 -- 172.21.15.132:0/3992670699 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(67 notify.0 [notify cookie 94505342424288 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9acc075030 con 0x7f9ad4014070 2024-05-08T18:50:47.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.392+0000 7f9adad5a640 1 -- 172.21.15.132:0/3992670699 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9acc075030 con 0x7f9ad4014070 2024-05-08T18:50:47.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.392+0000 7f9adad5a640 1 -- 172.21.15.132:0/3992670699 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== watch-notify(notify_complete (2) cookie 94505342424288 notify 107374182405 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f3bd5538a0 con 0x7f9ad4014070 2024-05-08T18:50:47.414 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:50:44.835566Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:44.835553Z","tags":[],"group_ids":[]} 2024-05-08T18:50:47.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.393+0000 7f99917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:47.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.393+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94505342191600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd5d50b0 con 0x55f3bd58be50 2024-05-08T18:50:47.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.394+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94505342191600] v25'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ac403b040 con 0x55f3bd58be50 2024-05-08T18:50:47.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.394+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94505342166960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd5d50b0 con 0x7f9ad4014070 2024-05-08T18:50:47.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.395+0000 7f9adad5a640 1 -- 172.21.15.132:0/3992670699 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94505342166960] v25'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9acc075030 con 0x7f9ad4014070 2024-05-08T18:50:47.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.395+0000 7f9add262800 20 remove_watcher() i=0 2024-05-08T18:50:47.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.395+0000 7f9add262800 2 removed watcher, disabling cache 2024-05-08T18:50:47.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.395+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94505342171088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd5d50b0 con 0x55f3bd58be50 2024-05-08T18:50:47.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.396+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94505342171088] v25'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403b040 con 0x55f3bd58be50 2024-05-08T18:50:47.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.396+0000 7f9add262800 20 remove_watcher() i=1 2024-05-08T18:50:47.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.396+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94505342174960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd5d50b0 con 0x55f3bd590720 2024-05-08T18:50:47.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.397+0000 7f9adb55b640 1 -- 172.21.15.132:0/3992670699 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94505342174960] v25'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ad403e070 con 0x55f3bd590720 2024-05-08T18:50:47.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.397+0000 7f9add262800 20 remove_watcher() i=2 2024-05-08T18:50:47.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.397+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94505342178656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd5d50b0 con 0x7f9ad4014070 2024-05-08T18:50:47.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.398+0000 7f9adad5a640 1 -- 172.21.15.132:0/3992670699 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94505342178656] v25'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9acc075030 con 0x7f9ad4014070 2024-05-08T18:50:47.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.398+0000 7f9add262800 20 remove_watcher() i=3 2024-05-08T18:50:47.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.398+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94505342182256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd5d50b0 con 0x55f3bd58be50 2024-05-08T18:50:47.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.399+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94505342182256] v25'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403b040 con 0x55f3bd58be50 2024-05-08T18:50:47.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.399+0000 7f9add262800 20 remove_watcher() i=4 2024-05-08T18:50:47.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.399+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94505342187280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd5d50b0 con 0x7f9acc078060 2024-05-08T18:50:47.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.400+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94505342187280] v25'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403b040 con 0x7f9acc078060 2024-05-08T18:50:47.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.400+0000 7f9add262800 20 remove_watcher() i=5 2024-05-08T18:50:47.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.400+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94505342172144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd5967b0 con 0x7f9acc078060 2024-05-08T18:50:47.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.401+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94505342172144] v25'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403b040 con 0x7f9acc078060 2024-05-08T18:50:47.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.401+0000 7f9add262800 20 remove_watcher() i=6 2024-05-08T18:50:47.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.401+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94505342184480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f3bd5986f0 con 0x7f9acc078060 2024-05-08T18:50:47.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.402+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94505342184480] v25'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ac403b040 con 0x7f9acc078060 2024-05-08T18:50:47.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.402+0000 7f9add262800 20 remove_watcher() i=7 2024-05-08T18:50:47.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.402+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f9acc078060 msgr2=0x7f9acc092700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.402+0000 7f9add262800 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f9acc078060 0x7f9acc092700 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.402+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f3bd58be50 msgr2=0x55f3bd58e310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.402+0000 7f9add262800 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f3bd58be50 0x55f3bd58e310 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.402+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9ad4014070 msgr2=0x7f9ad402d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.402+0000 7f9add262800 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9ad4014070 0x7f9ad402d450 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.402+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f3bd590720 msgr2=0x55f3bd592b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.402+0000 7f9add262800 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f3bd590720 0x55f3bd592b50 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.402+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f99a403bd40 msgr2=0x7f99a403e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.402+0000 7f9add262800 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f99a403bd40 0x7f99a403e200 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9acc092680 tx=0x7f9acc083000 comp rx=0 tx=0).stop 2024-05-08T18:50:47.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.402+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd578c00 msgr2=0x55f3bd580190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.402+0000 7f9add262800 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd578c00 0x55f3bd580190 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4022a80 tx=0x7f9ad4052bb0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.402+0000 7f9ad2559640 1 -- 172.21.15.132:0/3992670699 reap_dead start 2024-05-08T18:50:47.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.402+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 shutdown_connections 2024-05-08T18:50:47.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.402+0000 7f9add262800 1 --2- 172.21.15.132:0/3992670699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd578c00 0x55f3bd580190 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.402+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 >> 172.21.15.132:0/3992670699 conn(0x55f3bd574f60 msgr2=0x55f3bd5725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.402+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 shutdown_connections 2024-05-08T18:50:47.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.402+0000 7f9add262800 1 -- 172.21.15.132:0/3992670699 wait complete. 2024-05-08T18:50:47.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 -- 172.21.15.132:0/474193354 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f99b403bba0 msgr2=0x7f99b403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 --2- 172.21.15.132:0/474193354 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f99b403bba0 0x7f99b403e060 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55f3bd554d30 tx=0x7f9acc05d820 comp rx=0 tx=0).stop 2024-05-08T18:50:47.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 -- 172.21.15.132:0/474193354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd56b940 msgr2=0x55f3bd56bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 --2- 172.21.15.132:0/474193354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd56b940 0x55f3bd56bd60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55f3bd5512f0 tx=0x7f9ad40188f0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 -- 172.21.15.132:0/474193354 shutdown_connections 2024-05-08T18:50:47.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 --2- 172.21.15.132:0/474193354 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f99b403bba0 0x7f99b403e060 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 --2- 172.21.15.132:0/474193354 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd56b940 0x55f3bd56bd60 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 -- 172.21.15.132:0/474193354 >> 172.21.15.132:0/474193354 conn(0x55f3bd55f9e0 msgr2=0x55f3bd55fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 -- 172.21.15.132:0/474193354 shutdown_connections 2024-05-08T18:50:47.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 -- 172.21.15.132:0/474193354 wait complete. 2024-05-08T18:50:47.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 -- 172.21.15.132:0/2667172231 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f3bd4544e0 msgr2=0x55f3bd557660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 --2- 172.21.15.132:0/2667172231 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f3bd4544e0 0x55f3bd557660 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 -- 172.21.15.132:0/2667172231 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f3bd559da0 msgr2=0x55f3bd55c230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 --2- 172.21.15.132:0/2667172231 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f3bd559da0 0x55f3bd55c230 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 -- 172.21.15.132:0/2667172231 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f99c003bb50 msgr2=0x7f99c003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 --2- 172.21.15.132:0/2667172231 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f99c003bb50 0x7f99c003e010 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4001e40 tx=0x7f9ac40013a0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 -- 172.21.15.132:0/2667172231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd453b80 msgr2=0x55f3bd550420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 --2- 172.21.15.132:0/2667172231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd453b80 0x55f3bd550420 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0524f0 tx=0x7f9acc003020 comp rx=0 tx=0).stop 2024-05-08T18:50:47.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 -- 172.21.15.132:0/2667172231 shutdown_connections 2024-05-08T18:50:47.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 --2- 172.21.15.132:0/2667172231 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f3bd559da0 0x55f3bd55c230 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 --2- 172.21.15.132:0/2667172231 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f3bd4544e0 0x55f3bd557660 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 --2- 172.21.15.132:0/2667172231 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f99c003bb50 0x7f99c003e010 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 --2- 172.21.15.132:0/2667172231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f3bd453b80 0x55f3bd550420 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 -- 172.21.15.132:0/2667172231 >> 172.21.15.132:0/2667172231 conn(0x55f3bd44f6c0 msgr2=0x55f3bd542ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 -- 172.21.15.132:0/2667172231 shutdown_connections 2024-05-08T18:50:47.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.403+0000 7f9add262800 1 -- 172.21.15.132:0/2667172231 wait complete. 2024-05-08T18:50:47.427 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:50:44.835566Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:44.835553Z', 'tags': [], 'group_ids': []} 2024-05-08T18:50:47.427 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-05-08T18:50:47.427 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-05-08T18:50:47.428 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-05-08T18:50:47.471 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:47.472 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:47.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.473+0000 7f6774733800 1 Processor -- start 2024-05-08T18:50:47.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.473+0000 7f6774733800 1 -- start start 2024-05-08T18:50:47.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.473+0000 7f6774733800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x562cfa4636a0 0x562cfa465a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.473+0000 7f6774733800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562cfa466060 con 0x562cfa45f2b0 2024-05-08T18:50:47.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.473+0000 7f6774733800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x562cfa2ffe20 con 0x562cfa4636a0 2024-05-08T18:50:47.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.474+0000 7f676fcea640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x562cfa4636a0 0x562cfa465a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.474+0000 7f676fcea640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x562cfa4636a0 0x562cfa465a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60792/0 (socket says 172.21.15.132:60792) 2024-05-08T18:50:47.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.474+0000 7f676fcea640 1 -- 172.21.15.132:0/3607883186 learned_addr learned my addr 172.21.15.132:0/3607883186 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.474+0000 7f676fcea640 1 -- 172.21.15.132:0/3607883186 >> v1:172.21.15.42:6789/0 conn(0x562cfa45f2b0 legacy=0x562cfa45f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.474+0000 7f676fcea640 1 -- 172.21.15.132:0/3607883186 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cfa467290 con 0x562cfa4636a0 2024-05-08T18:50:47.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.476+0000 7f676fcea640 1 --2- 172.21.15.132:0/3607883186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa4636a0 0x562cfa465a90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f676400a520 tx=0x7f676401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b851458ce06559 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.476+0000 7f676f4e9640 1 -- 172.21.15.132:0/3607883186 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6764057070 con 0x562cfa4636a0 2024-05-08T18:50:47.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.476+0000 7f676f4e9640 1 -- 172.21.15.132:0/3607883186 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6764052570 con 0x562cfa4636a0 2024-05-08T18:50:47.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.476+0000 7f676f4e9640 1 -- 172.21.15.132:0/3607883186 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f676404ae60 con 0x562cfa4636a0 2024-05-08T18:50:47.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.476+0000 7f6774733800 1 -- 172.21.15.132:0/3607883186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa4636a0 msgr2=0x562cfa465a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.476+0000 7f6774733800 1 --2- 172.21.15.132:0/3607883186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa4636a0 0x562cfa465a90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f676400a520 tx=0x7f676401d010 comp rx=0 tx=0).stop 2024-05-08T18:50:47.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.476+0000 7f6774733800 1 -- 172.21.15.132:0/3607883186 shutdown_connections 2024-05-08T18:50:47.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.476+0000 7f6774733800 1 --2- 172.21.15.132:0/3607883186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa4636a0 0x562cfa465a90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.476+0000 7f6774733800 1 -- 172.21.15.132:0/3607883186 >> 172.21.15.132:0/3607883186 conn(0x562cfa45a830 msgr2=0x562cfa45cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.476+0000 7f6774733800 1 -- 172.21.15.132:0/3607883186 shutdown_connections 2024-05-08T18:50:47.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.476+0000 7f6774733800 1 -- 172.21.15.132:0/3607883186 wait complete. 2024-05-08T18:50:47.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.490+0000 7f6774733800 1 Processor -- start 2024-05-08T18:50:47.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.490+0000 7f6774733800 1 -- start start 2024-05-08T18:50:47.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.490+0000 7f6774733800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa45f2b0 0x562cfa3d4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.490+0000 7f6774733800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562cfa3aa5b0 con 0x562cfa45f2b0 2024-05-08T18:50:47.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.491+0000 7f67704eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa45f2b0 0x562cfa3d4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.491+0000 7f67704eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa45f2b0 0x562cfa3d4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60808/0 (socket says 172.21.15.132:60808) 2024-05-08T18:50:47.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.491+0000 7f67704eb640 1 -- 172.21.15.132:0/3625730546 learned_addr learned my addr 172.21.15.132:0/3625730546 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.491+0000 7f67704eb640 1 -- 172.21.15.132:0/3625730546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cfa3d3230 con 0x562cfa45f2b0 2024-05-08T18:50:47.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.491+0000 7f67704eb640 1 --2- 172.21.15.132:0/3625730546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa45f2b0 0x562cfa3d4c70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6760001610 tx=0x7f6760001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5034f14447a480 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.491+0000 7f665e60c640 1 -- 172.21.15.132:0/3625730546 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6760017070 con 0x562cfa45f2b0 2024-05-08T18:50:47.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.491+0000 7f665e60c640 1 -- 172.21.15.132:0/3625730546 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f676000f660 con 0x562cfa45f2b0 2024-05-08T18:50:47.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.491+0000 7f665e60c640 1 -- 172.21.15.132:0/3625730546 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f676000f980 con 0x562cfa45f2b0 2024-05-08T18:50:47.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.492+0000 7f6774733800 1 -- 172.21.15.132:0/3625730546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa45f2b0 msgr2=0x562cfa3d4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.492+0000 7f6774733800 1 --2- 172.21.15.132:0/3625730546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa45f2b0 0x562cfa3d4c70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6760001610 tx=0x7f6760001ad0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.492+0000 7f6774733800 1 -- 172.21.15.132:0/3625730546 shutdown_connections 2024-05-08T18:50:47.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.492+0000 7f6774733800 1 --2- 172.21.15.132:0/3625730546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa45f2b0 0x562cfa3d4c70 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.492+0000 7f6774733800 1 -- 172.21.15.132:0/3625730546 >> 172.21.15.132:0/3625730546 conn(0x562cfa45a830 msgr2=0x562cfa54bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.492+0000 7f6774733800 1 -- 172.21.15.132:0/3625730546 shutdown_connections 2024-05-08T18:50:47.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.492+0000 7f6774733800 1 -- 172.21.15.132:0/3625730546 wait complete. 2024-05-08T18:50:47.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.492+0000 7f6774733800 1 Processor -- start 2024-05-08T18:50:47.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.492+0000 7f6774733800 1 -- start start 2024-05-08T18:50:47.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.492+0000 7f6774733800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa45f2b0 0x562cfa55a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.492+0000 7f6774733800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562cfa466530 con 0x562cfa45f2b0 2024-05-08T18:50:47.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.493+0000 7f67704eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa45f2b0 0x562cfa55a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.493+0000 7f67704eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa45f2b0 0x562cfa55a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60814/0 (socket says 172.21.15.132:60814) 2024-05-08T18:50:47.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.493+0000 7f67704eb640 1 -- 172.21.15.132:0/720351657 learned_addr learned my addr 172.21.15.132:0/720351657 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.493+0000 7f67704eb640 1 -- 172.21.15.132:0/720351657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cfa55a910 con 0x562cfa45f2b0 2024-05-08T18:50:47.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.493+0000 7f67704eb640 1 --2- 172.21.15.132:0/720351657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa45f2b0 0x562cfa55a3d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6760003000 tx=0x7f6760000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.493+0000 7f665ce09640 1 -- 172.21.15.132:0/720351657 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6760017070 con 0x562cfa45f2b0 2024-05-08T18:50:47.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.493+0000 7f6774733800 1 -- 172.21.15.132:0/720351657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562cfa55aba0 con 0x562cfa45f2b0 2024-05-08T18:50:47.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.493+0000 7f665ce09640 1 -- 172.21.15.132:0/720351657 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6760023070 con 0x562cfa45f2b0 2024-05-08T18:50:47.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.493+0000 7f665ce09640 1 -- 172.21.15.132:0/720351657 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6760011c20 con 0x562cfa45f2b0 2024-05-08T18:50:47.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.493+0000 7f6774733800 1 -- 172.21.15.132:0/720351657 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cfa55d800 con 0x562cfa45f2b0 2024-05-08T18:50:47.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.494+0000 7f665ce09640 1 -- 172.21.15.132:0/720351657 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6760028460 con 0x562cfa45f2b0 2024-05-08T18:50:47.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.494+0000 7f665ce09640 1 --2- 172.21.15.132:0/720351657 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f665803bb50 0x7f665803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.494+0000 7f665ce09640 1 -- 172.21.15.132:0/720351657 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f67600524d0 con 0x562cfa45f2b0 2024-05-08T18:50:47.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.494+0000 7f676fcea640 1 --2- 172.21.15.132:0/720351657 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f665803bb50 0x7f665803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.494+0000 7f6774733800 1 --2- 172.21.15.132:0/720351657 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562cfa4636a0 0x562cfa5615c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.494+0000 7f6774733800 1 -- 172.21.15.132:0/720351657 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562cfa561b00 con 0x562cfa4636a0 2024-05-08T18:50:47.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.495+0000 7f6770cec640 1 --2- 172.21.15.132:0/720351657 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562cfa4636a0 0x562cfa5615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.495+0000 7f676fcea640 1 --2- 172.21.15.132:0/720351657 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f665803bb50 0x7f665803e010 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6764054000 tx=0x7f676404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.495+0000 7f6770cec640 1 --2- 172.21.15.132:0/720351657 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562cfa4636a0 0x562cfa5615c0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.495+0000 7f6770cec640 1 -- 172.21.15.132:0/720351657 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f67680083e0 con 0x562cfa4636a0 2024-05-08T18:50:47.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.495+0000 7f6774733800 1 -- 172.21.15.132:0/720351657 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562cfa55eb70 con 0x562cfa4636a0 2024-05-08T18:50:47.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.495+0000 7f6770cec640 1 -- 172.21.15.132:0/720351657 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f67680083e0 con 0x562cfa4636a0 2024-05-08T18:50:47.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.495+0000 7f6774733800 1 --2- 172.21.15.132:0/720351657 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562cfa563df0 0x562cfa5661e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.495+0000 7f6774733800 1 -- 172.21.15.132:0/720351657 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5668d0 con 0x562cfa563df0 2024-05-08T18:50:47.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.496+0000 7f67704eb640 1 --2- 172.21.15.132:0/720351657 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562cfa563df0 0x562cfa5661e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.496+0000 7f67704eb640 1 --2- 172.21.15.132:0/720351657 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562cfa563df0 0x562cfa5661e0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.496+0000 7f67704eb640 1 -- 172.21.15.132:0/720351657 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6760003030 con 0x562cfa563df0 2024-05-08T18:50:47.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.496+0000 7f6774733800 1 -- 172.21.15.132:0/720351657 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562cfa562c90 con 0x562cfa4636a0 2024-05-08T18:50:47.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.496+0000 7f6770cec640 1 -- 172.21.15.132:0/720351657 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f67680083e0 con 0x562cfa4636a0 2024-05-08T18:50:47.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.496+0000 7f6774733800 1 -- 172.21.15.132:0/720351657 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562cfa563150 con 0x562cfa4636a0 2024-05-08T18:50:47.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.497+0000 7f6770cec640 1 -- 172.21.15.132:0/720351657 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f67680083e0 con 0x562cfa4636a0 2024-05-08T18:50:47.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.497+0000 7f6774733800 1 Processor -- start 2024-05-08T18:50:47.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.497+0000 7f6774733800 1 -- start start 2024-05-08T18:50:47.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.497+0000 7f6774733800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa575870 0x562cfa575c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.497+0000 7f6774733800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562cfa350fc0 con 0x562cfa575870 2024-05-08T18:50:47.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.497+0000 7f6770cec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa575870 0x562cfa575c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.497+0000 7f6770cec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa575870 0x562cfa575c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60822/0 (socket says 172.21.15.132:60822) 2024-05-08T18:50:47.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.497+0000 7f6770cec640 1 -- 172.21.15.132:0/1558092537 learned_addr learned my addr 172.21.15.132:0/1558092537 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.498+0000 7f6770cec640 1 -- 172.21.15.132:0/1558092537 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cfa5761d0 con 0x562cfa575870 2024-05-08T18:50:47.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.498+0000 7f6770cec640 1 --2- 172.21.15.132:0/1558092537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa575870 0x562cfa575c90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x562cfa55b780 tx=0x7f676800aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.498+0000 7f6655ffb640 1 -- 172.21.15.132:0/1558092537 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6768007d00 con 0x562cfa575870 2024-05-08T18:50:47.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.498+0000 7f6655ffb640 1 -- 172.21.15.132:0/1558092537 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f676801e020 con 0x562cfa575870 2024-05-08T18:50:47.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.498+0000 7f6655ffb640 1 -- 172.21.15.132:0/1558092537 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6768019420 con 0x562cfa575870 2024-05-08T18:50:47.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.498+0000 7f6774733800 1 -- 172.21.15.132:0/1558092537 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562cfa576c40 con 0x562cfa575870 2024-05-08T18:50:47.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.498+0000 7f6774733800 1 -- 172.21.15.132:0/1558092537 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cfa577140 con 0x562cfa575870 2024-05-08T18:50:47.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.499+0000 7f6655ffb640 1 -- 172.21.15.132:0/1558092537 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6768016040 con 0x562cfa575870 2024-05-08T18:50:47.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.499+0000 7f6655ffb640 1 --2- 172.21.15.132:0/1558092537 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f664803bb50 0x7f664803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.499+0000 7f6655ffb640 1 -- 172.21.15.132:0/1558092537 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f676801f030 con 0x562cfa575870 2024-05-08T18:50:47.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.499+0000 7f67704eb640 1 --2- 172.21.15.132:0/1558092537 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f664803bb50 0x7f664803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.499+0000 7f6774733800 1 Processor -- start 2024-05-08T18:50:47.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.499+0000 7f67704eb640 1 --2- 172.21.15.132:0/1558092537 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f664803bb50 0x7f664803e010 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x562cfa561f60 tx=0x7f676001cf90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.499+0000 7f6774733800 1 -- start start 2024-05-08T18:50:47.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.500+0000 7f6774733800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa582bd0 0x562cfa582ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.500+0000 7f6774733800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562cfa3d35b0 con 0x562cfa582bd0 2024-05-08T18:50:47.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.500+0000 7f6770cec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa582bd0 0x562cfa582ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.500+0000 7f6770cec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa582bd0 0x562cfa582ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60836/0 (socket says 172.21.15.132:60836) 2024-05-08T18:50:47.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.500+0000 7f6770cec640 1 -- 172.21.15.132:0/205045818 learned_addr learned my addr 172.21.15.132:0/205045818 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.500+0000 7f6770cec640 1 -- 172.21.15.132:0/205045818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cfa5835c0 con 0x562cfa582bd0 2024-05-08T18:50:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.500+0000 7f6770cec640 1 --2- 172.21.15.132:0/205045818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa582bd0 0x562cfa582ff0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6768018fd0 tx=0x7f6768014710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee995660ef8a61eb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.500+0000 7f66477fe640 1 -- 172.21.15.132:0/205045818 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f676801d070 con 0x562cfa582bd0 2024-05-08T18:50:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.500+0000 7f66477fe640 1 -- 172.21.15.132:0/205045818 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67680540d0 con 0x562cfa582bd0 2024-05-08T18:50:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.500+0000 7f66477fe640 1 -- 172.21.15.132:0/205045818 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67680543b0 con 0x562cfa582bd0 2024-05-08T18:50:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.501+0000 7f6774733800 1 -- 172.21.15.132:0/205045818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa582bd0 msgr2=0x562cfa582ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.501+0000 7f6774733800 1 --2- 172.21.15.132:0/205045818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa582bd0 0x562cfa582ff0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6768018fd0 tx=0x7f6768014710 comp rx=0 tx=0).stop 2024-05-08T18:50:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.501+0000 7f6774733800 1 -- 172.21.15.132:0/205045818 shutdown_connections 2024-05-08T18:50:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.501+0000 7f6774733800 1 --2- 172.21.15.132:0/205045818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa582bd0 0x562cfa582ff0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.501+0000 7f6774733800 1 -- 172.21.15.132:0/205045818 >> 172.21.15.132:0/205045818 conn(0x562cfa57eee0 msgr2=0x562cfa57cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.501+0000 7f6774733800 1 -- 172.21.15.132:0/205045818 shutdown_connections 2024-05-08T18:50:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.501+0000 7f6774733800 1 -- 172.21.15.132:0/205045818 wait complete. 2024-05-08T18:50:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.501+0000 7f6774733800 1 Processor -- start 2024-05-08T18:50:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.501+0000 7f6774733800 1 -- start start 2024-05-08T18:50:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.501+0000 7f6774733800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa582bd0 0x562cfa58a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.501+0000 7f6774733800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562cfa583d90 con 0x562cfa582bd0 2024-05-08T18:50:47.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.501+0000 7f6770cec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa582bd0 0x562cfa58a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.501+0000 7f6770cec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa582bd0 0x562cfa58a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60838/0 (socket says 172.21.15.132:60838) 2024-05-08T18:50:47.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.501+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 learned_addr learned my addr 172.21.15.132:0/1806038505 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.502+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cfa58a640 con 0x562cfa582bd0 2024-05-08T18:50:47.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.502+0000 7f6770cec640 1 --2- 172.21.15.132:0/1806038505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa582bd0 0x562cfa58a100 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6768043040 tx=0x7f6768052c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.502+0000 7f6645ffb640 1 -- 172.21.15.132:0/1806038505 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6768030020 con 0x562cfa582bd0 2024-05-08T18:50:47.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.502+0000 7f6645ffb640 1 -- 172.21.15.132:0/1806038505 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6768051650 con 0x562cfa582bd0 2024-05-08T18:50:47.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.502+0000 7f6645ffb640 1 -- 172.21.15.132:0/1806038505 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6768019650 con 0x562cfa582bd0 2024-05-08T18:50:47.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.502+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562cfa58a8d0 con 0x562cfa582bd0 2024-05-08T18:50:47.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.502+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cfa58d580 con 0x562cfa582bd0 2024-05-08T18:50:47.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.503+0000 7f6645ffb640 1 -- 172.21.15.132:0/1806038505 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6768033020 con 0x562cfa582bd0 2024-05-08T18:50:47.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.503+0000 7f6645ffb640 1 --2- 172.21.15.132:0/1806038505 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f663803bba0 0x7f663803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.503+0000 7f6645ffb640 1 -- 172.21.15.132:0/1806038505 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f6768036ad0 con 0x562cfa582bd0 2024-05-08T18:50:47.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.503+0000 7f6774733800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.503+0000 7f67704eb640 1 --2- 172.21.15.132:0/1806038505 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f663803bba0 0x7f663803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.503+0000 7f6774733800 1 --2- 172.21.15.132:0/1806038505 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562cfa595be0 0x562cfa598080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.504+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5987d0 con 0x562cfa595be0 2024-05-08T18:50:47.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.504+0000 7f676fcea640 1 --2- 172.21.15.132:0/1806038505 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562cfa595be0 0x562cfa598080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.504+0000 7f67704eb640 1 --2- 172.21.15.132:0/1806038505 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f663803bba0 0x7f663803e060 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6760052010 tx=0x7f676004f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.504+0000 7f676fcea640 1 --2- 172.21.15.132:0/1806038505 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562cfa595be0 0x562cfa598080 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.504+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.504+0000 7f6774733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.504+0000 7f6774733800 20 realm 2024-05-08T18:50:47.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.504+0000 7f6774733800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.504+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562cfa598ba0 con 0x562cfa595be0 2024-05-08T18:50:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.504+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.504+0000 7f6774733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.504+0000 7f6774733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.504+0000 7f6774733800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.504+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562cfa599470 con 0x562cfa595be0 2024-05-08T18:50:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.505+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.505+0000 7f6774733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.505+0000 7f6774733800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.505+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562cfa599810 con 0x562cfa595be0 2024-05-08T18:50:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.505+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.505+0000 7f6774733800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.505+0000 7f6774733800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.505+0000 7f6774733800 1 --2- 172.21.15.132:0/1806038505 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562cfa59a2c0 0x562cfa59c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.505+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59ce10 con 0x562cfa59a2c0 2024-05-08T18:50:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.505+0000 7f6770cec640 1 --2- 172.21.15.132:0/1806038505 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562cfa59a2c0 0x562cfa59c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.505+0000 7f6770cec640 1 --2- 172.21.15.132:0/1806038505 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562cfa59a2c0 0x562cfa59c6b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.506+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f67680083e0 con 0x562cfa59a2c0 2024-05-08T18:50:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.506+0000 7f6774733800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.506+0000 7f6774733800 20 searching for the correct realm 2024-05-08T18:50:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.506+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x562cfa59a2c0 2024-05-08T18:50:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.506+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67680083e0 con 0x562cfa59a2c0 2024-05-08T18:50:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.506+0000 7f6770cec640 1 --2- 172.21.15.132:0/1806038505 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6768035020 0x7f676804e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.506+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x7f6768035020 2024-05-08T18:50:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.506+0000 7f67704eb640 1 --2- 172.21.15.132:0/1806038505 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6768035020 0x7f676804e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.506+0000 7f67704eb640 1 --2- 172.21.15.132:0/1806038505 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6768035020 0x7f676804e7f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.507+0000 7f67704eb640 1 -- 172.21.15.132:0/1806038505 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6760003030 con 0x7f6768035020 2024-05-08T18:50:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.507+0000 7f67704eb640 1 --2- 172.21.15.132:0/1806038505 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f6760049190 0x7f6760026360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.507+0000 7f67704eb640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x7f6760049190 2024-05-08T18:50:47.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.507+0000 7f676fcea640 1 --2- 172.21.15.132:0/1806038505 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f6760049190 0x7f6760026360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.507+0000 7f676fcea640 1 --2- 172.21.15.132:0/1806038505 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f6760049190 0x7f6760026360 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.508+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f676405a040 con 0x7f6760049190 2024-05-08T18:50:47.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.508+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x562cfa595be0 2024-05-08T18:50:47.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.508+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.508+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x562cfa595be0 2024-05-08T18:50:47.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.508+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.508+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x7f6760049190 2024-05-08T18:50:47.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.508+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f676405a040 con 0x7f6760049190 2024-05-08T18:50:47.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.508+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x7f6760049190 2024-05-08T18:50:47.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.509+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f676405a040 con 0x7f6760049190 2024-05-08T18:50:47.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.509+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x7f6768035020 2024-05-08T18:50:47.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.509+0000 7f67704eb640 1 -- 172.21.15.132:0/1806038505 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6760003030 con 0x7f6768035020 2024-05-08T18:50:47.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.509+0000 7f67704eb640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x562cfa59a2c0 2024-05-08T18:50:47.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.509+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67680083e0 con 0x562cfa59a2c0 2024-05-08T18:50:47.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.509+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x562cfa595be0 2024-05-08T18:50:47.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.509+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.509+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x7f6760049190 2024-05-08T18:50:47.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.510+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f676405a040 con 0x7f6760049190 2024-05-08T18:50:47.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.510+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x562cfa595be0 2024-05-08T18:50:47.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.510+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.510+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x7f6768035020 2024-05-08T18:50:47.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.510+0000 7f67704eb640 1 -- 172.21.15.132:0/1806038505 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6760003030 con 0x7f6768035020 2024-05-08T18:50:47.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.510+0000 7f67704eb640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x562cfa59a2c0 2024-05-08T18:50:47.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.510+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f67680083e0 con 0x562cfa59a2c0 2024-05-08T18:50:47.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.510+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x562cfa59a2c0 2024-05-08T18:50:47.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.511+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67680083e0 con 0x562cfa59a2c0 2024-05-08T18:50:47.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.511+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x7f6760049190 2024-05-08T18:50:47.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.511+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f676405a040 con 0x7f6760049190 2024-05-08T18:50:47.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.511+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x562cfa59a2c0 2024-05-08T18:50:47.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.511+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67680083e0 con 0x562cfa59a2c0 2024-05-08T18:50:47.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.511+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x562cfa59a2c0 2024-05-08T18:50:47.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.511+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67680083e0 con 0x562cfa59a2c0 2024-05-08T18:50:47.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.511+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x562cfa595be0 2024-05-08T18:50:47.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.512+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.512+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x562cfa595be0 2024-05-08T18:50:47.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.512+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.512+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x7f6760049190 2024-05-08T18:50:47.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.512+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f676405a040 con 0x7f6760049190 2024-05-08T18:50:47.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.512+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x562cfa59a2c0 2024-05-08T18:50:47.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.512+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67680083e0 con 0x562cfa59a2c0 2024-05-08T18:50:47.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.512+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x7f6768035020 2024-05-08T18:50:47.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.513+0000 7f67704eb640 1 -- 172.21.15.132:0/1806038505 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6760003030 con 0x7f6768035020 2024-05-08T18:50:47.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.513+0000 7f67704eb640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x562cfa595be0 2024-05-08T18:50:47.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.513+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.513+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x7f6760049190 2024-05-08T18:50:47.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.513+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f676405a040 con 0x7f6760049190 2024-05-08T18:50:47.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.513+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x562cfa59a2c0 2024-05-08T18:50:47.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.513+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67680083e0 con 0x562cfa59a2c0 2024-05-08T18:50:47.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.513+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x7f6760049190 2024-05-08T18:50:47.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.514+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f676405a040 con 0x7f6760049190 2024-05-08T18:50:47.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.514+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x7f6768035020 2024-05-08T18:50:47.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.514+0000 7f67704eb640 1 -- 172.21.15.132:0/1806038505 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6760003030 con 0x7f6768035020 2024-05-08T18:50:47.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.514+0000 7f67704eb640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x562cfa59a2c0 2024-05-08T18:50:47.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.514+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67680083e0 con 0x562cfa59a2c0 2024-05-08T18:50:47.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.514+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x7f6760049190 2024-05-08T18:50:47.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.514+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f676405a040 con 0x7f6760049190 2024-05-08T18:50:47.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.514+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x562cfa595be0 2024-05-08T18:50:47.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.515+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.515+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e7f0 con 0x7f6768035020 2024-05-08T18:50:47.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.515+0000 7f67704eb640 1 -- 172.21.15.132:0/1806038505 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6760003030 con 0x7f6768035020 2024-05-08T18:50:47.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.515+0000 7f6774733800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:47.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.515+0000 7f6774733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:47.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.515+0000 7f6774733800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:47.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.515+0000 7f6774733800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:47.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.515+0000 7f6774733800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:47.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.515+0000 7f6774733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:47.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.515+0000 7f6774733800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.515+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59d8c0 con 0x562cfa595be0 2024-05-08T18:50:47.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.515+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.515+0000 7f6774733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.515+0000 7f6774733800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.515+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59e160 con 0x562cfa595be0 2024-05-08T18:50:47.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.515+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.516+0000 7f6774733800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:47.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.516+0000 7f6774733800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.516+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59d500 con 0x562cfa595be0 2024-05-08T18:50:47.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.516+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.516+0000 7f6774733800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:47.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.516+0000 7f6774733800 20 zone default found 2024-05-08T18:50:47.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.516+0000 7f6774733800 4 Realm: () 2024-05-08T18:50:47.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.516+0000 7f6774733800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:47.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.516+0000 7f6774733800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:47.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.516+0000 7f6774733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:47.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.516+0000 7f6774733800 20 zonegroup default 2024-05-08T18:50:47.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.516+0000 7f6774733800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.516+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59f170 con 0x7f6760049190 2024-05-08T18:50:47.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.516+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f676405a040 con 0x7f6760049190 2024-05-08T18:50:47.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.516+0000 7f6774733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.516+0000 7f6774733800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.516+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5a0b80 con 0x562cfa59a2c0 2024-05-08T18:50:47.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.516+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f67680083e0 con 0x562cfa59a2c0 2024-05-08T18:50:47.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.516+0000 7f6774733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.516+0000 7f6774733800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.516+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5a0fe0 con 0x562cfa59a2c0 2024-05-08T18:50:47.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.517+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f67680083e0 con 0x562cfa59a2c0 2024-05-08T18:50:47.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.517+0000 7f6774733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.517+0000 7f6774733800 20 started sync module instance, tier type = 2024-05-08T18:50:47.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.517+0000 7f6774733800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:47.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.517+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59ff90 con 0x7f6768035020 2024-05-08T18:50:47.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.518+0000 7f67704eb640 1 -- 172.21.15.132:0/1806038505 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6760003030 con 0x7f6768035020 2024-05-08T18:50:47.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.518+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94751178750688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5a1420 con 0x7f6768035020 2024-05-08T18:50:47.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.518+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5a1c70 con 0x562cfa595be0 2024-05-08T18:50:47.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.519+0000 7f67704eb640 1 -- 172.21.15.132:0/1806038505 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94751178750688] v25'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6760003030 con 0x7f6768035020 2024-05-08T18:50:47.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.519+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.519+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94751178758080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5a2090 con 0x562cfa595be0 2024-05-08T18:50:47.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.519+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5a2a50 con 0x562cfa59a2c0 2024-05-08T18:50:47.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.520+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94751178758080] v25'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.520+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67680083e0 con 0x562cfa59a2c0 2024-05-08T18:50:47.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.520+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94751178759616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5a2a50 con 0x562cfa59a2c0 2024-05-08T18:50:47.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.520+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5a3450 con 0x7f6768035020 2024-05-08T18:50:47.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.521+0000 7f67704eb640 1 -- 172.21.15.132:0/1806038505 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6760003030 con 0x7f6768035020 2024-05-08T18:50:47.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.521+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94751178759616] v25'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67680083e0 con 0x562cfa59a2c0 2024-05-08T18:50:47.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.521+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94751178761632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5a3840 con 0x7f6768035020 2024-05-08T18:50:47.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.521+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5a4240 con 0x562cfa595be0 2024-05-08T18:50:47.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.522+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.522+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94751178767696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5a4b10 con 0x562cfa595be0 2024-05-08T18:50:47.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.522+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5a55e0 con 0x7f6760049190 2024-05-08T18:50:47.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.522+0000 7f67704eb640 1 -- 172.21.15.132:0/1806038505 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94751178761632] v25'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6760003030 con 0x7f6768035020 2024-05-08T18:50:47.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.523+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f676405a040 con 0x7f6760049190 2024-05-08T18:50:47.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.523+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94751178772688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5a55a0 con 0x7f6760049190 2024-05-08T18:50:47.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.523+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5a6020 con 0x7f6760049190 2024-05-08T18:50:47.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.523+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94751178767696] v25'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.524+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94751178772688] v25'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f676405a040 con 0x7f6760049190 2024-05-08T18:50:47.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.524+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f676405a040 con 0x7f6760049190 2024-05-08T18:50:47.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.524+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94751178764128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5a5b70 con 0x7f6760049190 2024-05-08T18:50:47.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.524+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5a6530 con 0x7f6760049190 2024-05-08T18:50:47.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.526+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(58 notify.7 [create] v25'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f676405a040 con 0x7f6760049190 2024-05-08T18:50:47.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.526+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94751178776704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5a6950 con 0x7f6760049190 2024-05-08T18:50:47.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.526+0000 7f6774733800 20 add_watcher() i=0 2024-05-08T18:50:47.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.526+0000 7f6774733800 20 add_watcher() i=1 2024-05-08T18:50:47.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.526+0000 7f6774733800 20 add_watcher() i=2 2024-05-08T18:50:47.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.526+0000 7f6774733800 20 add_watcher() i=3 2024-05-08T18:50:47.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.526+0000 7f6774733800 20 add_watcher() i=4 2024-05-08T18:50:47.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.526+0000 7f6774733800 20 add_watcher() i=5 2024-05-08T18:50:47.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.526+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94751178764128] v25'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f676405a040 con 0x7f6760049190 2024-05-08T18:50:47.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.526+0000 7f6774733800 20 add_watcher() i=6 2024-05-08T18:50:47.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.527+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94751178776704] v25'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f676405a040 con 0x7f6760049190 2024-05-08T18:50:47.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.527+0000 7f6774733800 20 add_watcher() i=7 2024-05-08T18:50:47.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.527+0000 7f6774733800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:47.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.527+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5a4660 con 0x562cfa595be0 2024-05-08T18:50:47.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.527+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.527+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94751178770016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5a6e20 con 0x562cfa595be0 2024-05-08T18:50:47.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.528+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94751178770016] v25'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.528+0000 7f6626fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:47.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.528+0000 7f6774733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:47.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.528+0000 7f6774733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:47.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.528+0000 7f6774733800 5 note: GC not initialized 2024-05-08T18:50:47.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.528+0000 7f6625fdb640 20 reqs_thread_entry: start 2024-05-08T18:50:47.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.529+0000 7f6774733800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:47.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.529+0000 7f6774733800 20 Filter name: none 2024-05-08T18:50:47.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.529+0000 7f65977fe640 20 reqs_thread_entry: start 2024-05-08T18:50:47.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.529+0000 7f6774733800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.529+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5dc860 con 0x562cfa595be0 2024-05-08T18:50:47.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.529+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.529+0000 7f6774733800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:47.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.529+0000 7f6774733800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.529+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5dd0f0 con 0x562cfa595be0 2024-05-08T18:50:47.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.529+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.530+0000 7f6774733800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:47.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.530+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5de100 con 0x7f6768035020 2024-05-08T18:50:47.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.530+0000 7f67704eb640 1 -- 172.21.15.132:0/1806038505 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f6760003030 con 0x7f6768035020 2024-05-08T18:50:47.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.530+0000 7f6626fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:47.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.531+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94751178770016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5a7260 con 0x562cfa595be0 2024-05-08T18:50:47.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.532+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94751178770016] v25'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.532+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94751178750688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5a4660 con 0x7f6768035020 2024-05-08T18:50:47.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.533+0000 7f67704eb640 1 -- 172.21.15.132:0/1806038505 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94751178750688] v25'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6760003030 con 0x7f6768035020 2024-05-08T18:50:47.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.533+0000 7f6774733800 20 remove_watcher() i=0 2024-05-08T18:50:47.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.533+0000 7f6774733800 2 removed watcher, disabling cache 2024-05-08T18:50:47.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.533+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94751178758080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59fae0 con 0x562cfa595be0 2024-05-08T18:50:47.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.534+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94751178758080] v25'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.534+0000 7f6774733800 20 remove_watcher() i=1 2024-05-08T18:50:47.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.534+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94751178759616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59fae0 con 0x562cfa59a2c0 2024-05-08T18:50:47.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.535+0000 7f6770cec640 1 -- 172.21.15.132:0/1806038505 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94751178759616] v25'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67680083e0 con 0x562cfa59a2c0 2024-05-08T18:50:47.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.535+0000 7f6774733800 20 remove_watcher() i=2 2024-05-08T18:50:47.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.535+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94751178761632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa5a1dc0 con 0x7f6768035020 2024-05-08T18:50:47.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.536+0000 7f67704eb640 1 -- 172.21.15.132:0/1806038505 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94751178761632] v25'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6760003030 con 0x7f6768035020 2024-05-08T18:50:47.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.536+0000 7f6774733800 20 remove_watcher() i=3 2024-05-08T18:50:47.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.536+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94751178767696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59fae0 con 0x562cfa595be0 2024-05-08T18:50:47.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.537+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94751178767696] v25'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f676405a040 con 0x562cfa595be0 2024-05-08T18:50:47.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.537+0000 7f6774733800 20 remove_watcher() i=4 2024-05-08T18:50:47.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.537+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94751178772688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59fae0 con 0x7f6760049190 2024-05-08T18:50:47.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.537+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94751178772688] v25'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f676405a040 con 0x7f6760049190 2024-05-08T18:50:47.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.537+0000 7f6774733800 20 remove_watcher() i=5 2024-05-08T18:50:47.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.537+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94751178764128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59fae0 con 0x7f6760049190 2024-05-08T18:50:47.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.538+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94751178764128] v25'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f676405a040 con 0x7f6760049190 2024-05-08T18:50:47.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.538+0000 7f6774733800 20 remove_watcher() i=6 2024-05-08T18:50:47.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.538+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94751178776704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562cfa59fae0 con 0x7f6760049190 2024-05-08T18:50:47.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.539+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94751178776704] v25'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f676405a040 con 0x7f6760049190 2024-05-08T18:50:47.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.539+0000 7f6774733800 20 remove_watcher() i=7 2024-05-08T18:50:47.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.539+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f6760049190 msgr2=0x7f6760026360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.539+0000 7f6774733800 1 --2- 172.21.15.132:0/1806038505 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f6760049190 0x7f6760026360 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.539+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562cfa595be0 msgr2=0x562cfa598080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.539+0000 7f6774733800 1 --2- 172.21.15.132:0/1806038505 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562cfa595be0 0x562cfa598080 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.539+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6768035020 msgr2=0x7f676804e7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.539+0000 7f6774733800 1 --2- 172.21.15.132:0/1806038505 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6768035020 0x7f676804e7f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.539+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562cfa59a2c0 msgr2=0x562cfa59c6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.539+0000 7f6774733800 1 --2- 172.21.15.132:0/1806038505 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562cfa59a2c0 0x562cfa59c6b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f663803bba0 msgr2=0x7f663803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f6774733800 1 --2- 172.21.15.132:0/1806038505 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f663803bba0 0x7f663803e060 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6760052010 tx=0x7f676004f000 comp rx=0 tx=0).stop 2024-05-08T18:50:47.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa582bd0 msgr2=0x562cfa58a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f6774733800 1 --2- 172.21.15.132:0/1806038505 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa582bd0 0x562cfa58a100 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6768043040 tx=0x7f6768052c00 comp rx=0 tx=0).stop 2024-05-08T18:50:47.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 reap_dead start 2024-05-08T18:50:47.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f676fcea640 1 -- 172.21.15.132:0/1806038505 reap_dead start 2024-05-08T18:50:47.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 shutdown_connections 2024-05-08T18:50:47.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 >> 172.21.15.132:0/1806038505 conn(0x562cfa57eee0 msgr2=0x562cfa57c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 shutdown_connections 2024-05-08T18:50:47.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f6774733800 1 -- 172.21.15.132:0/1806038505 wait complete. 2024-05-08T18:50:47.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f6774733800 1 -- 172.21.15.132:0/1558092537 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f664803bb50 msgr2=0x7f664803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f6774733800 1 --2- 172.21.15.132:0/1558092537 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f664803bb50 0x7f664803e010 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x562cfa561f60 tx=0x7f676001cf90 comp rx=0 tx=0).stop 2024-05-08T18:50:47.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f6774733800 1 -- 172.21.15.132:0/1558092537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa575870 msgr2=0x562cfa575c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f6774733800 1 --2- 172.21.15.132:0/1558092537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa575870 0x562cfa575c90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x562cfa55b780 tx=0x7f676800aec0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f6774733800 1 -- 172.21.15.132:0/1558092537 shutdown_connections 2024-05-08T18:50:47.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f6774733800 1 --2- 172.21.15.132:0/1558092537 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f664803bb50 0x7f664803e010 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f6774733800 1 --2- 172.21.15.132:0/1558092537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa575870 0x562cfa575c90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f6774733800 1 -- 172.21.15.132:0/1558092537 >> 172.21.15.132:0/1558092537 conn(0x562cfa569910 msgr2=0x562cfa569d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f6774733800 1 -- 172.21.15.132:0/1558092537 shutdown_connections 2024-05-08T18:50:47.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f6774733800 1 -- 172.21.15.132:0/1558092537 wait complete. 2024-05-08T18:50:47.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f6774733800 1 -- 172.21.15.132:0/720351657 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562cfa4636a0 msgr2=0x562cfa5615c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f6774733800 1 --2- 172.21.15.132:0/720351657 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562cfa4636a0 0x562cfa5615c0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f6774733800 1 -- 172.21.15.132:0/720351657 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562cfa563df0 msgr2=0x562cfa5661e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.540+0000 7f6774733800 1 --2- 172.21.15.132:0/720351657 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562cfa563df0 0x562cfa5661e0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.541+0000 7f6774733800 1 -- 172.21.15.132:0/720351657 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f665803bb50 msgr2=0x7f665803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.541+0000 7f6774733800 1 --2- 172.21.15.132:0/720351657 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f665803bb50 0x7f665803e010 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6764054000 tx=0x7f676404e000 comp rx=0 tx=0).stop 2024-05-08T18:50:47.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.541+0000 7f6774733800 1 -- 172.21.15.132:0/720351657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa45f2b0 msgr2=0x562cfa55a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.541+0000 7f6774733800 1 --2- 172.21.15.132:0/720351657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa45f2b0 0x562cfa55a3d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6760003000 tx=0x7f6760000f40 comp rx=0 tx=0).stop 2024-05-08T18:50:47.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.541+0000 7f6774733800 1 -- 172.21.15.132:0/720351657 shutdown_connections 2024-05-08T18:50:47.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.541+0000 7f6774733800 1 --2- 172.21.15.132:0/720351657 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562cfa563df0 0x562cfa5661e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.541+0000 7f6774733800 1 --2- 172.21.15.132:0/720351657 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562cfa4636a0 0x562cfa5615c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.541+0000 7f6774733800 1 --2- 172.21.15.132:0/720351657 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f665803bb50 0x7f665803e010 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.541+0000 7f6774733800 1 --2- 172.21.15.132:0/720351657 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562cfa45f2b0 0x562cfa55a3d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.541+0000 7f6774733800 1 -- 172.21.15.132:0/720351657 >> 172.21.15.132:0/720351657 conn(0x562cfa45a830 msgr2=0x562cfa3d3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.541+0000 7f6774733800 1 -- 172.21.15.132:0/720351657 shutdown_connections 2024-05-08T18:50:47.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.541+0000 7f6774733800 1 -- 172.21.15.132:0/720351657 wait complete. 2024-05-08T18:50:47.553 INFO:teuthology.orchestra.run.smithi132.stdout:[] 2024-05-08T18:50:47.553 DEBUG:tasks.util.rgw: json result: [] 2024-05-08T18:50:47.553 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-05-08T18:50:47.553 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-05-08T18:50:47.554 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-05-08T18:50:47.637 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:47.637 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:47.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.639+0000 7f95f1211800 1 Processor -- start 2024-05-08T18:50:47.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.639+0000 7f95f1211800 1 -- start start 2024-05-08T18:50:47.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.639+0000 7f95f1211800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x564b893f8530 0x564b893f8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.639+0000 7f95f1211800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564b893f8f80 con 0x564b893fb520 2024-05-08T18:50:47.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.639+0000 7f95f1211800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x564b8929ae20 con 0x564b893f8530 2024-05-08T18:50:47.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.639+0000 7f95ec867640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x564b893f8530 0x564b893f8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.639+0000 7f95ec867640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x564b893f8530 0x564b893f8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60850/0 (socket says 172.21.15.132:60850) 2024-05-08T18:50:47.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.639+0000 7f95ec867640 1 -- 172.21.15.132:0/3050726909 learned_addr learned my addr 172.21.15.132:0/3050726909 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.639+0000 7f95e7fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x564b893fb520 0x564b893fb9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46900/0 (socket says 172.21.15.132:46900) 2024-05-08T18:50:47.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.640+0000 7f95ec867640 1 -- 172.21.15.132:0/3050726909 >> v1:172.21.15.42:6789/0 conn(0x564b893fb520 legacy=0x564b893fb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.640+0000 7f95ec867640 1 -- 172.21.15.132:0/3050726909 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b893fc0e0 con 0x564b893f8530 2024-05-08T18:50:47.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.641+0000 7f95ec867640 1 --2- 172.21.15.132:0/3050726909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b893f8530 0x564b893f8950 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f95e000a520 tx=0x7f95e001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ece209c424cc02 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.642+0000 7f95e77fe640 1 -- 172.21.15.132:0/3050726909 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e0057070 con 0x564b893f8530 2024-05-08T18:50:47.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.642+0000 7f95e77fe640 1 -- 172.21.15.132:0/3050726909 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e0052570 con 0x564b893f8530 2024-05-08T18:50:47.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.642+0000 7f95e77fe640 1 -- 172.21.15.132:0/3050726909 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e0052870 con 0x564b893f8530 2024-05-08T18:50:47.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.642+0000 7f95f1211800 1 -- 172.21.15.132:0/3050726909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b893f8530 msgr2=0x564b893f8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.642+0000 7f95f1211800 1 --2- 172.21.15.132:0/3050726909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b893f8530 0x564b893f8950 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f95e000a520 tx=0x7f95e001d010 comp rx=0 tx=0).stop 2024-05-08T18:50:47.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.642+0000 7f95f1211800 1 -- 172.21.15.132:0/3050726909 shutdown_connections 2024-05-08T18:50:47.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.642+0000 7f95f1211800 1 --2- 172.21.15.132:0/3050726909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b893f8530 0x564b893f8950 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.642+0000 7f95f1211800 1 -- 172.21.15.132:0/3050726909 >> 172.21.15.132:0/3050726909 conn(0x564b893f3ea0 msgr2=0x564b893f62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.642+0000 7f95f1211800 1 -- 172.21.15.132:0/3050726909 shutdown_connections 2024-05-08T18:50:47.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.642+0000 7f95f1211800 1 -- 172.21.15.132:0/3050726909 wait complete. 2024-05-08T18:50:47.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.656+0000 7f95f1211800 1 Processor -- start 2024-05-08T18:50:47.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.656+0000 7f95f1211800 1 -- start start 2024-05-08T18:50:47.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.656+0000 7f95f1211800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b893f8530 0x564b894eb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.656+0000 7f95f1211800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564b893455b0 con 0x564b893f8530 2024-05-08T18:50:47.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.656+0000 7f95ec867640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b893f8530 0x564b894eb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.656+0000 7f95ec867640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b893f8530 0x564b894eb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60852/0 (socket says 172.21.15.132:60852) 2024-05-08T18:50:47.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.656+0000 7f95ec867640 1 -- 172.21.15.132:0/4087609062 learned_addr learned my addr 172.21.15.132:0/4087609062 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.656+0000 7f95ec867640 1 -- 172.21.15.132:0/4087609062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b894ebc90 con 0x564b893f8530 2024-05-08T18:50:47.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.657+0000 7f95ec867640 1 --2- 172.21.15.132:0/4087609062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b893f8530 0x564b894eb6c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f95e001d050 tx=0x7f95e004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8291317f8a4eded4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.657+0000 7f94dae05640 1 -- 172.21.15.132:0/4087609062 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e0057040 con 0x564b893f8530 2024-05-08T18:50:47.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.657+0000 7f94dae05640 1 -- 172.21.15.132:0/4087609062 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e0052850 con 0x564b893f8530 2024-05-08T18:50:47.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.657+0000 7f94dae05640 1 -- 172.21.15.132:0/4087609062 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e0052b70 con 0x564b893f8530 2024-05-08T18:50:47.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.657+0000 7f95f1211800 1 -- 172.21.15.132:0/4087609062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b893f8530 msgr2=0x564b894eb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.657+0000 7f95f1211800 1 --2- 172.21.15.132:0/4087609062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b893f8530 0x564b894eb6c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f95e001d050 tx=0x7f95e004c000 comp rx=0 tx=0).stop 2024-05-08T18:50:47.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.657+0000 7f95f1211800 1 -- 172.21.15.132:0/4087609062 shutdown_connections 2024-05-08T18:50:47.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.657+0000 7f95f1211800 1 --2- 172.21.15.132:0/4087609062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b893f8530 0x564b894eb6c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.657+0000 7f95f1211800 1 -- 172.21.15.132:0/4087609062 >> 172.21.15.132:0/4087609062 conn(0x564b893f3ea0 msgr2=0x564b894e6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.657+0000 7f95f1211800 1 -- 172.21.15.132:0/4087609062 shutdown_connections 2024-05-08T18:50:47.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.658+0000 7f95f1211800 1 -- 172.21.15.132:0/4087609062 wait complete. 2024-05-08T18:50:47.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.658+0000 7f95f1211800 1 Processor -- start 2024-05-08T18:50:47.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.658+0000 7f95f1211800 1 -- start start 2024-05-08T18:50:47.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.658+0000 7f95f1211800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b893f8530 0x564b894f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.658+0000 7f95f1211800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564b894039f0 con 0x564b893f8530 2024-05-08T18:50:47.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.658+0000 7f95ec867640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b893f8530 0x564b894f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.658+0000 7f95ec867640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b893f8530 0x564b894f3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60856/0 (socket says 172.21.15.132:60856) 2024-05-08T18:50:47.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.658+0000 7f95ec867640 1 -- 172.21.15.132:0/3117328904 learned_addr learned my addr 172.21.15.132:0/3117328904 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.658+0000 7f95ec867640 1 -- 172.21.15.132:0/3117328904 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b894f35d0 con 0x564b893f8530 2024-05-08T18:50:47.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.659+0000 7f95ec867640 1 --2- 172.21.15.132:0/3117328904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b893f8530 0x564b894f3090 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f95e001d050 tx=0x7f95e0003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.659+0000 7f94d9602640 1 -- 172.21.15.132:0/3117328904 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e0073070 con 0x564b893f8530 2024-05-08T18:50:47.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.659+0000 7f94d9602640 1 -- 172.21.15.132:0/3117328904 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e005d650 con 0x564b893f8530 2024-05-08T18:50:47.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.659+0000 7f95f1211800 1 -- 172.21.15.132:0/3117328904 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b894f3860 con 0x564b893f8530 2024-05-08T18:50:47.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.659+0000 7f94d9602640 1 -- 172.21.15.132:0/3117328904 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e0057070 con 0x564b893f8530 2024-05-08T18:50:47.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.659+0000 7f95f1211800 1 -- 172.21.15.132:0/3117328904 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b894f6510 con 0x564b893f8530 2024-05-08T18:50:47.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.660+0000 7f94d9602640 1 -- 172.21.15.132:0/3117328904 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f95e0076070 con 0x564b893f8530 2024-05-08T18:50:47.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.660+0000 7f94d9602640 1 --2- 172.21.15.132:0/3117328904 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f94d403bb50 0x7f94d403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.660+0000 7f94d9602640 1 -- 172.21.15.132:0/3117328904 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f95e0094130 con 0x564b893f8530 2024-05-08T18:50:47.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.660+0000 7f95e7fff640 1 --2- 172.21.15.132:0/3117328904 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f94d403bb50 0x7f94d403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.660+0000 7f95f1211800 1 --2- 172.21.15.132:0/3117328904 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564b893fb520 0x564b894fa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.660+0000 7f95f1211800 1 -- 172.21.15.132:0/3117328904 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b894fa8b0 con 0x564b893fb520 2024-05-08T18:50:47.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.660+0000 7f95ed068640 1 --2- 172.21.15.132:0/3117328904 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564b893fb520 0x564b894fa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.660+0000 7f95e7fff640 1 --2- 172.21.15.132:0/3117328904 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f94d403bb50 0x7f94d403e010 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f95d8000f60 tx=0x7f95d8001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.661+0000 7f95ed068640 1 --2- 172.21.15.132:0/3117328904 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564b893fb520 0x564b894fa2d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.661+0000 7f95ed068640 1 -- 172.21.15.132:0/3117328904 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95e800a4a0 con 0x564b893fb520 2024-05-08T18:50:47.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.661+0000 7f95f1211800 1 -- 172.21.15.132:0/3117328904 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b894f78a0 con 0x564b893fb520 2024-05-08T18:50:47.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.661+0000 7f95ed068640 1 -- 172.21.15.132:0/3117328904 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f95e800a4a0 con 0x564b893fb520 2024-05-08T18:50:47.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.661+0000 7f95f1211800 1 --2- 172.21.15.132:0/3117328904 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564b894fcc00 0x564b894feff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.661+0000 7f95f1211800 1 -- 172.21.15.132:0/3117328904 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b894ff6e0 con 0x564b894fcc00 2024-05-08T18:50:47.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.661+0000 7f95ec867640 1 --2- 172.21.15.132:0/3117328904 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564b894fcc00 0x564b894feff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.661+0000 7f95ec867640 1 --2- 172.21.15.132:0/3117328904 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564b894fcc00 0x564b894feff0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.662+0000 7f95ec867640 1 -- 172.21.15.132:0/3117328904 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f95e0075030 con 0x564b894fcc00 2024-05-08T18:50:47.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.662+0000 7f95f1211800 1 -- 172.21.15.132:0/3117328904 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b894fbaa0 con 0x564b893fb520 2024-05-08T18:50:47.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.662+0000 7f95ed068640 1 -- 172.21.15.132:0/3117328904 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f95e800a4a0 con 0x564b893fb520 2024-05-08T18:50:47.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.662+0000 7f95f1211800 1 -- 172.21.15.132:0/3117328904 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b894fbf80 con 0x564b893fb520 2024-05-08T18:50:47.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.662+0000 7f95ed068640 1 -- 172.21.15.132:0/3117328904 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f95e800a4a0 con 0x564b893fb520 2024-05-08T18:50:47.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.663+0000 7f95f1211800 1 Processor -- start 2024-05-08T18:50:47.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.663+0000 7f95f1211800 1 -- start start 2024-05-08T18:50:47.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.663+0000 7f95f1211800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b8950e620 0x564b8950ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.663+0000 7f95f1211800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564b892ebfc0 con 0x564b8950e620 2024-05-08T18:50:47.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.663+0000 7f95ed068640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b8950e620 0x564b8950ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.663+0000 7f95ed068640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b8950e620 0x564b8950ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60872/0 (socket says 172.21.15.132:60872) 2024-05-08T18:50:47.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.663+0000 7f95ed068640 1 -- 172.21.15.132:0/3924625032 learned_addr learned my addr 172.21.15.132:0/3924625032 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.663+0000 7f95ed068640 1 -- 172.21.15.132:0/3924625032 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8950ef80 con 0x564b8950e620 2024-05-08T18:50:47.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.664+0000 7f95ed068640 1 --2- 172.21.15.132:0/3924625032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b8950e620 0x564b8950ea40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x564b894facb0 tx=0x7f95e8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.664+0000 7f94d27fc640 1 -- 172.21.15.132:0/3924625032 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e8014450 con 0x564b8950e620 2024-05-08T18:50:47.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.664+0000 7f94d27fc640 1 -- 172.21.15.132:0/3924625032 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e8014610 con 0x564b8950e620 2024-05-08T18:50:47.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.664+0000 7f95f1211800 1 -- 172.21.15.132:0/3924625032 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b8950f9f0 con 0x564b8950e620 2024-05-08T18:50:47.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.664+0000 7f94d27fc640 1 -- 172.21.15.132:0/3924625032 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e8014930 con 0x564b8950e620 2024-05-08T18:50:47.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.664+0000 7f95f1211800 1 -- 172.21.15.132:0/3924625032 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b8950fef0 con 0x564b8950e620 2024-05-08T18:50:47.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.665+0000 7f94d27fc640 1 -- 172.21.15.132:0/3924625032 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f95e8011040 con 0x564b8950e620 2024-05-08T18:50:47.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.665+0000 7f94d27fc640 1 --2- 172.21.15.132:0/3924625032 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f94c403bba0 0x7f94c403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.665+0000 7f94d27fc640 1 -- 172.21.15.132:0/3924625032 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f95e801e070 con 0x564b8950e620 2024-05-08T18:50:47.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.665+0000 7f95ec867640 1 --2- 172.21.15.132:0/3924625032 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f94c403bba0 0x7f94c403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.665+0000 7f95f1211800 1 Processor -- start 2024-05-08T18:50:47.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.665+0000 7f95ec867640 1 --2- 172.21.15.132:0/3924625032 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f94c403bba0 0x7f94c403e060 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x564b894fad50 tx=0x7f95e0006fa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.665+0000 7f95f1211800 1 -- start start 2024-05-08T18:50:47.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.665+0000 7f95f1211800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b8951b8f0 0x564b8951bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.665+0000 7f95f1211800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564b894ebf50 con 0x564b8951b8f0 2024-05-08T18:50:47.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.666+0000 7f95ed068640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b8951b8f0 0x564b8951bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.666+0000 7f95ed068640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b8951b8f0 0x564b8951bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60876/0 (socket says 172.21.15.132:60876) 2024-05-08T18:50:47.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.666+0000 7f95ed068640 1 -- 172.21.15.132:0/3670838624 learned_addr learned my addr 172.21.15.132:0/3670838624 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.666+0000 7f95ed068640 1 -- 172.21.15.132:0/3670838624 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b8951c2e0 con 0x564b8951b8f0 2024-05-08T18:50:47.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.666+0000 7f95ed068640 1 --2- 172.21.15.132:0/3670838624 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b8951b8f0 0x564b8951bd10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f95e8052c50 tx=0x7f95e80118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c1b3d21303bfe1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.666+0000 7f94c3fff640 1 -- 172.21.15.132:0/3670838624 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e8044020 con 0x564b8951b8f0 2024-05-08T18:50:47.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.666+0000 7f94c3fff640 1 -- 172.21.15.132:0/3670838624 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e8047070 con 0x564b8951b8f0 2024-05-08T18:50:47.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.666+0000 7f94c3fff640 1 -- 172.21.15.132:0/3670838624 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e80167c0 con 0x564b8951b8f0 2024-05-08T18:50:47.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.667+0000 7f95f1211800 1 -- 172.21.15.132:0/3670838624 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b8951b8f0 msgr2=0x564b8951bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.667+0000 7f95f1211800 1 --2- 172.21.15.132:0/3670838624 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b8951b8f0 0x564b8951bd10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f95e8052c50 tx=0x7f95e80118e0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.667+0000 7f95f1211800 1 -- 172.21.15.132:0/3670838624 shutdown_connections 2024-05-08T18:50:47.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.667+0000 7f95f1211800 1 --2- 172.21.15.132:0/3670838624 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b8951b8f0 0x564b8951bd10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.667+0000 7f95f1211800 1 -- 172.21.15.132:0/3670838624 >> 172.21.15.132:0/3670838624 conn(0x564b89517bb0 msgr2=0x564b89515c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.680 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.667+0000 7f95f1211800 1 -- 172.21.15.132:0/3670838624 shutdown_connections 2024-05-08T18:50:47.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.667+0000 7f95f1211800 1 -- 172.21.15.132:0/3670838624 wait complete. 2024-05-08T18:50:47.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.667+0000 7f95f1211800 1 Processor -- start 2024-05-08T18:50:47.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.667+0000 7f95f1211800 1 -- start start 2024-05-08T18:50:47.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.667+0000 7f95f1211800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b8951b8f0 0x564b89522ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.667+0000 7f95f1211800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564b8951ca60 con 0x564b8951b8f0 2024-05-08T18:50:47.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.668+0000 7f95ed068640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b8951b8f0 0x564b89522ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.668+0000 7f95ed068640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b8951b8f0 0x564b89522ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60890/0 (socket says 172.21.15.132:60890) 2024-05-08T18:50:47.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.668+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 learned_addr learned my addr 172.21.15.132:0/1475014060 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.668+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b89523410 con 0x564b8951b8f0 2024-05-08T18:50:47.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.668+0000 7f95ed068640 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b8951b8f0 0x564b89522ed0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f95e8011fb0 tx=0x7f95e8052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.668+0000 7f94c27fc640 1 -- 172.21.15.132:0/1475014060 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e802b560 con 0x564b8951b8f0 2024-05-08T18:50:47.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.668+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b895236a0 con 0x564b8951b8f0 2024-05-08T18:50:47.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.668+0000 7f94c27fc640 1 -- 172.21.15.132:0/1475014060 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e802b700 con 0x564b8951b8f0 2024-05-08T18:50:47.681 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.668+0000 7f94c27fc640 1 -- 172.21.15.132:0/1475014060 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95e802ba20 con 0x564b8951b8f0 2024-05-08T18:50:47.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.669+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b89526350 con 0x564b8951b8f0 2024-05-08T18:50:47.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.669+0000 7f94c27fc640 1 -- 172.21.15.132:0/1475014060 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f95e80547d0 con 0x564b8951b8f0 2024-05-08T18:50:47.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.669+0000 7f94c27fc640 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f94b803bb50 0x7f94b803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.669+0000 7f94c27fc640 1 -- 172.21.15.132:0/1475014060 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f95e800e040 con 0x564b8951b8f0 2024-05-08T18:50:47.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.670+0000 7f95ec867640 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f94b803bb50 0x7f94b803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.670+0000 7f95f1211800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.670+0000 7f95f1211800 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564b8952eaa0 0x564b89530f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.670+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b895316b0 con 0x564b8952eaa0 2024-05-08T18:50:47.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.670+0000 7f95e7fff640 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564b8952eaa0 0x564b89530f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.670+0000 7f95ec867640 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f94b803bb50 0x7f94b803e010 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f95e0092970 tx=0x7f95e0085000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.670+0000 7f95e7fff640 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564b8952eaa0 0x564b89530f60 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.670+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95d800f610 con 0x564b8952eaa0 2024-05-08T18:50:47.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.670+0000 7f95f1211800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.670+0000 7f95f1211800 20 realm 2024-05-08T18:50:47.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.670+0000 7f95f1211800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.670+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b8952def0 con 0x564b8952eaa0 2024-05-08T18:50:47.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.671+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95d800f610 con 0x564b8952eaa0 2024-05-08T18:50:47.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.671+0000 7f95f1211800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.671+0000 7f95f1211800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:47.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.671+0000 7f95f1211800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.671+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b89532190 con 0x564b8952eaa0 2024-05-08T18:50:47.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.671+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95d800f610 con 0x564b8952eaa0 2024-05-08T18:50:47.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.671+0000 7f95f1211800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.671+0000 7f95f1211800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.671+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b89532a60 con 0x564b8952eaa0 2024-05-08T18:50:47.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.671+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f95d800f610 con 0x564b8952eaa0 2024-05-08T18:50:47.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.671+0000 7f95f1211800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:47.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.671+0000 7f95f1211800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.671+0000 7f95f1211800 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564b89533360 0x564b89535750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.671+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b89535eb0 con 0x564b89533360 2024-05-08T18:50:47.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.671+0000 7f95ed068640 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564b89533360 0x564b89535750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.671+0000 7f95ed068640 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564b89533360 0x564b89535750 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.672+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f95e803f070 con 0x564b89533360 2024-05-08T18:50:47.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.672+0000 7f95f1211800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:47.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.672+0000 7f95f1211800 20 searching for the correct realm 2024-05-08T18:50:47.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.672+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x564b89533360 2024-05-08T18:50:47.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.672+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e803f070 con 0x564b89533360 2024-05-08T18:50:47.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.672+0000 7f95ed068640 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f95e8014070 0x7f95e802f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.672+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x7f95e8014070 2024-05-08T18:50:47.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.672+0000 7f95ec867640 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f95e8014070 0x7f95e802f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.673+0000 7f95ec867640 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f95e8014070 0x7f95e802f9b0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.673+0000 7f95ec867640 1 -- 172.21.15.132:0/1475014060 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e0075030 con 0x7f95e8014070 2024-05-08T18:50:47.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.673+0000 7f95ec867640 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f95e00a1040 0x7f95e005b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.673+0000 7f95ec867640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x7f95e00a1040 2024-05-08T18:50:47.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.673+0000 7f95e7fff640 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f95e00a1040 0x7f95e005b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.674+0000 7f95e7fff640 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f95e00a1040 0x7f95e005b550 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.674+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d800f610 con 0x7f95e00a1040 2024-05-08T18:50:47.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.674+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x564b8952eaa0 2024-05-08T18:50:47.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.674+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d800f610 con 0x564b8952eaa0 2024-05-08T18:50:47.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.674+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x564b8952eaa0 2024-05-08T18:50:47.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.674+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d802b040 con 0x564b8952eaa0 2024-05-08T18:50:47.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.674+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x7f95e00a1040 2024-05-08T18:50:47.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.675+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d802b040 con 0x7f95e00a1040 2024-05-08T18:50:47.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.675+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x7f95e00a1040 2024-05-08T18:50:47.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.675+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d802b040 con 0x7f95e00a1040 2024-05-08T18:50:47.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.675+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x7f95e8014070 2024-05-08T18:50:47.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.675+0000 7f95ec867640 1 -- 172.21.15.132:0/1475014060 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e0075030 con 0x7f95e8014070 2024-05-08T18:50:47.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.675+0000 7f95ec867640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x564b89533360 2024-05-08T18:50:47.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.675+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e803f070 con 0x564b89533360 2024-05-08T18:50:47.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.675+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x564b8952eaa0 2024-05-08T18:50:47.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.676+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d802b040 con 0x564b8952eaa0 2024-05-08T18:50:47.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.676+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x7f95e00a1040 2024-05-08T18:50:47.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.676+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d802b040 con 0x7f95e00a1040 2024-05-08T18:50:47.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.676+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x564b8952eaa0 2024-05-08T18:50:47.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.676+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f95d802b040 con 0x564b8952eaa0 2024-05-08T18:50:47.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.676+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x7f95e8014070 2024-05-08T18:50:47.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.676+0000 7f95ec867640 1 -- 172.21.15.132:0/1475014060 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f95e0075030 con 0x7f95e8014070 2024-05-08T18:50:47.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.676+0000 7f95ec867640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x564b89533360 2024-05-08T18:50:47.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.677+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f95e803f070 con 0x564b89533360 2024-05-08T18:50:47.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.677+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x564b89533360 2024-05-08T18:50:47.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.677+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e803f070 con 0x564b89533360 2024-05-08T18:50:47.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.677+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x7f95e00a1040 2024-05-08T18:50:47.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.677+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d802b040 con 0x7f95e00a1040 2024-05-08T18:50:47.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.677+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x564b89533360 2024-05-08T18:50:47.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.677+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e803f070 con 0x564b89533360 2024-05-08T18:50:47.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.677+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x564b89533360 2024-05-08T18:50:47.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.677+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e803f070 con 0x564b89533360 2024-05-08T18:50:47.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.677+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x564b8952eaa0 2024-05-08T18:50:47.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.678+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d802b040 con 0x564b8952eaa0 2024-05-08T18:50:47.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.678+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x564b8952eaa0 2024-05-08T18:50:47.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.678+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f95d802b040 con 0x564b8952eaa0 2024-05-08T18:50:47.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.678+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x7f95e00a1040 2024-05-08T18:50:47.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.678+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d802b040 con 0x7f95e00a1040 2024-05-08T18:50:47.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.678+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x564b89533360 2024-05-08T18:50:47.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.679+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e806c040 con 0x564b89533360 2024-05-08T18:50:47.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.679+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x7f95e8014070 2024-05-08T18:50:47.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.679+0000 7f95ec867640 1 -- 172.21.15.132:0/1475014060 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e0075030 con 0x7f95e8014070 2024-05-08T18:50:47.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.679+0000 7f95ec867640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x564b8952eaa0 2024-05-08T18:50:47.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.679+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d802b040 con 0x564b8952eaa0 2024-05-08T18:50:47.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.679+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x7f95e00a1040 2024-05-08T18:50:47.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.679+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d803b040 con 0x7f95e00a1040 2024-05-08T18:50:47.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.679+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x564b89533360 2024-05-08T18:50:47.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.680+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e806c040 con 0x564b89533360 2024-05-08T18:50:47.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.680+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x7f95e00a1040 2024-05-08T18:50:47.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.680+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d803b040 con 0x7f95e00a1040 2024-05-08T18:50:47.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.680+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x7f95e8014070 2024-05-08T18:50:47.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.680+0000 7f95ec867640 1 -- 172.21.15.132:0/1475014060 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e0075030 con 0x7f95e8014070 2024-05-08T18:50:47.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.680+0000 7f95ec867640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x564b89533360 2024-05-08T18:50:47.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.680+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e806c040 con 0x564b89533360 2024-05-08T18:50:47.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.680+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x7f95e00a1040 2024-05-08T18:50:47.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.681+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95d803b040 con 0x7f95e00a1040 2024-05-08T18:50:47.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.681+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x564b8952eaa0 2024-05-08T18:50:47.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.681+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f95d803b040 con 0x564b8952eaa0 2024-05-08T18:50:47.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.681+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564b89537890 con 0x7f95e8014070 2024-05-08T18:50:47.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.681+0000 7f95ec867640 1 -- 172.21.15.132:0/1475014060 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f95e0075030 con 0x7f95e8014070 2024-05-08T18:50:47.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:47.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:47.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:47.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:47.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:47.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:47.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b89536990 con 0x564b8952eaa0 2024-05-08T18:50:47.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f95d803b040 con 0x564b8952eaa0 2024-05-08T18:50:47.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b89537230 con 0x564b8952eaa0 2024-05-08T18:50:47.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f95d803b040 con 0x564b8952eaa0 2024-05-08T18:50:47.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:47.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b895365d0 con 0x564b8952eaa0 2024-05-08T18:50:47.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f95d803b040 con 0x564b8952eaa0 2024-05-08T18:50:47.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:47.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 20 zone default found 2024-05-08T18:50:47.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 4 Realm: () 2024-05-08T18:50:47.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:47.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:47.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:47.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 20 zonegroup default 2024-05-08T18:50:47.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.682+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b89537d60 con 0x7f95e00a1040 2024-05-08T18:50:47.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.683+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f95d803b040 con 0x7f95e00a1040 2024-05-08T18:50:47.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.683+0000 7f95f1211800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.683+0000 7f95f1211800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.683+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b89539bf0 con 0x564b89533360 2024-05-08T18:50:47.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.683+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f95e806c040 con 0x564b89533360 2024-05-08T18:50:47.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.683+0000 7f95f1211800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.683+0000 7f95f1211800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.683+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b89539f90 con 0x564b89533360 2024-05-08T18:50:47.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.683+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f95e806c040 con 0x564b89533360 2024-05-08T18:50:47.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.683+0000 7f95f1211800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.683+0000 7f95f1211800 20 started sync module instance, tier type = 2024-05-08T18:50:47.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.683+0000 7f95f1211800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:47.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.683+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b89539030 con 0x7f95e8014070 2024-05-08T18:50:47.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.684+0000 7f95ec867640 1 -- 172.21.15.132:0/1475014060 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e0075030 con 0x7f95e8014070 2024-05-08T18:50:47.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.684+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94882426491936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b89539840 con 0x7f95e8014070 2024-05-08T18:50:47.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.684+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b8953ac90 con 0x564b8952eaa0 2024-05-08T18:50:47.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.685+0000 7f95ec867640 1 -- 172.21.15.132:0/1475014060 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94882426491936] v25'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e0075030 con 0x7f95e8014070 2024-05-08T18:50:47.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.686+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d803b040 con 0x564b8952eaa0 2024-05-08T18:50:47.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.686+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94882426496272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b8953b080 con 0x564b8952eaa0 2024-05-08T18:50:47.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.686+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b8953baa0 con 0x564b89533360 2024-05-08T18:50:47.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.687+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e806c040 con 0x564b89533360 2024-05-08T18:50:47.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.687+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94882426500496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b8953ba60 con 0x564b89533360 2024-05-08T18:50:47.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.687+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b8953ca70 con 0x7f95e8014070 2024-05-08T18:50:47.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.687+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94882426496272] v25'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d803b040 con 0x564b8952eaa0 2024-05-08T18:50:47.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.688+0000 7f95ec867640 1 -- 172.21.15.132:0/1475014060 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e0075030 con 0x7f95e8014070 2024-05-08T18:50:47.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.688+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94882426500496] v25'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e806c040 con 0x564b89533360 2024-05-08T18:50:47.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.688+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94882426504496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b8953ce60 con 0x7f95e8014070 2024-05-08T18:50:47.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.688+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b8953be90 con 0x564b8952eaa0 2024-05-08T18:50:47.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.689+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d803b040 con 0x564b8952eaa0 2024-05-08T18:50:47.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.689+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94882426508144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b8953dc40 con 0x564b8952eaa0 2024-05-08T18:50:47.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.689+0000 7f95ec867640 1 -- 172.21.15.132:0/1475014060 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94882426504496] v25'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e0075030 con 0x7f95e8014070 2024-05-08T18:50:47.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.689+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b8953e180 con 0x7f95e00a1040 2024-05-08T18:50:47.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.690+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d803b040 con 0x7f95e00a1040 2024-05-08T18:50:47.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.690+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94882426497392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b8953e180 con 0x7f95e00a1040 2024-05-08T18:50:47.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.690+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b8953f0a0 con 0x7f95e00a1040 2024-05-08T18:50:47.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.690+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94882426508144] v25'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d803b040 con 0x564b8952eaa0 2024-05-08T18:50:47.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.691+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(56 notify.6 [create] v25'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d803b040 con 0x7f95e00a1040 2024-05-08T18:50:47.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.691+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94882426497392] v25'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d803b040 con 0x7f95e00a1040 2024-05-08T18:50:47.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.691+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94882426514320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b8953d790 con 0x7f95e00a1040 2024-05-08T18:50:47.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.691+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b8953f680 con 0x7f95e00a1040 2024-05-08T18:50:47.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.692+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94882426514320] v25'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d803b040 con 0x7f95e00a1040 2024-05-08T18:50:47.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.692+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d803b040 con 0x7f95e00a1040 2024-05-08T18:50:47.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.692+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94882426512752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b8953f680 con 0x7f95e00a1040 2024-05-08T18:50:47.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.692+0000 7f95f1211800 20 add_watcher() i=0 2024-05-08T18:50:47.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.692+0000 7f95f1211800 20 add_watcher() i=1 2024-05-08T18:50:47.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.692+0000 7f95f1211800 20 add_watcher() i=2 2024-05-08T18:50:47.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.692+0000 7f95f1211800 20 add_watcher() i=3 2024-05-08T18:50:47.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.692+0000 7f95f1211800 20 add_watcher() i=4 2024-05-08T18:50:47.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.692+0000 7f95f1211800 20 add_watcher() i=5 2024-05-08T18:50:47.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.692+0000 7f95f1211800 20 add_watcher() i=6 2024-05-08T18:50:47.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.693+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94882426512752] v25'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d803b040 con 0x7f95e00a1040 2024-05-08T18:50:47.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.693+0000 7f95f1211800 20 add_watcher() i=7 2024-05-08T18:50:47.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.693+0000 7f95f1211800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:47.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.693+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b895428f0 con 0x564b8952eaa0 2024-05-08T18:50:47.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.693+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f95d803b040 con 0x564b8952eaa0 2024-05-08T18:50:47.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.693+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94882426516288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b8953fc10 con 0x564b8952eaa0 2024-05-08T18:50:47.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.694+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94882426516288] v25'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f95d803b040 con 0x564b8952eaa0 2024-05-08T18:50:47.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.694+0000 7f94a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:47.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.694+0000 7f95f1211800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:47.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.694+0000 7f95f1211800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:47.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.695+0000 7f95f1211800 5 note: GC not initialized 2024-05-08T18:50:47.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.695+0000 7f94a1fe3640 20 reqs_thread_entry: start 2024-05-08T18:50:47.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.695+0000 7f95f1211800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:47.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.695+0000 7f95f1211800 20 Filter name: none 2024-05-08T18:50:47.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.695+0000 7f94137fe640 20 reqs_thread_entry: start 2024-05-08T18:50:47.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.695+0000 7f95f1211800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.695+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b89575970 con 0x564b8952eaa0 2024-05-08T18:50:47.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.695+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f95d803b040 con 0x564b8952eaa0 2024-05-08T18:50:47.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.695+0000 7f95f1211800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:47.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.695+0000 7f95f1211800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.695+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b89576200 con 0x564b8952eaa0 2024-05-08T18:50:47.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.696+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f95d803b040 con 0x564b8952eaa0 2024-05-08T18:50:47.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.696+0000 7f95f1211800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:47.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.696+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564b89577210 con 0x7f95e8014070 2024-05-08T18:50:47.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.696+0000 7f95ec867640 1 -- 172.21.15.132:0/1475014060 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f95e0075030 con 0x7f95e8014070 2024-05-08T18:50:47.707 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.697+0000 7f94a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:47.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.697+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94882426516288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b8952c150 con 0x564b8952eaa0 2024-05-08T18:50:47.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.698+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94882426516288] v25'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f95d803b040 con 0x564b8952eaa0 2024-05-08T18:50:47.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.698+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94882426491936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b8952c150 con 0x7f95e8014070 2024-05-08T18:50:47.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.699+0000 7f95ec867640 1 -- 172.21.15.132:0/1475014060 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94882426491936] v25'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e0075030 con 0x7f95e8014070 2024-05-08T18:50:47.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.699+0000 7f95f1211800 20 remove_watcher() i=0 2024-05-08T18:50:47.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.699+0000 7f95f1211800 2 removed watcher, disabling cache 2024-05-08T18:50:47.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.699+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94882426496272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b89539420 con 0x564b8952eaa0 2024-05-08T18:50:47.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.700+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94882426496272] v25'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d803b040 con 0x564b8952eaa0 2024-05-08T18:50:47.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.700+0000 7f95f1211800 20 remove_watcher() i=1 2024-05-08T18:50:47.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.700+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94882426500496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b89539420 con 0x564b89533360 2024-05-08T18:50:47.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.701+0000 7f95ed068640 1 -- 172.21.15.132:0/1475014060 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94882426500496] v25'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e806c040 con 0x564b89533360 2024-05-08T18:50:47.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.701+0000 7f95f1211800 20 remove_watcher() i=2 2024-05-08T18:50:47.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.701+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94882426504496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b89539420 con 0x7f95e8014070 2024-05-08T18:50:47.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.702+0000 7f95ec867640 1 -- 172.21.15.132:0/1475014060 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94882426504496] v25'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95e0075030 con 0x7f95e8014070 2024-05-08T18:50:47.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.702+0000 7f95f1211800 20 remove_watcher() i=3 2024-05-08T18:50:47.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.702+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94882426508144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b89539420 con 0x564b8952eaa0 2024-05-08T18:50:47.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.703+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94882426508144] v25'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d803b040 con 0x564b8952eaa0 2024-05-08T18:50:47.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.703+0000 7f95f1211800 20 remove_watcher() i=4 2024-05-08T18:50:47.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.703+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94882426497392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b89539420 con 0x7f95e00a1040 2024-05-08T18:50:47.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.704+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94882426497392] v25'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d803b040 con 0x7f95e00a1040 2024-05-08T18:50:47.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.704+0000 7f95f1211800 20 remove_watcher() i=5 2024-05-08T18:50:47.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.704+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94882426514320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b89539420 con 0x7f95e00a1040 2024-05-08T18:50:47.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.705+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94882426514320] v25'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d803b040 con 0x7f95e00a1040 2024-05-08T18:50:47.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.705+0000 7f95f1211800 20 remove_watcher() i=6 2024-05-08T18:50:47.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.705+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94882426512752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564b89539420 con 0x7f95e00a1040 2024-05-08T18:50:47.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.706+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94882426512752] v25'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f95d803b040 con 0x7f95e00a1040 2024-05-08T18:50:47.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.706+0000 7f95f1211800 20 remove_watcher() i=7 2024-05-08T18:50:47.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.706+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f95e00a1040 msgr2=0x7f95e005b550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.706+0000 7f95f1211800 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f95e00a1040 0x7f95e005b550 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.706+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564b8952eaa0 msgr2=0x564b89530f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.706+0000 7f95f1211800 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564b8952eaa0 0x564b89530f60 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.706+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f95e8014070 msgr2=0x7f95e802f9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.706+0000 7f95f1211800 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f95e8014070 0x7f95e802f9b0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.706+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564b89533360 msgr2=0x564b89535750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.706+0000 7f95f1211800 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564b89533360 0x564b89535750 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.706+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f94b803bb50 msgr2=0x7f94b803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.706+0000 7f95f1211800 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f94b803bb50 0x7f94b803e010 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f95e0092970 tx=0x7f95e0085000 comp rx=0 tx=0).stop 2024-05-08T18:50:47.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.706+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b8951b8f0 msgr2=0x564b89522ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.706+0000 7f95e7fff640 1 -- 172.21.15.132:0/1475014060 reap_dead start 2024-05-08T18:50:47.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.706+0000 7f95f1211800 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b8951b8f0 0x564b89522ed0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f95e8011fb0 tx=0x7f95e8052be0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.706+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 shutdown_connections 2024-05-08T18:50:47.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.706+0000 7f95f1211800 1 --2- 172.21.15.132:0/1475014060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b8951b8f0 0x564b89522ed0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.706+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 >> 172.21.15.132:0/1475014060 conn(0x564b89517bb0 msgr2=0x564b89515260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.706+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 shutdown_connections 2024-05-08T18:50:47.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.706+0000 7f95f1211800 1 -- 172.21.15.132:0/1475014060 wait complete. 2024-05-08T18:50:47.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 -- 172.21.15.132:0/3924625032 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f94c403bba0 msgr2=0x7f94c403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 --2- 172.21.15.132:0/3924625032 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f94c403bba0 0x7f94c403e060 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x564b894fad50 tx=0x7f95e0006fa0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 -- 172.21.15.132:0/3924625032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b8950e620 msgr2=0x564b8950ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 --2- 172.21.15.132:0/3924625032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b8950e620 0x564b8950ea40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x564b894facb0 tx=0x7f95e8018830 comp rx=0 tx=0).stop 2024-05-08T18:50:47.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 -- 172.21.15.132:0/3924625032 shutdown_connections 2024-05-08T18:50:47.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 --2- 172.21.15.132:0/3924625032 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f94c403bba0 0x7f94c403e060 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 --2- 172.21.15.132:0/3924625032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b8950e620 0x564b8950ea40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 -- 172.21.15.132:0/3924625032 >> 172.21.15.132:0/3924625032 conn(0x564b895026c0 msgr2=0x564b89502ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 -- 172.21.15.132:0/3924625032 shutdown_connections 2024-05-08T18:50:47.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 -- 172.21.15.132:0/3924625032 wait complete. 2024-05-08T18:50:47.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 -- 172.21.15.132:0/3117328904 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564b893fb520 msgr2=0x564b894fa2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 --2- 172.21.15.132:0/3117328904 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564b893fb520 0x564b894fa2d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 -- 172.21.15.132:0/3117328904 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564b894fcc00 msgr2=0x564b894feff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 --2- 172.21.15.132:0/3117328904 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564b894fcc00 0x564b894feff0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 -- 172.21.15.132:0/3117328904 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f94d403bb50 msgr2=0x7f94d403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 --2- 172.21.15.132:0/3117328904 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f94d403bb50 0x7f94d403e010 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f95d8000f60 tx=0x7f95d8001370 comp rx=0 tx=0).stop 2024-05-08T18:50:47.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 -- 172.21.15.132:0/3117328904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b893f8530 msgr2=0x564b894f3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 --2- 172.21.15.132:0/3117328904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b893f8530 0x564b894f3090 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f95e001d050 tx=0x7f95e0003020 comp rx=0 tx=0).stop 2024-05-08T18:50:47.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 -- 172.21.15.132:0/3117328904 shutdown_connections 2024-05-08T18:50:47.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 --2- 172.21.15.132:0/3117328904 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564b894fcc00 0x564b894feff0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 --2- 172.21.15.132:0/3117328904 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564b893fb520 0x564b894fa2d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 --2- 172.21.15.132:0/3117328904 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f94d403bb50 0x7f94d403e010 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 --2- 172.21.15.132:0/3117328904 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564b893f8530 0x564b894f3090 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 -- 172.21.15.132:0/3117328904 >> 172.21.15.132:0/3117328904 conn(0x564b893f3ea0 msgr2=0x564b894e57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 -- 172.21.15.132:0/3117328904 shutdown_connections 2024-05-08T18:50:47.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.707+0000 7f95f1211800 1 -- 172.21.15.132:0/3117328904 wait complete. 2024-05-08T18:50:47.718 INFO:teuthology.orchestra.run.smithi132.stdout:[] 2024-05-08T18:50:47.718 DEBUG:tasks.util.rgw: json result: [] 2024-05-08T18:50:47.733 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:50:47.733 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-05-08T18:50:47.733 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-05-08T18:50:47.734 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-05-08T18:50:47.802 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:47.802 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:47.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.804+0000 7fa4bcf0c800 1 Processor -- start 2024-05-08T18:50:47.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.804+0000 7fa4bcf0c800 1 -- start start 2024-05-08T18:50:47.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.804+0000 7fa4bcf0c800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x563c6b4245d0 0x563c6b4269c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.804+0000 7fa4bcf0c800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563c6b426f90 con 0x563c6b420140 2024-05-08T18:50:47.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.804+0000 7fa4bcf0c800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x563c6b2c1e20 con 0x563c6b4245d0 2024-05-08T18:50:47.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.804+0000 7fa4b3fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x563c6b4245d0 0x563c6b4269c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.804+0000 7fa4baa04640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x563c6b420140 0x563c6b420560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46904/0 (socket says 172.21.15.132:46904) 2024-05-08T18:50:47.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.804+0000 7fa4baa04640 1 -- 172.21.15.132:0/1736324954 learned_addr learned my addr 172.21.15.132:0/1736324954 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:50:47.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.805+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1736324954 >> v1:172.21.15.42:6789/0 conn(0x563c6b420140 legacy=0x563c6b420560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.805+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1736324954 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c6b4281c0 con 0x563c6b4245d0 2024-05-08T18:50:47.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.807+0000 7fa4b3fff640 1 --2- 172.21.15.132:0/1736324954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b4245d0 0x563c6b4269c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa4a400a470 tx=0x7fa4a401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b4e1859fb3edd0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.807+0000 7fa4ba203640 1 -- 172.21.15.132:0/1736324954 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4a4057070 con 0x563c6b4245d0 2024-05-08T18:50:47.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.807+0000 7fa4ba203640 1 -- 172.21.15.132:0/1736324954 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a4052570 con 0x563c6b4245d0 2024-05-08T18:50:47.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.807+0000 7fa4ba203640 1 -- 172.21.15.132:0/1736324954 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4a4052870 con 0x563c6b4245d0 2024-05-08T18:50:47.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.807+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1736324954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b4245d0 msgr2=0x563c6b4269c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.807+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1736324954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b4245d0 0x563c6b4269c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa4a400a470 tx=0x7fa4a401ce90 comp rx=0 tx=0).stop 2024-05-08T18:50:47.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.807+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1736324954 shutdown_connections 2024-05-08T18:50:47.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.807+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1736324954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b4245d0 0x563c6b4269c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.807+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1736324954 >> 172.21.15.132:0/1736324954 conn(0x563c6b41b720 msgr2=0x563c6b41db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.807+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1736324954 shutdown_connections 2024-05-08T18:50:47.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.807+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1736324954 wait complete. 2024-05-08T18:50:47.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.820+0000 7fa4bcf0c800 1 Processor -- start 2024-05-08T18:50:47.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.821+0000 7fa4bcf0c800 1 -- start start 2024-05-08T18:50:47.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.821+0000 7fa4bcf0c800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b420140 0x563c6b3942c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.821+0000 7fa4bcf0c800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563c6b36c5b0 con 0x563c6b420140 2024-05-08T18:50:47.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.821+0000 7fa4baa04640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b420140 0x563c6b3942c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.821+0000 7fa4baa04640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b420140 0x563c6b3942c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60920/0 (socket says 172.21.15.132:60920) 2024-05-08T18:50:47.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.821+0000 7fa4baa04640 1 -- 172.21.15.132:0/1990410953 learned_addr learned my addr 172.21.15.132:0/1990410953 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.821+0000 7fa4baa04640 1 -- 172.21.15.132:0/1990410953 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c6b515310 con 0x563c6b420140 2024-05-08T18:50:47.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.821+0000 7fa4baa04640 1 --2- 172.21.15.132:0/1990410953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b420140 0x563c6b3942c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac001d80 tx=0x7fa4ac001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d6d88b96ecb119 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.822+0000 7fa3a8e09640 1 -- 172.21.15.132:0/1990410953 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4ac013030 con 0x563c6b420140 2024-05-08T18:50:47.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.822+0000 7fa3a8e09640 1 -- 172.21.15.132:0/1990410953 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4ac00e470 con 0x563c6b420140 2024-05-08T18:50:47.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.822+0000 7fa3a8e09640 1 -- 172.21.15.132:0/1990410953 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4ac00e810 con 0x563c6b420140 2024-05-08T18:50:47.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.822+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1990410953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b420140 msgr2=0x563c6b3942c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.822+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1990410953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b420140 0x563c6b3942c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac001d80 tx=0x7fa4ac001e70 comp rx=0 tx=0).stop 2024-05-08T18:50:47.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.822+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1990410953 shutdown_connections 2024-05-08T18:50:47.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.822+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1990410953 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b420140 0x563c6b3942c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.822+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1990410953 >> 172.21.15.132:0/1990410953 conn(0x563c6b41b720 msgr2=0x563c6b50ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.822+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1990410953 shutdown_connections 2024-05-08T18:50:47.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.822+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1990410953 wait complete. 2024-05-08T18:50:47.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.823+0000 7fa4bcf0c800 1 Processor -- start 2024-05-08T18:50:47.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.823+0000 7fa4bcf0c800 1 -- start start 2024-05-08T18:50:47.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.823+0000 7fa4bcf0c800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b420140 0x563c6b51a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.823+0000 7fa4bcf0c800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563c6b427460 con 0x563c6b420140 2024-05-08T18:50:47.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.823+0000 7fa4baa04640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b420140 0x563c6b51a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.823+0000 7fa4baa04640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b420140 0x563c6b51a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60928/0 (socket says 172.21.15.132:60928) 2024-05-08T18:50:47.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.823+0000 7fa4baa04640 1 -- 172.21.15.132:0/1458567723 learned_addr learned my addr 172.21.15.132:0/1458567723 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.823+0000 7fa4baa04640 1 -- 172.21.15.132:0/1458567723 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c6b51a6a0 con 0x563c6b420140 2024-05-08T18:50:47.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.824+0000 7fa4baa04640 1 --2- 172.21.15.132:0/1458567723 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b420140 0x563c6b51a160 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac004000 tx=0x7fa4ac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.824+0000 7fa3a7606640 1 -- 172.21.15.132:0/1458567723 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4ac027070 con 0x563c6b420140 2024-05-08T18:50:47.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.824+0000 7fa3a7606640 1 -- 172.21.15.132:0/1458567723 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4ac001400 con 0x563c6b420140 2024-05-08T18:50:47.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.824+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1458567723 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c6b51a930 con 0x563c6b420140 2024-05-08T18:50:47.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.824+0000 7fa3a7606640 1 -- 172.21.15.132:0/1458567723 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4ac019a70 con 0x563c6b420140 2024-05-08T18:50:47.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.824+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1458567723 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c6b51d5e0 con 0x563c6b420140 2024-05-08T18:50:47.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.825+0000 7fa3a7606640 1 -- 172.21.15.132:0/1458567723 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa4ac02a070 con 0x563c6b420140 2024-05-08T18:50:47.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.825+0000 7fa3a7606640 1 --2- 172.21.15.132:0/1458567723 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3a003bb50 0x7fa3a003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.825+0000 7fa3a7606640 1 -- 172.21.15.132:0/1458567723 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fa4ac01f070 con 0x563c6b420140 2024-05-08T18:50:47.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.825+0000 7fa4b3fff640 1 --2- 172.21.15.132:0/1458567723 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3a003bb50 0x7fa3a003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.825+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1458567723 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x563c6b4245d0 0x563c6b5213a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.825+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1458567723 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563c6b521920 con 0x563c6b4245d0 2024-05-08T18:50:47.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.825+0000 7fa4bb205640 1 --2- 172.21.15.132:0/1458567723 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x563c6b4245d0 0x563c6b5213a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.825+0000 7fa4b3fff640 1 --2- 172.21.15.132:0/1458567723 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3a003bb50 0x7fa3a003e010 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4054000 tx=0x7fa4a404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.826+0000 7fa4bb205640 1 --2- 172.21.15.132:0/1458567723 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x563c6b4245d0 0x563c6b5213a0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.826+0000 7fa4bb205640 1 -- 172.21.15.132:0/1458567723 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4b400a4a0 con 0x563c6b4245d0 2024-05-08T18:50:47.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.826+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1458567723 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563c6b51e970 con 0x563c6b4245d0 2024-05-08T18:50:47.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.826+0000 7fa4bb205640 1 -- 172.21.15.132:0/1458567723 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa4b400a4a0 con 0x563c6b4245d0 2024-05-08T18:50:47.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.826+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1458567723 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x563c6b523c50 0x563c6b526040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.826+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1458567723 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563c6b526730 con 0x563c6b523c50 2024-05-08T18:50:47.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.826+0000 7fa4baa04640 1 --2- 172.21.15.132:0/1458567723 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x563c6b523c50 0x563c6b526040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.826+0000 7fa4baa04640 1 --2- 172.21.15.132:0/1458567723 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x563c6b523c50 0x563c6b526040 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.827+0000 7fa4baa04640 1 -- 172.21.15.132:0/1458567723 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa4ac029030 con 0x563c6b523c50 2024-05-08T18:50:47.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.827+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1458567723 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563c6b522af0 con 0x563c6b4245d0 2024-05-08T18:50:47.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.827+0000 7fa4bb205640 1 -- 172.21.15.132:0/1458567723 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa4b400a4a0 con 0x563c6b4245d0 2024-05-08T18:50:47.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.827+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1458567723 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563c6b522fd0 con 0x563c6b4245d0 2024-05-08T18:50:47.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.827+0000 7fa4bb205640 1 -- 172.21.15.132:0/1458567723 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa4b400a4a0 con 0x563c6b4245d0 2024-05-08T18:50:47.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.828+0000 7fa4bcf0c800 1 Processor -- start 2024-05-08T18:50:47.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.828+0000 7fa4bcf0c800 1 -- start start 2024-05-08T18:50:47.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.828+0000 7fa4bcf0c800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b512ea0 0x563c6b511310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.828+0000 7fa4bcf0c800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563c6b312fc0 con 0x563c6b512ea0 2024-05-08T18:50:47.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.828+0000 7fa4bb205640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b512ea0 0x563c6b511310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.828+0000 7fa4bb205640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b512ea0 0x563c6b511310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60930/0 (socket says 172.21.15.132:60930) 2024-05-08T18:50:47.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.828+0000 7fa4bb205640 1 -- 172.21.15.132:0/1938161436 learned_addr learned my addr 172.21.15.132:0/1938161436 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.829+0000 7fa4bb205640 1 -- 172.21.15.132:0/1938161436 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c6b511850 con 0x563c6b512ea0 2024-05-08T18:50:47.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.829+0000 7fa4bb205640 1 --2- 172.21.15.132:0/1938161436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b512ea0 0x563c6b511310 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x563c6b521d00 tx=0x7fa4b4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.829+0000 7fa3a4e01640 1 -- 172.21.15.132:0/1938161436 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4b4014450 con 0x563c6b512ea0 2024-05-08T18:50:47.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.829+0000 7fa3a4e01640 1 -- 172.21.15.132:0/1938161436 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b4014610 con 0x563c6b512ea0 2024-05-08T18:50:47.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.829+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1938161436 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c6b511ae0 con 0x563c6b512ea0 2024-05-08T18:50:47.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.829+0000 7fa3a4e01640 1 -- 172.21.15.132:0/1938161436 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4b4014930 con 0x563c6b512ea0 2024-05-08T18:50:47.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.829+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1938161436 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c6b511fe0 con 0x563c6b512ea0 2024-05-08T18:50:47.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.830+0000 7fa3a4e01640 1 -- 172.21.15.132:0/1938161436 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa4b4011040 con 0x563c6b512ea0 2024-05-08T18:50:47.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.830+0000 7fa3a4e01640 1 --2- 172.21.15.132:0/1938161436 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa39403bb50 0x7fa39403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.830+0000 7fa3a4e01640 1 -- 172.21.15.132:0/1938161436 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fa4b401e070 con 0x563c6b512ea0 2024-05-08T18:50:47.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.830+0000 7fa4baa04640 1 --2- 172.21.15.132:0/1938161436 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa39403bb50 0x7fa39403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.830+0000 7fa4bcf0c800 1 Processor -- start 2024-05-08T18:50:47.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.830+0000 7fa4baa04640 1 --2- 172.21.15.132:0/1938161436 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa39403bb50 0x7fa39403e010 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x563c6b521da0 tx=0x7fa4ac00c780 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.830+0000 7fa4bcf0c800 1 -- start start 2024-05-08T18:50:47.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.831+0000 7fa4bcf0c800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b544b50 0x563c6b544f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.831+0000 7fa4bcf0c800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563c6b515660 con 0x563c6b544b50 2024-05-08T18:50:47.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.831+0000 7fa4bb205640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b544b50 0x563c6b544f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.831+0000 7fa4bb205640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b544b50 0x563c6b544f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60936/0 (socket says 172.21.15.132:60936) 2024-05-08T18:50:47.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.831+0000 7fa4bb205640 1 -- 172.21.15.132:0/1770059287 learned_addr learned my addr 172.21.15.132:0/1770059287 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.831+0000 7fa4bb205640 1 -- 172.21.15.132:0/1770059287 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c6b545540 con 0x563c6b544b50 2024-05-08T18:50:47.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.831+0000 7fa4bb205640 1 --2- 172.21.15.132:0/1770059287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b544b50 0x563c6b544f70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4052cd0 tx=0x7fa4b402b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5930f85dd741475 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.831+0000 7fa39e7fc640 1 -- 172.21.15.132:0/1770059287 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4b4028030 con 0x563c6b544b50 2024-05-08T18:50:47.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.831+0000 7fa39e7fc640 1 -- 172.21.15.132:0/1770059287 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b4016440 con 0x563c6b544b50 2024-05-08T18:50:47.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.831+0000 7fa39e7fc640 1 -- 172.21.15.132:0/1770059287 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4b4011a80 con 0x563c6b544b50 2024-05-08T18:50:47.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.832+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1770059287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b544b50 msgr2=0x563c6b544f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.832+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1770059287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b544b50 0x563c6b544f70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4052cd0 tx=0x7fa4b402b720 comp rx=0 tx=0).stop 2024-05-08T18:50:47.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.832+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1770059287 shutdown_connections 2024-05-08T18:50:47.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.832+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1770059287 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b544b50 0x563c6b544f70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.832+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1770059287 >> 172.21.15.132:0/1770059287 conn(0x563c6b540eb0 msgr2=0x563c6b53ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.832+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1770059287 shutdown_connections 2024-05-08T18:50:47.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.832+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1770059287 wait complete. 2024-05-08T18:50:47.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.832+0000 7fa4bcf0c800 1 Processor -- start 2024-05-08T18:50:47.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.832+0000 7fa4bcf0c800 1 -- start start 2024-05-08T18:50:47.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.832+0000 7fa4bcf0c800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b544b50 0x563c6b54c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.832+0000 7fa4bcf0c800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563c6b545cb0 con 0x563c6b544b50 2024-05-08T18:50:47.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.832+0000 7fa4bb205640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b544b50 0x563c6b54c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.832+0000 7fa4bb205640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b544b50 0x563c6b54c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60950/0 (socket says 172.21.15.132:60950) 2024-05-08T18:50:47.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.832+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 learned_addr learned my addr 172.21.15.132:0/1173142927 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.833+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c6b54c680 con 0x563c6b544b50 2024-05-08T18:50:47.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.833+0000 7fa4bb205640 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b544b50 0x563c6b54c140 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4016c90 tx=0x7fa4b4052c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.833+0000 7fa39cff9640 1 -- 172.21.15.132:0/1173142927 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4b40540d0 con 0x563c6b544b50 2024-05-08T18:50:47.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.833+0000 7fa39cff9640 1 -- 172.21.15.132:0/1173142927 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b4054270 con 0x563c6b544b50 2024-05-08T18:50:47.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.833+0000 7fa39cff9640 1 -- 172.21.15.132:0/1173142927 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4b402b7d0 con 0x563c6b544b50 2024-05-08T18:50:47.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.833+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563c6b54c910 con 0x563c6b544b50 2024-05-08T18:50:47.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.833+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c6b54f5c0 con 0x563c6b544b50 2024-05-08T18:50:47.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.834+0000 7fa39cff9640 1 -- 172.21.15.132:0/1173142927 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa4b4034020 con 0x563c6b544b50 2024-05-08T18:50:47.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.834+0000 7fa39cff9640 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa38403bba0 0x7fa38403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.834+0000 7fa4bcf0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.834+0000 7fa39cff9640 1 -- 172.21.15.132:0/1173142927 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fa4b4032020 con 0x563c6b544b50 2024-05-08T18:50:47.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.834+0000 7fa4baa04640 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa38403bba0 0x7fa38403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.834+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x563c6b557df0 0x563c6b55a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.834+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563c6b55a9d0 con 0x563c6b557df0 2024-05-08T18:50:47.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.835+0000 7fa4b3fff640 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x563c6b557df0 0x563c6b55a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.835+0000 7fa4baa04640 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa38403bba0 0x7fa38403e060 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac021000 tx=0x7fa4ac045000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.835+0000 7fa4b3fff640 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x563c6b557df0 0x563c6b55a280 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.835+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4a405a040 con 0x563c6b557df0 2024-05-08T18:50:47.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.835+0000 7fa4bcf0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.835+0000 7fa4bcf0c800 20 realm 2024-05-08T18:50:47.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.835+0000 7fa4bcf0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.835+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563c6b55ada0 con 0x563c6b557df0 2024-05-08T18:50:47.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.835+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4a405a040 con 0x563c6b557df0 2024-05-08T18:50:47.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.835+0000 7fa4bcf0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.835+0000 7fa4bcf0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:47.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.835+0000 7fa4bcf0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.835+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563c6b55b670 con 0x563c6b557df0 2024-05-08T18:50:47.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.836+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4a405a040 con 0x563c6b557df0 2024-05-08T18:50:47.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.836+0000 7fa4bcf0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.836+0000 7fa4bcf0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.836+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563c6b55ba10 con 0x563c6b557df0 2024-05-08T18:50:47.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.836+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa4a405a040 con 0x563c6b557df0 2024-05-08T18:50:47.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.836+0000 7fa4bcf0c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:47.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.836+0000 7fa4bcf0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.836+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x563c6b55c4c0 0x563c6b55e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.836+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563c6b55f010 con 0x563c6b55c4c0 2024-05-08T18:50:47.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.836+0000 7fa4bb205640 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x563c6b55c4c0 0x563c6b55e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.836+0000 7fa4bb205640 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x563c6b55c4c0 0x563c6b55e8b0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.837+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa4b402a070 con 0x563c6b55c4c0 2024-05-08T18:50:47.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.837+0000 7fa4bcf0c800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:47.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.837+0000 7fa4bcf0c800 20 searching for the correct realm 2024-05-08T18:50:47.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.837+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x563c6b55c4c0 2024-05-08T18:50:47.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.837+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4b402a070 con 0x563c6b55c4c0 2024-05-08T18:50:47.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.837+0000 7fa4bb205640 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa4b4014070 0x7fa4b40439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.837+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x7fa4b4014070 2024-05-08T18:50:47.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.837+0000 7fa4baa04640 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa4b4014070 0x7fa4b40439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.837+0000 7fa4baa04640 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa4b4014070 0x7fa4b40439b0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.838+0000 7fa4baa04640 1 -- 172.21.15.132:0/1173142927 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4ac03d030 con 0x7fa4b4014070 2024-05-08T18:50:47.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.838+0000 7fa4baa04640 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa4ac048040 0x7fa4ac02a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.838+0000 7fa4baa04640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x7fa4ac048040 2024-05-08T18:50:47.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.838+0000 7fa4b3fff640 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa4ac048040 0x7fa4ac02a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.838+0000 7fa4b3fff640 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa4ac048040 0x7fa4ac02a7e0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.839+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4a405a040 con 0x7fa4ac048040 2024-05-08T18:50:47.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.839+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x563c6b557df0 2024-05-08T18:50:47.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.839+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4a405a040 con 0x563c6b557df0 2024-05-08T18:50:47.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.839+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x563c6b557df0 2024-05-08T18:50:47.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.839+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4a405a040 con 0x563c6b557df0 2024-05-08T18:50:47.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.839+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x7fa4ac048040 2024-05-08T18:50:47.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.839+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4a405a040 con 0x7fa4ac048040 2024-05-08T18:50:47.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.839+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x7fa4ac048040 2024-05-08T18:50:47.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.840+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4a405a040 con 0x7fa4ac048040 2024-05-08T18:50:47.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.840+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x7fa4b4014070 2024-05-08T18:50:47.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.840+0000 7fa4baa04640 1 -- 172.21.15.132:0/1173142927 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4ac03d030 con 0x7fa4b4014070 2024-05-08T18:50:47.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.840+0000 7fa4baa04640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x563c6b55c4c0 2024-05-08T18:50:47.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.840+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4b402a070 con 0x563c6b55c4c0 2024-05-08T18:50:47.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.840+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x563c6b557df0 2024-05-08T18:50:47.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.840+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4a405a040 con 0x563c6b557df0 2024-05-08T18:50:47.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.840+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x7fa4ac048040 2024-05-08T18:50:47.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.841+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4a405a040 con 0x7fa4ac048040 2024-05-08T18:50:47.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.841+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x563c6b557df0 2024-05-08T18:50:47.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.841+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa4a405a040 con 0x563c6b557df0 2024-05-08T18:50:47.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.841+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x7fa4b4014070 2024-05-08T18:50:47.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.841+0000 7fa4baa04640 1 -- 172.21.15.132:0/1173142927 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa4ac03d030 con 0x7fa4b4014070 2024-05-08T18:50:47.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.841+0000 7fa4baa04640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x563c6b55c4c0 2024-05-08T18:50:47.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.841+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa4b402a070 con 0x563c6b55c4c0 2024-05-08T18:50:47.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.841+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x563c6b55c4c0 2024-05-08T18:50:47.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.842+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4b402a070 con 0x563c6b55c4c0 2024-05-08T18:50:47.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.842+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x7fa4ac048040 2024-05-08T18:50:47.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.842+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4a405a040 con 0x7fa4ac048040 2024-05-08T18:50:47.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.842+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x563c6b55c4c0 2024-05-08T18:50:47.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.843+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4b402a070 con 0x563c6b55c4c0 2024-05-08T18:50:47.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.843+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x563c6b55c4c0 2024-05-08T18:50:47.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.843+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4b402a070 con 0x563c6b55c4c0 2024-05-08T18:50:47.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.843+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x563c6b557df0 2024-05-08T18:50:47.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.843+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4a405a040 con 0x563c6b557df0 2024-05-08T18:50:47.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.843+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x563c6b557df0 2024-05-08T18:50:47.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.843+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa4a405a040 con 0x563c6b557df0 2024-05-08T18:50:47.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.843+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x7fa4ac048040 2024-05-08T18:50:47.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.844+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4a407d040 con 0x7fa4ac048040 2024-05-08T18:50:47.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.844+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x563c6b55c4c0 2024-05-08T18:50:47.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.844+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4b402a070 con 0x563c6b55c4c0 2024-05-08T18:50:47.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.844+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x7fa4b4014070 2024-05-08T18:50:47.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.844+0000 7fa4baa04640 1 -- 172.21.15.132:0/1173142927 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4ac03d030 con 0x7fa4b4014070 2024-05-08T18:50:47.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.844+0000 7fa4baa04640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x563c6b557df0 2024-05-08T18:50:47.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.844+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4a407d040 con 0x563c6b557df0 2024-05-08T18:50:47.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.844+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x7fa4ac048040 2024-05-08T18:50:47.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.845+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4a407d040 con 0x7fa4ac048040 2024-05-08T18:50:47.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.845+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x563c6b55c4c0 2024-05-08T18:50:47.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.845+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4b402a070 con 0x563c6b55c4c0 2024-05-08T18:50:47.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.845+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x7fa4ac048040 2024-05-08T18:50:47.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.845+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4a407d040 con 0x7fa4ac048040 2024-05-08T18:50:47.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.845+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x7fa4b4014070 2024-05-08T18:50:47.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.845+0000 7fa4baa04640 1 -- 172.21.15.132:0/1173142927 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4ac03d030 con 0x7fa4b4014070 2024-05-08T18:50:47.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.845+0000 7fa4baa04640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x563c6b55c4c0 2024-05-08T18:50:47.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.846+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4b402a070 con 0x563c6b55c4c0 2024-05-08T18:50:47.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.846+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x7fa4ac048040 2024-05-08T18:50:47.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.846+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4a407d040 con 0x7fa4ac048040 2024-05-08T18:50:47.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.846+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x563c6b557df0 2024-05-08T18:50:47.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.846+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa4a407d040 con 0x563c6b557df0 2024-05-08T18:50:47.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.846+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5609f0 con 0x7fa4b4014070 2024-05-08T18:50:47.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.847+0000 7fa4baa04640 1 -- 172.21.15.132:0/1173142927 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4ac03d030 con 0x7fa4b4014070 2024-05-08T18:50:47.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.847+0000 7fa4bcf0c800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:47.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.847+0000 7fa4bcf0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:47.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.847+0000 7fa4bcf0c800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:47.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.847+0000 7fa4bcf0c800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:47.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.847+0000 7fa4bcf0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:47.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.847+0000 7fa4bcf0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:47.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.847+0000 7fa4bcf0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.847+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563c6b55faf0 con 0x563c6b557df0 2024-05-08T18:50:47.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.847+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4a407d040 con 0x563c6b557df0 2024-05-08T18:50:47.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.847+0000 7fa4bcf0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.847+0000 7fa4bcf0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.847+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563c6b560390 con 0x563c6b557df0 2024-05-08T18:50:47.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.847+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa4a407d040 con 0x563c6b557df0 2024-05-08T18:50:47.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.847+0000 7fa4bcf0c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:47.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.847+0000 7fa4bcf0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.847+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563c6b55f730 con 0x563c6b557df0 2024-05-08T18:50:47.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa4a407d040 con 0x563c6b557df0 2024-05-08T18:50:47.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4bcf0c800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:47.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4bcf0c800 20 zone default found 2024-05-08T18:50:47.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4bcf0c800 4 Realm: () 2024-05-08T18:50:47.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4bcf0c800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:47.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4bcf0c800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:47.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4bcf0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:47.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4bcf0c800 20 zonegroup default 2024-05-08T18:50:47.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4bcf0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563c6b561370 con 0x7fa4ac048040 2024-05-08T18:50:47.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa4a407d040 con 0x7fa4ac048040 2024-05-08T18:50:47.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4bcf0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4bcf0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563c6b562db0 con 0x563c6b55c4c0 2024-05-08T18:50:47.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa4b402a070 con 0x563c6b55c4c0 2024-05-08T18:50:47.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4bcf0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4bcf0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563c6b563280 con 0x563c6b55c4c0 2024-05-08T18:50:47.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa4b402a070 con 0x563c6b55c4c0 2024-05-08T18:50:47.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4bcf0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4bcf0c800 20 started sync module instance, tier type = 2024-05-08T18:50:47.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4bcf0c800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:47.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.848+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b562190 con 0x7fa4b4014070 2024-05-08T18:50:47.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.849+0000 7fa4baa04640 1 -- 172.21.15.132:0/1173142927 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4ac03d030 con 0x7fa4b4014070 2024-05-08T18:50:47.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.849+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94817498832096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5636e0 con 0x7fa4b4014070 2024-05-08T18:50:47.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.849+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b563f30 con 0x563c6b557df0 2024-05-08T18:50:47.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.850+0000 7fa4baa04640 1 -- 172.21.15.132:0/1173142927 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94817498832096] v25'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4ac03d030 con 0x7fa4b4014070 2024-05-08T18:50:47.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.851+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4a407d040 con 0x563c6b557df0 2024-05-08T18:50:47.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.851+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94817498839680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b564350 con 0x563c6b557df0 2024-05-08T18:50:47.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.851+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b564c00 con 0x563c6b55c4c0 2024-05-08T18:50:47.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.852+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4b402a070 con 0x563c6b55c4c0 2024-05-08T18:50:47.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.852+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94817498841936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5647b0 con 0x563c6b55c4c0 2024-05-08T18:50:47.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.852+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b565bd0 con 0x7fa4b4014070 2024-05-08T18:50:47.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.852+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94817498839680] v25'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4a407d040 con 0x563c6b557df0 2024-05-08T18:50:47.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.853+0000 7fa4baa04640 1 -- 172.21.15.132:0/1173142927 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4ac03d030 con 0x7fa4b4014070 2024-05-08T18:50:47.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.853+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94817498846912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b565fc0 con 0x7fa4b4014070 2024-05-08T18:50:47.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.853+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94817498841936] v25'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4b402a070 con 0x563c6b55c4c0 2024-05-08T18:50:47.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.853+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b565010 con 0x563c6b557df0 2024-05-08T18:50:47.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.854+0000 7fa4baa04640 1 -- 172.21.15.132:0/1173142927 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94817498846912] v25'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4ac03d030 con 0x7fa4b4014070 2024-05-08T18:50:47.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.854+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4a407d040 con 0x563c6b557df0 2024-05-08T18:50:47.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.854+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94817498840736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5669b0 con 0x563c6b557df0 2024-05-08T18:50:47.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.854+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b567370 con 0x7fa4ac048040 2024-05-08T18:50:47.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.855+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94817498840736] v25'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4a407d040 con 0x563c6b557df0 2024-05-08T18:50:47.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.857+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4a407d040 con 0x7fa4ac048040 2024-05-08T18:50:47.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.857+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94817498851040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b567370 con 0x7fa4ac048040 2024-05-08T18:50:47.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.857+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b567d30 con 0x7fa4ac048040 2024-05-08T18:50:47.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.858+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(56 notify.6 [create] v25'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4a407d040 con 0x7fa4ac048040 2024-05-08T18:50:47.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.858+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94817498855552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b568150 con 0x7fa4ac048040 2024-05-08T18:50:47.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.858+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b568bb0 con 0x7fa4ac048040 2024-05-08T18:50:47.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.858+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94817498851040] v25'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4a407d040 con 0x7fa4ac048040 2024-05-08T18:50:47.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.859+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94817498855552] v25'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4a407d040 con 0x7fa4ac048040 2024-05-08T18:50:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.859+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4a407d040 con 0x7fa4ac048040 2024-05-08T18:50:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.859+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94817498853056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b567ce0 con 0x7fa4ac048040 2024-05-08T18:50:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.859+0000 7fa4bcf0c800 20 add_watcher() i=0 2024-05-08T18:50:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.859+0000 7fa4bcf0c800 20 add_watcher() i=1 2024-05-08T18:50:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.859+0000 7fa4bcf0c800 20 add_watcher() i=2 2024-05-08T18:50:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.859+0000 7fa4bcf0c800 20 add_watcher() i=3 2024-05-08T18:50:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.859+0000 7fa4bcf0c800 20 add_watcher() i=4 2024-05-08T18:50:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.859+0000 7fa4bcf0c800 20 add_watcher() i=5 2024-05-08T18:50:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.859+0000 7fa4bcf0c800 20 add_watcher() i=6 2024-05-08T18:50:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.860+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94817498853056] v25'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4a407d040 con 0x7fa4ac048040 2024-05-08T18:50:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.860+0000 7fa4bcf0c800 20 add_watcher() i=7 2024-05-08T18:50:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.860+0000 7fa4bcf0c800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.860+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563c6b56bcb0 con 0x563c6b557df0 2024-05-08T18:50:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.860+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa4a407d040 con 0x563c6b557df0 2024-05-08T18:50:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.860+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94817498859200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b569130 con 0x563c6b557df0 2024-05-08T18:50:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.861+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94817498859200] v25'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa4a407d040 con 0x563c6b557df0 2024-05-08T18:50:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.861+0000 7fa3717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.861+0000 7fa4bcf0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.861+0000 7fa4bcf0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.861+0000 7fa4bcf0c800 5 note: GC not initialized 2024-05-08T18:50:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.862+0000 7fa2ebfff640 20 reqs_thread_entry: start 2024-05-08T18:50:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.862+0000 7fa4bcf0c800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.862+0000 7fa4bcf0c800 20 Filter name: none 2024-05-08T18:50:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.862+0000 7fa2e9ffb640 20 reqs_thread_entry: start 2024-05-08T18:50:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.862+0000 7fa4bcf0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.862+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563c6b59ea70 con 0x563c6b557df0 2024-05-08T18:50:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.862+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa4a407d040 con 0x563c6b557df0 2024-05-08T18:50:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.862+0000 7fa4bcf0c800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:47.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.862+0000 7fa4bcf0c800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.862+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563c6b59f300 con 0x563c6b557df0 2024-05-08T18:50:47.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.863+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa4a407d040 con 0x563c6b557df0 2024-05-08T18:50:47.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.863+0000 7fa4bcf0c800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:47.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.863+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5a0310 con 0x7fa4b4014070 2024-05-08T18:50:47.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.863+0000 7fa4baa04640 1 -- 172.21.15.132:0/1173142927 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fa4ac03d030 con 0x7fa4b4014070 2024-05-08T18:50:47.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.864+0000 7fa3717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:47.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.864+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94817498859200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b569130 con 0x563c6b557df0 2024-05-08T18:50:47.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.865+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94817498859200] v25'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa4a407d040 con 0x563c6b557df0 2024-05-08T18:50:47.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.865+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94817498832096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b5686c0 con 0x7fa4b4014070 2024-05-08T18:50:47.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.866+0000 7fa4baa04640 1 -- 172.21.15.132:0/1173142927 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94817498832096] v25'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4ac03d030 con 0x7fa4b4014070 2024-05-08T18:50:47.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.866+0000 7fa4bcf0c800 20 remove_watcher() i=0 2024-05-08T18:50:47.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.866+0000 7fa4bcf0c800 2 removed watcher, disabling cache 2024-05-08T18:50:47.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.866+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94817498839680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b561ce0 con 0x563c6b557df0 2024-05-08T18:50:47.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.867+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94817498839680] v25'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4a407d040 con 0x563c6b557df0 2024-05-08T18:50:47.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.867+0000 7fa4bcf0c800 20 remove_watcher() i=1 2024-05-08T18:50:47.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.867+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94817498841936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b561ce0 con 0x563c6b55c4c0 2024-05-08T18:50:47.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.868+0000 7fa4bb205640 1 -- 172.21.15.132:0/1173142927 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94817498841936] v25'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4b402a070 con 0x563c6b55c4c0 2024-05-08T18:50:47.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.868+0000 7fa4bcf0c800 20 remove_watcher() i=2 2024-05-08T18:50:47.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.868+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94817498846912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b564350 con 0x7fa4b4014070 2024-05-08T18:50:47.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.869+0000 7fa4baa04640 1 -- 172.21.15.132:0/1173142927 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94817498846912] v25'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4ac03d030 con 0x7fa4b4014070 2024-05-08T18:50:47.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.869+0000 7fa4bcf0c800 20 remove_watcher() i=3 2024-05-08T18:50:47.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.869+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94817498840736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b561ce0 con 0x563c6b557df0 2024-05-08T18:50:47.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.870+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94817498840736] v25'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4a407d040 con 0x563c6b557df0 2024-05-08T18:50:47.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.870+0000 7fa4bcf0c800 20 remove_watcher() i=4 2024-05-08T18:50:47.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.870+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94817498851040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b561ce0 con 0x7fa4ac048040 2024-05-08T18:50:47.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.871+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94817498851040] v25'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4a407d040 con 0x7fa4ac048040 2024-05-08T18:50:47.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.871+0000 7fa4bcf0c800 20 remove_watcher() i=5 2024-05-08T18:50:47.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.871+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94817498855552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b561ce0 con 0x7fa4ac048040 2024-05-08T18:50:47.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.872+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94817498855552] v25'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4a407d040 con 0x7fa4ac048040 2024-05-08T18:50:47.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.872+0000 7fa4bcf0c800 20 remove_watcher() i=6 2024-05-08T18:50:47.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.872+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94817498853056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563c6b561ce0 con 0x7fa4ac048040 2024-05-08T18:50:47.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94817498853056] v25'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4a407d040 con 0x7fa4ac048040 2024-05-08T18:50:47.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4bcf0c800 20 remove_watcher() i=7 2024-05-08T18:50:47.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa4ac048040 msgr2=0x7fa4ac02a7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa4ac048040 0x7fa4ac02a7e0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x563c6b557df0 msgr2=0x563c6b55a280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x563c6b557df0 0x563c6b55a280 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa4b4014070 msgr2=0x7fa4b40439b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa4b4014070 0x7fa4b40439b0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x563c6b55c4c0 msgr2=0x563c6b55e8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x563c6b55c4c0 0x563c6b55e8b0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa38403bba0 msgr2=0x7fa38403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa38403bba0 0x7fa38403e060 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac021000 tx=0x7fa4ac045000 comp rx=0 tx=0).stop 2024-05-08T18:50:47.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b544b50 msgr2=0x563c6b54c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4b3fff640 1 -- 172.21.15.132:0/1173142927 reap_dead start 2024-05-08T18:50:47.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b544b50 0x563c6b54c140 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4016c90 tx=0x7fa4b4052c60 comp rx=0 tx=0).stop 2024-05-08T18:50:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 shutdown_connections 2024-05-08T18:50:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1173142927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b544b50 0x563c6b54c140 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 >> 172.21.15.132:0/1173142927 conn(0x563c6b540eb0 msgr2=0x563c6b53e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 shutdown_connections 2024-05-08T18:50:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1173142927 wait complete. 2024-05-08T18:50:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1938161436 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa39403bb50 msgr2=0x7fa39403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1938161436 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa39403bb50 0x7fa39403e010 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x563c6b521da0 tx=0x7fa4ac00c780 comp rx=0 tx=0).stop 2024-05-08T18:50:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1938161436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b512ea0 msgr2=0x563c6b511310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.873+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1938161436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b512ea0 0x563c6b511310 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x563c6b521d00 tx=0x7fa4b4018830 comp rx=0 tx=0).stop 2024-05-08T18:50:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.874+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1938161436 shutdown_connections 2024-05-08T18:50:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.874+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1938161436 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa39403bb50 0x7fa39403e010 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.874+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1938161436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b512ea0 0x563c6b511310 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.874+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1938161436 >> 172.21.15.132:0/1938161436 conn(0x563c6b529710 msgr2=0x563c6b529b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.874+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1938161436 shutdown_connections 2024-05-08T18:50:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.874+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1938161436 wait complete. 2024-05-08T18:50:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.874+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1458567723 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x563c6b4245d0 msgr2=0x563c6b5213a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.874+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1458567723 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x563c6b4245d0 0x563c6b5213a0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.874+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1458567723 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x563c6b523c50 msgr2=0x563c6b526040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.874+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1458567723 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x563c6b523c50 0x563c6b526040 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.874+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1458567723 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3a003bb50 msgr2=0x7fa3a003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.874+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1458567723 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3a003bb50 0x7fa3a003e010 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4054000 tx=0x7fa4a404e000 comp rx=0 tx=0).stop 2024-05-08T18:50:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.874+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1458567723 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b420140 msgr2=0x563c6b51a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.874+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1458567723 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b420140 0x563c6b51a160 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac004000 tx=0x7fa4ac000bc0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.874+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1458567723 shutdown_connections 2024-05-08T18:50:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.874+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1458567723 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x563c6b523c50 0x563c6b526040 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.874+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1458567723 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x563c6b4245d0 0x563c6b5213a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.874+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1458567723 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3a003bb50 0x7fa3a003e010 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.874+0000 7fa4bcf0c800 1 --2- 172.21.15.132:0/1458567723 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563c6b420140 0x563c6b51a160 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.874+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1458567723 >> 172.21.15.132:0/1458567723 conn(0x563c6b41b720 msgr2=0x563c6b50b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.874+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1458567723 shutdown_connections 2024-05-08T18:50:47.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.874+0000 7fa4bcf0c800 1 -- 172.21.15.132:0/1458567723 wait complete. 2024-05-08T18:50:47.882 INFO:teuthology.orchestra.run.smithi132.stdout:["myfoo"] 2024-05-08T18:50:47.882 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-05-08T18:50:47.886 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:50:47.886 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-05-08T18:50:47.886 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-05-08T18:50:47.886 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-05-08T18:50:47.928 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:47.929 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:47.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.930+0000 7f9a1af1f800 1 Processor -- start 2024-05-08T18:50:47.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.930+0000 7f9a1af1f800 1 -- start start 2024-05-08T18:50:47.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.930+0000 7f9a1af1f800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5616b3746d40 0x5616b3749130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.930+0000 7f9a1af1f800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5616b374d180 con 0x5616b3749670 2024-05-08T18:50:47.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.930+0000 7f9a1af1f800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x5616b35e6e20 con 0x5616b3746d40 2024-05-08T18:50:47.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.930+0000 7f9a16be0640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5616b3746d40 0x5616b3749130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.930+0000 7f9a0ffff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x5616b3749670 0x5616b374ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46908/0 (socket says 172.21.15.132:46908) 2024-05-08T18:50:47.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.930+0000 7f9a0ffff640 1 -- 172.21.15.132:0/703856663 learned_addr learned my addr 172.21.15.132:0/703856663 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:50:47.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.930+0000 7f9a163df640 1 -- 172.21.15.132:0/703856663 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 937830805 0 0) 0x5616b374d180 con 0x5616b3749670 2024-05-08T18:50:47.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.930+0000 7f9a163df640 1 -- 172.21.15.132:0/703856663 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a04001e10 con 0x5616b3749670 2024-05-08T18:50:47.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.930+0000 7f9a16be0640 1 -- 172.21.15.132:0/703856663 >> v1:172.21.15.42:6789/0 conn(0x5616b3749670 legacy=0x5616b374ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.931+0000 7f9a16be0640 1 -- 172.21.15.132:0/703856663 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b374e360 con 0x5616b3746d40 2024-05-08T18:50:47.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.932+0000 7f9a16be0640 1 --2- 172.21.15.132:0/703856663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746d40 0x5616b3749130 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800a470 tx=0x7f9a0801cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156a247f815c22f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.933+0000 7f9a163df640 1 -- 172.21.15.132:0/703856663 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a08057070 con 0x5616b3746d40 2024-05-08T18:50:47.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.933+0000 7f9a163df640 1 -- 172.21.15.132:0/703856663 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a08052570 con 0x5616b3746d40 2024-05-08T18:50:47.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.933+0000 7f9a163df640 1 -- 172.21.15.132:0/703856663 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a08052850 con 0x5616b3746d40 2024-05-08T18:50:47.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.933+0000 7f9a1af1f800 1 -- 172.21.15.132:0/703856663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746d40 msgr2=0x5616b3749130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.933+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/703856663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746d40 0x5616b3749130 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800a470 tx=0x7f9a0801cdb0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.933+0000 7f9a1af1f800 1 -- 172.21.15.132:0/703856663 shutdown_connections 2024-05-08T18:50:47.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.933+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/703856663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746d40 0x5616b3749130 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.933+0000 7f9a1af1f800 1 -- 172.21.15.132:0/703856663 >> 172.21.15.132:0/703856663 conn(0x5616b3740690 msgr2=0x5616b3742af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.933+0000 7f9a1af1f800 1 -- 172.21.15.132:0/703856663 shutdown_connections 2024-05-08T18:50:47.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.933+0000 7f9a1af1f800 1 -- 172.21.15.132:0/703856663 wait complete. 2024-05-08T18:50:47.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.947+0000 7f9a1af1f800 1 Processor -- start 2024-05-08T18:50:47.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.947+0000 7f9a1af1f800 1 -- start start 2024-05-08T18:50:47.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.947+0000 7f9a1af1f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746d40 0x5616b38373c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.947+0000 7f9a1af1f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5616b36915a0 con 0x5616b3746d40 2024-05-08T18:50:47.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.947+0000 7f9a16be0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746d40 0x5616b38373c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.947+0000 7f9a16be0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746d40 0x5616b38373c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60960/0 (socket says 172.21.15.132:60960) 2024-05-08T18:50:47.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.947+0000 7f9a16be0640 1 -- 172.21.15.132:0/3335011636 learned_addr learned my addr 172.21.15.132:0/3335011636 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.948+0000 7f9a16be0640 1 -- 172.21.15.132:0/3335011636 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b3837990 con 0x5616b3746d40 2024-05-08T18:50:47.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.948+0000 7f9a16be0640 1 --2- 172.21.15.132:0/3335011636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746d40 0x5616b38373c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9a08055040 tx=0x7f9a0804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa2590fd884b691 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.948+0000 7f9904e09640 1 -- 172.21.15.132:0/3335011636 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a08057040 con 0x5616b3746d40 2024-05-08T18:50:47.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.948+0000 7f9904e09640 1 -- 172.21.15.132:0/3335011636 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a08052950 con 0x5616b3746d40 2024-05-08T18:50:47.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.948+0000 7f9904e09640 1 -- 172.21.15.132:0/3335011636 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a08052c70 con 0x5616b3746d40 2024-05-08T18:50:47.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.949+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3335011636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746d40 msgr2=0x5616b38373c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.949+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/3335011636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746d40 0x5616b38373c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9a08055040 tx=0x7f9a0804c000 comp rx=0 tx=0).stop 2024-05-08T18:50:47.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.949+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3335011636 shutdown_connections 2024-05-08T18:50:47.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.949+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/3335011636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746d40 0x5616b38373c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.949+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3335011636 >> 172.21.15.132:0/3335011636 conn(0x5616b3740690 msgr2=0x5616b3832ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.949+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3335011636 shutdown_connections 2024-05-08T18:50:47.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.949+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3335011636 wait complete. 2024-05-08T18:50:47.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.949+0000 7f9a1af1f800 1 Processor -- start 2024-05-08T18:50:47.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.949+0000 7f9a1af1f800 1 -- start start 2024-05-08T18:50:47.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.949+0000 7f9a1af1f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746d40 0x5616b383ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.949+0000 7f9a1af1f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5616b374d5f0 con 0x5616b3746d40 2024-05-08T18:50:47.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.949+0000 7f9a16be0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746d40 0x5616b383ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.949+0000 7f9a16be0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746d40 0x5616b383ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60974/0 (socket says 172.21.15.132:60974) 2024-05-08T18:50:47.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.949+0000 7f9a16be0640 1 -- 172.21.15.132:0/3124003774 learned_addr learned my addr 172.21.15.132:0/3124003774 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.950+0000 7f9a16be0640 1 -- 172.21.15.132:0/3124003774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b383f3c0 con 0x5616b3746d40 2024-05-08T18:50:47.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.950+0000 7f9a16be0640 1 --2- 172.21.15.132:0/3124003774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746d40 0x5616b383ee80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9a0801baa0 tx=0x7f9a08003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.950+0000 7f9903606640 1 -- 172.21.15.132:0/3124003774 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a08073070 con 0x5616b3746d40 2024-05-08T18:50:47.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.950+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3124003774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616b383f650 con 0x5616b3746d40 2024-05-08T18:50:47.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.950+0000 7f9903606640 1 -- 172.21.15.132:0/3124003774 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0805d780 con 0x5616b3746d40 2024-05-08T18:50:47.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.950+0000 7f9903606640 1 -- 172.21.15.132:0/3124003774 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a08057070 con 0x5616b3746d40 2024-05-08T18:50:47.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.950+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3124003774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616b3842260 con 0x5616b3746d40 2024-05-08T18:50:47.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.951+0000 7f9903606640 1 -- 172.21.15.132:0/3124003774 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9a08076070 con 0x5616b3746d40 2024-05-08T18:50:47.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.951+0000 7f9903606640 1 --2- 172.21.15.132:0/3124003774 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f98fc03bb50 0x7f98fc03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.951+0000 7f9903606640 1 -- 172.21.15.132:0/3124003774 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f9a080941c0 con 0x5616b3746d40 2024-05-08T18:50:47.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.951+0000 7f9a0ffff640 1 --2- 172.21.15.132:0/3124003774 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f98fc03bb50 0x7f98fc03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.951+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/3124003774 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5616b3749670 0x5616b3846020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.951+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3124003774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5616b38465b0 con 0x5616b3749670 2024-05-08T18:50:47.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.951+0000 7f9a173e1640 1 --2- 172.21.15.132:0/3124003774 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5616b3749670 0x5616b3846020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.952+0000 7f9a0ffff640 1 --2- 172.21.15.132:0/3124003774 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f98fc03bb50 0x7f98fc03e010 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9a00000f60 tx=0x7f9a000010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.952+0000 7f9a173e1640 1 --2- 172.21.15.132:0/3124003774 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5616b3749670 0x5616b3846020 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.952+0000 7f9a173e1640 1 -- 172.21.15.132:0/3124003774 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a1000a4a0 con 0x5616b3749670 2024-05-08T18:50:47.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.952+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3124003774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5616b38435d0 con 0x5616b3749670 2024-05-08T18:50:47.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.952+0000 7f9a173e1640 1 -- 172.21.15.132:0/3124003774 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9a1000a4a0 con 0x5616b3749670 2024-05-08T18:50:47.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.952+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/3124003774 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5616b38488e0 0x5616b384acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.952+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3124003774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5616b384b370 con 0x5616b38488e0 2024-05-08T18:50:47.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.952+0000 7f9a16be0640 1 --2- 172.21.15.132:0/3124003774 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5616b38488e0 0x5616b384acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.952+0000 7f9a16be0640 1 --2- 172.21.15.132:0/3124003774 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5616b38488e0 0x5616b384acd0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.953+0000 7f9a16be0640 1 -- 172.21.15.132:0/3124003774 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9a08075030 con 0x5616b38488e0 2024-05-08T18:50:47.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.953+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3124003774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5616b3847780 con 0x5616b3749670 2024-05-08T18:50:47.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.953+0000 7f9a173e1640 1 -- 172.21.15.132:0/3124003774 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9a1000a4a0 con 0x5616b3749670 2024-05-08T18:50:47.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.953+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3124003774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5616b3847c60 con 0x5616b3749670 2024-05-08T18:50:47.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.953+0000 7f9a173e1640 1 -- 172.21.15.132:0/3124003774 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9a1000a4a0 con 0x5616b3749670 2024-05-08T18:50:47.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.954+0000 7f9a1af1f800 1 Processor -- start 2024-05-08T18:50:47.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.954+0000 7f9a1af1f800 1 -- start start 2024-05-08T18:50:47.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.954+0000 7f9a1af1f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b385a2f0 0x5616b385a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.954+0000 7f9a1af1f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5616b3637fc0 con 0x5616b385a2f0 2024-05-08T18:50:47.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.954+0000 7f9a173e1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b385a2f0 0x5616b385a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.954+0000 7f9a173e1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b385a2f0 0x5616b385a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60988/0 (socket says 172.21.15.132:60988) 2024-05-08T18:50:47.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.954+0000 7f9a173e1640 1 -- 172.21.15.132:0/3608973242 learned_addr learned my addr 172.21.15.132:0/3608973242 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.955+0000 7f9a173e1640 1 -- 172.21.15.132:0/3608973242 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b385ac50 con 0x5616b385a2f0 2024-05-08T18:50:47.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.955+0000 7f9a173e1640 1 --2- 172.21.15.132:0/3608973242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b385a2f0 0x5616b385a710 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x5616b383fd00 tx=0x7f9a100188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.955+0000 7f9900e01640 1 -- 172.21.15.132:0/3608973242 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a10014450 con 0x5616b385a2f0 2024-05-08T18:50:47.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.955+0000 7f9900e01640 1 -- 172.21.15.132:0/3608973242 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a100145f0 con 0x5616b385a2f0 2024-05-08T18:50:47.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.955+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3608973242 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616b385b6c0 con 0x5616b385a2f0 2024-05-08T18:50:47.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.955+0000 7f9900e01640 1 -- 172.21.15.132:0/3608973242 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a100148d0 con 0x5616b385a2f0 2024-05-08T18:50:47.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.955+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3608973242 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616b385bbc0 con 0x5616b385a2f0 2024-05-08T18:50:47.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.956+0000 7f9900e01640 1 -- 172.21.15.132:0/3608973242 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9a10011040 con 0x5616b385a2f0 2024-05-08T18:50:47.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.956+0000 7f9900e01640 1 --2- 172.21.15.132:0/3608973242 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f98f003bb50 0x7f98f003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.956+0000 7f9900e01640 1 -- 172.21.15.132:0/3608973242 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f9a1001e070 con 0x5616b385a2f0 2024-05-08T18:50:47.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.956+0000 7f9a16be0640 1 --2- 172.21.15.132:0/3608973242 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f98f003bb50 0x7f98f003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.956+0000 7f9a1af1f800 1 Processor -- start 2024-05-08T18:50:47.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.956+0000 7f9a16be0640 1 --2- 172.21.15.132:0/3608973242 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f98f003bb50 0x7f98f003e010 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x5616b3846a20 tx=0x7f9a080926f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.956+0000 7f9a1af1f800 1 -- start start 2024-05-08T18:50:47.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.956+0000 7f9a1af1f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746330 0x5616b3746750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.956+0000 7f9a1af1f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5616b3837c50 con 0x5616b3746330 2024-05-08T18:50:47.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.957+0000 7f9a173e1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746330 0x5616b3746750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.957+0000 7f9a173e1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746330 0x5616b3746750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:60992/0 (socket says 172.21.15.132:60992) 2024-05-08T18:50:47.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.957+0000 7f9a173e1640 1 -- 172.21.15.132:0/2153937013 learned_addr learned my addr 172.21.15.132:0/2153937013 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.957+0000 7f9a173e1640 1 -- 172.21.15.132:0/2153937013 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b3744b30 con 0x5616b3746330 2024-05-08T18:50:47.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.957+0000 7f9a173e1640 1 --2- 172.21.15.132:0/2153937013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746330 0x5616b3746750 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9a10005a80 tx=0x7f9a100118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4507c6cb6efae6bb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.957+0000 7f98fa7fc640 1 -- 172.21.15.132:0/2153937013 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a1002bc50 con 0x5616b3746330 2024-05-08T18:50:47.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.957+0000 7f98fa7fc640 1 -- 172.21.15.132:0/2153937013 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a1002bdf0 con 0x5616b3746330 2024-05-08T18:50:47.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.957+0000 7f98fa7fc640 1 -- 172.21.15.132:0/2153937013 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a10054200 con 0x5616b3746330 2024-05-08T18:50:47.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.958+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2153937013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746330 msgr2=0x5616b3746750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:47.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.958+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/2153937013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746330 0x5616b3746750 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9a10005a80 tx=0x7f9a100118e0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.958+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2153937013 shutdown_connections 2024-05-08T18:50:47.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.958+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/2153937013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746330 0x5616b3746750 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:47.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.958+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2153937013 >> 172.21.15.132:0/2153937013 conn(0x5616b3863970 msgr2=0x5616b38619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:47.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.958+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2153937013 shutdown_connections 2024-05-08T18:50:47.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.958+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2153937013 wait complete. 2024-05-08T18:50:47.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.958+0000 7f9a1af1f800 1 Processor -- start 2024-05-08T18:50:47.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.958+0000 7f9a1af1f800 1 -- start start 2024-05-08T18:50:47.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.958+0000 7f9a1af1f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746330 0x5616b3870d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.958+0000 7f9a1af1f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5616b3745000 con 0x5616b3746330 2024-05-08T18:50:47.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.958+0000 7f9a173e1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746330 0x5616b3870d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.958+0000 7f9a173e1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746330 0x5616b3870d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32768/0 (socket says 172.21.15.132:32768) 2024-05-08T18:50:47.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.958+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 learned_addr learned my addr 172.21.15.132:0/2447313707 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:47.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.959+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b38712d0 con 0x5616b3746330 2024-05-08T18:50:47.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.959+0000 7f9a173e1640 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746330 0x5616b3870d90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9a100014b0 tx=0x7f9a10052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.959+0000 7f98f8ff9640 1 -- 172.21.15.132:0/2447313707 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a1002b690 con 0x5616b3746330 2024-05-08T18:50:47.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.959+0000 7f98f8ff9640 1 -- 172.21.15.132:0/2447313707 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a10031070 con 0x5616b3746330 2024-05-08T18:50:47.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.959+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616b3871560 con 0x5616b3746330 2024-05-08T18:50:47.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.959+0000 7f98f8ff9640 1 -- 172.21.15.132:0/2447313707 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a1002b960 con 0x5616b3746330 2024-05-08T18:50:47.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.959+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616b3874210 con 0x5616b3746330 2024-05-08T18:50:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.960+0000 7f98f8ff9640 1 -- 172.21.15.132:0/2447313707 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9a10054850 con 0x5616b3746330 2024-05-08T18:50:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.960+0000 7f98f8ff9640 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f98e003bba0 0x7f98e003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.960+0000 7f98f8ff9640 1 -- 172.21.15.132:0/2447313707 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f9a1000e040 con 0x5616b3746330 2024-05-08T18:50:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.960+0000 7f9a16be0640 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f98e003bba0 0x7f98e003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.960+0000 7f9a1af1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.960+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5616b387ca80 0x5616b387ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.960+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5616b387f670 con 0x5616b387ca80 2024-05-08T18:50:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.960+0000 7f9a0ffff640 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5616b387ca80 0x5616b387ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.961+0000 7f9a16be0640 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f98e003bba0 0x7f98e003e060 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x5616b384b770 tx=0x7f9a08085000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.961+0000 7f9a0ffff640 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5616b387ca80 0x5616b387ef20 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.961+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a00009050 con 0x5616b387ca80 2024-05-08T18:50:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.961+0000 7f9a1af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.961+0000 7f9a1af1f800 20 realm 2024-05-08T18:50:47.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.961+0000 7f9a1af1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.961+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5616b387bf90 con 0x5616b387ca80 2024-05-08T18:50:47.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.961+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a00009050 con 0x5616b387ca80 2024-05-08T18:50:47.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.961+0000 7f9a1af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.961+0000 7f9a1af1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:47.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.961+0000 7f9a1af1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.961+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5616b3880170 con 0x5616b387ca80 2024-05-08T18:50:47.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.961+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a00009050 con 0x5616b387ca80 2024-05-08T18:50:47.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.961+0000 7f9a1af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.961+0000 7f9a1af1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.961+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5616b3880a40 con 0x5616b387ca80 2024-05-08T18:50:47.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.961+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9a00009050 con 0x5616b387ca80 2024-05-08T18:50:47.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.962+0000 7f9a1af1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:47.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.962+0000 7f9a1af1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.962+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5616b38812f0 0x5616b38836e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.962+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5616b3883e20 con 0x5616b38812f0 2024-05-08T18:50:47.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.962+0000 7f9a173e1640 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5616b38812f0 0x5616b38836e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.962+0000 7f9a173e1640 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5616b38812f0 0x5616b38836e0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.962+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9a1002a070 con 0x5616b38812f0 2024-05-08T18:50:47.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.962+0000 7f9a1af1f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:47.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.962+0000 7f9a1af1f800 20 searching for the correct realm 2024-05-08T18:50:47.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.962+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x5616b38812f0 2024-05-08T18:50:47.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.963+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:47.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.963+0000 7f9a173e1640 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9a10014070 0x7f9a10001890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.963+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x7f9a10014070 2024-05-08T18:50:47.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.963+0000 7f9a16be0640 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9a10014070 0x7f9a10001890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.963+0000 7f9a16be0640 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9a10014070 0x7f9a10001890 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.963+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a08075030 con 0x7f9a10014070 2024-05-08T18:50:47.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.963+0000 7f9a16be0640 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f9a08078060 0x7f9a0805b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:47.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.964+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x7f9a08078060 2024-05-08T18:50:47.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.964+0000 7f9a0ffff640 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f9a08078060 0x7f9a0805b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:47.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.964+0000 7f9a0ffff640 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f9a08078060 0x7f9a0805b7a0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:47.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.964+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00009050 con 0x7f9a08078060 2024-05-08T18:50:47.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.964+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x5616b387ca80 2024-05-08T18:50:47.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.965+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00009050 con 0x5616b387ca80 2024-05-08T18:50:47.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.965+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x5616b387ca80 2024-05-08T18:50:47.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.965+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00029040 con 0x5616b387ca80 2024-05-08T18:50:47.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.965+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x7f9a08078060 2024-05-08T18:50:47.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.965+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00029040 con 0x7f9a08078060 2024-05-08T18:50:47.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.965+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x7f9a08078060 2024-05-08T18:50:47.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.965+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00029040 con 0x7f9a08078060 2024-05-08T18:50:47.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.965+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x7f9a10014070 2024-05-08T18:50:47.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.965+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a08075030 con 0x7f9a10014070 2024-05-08T18:50:47.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.965+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x5616b38812f0 2024-05-08T18:50:47.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.966+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:47.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.966+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x5616b387ca80 2024-05-08T18:50:47.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.966+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00029040 con 0x5616b387ca80 2024-05-08T18:50:47.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.966+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x7f9a08078060 2024-05-08T18:50:47.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.966+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00029040 con 0x7f9a08078060 2024-05-08T18:50:47.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.966+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x5616b387ca80 2024-05-08T18:50:47.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.966+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9a00029040 con 0x5616b387ca80 2024-05-08T18:50:47.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.966+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x7f9a10014070 2024-05-08T18:50:47.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.967+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9a08075030 con 0x7f9a10014070 2024-05-08T18:50:47.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.967+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x5616b38812f0 2024-05-08T18:50:47.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.967+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:47.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.967+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x5616b38812f0 2024-05-08T18:50:47.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.967+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:47.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.967+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x7f9a08078060 2024-05-08T18:50:47.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.968+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00029040 con 0x7f9a08078060 2024-05-08T18:50:47.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.968+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x5616b38812f0 2024-05-08T18:50:47.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.968+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:47.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.968+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x5616b38812f0 2024-05-08T18:50:47.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.968+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:47.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.968+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x5616b387ca80 2024-05-08T18:50:47.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.968+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00029040 con 0x5616b387ca80 2024-05-08T18:50:47.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.968+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x5616b387ca80 2024-05-08T18:50:47.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.968+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9a00029040 con 0x5616b387ca80 2024-05-08T18:50:47.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.968+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x7f9a08078060 2024-05-08T18:50:47.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.969+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00029040 con 0x7f9a08078060 2024-05-08T18:50:47.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.969+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x5616b38812f0 2024-05-08T18:50:47.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.969+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:47.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.969+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x7f9a10014070 2024-05-08T18:50:47.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.969+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a08075030 con 0x7f9a10014070 2024-05-08T18:50:47.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.969+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x5616b387ca80 2024-05-08T18:50:47.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.970+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00029040 con 0x5616b387ca80 2024-05-08T18:50:47.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.970+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x7f9a08078060 2024-05-08T18:50:47.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.970+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00029040 con 0x7f9a08078060 2024-05-08T18:50:47.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.970+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x5616b38812f0 2024-05-08T18:50:47.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.970+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:47.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.970+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x7f9a08078060 2024-05-08T18:50:47.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.970+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00029040 con 0x7f9a08078060 2024-05-08T18:50:47.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.970+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x7f9a10014070 2024-05-08T18:50:47.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.971+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a08075030 con 0x7f9a10014070 2024-05-08T18:50:47.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.971+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x5616b38812f0 2024-05-08T18:50:47.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.971+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:47.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.971+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885800 con 0x7f9a08078060 2024-05-08T18:50:47.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.971+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00029040 con 0x7f9a08078060 2024-05-08T18:50:47.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.971+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f9a0003a040 con 0x5616b387ca80 2024-05-08T18:50:47.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.971+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9a00029040 con 0x5616b387ca80 2024-05-08T18:50:47.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.971+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f9a0003a040 con 0x7f9a10014070 2024-05-08T18:50:47.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a08075030 con 0x7f9a10014070 2024-05-08T18:50:47.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:47.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:47.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:47.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:47.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:47.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:47.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5616b38848d0 con 0x5616b387ca80 2024-05-08T18:50:47.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a00029040 con 0x5616b387ca80 2024-05-08T18:50:47.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:47.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885170 con 0x5616b387ca80 2024-05-08T18:50:47.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9a00029040 con 0x5616b387ca80 2024-05-08T18:50:47.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:47.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:47.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5616b3884510 con 0x5616b387ca80 2024-05-08T18:50:48.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9a00029040 con 0x5616b387ca80 2024-05-08T18:50:48.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:48.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 20 zone default found 2024-05-08T18:50:48.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 4 Realm: () 2024-05-08T18:50:48.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:48.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:48.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:48.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 20 zonegroup default 2024-05-08T18:50:48.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.972+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885cd0 con 0x7f9a08078060 2024-05-08T18:50:48.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.973+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9a00029040 con 0x7f9a08078060 2024-05-08T18:50:48.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.973+0000 7f9a1af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.973+0000 7f9a1af1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.973+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5616b3884dd0 con 0x5616b38812f0 2024-05-08T18:50:48.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.973+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:48.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.973+0000 7f9a1af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.973+0000 7f9a1af1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.973+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5616b3887d00 con 0x5616b38812f0 2024-05-08T18:50:48.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.973+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:48.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.973+0000 7f9a1af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.973+0000 7f9a1af1f800 20 started sync module instance, tier type = 2024-05-08T18:50:48.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.973+0000 7f9a1af1f800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:48.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.973+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b3886fa0 con 0x7f9a10014070 2024-05-08T18:50:48.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.974+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a08075030 con 0x7f9a10014070 2024-05-08T18:50:48.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.974+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94655501331184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b3888160 con 0x7f9a10014070 2024-05-08T18:50:48.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.974+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b38889b0 con 0x5616b387ca80 2024-05-08T18:50:48.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.975+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94655501331184] v25'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a08075030 con 0x7f9a10014070 2024-05-08T18:50:48.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.976+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a00029040 con 0x5616b387ca80 2024-05-08T18:50:48.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.976+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94655501337856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b3888dd0 con 0x5616b387ca80 2024-05-08T18:50:48.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.976+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b3889620 con 0x5616b38812f0 2024-05-08T18:50:48.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.977+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94655501337856] v25'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a00029040 con 0x5616b387ca80 2024-05-08T18:50:48.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.977+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:48.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.977+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94655501339392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b38894f0 con 0x5616b38812f0 2024-05-08T18:50:48.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.977+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b3889ff0 con 0x7f9a10014070 2024-05-08T18:50:48.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.978+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94655501339392] v25'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:48.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.978+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a08075030 con 0x7f9a10014070 2024-05-08T18:50:48.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.978+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94655501343456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b388a410 con 0x7f9a10014070 2024-05-08T18:50:48.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.978+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b388ae30 con 0x5616b387ca80 2024-05-08T18:50:48.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.979+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94655501343456] v25'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a08075030 con 0x7f9a10014070 2024-05-08T18:50:48.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.979+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a00029040 con 0x5616b387ca80 2024-05-08T18:50:48.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.979+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94655501347104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b388b220 con 0x5616b387ca80 2024-05-08T18:50:48.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.979+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b388bc40 con 0x7f9a08078060 2024-05-08T18:50:48.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.980+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a00029040 con 0x7f9a08078060 2024-05-08T18:50:48.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.980+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94655501350704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b388bc00 con 0x7f9a08078060 2024-05-08T18:50:48.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.980+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b388cc00 con 0x7f9a08078060 2024-05-08T18:50:48.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.980+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94655501347104] v25'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a00029040 con 0x5616b387ca80 2024-05-08T18:50:48.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.981+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94655501350704] v25'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a00029040 con 0x7f9a08078060 2024-05-08T18:50:48.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.981+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a00029040 con 0x7f9a08078060 2024-05-08T18:50:48.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.981+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94655501354800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b388bde0 con 0x7f9a08078060 2024-05-08T18:50:48.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.981+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b388d4d0 con 0x7f9a08078060 2024-05-08T18:50:48.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.982+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94655501354800] v25'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a00029040 con 0x7f9a08078060 2024-05-08T18:50:48.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.982+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a00029040 con 0x7f9a08078060 2024-05-08T18:50:48.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.982+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94655501340512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b388bde0 con 0x7f9a08078060 2024-05-08T18:50:48.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.982+0000 7f9a1af1f800 20 add_watcher() i=0 2024-05-08T18:50:48.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.982+0000 7f9a1af1f800 20 add_watcher() i=1 2024-05-08T18:50:48.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.982+0000 7f9a1af1f800 20 add_watcher() i=2 2024-05-08T18:50:48.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.982+0000 7f9a1af1f800 20 add_watcher() i=3 2024-05-08T18:50:48.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.982+0000 7f9a1af1f800 20 add_watcher() i=4 2024-05-08T18:50:48.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.982+0000 7f9a1af1f800 20 add_watcher() i=5 2024-05-08T18:50:48.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.982+0000 7f9a1af1f800 20 add_watcher() i=6 2024-05-08T18:50:48.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.983+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94655501340512] v25'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a00029040 con 0x7f9a08078060 2024-05-08T18:50:48.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.983+0000 7f9a1af1f800 20 add_watcher() i=7 2024-05-08T18:50:48.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.983+0000 7f9a1af1f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:48.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.983+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5616b3890500 con 0x5616b387ca80 2024-05-08T18:50:48.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.983+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9a00029040 con 0x5616b387ca80 2024-05-08T18:50:48.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.983+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94655501357088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b388d9c0 con 0x5616b387ca80 2024-05-08T18:50:48.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.984+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94655501357088] v25'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9a00029040 con 0x5616b387ca80 2024-05-08T18:50:48.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.984+0000 7f98cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:48.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.985+0000 7f9a1af1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:48.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.985+0000 7f9a1af1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:48.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.985+0000 7f9a1af1f800 5 note: GC not initialized 2024-05-08T18:50:48.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.985+0000 7f9847fff640 20 reqs_thread_entry: start 2024-05-08T18:50:48.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.985+0000 7f9a1af1f800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:48.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.985+0000 7f9a1af1f800 20 Filter name: none 2024-05-08T18:50:48.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.985+0000 7f9845ffb640 20 reqs_thread_entry: start 2024-05-08T18:50:48.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.985+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b38c3190 con 0x5616b38812f0 2024-05-08T18:50:48.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.986+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(62 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:48.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.986+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3884dd0 con 0x5616b38812f0 2024-05-08T18:50:48.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.986+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(63 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:48.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.986+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3884dd0 con 0x5616b387ca80 2024-05-08T18:50:48.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.986+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(64 [pgnls start_epoch 25 out=49b] v25'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00029040 con 0x5616b387ca80 2024-05-08T18:50:48.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.986+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885170 con 0x5616b387ca80 2024-05-08T18:50:48.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.986+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 [pgnls start_epoch 25 out=49b] v25'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00043040 con 0x5616b387ca80 2024-05-08T18:50:48.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.986+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885170 con 0x7f9a10014070 2024-05-08T18:50:48.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.987+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(66 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a08075030 con 0x7f9a10014070 2024-05-08T18:50:48.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.987+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885170 con 0x5616b38812f0 2024-05-08T18:50:48.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.987+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(67 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:48.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.987+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885170 con 0x5616b387ca80 2024-05-08T18:50:48.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.987+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00043040 con 0x5616b387ca80 2024-05-08T18:50:48.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.987+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885170 con 0x5616b38812f0 2024-05-08T18:50:48.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.987+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(69 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:48.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.987+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885170 con 0x7f9a10014070 2024-05-08T18:50:48.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.988+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(70 [pgnls start_epoch 25 out=49b] v25'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a08075030 con 0x7f9a10014070 2024-05-08T18:50:48.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.988+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885170 con 0x5616b38812f0 2024-05-08T18:50:48.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.988+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(71 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:48.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.988+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885170 con 0x5616b387ca80 2024-05-08T18:50:48.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.988+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(72 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00043040 con 0x5616b387ca80 2024-05-08T18:50:48.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.988+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885170 con 0x7f9a08078060 2024-05-08T18:50:48.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.989+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(73 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00043040 con 0x7f9a08078060 2024-05-08T18:50:48.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.989+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f9a00048040 con 0x7f9a08078060 2024-05-08T18:50:48.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.989+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(74 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00043040 con 0x7f9a08078060 2024-05-08T18:50:48.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.989+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f9a00048040 con 0x5616b38812f0 2024-05-08T18:50:48.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.989+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(75 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:48.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.989+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f9a00048040 con 0x7f9a08078060 2024-05-08T18:50:48.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.989+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(76 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00043040 con 0x7f9a08078060 2024-05-08T18:50:48.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.989+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f9a00048040 con 0x7f9a08078060 2024-05-08T18:50:48.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.990+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(77 [pgnls start_epoch 25 out=127b] v25'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f9a00043040 con 0x7f9a08078060 2024-05-08T18:50:48.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.990+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f9a00048040 con 0x7f9a08078060 2024-05-08T18:50:48.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.990+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(78 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00043040 con 0x7f9a08078060 2024-05-08T18:50:48.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.990+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f9a00048040 con 0x5616b38812f0 2024-05-08T18:50:48.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.990+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(79 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:48.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.990+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f9a00048040 con 0x7f9a10014070 2024-05-08T18:50:48.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.990+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(80 [pgnls start_epoch 25 out=70b] v25'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f9a08075030 con 0x7f9a10014070 2024-05-08T18:50:48.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.990+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f9a00048040 con 0x5616b387ca80 2024-05-08T18:50:48.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.991+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(81 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00043040 con 0x5616b387ca80 2024-05-08T18:50:48.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.991+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f9a00048040 con 0x5616b387ca80 2024-05-08T18:50:48.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.991+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(82 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00043040 con 0x5616b387ca80 2024-05-08T18:50:48.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.991+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f9a00048040 con 0x5616b38812f0 2024-05-08T18:50:48.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.991+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(83 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:48.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.991+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f9a00048040 con 0x7f9a10014070 2024-05-08T18:50:48.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.991+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(84 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a08075030 con 0x7f9a10014070 2024-05-08T18:50:48.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.991+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f9a00048040 con 0x7f9a08078060 2024-05-08T18:50:48.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.992+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(85 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00043040 con 0x7f9a08078060 2024-05-08T18:50:48.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.992+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f9a00048040 con 0x5616b387ca80 2024-05-08T18:50:48.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.992+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(86 [pgnls start_epoch 25 out=49b] v25'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00043040 con 0x5616b387ca80 2024-05-08T18:50:48.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.992+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f9a00048040 con 0x7f9a08078060 2024-05-08T18:50:48.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.992+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(87 [pgnls start_epoch 25 out=49b] v25'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00043040 con 0x7f9a08078060 2024-05-08T18:50:48.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.992+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f9a00048040 con 0x5616b38812f0 2024-05-08T18:50:48.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.992+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(88 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:48.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.992+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f9a00048040 con 0x7f9a10014070 2024-05-08T18:50:48.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.993+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(89 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a08075030 con 0x7f9a10014070 2024-05-08T18:50:48.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.993+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f9a00048040 con 0x7f9a08078060 2024-05-08T18:50:48.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.993+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(90 [pgnls start_epoch 25 out=49b] v25'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00043040 con 0x7f9a08078060 2024-05-08T18:50:48.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.993+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f9a00048040 con 0x5616b387ca80 2024-05-08T18:50:48.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.993+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(91 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a00043040 con 0x5616b387ca80 2024-05-08T18:50:48.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.993+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f9a00048040 con 0x5616b38812f0 2024-05-08T18:50:48.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.993+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(92 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:48.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.993+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f9a00048040 con 0x7f9a10014070 2024-05-08T18:50:48.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.994+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(93 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a08075030 con 0x7f9a10014070 2024-05-08T18:50:48.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.994+0000 7f9a1af1f800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 2024-05-08T18:50:48.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.994+0000 7f9a1af1f800 20 RGWRados::pool_iterate: got myfoo 2024-05-08T18:50:48.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.995+0000 7f98cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:48.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.995+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94655501357088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b3884dd0 con 0x5616b387ca80 2024-05-08T18:50:48.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.996+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94655501357088] v25'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9a00043040 con 0x5616b387ca80 2024-05-08T18:50:48.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.996+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94655501331184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885170 con 0x7f9a10014070 2024-05-08T18:50:48.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.997+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94655501331184] v25'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a08075030 con 0x7f9a10014070 2024-05-08T18:50:48.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.997+0000 7f9a1af1f800 20 remove_watcher() i=0 2024-05-08T18:50:48.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.997+0000 7f9a1af1f800 2 removed watcher, disabling cache 2024-05-08T18:50:48.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.997+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94655501337856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885170 con 0x5616b387ca80 2024-05-08T18:50:48.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.998+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94655501337856] v25'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a00043040 con 0x5616b387ca80 2024-05-08T18:50:48.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.998+0000 7f9a1af1f800 20 remove_watcher() i=1 2024-05-08T18:50:48.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.998+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94655501339392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b3885170 con 0x5616b38812f0 2024-05-08T18:50:48.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.999+0000 7f9a173e1640 1 -- 172.21.15.132:0/2447313707 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94655501339392] v25'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a1005e040 con 0x5616b38812f0 2024-05-08T18:50:48.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.999+0000 7f9a1af1f800 20 remove_watcher() i=2 2024-05-08T18:50:48.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:47.999+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94655501343456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b3886af0 con 0x7f9a10014070 2024-05-08T18:50:48.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.000+0000 7f9a16be0640 1 -- 172.21.15.132:0/2447313707 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94655501343456] v25'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a08075030 con 0x7f9a10014070 2024-05-08T18:50:48.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.000+0000 7f9a1af1f800 20 remove_watcher() i=3 2024-05-08T18:50:48.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.000+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94655501347104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b3888500 con 0x5616b387ca80 2024-05-08T18:50:48.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.001+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.1 v2:172.21.15.132:6800/3697320277 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94655501347104] v25'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a00043040 con 0x5616b387ca80 2024-05-08T18:50:48.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.001+0000 7f9a1af1f800 20 remove_watcher() i=4 2024-05-08T18:50:48.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.001+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94655501350704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b3889ae0 con 0x7f9a08078060 2024-05-08T18:50:48.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.002+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94655501350704] v25'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a00043040 con 0x7f9a08078060 2024-05-08T18:50:48.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.002+0000 7f9a1af1f800 20 remove_watcher() i=5 2024-05-08T18:50:48.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.002+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94655501354800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b3889ae0 con 0x7f9a08078060 2024-05-08T18:50:48.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.003+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94655501354800] v25'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a00043040 con 0x7f9a08078060 2024-05-08T18:50:48.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.003+0000 7f9a1af1f800 20 remove_watcher() i=6 2024-05-08T18:50:48.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.003+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94655501340512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5616b3889ae0 con 0x7f9a08078060 2024-05-08T18:50:48.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.004+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94655501340512] v25'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a00043040 con 0x7f9a08078060 2024-05-08T18:50:48.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.004+0000 7f9a1af1f800 20 remove_watcher() i=7 2024-05-08T18:50:48.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.004+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f9a08078060 msgr2=0x7f9a0805b7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.004+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f9a08078060 0x7f9a0805b7a0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.004+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5616b387ca80 msgr2=0x5616b387ef20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.004+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5616b387ca80 0x5616b387ef20 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.004+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9a10014070 msgr2=0x7f9a10001890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.004+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9a10014070 0x7f9a10001890 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.004+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5616b38812f0 msgr2=0x5616b38836e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.004+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5616b38812f0 0x5616b38836e0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.004+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f98e003bba0 msgr2=0x7f98e003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.004+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f98e003bba0 0x7f98e003e060 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x5616b384b770 tx=0x7f9a08085000 comp rx=0 tx=0).stop 2024-05-08T18:50:48.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.004+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746330 msgr2=0x5616b3870d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.004+0000 7f9a0ffff640 1 -- 172.21.15.132:0/2447313707 reap_dead start 2024-05-08T18:50:48.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.004+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746330 0x5616b3870d90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9a100014b0 tx=0x7f9a10052be0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.004+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 shutdown_connections 2024-05-08T18:50:48.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.004+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/2447313707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746330 0x5616b3870d90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.004+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 >> 172.21.15.132:0/2447313707 conn(0x5616b3863970 msgr2=0x5616b3860fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.004+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 shutdown_connections 2024-05-08T18:50:48.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.004+0000 7f9a1af1f800 1 -- 172.21.15.132:0/2447313707 wait complete. 2024-05-08T18:50:48.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3608973242 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f98f003bb50 msgr2=0x7f98f003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/3608973242 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f98f003bb50 0x7f98f003e010 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x5616b3846a20 tx=0x7f9a080926f0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3608973242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b385a2f0 msgr2=0x5616b385a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/3608973242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b385a2f0 0x5616b385a710 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x5616b383fd00 tx=0x7f9a100188f0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3608973242 shutdown_connections 2024-05-08T18:50:48.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/3608973242 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f98f003bb50 0x7f98f003e010 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/3608973242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b385a2f0 0x5616b385a710 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3608973242 >> 172.21.15.132:0/3608973242 conn(0x5616b384e390 msgr2=0x5616b384e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3608973242 shutdown_connections 2024-05-08T18:50:48.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3608973242 wait complete. 2024-05-08T18:50:48.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3124003774 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5616b3749670 msgr2=0x5616b3846020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/3124003774 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5616b3749670 0x5616b3846020 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3124003774 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5616b38488e0 msgr2=0x5616b384acd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/3124003774 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5616b38488e0 0x5616b384acd0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3124003774 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f98fc03bb50 msgr2=0x7f98fc03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/3124003774 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f98fc03bb50 0x7f98fc03e010 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9a00000f60 tx=0x7f9a000010a0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3124003774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746d40 msgr2=0x5616b383ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/3124003774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746d40 0x5616b383ee80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9a0801baa0 tx=0x7f9a08003020 comp rx=0 tx=0).stop 2024-05-08T18:50:48.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3124003774 shutdown_connections 2024-05-08T18:50:48.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/3124003774 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5616b38488e0 0x5616b384acd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/3124003774 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5616b3749670 0x5616b3846020 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/3124003774 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f98fc03bb50 0x7f98fc03e010 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 --2- 172.21.15.132:0/3124003774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5616b3746d40 0x5616b383ee80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3124003774 >> 172.21.15.132:0/3124003774 conn(0x5616b3740690 msgr2=0x5616b38314e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3124003774 shutdown_connections 2024-05-08T18:50:48.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.005+0000 7f9a1af1f800 1 -- 172.21.15.132:0/3124003774 wait complete. 2024-05-08T18:50:48.022 INFO:teuthology.orchestra.run.smithi132.stdout:["myfoo"] 2024-05-08T18:50:48.023 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-05-08T18:50:48.033 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:50:48.043 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:50:48.052 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:50:48.098 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-05-08T18:50:48.125 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:50:48.151 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:50:48.177 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:50:48.178 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T18:50:48.178 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T18:50:48.178 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-05-08T18:50:48.222 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:48.222 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:48.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.223+0000 7f48d13af800 1 Processor -- start 2024-05-08T18:50:48.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.223+0000 7f48d13af800 1 -- start start 2024-05-08T18:50:48.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.223+0000 7f48d13af800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55e8e10575d0 0x55e8e10599c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.223+0000 7f48d13af800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e8e1059f90 con 0x55e8e1053140 2024-05-08T18:50:48.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.223+0000 7f48d13af800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55e8e0ef4e20 con 0x55e8e10575d0 2024-05-08T18:50:48.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.224+0000 7f48c7fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55e8e10575d0 0x55e8e10599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.224+0000 7f48c7fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55e8e10575d0 0x55e8e10599c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32782/0 (socket says 172.21.15.132:32782) 2024-05-08T18:50:48.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.224+0000 7f48c7fff640 1 -- 172.21.15.132:0/1189680656 learned_addr learned my addr 172.21.15.132:0/1189680656 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.224+0000 7f48ceeae640 1 --1- 172.21.15.132:0/1189680656 >> v1:172.21.15.42:6789/0 conn(0x55e8e1053140 0x55e8e1053560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46922/0 (socket says 172.21.15.132:46922) 2024-05-08T18:50:48.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.224+0000 7f48c7fff640 1 -- 172.21.15.132:0/1189680656 >> v1:172.21.15.42:6789/0 conn(0x55e8e1053140 legacy=0x55e8e1053560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.224+0000 7f48c7fff640 1 -- 172.21.15.132:0/1189680656 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8e105b1c0 con 0x55e8e10575d0 2024-05-08T18:50:48.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.226+0000 7f48c7fff640 1 --2- 172.21.15.132:0/1189680656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e10575d0 0x55e8e10599c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f48b800a520 tx=0x7f48b801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae1ef7902dbd9db server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.226+0000 7f48ce6ad640 1 -- 172.21.15.132:0/1189680656 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48b8057070 con 0x55e8e10575d0 2024-05-08T18:50:48.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.226+0000 7f48ce6ad640 1 -- 172.21.15.132:0/1189680656 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b8052570 con 0x55e8e10575d0 2024-05-08T18:50:48.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.226+0000 7f48ce6ad640 1 -- 172.21.15.132:0/1189680656 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48b804ae60 con 0x55e8e10575d0 2024-05-08T18:50:48.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.227+0000 7f48d13af800 1 -- 172.21.15.132:0/1189680656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e10575d0 msgr2=0x55e8e10599c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.227+0000 7f48d13af800 1 --2- 172.21.15.132:0/1189680656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e10575d0 0x55e8e10599c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f48b800a520 tx=0x7f48b801d010 comp rx=0 tx=0).stop 2024-05-08T18:50:48.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.227+0000 7f48d13af800 1 -- 172.21.15.132:0/1189680656 shutdown_connections 2024-05-08T18:50:48.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.227+0000 7f48d13af800 1 --2- 172.21.15.132:0/1189680656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e10575d0 0x55e8e10599c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.227+0000 7f48d13af800 1 -- 172.21.15.132:0/1189680656 >> 172.21.15.132:0/1189680656 conn(0x55e8e104e720 msgr2=0x55e8e1050b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.227+0000 7f48d13af800 1 -- 172.21.15.132:0/1189680656 shutdown_connections 2024-05-08T18:50:48.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.227+0000 7f48d13af800 1 -- 172.21.15.132:0/1189680656 wait complete. 2024-05-08T18:50:48.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.240+0000 7f48d13af800 1 Processor -- start 2024-05-08T18:50:48.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.240+0000 7f48d13af800 1 -- start start 2024-05-08T18:50:48.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.240+0000 7f48d13af800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1053140 0x55e8e0fc72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.240+0000 7f48d13af800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e8e0f9f5b0 con 0x55e8e1053140 2024-05-08T18:50:48.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.241+0000 7f48ceeae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1053140 0x55e8e0fc72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.241+0000 7f48ceeae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1053140 0x55e8e0fc72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32796/0 (socket says 172.21.15.132:32796) 2024-05-08T18:50:48.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.241+0000 7f48ceeae640 1 -- 172.21.15.132:0/2517161893 learned_addr learned my addr 172.21.15.132:0/2517161893 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.241+0000 7f48ceeae640 1 -- 172.21.15.132:0/2517161893 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8e1148310 con 0x55e8e1053140 2024-05-08T18:50:48.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.241+0000 7f48ceeae640 1 --2- 172.21.15.132:0/2517161893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1053140 0x55e8e0fc72c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f48c0001e40 tx=0x7f48c0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620dd9dbee7df8c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.241+0000 7f47bce09640 1 -- 172.21.15.132:0/2517161893 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c000e5c0 con 0x55e8e1053140 2024-05-08T18:50:48.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.241+0000 7f47bce09640 1 -- 172.21.15.132:0/2517161893 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c0006070 con 0x55e8e1053140 2024-05-08T18:50:48.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.241+0000 7f47bce09640 1 -- 172.21.15.132:0/2517161893 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c000e910 con 0x55e8e1053140 2024-05-08T18:50:48.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.242+0000 7f48d13af800 1 -- 172.21.15.132:0/2517161893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1053140 msgr2=0x55e8e0fc72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.242+0000 7f48d13af800 1 --2- 172.21.15.132:0/2517161893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1053140 0x55e8e0fc72c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f48c0001e40 tx=0x7f48c0001e70 comp rx=0 tx=0).stop 2024-05-08T18:50:48.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.242+0000 7f48d13af800 1 -- 172.21.15.132:0/2517161893 shutdown_connections 2024-05-08T18:50:48.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.242+0000 7f48d13af800 1 --2- 172.21.15.132:0/2517161893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1053140 0x55e8e0fc72c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.242+0000 7f48d13af800 1 -- 172.21.15.132:0/2517161893 >> 172.21.15.132:0/2517161893 conn(0x55e8e104e720 msgr2=0x55e8e113fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.242+0000 7f48d13af800 1 -- 172.21.15.132:0/2517161893 shutdown_connections 2024-05-08T18:50:48.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.242+0000 7f48d13af800 1 -- 172.21.15.132:0/2517161893 wait complete. 2024-05-08T18:50:48.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.242+0000 7f48d13af800 1 Processor -- start 2024-05-08T18:50:48.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.242+0000 7f48d13af800 1 -- start start 2024-05-08T18:50:48.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.243+0000 7f48d13af800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1053140 0x55e8e114d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.243+0000 7f48d13af800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e8e105a460 con 0x55e8e1053140 2024-05-08T18:50:48.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.243+0000 7f48ceeae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1053140 0x55e8e114d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.243+0000 7f48ceeae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1053140 0x55e8e114d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32810/0 (socket says 172.21.15.132:32810) 2024-05-08T18:50:48.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.243+0000 7f48ceeae640 1 -- 172.21.15.132:0/1955302740 learned_addr learned my addr 172.21.15.132:0/1955302740 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.243+0000 7f48ceeae640 1 -- 172.21.15.132:0/1955302740 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8e114d6a0 con 0x55e8e1053140 2024-05-08T18:50:48.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.243+0000 7f48ceeae640 1 --2- 172.21.15.132:0/1955302740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1053140 0x55e8e114d160 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f48c0000f60 tx=0x7f48c0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.243+0000 7f47bb606640 1 -- 172.21.15.132:0/1955302740 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c000f8d0 con 0x55e8e1053140 2024-05-08T18:50:48.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.243+0000 7f47bb606640 1 -- 172.21.15.132:0/1955302740 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c000fa70 con 0x55e8e1053140 2024-05-08T18:50:48.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.243+0000 7f47bb606640 1 -- 172.21.15.132:0/1955302740 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c000fd90 con 0x55e8e1053140 2024-05-08T18:50:48.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.243+0000 7f48d13af800 1 -- 172.21.15.132:0/1955302740 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8e114d930 con 0x55e8e1053140 2024-05-08T18:50:48.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.244+0000 7f48d13af800 1 -- 172.21.15.132:0/1955302740 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8e11505e0 con 0x55e8e1053140 2024-05-08T18:50:48.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.244+0000 7f47bb606640 1 -- 172.21.15.132:0/1955302740 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f48c0017070 con 0x55e8e1053140 2024-05-08T18:50:48.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.245+0000 7f47bb606640 1 --2- 172.21.15.132:0/1955302740 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f47b403bb00 0x7f47b403dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.245+0000 7f47bb606640 1 -- 172.21.15.132:0/1955302740 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f48c0015020 con 0x55e8e1053140 2024-05-08T18:50:48.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.245+0000 7f48c7fff640 1 --2- 172.21.15.132:0/1955302740 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f47b403bb00 0x7f47b403dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.245+0000 7f48d13af800 1 --2- 172.21.15.132:0/1955302740 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e8e10575d0 0x55e8e11543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.245+0000 7f48d13af800 1 -- 172.21.15.132:0/1955302740 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1154920 con 0x55e8e10575d0 2024-05-08T18:50:48.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.245+0000 7f48cf6af640 1 --2- 172.21.15.132:0/1955302740 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e8e10575d0 0x55e8e11543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.245+0000 7f48c7fff640 1 --2- 172.21.15.132:0/1955302740 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f47b403bb00 0x7f47b403dfc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f48b8054000 tx=0x7f48b804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.245+0000 7f48cf6af640 1 --2- 172.21.15.132:0/1955302740 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e8e10575d0 0x55e8e11543a0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.245+0000 7f48cf6af640 1 -- 172.21.15.132:0/1955302740 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48c800a4a0 con 0x55e8e10575d0 2024-05-08T18:50:48.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.246+0000 7f48d13af800 1 -- 172.21.15.132:0/1955302740 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1151970 con 0x55e8e10575d0 2024-05-08T18:50:48.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.246+0000 7f48cf6af640 1 -- 172.21.15.132:0/1955302740 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f48c800a4a0 con 0x55e8e10575d0 2024-05-08T18:50:48.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.246+0000 7f48d13af800 1 --2- 172.21.15.132:0/1955302740 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e8e1156c70 0x55e8e1159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.246+0000 7f48d13af800 1 -- 172.21.15.132:0/1955302740 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1159700 con 0x55e8e1156c70 2024-05-08T18:50:48.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.246+0000 7f48ceeae640 1 --2- 172.21.15.132:0/1955302740 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e8e1156c70 0x55e8e1159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.246+0000 7f48ceeae640 1 --2- 172.21.15.132:0/1955302740 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e8e1156c70 0x55e8e1159060 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.246+0000 7f48ceeae640 1 -- 172.21.15.132:0/1955302740 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f48c002e070 con 0x55e8e1156c70 2024-05-08T18:50:48.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.246+0000 7f48d13af800 1 -- 172.21.15.132:0/1955302740 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1155b10 con 0x55e8e10575d0 2024-05-08T18:50:48.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.247+0000 7f48cf6af640 1 -- 172.21.15.132:0/1955302740 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f48c800a4a0 con 0x55e8e10575d0 2024-05-08T18:50:48.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.247+0000 7f48d13af800 1 -- 172.21.15.132:0/1955302740 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1155fa0 con 0x55e8e10575d0 2024-05-08T18:50:48.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.247+0000 7f48cf6af640 1 -- 172.21.15.132:0/1955302740 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f48c800a4a0 con 0x55e8e10575d0 2024-05-08T18:50:48.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.247+0000 7f48d13af800 1 Processor -- start 2024-05-08T18:50:48.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.247+0000 7f48d13af800 1 -- start start 2024-05-08T18:50:48.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.247+0000 7f48d13af800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e11686d0 0x55e8e1168af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.247+0000 7f48d13af800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e8e0f45fc0 con 0x55e8e11686d0 2024-05-08T18:50:48.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.248+0000 7f48cf6af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e11686d0 0x55e8e1168af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.248+0000 7f48cf6af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e11686d0 0x55e8e1168af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32816/0 (socket says 172.21.15.132:32816) 2024-05-08T18:50:48.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.248+0000 7f48cf6af640 1 -- 172.21.15.132:0/1646202163 learned_addr learned my addr 172.21.15.132:0/1646202163 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.248+0000 7f48cf6af640 1 -- 172.21.15.132:0/1646202163 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8e1169030 con 0x55e8e11686d0 2024-05-08T18:50:48.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.248+0000 7f48cf6af640 1 --2- 172.21.15.132:0/1646202163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e11686d0 0x55e8e1168af0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x55e8e1154d20 tx=0x7f48c8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.248+0000 7f47b8e01640 1 -- 172.21.15.132:0/1646202163 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c8014450 con 0x55e8e11686d0 2024-05-08T18:50:48.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.248+0000 7f47b8e01640 1 -- 172.21.15.132:0/1646202163 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c8014610 con 0x55e8e11686d0 2024-05-08T18:50:48.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.248+0000 7f48d13af800 1 -- 172.21.15.132:0/1646202163 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8e1169aa0 con 0x55e8e11686d0 2024-05-08T18:50:48.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.248+0000 7f47b8e01640 1 -- 172.21.15.132:0/1646202163 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c8014930 con 0x55e8e11686d0 2024-05-08T18:50:48.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.248+0000 7f48d13af800 1 -- 172.21.15.132:0/1646202163 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8e1169fa0 con 0x55e8e11686d0 2024-05-08T18:50:48.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.249+0000 7f47b8e01640 1 -- 172.21.15.132:0/1646202163 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f48c8011040 con 0x55e8e11686d0 2024-05-08T18:50:48.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.249+0000 7f47b8e01640 1 --2- 172.21.15.132:0/1646202163 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f47a803bba0 0x7f47a803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.249+0000 7f47b8e01640 1 -- 172.21.15.132:0/1646202163 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f48c801e070 con 0x55e8e11686d0 2024-05-08T18:50:48.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.249+0000 7f48ceeae640 1 --2- 172.21.15.132:0/1646202163 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f47a803bba0 0x7f47a803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.250+0000 7f48d13af800 1 Processor -- start 2024-05-08T18:50:48.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.250+0000 7f48ceeae640 1 --2- 172.21.15.132:0/1646202163 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f47a803bba0 0x7f47a803e060 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55e8e1154d90 tx=0x7f48c0051800 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.250+0000 7f48d13af800 1 -- start start 2024-05-08T18:50:48.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.250+0000 7f48d13af800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1175950 0x55e8e1175d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.250+0000 7f48d13af800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e8e1148660 con 0x55e8e1175950 2024-05-08T18:50:48.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.250+0000 7f48cf6af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1175950 0x55e8e1175d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.250+0000 7f48cf6af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1175950 0x55e8e1175d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32824/0 (socket says 172.21.15.132:32824) 2024-05-08T18:50:48.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.250+0000 7f48cf6af640 1 -- 172.21.15.132:0/415110957 learned_addr learned my addr 172.21.15.132:0/415110957 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.250+0000 7f48cf6af640 1 -- 172.21.15.132:0/415110957 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8e1176340 con 0x55e8e1175950 2024-05-08T18:50:48.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.250+0000 7f48cf6af640 1 --2- 172.21.15.132:0/415110957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1175950 0x55e8e1175d70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f48c8052c80 tx=0x7f48c8052f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f085b38bf22a9a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.251+0000 7f47b27fc640 1 -- 172.21.15.132:0/415110957 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c8044020 con 0x55e8e1175950 2024-05-08T18:50:48.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.251+0000 7f47b27fc640 1 -- 172.21.15.132:0/415110957 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c8047070 con 0x55e8e1175950 2024-05-08T18:50:48.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.251+0000 7f47b27fc640 1 -- 172.21.15.132:0/415110957 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c8014c20 con 0x55e8e1175950 2024-05-08T18:50:48.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.251+0000 7f48d13af800 1 -- 172.21.15.132:0/415110957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1175950 msgr2=0x55e8e1175d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.251+0000 7f48d13af800 1 --2- 172.21.15.132:0/415110957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1175950 0x55e8e1175d70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f48c8052c80 tx=0x7f48c8052f00 comp rx=0 tx=0).stop 2024-05-08T18:50:48.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.251+0000 7f48d13af800 1 -- 172.21.15.132:0/415110957 shutdown_connections 2024-05-08T18:50:48.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.251+0000 7f48d13af800 1 --2- 172.21.15.132:0/415110957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1175950 0x55e8e1175d70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.251+0000 7f48d13af800 1 -- 172.21.15.132:0/415110957 >> 172.21.15.132:0/415110957 conn(0x55e8e1171cb0 msgr2=0x55e8e116fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.251+0000 7f48d13af800 1 -- 172.21.15.132:0/415110957 shutdown_connections 2024-05-08T18:50:48.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.251+0000 7f48d13af800 1 -- 172.21.15.132:0/415110957 wait complete. 2024-05-08T18:50:48.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.251+0000 7f48d13af800 1 Processor -- start 2024-05-08T18:50:48.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.251+0000 7f48d13af800 1 -- start start 2024-05-08T18:50:48.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.252+0000 7f48d13af800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1175950 0x55e8e117cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.252+0000 7f48d13af800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e8e1176ab0 con 0x55e8e1175950 2024-05-08T18:50:48.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.252+0000 7f48cf6af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1175950 0x55e8e117cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.252+0000 7f48cf6af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1175950 0x55e8e117cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32832/0 (socket says 172.21.15.132:32832) 2024-05-08T18:50:48.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.252+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 learned_addr learned my addr 172.21.15.132:0/164483828 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.252+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8e117d4d0 con 0x55e8e1175950 2024-05-08T18:50:48.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.252+0000 7f48cf6af640 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1175950 0x55e8e117cf90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f48c8051b70 tx=0x7f48c8052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.252+0000 7f47b0ff9640 1 -- 172.21.15.132:0/164483828 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c8040710 con 0x55e8e1175950 2024-05-08T18:50:48.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.252+0000 7f47b0ff9640 1 -- 172.21.15.132:0/164483828 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c80408b0 con 0x55e8e1175950 2024-05-08T18:50:48.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.252+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8e117d760 con 0x55e8e1175950 2024-05-08T18:50:48.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.252+0000 7f47b0ff9640 1 -- 172.21.15.132:0/164483828 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c8040b90 con 0x55e8e1175950 2024-05-08T18:50:48.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.252+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8e1180410 con 0x55e8e1175950 2024-05-08T18:50:48.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.253+0000 7f47b0ff9640 1 -- 172.21.15.132:0/164483828 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f48c8054810 con 0x55e8e1175950 2024-05-08T18:50:48.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.253+0000 7f47b0ff9640 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f479803bb50 0x7f479803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.253+0000 7f47b0ff9640 1 -- 172.21.15.132:0/164483828 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f48c800e040 con 0x55e8e1175950 2024-05-08T18:50:48.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.253+0000 7f48ceeae640 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f479803bb50 0x7f479803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.253+0000 7f48d13af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.254+0000 7f48d13af800 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e8e1188b70 0x55e8e118b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.254+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e118b780 con 0x55e8e1188b70 2024-05-08T18:50:48.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.254+0000 7f48c7fff640 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e8e1188b70 0x55e8e118b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.254+0000 7f48ceeae640 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f479803bb50 0x7f479803e010 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f48c0017d00 tx=0x7f48c0047000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.254+0000 7f48c7fff640 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e8e1188b70 0x55e8e118b030 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.254+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.254+0000 7f48d13af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.254+0000 7f48d13af800 20 realm 2024-05-08T18:50:48.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.254+0000 7f48d13af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.254+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e118bb50 con 0x55e8e1188b70 2024-05-08T18:50:48.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.254+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.254+0000 7f48d13af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.254+0000 7f48d13af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:48.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.254+0000 7f48d13af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.254+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e118c3f0 con 0x55e8e1188b70 2024-05-08T18:50:48.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.255+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.255+0000 7f48d13af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.255+0000 7f48d13af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.255+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e118c790 con 0x55e8e1188b70 2024-05-08T18:50:48.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.255+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.255+0000 7f48d13af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:48.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.255+0000 7f48d13af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.255+0000 7f48d13af800 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e8e118d4f0 0x55e8e118f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.255+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e118fe20 con 0x55e8e118d4f0 2024-05-08T18:50:48.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.255+0000 7f48cf6af640 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e8e118d4f0 0x55e8e118f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.255+0000 7f48cf6af640 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e8e118d4f0 0x55e8e118f8e0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.256+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f48c802a070 con 0x55e8e118d4f0 2024-05-08T18:50:48.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.256+0000 7f48d13af800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:48.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.256+0000 7f48d13af800 20 searching for the correct realm 2024-05-08T18:50:48.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.256+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x55e8e118d4f0 2024-05-08T18:50:48.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.256+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48c802a070 con 0x55e8e118d4f0 2024-05-08T18:50:48.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.256+0000 7f48cf6af640 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f48c8014070 0x7f48c8044020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.256+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x7f48c8014070 2024-05-08T18:50:48.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.256+0000 7f48ceeae640 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f48c8014070 0x7f48c8044020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.257+0000 7f48ceeae640 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f48c8014070 0x7f48c8044020 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.257+0000 7f48ceeae640 1 -- 172.21.15.132:0/164483828 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48c002e070 con 0x7f48c8014070 2024-05-08T18:50:48.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.257+0000 7f48ceeae640 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f48c003d040 0x7f48c004a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.257+0000 7f48ceeae640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x7f48c003d040 2024-05-08T18:50:48.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.257+0000 7f48c7fff640 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f48c003d040 0x7f48c004a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.258+0000 7f48c7fff640 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f48c003d040 0x7f48c004a740 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.258+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b805a040 con 0x7f48c003d040 2024-05-08T18:50:48.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.258+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x55e8e1188b70 2024-05-08T18:50:48.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.258+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.258+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x55e8e1188b70 2024-05-08T18:50:48.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.258+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.258+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x7f48c003d040 2024-05-08T18:50:48.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.259+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b805a040 con 0x7f48c003d040 2024-05-08T18:50:48.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.259+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x7f48c003d040 2024-05-08T18:50:48.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.259+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b805a040 con 0x7f48c003d040 2024-05-08T18:50:48.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.259+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x7f48c8014070 2024-05-08T18:50:48.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.259+0000 7f48ceeae640 1 -- 172.21.15.132:0/164483828 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48c002e070 con 0x7f48c8014070 2024-05-08T18:50:48.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.259+0000 7f48ceeae640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x55e8e118d4f0 2024-05-08T18:50:48.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.259+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48c802a070 con 0x55e8e118d4f0 2024-05-08T18:50:48.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.259+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x55e8e1188b70 2024-05-08T18:50:48.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.260+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.260+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x7f48c003d040 2024-05-08T18:50:48.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.260+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b805a040 con 0x7f48c003d040 2024-05-08T18:50:48.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.260+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x55e8e1188b70 2024-05-08T18:50:48.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.260+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.260+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x7f48c8014070 2024-05-08T18:50:48.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.260+0000 7f48ceeae640 1 -- 172.21.15.132:0/164483828 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f48c002e070 con 0x7f48c8014070 2024-05-08T18:50:48.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.260+0000 7f48ceeae640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x55e8e118d4f0 2024-05-08T18:50:48.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.260+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f48c802a070 con 0x55e8e118d4f0 2024-05-08T18:50:48.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.261+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x55e8e118d4f0 2024-05-08T18:50:48.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.261+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48c802a070 con 0x55e8e118d4f0 2024-05-08T18:50:48.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.261+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x7f48c003d040 2024-05-08T18:50:48.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.261+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b805a040 con 0x7f48c003d040 2024-05-08T18:50:48.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.261+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x55e8e118d4f0 2024-05-08T18:50:48.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.261+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48c802a070 con 0x55e8e118d4f0 2024-05-08T18:50:48.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.261+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x55e8e118d4f0 2024-05-08T18:50:48.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.261+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48c802a070 con 0x55e8e118d4f0 2024-05-08T18:50:48.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.261+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x55e8e1188b70 2024-05-08T18:50:48.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.262+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.262+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x55e8e1188b70 2024-05-08T18:50:48.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.262+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.262+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x7f48c003d040 2024-05-08T18:50:48.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.262+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b805a040 con 0x7f48c003d040 2024-05-08T18:50:48.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.262+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x55e8e118d4f0 2024-05-08T18:50:48.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.263+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48c802a070 con 0x55e8e118d4f0 2024-05-08T18:50:48.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.263+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x7f48c8014070 2024-05-08T18:50:48.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.263+0000 7f48ceeae640 1 -- 172.21.15.132:0/164483828 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48c002e070 con 0x7f48c8014070 2024-05-08T18:50:48.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.263+0000 7f48ceeae640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x55e8e1188b70 2024-05-08T18:50:48.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.263+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.263+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x7f48c003d040 2024-05-08T18:50:48.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.263+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b805a040 con 0x7f48c003d040 2024-05-08T18:50:48.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.263+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x55e8e118d4f0 2024-05-08T18:50:48.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.264+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48c802a070 con 0x55e8e118d4f0 2024-05-08T18:50:48.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.264+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x7f48c003d040 2024-05-08T18:50:48.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.264+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b805a040 con 0x7f48c003d040 2024-05-08T18:50:48.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.264+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x7f48c8014070 2024-05-08T18:50:48.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.264+0000 7f48ceeae640 1 -- 172.21.15.132:0/164483828 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48c002e070 con 0x7f48c8014070 2024-05-08T18:50:48.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.264+0000 7f48ceeae640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x55e8e118d4f0 2024-05-08T18:50:48.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.264+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48c802a070 con 0x55e8e118d4f0 2024-05-08T18:50:48.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.265+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x7f48c003d040 2024-05-08T18:50:48.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.265+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48b805a040 con 0x7f48c003d040 2024-05-08T18:50:48.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.265+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x55e8e1188b70 2024-05-08T18:50:48.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.265+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.265+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11917a0 con 0x7f48c8014070 2024-05-08T18:50:48.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48ceeae640 1 -- 172.21.15.132:0/164483828 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48c002e070 con 0x7f48c8014070 2024-05-08T18:50:48.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:48.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:48.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:48.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:48.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:48.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:48.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1190870 con 0x55e8e1188b70 2024-05-08T18:50:48.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1191110 con 0x55e8e1188b70 2024-05-08T18:50:48.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:48.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1191c70 con 0x55e8e1188b70 2024-05-08T18:50:48.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:48.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 20 zone default found 2024-05-08T18:50:48.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 4 Realm: () 2024-05-08T18:50:48.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:48.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:48.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:48.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 20 zonegroup default 2024-05-08T18:50:48.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.266+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1192010 con 0x7f48c003d040 2024-05-08T18:50:48.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.267+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f48b805a040 con 0x7f48c003d040 2024-05-08T18:50:48.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.267+0000 7f48d13af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.267+0000 7f48d13af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.267+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1190d50 con 0x55e8e118d4f0 2024-05-08T18:50:48.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.267+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f48c802a070 con 0x55e8e118d4f0 2024-05-08T18:50:48.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.267+0000 7f48d13af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.267+0000 7f48d13af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.267+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1194030 con 0x55e8e118d4f0 2024-05-08T18:50:48.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.267+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f48c802a070 con 0x55e8e118d4f0 2024-05-08T18:50:48.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.267+0000 7f48d13af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.267+0000 7f48d13af800 20 started sync module instance, tier type = 2024-05-08T18:50:48.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.267+0000 7f48d13af800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:48.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.267+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1192e90 con 0x7f48c8014070 2024-05-08T18:50:48.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.268+0000 7f48ceeae640 1 -- 172.21.15.132:0/164483828 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48c002e070 con 0x7f48c8014070 2024-05-08T18:50:48.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.268+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94458697298560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1194940 con 0x7f48c8014070 2024-05-08T18:50:48.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.268+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1195190 con 0x55e8e1188b70 2024-05-08T18:50:48.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.269+0000 7f48ceeae640 1 -- 172.21.15.132:0/164483828 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94458697298560] v25'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48c002e070 con 0x7f48c8014070 2024-05-08T18:50:48.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.269+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.270+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94458697303184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1195210 con 0x55e8e1188b70 2024-05-08T18:50:48.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.270+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1195d30 con 0x55e8e118d4f0 2024-05-08T18:50:48.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.271+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48c802a070 con 0x55e8e118d4f0 2024-05-08T18:50:48.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.271+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94458697308160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1195cf0 con 0x55e8e118d4f0 2024-05-08T18:50:48.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.271+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1196cf0 con 0x7f48c8014070 2024-05-08T18:50:48.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.271+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94458697303184] v25'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.272+0000 7f48ceeae640 1 -- 172.21.15.132:0/164483828 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48c002e070 con 0x7f48c8014070 2024-05-08T18:50:48.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.272+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94458697312288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1197090 con 0x7f48c8014070 2024-05-08T18:50:48.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.272+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94458697308160] v25'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48c802a070 con 0x55e8e118d4f0 2024-05-08T18:50:48.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.272+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1196120 con 0x55e8e1188b70 2024-05-08T18:50:48.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.273+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.273+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94458697315840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1197ed0 con 0x55e8e1188b70 2024-05-08T18:50:48.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.273+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1198910 con 0x7f48c003d040 2024-05-08T18:50:48.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.273+0000 7f48ceeae640 1 -- 172.21.15.132:0/164483828 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94458697312288] v25'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48c002e070 con 0x7f48c8014070 2024-05-08T18:50:48.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.274+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94458697315840] v25'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.274+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b805a040 con 0x7f48c003d040 2024-05-08T18:50:48.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.274+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94458697319392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1197a20 con 0x7f48c003d040 2024-05-08T18:50:48.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.274+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11991b0 con 0x7f48c003d040 2024-05-08T18:50:48.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.275+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94458697319392] v25'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b805a040 con 0x7f48c003d040 2024-05-08T18:50:48.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.275+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b805a040 con 0x7f48c003d040 2024-05-08T18:50:48.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.275+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94458697305312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1197a20 con 0x7f48c003d040 2024-05-08T18:50:48.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.275+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11997d0 con 0x7f48c003d040 2024-05-08T18:50:48.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.276+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94458697305312] v25'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b805a040 con 0x7f48c003d040 2024-05-08T18:50:48.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.276+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b805a040 con 0x7f48c003d040 2024-05-08T18:50:48.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.276+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94458697321600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11997d0 con 0x7f48c003d040 2024-05-08T18:50:48.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.276+0000 7f48d13af800 20 add_watcher() i=0 2024-05-08T18:50:48.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.276+0000 7f48d13af800 20 add_watcher() i=1 2024-05-08T18:50:48.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.276+0000 7f48d13af800 20 add_watcher() i=2 2024-05-08T18:50:48.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.276+0000 7f48d13af800 20 add_watcher() i=3 2024-05-08T18:50:48.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.276+0000 7f48d13af800 20 add_watcher() i=4 2024-05-08T18:50:48.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.276+0000 7f48d13af800 20 add_watcher() i=5 2024-05-08T18:50:48.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.276+0000 7f48d13af800 20 add_watcher() i=6 2024-05-08T18:50:48.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.277+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94458697321600] v25'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b805a040 con 0x7f48c003d040 2024-05-08T18:50:48.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.277+0000 7f48d13af800 20 add_watcher() i=7 2024-05-08T18:50:48.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.277+0000 7f48d13af800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:48.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.277+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e119caf0 con 0x55e8e1188b70 2024-05-08T18:50:48.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.277+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.277+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94458697323664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1199d60 con 0x55e8e1188b70 2024-05-08T18:50:48.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.278+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94458697323664] v25'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.279+0000 7f47857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:48.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.279+0000 7f48d13af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:48.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.279+0000 7f48d13af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:48.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.279+0000 7f48d13af800 5 note: GC not initialized 2024-05-08T18:50:48.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.279+0000 7f46fffff640 20 reqs_thread_entry: start 2024-05-08T18:50:48.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.279+0000 7f48d13af800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:48.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.279+0000 7f48d13af800 20 Filter name: none 2024-05-08T18:50:48.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.279+0000 7f46fdffb640 20 reqs_thread_entry: start 2024-05-08T18:50:48.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.279+0000 7f48d13af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.279+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11cff90 con 0x7f48c8014070 2024-05-08T18:50:48.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.280+0000 7f48ceeae640 1 -- 172.21.15.132:0/164483828 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f48c002e070 con 0x7f48c8014070 2024-05-08T18:50:48.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.280+0000 7f48d13af800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:50:48.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.280+0000 7f48d13af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.280+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 8.1e 8:7ec7f916:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11d0b40 con 0x7f48c003d040 2024-05-08T18:50:48.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.280+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(63 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f48b805a040 con 0x7f48c003d040 2024-05-08T18:50:48.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.280+0000 7f48d13af800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:50:48.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.280+0000 7f48d13af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:50:48.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.280+0000 7f48d13af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.280+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11d0b80 con 0x7f48c8014070 2024-05-08T18:50:48.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.281+0000 7f48ceeae640 1 -- 172.21.15.132:0/164483828 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f48c002e070 con 0x7f48c8014070 2024-05-08T18:50:48.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.281+0000 7f48d13af800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:50:48.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.281+0000 7f48d13af800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.281+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:65 8.1e 8:7ec7f916:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11d2320 con 0x7f48c003d040 2024-05-08T18:50:48.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.281+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(65 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f48b805a040 con 0x7f48c003d040 2024-05-08T18:50:48.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.281+0000 7f48d13af800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:50:48.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.281+0000 7f48d13af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:50:48.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.281+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:66 4.3d 4:beedfbf8:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11d1910 con 0x55e8e118d4f0 2024-05-08T18:50:48.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.281+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 4.0 4:01e493d7:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11d6e90 con 0x55e8e118d4f0 2024-05-08T18:50:48.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.281+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:68 4.3a 4:5c1a59ec:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11d9880 con 0x55e8e118d4f0 2024-05-08T18:50:48.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.281+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 4.4 4:2155dbb4:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11dc240 con 0x7f48c003d040 2024-05-08T18:50:48.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.281+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:70 4.30 4:0edbbef1:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11d9880 con 0x55e8e118d4f0 2024-05-08T18:50:48.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.281+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 4.2 4:435b253f:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11e10e0 con 0x55e8e1188b70 2024-05-08T18:50:48.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.281+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 4.2a 4:56da7a03:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11e3b10 con 0x55e8e1188b70 2024-05-08T18:50:48.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.281+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:73 4.29 4:96c53c8a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11e3b10 con 0x55e8e118d4f0 2024-05-08T18:50:48.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.282+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 4.1a 4:5ae0f416:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11e8a80 con 0x7f48c8014070 2024-05-08T18:50:48.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.282+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(69 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f48b805a040 con 0x7f48c003d040 2024-05-08T18:50:48.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.282+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(66 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f48c802a070 con 0x55e8e118d4f0 2024-05-08T18:50:48.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.282+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f48c802a070 con 0x55e8e118d4f0 2024-05-08T18:50:48.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.282+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(68 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f48c802a070 con 0x55e8e118d4f0 2024-05-08T18:50:48.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.282+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(70 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f48c802a070 con 0x55e8e118d4f0 2024-05-08T18:50:48.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.282+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(71 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.282+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:75 4.c 4:33d05922:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11d7230 con 0x55e8e1188b70 2024-05-08T18:50:48.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.282+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(73 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f48c802a070 con 0x55e8e118d4f0 2024-05-08T18:50:48.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.282+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:76 4.13 4:cba0e3e9:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11dcba0 con 0x7f48c8014070 2024-05-08T18:50:48.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.282+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(72 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.282+0000 7f48ceeae640 1 -- 172.21.15.132:0/164483828 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(74 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f48c002e070 con 0x7f48c8014070 2024-05-08T18:50:48.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.282+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(75 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.282+0000 7f48ceeae640 1 -- 172.21.15.132:0/164483828 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(76 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f48c002e070 con 0x7f48c8014070 2024-05-08T18:50:48.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.283+0000 7f47857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:48.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.283+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94458697323664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e11ce140 con 0x55e8e1188b70 2024-05-08T18:50:48.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.284+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94458697323664] v25'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.284+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94458697298560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1199490 con 0x7f48c8014070 2024-05-08T18:50:48.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.285+0000 7f48ceeae640 1 -- 172.21.15.132:0/164483828 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94458697298560] v25'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48c002e070 con 0x7f48c8014070 2024-05-08T18:50:48.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.285+0000 7f48d13af800 20 remove_watcher() i=0 2024-05-08T18:50:48.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.285+0000 7f48d13af800 2 removed watcher, disabling cache 2024-05-08T18:50:48.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.285+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94458697303184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1199490 con 0x55e8e1188b70 2024-05-08T18:50:48.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.286+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94458697303184] v25'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.286+0000 7f48d13af800 20 remove_watcher() i=1 2024-05-08T18:50:48.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.286+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94458697308160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1194490 con 0x55e8e118d4f0 2024-05-08T18:50:48.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.287+0000 7f48cf6af640 1 -- 172.21.15.132:0/164483828 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94458697308160] v25'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48c802a070 con 0x55e8e118d4f0 2024-05-08T18:50:48.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.287+0000 7f48d13af800 20 remove_watcher() i=2 2024-05-08T18:50:48.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.287+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94458697312288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1199490 con 0x7f48c8014070 2024-05-08T18:50:48.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.288+0000 7f48ceeae640 1 -- 172.21.15.132:0/164483828 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94458697312288] v25'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48c002e070 con 0x7f48c8014070 2024-05-08T18:50:48.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.288+0000 7f48d13af800 20 remove_watcher() i=3 2024-05-08T18:50:48.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.288+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94458697315840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1196820 con 0x55e8e1188b70 2024-05-08T18:50:48.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.289+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94458697315840] v25'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b805a040 con 0x55e8e1188b70 2024-05-08T18:50:48.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.289+0000 7f48d13af800 20 remove_watcher() i=4 2024-05-08T18:50:48.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.289+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94458697319392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1199490 con 0x7f48c003d040 2024-05-08T18:50:48.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.290+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94458697319392] v25'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b805a040 con 0x7f48c003d040 2024-05-08T18:50:48.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.290+0000 7f48d13af800 20 remove_watcher() i=5 2024-05-08T18:50:48.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.290+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94458697305312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1197600 con 0x7f48c003d040 2024-05-08T18:50:48.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.291+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94458697305312] v25'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b805a040 con 0x7f48c003d040 2024-05-08T18:50:48.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.291+0000 7f48d13af800 20 remove_watcher() i=6 2024-05-08T18:50:48.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.291+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94458697321600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8e1196820 con 0x7f48c003d040 2024-05-08T18:50:48.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.292+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94458697321600] v25'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48b805a040 con 0x7f48c003d040 2024-05-08T18:50:48.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.292+0000 7f48d13af800 20 remove_watcher() i=7 2024-05-08T18:50:48.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.292+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f48c003d040 msgr2=0x7f48c004a740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.292+0000 7f48d13af800 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f48c003d040 0x7f48c004a740 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.292+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e8e1188b70 msgr2=0x55e8e118b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.292+0000 7f48d13af800 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e8e1188b70 0x55e8e118b030 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.292+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f48c8014070 msgr2=0x7f48c8044020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.292+0000 7f48d13af800 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f48c8014070 0x7f48c8044020 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.292+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e8e118d4f0 msgr2=0x55e8e118f8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.292+0000 7f48d13af800 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e8e118d4f0 0x55e8e118f8e0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.292+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f479803bb50 msgr2=0x7f479803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.292+0000 7f48d13af800 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f479803bb50 0x7f479803e010 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f48c0017d00 tx=0x7f48c0047000 comp rx=0 tx=0).stop 2024-05-08T18:50:48.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.292+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1175950 msgr2=0x55e8e117cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.292+0000 7f48c7fff640 1 -- 172.21.15.132:0/164483828 reap_dead start 2024-05-08T18:50:48.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.292+0000 7f48d13af800 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1175950 0x55e8e117cf90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f48c8051b70 tx=0x7f48c8052be0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.292+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 shutdown_connections 2024-05-08T18:50:48.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.292+0000 7f48d13af800 1 --2- 172.21.15.132:0/164483828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1175950 0x55e8e117cf90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.292+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 >> 172.21.15.132:0/164483828 conn(0x55e8e1171cb0 msgr2=0x55e8e116f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.292+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 shutdown_connections 2024-05-08T18:50:48.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 -- 172.21.15.132:0/164483828 wait complete. 2024-05-08T18:50:48.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 -- 172.21.15.132:0/1646202163 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f47a803bba0 msgr2=0x7f47a803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 --2- 172.21.15.132:0/1646202163 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f47a803bba0 0x7f47a803e060 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55e8e1154d90 tx=0x7f48c0051800 comp rx=0 tx=0).stop 2024-05-08T18:50:48.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 -- 172.21.15.132:0/1646202163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e11686d0 msgr2=0x55e8e1168af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 --2- 172.21.15.132:0/1646202163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e11686d0 0x55e8e1168af0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x55e8e1154d20 tx=0x7f48c8018830 comp rx=0 tx=0).stop 2024-05-08T18:50:48.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 -- 172.21.15.132:0/1646202163 shutdown_connections 2024-05-08T18:50:48.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 --2- 172.21.15.132:0/1646202163 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f47a803bba0 0x7f47a803e060 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 --2- 172.21.15.132:0/1646202163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e11686d0 0x55e8e1168af0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 -- 172.21.15.132:0/1646202163 >> 172.21.15.132:0/1646202163 conn(0x55e8e115c770 msgr2=0x55e8e115cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 -- 172.21.15.132:0/1646202163 shutdown_connections 2024-05-08T18:50:48.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 -- 172.21.15.132:0/1646202163 wait complete. 2024-05-08T18:50:48.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 -- 172.21.15.132:0/1955302740 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e8e10575d0 msgr2=0x55e8e11543a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 --2- 172.21.15.132:0/1955302740 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e8e10575d0 0x55e8e11543a0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 -- 172.21.15.132:0/1955302740 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e8e1156c70 msgr2=0x55e8e1159060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 --2- 172.21.15.132:0/1955302740 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e8e1156c70 0x55e8e1159060 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 -- 172.21.15.132:0/1955302740 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f47b403bb00 msgr2=0x7f47b403dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 --2- 172.21.15.132:0/1955302740 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f47b403bb00 0x7f47b403dfc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f48b8054000 tx=0x7f48b804e000 comp rx=0 tx=0).stop 2024-05-08T18:50:48.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 -- 172.21.15.132:0/1955302740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1053140 msgr2=0x55e8e114d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 --2- 172.21.15.132:0/1955302740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1053140 0x55e8e114d160 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f48c0000f60 tx=0x7f48c0000bc0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 -- 172.21.15.132:0/1955302740 shutdown_connections 2024-05-08T18:50:48.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 --2- 172.21.15.132:0/1955302740 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e8e1156c70 0x55e8e1159060 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 --2- 172.21.15.132:0/1955302740 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e8e10575d0 0x55e8e11543a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 --2- 172.21.15.132:0/1955302740 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f47b403bb00 0x7f47b403dfc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 --2- 172.21.15.132:0/1955302740 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8e1053140 0x55e8e114d160 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 -- 172.21.15.132:0/1955302740 >> 172.21.15.132:0/1955302740 conn(0x55e8e104e720 msgr2=0x55e8e113e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 -- 172.21.15.132:0/1955302740 shutdown_connections 2024-05-08T18:50:48.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.293+0000 7f48d13af800 1 -- 172.21.15.132:0/1955302740 wait complete. 2024-05-08T18:50:48.305 INFO:teuthology.orchestra.run.smithi132.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"23dcc2a0-b283-45fd-8c01-831457a34b43","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1","marker":"bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-08T18:50:47.730445Z","creation_time":"2024-05-08T18:50:47.727613Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-05-08T18:50:48.306 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '23dcc2a0-b283-45fd-8c01-831457a34b43', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1', 'marker': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:50:47.730445Z', 'creation_time': '2024-05-08T18:50:47.727613Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T18:50:48.306 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-05-08T18:50:48.306 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-05-08T18:50:48.306 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-05-08T18:50:48.351 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:48.352 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:48.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.353+0000 7f1d6c93f800 1 Processor -- start 2024-05-08T18:50:48.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.353+0000 7f1d6c93f800 1 -- start start 2024-05-08T18:50:48.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.353+0000 7f1d6c93f800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5601e2bc32b0 0x5601e2bc36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.353+0000 7f1d6c93f800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5601e2bc3d50 con 0x5601e2bc4470 2024-05-08T18:50:48.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.353+0000 7f1d6c93f800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x5601e2a63e20 con 0x5601e2bc32b0 2024-05-08T18:50:48.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.354+0000 7f1d68694640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5601e2bc32b0 0x5601e2bc36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.354+0000 7f1d68694640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5601e2bc32b0 0x5601e2bc36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32842/0 (socket says 172.21.15.132:32842) 2024-05-08T18:50:48.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.354+0000 7f1d68694640 1 -- 172.21.15.132:0/3258746385 learned_addr learned my addr 172.21.15.132:0/3258746385 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.354+0000 7f1d68694640 1 -- 172.21.15.132:0/3258746385 >> v1:172.21.15.42:6789/0 conn(0x5601e2bc4470 legacy=0x5601e2bc48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.354+0000 7f1d68694640 1 -- 172.21.15.132:0/3258746385 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601e2bc5030 con 0x5601e2bc32b0 2024-05-08T18:50:48.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.356+0000 7f1d68694640 1 --2- 172.21.15.132:0/3258746385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2bc32b0 0x5601e2bc36d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1d5800a520 tx=0x7f1d5801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0281230ccefbeb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.356+0000 7f1d67e93640 1 -- 172.21.15.132:0/3258746385 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d58057070 con 0x5601e2bc32b0 2024-05-08T18:50:48.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.356+0000 7f1d67e93640 1 -- 172.21.15.132:0/3258746385 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d58052570 con 0x5601e2bc32b0 2024-05-08T18:50:48.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.356+0000 7f1d67e93640 1 -- 172.21.15.132:0/3258746385 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d58052870 con 0x5601e2bc32b0 2024-05-08T18:50:48.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.356+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3258746385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2bc32b0 msgr2=0x5601e2bc36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.356+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/3258746385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2bc32b0 0x5601e2bc36d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1d5800a520 tx=0x7f1d5801d010 comp rx=0 tx=0).stop 2024-05-08T18:50:48.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.356+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3258746385 shutdown_connections 2024-05-08T18:50:48.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.356+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/3258746385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2bc32b0 0x5601e2bc36d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.356+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3258746385 >> 172.21.15.132:0/3258746385 conn(0x5601e2bbe830 msgr2=0x5601e2bc0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.356+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3258746385 shutdown_connections 2024-05-08T18:50:48.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.356+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3258746385 wait complete. 2024-05-08T18:50:48.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.370+0000 7f1d6c93f800 1 Processor -- start 2024-05-08T18:50:48.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.370+0000 7f1d6c93f800 1 -- start start 2024-05-08T18:50:48.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.370+0000 7f1d6c93f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2bc32b0 0x5601e2cb4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.370+0000 7f1d6c93f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5601e2b0e5b0 con 0x5601e2bc32b0 2024-05-08T18:50:48.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.370+0000 7f1d68694640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2bc32b0 0x5601e2cb4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.370+0000 7f1d68694640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2bc32b0 0x5601e2cb4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32858/0 (socket says 172.21.15.132:32858) 2024-05-08T18:50:48.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.370+0000 7f1d68694640 1 -- 172.21.15.132:0/3604796451 learned_addr learned my addr 172.21.15.132:0/3604796451 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.371+0000 7f1d68694640 1 -- 172.21.15.132:0/3604796451 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601e2cb4ce0 con 0x5601e2bc32b0 2024-05-08T18:50:48.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.371+0000 7f1d68694640 1 --2- 172.21.15.132:0/3604796451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2bc32b0 0x5601e2cb4710 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1d5801d050 tx=0x7f1d5804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b779339f8e7653fe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.371+0000 7f1c5660c640 1 -- 172.21.15.132:0/3604796451 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d58057040 con 0x5601e2bc32b0 2024-05-08T18:50:48.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.371+0000 7f1c5660c640 1 -- 172.21.15.132:0/3604796451 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d58052850 con 0x5601e2bc32b0 2024-05-08T18:50:48.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.371+0000 7f1c5660c640 1 -- 172.21.15.132:0/3604796451 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d58052b70 con 0x5601e2bc32b0 2024-05-08T18:50:48.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.372+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3604796451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2bc32b0 msgr2=0x5601e2cb4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.372+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/3604796451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2bc32b0 0x5601e2cb4710 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1d5801d050 tx=0x7f1d5804c000 comp rx=0 tx=0).stop 2024-05-08T18:50:48.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.372+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3604796451 shutdown_connections 2024-05-08T18:50:48.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.372+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/3604796451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2bc32b0 0x5601e2cb4710 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.372+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3604796451 >> 172.21.15.132:0/3604796451 conn(0x5601e2bbe830 msgr2=0x5601e2cb0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.372+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3604796451 shutdown_connections 2024-05-08T18:50:48.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.372+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3604796451 wait complete. 2024-05-08T18:50:48.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.372+0000 7f1d6c93f800 1 Processor -- start 2024-05-08T18:50:48.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.372+0000 7f1d6c93f800 1 -- start start 2024-05-08T18:50:48.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.372+0000 7f1d6c93f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2bc32b0 0x5601e2cbc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.372+0000 7f1d6c93f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5601e2bcc940 con 0x5601e2bc32b0 2024-05-08T18:50:48.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.373+0000 7f1d68694640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2bc32b0 0x5601e2cbc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.373+0000 7f1d68694640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2bc32b0 0x5601e2cbc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32874/0 (socket says 172.21.15.132:32874) 2024-05-08T18:50:48.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.373+0000 7f1d68694640 1 -- 172.21.15.132:0/1012082150 learned_addr learned my addr 172.21.15.132:0/1012082150 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.373+0000 7f1d68694640 1 -- 172.21.15.132:0/1012082150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601e2cbc610 con 0x5601e2bc32b0 2024-05-08T18:50:48.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.373+0000 7f1d68694640 1 --2- 172.21.15.132:0/1012082150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2bc32b0 0x5601e2cbc0d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1d5801d050 tx=0x7f1d58003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.374+0000 7f1c54e09640 1 -- 172.21.15.132:0/1012082150 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d58073070 con 0x5601e2bc32b0 2024-05-08T18:50:48.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.374+0000 7f1d6c93f800 1 -- 172.21.15.132:0/1012082150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601e2cbc8a0 con 0x5601e2bc32b0 2024-05-08T18:50:48.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.374+0000 7f1c54e09640 1 -- 172.21.15.132:0/1012082150 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d5805d650 con 0x5601e2bc32b0 2024-05-08T18:50:48.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.374+0000 7f1d6c93f800 1 -- 172.21.15.132:0/1012082150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601e2cbf550 con 0x5601e2bc32b0 2024-05-08T18:50:48.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.374+0000 7f1c54e09640 1 -- 172.21.15.132:0/1012082150 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d58057070 con 0x5601e2bc32b0 2024-05-08T18:50:48.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.375+0000 7f1c54e09640 1 -- 172.21.15.132:0/1012082150 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1d58076070 con 0x5601e2bc32b0 2024-05-08T18:50:48.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.375+0000 7f1c54e09640 1 --2- 172.21.15.132:0/1012082150 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c5003bba0 0x7f1c5003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.375+0000 7f1c54e09640 1 -- 172.21.15.132:0/1012082150 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f1d58094080 con 0x5601e2bc32b0 2024-05-08T18:50:48.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.375+0000 7f1d5ffff640 1 --2- 172.21.15.132:0/1012082150 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c5003bba0 0x7f1c5003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.375+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/1012082150 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5601e2bc4470 0x5601e2cc3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.375+0000 7f1d6c93f800 1 -- 172.21.15.132:0/1012082150 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2cc3890 con 0x5601e2bc4470 2024-05-08T18:50:48.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.375+0000 7f1d68e95640 1 --2- 172.21.15.132:0/1012082150 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5601e2bc4470 0x5601e2cc3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.375+0000 7f1d5ffff640 1 --2- 172.21.15.132:0/1012082150 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c5003bba0 0x7f1c5003e060 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1d50001e10 tx=0x7f1d50001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.376+0000 7f1d68e95640 1 --2- 172.21.15.132:0/1012082150 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5601e2bc4470 0x5601e2cc3310 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.376+0000 7f1d68e95640 1 -- 172.21.15.132:0/1012082150 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d6000a4a0 con 0x5601e2bc4470 2024-05-08T18:50:48.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.376+0000 7f1d6c93f800 1 -- 172.21.15.132:0/1012082150 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2cc4170 con 0x5601e2bc4470 2024-05-08T18:50:48.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.376+0000 7f1d68e95640 1 -- 172.21.15.132:0/1012082150 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d6000a4a0 con 0x5601e2bc4470 2024-05-08T18:50:48.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.376+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/1012082150 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5601e2cc5ac0 0x5601e2cc7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.376+0000 7f1d6c93f800 1 -- 172.21.15.132:0/1012082150 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2cc86e0 con 0x5601e2cc5ac0 2024-05-08T18:50:48.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.376+0000 7f1d68694640 1 --2- 172.21.15.132:0/1012082150 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5601e2cc5ac0 0x5601e2cc7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.376+0000 7f1d68694640 1 --2- 172.21.15.132:0/1012082150 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5601e2cc5ac0 0x5601e2cc7f50 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.377+0000 7f1d68694640 1 -- 172.21.15.132:0/1012082150 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1d58075030 con 0x5601e2cc5ac0 2024-05-08T18:50:48.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.377+0000 7f1d6c93f800 1 -- 172.21.15.132:0/1012082150 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2cc49c0 con 0x5601e2bc4470 2024-05-08T18:50:48.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.377+0000 7f1d68e95640 1 -- 172.21.15.132:0/1012082150 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d6000a4a0 con 0x5601e2bc4470 2024-05-08T18:50:48.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.377+0000 7f1d6c93f800 1 -- 172.21.15.132:0/1012082150 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2cc4da0 con 0x5601e2bc4470 2024-05-08T18:50:48.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.377+0000 7f1d68e95640 1 -- 172.21.15.132:0/1012082150 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1d6000a4a0 con 0x5601e2bc4470 2024-05-08T18:50:48.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.378+0000 7f1d6c93f800 1 Processor -- start 2024-05-08T18:50:48.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.378+0000 7f1d6c93f800 1 -- start start 2024-05-08T18:50:48.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.378+0000 7f1d6c93f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2cd7620 0x5601e2cd7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.378+0000 7f1d6c93f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5601e2ab4fc0 con 0x5601e2cd7620 2024-05-08T18:50:48.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.378+0000 7f1d68e95640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2cd7620 0x5601e2cd7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.378+0000 7f1d68e95640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2cd7620 0x5601e2cd7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32884/0 (socket says 172.21.15.132:32884) 2024-05-08T18:50:48.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.378+0000 7f1d68e95640 1 -- 172.21.15.132:0/3231877028 learned_addr learned my addr 172.21.15.132:0/3231877028 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.379+0000 7f1d68e95640 1 -- 172.21.15.132:0/3231877028 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601e2cd7f80 con 0x5601e2cd7620 2024-05-08T18:50:48.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.379+0000 7f1d68e95640 1 --2- 172.21.15.132:0/3231877028 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2cd7620 0x5601e2cd7a40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x5601e2cc3c90 tx=0x7f1d60018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.379+0000 7f1c4dffb640 1 -- 172.21.15.132:0/3231877028 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d60014450 con 0x5601e2cd7620 2024-05-08T18:50:48.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.379+0000 7f1c4dffb640 1 -- 172.21.15.132:0/3231877028 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d60014610 con 0x5601e2cd7620 2024-05-08T18:50:48.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.379+0000 7f1c4dffb640 1 -- 172.21.15.132:0/3231877028 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d60014930 con 0x5601e2cd7620 2024-05-08T18:50:48.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.379+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3231877028 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601e2cd89f0 con 0x5601e2cd7620 2024-05-08T18:50:48.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.379+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3231877028 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601e2cd8ef0 con 0x5601e2cd7620 2024-05-08T18:50:48.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.380+0000 7f1c4dffb640 1 -- 172.21.15.132:0/3231877028 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1d60011040 con 0x5601e2cd7620 2024-05-08T18:50:48.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.380+0000 7f1c4dffb640 1 --2- 172.21.15.132:0/3231877028 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c4003bb50 0x7f1c4003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.380+0000 7f1c4dffb640 1 -- 172.21.15.132:0/3231877028 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f1d6001e070 con 0x5601e2cd7620 2024-05-08T18:50:48.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.380+0000 7f1d68694640 1 --2- 172.21.15.132:0/3231877028 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c4003bb50 0x7f1c4003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.380+0000 7f1d6c93f800 1 Processor -- start 2024-05-08T18:50:48.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.380+0000 7f1d68694640 1 --2- 172.21.15.132:0/3231877028 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c4003bb50 0x7f1c4003e010 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x5601e2cc0a10 tx=0x7f1d58076c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.380+0000 7f1d6c93f800 1 -- start start 2024-05-08T18:50:48.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.381+0000 7f1d6c93f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2ce4900 0x5601e2ce4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.381+0000 7f1d6c93f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5601e2cb4fa0 con 0x5601e2ce4900 2024-05-08T18:50:48.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.381+0000 7f1d68e95640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2ce4900 0x5601e2ce4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.381+0000 7f1d68e95640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2ce4900 0x5601e2ce4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32888/0 (socket says 172.21.15.132:32888) 2024-05-08T18:50:48.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.381+0000 7f1d68e95640 1 -- 172.21.15.132:0/1605091920 learned_addr learned my addr 172.21.15.132:0/1605091920 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.381+0000 7f1d68e95640 1 -- 172.21.15.132:0/1605091920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601e2ce52f0 con 0x5601e2ce4900 2024-05-08T18:50:48.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.381+0000 7f1d68e95640 1 --2- 172.21.15.132:0/1605091920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2ce4900 0x5601e2ce4d20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1d60052cd0 tx=0x7f1d6002b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43d56ed5d3a23c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.381+0000 7f1c3f7fe640 1 -- 172.21.15.132:0/1605091920 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d60028070 con 0x5601e2ce4900 2024-05-08T18:50:48.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.381+0000 7f1c3f7fe640 1 -- 172.21.15.132:0/1605091920 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d60016e00 con 0x5601e2ce4900 2024-05-08T18:50:48.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.381+0000 7f1c3f7fe640 1 -- 172.21.15.132:0/1605091920 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d600165b0 con 0x5601e2ce4900 2024-05-08T18:50:48.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.382+0000 7f1d6c93f800 1 -- 172.21.15.132:0/1605091920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2ce4900 msgr2=0x5601e2ce4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.382+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/1605091920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2ce4900 0x5601e2ce4d20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1d60052cd0 tx=0x7f1d6002b720 comp rx=0 tx=0).stop 2024-05-08T18:50:48.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.382+0000 7f1d6c93f800 1 -- 172.21.15.132:0/1605091920 shutdown_connections 2024-05-08T18:50:48.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.382+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/1605091920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2ce4900 0x5601e2ce4d20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.382+0000 7f1d6c93f800 1 -- 172.21.15.132:0/1605091920 >> 172.21.15.132:0/1605091920 conn(0x5601e2ce0c60 msgr2=0x5601e2cdecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.382+0000 7f1d6c93f800 1 -- 172.21.15.132:0/1605091920 shutdown_connections 2024-05-08T18:50:48.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.382+0000 7f1d6c93f800 1 -- 172.21.15.132:0/1605091920 wait complete. 2024-05-08T18:50:48.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.382+0000 7f1d6c93f800 1 Processor -- start 2024-05-08T18:50:48.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.382+0000 7f1d6c93f800 1 -- start start 2024-05-08T18:50:48.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.382+0000 7f1d6c93f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2ce4900 0x5601e2b38c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.382+0000 7f1d6c93f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5601e2ce5a60 con 0x5601e2ce4900 2024-05-08T18:50:48.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.382+0000 7f1d68e95640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2ce4900 0x5601e2b38c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.382+0000 7f1d68e95640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2ce4900 0x5601e2b38c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32890/0 (socket says 172.21.15.132:32890) 2024-05-08T18:50:48.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.382+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 learned_addr learned my addr 172.21.15.132:0/3931210560 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.383+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601e2b37360 con 0x5601e2ce4900 2024-05-08T18:50:48.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.383+0000 7f1d68e95640 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2ce4900 0x5601e2b38c70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1d60016c90 tx=0x7f1d60052c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.383+0000 7f1c3dffb640 1 -- 172.21.15.132:0/3931210560 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d60031070 con 0x5601e2ce4900 2024-05-08T18:50:48.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.383+0000 7f1c3dffb640 1 -- 172.21.15.132:0/3931210560 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d60011850 con 0x5601e2ce4900 2024-05-08T18:50:48.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.383+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601e2b375f0 con 0x5601e2ce4900 2024-05-08T18:50:48.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.383+0000 7f1c3dffb640 1 -- 172.21.15.132:0/3931210560 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d60044030 con 0x5601e2ce4900 2024-05-08T18:50:48.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.383+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601e2b37a90 con 0x5601e2ce4900 2024-05-08T18:50:48.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.384+0000 7f1c3dffb640 1 -- 172.21.15.132:0/3931210560 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1d60034070 con 0x5601e2ce4900 2024-05-08T18:50:48.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.384+0000 7f1c3dffb640 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c3003bb50 0x7f1c3003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.384+0000 7f1c3dffb640 1 -- 172.21.15.132:0/3931210560 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f1d6000e040 con 0x5601e2ce4900 2024-05-08T18:50:48.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.384+0000 7f1d68694640 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c3003bb50 0x7f1c3003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.384+0000 7f1d6c93f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.384+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5601e2cf9bd0 0x5601e2cfc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.384+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2cfc7e0 con 0x5601e2cf9bd0 2024-05-08T18:50:48.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.384+0000 7f1d5ffff640 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5601e2cf9bd0 0x5601e2cfc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.384+0000 7f1d68694640 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c3003bb50 0x7f1c3003e010 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1d5805daf0 tx=0x7f1d58083000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.385+0000 7f1d5ffff640 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5601e2cf9bd0 0x5601e2cfc090 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.385+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d5000bdb0 con 0x5601e2cf9bd0 2024-05-08T18:50:48.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.385+0000 7f1d6c93f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.385+0000 7f1d6c93f800 20 realm 2024-05-08T18:50:48.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.385+0000 7f1d6c93f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.385+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2cf9070 con 0x5601e2cf9bd0 2024-05-08T18:50:48.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.385+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d5000bdb0 con 0x5601e2cf9bd0 2024-05-08T18:50:48.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.385+0000 7f1d6c93f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.385+0000 7f1d6c93f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:48.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.385+0000 7f1d6c93f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.385+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2cfd2c0 con 0x5601e2cf9bd0 2024-05-08T18:50:48.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.385+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d5000bdb0 con 0x5601e2cf9bd0 2024-05-08T18:50:48.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.385+0000 7f1d6c93f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.385+0000 7f1d6c93f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.385+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2cfdb90 con 0x5601e2cf9bd0 2024-05-08T18:50:48.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.386+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d5000bdb0 con 0x5601e2cf9bd0 2024-05-08T18:50:48.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.386+0000 7f1d6c93f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:48.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.386+0000 7f1d6c93f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.386+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5601e2cfe440 0x5601e2d00850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.386+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d00fb0 con 0x5601e2cfe440 2024-05-08T18:50:48.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.386+0000 7f1d68e95640 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5601e2cfe440 0x5601e2d00850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.386+0000 7f1d68e95640 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5601e2cfe440 0x5601e2d00850 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.386+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1d60033030 con 0x5601e2cfe440 2024-05-08T18:50:48.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.386+0000 7f1d6c93f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:48.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.386+0000 7f1d6c93f800 20 searching for the correct realm 2024-05-08T18:50:48.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.386+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x5601e2cfe440 2024-05-08T18:50:48.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.387+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d60033030 con 0x5601e2cfe440 2024-05-08T18:50:48.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.387+0000 7f1d68e95640 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1d60036070 0x7f1d60038080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.387+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x7f1d60036070 2024-05-08T18:50:48.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.387+0000 7f1d68694640 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1d60036070 0x7f1d60038080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.387+0000 7f1d68694640 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1d60036070 0x7f1d60038080 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.387+0000 7f1d68694640 1 -- 172.21.15.132:0/3931210560 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d58075030 con 0x7f1d60036070 2024-05-08T18:50:48.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.388+0000 7f1d68694640 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1d58078060 0x7f1d5805c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.388+0000 7f1d68694640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x7f1d58078060 2024-05-08T18:50:48.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.388+0000 7f1d5ffff640 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1d58078060 0x7f1d5805c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.388+0000 7f1d5ffff640 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1d58078060 0x7f1d5805c3e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.388+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d5000bdb0 con 0x7f1d58078060 2024-05-08T18:50:48.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.388+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x5601e2cf9bd0 2024-05-08T18:50:48.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.389+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d5000bdb0 con 0x5601e2cf9bd0 2024-05-08T18:50:48.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.389+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x5601e2cf9bd0 2024-05-08T18:50:48.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.389+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.389+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x7f1d58078060 2024-05-08T18:50:48.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.389+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d5002a040 con 0x7f1d58078060 2024-05-08T18:50:48.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.389+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x7f1d58078060 2024-05-08T18:50:48.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.389+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d5002a040 con 0x7f1d58078060 2024-05-08T18:50:48.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.389+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x7f1d60036070 2024-05-08T18:50:48.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.390+0000 7f1d68694640 1 -- 172.21.15.132:0/3931210560 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d58075030 con 0x7f1d60036070 2024-05-08T18:50:48.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.390+0000 7f1d68694640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x5601e2cfe440 2024-05-08T18:50:48.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.390+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d60033030 con 0x5601e2cfe440 2024-05-08T18:50:48.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.390+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x5601e2cf9bd0 2024-05-08T18:50:48.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.390+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.390+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x7f1d58078060 2024-05-08T18:50:48.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.390+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d5002a040 con 0x7f1d58078060 2024-05-08T18:50:48.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.391+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x5601e2cf9bd0 2024-05-08T18:50:48.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.391+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.391+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x7f1d60036070 2024-05-08T18:50:48.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.391+0000 7f1d68694640 1 -- 172.21.15.132:0/3931210560 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1d58075030 con 0x7f1d60036070 2024-05-08T18:50:48.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.391+0000 7f1d68694640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x5601e2cfe440 2024-05-08T18:50:48.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.391+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1d60033030 con 0x5601e2cfe440 2024-05-08T18:50:48.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.391+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x5601e2cfe440 2024-05-08T18:50:48.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.391+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d60033030 con 0x5601e2cfe440 2024-05-08T18:50:48.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.391+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x7f1d58078060 2024-05-08T18:50:48.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.392+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d5002a040 con 0x7f1d58078060 2024-05-08T18:50:48.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.392+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x5601e2cfe440 2024-05-08T18:50:48.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.392+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d60033030 con 0x5601e2cfe440 2024-05-08T18:50:48.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.392+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x5601e2cfe440 2024-05-08T18:50:48.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.392+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d60033030 con 0x5601e2cfe440 2024-05-08T18:50:48.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.392+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x5601e2cf9bd0 2024-05-08T18:50:48.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.393+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.393+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x5601e2cf9bd0 2024-05-08T18:50:48.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.393+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.393+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x7f1d58078060 2024-05-08T18:50:48.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.393+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d5002a040 con 0x7f1d58078060 2024-05-08T18:50:48.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.393+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x5601e2cfe440 2024-05-08T18:50:48.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.393+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d60033030 con 0x5601e2cfe440 2024-05-08T18:50:48.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.393+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x7f1d60036070 2024-05-08T18:50:48.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.394+0000 7f1d68694640 1 -- 172.21.15.132:0/3931210560 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d58075030 con 0x7f1d60036070 2024-05-08T18:50:48.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.394+0000 7f1d68694640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x5601e2cf9bd0 2024-05-08T18:50:48.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.394+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.394+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x7f1d58078060 2024-05-08T18:50:48.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.394+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d5002a040 con 0x7f1d58078060 2024-05-08T18:50:48.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.394+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x5601e2cfe440 2024-05-08T18:50:48.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.394+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d60033030 con 0x5601e2cfe440 2024-05-08T18:50:48.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.394+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x7f1d58078060 2024-05-08T18:50:48.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.395+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d5002a040 con 0x7f1d58078060 2024-05-08T18:50:48.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.395+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x7f1d60036070 2024-05-08T18:50:48.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.395+0000 7f1d68694640 1 -- 172.21.15.132:0/3931210560 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d58075030 con 0x7f1d60036070 2024-05-08T18:50:48.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.395+0000 7f1d68694640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x5601e2cfe440 2024-05-08T18:50:48.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.395+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d60033030 con 0x5601e2cfe440 2024-05-08T18:50:48.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.395+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x7f1d58078060 2024-05-08T18:50:48.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.396+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d5002a040 con 0x7f1d58078060 2024-05-08T18:50:48.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.396+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x5601e2cf9bd0 2024-05-08T18:50:48.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.396+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.396+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02990 con 0x7f1d60036070 2024-05-08T18:50:48.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.396+0000 7f1d68694640 1 -- 172.21.15.132:0/3931210560 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d58075030 con 0x7f1d60036070 2024-05-08T18:50:48.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.396+0000 7f1d6c93f800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:48.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.396+0000 7f1d6c93f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:48.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.396+0000 7f1d6c93f800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:48.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.396+0000 7f1d6c93f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:48.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.396+0000 7f1d6c93f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:48.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.396+0000 7f1d6c93f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:48.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.396+0000 7f1d6c93f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.396+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d01a60 con 0x5601e2cf9bd0 2024-05-08T18:50:48.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.396+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.396+0000 7f1d6c93f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.396+0000 7f1d6c93f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.396+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02300 con 0x5601e2cf9bd0 2024-05-08T18:50:48.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.397+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.397+0000 7f1d6c93f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:48.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.397+0000 7f1d6c93f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.397+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d016a0 con 0x5601e2cf9bd0 2024-05-08T18:50:48.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.397+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.397+0000 7f1d6c93f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:48.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.397+0000 7f1d6c93f800 20 zone default found 2024-05-08T18:50:48.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.397+0000 7f1d6c93f800 4 Realm: () 2024-05-08T18:50:48.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.397+0000 7f1d6c93f800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:48.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.397+0000 7f1d6c93f800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:48.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.397+0000 7f1d6c93f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:48.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.397+0000 7f1d6c93f800 20 zonegroup default 2024-05-08T18:50:48.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.397+0000 7f1d6c93f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.397+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d02e60 con 0x7f1d58078060 2024-05-08T18:50:48.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.397+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1d5002a040 con 0x7f1d58078060 2024-05-08T18:50:48.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.397+0000 7f1d6c93f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.397+0000 7f1d6c93f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.397+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d04cf0 con 0x5601e2cfe440 2024-05-08T18:50:48.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.398+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d60033030 con 0x5601e2cfe440 2024-05-08T18:50:48.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.398+0000 7f1d6c93f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.398+0000 7f1d6c93f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.398+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d05090 con 0x5601e2cfe440 2024-05-08T18:50:48.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.398+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d60033030 con 0x5601e2cfe440 2024-05-08T18:50:48.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.398+0000 7f1d6c93f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.398+0000 7f1d6c93f800 20 started sync module instance, tier type = 2024-05-08T18:50:48.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.398+0000 7f1d6c93f800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:48.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.398+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d04130 con 0x7f1d60036070 2024-05-08T18:50:48.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.399+0000 7f1d68694640 1 -- 172.21.15.132:0/3931210560 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d58075030 con 0x7f1d60036070 2024-05-08T18:50:48.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.399+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94566100253824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d05430 con 0x7f1d60036070 2024-05-08T18:50:48.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.399+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d05df0 con 0x5601e2cf9bd0 2024-05-08T18:50:48.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.400+0000 7f1d68694640 1 -- 172.21.15.132:0/3931210560 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94566100253824] v25'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d58075030 con 0x7f1d60036070 2024-05-08T18:50:48.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.400+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.400+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94566100261184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d06210 con 0x5601e2cf9bd0 2024-05-08T18:50:48.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.400+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d06bd0 con 0x5601e2cfe440 2024-05-08T18:50:48.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.401+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94566100261184] v25'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.401+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d60033030 con 0x5601e2cfe440 2024-05-08T18:50:48.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.401+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94566100262720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d06bd0 con 0x5601e2cfe440 2024-05-08T18:50:48.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.402+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d07590 con 0x7f1d60036070 2024-05-08T18:50:48.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.402+0000 7f1d68694640 1 -- 172.21.15.132:0/3931210560 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d58075030 con 0x7f1d60036070 2024-05-08T18:50:48.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.402+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94566100262720] v25'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d60033030 con 0x5601e2cfe440 2024-05-08T18:50:48.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.402+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94566100267232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d07e20 con 0x7f1d60036070 2024-05-08T18:50:48.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.403+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d06720 con 0x5601e2cf9bd0 2024-05-08T18:50:48.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.404+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.404+0000 7f1d68694640 1 -- 172.21.15.132:0/3931210560 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94566100267232] v25'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d58075030 con 0x7f1d60036070 2024-05-08T18:50:48.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.404+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94566100272144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d08ce0 con 0x5601e2cf9bd0 2024-05-08T18:50:48.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.404+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d07950 con 0x7f1d58078060 2024-05-08T18:50:48.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.405+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94566100272144] v25'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.405+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d5002a040 con 0x7f1d58078060 2024-05-08T18:50:48.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.405+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94566100273200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d08c50 con 0x7f1d58078060 2024-05-08T18:50:48.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.405+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d09d40 con 0x7f1d58078060 2024-05-08T18:50:48.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.406+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(56 notify.6 [create] v25'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d5002a040 con 0x7f1d58078060 2024-05-08T18:50:48.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.406+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94566100277392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d0a160 con 0x7f1d58078060 2024-05-08T18:50:48.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.406+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d0abd0 con 0x7f1d58078060 2024-05-08T18:50:48.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.406+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94566100273200] v25'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d5002a040 con 0x7f1d58078060 2024-05-08T18:50:48.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.406+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94566100277392] v25'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d5002a040 con 0x7f1d58078060 2024-05-08T18:50:48.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.407+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d5002a040 con 0x7f1d58078060 2024-05-08T18:50:48.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.407+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94566100280992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d09cb0 con 0x7f1d58078060 2024-05-08T18:50:48.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.407+0000 7f1d6c93f800 20 add_watcher() i=0 2024-05-08T18:50:48.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.407+0000 7f1d6c93f800 20 add_watcher() i=1 2024-05-08T18:50:48.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.407+0000 7f1d6c93f800 20 add_watcher() i=2 2024-05-08T18:50:48.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.407+0000 7f1d6c93f800 20 add_watcher() i=3 2024-05-08T18:50:48.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.407+0000 7f1d6c93f800 20 add_watcher() i=4 2024-05-08T18:50:48.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.407+0000 7f1d6c93f800 20 add_watcher() i=5 2024-05-08T18:50:48.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.407+0000 7f1d6c93f800 20 add_watcher() i=6 2024-05-08T18:50:48.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.407+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94566100280992] v25'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d5002a040 con 0x7f1d58078060 2024-05-08T18:50:48.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.407+0000 7f1d6c93f800 20 add_watcher() i=7 2024-05-08T18:50:48.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.407+0000 7f1d6c93f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:48.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.408+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d0dde0 con 0x5601e2cf9bd0 2024-05-08T18:50:48.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.408+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.408+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94566100275824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d0b260 con 0x5601e2cf9bd0 2024-05-08T18:50:48.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.409+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94566100275824] v25'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.409+0000 7f1c1e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:48.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.409+0000 7f1d6c93f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:48.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.409+0000 7f1d6c93f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:48.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.409+0000 7f1d6c93f800 5 note: GC not initialized 2024-05-08T18:50:48.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.409+0000 7f1c1d7e2640 20 reqs_thread_entry: start 2024-05-08T18:50:48.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.409+0000 7f1d6c93f800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:48.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.410+0000 7f1d6c93f800 20 Filter name: none 2024-05-08T18:50:48.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.410+0000 7f1b8effd640 20 reqs_thread_entry: start 2024-05-08T18:50:48.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.410+0000 7f1d6c93f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.410+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d40aa0 con 0x5601e2cf9bd0 2024-05-08T18:50:48.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.410+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.410+0000 7f1d6c93f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:48.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.410+0000 7f1d6c93f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.410+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d41330 con 0x5601e2cf9bd0 2024-05-08T18:50:48.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.410+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.410+0000 7f1d6c93f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:48.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.410+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d42340 con 0x7f1d60036070 2024-05-08T18:50:48.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.411+0000 7f1d68694640 1 -- 172.21.15.132:0/3931210560 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f1d58075030 con 0x7f1d60036070 2024-05-08T18:50:48.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.411+0000 7f1d6c93f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.411+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d3fd50 con 0x7f1d60036070 2024-05-08T18:50:48.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.411+0000 7f1d68694640 1 -- 172.21.15.132:0/3931210560 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1d58075030 con 0x7f1d60036070 2024-05-08T18:50:48.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.411+0000 7f1d6c93f800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:50:48.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.411+0000 7f1d6c93f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.411+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:66 8.1e 8:7ec7f916:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d42340 con 0x7f1d58078060 2024-05-08T18:50:48.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.411+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(66 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1d5002a040 con 0x7f1d58078060 2024-05-08T18:50:48.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.411+0000 7f1d6c93f800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:50:48.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.412+0000 7f1d6c93f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:50:48.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.412+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 4.3d 4:beedfbf8:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d41d40 con 0x5601e2cfe440 2024-05-08T18:50:48.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.412+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:68 4.0 4:01e493d7:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d46da0 con 0x5601e2cfe440 2024-05-08T18:50:48.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.412+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 4.3a 4:5c1a59ec:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d49690 con 0x5601e2cfe440 2024-05-08T18:50:48.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.412+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:70 4.4 4:2155dbb4:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d46da0 con 0x7f1d58078060 2024-05-08T18:50:48.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.412+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 4.30 4:0edbbef1:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d4e4a0 con 0x5601e2cfe440 2024-05-08T18:50:48.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.412+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 4.2 4:435b253f:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d51100 con 0x5601e2cf9bd0 2024-05-08T18:50:48.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.412+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:73 4.2a 4:56da7a03:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d53970 con 0x5601e2cf9bd0 2024-05-08T18:50:48.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.412+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:74 4.29 4:96c53c8a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d566d0 con 0x5601e2cfe440 2024-05-08T18:50:48.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.412+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:75 4.1a 4:5ae0f416:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d59570 con 0x7f1d60036070 2024-05-08T18:50:48.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.412+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 4.c 4:33d05922:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d51100 con 0x5601e2cf9bd0 2024-05-08T18:50:48.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.412+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(70 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1d5002a040 con 0x7f1d58078060 2024-05-08T18:50:48.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.412+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:77 4.13 4:cba0e3e9:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d53970 con 0x7f1d60036070 2024-05-08T18:50:48.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.412+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(72 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.412+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(73 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.412+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(76 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.412+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(67 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1d60033030 con 0x5601e2cfe440 2024-05-08T18:50:48.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.412+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(68 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1d60033030 con 0x5601e2cfe440 2024-05-08T18:50:48.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.412+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(69 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1d60033030 con 0x5601e2cfe440 2024-05-08T18:50:48.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.412+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(71 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1d60033030 con 0x5601e2cfe440 2024-05-08T18:50:48.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.412+0000 7f1d68694640 1 -- 172.21.15.132:0/3931210560 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(75 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1d58075030 con 0x7f1d60036070 2024-05-08T18:50:48.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.412+0000 7f1d68694640 1 -- 172.21.15.132:0/3931210560 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(77 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f1d58075030 con 0x7f1d60036070 2024-05-08T18:50:48.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.413+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(74 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1d60033030 con 0x5601e2cfe440 2024-05-08T18:50:48.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.413+0000 7f1c1e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:48.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.413+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94566100275824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d29530 con 0x5601e2cf9bd0 2024-05-08T18:50:48.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.414+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94566100275824] v25'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.414+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94566100253824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d29530 con 0x7f1d60036070 2024-05-08T18:50:48.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.415+0000 7f1d68694640 1 -- 172.21.15.132:0/3931210560 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94566100253824] v25'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d58075030 con 0x7f1d60036070 2024-05-08T18:50:48.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.415+0000 7f1d6c93f800 20 remove_watcher() i=0 2024-05-08T18:50:48.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.415+0000 7f1d6c93f800 2 removed watcher, disabling cache 2024-05-08T18:50:48.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.415+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94566100261184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d29530 con 0x5601e2cf9bd0 2024-05-08T18:50:48.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.416+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94566100261184] v25'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.417+0000 7f1d6c93f800 20 remove_watcher() i=1 2024-05-08T18:50:48.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.417+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94566100262720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d29530 con 0x5601e2cfe440 2024-05-08T18:50:48.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.417+0000 7f1d68e95640 1 -- 172.21.15.132:0/3931210560 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94566100262720] v25'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d60033030 con 0x5601e2cfe440 2024-05-08T18:50:48.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.417+0000 7f1d6c93f800 20 remove_watcher() i=2 2024-05-08T18:50:48.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.417+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94566100267232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d29530 con 0x7f1d60036070 2024-05-08T18:50:48.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.419+0000 7f1d68694640 1 -- 172.21.15.132:0/3931210560 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94566100267232] v25'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d58075030 con 0x7f1d60036070 2024-05-08T18:50:48.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.419+0000 7f1d6c93f800 20 remove_watcher() i=3 2024-05-08T18:50:48.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.419+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94566100272144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d29530 con 0x5601e2cf9bd0 2024-05-08T18:50:48.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.419+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94566100272144] v25'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d5002a040 con 0x5601e2cf9bd0 2024-05-08T18:50:48.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.419+0000 7f1d6c93f800 20 remove_watcher() i=4 2024-05-08T18:50:48.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.419+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94566100273200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d29530 con 0x7f1d58078060 2024-05-08T18:50:48.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.420+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94566100273200] v25'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d5002a040 con 0x7f1d58078060 2024-05-08T18:50:48.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.420+0000 7f1d6c93f800 20 remove_watcher() i=5 2024-05-08T18:50:48.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.420+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94566100277392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d29530 con 0x7f1d58078060 2024-05-08T18:50:48.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.421+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94566100277392] v25'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d5002a040 con 0x7f1d58078060 2024-05-08T18:50:48.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.421+0000 7f1d6c93f800 20 remove_watcher() i=6 2024-05-08T18:50:48.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.421+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94566100280992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5601e2d29530 con 0x7f1d58078060 2024-05-08T18:50:48.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.422+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94566100280992] v25'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d5002a040 con 0x7f1d58078060 2024-05-08T18:50:48.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.422+0000 7f1d6c93f800 20 remove_watcher() i=7 2024-05-08T18:50:48.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.422+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1d58078060 msgr2=0x7f1d5805c3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.422+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1d58078060 0x7f1d5805c3e0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.422+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5601e2cf9bd0 msgr2=0x5601e2cfc090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.422+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5601e2cf9bd0 0x5601e2cfc090 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.422+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1d60036070 msgr2=0x7f1d60038080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.422+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1d60036070 0x7f1d60038080 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.422+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5601e2cfe440 msgr2=0x5601e2d00850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.422+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5601e2cfe440 0x5601e2d00850 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.422+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c3003bb50 msgr2=0x7f1c3003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.422+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c3003bb50 0x7f1c3003e010 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1d5805daf0 tx=0x7f1d58083000 comp rx=0 tx=0).stop 2024-05-08T18:50:48.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.422+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2ce4900 msgr2=0x5601e2b38c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.422+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2ce4900 0x5601e2b38c70 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1d60016c90 tx=0x7f1d60052c60 comp rx=0 tx=0).stop 2024-05-08T18:50:48.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.422+0000 7f1d5ffff640 1 -- 172.21.15.132:0/3931210560 reap_dead start 2024-05-08T18:50:48.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 shutdown_connections 2024-05-08T18:50:48.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/3931210560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2ce4900 0x5601e2b38c70 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 >> 172.21.15.132:0/3931210560 conn(0x5601e2ce0c60 msgr2=0x5601e2cde2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 shutdown_connections 2024-05-08T18:50:48.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3931210560 wait complete. 2024-05-08T18:50:48.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3231877028 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c4003bb50 msgr2=0x7f1c4003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/3231877028 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c4003bb50 0x7f1c4003e010 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x5601e2cc0a10 tx=0x7f1d58076c10 comp rx=0 tx=0).stop 2024-05-08T18:50:48.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3231877028 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2cd7620 msgr2=0x5601e2cd7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/3231877028 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2cd7620 0x5601e2cd7a40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x5601e2cc3c90 tx=0x7f1d60018830 comp rx=0 tx=0).stop 2024-05-08T18:50:48.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3231877028 shutdown_connections 2024-05-08T18:50:48.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/3231877028 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c4003bb50 0x7f1c4003e010 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/3231877028 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2cd7620 0x5601e2cd7a40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3231877028 >> 172.21.15.132:0/3231877028 conn(0x5601e2ccb6c0 msgr2=0x5601e2ccbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3231877028 shutdown_connections 2024-05-08T18:50:48.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 -- 172.21.15.132:0/3231877028 wait complete. 2024-05-08T18:50:48.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 -- 172.21.15.132:0/1012082150 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5601e2bc4470 msgr2=0x5601e2cc3310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/1012082150 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5601e2bc4470 0x5601e2cc3310 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 -- 172.21.15.132:0/1012082150 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5601e2cc5ac0 msgr2=0x5601e2cc7f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/1012082150 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5601e2cc5ac0 0x5601e2cc7f50 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 -- 172.21.15.132:0/1012082150 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c5003bba0 msgr2=0x7f1c5003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/1012082150 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c5003bba0 0x7f1c5003e060 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1d50001e10 tx=0x7f1d50001390 comp rx=0 tx=0).stop 2024-05-08T18:50:48.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 -- 172.21.15.132:0/1012082150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2bc32b0 msgr2=0x5601e2cbc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.423+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/1012082150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2bc32b0 0x5601e2cbc0d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1d5801d050 tx=0x7f1d58003020 comp rx=0 tx=0).stop 2024-05-08T18:50:48.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.424+0000 7f1d6c93f800 1 -- 172.21.15.132:0/1012082150 shutdown_connections 2024-05-08T18:50:48.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.424+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/1012082150 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5601e2cc5ac0 0x5601e2cc7f50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.424+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/1012082150 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5601e2bc4470 0x5601e2cc3310 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.424+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/1012082150 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c5003bba0 0x7f1c5003e060 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.424+0000 7f1d6c93f800 1 --2- 172.21.15.132:0/1012082150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5601e2bc32b0 0x5601e2cbc0d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.424+0000 7f1d6c93f800 1 -- 172.21.15.132:0/1012082150 >> 172.21.15.132:0/1012082150 conn(0x5601e2bbe830 msgr2=0x5601e2cae830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.424+0000 7f1d6c93f800 1 -- 172.21.15.132:0/1012082150 shutdown_connections 2024-05-08T18:50:48.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.424+0000 7f1d6c93f800 1 -- 172.21.15.132:0/1012082150 wait complete. 2024-05-08T18:50:48.434 INFO:teuthology.orchestra.run.smithi132.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"23dcc2a0-b283-45fd-8c01-831457a34b43","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1","marker":"bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-08T18:50:47.730445Z","creation_time":"2024-05-08T18:50:47.727613Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-05-08T18:50:48.434 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '23dcc2a0-b283-45fd-8c01-831457a34b43', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1', 'marker': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:50:47.730445Z', 'creation_time': '2024-05-08T18:50:47.727613Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-05-08T18:50:48.439 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-08T18:50:48.439 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T18:50:48.439 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T18:50:48.440 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-05-08T18:50:48.483 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:48.483 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:48.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.485+0000 7f1a39723800 1 Processor -- start 2024-05-08T18:50:48.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.485+0000 7f1a39723800 1 -- start start 2024-05-08T18:50:48.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.485+0000 7f1a39723800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5576df3ad6a0 0x5576df3afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.485+0000 7f1a39723800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5576df3b0060 con 0x5576df3a92b0 2024-05-08T18:50:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.485+0000 7f1a39723800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x5576df249e20 con 0x5576df3ad6a0 2024-05-08T18:50:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.485+0000 7f1a2ffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5576df3ad6a0 0x5576df3afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.485+0000 7f1a35363640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x5576df3a92b0 0x5576df3a96d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46946/0 (socket says 172.21.15.132:46946) 2024-05-08T18:50:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.485+0000 7f1a35363640 1 -- 172.21.15.132:0/2395623382 learned_addr learned my addr 172.21.15.132:0/2395623382 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:50:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.486+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2395623382 >> v1:172.21.15.42:6789/0 conn(0x5576df3a92b0 legacy=0x5576df3a96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.486+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2395623382 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576df3b1290 con 0x5576df3ad6a0 2024-05-08T18:50:48.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.488+0000 7f1a2ffff640 1 --2- 172.21.15.132:0/2395623382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df3ad6a0 0x5576df3afa90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1a2000a470 tx=0x7f1a2001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9986312a0e9a5f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.488+0000 7f1a34b62640 1 -- 172.21.15.132:0/2395623382 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a20057070 con 0x5576df3ad6a0 2024-05-08T18:50:48.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.488+0000 7f1a34b62640 1 -- 172.21.15.132:0/2395623382 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a20052570 con 0x5576df3ad6a0 2024-05-08T18:50:48.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.488+0000 7f1a34b62640 1 -- 172.21.15.132:0/2395623382 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a20052870 con 0x5576df3ad6a0 2024-05-08T18:50:48.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.488+0000 7f1a39723800 1 -- 172.21.15.132:0/2395623382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df3ad6a0 msgr2=0x5576df3afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.488+0000 7f1a39723800 1 --2- 172.21.15.132:0/2395623382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df3ad6a0 0x5576df3afa90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1a2000a470 tx=0x7f1a2001ce90 comp rx=0 tx=0).stop 2024-05-08T18:50:48.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.488+0000 7f1a39723800 1 -- 172.21.15.132:0/2395623382 shutdown_connections 2024-05-08T18:50:48.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.488+0000 7f1a39723800 1 --2- 172.21.15.132:0/2395623382 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df3ad6a0 0x5576df3afa90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.488+0000 7f1a39723800 1 -- 172.21.15.132:0/2395623382 >> 172.21.15.132:0/2395623382 conn(0x5576df3a4830 msgr2=0x5576df3a6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.488+0000 7f1a39723800 1 -- 172.21.15.132:0/2395623382 shutdown_connections 2024-05-08T18:50:48.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.488+0000 7f1a39723800 1 -- 172.21.15.132:0/2395623382 wait complete. 2024-05-08T18:50:48.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.502+0000 7f1a39723800 1 Processor -- start 2024-05-08T18:50:48.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.502+0000 7f1a39723800 1 -- start start 2024-05-08T18:50:48.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.503+0000 7f1a39723800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df3a92b0 0x5576df49a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.503+0000 7f1a39723800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5576df2f45b0 con 0x5576df3a92b0 2024-05-08T18:50:48.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.503+0000 7f1a35363640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df3a92b0 0x5576df49a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.503+0000 7f1a35363640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df3a92b0 0x5576df49a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32904/0 (socket says 172.21.15.132:32904) 2024-05-08T18:50:48.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.503+0000 7f1a35363640 1 -- 172.21.15.132:0/171767202 learned_addr learned my addr 172.21.15.132:0/171767202 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.503+0000 7f1a35363640 1 -- 172.21.15.132:0/171767202 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576df49abb0 con 0x5576df3a92b0 2024-05-08T18:50:48.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.503+0000 7f1a35363640 1 --2- 172.21.15.132:0/171767202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df3a92b0 0x5576df49a5e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1a28001d80 tx=0x7f1a28001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6236c8db6c9fcd4a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.503+0000 7f1923606640 1 -- 172.21.15.132:0/171767202 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a28013030 con 0x5576df3a92b0 2024-05-08T18:50:48.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.503+0000 7f1923606640 1 -- 172.21.15.132:0/171767202 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a2800e470 con 0x5576df3a92b0 2024-05-08T18:50:48.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.503+0000 7f1923606640 1 -- 172.21.15.132:0/171767202 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a2800e810 con 0x5576df3a92b0 2024-05-08T18:50:48.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.504+0000 7f1a39723800 1 -- 172.21.15.132:0/171767202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df3a92b0 msgr2=0x5576df49a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.504+0000 7f1a39723800 1 --2- 172.21.15.132:0/171767202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df3a92b0 0x5576df49a5e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1a28001d80 tx=0x7f1a28001e70 comp rx=0 tx=0).stop 2024-05-08T18:50:48.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.504+0000 7f1a39723800 1 -- 172.21.15.132:0/171767202 shutdown_connections 2024-05-08T18:50:48.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.504+0000 7f1a39723800 1 --2- 172.21.15.132:0/171767202 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df3a92b0 0x5576df49a5e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.504+0000 7f1a39723800 1 -- 172.21.15.132:0/171767202 >> 172.21.15.132:0/171767202 conn(0x5576df3a4830 msgr2=0x5576df495f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.504+0000 7f1a39723800 1 -- 172.21.15.132:0/171767202 shutdown_connections 2024-05-08T18:50:48.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.504+0000 7f1a39723800 1 -- 172.21.15.132:0/171767202 wait complete. 2024-05-08T18:50:48.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.505+0000 7f1a39723800 1 Processor -- start 2024-05-08T18:50:48.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.505+0000 7f1a39723800 1 -- start start 2024-05-08T18:50:48.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.505+0000 7f1a39723800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df3a92b0 0x5576df4a2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.505+0000 7f1a39723800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5576df3b0530 con 0x5576df3a92b0 2024-05-08T18:50:48.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.505+0000 7f1a35363640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df3a92b0 0x5576df4a2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.505+0000 7f1a35363640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df3a92b0 0x5576df4a2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32906/0 (socket says 172.21.15.132:32906) 2024-05-08T18:50:48.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.505+0000 7f1a35363640 1 -- 172.21.15.132:0/2548805757 learned_addr learned my addr 172.21.15.132:0/2548805757 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.505+0000 7f1a35363640 1 -- 172.21.15.132:0/2548805757 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576df4a26c0 con 0x5576df3a92b0 2024-05-08T18:50:48.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.505+0000 7f1a35363640 1 --2- 172.21.15.132:0/2548805757 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df3a92b0 0x5576df4a2180 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1a28004000 tx=0x7f1a28000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.506+0000 7f1921e03640 1 -- 172.21.15.132:0/2548805757 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a28027070 con 0x5576df3a92b0 2024-05-08T18:50:48.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.506+0000 7f1921e03640 1 -- 172.21.15.132:0/2548805757 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a28019900 con 0x5576df3a92b0 2024-05-08T18:50:48.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.506+0000 7f1a39723800 1 -- 172.21.15.132:0/2548805757 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576df4a2950 con 0x5576df3a92b0 2024-05-08T18:50:48.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.506+0000 7f1921e03640 1 -- 172.21.15.132:0/2548805757 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a28019c60 con 0x5576df3a92b0 2024-05-08T18:50:48.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.506+0000 7f1a39723800 1 -- 172.21.15.132:0/2548805757 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576df4a5600 con 0x5576df3a92b0 2024-05-08T18:50:48.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.506+0000 7f1921e03640 1 -- 172.21.15.132:0/2548805757 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1a2802a070 con 0x5576df3a92b0 2024-05-08T18:50:48.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.507+0000 7f1921e03640 1 --2- 172.21.15.132:0/2548805757 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f191c03bb50 0x7f191c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.507+0000 7f1921e03640 1 -- 172.21.15.132:0/2548805757 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f1a2801f070 con 0x5576df3a92b0 2024-05-08T18:50:48.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.507+0000 7f1a2ffff640 1 --2- 172.21.15.132:0/2548805757 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f191c03bb50 0x7f191c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.507+0000 7f1a39723800 1 --2- 172.21.15.132:0/2548805757 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5576df3ad6a0 0x5576df4a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.507+0000 7f1a39723800 1 -- 172.21.15.132:0/2548805757 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df4a9940 con 0x5576df3ad6a0 2024-05-08T18:50:48.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.507+0000 7f1a35b64640 1 --2- 172.21.15.132:0/2548805757 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5576df3ad6a0 0x5576df4a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.507+0000 7f1a2ffff640 1 --2- 172.21.15.132:0/2548805757 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f191c03bb50 0x7f191c03e010 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1a20054000 tx=0x7f1a2004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.507+0000 7f1a35b64640 1 --2- 172.21.15.132:0/2548805757 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5576df3ad6a0 0x5576df4a93c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.508+0000 7f1a35b64640 1 -- 172.21.15.132:0/2548805757 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5576df3ad6a0 2024-05-08T18:50:48.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.508+0000 7f1a39723800 1 -- 172.21.15.132:0/2548805757 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df4a6990 con 0x5576df3ad6a0 2024-05-08T18:50:48.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.508+0000 7f1a35b64640 1 -- 172.21.15.132:0/2548805757 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5576df3ad6a0 2024-05-08T18:50:48.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.508+0000 7f1a39723800 1 --2- 172.21.15.132:0/2548805757 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5576df4abc90 0x5576df4ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.508+0000 7f1a39723800 1 -- 172.21.15.132:0/2548805757 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df4ae720 con 0x5576df4abc90 2024-05-08T18:50:48.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.508+0000 7f1a35363640 1 --2- 172.21.15.132:0/2548805757 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5576df4abc90 0x5576df4ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.508+0000 7f1a35363640 1 --2- 172.21.15.132:0/2548805757 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5576df4abc90 0x5576df4ae080 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.509+0000 7f1a35363640 1 -- 172.21.15.132:0/2548805757 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1a28029030 con 0x5576df4abc90 2024-05-08T18:50:48.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.509+0000 7f1a39723800 1 -- 172.21.15.132:0/2548805757 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df4aab30 con 0x5576df3ad6a0 2024-05-08T18:50:48.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.509+0000 7f1a35b64640 1 -- 172.21.15.132:0/2548805757 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5576df3ad6a0 2024-05-08T18:50:48.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.509+0000 7f1a39723800 1 -- 172.21.15.132:0/2548805757 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df4ab010 con 0x5576df3ad6a0 2024-05-08T18:50:48.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.509+0000 7f1a35b64640 1 -- 172.21.15.132:0/2548805757 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1a3000a4a0 con 0x5576df3ad6a0 2024-05-08T18:50:48.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.510+0000 7f1a39723800 1 Processor -- start 2024-05-08T18:50:48.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.510+0000 7f1a39723800 1 -- start start 2024-05-08T18:50:48.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.510+0000 7f1a39723800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df31eed0 0x5576df31d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.510+0000 7f1a39723800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5576df29afc0 con 0x5576df31eed0 2024-05-08T18:50:48.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.510+0000 7f1a35b64640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df31eed0 0x5576df31d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.510+0000 7f1a35b64640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df31eed0 0x5576df31d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32914/0 (socket says 172.21.15.132:32914) 2024-05-08T18:50:48.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.510+0000 7f1a35b64640 1 -- 172.21.15.132:0/4168917118 learned_addr learned my addr 172.21.15.132:0/4168917118 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.510+0000 7f1a35b64640 1 -- 172.21.15.132:0/4168917118 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576df31d880 con 0x5576df31eed0 2024-05-08T18:50:48.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.510+0000 7f1a35b64640 1 --2- 172.21.15.132:0/4168917118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df31eed0 0x5576df31d340 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x5576df4a3050 tx=0x7f1a300188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.511+0000 7f191affd640 1 -- 172.21.15.132:0/4168917118 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a30014450 con 0x5576df31eed0 2024-05-08T18:50:48.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.511+0000 7f191affd640 1 -- 172.21.15.132:0/4168917118 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a300145f0 con 0x5576df31eed0 2024-05-08T18:50:48.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.511+0000 7f1a39723800 1 -- 172.21.15.132:0/4168917118 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576df31db10 con 0x5576df31eed0 2024-05-08T18:50:48.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.511+0000 7f191affd640 1 -- 172.21.15.132:0/4168917118 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a300148d0 con 0x5576df31eed0 2024-05-08T18:50:48.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.511+0000 7f1a39723800 1 -- 172.21.15.132:0/4168917118 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576df31e010 con 0x5576df31eed0 2024-05-08T18:50:48.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.511+0000 7f191affd640 1 -- 172.21.15.132:0/4168917118 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1a30011040 con 0x5576df31eed0 2024-05-08T18:50:48.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.512+0000 7f191affd640 1 --2- 172.21.15.132:0/4168917118 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f190c03bba0 0x7f190c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.512+0000 7f191affd640 1 -- 172.21.15.132:0/4168917118 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f1a3001e070 con 0x5576df31eed0 2024-05-08T18:50:48.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.512+0000 7f1a35363640 1 --2- 172.21.15.132:0/4168917118 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f190c03bba0 0x7f190c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.512+0000 7f1a39723800 1 Processor -- start 2024-05-08T18:50:48.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.512+0000 7f1a35363640 1 --2- 172.21.15.132:0/4168917118 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f190c03bba0 0x7f190c03e060 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x5576df4a9db0 tx=0x7f1a2800ef30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.512+0000 7f1a39723800 1 -- start start 2024-05-08T18:50:48.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.512+0000 7f1a39723800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df4ccbd0 0x5576df4ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.512+0000 7f1a39723800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5576df49af30 con 0x5576df4ccbd0 2024-05-08T18:50:48.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.512+0000 7f1a35b64640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df4ccbd0 0x5576df4ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.513+0000 7f1a35b64640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df4ccbd0 0x5576df4ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32922/0 (socket says 172.21.15.132:32922) 2024-05-08T18:50:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.513+0000 7f1a35b64640 1 -- 172.21.15.132:0/275646855 learned_addr learned my addr 172.21.15.132:0/275646855 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.513+0000 7f1a35b64640 1 -- 172.21.15.132:0/275646855 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576df4cd5c0 con 0x5576df4ccbd0 2024-05-08T18:50:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.513+0000 7f1a35b64640 1 --2- 172.21.15.132:0/275646855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df4ccbd0 0x5576df4ccff0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1a30013fd0 tx=0x7f1a300118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369af0b611f771eb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.513+0000 7f1918ff9640 1 -- 172.21.15.132:0/275646855 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a30047020 con 0x5576df4ccbd0 2024-05-08T18:50:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.513+0000 7f1918ff9640 1 -- 172.21.15.132:0/275646855 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a30001310 con 0x5576df4ccbd0 2024-05-08T18:50:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.513+0000 7f1918ff9640 1 -- 172.21.15.132:0/275646855 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a30022ca0 con 0x5576df4ccbd0 2024-05-08T18:50:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.514+0000 7f1a39723800 1 -- 172.21.15.132:0/275646855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df4ccbd0 msgr2=0x5576df4ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.514+0000 7f1a39723800 1 --2- 172.21.15.132:0/275646855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df4ccbd0 0x5576df4ccff0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1a30013fd0 tx=0x7f1a300118e0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.514+0000 7f1a39723800 1 -- 172.21.15.132:0/275646855 shutdown_connections 2024-05-08T18:50:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.514+0000 7f1a39723800 1 --2- 172.21.15.132:0/275646855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df4ccbd0 0x5576df4ccff0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.514+0000 7f1a39723800 1 -- 172.21.15.132:0/275646855 >> 172.21.15.132:0/275646855 conn(0x5576df4c8e90 msgr2=0x5576df4c6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.514+0000 7f1a39723800 1 -- 172.21.15.132:0/275646855 shutdown_connections 2024-05-08T18:50:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.514+0000 7f1a39723800 1 -- 172.21.15.132:0/275646855 wait complete. 2024-05-08T18:50:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.514+0000 7f1a39723800 1 Processor -- start 2024-05-08T18:50:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.514+0000 7f1a39723800 1 -- start start 2024-05-08T18:50:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.514+0000 7f1a39723800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df4ccbd0 0x5576df4d4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.514+0000 7f1a39723800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5576df4cdd00 con 0x5576df4ccbd0 2024-05-08T18:50:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.514+0000 7f1a35b64640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df4ccbd0 0x5576df4d4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.514+0000 7f1a35b64640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df4ccbd0 0x5576df4d4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32938/0 (socket says 172.21.15.132:32938) 2024-05-08T18:50:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.514+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 learned_addr learned my addr 172.21.15.132:0/2471089408 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.514+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576df4d4650 con 0x5576df4ccbd0 2024-05-08T18:50:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.515+0000 7f1a35b64640 1 --2- 172.21.15.132:0/2471089408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df4ccbd0 0x5576df4d4110 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1a30011f60 tx=0x7f1a30052b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.515+0000 7f190affd640 1 -- 172.21.15.132:0/2471089408 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a30031070 con 0x5576df4ccbd0 2024-05-08T18:50:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.515+0000 7f190affd640 1 -- 172.21.15.132:0/2471089408 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a3002b560 con 0x5576df4ccbd0 2024-05-08T18:50:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.515+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576df4d48e0 con 0x5576df4ccbd0 2024-05-08T18:50:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.515+0000 7f190affd640 1 -- 172.21.15.132:0/2471089408 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a30047040 con 0x5576df4ccbd0 2024-05-08T18:50:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.515+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576df4d7590 con 0x5576df4ccbd0 2024-05-08T18:50:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.516+0000 7f190affd640 1 -- 172.21.15.132:0/2471089408 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1a30034070 con 0x5576df4ccbd0 2024-05-08T18:50:48.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.516+0000 7f190affd640 1 --2- 172.21.15.132:0/2471089408 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f190003bba0 0x7f190003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.516+0000 7f190affd640 1 -- 172.21.15.132:0/2471089408 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f1a3000e040 con 0x5576df4ccbd0 2024-05-08T18:50:48.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.516+0000 7f1a35363640 1 --2- 172.21.15.132:0/2471089408 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f190003bba0 0x7f190003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.516+0000 7f1a39723800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.516+0000 7f1a39723800 1 --2- 172.21.15.132:0/2471089408 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5576df4dfd50 0x5576df4e2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.516+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e2960 con 0x5576df4dfd50 2024-05-08T18:50:48.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.516+0000 7f1a2ffff640 1 --2- 172.21.15.132:0/2471089408 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5576df4dfd50 0x5576df4e2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.516+0000 7f1a35363640 1 --2- 172.21.15.132:0/2471089408 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f190003bba0 0x7f190003e060 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1a2802a770 tx=0x7f1a28045000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.516+0000 7f1a2ffff640 1 --2- 172.21.15.132:0/2471089408 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5576df4dfd50 0x5576df4e2210 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.517+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a2005a040 con 0x5576df4dfd50 2024-05-08T18:50:48.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.517+0000 7f1a39723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.517+0000 7f1a39723800 20 realm 2024-05-08T18:50:48.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.517+0000 7f1a39723800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.517+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e2d30 con 0x5576df4dfd50 2024-05-08T18:50:48.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.517+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a2005a040 con 0x5576df4dfd50 2024-05-08T18:50:48.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.517+0000 7f1a39723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.517+0000 7f1a39723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:48.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.517+0000 7f1a39723800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.517+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e3600 con 0x5576df4dfd50 2024-05-08T18:50:48.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.517+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a2005a040 con 0x5576df4dfd50 2024-05-08T18:50:48.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.517+0000 7f1a39723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.517+0000 7f1a39723800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.517+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e39a0 con 0x5576df4dfd50 2024-05-08T18:50:48.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.517+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1a2005a040 con 0x5576df4dfd50 2024-05-08T18:50:48.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.517+0000 7f1a39723800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:48.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.517+0000 7f1a39723800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.517+0000 7f1a39723800 1 --2- 172.21.15.132:0/2471089408 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5576df4e4450 0x5576df4e6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.517+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e6fa0 con 0x5576df4e4450 2024-05-08T18:50:48.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.518+0000 7f1a35b64640 1 --2- 172.21.15.132:0/2471089408 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5576df4e4450 0x5576df4e6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.518+0000 7f1a35b64640 1 --2- 172.21.15.132:0/2471089408 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5576df4e4450 0x5576df4e6840 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.518+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1a3003d070 con 0x5576df4e4450 2024-05-08T18:50:48.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.518+0000 7f1a39723800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:48.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.518+0000 7f1a39723800 20 searching for the correct realm 2024-05-08T18:50:48.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.518+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x5576df4e4450 2024-05-08T18:50:48.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.519+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a3003d070 con 0x5576df4e4450 2024-05-08T18:50:48.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.519+0000 7f1a35b64640 1 --2- 172.21.15.132:0/2471089408 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1a30036070 0x7f1a30007990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.519+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x7f1a30036070 2024-05-08T18:50:48.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.519+0000 7f1a35363640 1 --2- 172.21.15.132:0/2471089408 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1a30036070 0x7f1a30007990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.519+0000 7f1a35363640 1 --2- 172.21.15.132:0/2471089408 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1a30036070 0x7f1a30007990 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.519+0000 7f1a35363640 1 -- 172.21.15.132:0/2471089408 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a28029030 con 0x7f1a30036070 2024-05-08T18:50:48.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.519+0000 7f1a35363640 1 --2- 172.21.15.132:0/2471089408 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1a2802c060 0x7f1a280520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.519+0000 7f1a35363640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x7f1a2802c060 2024-05-08T18:50:48.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.520+0000 7f1a2ffff640 1 --2- 172.21.15.132:0/2471089408 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1a2802c060 0x7f1a280520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.520+0000 7f1a2ffff640 1 --2- 172.21.15.132:0/2471089408 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1a2802c060 0x7f1a280520a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.520+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2005a040 con 0x7f1a2802c060 2024-05-08T18:50:48.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.520+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x5576df4dfd50 2024-05-08T18:50:48.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.521+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2005a040 con 0x5576df4dfd50 2024-05-08T18:50:48.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.521+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x5576df4dfd50 2024-05-08T18:50:48.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.521+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2005a040 con 0x5576df4dfd50 2024-05-08T18:50:48.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.521+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x7f1a2802c060 2024-05-08T18:50:48.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.521+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2005a040 con 0x7f1a2802c060 2024-05-08T18:50:48.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.521+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x7f1a2802c060 2024-05-08T18:50:48.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.521+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2005a040 con 0x7f1a2802c060 2024-05-08T18:50:48.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.521+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x7f1a30036070 2024-05-08T18:50:48.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.521+0000 7f1a35363640 1 -- 172.21.15.132:0/2471089408 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a28029030 con 0x7f1a30036070 2024-05-08T18:50:48.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.521+0000 7f1a35363640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x5576df4e4450 2024-05-08T18:50:48.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.522+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a3003d070 con 0x5576df4e4450 2024-05-08T18:50:48.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.522+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x5576df4dfd50 2024-05-08T18:50:48.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.522+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2005a040 con 0x5576df4dfd50 2024-05-08T18:50:48.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.522+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x7f1a2802c060 2024-05-08T18:50:48.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.522+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2005a040 con 0x7f1a2802c060 2024-05-08T18:50:48.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.522+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x5576df4dfd50 2024-05-08T18:50:48.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.522+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1a2005a040 con 0x5576df4dfd50 2024-05-08T18:50:48.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.522+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x7f1a30036070 2024-05-08T18:50:48.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.523+0000 7f1a35363640 1 -- 172.21.15.132:0/2471089408 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1a28029030 con 0x7f1a30036070 2024-05-08T18:50:48.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.523+0000 7f1a35363640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x5576df4e4450 2024-05-08T18:50:48.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.523+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1a3003d070 con 0x5576df4e4450 2024-05-08T18:50:48.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.523+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x5576df4e4450 2024-05-08T18:50:48.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.523+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a3003d070 con 0x5576df4e4450 2024-05-08T18:50:48.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.523+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x7f1a2802c060 2024-05-08T18:50:48.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.523+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2005a040 con 0x7f1a2802c060 2024-05-08T18:50:48.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.523+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x5576df4e4450 2024-05-08T18:50:48.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.524+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a3003d070 con 0x5576df4e4450 2024-05-08T18:50:48.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.524+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x5576df4e4450 2024-05-08T18:50:48.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.524+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a3003d070 con 0x5576df4e4450 2024-05-08T18:50:48.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.524+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x5576df4dfd50 2024-05-08T18:50:48.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.524+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2005a040 con 0x5576df4dfd50 2024-05-08T18:50:48.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.524+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x5576df4dfd50 2024-05-08T18:50:48.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.524+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1a2005a040 con 0x5576df4dfd50 2024-05-08T18:50:48.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.524+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x7f1a2802c060 2024-05-08T18:50:48.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.524+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2007d040 con 0x7f1a2802c060 2024-05-08T18:50:48.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.524+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x5576df4e4450 2024-05-08T18:50:48.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.525+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a3003d070 con 0x5576df4e4450 2024-05-08T18:50:48.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.525+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x7f1a30036070 2024-05-08T18:50:48.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.525+0000 7f1a35363640 1 -- 172.21.15.132:0/2471089408 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a28029030 con 0x7f1a30036070 2024-05-08T18:50:48.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.525+0000 7f1a35363640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x5576df4dfd50 2024-05-08T18:50:48.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.525+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2007d040 con 0x5576df4dfd50 2024-05-08T18:50:48.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.525+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x7f1a2802c060 2024-05-08T18:50:48.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.525+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2007d040 con 0x7f1a2802c060 2024-05-08T18:50:48.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.525+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x5576df4e4450 2024-05-08T18:50:48.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.526+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a3003d070 con 0x5576df4e4450 2024-05-08T18:50:48.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.526+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x7f1a2802c060 2024-05-08T18:50:48.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.526+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2007d040 con 0x7f1a2802c060 2024-05-08T18:50:48.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.526+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x7f1a30036070 2024-05-08T18:50:48.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.526+0000 7f1a35363640 1 -- 172.21.15.132:0/2471089408 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a28029030 con 0x7f1a30036070 2024-05-08T18:50:48.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.526+0000 7f1a35363640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x5576df4e4450 2024-05-08T18:50:48.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.526+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a3003d070 con 0x5576df4e4450 2024-05-08T18:50:48.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.526+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x7f1a2802c060 2024-05-08T18:50:48.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.527+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a2007d040 con 0x7f1a2802c060 2024-05-08T18:50:48.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.527+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x5576df4dfd50 2024-05-08T18:50:48.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.527+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1a2007d040 con 0x5576df4dfd50 2024-05-08T18:50:48.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.527+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8980 con 0x7f1a30036070 2024-05-08T18:50:48.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.527+0000 7f1a35363640 1 -- 172.21.15.132:0/2471089408 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1a28029030 con 0x7f1a30036070 2024-05-08T18:50:48.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.527+0000 7f1a39723800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:48.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.527+0000 7f1a39723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:48.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.527+0000 7f1a39723800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:48.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.527+0000 7f1a39723800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:48.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.527+0000 7f1a39723800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:48.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.527+0000 7f1a39723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:48.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.527+0000 7f1a39723800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.527+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e7a80 con 0x5576df4dfd50 2024-05-08T18:50:48.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.528+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1a2007d040 con 0x5576df4dfd50 2024-05-08T18:50:48.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.528+0000 7f1a39723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.528+0000 7f1a39723800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.528+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e8320 con 0x5576df4dfd50 2024-05-08T18:50:48.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.528+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1a2007d040 con 0x5576df4dfd50 2024-05-08T18:50:48.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.528+0000 7f1a39723800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:48.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.528+0000 7f1a39723800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.528+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e76c0 con 0x5576df4dfd50 2024-05-08T18:50:48.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.528+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1a2007d040 con 0x5576df4dfd50 2024-05-08T18:50:48.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.528+0000 7f1a39723800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:48.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.528+0000 7f1a39723800 20 zone default found 2024-05-08T18:50:48.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.528+0000 7f1a39723800 4 Realm: () 2024-05-08T18:50:48.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.528+0000 7f1a39723800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:48.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.528+0000 7f1a39723800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:48.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.528+0000 7f1a39723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:48.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.528+0000 7f1a39723800 20 zonegroup default 2024-05-08T18:50:48.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.528+0000 7f1a39723800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.528+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df4e9300 con 0x7f1a2802c060 2024-05-08T18:50:48.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.528+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1a2007d040 con 0x7f1a2802c060 2024-05-08T18:50:48.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.528+0000 7f1a39723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.528+0000 7f1a39723800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.528+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df4ead70 con 0x5576df4e4450 2024-05-08T18:50:48.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.529+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1a3003d070 con 0x5576df4e4450 2024-05-08T18:50:48.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.529+0000 7f1a39723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.529+0000 7f1a39723800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.529+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df4eb1e0 con 0x5576df4e4450 2024-05-08T18:50:48.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.529+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1a3003d070 con 0x5576df4e4450 2024-05-08T18:50:48.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.529+0000 7f1a39723800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.529+0000 7f1a39723800 20 started sync module instance, tier type = 2024-05-08T18:50:48.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.529+0000 7f1a39723800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:48.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.529+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df4ea170 con 0x7f1a30036070 2024-05-08T18:50:48.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.530+0000 7f1a35363640 1 -- 172.21.15.132:0/2471089408 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a28029030 con 0x7f1a30036070 2024-05-08T18:50:48.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.530+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93969040975200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df4ea980 con 0x7f1a30036070 2024-05-08T18:50:48.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.530+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df4ec110 con 0x5576df4dfd50 2024-05-08T18:50:48.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.531+0000 7f1a35363640 1 -- 172.21.15.132:0/2471089408 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93969040975200] v25'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a28029030 con 0x7f1a30036070 2024-05-08T18:50:48.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.531+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a2007d040 con 0x5576df4dfd50 2024-05-08T18:50:48.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.531+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93969040981088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df4ec080 con 0x5576df4dfd50 2024-05-08T18:50:48.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.531+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df4ecfd0 con 0x5576df4e4450 2024-05-08T18:50:48.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.532+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93969040981088] v25'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a2007d040 con 0x5576df4dfd50 2024-05-08T18:50:48.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.532+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a3003d070 con 0x5576df4e4450 2024-05-08T18:50:48.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.532+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93969040983296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df4ecfd0 con 0x5576df4e4450 2024-05-08T18:50:48.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.533+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df4eda20 con 0x7f1a30036070 2024-05-08T18:50:48.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.533+0000 7f1a35363640 1 -- 172.21.15.132:0/2471089408 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a28029030 con 0x7f1a30036070 2024-05-08T18:50:48.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.533+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93969040983296] v25'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a3003d070 con 0x5576df4e4450 2024-05-08T18:50:48.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.533+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93969040984864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df4ecf40 con 0x7f1a30036070 2024-05-08T18:50:48.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.533+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df4ee8e0 con 0x5576df4dfd50 2024-05-08T18:50:48.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.534+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a2007d040 con 0x5576df4dfd50 2024-05-08T18:50:48.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.534+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93969040991760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df4ef180 con 0x5576df4dfd50 2024-05-08T18:50:48.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.534+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df4efc70 con 0x7f1a2802c060 2024-05-08T18:50:48.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.535+0000 7f1a35363640 1 -- 172.21.15.132:0/2471089408 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93969040984864] v25'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a28029030 con 0x7f1a30036070 2024-05-08T18:50:48.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.535+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a2007d040 con 0x7f1a2802c060 2024-05-08T18:50:48.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.535+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93969040996160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df4efc30 con 0x7f1a2802c060 2024-05-08T18:50:48.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.535+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df4f0680 con 0x7f1a2802c060 2024-05-08T18:50:48.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.535+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93969040991760] v25'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a2007d040 con 0x5576df4dfd50 2024-05-08T18:50:48.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.536+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93969040996160] v25'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a2007d040 con 0x7f1a2802c060 2024-05-08T18:50:48.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.537+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a2007d040 con 0x7f1a2802c060 2024-05-08T18:50:48.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.537+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93969040989712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df4f01d0 con 0x7f1a2802c060 2024-05-08T18:50:48.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.537+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df4f0b90 con 0x7f1a2802c060 2024-05-08T18:50:48.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.537+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(58 notify.7 [create] v25'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a2007d040 con 0x7f1a2802c060 2024-05-08T18:50:48.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.537+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93969041000160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df4f0fb0 con 0x7f1a2802c060 2024-05-08T18:50:48.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.537+0000 7f1a39723800 20 add_watcher() i=0 2024-05-08T18:50:48.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.537+0000 7f1a39723800 20 add_watcher() i=1 2024-05-08T18:50:48.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.537+0000 7f1a39723800 20 add_watcher() i=2 2024-05-08T18:50:48.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.537+0000 7f1a39723800 20 add_watcher() i=3 2024-05-08T18:50:48.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.537+0000 7f1a39723800 20 add_watcher() i=4 2024-05-08T18:50:48.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.537+0000 7f1a39723800 20 add_watcher() i=5 2024-05-08T18:50:48.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.538+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93969040989712] v25'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a2007d040 con 0x7f1a2802c060 2024-05-08T18:50:48.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.538+0000 7f1a39723800 20 add_watcher() i=6 2024-05-08T18:50:48.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.538+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93969041000160] v25'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a2007d040 con 0x7f1a2802c060 2024-05-08T18:50:48.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.538+0000 7f1a39723800 20 add_watcher() i=7 2024-05-08T18:50:48.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.538+0000 7f1a39723800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:48.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.538+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df4f0fb0 con 0x5576df4dfd50 2024-05-08T18:50:48.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.539+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1a2007d040 con 0x5576df4dfd50 2024-05-08T18:50:48.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.539+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93969041001216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df4f0f20 con 0x5576df4dfd50 2024-05-08T18:50:48.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.540+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93969041001216] v25'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1a2007d040 con 0x5576df4dfd50 2024-05-08T18:50:48.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.540+0000 7f18eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:48.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.540+0000 7f1a39723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:48.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.540+0000 7f1a39723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:48.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.540+0000 7f1a39723800 5 note: GC not initialized 2024-05-08T18:50:48.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.540+0000 7f18ea7e4640 20 reqs_thread_entry: start 2024-05-08T18:50:48.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.540+0000 7f1a39723800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:48.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.540+0000 7f1a39723800 20 Filter name: none 2024-05-08T18:50:48.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.540+0000 7f185bfff640 20 reqs_thread_entry: start 2024-05-08T18:50:48.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.540+0000 7f1a39723800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.540+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df527450 con 0x7f1a30036070 2024-05-08T18:50:48.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.541+0000 7f1a35363640 1 -- 172.21.15.132:0/2471089408 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1a28029030 con 0x7f1a30036070 2024-05-08T18:50:48.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.541+0000 7f1a39723800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:50:48.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.541+0000 7f1a39723800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.541+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 8.1e 8:7ec7f916:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df527ce0 con 0x7f1a2802c060 2024-05-08T18:50:48.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.542+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(63 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1a2007d040 con 0x7f1a2802c060 2024-05-08T18:50:48.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.542+0000 7f1a39723800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:50:48.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.542+0000 7f1a39723800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:50:48.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.542+0000 7f1a39723800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.542+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df526810 con 0x7f1a30036070 2024-05-08T18:50:48.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.542+0000 7f1a35363640 1 -- 172.21.15.132:0/2471089408 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1a28029030 con 0x7f1a30036070 2024-05-08T18:50:48.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.542+0000 7f1a39723800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:50:48.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.542+0000 7f1a39723800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.542+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:65 8.1e 8:7ec7f916:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df529360 con 0x7f1a2802c060 2024-05-08T18:50:48.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.542+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(65 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1a2007d040 con 0x7f1a2802c060 2024-05-08T18:50:48.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.542+0000 7f1a39723800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:50:48.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.542+0000 7f1a39723800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:50:48.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.542+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:66 4.3d 4:beedfbf8:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df528d40 con 0x5576df4e4450 2024-05-08T18:50:48.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.542+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 4.0 4:01e493d7:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df52d7d0 con 0x5576df4e4450 2024-05-08T18:50:48.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.542+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:68 4.3a 4:5c1a59ec:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df52fce0 con 0x5576df4e4450 2024-05-08T18:50:48.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.542+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 4.4 4:2155dbb4:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df532950 con 0x7f1a2802c060 2024-05-08T18:50:48.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.543+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:70 4.30 4:0edbbef1:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df535430 con 0x5576df4e4450 2024-05-08T18:50:48.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.543+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 4.2 4:435b253f:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df535430 con 0x5576df4dfd50 2024-05-08T18:50:48.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.543+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 4.2a 4:56da7a03:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df53a850 con 0x5576df4dfd50 2024-05-08T18:50:48.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.543+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:73 4.29 4:96c53c8a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df53a850 con 0x5576df4e4450 2024-05-08T18:50:48.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.543+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(67 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1a3003d070 con 0x5576df4e4450 2024-05-08T18:50:48.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.543+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 4.1a 4:5ae0f416:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df53fc90 con 0x7f1a30036070 2024-05-08T18:50:48.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.543+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:75 4.c 4:33d05922:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df542b50 con 0x5576df4dfd50 2024-05-08T18:50:48.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.543+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(69 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1a2007d040 con 0x7f1a2802c060 2024-05-08T18:50:48.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.543+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:76 4.13 4:cba0e3e9:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5576df532420 con 0x7f1a30036070 2024-05-08T18:50:48.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.543+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(68 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1a3003d070 con 0x5576df4e4450 2024-05-08T18:50:48.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.543+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(70 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1a3003d070 con 0x5576df4e4450 2024-05-08T18:50:48.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.543+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(66 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1a3003d070 con 0x5576df4e4450 2024-05-08T18:50:48.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.543+0000 7f1a35363640 1 -- 172.21.15.132:0/2471089408 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(74 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1a28029030 con 0x7f1a30036070 2024-05-08T18:50:48.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.543+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(71 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f1a2007d040 con 0x5576df4dfd50 2024-05-08T18:50:48.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.543+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(72 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1a2007d040 con 0x5576df4dfd50 2024-05-08T18:50:48.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.543+0000 7f1a35363640 1 -- 172.21.15.132:0/2471089408 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(76 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f1a28029030 con 0x7f1a30036070 2024-05-08T18:50:48.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.543+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(75 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1a2007d040 con 0x5576df4dfd50 2024-05-08T18:50:48.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.543+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(73 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1a3003d070 con 0x5576df4e4450 2024-05-08T18:50:48.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.544+0000 7f18eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:48.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.544+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93969041001216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df542b50 con 0x5576df4dfd50 2024-05-08T18:50:48.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.545+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 93969041001216] v25'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1a2007d040 con 0x5576df4dfd50 2024-05-08T18:50:48.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.545+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93969040975200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df50f9d0 con 0x7f1a30036070 2024-05-08T18:50:48.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.546+0000 7f1a35363640 1 -- 172.21.15.132:0/2471089408 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 93969040975200] v25'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a28029030 con 0x7f1a30036070 2024-05-08T18:50:48.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.546+0000 7f1a39723800 20 remove_watcher() i=0 2024-05-08T18:50:48.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.546+0000 7f1a39723800 2 removed watcher, disabling cache 2024-05-08T18:50:48.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.546+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93969040981088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df50f9d0 con 0x5576df4dfd50 2024-05-08T18:50:48.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.547+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 93969040981088] v25'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a2007d040 con 0x5576df4dfd50 2024-05-08T18:50:48.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.547+0000 7f1a39723800 20 remove_watcher() i=1 2024-05-08T18:50:48.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.547+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93969040983296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df50f9d0 con 0x5576df4e4450 2024-05-08T18:50:48.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.548+0000 7f1a35b64640 1 -- 172.21.15.132:0/2471089408 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 93969040983296] v25'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a3003d070 con 0x5576df4e4450 2024-05-08T18:50:48.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.548+0000 7f1a39723800 20 remove_watcher() i=2 2024-05-08T18:50:48.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.548+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93969040984864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df50f9d0 con 0x7f1a30036070 2024-05-08T18:50:48.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.549+0000 7f1a35363640 1 -- 172.21.15.132:0/2471089408 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 93969040984864] v25'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a28029030 con 0x7f1a30036070 2024-05-08T18:50:48.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.549+0000 7f1a39723800 20 remove_watcher() i=3 2024-05-08T18:50:48.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.549+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93969040991760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df50f9d0 con 0x5576df4dfd50 2024-05-08T18:50:48.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.550+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 93969040991760] v25'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a2008b040 con 0x5576df4dfd50 2024-05-08T18:50:48.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.550+0000 7f1a39723800 20 remove_watcher() i=4 2024-05-08T18:50:48.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.550+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93969040996160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df50f9d0 con 0x7f1a2802c060 2024-05-08T18:50:48.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.551+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 93969040996160] v25'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a2008b040 con 0x7f1a2802c060 2024-05-08T18:50:48.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.551+0000 7f1a39723800 20 remove_watcher() i=5 2024-05-08T18:50:48.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.551+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93969040989712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df50f9d0 con 0x7f1a2802c060 2024-05-08T18:50:48.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.552+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 93969040989712] v25'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a2008b040 con 0x7f1a2802c060 2024-05-08T18:50:48.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.552+0000 7f1a39723800 20 remove_watcher() i=6 2024-05-08T18:50:48.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.552+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93969041000160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5576df50f9d0 con 0x7f1a2802c060 2024-05-08T18:50:48.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.553+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 93969041000160] v25'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1a2008b040 con 0x7f1a2802c060 2024-05-08T18:50:48.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.553+0000 7f1a39723800 20 remove_watcher() i=7 2024-05-08T18:50:48.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.553+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1a2802c060 msgr2=0x7f1a280520a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.553+0000 7f1a39723800 1 --2- 172.21.15.132:0/2471089408 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1a2802c060 0x7f1a280520a0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.553+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5576df4dfd50 msgr2=0x5576df4e2210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.553+0000 7f1a39723800 1 --2- 172.21.15.132:0/2471089408 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5576df4dfd50 0x5576df4e2210 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.553+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1a30036070 msgr2=0x7f1a30007990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.553+0000 7f1a39723800 1 --2- 172.21.15.132:0/2471089408 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1a30036070 0x7f1a30007990 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.553+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5576df4e4450 msgr2=0x5576df4e6840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.553+0000 7f1a39723800 1 --2- 172.21.15.132:0/2471089408 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5576df4e4450 0x5576df4e6840 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.553+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f190003bba0 msgr2=0x7f190003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.553+0000 7f1a39723800 1 --2- 172.21.15.132:0/2471089408 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f190003bba0 0x7f190003e060 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1a2802a770 tx=0x7f1a28045000 comp rx=0 tx=0).stop 2024-05-08T18:50:48.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.553+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df4ccbd0 msgr2=0x5576df4d4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.553+0000 7f1a39723800 1 --2- 172.21.15.132:0/2471089408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df4ccbd0 0x5576df4d4110 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1a30011f60 tx=0x7f1a30052b90 comp rx=0 tx=0).stop 2024-05-08T18:50:48.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.553+0000 7f1a2ffff640 1 -- 172.21.15.132:0/2471089408 reap_dead start 2024-05-08T18:50:48.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.553+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 shutdown_connections 2024-05-08T18:50:48.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.553+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 >> 172.21.15.132:0/2471089408 conn(0x5576df4c8e90 msgr2=0x5576df4c6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 shutdown_connections 2024-05-08T18:50:48.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 -- 172.21.15.132:0/2471089408 wait complete. 2024-05-08T18:50:48.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 -- 172.21.15.132:0/4168917118 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f190c03bba0 msgr2=0x7f190c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 --2- 172.21.15.132:0/4168917118 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f190c03bba0 0x7f190c03e060 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x5576df4a9db0 tx=0x7f1a2800ef30 comp rx=0 tx=0).stop 2024-05-08T18:50:48.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 -- 172.21.15.132:0/4168917118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df31eed0 msgr2=0x5576df31d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 --2- 172.21.15.132:0/4168917118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df31eed0 0x5576df31d340 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x5576df4a3050 tx=0x7f1a300188f0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 -- 172.21.15.132:0/4168917118 shutdown_connections 2024-05-08T18:50:48.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 --2- 172.21.15.132:0/4168917118 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f190c03bba0 0x7f190c03e060 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 --2- 172.21.15.132:0/4168917118 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df31eed0 0x5576df31d340 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 -- 172.21.15.132:0/4168917118 >> 172.21.15.132:0/4168917118 conn(0x5576df4b1740 msgr2=0x5576df4b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 -- 172.21.15.132:0/4168917118 shutdown_connections 2024-05-08T18:50:48.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 -- 172.21.15.132:0/4168917118 wait complete. 2024-05-08T18:50:48.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 -- 172.21.15.132:0/2548805757 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5576df3ad6a0 msgr2=0x5576df4a93c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 --2- 172.21.15.132:0/2548805757 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5576df3ad6a0 0x5576df4a93c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 -- 172.21.15.132:0/2548805757 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5576df4abc90 msgr2=0x5576df4ae080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 --2- 172.21.15.132:0/2548805757 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5576df4abc90 0x5576df4ae080 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 -- 172.21.15.132:0/2548805757 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f191c03bb50 msgr2=0x7f191c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 --2- 172.21.15.132:0/2548805757 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f191c03bb50 0x7f191c03e010 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1a20054000 tx=0x7f1a2004e000 comp rx=0 tx=0).stop 2024-05-08T18:50:48.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 -- 172.21.15.132:0/2548805757 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df3a92b0 msgr2=0x5576df4a2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 --2- 172.21.15.132:0/2548805757 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df3a92b0 0x5576df4a2180 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1a28004000 tx=0x7f1a28000bc0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 -- 172.21.15.132:0/2548805757 shutdown_connections 2024-05-08T18:50:48.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 --2- 172.21.15.132:0/2548805757 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5576df4abc90 0x5576df4ae080 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 --2- 172.21.15.132:0/2548805757 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5576df3ad6a0 0x5576df4a93c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 --2- 172.21.15.132:0/2548805757 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f191c03bb50 0x7f191c03e010 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 --2- 172.21.15.132:0/2548805757 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5576df3a92b0 0x5576df4a2180 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 -- 172.21.15.132:0/2548805757 >> 172.21.15.132:0/2548805757 conn(0x5576df3a4830 msgr2=0x5576df494700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.554+0000 7f1a39723800 1 -- 172.21.15.132:0/2548805757 shutdown_connections 2024-05-08T18:50:48.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.555+0000 7f1a39723800 1 -- 172.21.15.132:0/2548805757 wait complete. 2024-05-08T18:50:48.568 INFO:teuthology.orchestra.run.smithi132.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"23dcc2a0-b283-45fd-8c01-831457a34b43","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1","marker":"bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-08T18:50:47.730445Z","creation_time":"2024-05-08T18:50:47.727613Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-05-08T18:50:48.568 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '23dcc2a0-b283-45fd-8c01-831457a34b43', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1', 'marker': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:50:47.730445Z', 'creation_time': '2024-05-08T18:50:47.727613Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T18:50:48.568 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-05-08T18:50:48.568 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-05-08T18:50:48.568 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-05-08T18:50:48.613 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:48.613 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:48.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.615+0000 7f3875830800 1 Processor -- start 2024-05-08T18:50:48.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.615+0000 7f3875830800 1 -- start start 2024-05-08T18:50:48.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.615+0000 7f3875830800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x564f15d03150 0x564f15d03570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.615+0000 7f3875830800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564f15d03bf0 con 0x564f15d043b0 2024-05-08T18:50:48.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.615+0000 7f3875830800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x564f15ba4e20 con 0x564f15d03150 2024-05-08T18:50:48.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.615+0000 7f3870a84640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x564f15d03150 0x564f15d03570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.615+0000 7f386bfff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x564f15d043b0 0x564f15d04830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46958/0 (socket says 172.21.15.132:46958) 2024-05-08T18:50:48.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.615+0000 7f386bfff640 1 -- 172.21.15.132:0/867951332 learned_addr learned my addr 172.21.15.132:0/867951332 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:50:48.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.615+0000 7f3870a84640 1 -- 172.21.15.132:0/867951332 >> v1:172.21.15.42:6789/0 conn(0x564f15d043b0 legacy=0x564f15d04830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.615+0000 7f3870a84640 1 -- 172.21.15.132:0/867951332 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f15d04f70 con 0x564f15d03150 2024-05-08T18:50:48.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.617+0000 7f3870a84640 1 --2- 172.21.15.132:0/867951332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15d03150 0x564f15d03570 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f386400a470 tx=0x7f386401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a328873f66ef09c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.618+0000 7f386b7fe640 1 -- 172.21.15.132:0/867951332 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3864057070 con 0x564f15d03150 2024-05-08T18:50:48.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.618+0000 7f386b7fe640 1 -- 172.21.15.132:0/867951332 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f386404adc0 con 0x564f15d03150 2024-05-08T18:50:48.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.618+0000 7f386b7fe640 1 -- 172.21.15.132:0/867951332 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3864052590 con 0x564f15d03150 2024-05-08T18:50:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.618+0000 7f3875830800 1 -- 172.21.15.132:0/867951332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15d03150 msgr2=0x564f15d03570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.618+0000 7f3875830800 1 --2- 172.21.15.132:0/867951332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15d03150 0x564f15d03570 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f386400a470 tx=0x7f386401ce90 comp rx=0 tx=0).stop 2024-05-08T18:50:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.618+0000 7f3875830800 1 -- 172.21.15.132:0/867951332 shutdown_connections 2024-05-08T18:50:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.618+0000 7f3875830800 1 --2- 172.21.15.132:0/867951332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15d03150 0x564f15d03570 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.618+0000 7f3875830800 1 -- 172.21.15.132:0/867951332 >> 172.21.15.132:0/867951332 conn(0x564f15cfe730 msgr2=0x564f15d00b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.618+0000 7f3875830800 1 -- 172.21.15.132:0/867951332 shutdown_connections 2024-05-08T18:50:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.618+0000 7f3875830800 1 -- 172.21.15.132:0/867951332 wait complete. 2024-05-08T18:50:48.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.631+0000 7f3875830800 1 Processor -- start 2024-05-08T18:50:48.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.631+0000 7f3875830800 1 -- start start 2024-05-08T18:50:48.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.631+0000 7f3875830800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15d03150 0x564f15df3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.632+0000 7f3875830800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564f15c4f5c0 con 0x564f15d03150 2024-05-08T18:50:48.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.632+0000 7f3870a84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15d03150 0x564f15df3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.632+0000 7f3870a84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15d03150 0x564f15df3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32948/0 (socket says 172.21.15.132:32948) 2024-05-08T18:50:48.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.632+0000 7f3870a84640 1 -- 172.21.15.132:0/1068186063 learned_addr learned my addr 172.21.15.132:0/1068186063 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.632+0000 7f3870a84640 1 -- 172.21.15.132:0/1068186063 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f15df3af0 con 0x564f15d03150 2024-05-08T18:50:48.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.632+0000 7f3870a84640 1 --2- 172.21.15.132:0/1068186063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15d03150 0x564f15df3520 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f386401ced0 tx=0x7f386404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2454b04dd93a47 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.633+0000 7f375ee05640 1 -- 172.21.15.132:0/1068186063 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3864057040 con 0x564f15d03150 2024-05-08T18:50:48.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.633+0000 7f375ee05640 1 -- 172.21.15.132:0/1068186063 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3864063070 con 0x564f15d03150 2024-05-08T18:50:48.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.633+0000 7f375ee05640 1 -- 172.21.15.132:0/1068186063 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3864052800 con 0x564f15d03150 2024-05-08T18:50:48.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.633+0000 7f3875830800 1 -- 172.21.15.132:0/1068186063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15d03150 msgr2=0x564f15df3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.633+0000 7f3875830800 1 --2- 172.21.15.132:0/1068186063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15d03150 0x564f15df3520 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f386401ced0 tx=0x7f386404c000 comp rx=0 tx=0).stop 2024-05-08T18:50:48.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.633+0000 7f3875830800 1 -- 172.21.15.132:0/1068186063 shutdown_connections 2024-05-08T18:50:48.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.633+0000 7f3875830800 1 --2- 172.21.15.132:0/1068186063 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15d03150 0x564f15df3520 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.633+0000 7f3875830800 1 -- 172.21.15.132:0/1068186063 >> 172.21.15.132:0/1068186063 conn(0x564f15cfe730 msgr2=0x564f15deee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.633+0000 7f3875830800 1 -- 172.21.15.132:0/1068186063 shutdown_connections 2024-05-08T18:50:48.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.633+0000 7f3875830800 1 -- 172.21.15.132:0/1068186063 wait complete. 2024-05-08T18:50:48.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.634+0000 7f3875830800 1 Processor -- start 2024-05-08T18:50:48.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.634+0000 7f3875830800 1 -- start start 2024-05-08T18:50:48.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.634+0000 7f3875830800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15d03150 0x564f15dfafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.634+0000 7f3875830800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564f15c76a00 con 0x564f15d03150 2024-05-08T18:50:48.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.634+0000 7f3870a84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15d03150 0x564f15dfafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.634+0000 7f3870a84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15d03150 0x564f15dfafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32964/0 (socket says 172.21.15.132:32964) 2024-05-08T18:50:48.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.634+0000 7f3870a84640 1 -- 172.21.15.132:0/3835724520 learned_addr learned my addr 172.21.15.132:0/3835724520 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.634+0000 7f3870a84640 1 -- 172.21.15.132:0/3835724520 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f15dfb510 con 0x564f15d03150 2024-05-08T18:50:48.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.635+0000 7f3870a84640 1 --2- 172.21.15.132:0/3835724520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15d03150 0x564f15dfafd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f386404ad90 tx=0x7f3864002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.635+0000 7f375d602640 1 -- 172.21.15.132:0/3835724520 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f386406d070 con 0x564f15d03150 2024-05-08T18:50:48.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.635+0000 7f375d602640 1 -- 172.21.15.132:0/3835724520 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3864052d00 con 0x564f15d03150 2024-05-08T18:50:48.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.635+0000 7f375d602640 1 -- 172.21.15.132:0/3835724520 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3864057050 con 0x564f15d03150 2024-05-08T18:50:48.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.635+0000 7f3875830800 1 -- 172.21.15.132:0/3835724520 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f15dfb7a0 con 0x564f15d03150 2024-05-08T18:50:48.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.635+0000 7f3875830800 1 -- 172.21.15.132:0/3835724520 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f15dfe450 con 0x564f15d03150 2024-05-08T18:50:48.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.636+0000 7f375d602640 1 -- 172.21.15.132:0/3835724520 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f386405d470 con 0x564f15d03150 2024-05-08T18:50:48.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.636+0000 7f375d602640 1 --2- 172.21.15.132:0/3835724520 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f375803bb50 0x7f375803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.636+0000 7f375d602640 1 -- 172.21.15.132:0/3835724520 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f3864093900 con 0x564f15d03150 2024-05-08T18:50:48.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.636+0000 7f386bfff640 1 --2- 172.21.15.132:0/3835724520 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f375803bb50 0x7f375803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.636+0000 7f3875830800 1 --2- 172.21.15.132:0/3835724520 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564f15d043b0 0x564f15e02210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.636+0000 7f3875830800 1 -- 172.21.15.132:0/3835724520 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e027a0 con 0x564f15d043b0 2024-05-08T18:50:48.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.636+0000 7f3871285640 1 --2- 172.21.15.132:0/3835724520 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564f15d043b0 0x564f15e02210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.636+0000 7f386bfff640 1 --2- 172.21.15.132:0/3835724520 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f375803bb50 0x7f375803e010 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f385c000f60 tx=0x7f385c0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.637+0000 7f3871285640 1 --2- 172.21.15.132:0/3835724520 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564f15d043b0 0x564f15e02210 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.637+0000 7f3871285640 1 -- 172.21.15.132:0/3835724520 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f386c00a4a0 con 0x564f15d043b0 2024-05-08T18:50:48.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.637+0000 7f3875830800 1 -- 172.21.15.132:0/3835724520 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15dff7e0 con 0x564f15d043b0 2024-05-08T18:50:48.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.637+0000 7f3871285640 1 -- 172.21.15.132:0/3835724520 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f386c00a4a0 con 0x564f15d043b0 2024-05-08T18:50:48.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.637+0000 7f3875830800 1 --2- 172.21.15.132:0/3835724520 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564f15e04b40 0x564f15e06f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.637+0000 7f3875830800 1 -- 172.21.15.132:0/3835724520 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e07600 con 0x564f15e04b40 2024-05-08T18:50:48.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.637+0000 7f3870a84640 1 --2- 172.21.15.132:0/3835724520 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564f15e04b40 0x564f15e06f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.637+0000 7f3870a84640 1 --2- 172.21.15.132:0/3835724520 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564f15e04b40 0x564f15e06f30 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.638+0000 7f3870a84640 1 -- 172.21.15.132:0/3835724520 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f386405a040 con 0x564f15e04b40 2024-05-08T18:50:48.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.638+0000 7f3875830800 1 -- 172.21.15.132:0/3835724520 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e039e0 con 0x564f15d043b0 2024-05-08T18:50:48.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.638+0000 7f3871285640 1 -- 172.21.15.132:0/3835724520 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f386c00a4a0 con 0x564f15d043b0 2024-05-08T18:50:48.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.638+0000 7f3875830800 1 -- 172.21.15.132:0/3835724520 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e03e80 con 0x564f15d043b0 2024-05-08T18:50:48.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.638+0000 7f3871285640 1 -- 172.21.15.132:0/3835724520 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f386c00a4a0 con 0x564f15d043b0 2024-05-08T18:50:48.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.639+0000 7f3875830800 1 Processor -- start 2024-05-08T18:50:48.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.639+0000 7f3875830800 1 -- start start 2024-05-08T18:50:48.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.639+0000 7f3875830800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15e16560 0x564f15e16980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.639+0000 7f3875830800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564f15bf5fc0 con 0x564f15e16560 2024-05-08T18:50:48.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.639+0000 7f3871285640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15e16560 0x564f15e16980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.639+0000 7f3871285640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15e16560 0x564f15e16980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32972/0 (socket says 172.21.15.132:32972) 2024-05-08T18:50:48.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.639+0000 7f3871285640 1 -- 172.21.15.132:0/1639749556 learned_addr learned my addr 172.21.15.132:0/1639749556 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.639+0000 7f3871285640 1 -- 172.21.15.132:0/1639749556 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f15e16ec0 con 0x564f15e16560 2024-05-08T18:50:48.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.640+0000 7f3871285640 1 --2- 172.21.15.132:0/1639749556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15e16560 0x564f15e16980 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x564f15e02ba0 tx=0x7f386c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.640+0000 7f37567fc640 1 -- 172.21.15.132:0/1639749556 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f386c014450 con 0x564f15e16560 2024-05-08T18:50:48.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.640+0000 7f37567fc640 1 -- 172.21.15.132:0/1639749556 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f386c0145f0 con 0x564f15e16560 2024-05-08T18:50:48.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.640+0000 7f37567fc640 1 -- 172.21.15.132:0/1639749556 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f386c0148f0 con 0x564f15e16560 2024-05-08T18:50:48.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.640+0000 7f3875830800 1 -- 172.21.15.132:0/1639749556 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f15e17930 con 0x564f15e16560 2024-05-08T18:50:48.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.640+0000 7f3875830800 1 -- 172.21.15.132:0/1639749556 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f15e17e30 con 0x564f15e16560 2024-05-08T18:50:48.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.641+0000 7f37567fc640 1 -- 172.21.15.132:0/1639749556 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f386c011040 con 0x564f15e16560 2024-05-08T18:50:48.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.641+0000 7f37567fc640 1 --2- 172.21.15.132:0/1639749556 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f374803bb50 0x7f374803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.641+0000 7f37567fc640 1 -- 172.21.15.132:0/1639749556 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f386c01e070 con 0x564f15e16560 2024-05-08T18:50:48.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.641+0000 7f3870a84640 1 --2- 172.21.15.132:0/1639749556 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f374803bb50 0x7f374803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.641+0000 7f3875830800 1 Processor -- start 2024-05-08T18:50:48.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.641+0000 7f3875830800 1 -- start start 2024-05-08T18:50:48.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.641+0000 7f3870a84640 1 --2- 172.21.15.132:0/1639749556 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f374803bb50 0x7f374803e010 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x564f15e02c90 tx=0x7f386408e0c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.641+0000 7f3875830800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15e238d0 0x564f15e23cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.641+0000 7f3875830800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564f15df3db0 con 0x564f15e238d0 2024-05-08T18:50:48.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.641+0000 7f3871285640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15e238d0 0x564f15e23cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.642+0000 7f3871285640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15e238d0 0x564f15e23cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32976/0 (socket says 172.21.15.132:32976) 2024-05-08T18:50:48.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.642+0000 7f3871285640 1 -- 172.21.15.132:0/4441365 learned_addr learned my addr 172.21.15.132:0/4441365 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.642+0000 7f3871285640 1 -- 172.21.15.132:0/4441365 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f15e242c0 con 0x564f15e238d0 2024-05-08T18:50:48.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.642+0000 7f3871285640 1 --2- 172.21.15.132:0/4441365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15e238d0 0x564f15e23cf0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f386c001480 tx=0x7f386c0118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7272f56868d12759 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.642+0000 7f3747fff640 1 -- 172.21.15.132:0/4441365 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f386c022db0 con 0x564f15e238d0 2024-05-08T18:50:48.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.642+0000 7f3747fff640 1 -- 172.21.15.132:0/4441365 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f386c011c00 con 0x564f15e238d0 2024-05-08T18:50:48.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.642+0000 7f3747fff640 1 -- 172.21.15.132:0/4441365 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f386c014ae0 con 0x564f15e238d0 2024-05-08T18:50:48.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.643+0000 7f3875830800 1 -- 172.21.15.132:0/4441365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15e238d0 msgr2=0x564f15e23cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.643+0000 7f3875830800 1 --2- 172.21.15.132:0/4441365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15e238d0 0x564f15e23cf0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f386c001480 tx=0x7f386c0118e0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.643+0000 7f3875830800 1 -- 172.21.15.132:0/4441365 shutdown_connections 2024-05-08T18:50:48.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.643+0000 7f3875830800 1 --2- 172.21.15.132:0/4441365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15e238d0 0x564f15e23cf0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.643+0000 7f3875830800 1 -- 172.21.15.132:0/4441365 >> 172.21.15.132:0/4441365 conn(0x564f15e1fbe0 msgr2=0x564f15e1dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.643+0000 7f3875830800 1 -- 172.21.15.132:0/4441365 shutdown_connections 2024-05-08T18:50:48.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.643+0000 7f3875830800 1 -- 172.21.15.132:0/4441365 wait complete. 2024-05-08T18:50:48.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.643+0000 7f3875830800 1 Processor -- start 2024-05-08T18:50:48.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.643+0000 7f3875830800 1 -- start start 2024-05-08T18:50:48.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.643+0000 7f3875830800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15e238d0 0x564f15e2ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.643+0000 7f3875830800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564f15e24a10 con 0x564f15e238d0 2024-05-08T18:50:48.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.643+0000 7f3871285640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15e238d0 0x564f15e2ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.643+0000 7f3871285640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15e238d0 0x564f15e2ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32978/0 (socket says 172.21.15.132:32978) 2024-05-08T18:50:48.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.643+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 learned_addr learned my addr 172.21.15.132:0/1069830862 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.644+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f15e2b370 con 0x564f15e238d0 2024-05-08T18:50:48.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.644+0000 7f3871285640 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15e238d0 0x564f15e2ae30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f386c051ae0 tx=0x7f386c052ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.644+0000 7f37467fc640 1 -- 172.21.15.132:0/1069830862 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f386c031020 con 0x564f15e238d0 2024-05-08T18:50:48.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.644+0000 7f37467fc640 1 -- 172.21.15.132:0/1069830862 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f386c047040 con 0x564f15e238d0 2024-05-08T18:50:48.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.644+0000 7f37467fc640 1 -- 172.21.15.132:0/1069830862 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f386c045040 con 0x564f15e238d0 2024-05-08T18:50:48.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.644+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f15e2b600 con 0x564f15e238d0 2024-05-08T18:50:48.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.644+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f15e2e2b0 con 0x564f15e238d0 2024-05-08T18:50:48.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.645+0000 7f37467fc640 1 -- 172.21.15.132:0/1069830862 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f386c034020 con 0x564f15e238d0 2024-05-08T18:50:48.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.645+0000 7f37467fc640 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f373c03bb50 0x7f373c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.645+0000 7f37467fc640 1 -- 172.21.15.132:0/1069830862 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f386c00e040 con 0x564f15e238d0 2024-05-08T18:50:48.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.645+0000 7f3870a84640 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f373c03bb50 0x7f373c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.645+0000 7f3875830800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.645+0000 7f3875830800 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564f15e36b20 0x564f15e38fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.645+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e39730 con 0x564f15e36b20 2024-05-08T18:50:48.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.645+0000 7f386bfff640 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564f15e36b20 0x564f15e38fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.645+0000 7f3870a84640 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f373c03bb50 0x7f373c03e010 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x564f15e079e0 tx=0x7f386407a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.646+0000 7f386bfff640 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564f15e36b20 0x564f15e38fe0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.646+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f385c009050 con 0x564f15e36b20 2024-05-08T18:50:48.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.646+0000 7f3875830800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.646+0000 7f3875830800 20 realm 2024-05-08T18:50:48.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.646+0000 7f3875830800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.646+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e35fc0 con 0x564f15e36b20 2024-05-08T18:50:48.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.646+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f385c009050 con 0x564f15e36b20 2024-05-08T18:50:48.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.646+0000 7f3875830800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.646+0000 7f3875830800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:48.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.646+0000 7f3875830800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.646+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3a210 con 0x564f15e36b20 2024-05-08T18:50:48.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.646+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f385c009050 con 0x564f15e36b20 2024-05-08T18:50:48.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.646+0000 7f3875830800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.646+0000 7f3875830800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.646+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3aae0 con 0x564f15e36b20 2024-05-08T18:50:48.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.647+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f385c009050 con 0x564f15e36b20 2024-05-08T18:50:48.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.647+0000 7f3875830800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:48.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.647+0000 7f3875830800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.647+0000 7f3875830800 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564f15e3b390 0x564f15e3d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.647+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3dec0 con 0x564f15e3b390 2024-05-08T18:50:48.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.647+0000 7f3871285640 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564f15e3b390 0x564f15e3d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.647+0000 7f3871285640 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564f15e3b390 0x564f15e3d780 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.647+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f386c02a070 con 0x564f15e3b390 2024-05-08T18:50:48.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.647+0000 7f3875830800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:48.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.647+0000 7f3875830800 20 searching for the correct realm 2024-05-08T18:50:48.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.647+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x564f15e3b390 2024-05-08T18:50:48.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.648+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386c02a070 con 0x564f15e3b390 2024-05-08T18:50:48.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.648+0000 7f3871285640 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f386c036020 0x7f386c050460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.648+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x7f386c036020 2024-05-08T18:50:48.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.648+0000 7f3870a84640 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f386c036020 0x7f386c050460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.648+0000 7f3870a84640 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f386c036020 0x7f386c050460 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.649+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386405a040 con 0x7f386c036020 2024-05-08T18:50:48.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.649+0000 7f3870a84640 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f3864093050 0x7f3864066380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.649+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x7f3864093050 2024-05-08T18:50:48.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.649+0000 7f386bfff640 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f3864093050 0x7f3864066380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.649+0000 7f386bfff640 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f3864093050 0x7f3864066380 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.649+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385c009050 con 0x7f3864093050 2024-05-08T18:50:48.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.649+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x564f15e36b20 2024-05-08T18:50:48.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.650+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385c009050 con 0x564f15e36b20 2024-05-08T18:50:48.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.650+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x564f15e36b20 2024-05-08T18:50:48.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.650+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.650+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x7f3864093050 2024-05-08T18:50:48.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.650+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385c029040 con 0x7f3864093050 2024-05-08T18:50:48.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.650+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x7f3864093050 2024-05-08T18:50:48.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.650+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385c029040 con 0x7f3864093050 2024-05-08T18:50:48.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.650+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x7f386c036020 2024-05-08T18:50:48.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.651+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386405a040 con 0x7f386c036020 2024-05-08T18:50:48.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.651+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x564f15e3b390 2024-05-08T18:50:48.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.651+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386c02a070 con 0x564f15e3b390 2024-05-08T18:50:48.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.651+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x564f15e36b20 2024-05-08T18:50:48.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.651+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.651+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x7f3864093050 2024-05-08T18:50:48.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.651+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385c029040 con 0x7f3864093050 2024-05-08T18:50:48.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.652+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x564f15e36b20 2024-05-08T18:50:48.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.652+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.652+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x7f386c036020 2024-05-08T18:50:48.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.652+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f386405a040 con 0x7f386c036020 2024-05-08T18:50:48.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.652+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x564f15e3b390 2024-05-08T18:50:48.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.652+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f386c02a070 con 0x564f15e3b390 2024-05-08T18:50:48.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.652+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x564f15e3b390 2024-05-08T18:50:48.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.652+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386c02a070 con 0x564f15e3b390 2024-05-08T18:50:48.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.652+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x7f3864093050 2024-05-08T18:50:48.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.653+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385c029040 con 0x7f3864093050 2024-05-08T18:50:48.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.653+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x564f15e3b390 2024-05-08T18:50:48.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.653+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386c02a070 con 0x564f15e3b390 2024-05-08T18:50:48.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.653+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x564f15e3b390 2024-05-08T18:50:48.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.653+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386c02a070 con 0x564f15e3b390 2024-05-08T18:50:48.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.653+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x564f15e36b20 2024-05-08T18:50:48.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.653+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.653+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x564f15e36b20 2024-05-08T18:50:48.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.654+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.654+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x7f3864093050 2024-05-08T18:50:48.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.654+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385c029040 con 0x7f3864093050 2024-05-08T18:50:48.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.654+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x564f15e3b390 2024-05-08T18:50:48.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.654+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386c02a070 con 0x564f15e3b390 2024-05-08T18:50:48.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.654+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x7f386c036020 2024-05-08T18:50:48.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.654+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386405a040 con 0x7f386c036020 2024-05-08T18:50:48.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.654+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x564f15e36b20 2024-05-08T18:50:48.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.655+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.655+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x7f3864093050 2024-05-08T18:50:48.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.655+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385c029040 con 0x7f3864093050 2024-05-08T18:50:48.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.655+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x564f15e3b390 2024-05-08T18:50:48.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.655+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386c02a070 con 0x564f15e3b390 2024-05-08T18:50:48.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.655+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x7f3864093050 2024-05-08T18:50:48.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.656+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385c029040 con 0x7f3864093050 2024-05-08T18:50:48.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.656+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x7f386c036020 2024-05-08T18:50:48.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.656+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386405a040 con 0x7f386c036020 2024-05-08T18:50:48.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.656+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x564f15e3b390 2024-05-08T18:50:48.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.656+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386c02a070 con 0x564f15e3b390 2024-05-08T18:50:48.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.656+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x7f3864093050 2024-05-08T18:50:48.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.656+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385c029040 con 0x7f3864093050 2024-05-08T18:50:48.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.656+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x564f15e36b20 2024-05-08T18:50:48.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.657+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.657+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f8a0 con 0x7f386c036020 2024-05-08T18:50:48.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.657+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f386405a040 con 0x7f386c036020 2024-05-08T18:50:48.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.657+0000 7f3875830800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:48.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.657+0000 7f3875830800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:48.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.657+0000 7f3875830800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:48.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.657+0000 7f3875830800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:48.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.657+0000 7f3875830800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:48.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.657+0000 7f3875830800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:48.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.657+0000 7f3875830800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.657+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3e970 con 0x564f15e36b20 2024-05-08T18:50:48.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.657+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.657+0000 7f3875830800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.657+0000 7f3875830800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.657+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3f210 con 0x564f15e36b20 2024-05-08T18:50:48.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.657+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.657+0000 7f3875830800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:48.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.657+0000 7f3875830800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.657+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e3e5b0 con 0x564f15e36b20 2024-05-08T18:50:48.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.658+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.658+0000 7f3875830800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:48.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.658+0000 7f3875830800 20 zone default found 2024-05-08T18:50:48.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.658+0000 7f3875830800 4 Realm: () 2024-05-08T18:50:48.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.658+0000 7f3875830800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:48.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.658+0000 7f3875830800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:48.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.658+0000 7f3875830800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:48.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.658+0000 7f3875830800 20 zonegroup default 2024-05-08T18:50:48.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.658+0000 7f3875830800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.658+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e40220 con 0x7f3864093050 2024-05-08T18:50:48.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.658+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f385c029040 con 0x7f3864093050 2024-05-08T18:50:48.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.658+0000 7f3875830800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.658+0000 7f3875830800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.658+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e41c60 con 0x564f15e3b390 2024-05-08T18:50:48.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.658+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f386c02a070 con 0x564f15e3b390 2024-05-08T18:50:48.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.658+0000 7f3875830800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.658+0000 7f3875830800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.658+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e42110 con 0x564f15e3b390 2024-05-08T18:50:48.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.659+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f386c02a070 con 0x564f15e3b390 2024-05-08T18:50:48.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.659+0000 7f3875830800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.659+0000 7f3875830800 20 started sync module instance, tier type = 2024-05-08T18:50:48.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.659+0000 7f3875830800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:48.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.659+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e41090 con 0x7f386c036020 2024-05-08T18:50:48.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.660+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386405a040 con 0x7f386c036020 2024-05-08T18:50:48.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.660+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94897669674112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e42a20 con 0x7f386c036020 2024-05-08T18:50:48.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.660+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e43270 con 0x564f15e36b20 2024-05-08T18:50:48.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.661+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94897669674112] v25'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386405a040 con 0x7f386c036020 2024-05-08T18:50:48.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.661+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.661+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94897669678448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e43330 con 0x564f15e36b20 2024-05-08T18:50:48.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.661+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e43e50 con 0x564f15e3b390 2024-05-08T18:50:48.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.662+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94897669678448] v25'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.662+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386c02a070 con 0x564f15e3b390 2024-05-08T18:50:48.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.662+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94897669683488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e43e10 con 0x564f15e3b390 2024-05-08T18:50:48.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.662+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e44900 con 0x7f386c036020 2024-05-08T18:50:48.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.663+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386405a040 con 0x7f386c036020 2024-05-08T18:50:48.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.663+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94897669686288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e451d0 con 0x7f386c036020 2024-05-08T18:50:48.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.663+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e45c70 con 0x564f15e36b20 2024-05-08T18:50:48.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.663+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94897669683488] v25'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386c02a070 con 0x564f15e3b390 2024-05-08T18:50:48.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.664+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94897669686288] v25'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386405a040 con 0x7f386c036020 2024-05-08T18:50:48.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.664+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.664+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94897669691200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e44d20 con 0x564f15e36b20 2024-05-08T18:50:48.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.664+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e46510 con 0x7f3864093050 2024-05-08T18:50:48.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.665+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94897669691200] v25'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.666+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c029040 con 0x7f3864093050 2024-05-08T18:50:48.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.666+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94897669680576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e44d20 con 0x7f3864093050 2024-05-08T18:50:48.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.666+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e46b90 con 0x7f3864093050 2024-05-08T18:50:48.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.667+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94897669680576] v25'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c029040 con 0x7f3864093050 2024-05-08T18:50:48.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.667+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c029040 con 0x7f3864093050 2024-05-08T18:50:48.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.667+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94897669695104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e46b50 con 0x7f3864093050 2024-05-08T18:50:48.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.667+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e475d0 con 0x7f3864093050 2024-05-08T18:50:48.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.668+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(58 notify.7 [create] v25'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c029040 con 0x7f3864093050 2024-05-08T18:50:48.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.668+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94897669697824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e479f0 con 0x7f3864093050 2024-05-08T18:50:48.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.668+0000 7f3875830800 20 add_watcher() i=0 2024-05-08T18:50:48.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.668+0000 7f3875830800 20 add_watcher() i=1 2024-05-08T18:50:48.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.668+0000 7f3875830800 20 add_watcher() i=2 2024-05-08T18:50:48.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.668+0000 7f3875830800 20 add_watcher() i=3 2024-05-08T18:50:48.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.668+0000 7f3875830800 20 add_watcher() i=4 2024-05-08T18:50:48.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.668+0000 7f3875830800 20 add_watcher() i=5 2024-05-08T18:50:48.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.668+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94897669695104] v25'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c029040 con 0x7f3864093050 2024-05-08T18:50:48.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.668+0000 7f3875830800 20 add_watcher() i=6 2024-05-08T18:50:48.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.669+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94897669697824] v25'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c029040 con 0x7f3864093050 2024-05-08T18:50:48.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.669+0000 7f3875830800 20 add_watcher() i=7 2024-05-08T18:50:48.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.669+0000 7f3875830800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:48.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.669+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e479f0 con 0x564f15e36b20 2024-05-08T18:50:48.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.670+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.670+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94897669698880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e47960 con 0x564f15e36b20 2024-05-08T18:50:48.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.671+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94897669698880] v25'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.671+0000 7f3726fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:48.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.671+0000 7f3875830800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:48.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.671+0000 7f3875830800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:48.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.671+0000 7f3875830800 5 note: GC not initialized 2024-05-08T18:50:48.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.671+0000 7f3725fe3640 20 reqs_thread_entry: start 2024-05-08T18:50:48.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.671+0000 7f3875830800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:48.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.671+0000 7f3875830800 20 Filter name: none 2024-05-08T18:50:48.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.671+0000 7f36977fe640 20 reqs_thread_entry: start 2024-05-08T18:50:48.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.671+0000 7f3875830800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.671+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e7da60 con 0x564f15e36b20 2024-05-08T18:50:48.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.672+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.672+0000 7f3875830800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:48.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.672+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e7ee50 con 0x7f386c036020 2024-05-08T18:50:48.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.672+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f386405a040 con 0x7f386c036020 2024-05-08T18:50:48.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.672+0000 7f3875830800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.672+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:64 8.1e 8:7ec7f916:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e7ee50 con 0x7f3864093050 2024-05-08T18:50:48.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.673+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(64 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f385c029040 con 0x7f3864093050 2024-05-08T18:50:48.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.673+0000 7f3875830800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:50:48.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.673+0000 7f3875830800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:50:48.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.673+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:65 4.3d 4:beedfbf8:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e80900 con 0x564f15e3b390 2024-05-08T18:50:48.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.673+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:66 4.0 4:01e493d7:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e835b0 con 0x564f15e3b390 2024-05-08T18:50:48.690 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.673+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 4.3a 4:5c1a59ec:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e862e0 con 0x564f15e3b390 2024-05-08T18:50:48.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.673+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:68 4.4 4:2155dbb4:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e88e30 con 0x7f3864093050 2024-05-08T18:50:48.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.673+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 4.30 4:0edbbef1:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e8b6a0 con 0x564f15e3b390 2024-05-08T18:50:48.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.673+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 4.2 4:435b253f:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e8df10 con 0x564f15e36b20 2024-05-08T18:50:48.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.673+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 4.2a 4:56da7a03:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e8b6a0 con 0x564f15e36b20 2024-05-08T18:50:48.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.673+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:72 4.29 4:96c53c8a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e8b6a0 con 0x564f15e3b390 2024-05-08T18:50:48.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.673+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(65 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f386c02a070 con 0x564f15e3b390 2024-05-08T18:50:48.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.673+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:73 4.1a 4:5ae0f416:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e95410 con 0x7f386c036020 2024-05-08T18:50:48.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.673+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:74 4.c 4:33d05922:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e95d80 con 0x564f15e36b20 2024-05-08T18:50:48.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.673+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(66 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f386c02a070 con 0x564f15e3b390 2024-05-08T18:50:48.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.673+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:75 4.13 4:cba0e3e9:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e95410 con 0x7f386c036020 2024-05-08T18:50:48.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.673+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(68 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f385c029040 con 0x7f3864093050 2024-05-08T18:50:48.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.673+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(67 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f386c02a070 con 0x564f15e3b390 2024-05-08T18:50:48.691 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.673+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(69 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f386c02a070 con 0x564f15e3b390 2024-05-08T18:50:48.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.673+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(70 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.674+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(71 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.674+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(74 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.674+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(72 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f386c02a070 con 0x564f15e3b390 2024-05-08T18:50:48.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.674+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(73 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f386405a040 con 0x7f386c036020 2024-05-08T18:50:48.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.674+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(75 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f386405a040 con 0x7f386c036020 2024-05-08T18:50:48.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.674+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e95410 con 0x7f386c036020 2024-05-08T18:50:48.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.675+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(76 foo.buckets [call] v25'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f386405a040 con 0x7f386c036020 2024-05-08T18:50:48.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.675+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e95410 con 0x7f386c036020 2024-05-08T18:50:48.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.676+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(77 foo.buckets [call] v25'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f386405a040 con 0x7f386c036020 2024-05-08T18:50:48.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.676+0000 7f3875830800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.676+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e95410 con 0x564f15e36b20 2024-05-08T18:50:48.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.676+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.692 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.676+0000 7f3875830800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:48.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.676+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564f15e95410 con 0x7f386c036020 2024-05-08T18:50:48.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.676+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f386405a040 con 0x7f386c036020 2024-05-08T18:50:48.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.677+0000 7f3726fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:48.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.677+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94897669698880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e664f0 con 0x564f15e36b20 2024-05-08T18:50:48.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.678+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94897669698880] v25'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.678+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94897669674112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e664f0 con 0x7f386c036020 2024-05-08T18:50:48.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.679+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94897669674112] v25'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386405a040 con 0x7f386c036020 2024-05-08T18:50:48.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.679+0000 7f3875830800 20 remove_watcher() i=0 2024-05-08T18:50:48.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.679+0000 7f3875830800 2 removed watcher, disabling cache 2024-05-08T18:50:48.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.679+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94897669678448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e664f0 con 0x564f15e36b20 2024-05-08T18:50:48.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.680+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94897669678448] v25'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c029040 con 0x564f15e36b20 2024-05-08T18:50:48.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.680+0000 7f3875830800 20 remove_watcher() i=1 2024-05-08T18:50:48.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.680+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94897669683488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e664f0 con 0x564f15e3b390 2024-05-08T18:50:48.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.681+0000 7f3871285640 1 -- 172.21.15.132:0/1069830862 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94897669683488] v25'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386c02a070 con 0x564f15e3b390 2024-05-08T18:50:48.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.681+0000 7f3875830800 20 remove_watcher() i=2 2024-05-08T18:50:48.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.681+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94897669686288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e664f0 con 0x7f386c036020 2024-05-08T18:50:48.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.682+0000 7f3870a84640 1 -- 172.21.15.132:0/1069830862 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94897669686288] v25'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f386405a040 con 0x7f386c036020 2024-05-08T18:50:48.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.682+0000 7f3875830800 20 remove_watcher() i=3 2024-05-08T18:50:48.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.682+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94897669691200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e664f0 con 0x564f15e36b20 2024-05-08T18:50:48.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.683+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94897669691200] v25'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c04f040 con 0x564f15e36b20 2024-05-08T18:50:48.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.683+0000 7f3875830800 20 remove_watcher() i=4 2024-05-08T18:50:48.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.683+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94897669680576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e664f0 con 0x7f3864093050 2024-05-08T18:50:48.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.684+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94897669680576] v25'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c04f040 con 0x7f3864093050 2024-05-08T18:50:48.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.684+0000 7f3875830800 20 remove_watcher() i=5 2024-05-08T18:50:48.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.684+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94897669695104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e664f0 con 0x7f3864093050 2024-05-08T18:50:48.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.685+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94897669695104] v25'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c04f040 con 0x7f3864093050 2024-05-08T18:50:48.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.685+0000 7f3875830800 20 remove_watcher() i=6 2024-05-08T18:50:48.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.685+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94897669697824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564f15e664f0 con 0x7f3864093050 2024-05-08T18:50:48.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.686+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94897669697824] v25'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c04f040 con 0x7f3864093050 2024-05-08T18:50:48.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.686+0000 7f3875830800 20 remove_watcher() i=7 2024-05-08T18:50:48.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.686+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f3864093050 msgr2=0x7f3864066380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.686+0000 7f3875830800 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f3864093050 0x7f3864066380 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.686+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564f15e36b20 msgr2=0x564f15e38fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.686+0000 7f3875830800 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564f15e36b20 0x564f15e38fe0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.686+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f386c036020 msgr2=0x7f386c050460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.686+0000 7f3875830800 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f386c036020 0x7f386c050460 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.686+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564f15e3b390 msgr2=0x564f15e3d780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.686+0000 7f3875830800 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564f15e3b390 0x564f15e3d780 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f373c03bb50 msgr2=0x7f373c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f373c03bb50 0x7f373c03e010 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x564f15e079e0 tx=0x7f386407a000 comp rx=0 tx=0).stop 2024-05-08T18:50:48.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15e238d0 msgr2=0x564f15e2ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f386bfff640 1 -- 172.21.15.132:0/1069830862 reap_dead start 2024-05-08T18:50:48.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15e238d0 0x564f15e2ae30 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f386c051ae0 tx=0x7f386c052ba0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 shutdown_connections 2024-05-08T18:50:48.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 --2- 172.21.15.132:0/1069830862 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15e238d0 0x564f15e2ae30 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 >> 172.21.15.132:0/1069830862 conn(0x564f15e1fbe0 msgr2=0x564f15e1d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 shutdown_connections 2024-05-08T18:50:48.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 -- 172.21.15.132:0/1069830862 wait complete. 2024-05-08T18:50:48.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 -- 172.21.15.132:0/1639749556 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f374803bb50 msgr2=0x7f374803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 --2- 172.21.15.132:0/1639749556 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f374803bb50 0x7f374803e010 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x564f15e02c90 tx=0x7f386408e0c0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 -- 172.21.15.132:0/1639749556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15e16560 msgr2=0x564f15e16980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 --2- 172.21.15.132:0/1639749556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15e16560 0x564f15e16980 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x564f15e02ba0 tx=0x7f386c018830 comp rx=0 tx=0).stop 2024-05-08T18:50:48.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 -- 172.21.15.132:0/1639749556 shutdown_connections 2024-05-08T18:50:48.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 --2- 172.21.15.132:0/1639749556 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f374803bb50 0x7f374803e010 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 --2- 172.21.15.132:0/1639749556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15e16560 0x564f15e16980 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 -- 172.21.15.132:0/1639749556 >> 172.21.15.132:0/1639749556 conn(0x564f15e0a600 msgr2=0x564f15e0aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 -- 172.21.15.132:0/1639749556 shutdown_connections 2024-05-08T18:50:48.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 -- 172.21.15.132:0/1639749556 wait complete. 2024-05-08T18:50:48.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 -- 172.21.15.132:0/3835724520 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564f15d043b0 msgr2=0x564f15e02210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 --2- 172.21.15.132:0/3835724520 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564f15d043b0 0x564f15e02210 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 -- 172.21.15.132:0/3835724520 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564f15e04b40 msgr2=0x564f15e06f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.687+0000 7f3875830800 1 --2- 172.21.15.132:0/3835724520 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564f15e04b40 0x564f15e06f30 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.688+0000 7f3875830800 1 -- 172.21.15.132:0/3835724520 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f375803bb50 msgr2=0x7f375803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.688+0000 7f3875830800 1 --2- 172.21.15.132:0/3835724520 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f375803bb50 0x7f375803e010 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f385c000f60 tx=0x7f385c0012b0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.688+0000 7f3875830800 1 -- 172.21.15.132:0/3835724520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15d03150 msgr2=0x564f15dfafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.688+0000 7f3875830800 1 --2- 172.21.15.132:0/3835724520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15d03150 0x564f15dfafd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f386404ad90 tx=0x7f3864002fb0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.688+0000 7f3875830800 1 -- 172.21.15.132:0/3835724520 shutdown_connections 2024-05-08T18:50:48.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.688+0000 7f3875830800 1 --2- 172.21.15.132:0/3835724520 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564f15e04b40 0x564f15e06f30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.688+0000 7f3875830800 1 --2- 172.21.15.132:0/3835724520 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564f15d043b0 0x564f15e02210 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.688+0000 7f3875830800 1 --2- 172.21.15.132:0/3835724520 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f375803bb50 0x7f375803e010 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.688+0000 7f3875830800 1 --2- 172.21.15.132:0/3835724520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564f15d03150 0x564f15dfafd0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.688+0000 7f3875830800 1 -- 172.21.15.132:0/3835724520 >> 172.21.15.132:0/3835724520 conn(0x564f15cfe730 msgr2=0x564f15ded640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.688+0000 7f3875830800 1 -- 172.21.15.132:0/3835724520 shutdown_connections 2024-05-08T18:50:48.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.688+0000 7f3875830800 1 -- 172.21.15.132:0/3835724520 wait complete. 2024-05-08T18:50:48.700 INFO:teuthology.orchestra.run.smithi132.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-05-08T18:50:48.676489Z","last_stats_update":"2024-05-08T18:50:48.675524Z"} 2024-05-08T18:50:48.700 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-05-08T18:50:48.676489Z', 'last_stats_update': '2024-05-08T18:50:48.675524Z'} 2024-05-08T18:50:48.704 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:50:48.704 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-05-08T18:50:48.705 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-05-08T18:50:48.705 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-05-08T18:50:48.751 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:48.751 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:48.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.752+0000 7f29ac125800 1 Processor -- start 2024-05-08T18:50:48.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.752+0000 7f29ac125800 1 -- start start 2024-05-08T18:50:48.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.752+0000 7f29ac125800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55b955303b70 0x55b955303f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.752+0000 7f29ac125800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b955278660 con 0x55b9553044d0 2024-05-08T18:50:48.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.752+0000 7f29ac125800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55b9551a5e20 con 0x55b955303b70 2024-05-08T18:50:48.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.753+0000 7f29a7eb0640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55b955303b70 0x55b955303f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.753+0000 7f29a7eb0640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55b955303b70 0x55b955303f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:32990/0 (socket says 172.21.15.132:32990) 2024-05-08T18:50:48.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.753+0000 7f29a7eb0640 1 -- 172.21.15.132:0/1110450123 learned_addr learned my addr 172.21.15.132:0/1110450123 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.753+0000 7f299f6af640 1 --1- 172.21.15.132:0/1110450123 >> v1:172.21.15.42:6789/0 conn(0x55b9553044d0 0x55b955304980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46974/0 (socket says 172.21.15.132:46974) 2024-05-08T18:50:48.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.753+0000 7f29a7eb0640 1 -- 172.21.15.132:0/1110450123 >> v1:172.21.15.42:6789/0 conn(0x55b9553044d0 legacy=0x55b955304980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.753+0000 7f29a7eb0640 1 -- 172.21.15.132:0/1110450123 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b955305090 con 0x55b955303b70 2024-05-08T18:50:48.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.755+0000 7f29a7eb0640 1 --2- 172.21.15.132:0/1110450123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955303b70 0x55b955303f90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f299800a520 tx=0x7f299801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3fdbda77f68e272 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.755+0000 7f29a76af640 1 -- 172.21.15.132:0/1110450123 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2998057070 con 0x55b955303b70 2024-05-08T18:50:48.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.755+0000 7f29a76af640 1 -- 172.21.15.132:0/1110450123 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2998052570 con 0x55b955303b70 2024-05-08T18:50:48.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.755+0000 7f29a76af640 1 -- 172.21.15.132:0/1110450123 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f299804ae60 con 0x55b955303b70 2024-05-08T18:50:48.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.755+0000 7f29ac125800 1 -- 172.21.15.132:0/1110450123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955303b70 msgr2=0x55b955303f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.755+0000 7f29ac125800 1 --2- 172.21.15.132:0/1110450123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955303b70 0x55b955303f90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f299800a520 tx=0x7f299801d010 comp rx=0 tx=0).stop 2024-05-08T18:50:48.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.755+0000 7f29ac125800 1 -- 172.21.15.132:0/1110450123 shutdown_connections 2024-05-08T18:50:48.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.755+0000 7f29ac125800 1 --2- 172.21.15.132:0/1110450123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955303b70 0x55b955303f90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.755+0000 7f29ac125800 1 -- 172.21.15.132:0/1110450123 >> 172.21.15.132:0/1110450123 conn(0x55b9552ff730 msgr2=0x55b955301b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.755+0000 7f29ac125800 1 -- 172.21.15.132:0/1110450123 shutdown_connections 2024-05-08T18:50:48.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.755+0000 7f29ac125800 1 -- 172.21.15.132:0/1110450123 wait complete. 2024-05-08T18:50:48.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.769+0000 7f29ac125800 1 Processor -- start 2024-05-08T18:50:48.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.769+0000 7f29ac125800 1 -- start start 2024-05-08T18:50:48.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.769+0000 7f29ac125800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955303b70 0x55b9553f8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.769+0000 7f29ac125800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b9552505c0 con 0x55b955303b70 2024-05-08T18:50:48.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.769+0000 7f29a7eb0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955303b70 0x55b9553f8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.769+0000 7f29a7eb0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955303b70 0x55b9553f8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33006/0 (socket says 172.21.15.132:33006) 2024-05-08T18:50:48.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.769+0000 7f29a7eb0640 1 -- 172.21.15.132:0/3134721899 learned_addr learned my addr 172.21.15.132:0/3134721899 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.770+0000 7f29a7eb0640 1 -- 172.21.15.132:0/3134721899 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9553f9060 con 0x55b955303b70 2024-05-08T18:50:48.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.770+0000 7f29a7eb0640 1 --2- 172.21.15.132:0/3134721899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955303b70 0x55b9553f8a90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2998055040 tx=0x7f299804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb6141e18f0ef9d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.770+0000 7f2895e0b640 1 -- 172.21.15.132:0/3134721899 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2998057040 con 0x55b955303b70 2024-05-08T18:50:48.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.770+0000 7f2895e0b640 1 -- 172.21.15.132:0/3134721899 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2998052720 con 0x55b955303b70 2024-05-08T18:50:48.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.770+0000 7f2895e0b640 1 -- 172.21.15.132:0/3134721899 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2998052a20 con 0x55b955303b70 2024-05-08T18:50:48.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.771+0000 7f29ac125800 1 -- 172.21.15.132:0/3134721899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955303b70 msgr2=0x55b9553f8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.771+0000 7f29ac125800 1 --2- 172.21.15.132:0/3134721899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955303b70 0x55b9553f8a90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2998055040 tx=0x7f299804c000 comp rx=0 tx=0).stop 2024-05-08T18:50:48.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.771+0000 7f29ac125800 1 -- 172.21.15.132:0/3134721899 shutdown_connections 2024-05-08T18:50:48.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.771+0000 7f29ac125800 1 --2- 172.21.15.132:0/3134721899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955303b70 0x55b9553f8a90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.771+0000 7f29ac125800 1 -- 172.21.15.132:0/3134721899 >> 172.21.15.132:0/3134721899 conn(0x55b9552ff730 msgr2=0x55b9553f43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.771+0000 7f29ac125800 1 -- 172.21.15.132:0/3134721899 shutdown_connections 2024-05-08T18:50:48.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.771+0000 7f29ac125800 1 -- 172.21.15.132:0/3134721899 wait complete. 2024-05-08T18:50:48.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.771+0000 7f29ac125800 1 Processor -- start 2024-05-08T18:50:48.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.771+0000 7f29ac125800 1 -- start start 2024-05-08T18:50:48.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.771+0000 7f29ac125800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955303b70 0x55b9554004e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.771+0000 7f29ac125800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b9553055c0 con 0x55b955303b70 2024-05-08T18:50:48.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.772+0000 7f29a7eb0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955303b70 0x55b9554004e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.772+0000 7f29a7eb0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955303b70 0x55b9554004e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33016/0 (socket says 172.21.15.132:33016) 2024-05-08T18:50:48.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.772+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2044596584 learned_addr learned my addr 172.21.15.132:0/2044596584 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.772+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2044596584 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b955400a20 con 0x55b955303b70 2024-05-08T18:50:48.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.772+0000 7f29a7eb0640 1 --2- 172.21.15.132:0/2044596584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955303b70 0x55b9554004e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f29980524f0 tx=0x7f2998003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.772+0000 7f288ffff640 1 -- 172.21.15.132:0/2044596584 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2998073070 con 0x55b955303b70 2024-05-08T18:50:48.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.772+0000 7f288ffff640 1 -- 172.21.15.132:0/2044596584 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f299805d440 con 0x55b955303b70 2024-05-08T18:50:48.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.772+0000 7f29ac125800 1 -- 172.21.15.132:0/2044596584 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b955400cb0 con 0x55b955303b70 2024-05-08T18:50:48.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.772+0000 7f288ffff640 1 -- 172.21.15.132:0/2044596584 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2998057070 con 0x55b955303b70 2024-05-08T18:50:48.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.773+0000 7f29ac125800 1 -- 172.21.15.132:0/2044596584 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9554038c0 con 0x55b955303b70 2024-05-08T18:50:48.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.773+0000 7f288ffff640 1 -- 172.21.15.132:0/2044596584 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2998076070 con 0x55b955303b70 2024-05-08T18:50:48.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.774+0000 7f288ffff640 1 --2- 172.21.15.132:0/2044596584 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f289003bb50 0x7f289003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.774+0000 7f288ffff640 1 -- 172.21.15.132:0/2044596584 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f29980940a0 con 0x55b955303b70 2024-05-08T18:50:48.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.774+0000 7f299f6af640 1 --2- 172.21.15.132:0/2044596584 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f289003bb50 0x7f289003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.774+0000 7f29ac125800 1 --2- 172.21.15.132:0/2044596584 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55b9553044d0 0x55b955407680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.774+0000 7f29ac125800 1 -- 172.21.15.132:0/2044596584 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b955407bc0 con 0x55b9553044d0 2024-05-08T18:50:48.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.774+0000 7f29a86b1640 1 --2- 172.21.15.132:0/2044596584 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55b9553044d0 0x55b955407680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.774+0000 7f299f6af640 1 --2- 172.21.15.132:0/2044596584 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f289003bb50 0x7f289003e010 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2990001e40 tx=0x7f29900013a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.774+0000 7f29a86b1640 1 --2- 172.21.15.132:0/2044596584 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55b9553044d0 0x55b955407680 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.774+0000 7f29a86b1640 1 -- 172.21.15.132:0/2044596584 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29a000a4a0 con 0x55b9553044d0 2024-05-08T18:50:48.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.775+0000 7f29ac125800 1 -- 172.21.15.132:0/2044596584 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b9554084a0 con 0x55b9553044d0 2024-05-08T18:50:48.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.775+0000 7f29a86b1640 1 -- 172.21.15.132:0/2044596584 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f29a000a4a0 con 0x55b9553044d0 2024-05-08T18:50:48.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.775+0000 7f29ac125800 1 --2- 172.21.15.132:0/2044596584 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55b955409db0 0x55b95540c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.775+0000 7f29ac125800 1 -- 172.21.15.132:0/2044596584 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b95540c9e0 con 0x55b955409db0 2024-05-08T18:50:48.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.775+0000 7f29a7eb0640 1 --2- 172.21.15.132:0/2044596584 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55b955409db0 0x55b95540c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.775+0000 7f29a7eb0640 1 --2- 172.21.15.132:0/2044596584 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55b955409db0 0x55b95540c250 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.775+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2044596584 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2998075030 con 0x55b955409db0 2024-05-08T18:50:48.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.775+0000 7f29ac125800 1 -- 172.21.15.132:0/2044596584 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b955408cf0 con 0x55b9553044d0 2024-05-08T18:50:48.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.776+0000 7f29a86b1640 1 -- 172.21.15.132:0/2044596584 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f29a000a4a0 con 0x55b9553044d0 2024-05-08T18:50:48.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.776+0000 7f29ac125800 1 -- 172.21.15.132:0/2044596584 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b9554090d0 con 0x55b9553044d0 2024-05-08T18:50:48.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.776+0000 7f29a86b1640 1 -- 172.21.15.132:0/2044596584 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f29a000a4a0 con 0x55b9553044d0 2024-05-08T18:50:48.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.776+0000 7f29ac125800 1 Processor -- start 2024-05-08T18:50:48.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.776+0000 7f29ac125800 1 -- start start 2024-05-08T18:50:48.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.776+0000 7f29ac125800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b95541b9b0 0x55b95541bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.776+0000 7f29ac125800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b9551f6fc0 con 0x55b95541b9b0 2024-05-08T18:50:48.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.777+0000 7f29a86b1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b95541b9b0 0x55b95541bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.777+0000 7f29a86b1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b95541b9b0 0x55b95541bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33018/0 (socket says 172.21.15.132:33018) 2024-05-08T18:50:48.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.777+0000 7f29a86b1640 1 -- 172.21.15.132:0/120540612 learned_addr learned my addr 172.21.15.132:0/120540612 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.777+0000 7f29a86b1640 1 -- 172.21.15.132:0/120540612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b95541c310 con 0x55b95541b9b0 2024-05-08T18:50:48.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.777+0000 7f29a86b1640 1 --2- 172.21.15.132:0/120540612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b95541b9b0 0x55b95541bdd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x55b955401300 tx=0x7f29a0012fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.777+0000 7f288d7fa640 1 -- 172.21.15.132:0/120540612 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29a0014450 con 0x55b95541b9b0 2024-05-08T18:50:48.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.777+0000 7f288d7fa640 1 -- 172.21.15.132:0/120540612 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a0014610 con 0x55b95541b9b0 2024-05-08T18:50:48.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.777+0000 7f288d7fa640 1 -- 172.21.15.132:0/120540612 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29a0014930 con 0x55b95541b9b0 2024-05-08T18:50:48.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.777+0000 7f29ac125800 1 -- 172.21.15.132:0/120540612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b95541cd80 con 0x55b95541b9b0 2024-05-08T18:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.778+0000 7f29ac125800 1 -- 172.21.15.132:0/120540612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b95541d280 con 0x55b95541b9b0 2024-05-08T18:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.778+0000 7f288d7fa640 1 -- 172.21.15.132:0/120540612 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f29a0011040 con 0x55b95541b9b0 2024-05-08T18:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.778+0000 7f288d7fa640 1 --2- 172.21.15.132:0/120540612 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f288003bba0 0x7f288003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.778+0000 7f288d7fa640 1 -- 172.21.15.132:0/120540612 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f29a001e070 con 0x55b95541b9b0 2024-05-08T18:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.779+0000 7f29a7eb0640 1 --2- 172.21.15.132:0/120540612 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f288003bba0 0x7f288003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.779+0000 7f29ac125800 1 Processor -- start 2024-05-08T18:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.779+0000 7f29a7eb0640 1 --2- 172.21.15.132:0/120540612 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f288003bba0 0x7f288003e060 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55b955404d80 tx=0x7f299805d820 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.779+0000 7f29ac125800 1 -- start start 2024-05-08T18:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.779+0000 7f29ac125800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955428cb0 0x55b9554290d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.779+0000 7f29ac125800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b9553f9320 con 0x55b955428cb0 2024-05-08T18:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.779+0000 7f29a86b1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955428cb0 0x55b9554290d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.779+0000 7f29a86b1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955428cb0 0x55b9554290d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33032/0 (socket says 172.21.15.132:33032) 2024-05-08T18:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.779+0000 7f29a86b1640 1 -- 172.21.15.132:0/455784436 learned_addr learned my addr 172.21.15.132:0/455784436 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.779+0000 7f29a86b1640 1 -- 172.21.15.132:0/455784436 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9554296a0 con 0x55b955428cb0 2024-05-08T18:50:48.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.780+0000 7f29a86b1640 1 --2- 172.21.15.132:0/455784436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955428cb0 0x55b9554290d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f29a0013fd0 tx=0x7f29a00118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47694ecb87ec7c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.780+0000 7f2886ffd640 1 -- 172.21.15.132:0/455784436 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29a0044020 con 0x55b955428cb0 2024-05-08T18:50:48.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.780+0000 7f2886ffd640 1 -- 172.21.15.132:0/455784436 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a0022db0 con 0x55b955428cb0 2024-05-08T18:50:48.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.780+0000 7f2886ffd640 1 -- 172.21.15.132:0/455784436 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29a002bda0 con 0x55b955428cb0 2024-05-08T18:50:48.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.780+0000 7f29ac125800 1 -- 172.21.15.132:0/455784436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955428cb0 msgr2=0x55b9554290d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.780+0000 7f29ac125800 1 --2- 172.21.15.132:0/455784436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955428cb0 0x55b9554290d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f29a0013fd0 tx=0x7f29a00118e0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.780+0000 7f29ac125800 1 -- 172.21.15.132:0/455784436 shutdown_connections 2024-05-08T18:50:48.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.780+0000 7f29ac125800 1 --2- 172.21.15.132:0/455784436 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955428cb0 0x55b9554290d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.780+0000 7f29ac125800 1 -- 172.21.15.132:0/455784436 >> 172.21.15.132:0/455784436 conn(0x55b955424f80 msgr2=0x55b955422fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.780+0000 7f29ac125800 1 -- 172.21.15.132:0/455784436 shutdown_connections 2024-05-08T18:50:48.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.780+0000 7f29ac125800 1 -- 172.21.15.132:0/455784436 wait complete. 2024-05-08T18:50:48.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.781+0000 7f29ac125800 1 Processor -- start 2024-05-08T18:50:48.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.781+0000 7f29ac125800 1 -- start start 2024-05-08T18:50:48.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.781+0000 7f29ac125800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955428cb0 0x55b955430160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.781+0000 7f29ac125800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b955429df0 con 0x55b955428cb0 2024-05-08T18:50:48.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.781+0000 7f29a86b1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955428cb0 0x55b955430160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.781+0000 7f29a86b1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955428cb0 0x55b955430160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33046/0 (socket says 172.21.15.132:33046) 2024-05-08T18:50:48.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.781+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 learned_addr learned my addr 172.21.15.132:0/2370931169 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.781+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9554306a0 con 0x55b955428cb0 2024-05-08T18:50:48.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.781+0000 7f29a86b1640 1 --2- 172.21.15.132:0/2370931169 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955428cb0 0x55b955430160 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f29a0045030 tx=0x7f29a0052ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.781+0000 7f28857fa640 1 -- 172.21.15.132:0/2370931169 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29a00543b0 con 0x55b955428cb0 2024-05-08T18:50:48.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.781+0000 7f28857fa640 1 -- 172.21.15.132:0/2370931169 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a0054550 con 0x55b955428cb0 2024-05-08T18:50:48.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.781+0000 7f28857fa640 1 -- 172.21.15.132:0/2370931169 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29a00409d0 con 0x55b955428cb0 2024-05-08T18:50:48.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.781+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b955430930 con 0x55b955428cb0 2024-05-08T18:50:48.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.782+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9554335e0 con 0x55b955428cb0 2024-05-08T18:50:48.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.782+0000 7f28857fa640 1 -- 172.21.15.132:0/2370931169 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f29a0040b70 con 0x55b955428cb0 2024-05-08T18:50:48.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.782+0000 7f28857fa640 1 --2- 172.21.15.132:0/2370931169 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f287003bb00 0x7f287003dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.782+0000 7f28857fa640 1 -- 172.21.15.132:0/2370931169 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f29a000e040 con 0x55b955428cb0 2024-05-08T18:50:48.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.783+0000 7f29a7eb0640 1 --2- 172.21.15.132:0/2370931169 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f287003bb00 0x7f287003dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.783+0000 7f29a7eb0640 1 --2- 172.21.15.132:0/2370931169 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f287003bb00 0x7f287003dfc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f29980928e0 tx=0x7f2998083000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.783+0000 7f29ac125800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.783+0000 7f29ac125800 1 --2- 172.21.15.132:0/2370931169 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55b95543bed0 0x55b95543e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.783+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b95543eae0 con 0x55b95543bed0 2024-05-08T18:50:48.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.783+0000 7f299f6af640 1 --2- 172.21.15.132:0/2370931169 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55b95543bed0 0x55b95543e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.784+0000 7f299f6af640 1 --2- 172.21.15.132:0/2370931169 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55b95543bed0 0x55b95543e390 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.784+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f299000f670 con 0x55b95543bed0 2024-05-08T18:50:48.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.784+0000 7f29ac125800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.784+0000 7f29ac125800 20 realm 2024-05-08T18:50:48.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.784+0000 7f29ac125800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.784+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b95543b320 con 0x55b95543bed0 2024-05-08T18:50:48.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.784+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f299000f670 con 0x55b95543bed0 2024-05-08T18:50:48.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.784+0000 7f29ac125800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.784+0000 7f29ac125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:48.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.784+0000 7f29ac125800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.784+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b95543f5d0 con 0x55b95543bed0 2024-05-08T18:50:48.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.784+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f299000f670 con 0x55b95543bed0 2024-05-08T18:50:48.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.784+0000 7f29ac125800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.784+0000 7f29ac125800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.784+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b95543fea0 con 0x55b95543bed0 2024-05-08T18:50:48.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.784+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f299000f670 con 0x55b95543bed0 2024-05-08T18:50:48.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.784+0000 7f29ac125800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:48.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.784+0000 7f29ac125800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.784+0000 7f29ac125800 1 --2- 172.21.15.132:0/2370931169 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55b9554407a0 0x55b955442bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.785+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b955443360 con 0x55b9554407a0 2024-05-08T18:50:48.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.785+0000 7f29a86b1640 1 --2- 172.21.15.132:0/2370931169 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55b9554407a0 0x55b955442bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.785+0000 7f29a86b1640 1 --2- 172.21.15.132:0/2370931169 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55b9554407a0 0x55b955442bd0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.785+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f29a003d020 con 0x55b9554407a0 2024-05-08T18:50:48.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.785+0000 7f29ac125800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:48.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.785+0000 7f29ac125800 20 searching for the correct realm 2024-05-08T18:50:48.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.785+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x55b9554407a0 2024-05-08T18:50:48.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.786+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29a003d020 con 0x55b9554407a0 2024-05-08T18:50:48.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.786+0000 7f29a86b1640 1 --2- 172.21.15.132:0/2370931169 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f29a004e040 0x7f29a00419b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.786+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x7f29a004e040 2024-05-08T18:50:48.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.786+0000 7f29a7eb0640 1 --2- 172.21.15.132:0/2370931169 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f29a004e040 0x7f29a00419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.786+0000 7f29a7eb0640 1 --2- 172.21.15.132:0/2370931169 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f29a004e040 0x7f29a00419b0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.786+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2370931169 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2998075030 con 0x7f29a004e040 2024-05-08T18:50:48.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.786+0000 7f29a7eb0640 1 --2- 172.21.15.132:0/2370931169 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2998078060 0x7f29980773b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.786+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x7f2998078060 2024-05-08T18:50:48.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.787+0000 7f299f6af640 1 --2- 172.21.15.132:0/2370931169 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2998078060 0x7f29980773b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.787+0000 7f299f6af640 1 --2- 172.21.15.132:0/2370931169 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2998078060 0x7f29980773b0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.787+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f299000f670 con 0x7f2998078060 2024-05-08T18:50:48.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.787+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x55b95543bed0 2024-05-08T18:50:48.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.787+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f299000f670 con 0x55b95543bed0 2024-05-08T18:50:48.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.787+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x55b95543bed0 2024-05-08T18:50:48.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.788+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f299002b040 con 0x55b95543bed0 2024-05-08T18:50:48.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.788+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x7f2998078060 2024-05-08T18:50:48.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.788+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f299002b040 con 0x7f2998078060 2024-05-08T18:50:48.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.788+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x7f2998078060 2024-05-08T18:50:48.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.788+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f299002b040 con 0x7f2998078060 2024-05-08T18:50:48.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.788+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x7f29a004e040 2024-05-08T18:50:48.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.788+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2370931169 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2998075030 con 0x7f29a004e040 2024-05-08T18:50:48.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.788+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x55b9554407a0 2024-05-08T18:50:48.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.789+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29a003d020 con 0x55b9554407a0 2024-05-08T18:50:48.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.789+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x55b95543bed0 2024-05-08T18:50:48.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.789+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f299002b040 con 0x55b95543bed0 2024-05-08T18:50:48.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.789+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x7f2998078060 2024-05-08T18:50:48.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.789+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f299002b040 con 0x7f2998078060 2024-05-08T18:50:48.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.789+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x55b95543bed0 2024-05-08T18:50:48.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.789+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f299002b040 con 0x55b95543bed0 2024-05-08T18:50:48.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.789+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x7f29a004e040 2024-05-08T18:50:48.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.790+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2370931169 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2998075030 con 0x7f29a004e040 2024-05-08T18:50:48.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.790+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x55b9554407a0 2024-05-08T18:50:48.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.790+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f29a003d020 con 0x55b9554407a0 2024-05-08T18:50:48.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.790+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x55b9554407a0 2024-05-08T18:50:48.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.790+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29a003d020 con 0x55b9554407a0 2024-05-08T18:50:48.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.790+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x7f2998078060 2024-05-08T18:50:48.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.790+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f299002b040 con 0x7f2998078060 2024-05-08T18:50:48.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.790+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x55b9554407a0 2024-05-08T18:50:48.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.791+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29a003d020 con 0x55b9554407a0 2024-05-08T18:50:48.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.791+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x55b9554407a0 2024-05-08T18:50:48.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.791+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29a003d020 con 0x55b9554407a0 2024-05-08T18:50:48.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.791+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x55b95543bed0 2024-05-08T18:50:48.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.791+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f299002b040 con 0x55b95543bed0 2024-05-08T18:50:48.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.791+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x55b95543bed0 2024-05-08T18:50:48.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.791+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f299002b040 con 0x55b95543bed0 2024-05-08T18:50:48.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.791+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x7f2998078060 2024-05-08T18:50:48.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.792+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f299002b040 con 0x7f2998078060 2024-05-08T18:50:48.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.792+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x55b9554407a0 2024-05-08T18:50:48.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.792+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29a003d020 con 0x55b9554407a0 2024-05-08T18:50:48.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.792+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x7f29a004e040 2024-05-08T18:50:48.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.792+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2370931169 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2998075030 con 0x7f29a004e040 2024-05-08T18:50:48.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.792+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x55b95543bed0 2024-05-08T18:50:48.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.792+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f299002b040 con 0x55b95543bed0 2024-05-08T18:50:48.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.792+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x7f2998078060 2024-05-08T18:50:48.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.793+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f299003b040 con 0x7f2998078060 2024-05-08T18:50:48.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.793+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x55b9554407a0 2024-05-08T18:50:48.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.793+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29a003d020 con 0x55b9554407a0 2024-05-08T18:50:48.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.793+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x7f2998078060 2024-05-08T18:50:48.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.793+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f299003b040 con 0x7f2998078060 2024-05-08T18:50:48.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.793+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x7f29a004e040 2024-05-08T18:50:48.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.794+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2370931169 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2998075030 con 0x7f29a004e040 2024-05-08T18:50:48.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.794+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x55b9554407a0 2024-05-08T18:50:48.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.794+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29a003d020 con 0x55b9554407a0 2024-05-08T18:50:48.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.794+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x7f2998078060 2024-05-08T18:50:48.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.794+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f299003b040 con 0x7f2998078060 2024-05-08T18:50:48.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.794+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x55b95543bed0 2024-05-08T18:50:48.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.794+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f299003b040 con 0x55b95543bed0 2024-05-08T18:50:48.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.794+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b955444cb0 con 0x7f29a004e040 2024-05-08T18:50:48.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2370931169 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2998075030 con 0x7f29a004e040 2024-05-08T18:50:48.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:48.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:48.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:48.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:48.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:48.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:48.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b955443d50 con 0x55b95543bed0 2024-05-08T18:50:48.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f299003b040 con 0x55b95543bed0 2024-05-08T18:50:48.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b9554445f0 con 0x55b95543bed0 2024-05-08T18:50:48.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f299003b040 con 0x55b95543bed0 2024-05-08T18:50:48.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:48.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b955445130 con 0x55b95543bed0 2024-05-08T18:50:48.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f299003b040 con 0x55b95543bed0 2024-05-08T18:50:48.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:48.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 20 zone default found 2024-05-08T18:50:48.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 4 Realm: () 2024-05-08T18:50:48.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:48.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:48.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:48.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 20 zonegroup default 2024-05-08T18:50:48.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.795+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b955445170 con 0x7f2998078060 2024-05-08T18:50:48.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.796+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f299003b040 con 0x7f2998078060 2024-05-08T18:50:48.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.796+0000 7f29ac125800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.796+0000 7f29ac125800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.796+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b955446f90 con 0x55b9554407a0 2024-05-08T18:50:48.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.796+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f29a003d020 con 0x55b9554407a0 2024-05-08T18:50:48.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.796+0000 7f29ac125800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.796+0000 7f29ac125800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.796+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b9554473b0 con 0x55b9554407a0 2024-05-08T18:50:48.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.797+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f29a003d020 con 0x55b9554407a0 2024-05-08T18:50:48.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.797+0000 7f29ac125800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.797+0000 7f29ac125800 20 started sync module instance, tier type = 2024-05-08T18:50:48.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.797+0000 7f29ac125800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:48.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.797+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b955446430 con 0x7f29a004e040 2024-05-08T18:50:48.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.798+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2370931169 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2998075030 con 0x7f29a004e040 2024-05-08T18:50:48.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.798+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94254487857184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b955446090 con 0x7f29a004e040 2024-05-08T18:50:48.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.798+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b9554482c0 con 0x55b95543bed0 2024-05-08T18:50:48.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.799+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2370931169 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94254487857184] v25'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2998075030 con 0x7f29a004e040 2024-05-08T18:50:48.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.799+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f299003b040 con 0x55b95543bed0 2024-05-08T18:50:48.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.799+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94254487862800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b9554486e0 con 0x55b95543bed0 2024-05-08T18:50:48.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.799+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b9554490a0 con 0x55b9554407a0 2024-05-08T18:50:48.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.800+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29a003d020 con 0x55b9554407a0 2024-05-08T18:50:48.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.800+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94254487866352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b955449500 con 0x55b9554407a0 2024-05-08T18:50:48.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.800+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b95544a000 con 0x7f29a004e040 2024-05-08T18:50:48.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.800+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94254487862800] v25'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f299003b040 con 0x55b95543bed0 2024-05-08T18:50:48.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.801+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94254487866352] v25'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29a003d020 con 0x55b9554407a0 2024-05-08T18:50:48.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.801+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2370931169 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2998075030 con 0x7f29a004e040 2024-05-08T18:50:48.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.801+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94254487870192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b955449010 con 0x7f29a004e040 2024-05-08T18:50:48.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.801+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b95544a9c0 con 0x55b95543bed0 2024-05-08T18:50:48.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.802+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f299003b040 con 0x55b95543bed0 2024-05-08T18:50:48.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.802+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94254487873264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b95544b140 con 0x55b95543bed0 2024-05-08T18:50:48.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.802+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b95544bc40 con 0x7f2998078060 2024-05-08T18:50:48.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.802+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2370931169 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94254487870192] v25'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2998075030 con 0x7f29a004e040 2024-05-08T18:50:48.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.803+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94254487873264] v25'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f299003b040 con 0x55b95543bed0 2024-05-08T18:50:48.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.803+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f299003b040 con 0x7f2998078060 2024-05-08T18:50:48.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.803+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94254487877424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b95544bc00 con 0x7f2998078060 2024-05-08T18:50:48.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.803+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b95544c510 con 0x7f2998078060 2024-05-08T18:50:48.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.804+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94254487877424] v25'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f299003b040 con 0x7f2998078060 2024-05-08T18:50:48.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.804+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f299003b040 con 0x7f2998078060 2024-05-08T18:50:48.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.804+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94254487863856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b95544bc00 con 0x7f2998078060 2024-05-08T18:50:48.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.804+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b95544cb30 con 0x7f2998078060 2024-05-08T18:50:48.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.805+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(58 notify.7 [create] v25'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f299003b040 con 0x7f2998078060 2024-05-08T18:50:48.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.805+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94254487863856] v25'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f299003b040 con 0x7f2998078060 2024-05-08T18:50:48.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.805+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94254487881344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b95544cf50 con 0x7f2998078060 2024-05-08T18:50:48.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.805+0000 7f29ac125800 20 add_watcher() i=0 2024-05-08T18:50:48.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.805+0000 7f29ac125800 20 add_watcher() i=1 2024-05-08T18:50:48.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.805+0000 7f29ac125800 20 add_watcher() i=2 2024-05-08T18:50:48.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.805+0000 7f29ac125800 20 add_watcher() i=3 2024-05-08T18:50:48.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.805+0000 7f29ac125800 20 add_watcher() i=4 2024-05-08T18:50:48.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.805+0000 7f29ac125800 20 add_watcher() i=5 2024-05-08T18:50:48.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.805+0000 7f29ac125800 20 add_watcher() i=6 2024-05-08T18:50:48.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.806+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94254487881344] v25'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f299003b040 con 0x7f2998078060 2024-05-08T18:50:48.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.806+0000 7f29ac125800 20 add_watcher() i=7 2024-05-08T18:50:48.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.806+0000 7f29ac125800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:48.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.806+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b95544cf50 con 0x55b95543bed0 2024-05-08T18:50:48.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.806+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f299003b040 con 0x55b95543bed0 2024-05-08T18:50:48.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.806+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94254487882400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b95544cec0 con 0x55b95543bed0 2024-05-08T18:50:48.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.807+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94254487882400] v25'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f299003b040 con 0x55b95543bed0 2024-05-08T18:50:48.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.807+0000 7f285dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:48.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.807+0000 7f29ac125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:48.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.807+0000 7f29ac125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:48.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.807+0000 7f29ac125800 5 note: GC not initialized 2024-05-08T18:50:48.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.807+0000 7f285cfe1640 20 reqs_thread_entry: start 2024-05-08T18:50:48.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.808+0000 7f29ac125800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:48.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.808+0000 7f29ac125800 20 Filter name: none 2024-05-08T18:50:48.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.808+0000 7f27d67fc640 20 reqs_thread_entry: start 2024-05-08T18:50:48.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.808+0000 7f29ac125800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:50:48.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.808+0000 7f29ac125800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.808+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b955483490 con 0x55b95543bed0 2024-05-08T18:50:48.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.808+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f299003b040 con 0x55b95543bed0 2024-05-08T18:50:48.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.808+0000 7f29ac125800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:48.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.808+0000 7f29ac125800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:50:48.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.808+0000 7f29ac125800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:48.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.808+0000 7f29ac125800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:48.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.808+0000 7f29ac125800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:50:48.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.808+0000 7f29ac125800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.808+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b955482fb0 con 0x7f29a004e040 2024-05-08T18:50:48.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.808+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2370931169 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2998075030 con 0x7f29a004e040 2024-05-08T18:50:48.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.808+0000 7f29ac125800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:50:48.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.808+0000 7f29ac125800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:50:48.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.808+0000 7f29ac125800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:50:48.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.808+0000 7f29ac125800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 : miss 2024-05-08T18:50:48.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.808+0000 7f29ac125800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.809+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:64 8.1e 8:7ec7f916:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b955486fd0 con 0x7f2998078060 2024-05-08T18:50:48.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.809+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(64 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f299003b040 con 0x7f2998078060 2024-05-08T18:50:48.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.809+0000 7f29ac125800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:50:48.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.809+0000 7f29ac125800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 info.flags=0x17 2024-05-08T18:50:48.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.809+0000 7f29ac125800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 to cache LRU end 2024-05-08T18:50:48.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.809+0000 7f29ac125800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:48.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.809+0000 7f29ac125800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:50:48.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.809+0000 7f29ac125800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 2024-05-08T18:50:48.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.809+0000 7f29ac125800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-05-08T18:50:48.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.809+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b95548a730 con 0x7f29a004e040 2024-05-08T18:50:48.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.810+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2370931169 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(65 foo.buckets [call] v25'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2998075030 con 0x7f29a004e040 2024-05-08T18:50:48.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.810+0000 7f29ac125800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-05-08T18:50:48.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.810+0000 7f29ac125800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.810+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b9554898c0 con 0x7f29a004e040 2024-05-08T18:50:48.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.810+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2370931169 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f2998075030 con 0x7f29a004e040 2024-05-08T18:50:48.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.810+0000 7f29ac125800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:50:48.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.810+0000 7f29ac125800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-05-08T18:50:48.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.810+0000 7f29ac125800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:50:48.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.810+0000 7f29ac125800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:48.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.810+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b95548a550 con 0x7f29a004e040 2024-05-08T18:50:48.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.811+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2370931169 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v25'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f2998075030 con 0x7f29a004e040 2024-05-08T18:50:48.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.811+0000 7f29ac125800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-08T18:50:48.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.811+0000 7f29ac125800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:50:48.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.811+0000 7f29ac125800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:50:48.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.811+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94254488134896 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b95548bfd0 con 0x7f2998078060 2024-05-08T18:50:48.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.812+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== watch-notify(notify (1) cookie 94254487863856 notify 107374182401 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55b9554873c0 con 0x7f2998078060 2024-05-08T18:50:48.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.812+0000 7f2886ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182401 cookie 94254487863856 notifier 4473 bl.length()=338 2024-05-08T18:50:48.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.812+0000 7f2886ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-08T18:50:48.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.812+0000 7f2886ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:50:48.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.812+0000 7f2886ffd640 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f286c003ea0 con 0x7f2998078060 2024-05-08T18:50:48.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.812+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(68 notify.6 [notify cookie 94254488134896 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f299003b040 con 0x7f2998078060 2024-05-08T18:50:48.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.812+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f299003b040 con 0x7f2998078060 2024-05-08T18:50:48.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.812+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== watch-notify(notify_complete (2) cookie 94254488134896 notify 107374182401 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b9554865d0 con 0x7f2998078060 2024-05-08T18:50:48.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.813+0000 7f285dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:48.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.813+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94254487882400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b95548a030 con 0x55b95543bed0 2024-05-08T18:50:48.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.814+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94254487882400] v25'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f299003b040 con 0x55b95543bed0 2024-05-08T18:50:48.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.814+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94254487857184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b95544caa0 con 0x7f29a004e040 2024-05-08T18:50:48.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.815+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2370931169 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94254487857184] v25'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2998075030 con 0x7f29a004e040 2024-05-08T18:50:48.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.815+0000 7f29ac125800 20 remove_watcher() i=0 2024-05-08T18:50:48.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.815+0000 7f29ac125800 2 removed watcher, disabling cache 2024-05-08T18:50:48.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.815+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94254487862800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b955446820 con 0x55b95543bed0 2024-05-08T18:50:48.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.816+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94254487862800] v25'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f299003b040 con 0x55b95543bed0 2024-05-08T18:50:48.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.816+0000 7f29ac125800 20 remove_watcher() i=1 2024-05-08T18:50:48.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.816+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94254487866352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b95544caa0 con 0x55b9554407a0 2024-05-08T18:50:48.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.817+0000 7f29a86b1640 1 -- 172.21.15.132:0/2370931169 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94254487866352] v25'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29a003d020 con 0x55b9554407a0 2024-05-08T18:50:48.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.817+0000 7f29ac125800 20 remove_watcher() i=2 2024-05-08T18:50:48.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.817+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94254487870192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b955447e10 con 0x7f29a004e040 2024-05-08T18:50:48.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.818+0000 7f29a7eb0640 1 -- 172.21.15.132:0/2370931169 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94254487870192] v25'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2998075030 con 0x7f29a004e040 2024-05-08T18:50:48.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.818+0000 7f29ac125800 20 remove_watcher() i=3 2024-05-08T18:50:48.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.818+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94254487873264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b955446820 con 0x55b95543bed0 2024-05-08T18:50:48.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.819+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94254487873264] v25'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f299003b040 con 0x55b95543bed0 2024-05-08T18:50:48.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.819+0000 7f29ac125800 20 remove_watcher() i=4 2024-05-08T18:50:48.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.819+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94254487877424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b955448bf0 con 0x7f2998078060 2024-05-08T18:50:48.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.820+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94254487877424] v25'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f299003b040 con 0x7f2998078060 2024-05-08T18:50:48.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.820+0000 7f29ac125800 20 remove_watcher() i=5 2024-05-08T18:50:48.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.820+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94254487863856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b95544caa0 con 0x7f2998078060 2024-05-08T18:50:48.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.821+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94254487863856] v25'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f299003b040 con 0x7f2998078060 2024-05-08T18:50:48.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.821+0000 7f29ac125800 20 remove_watcher() i=6 2024-05-08T18:50:48.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.821+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94254487881344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b955446820 con 0x7f2998078060 2024-05-08T18:50:48.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94254487881344] v25'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f299003b040 con 0x7f2998078060 2024-05-08T18:50:48.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 20 remove_watcher() i=7 2024-05-08T18:50:48.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2998078060 msgr2=0x7f29980773b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 --2- 172.21.15.132:0/2370931169 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2998078060 0x7f29980773b0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55b95543bed0 msgr2=0x55b95543e390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 --2- 172.21.15.132:0/2370931169 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55b95543bed0 0x55b95543e390 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f29a004e040 msgr2=0x7f29a00419b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 --2- 172.21.15.132:0/2370931169 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f29a004e040 0x7f29a00419b0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55b9554407a0 msgr2=0x55b955442bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 --2- 172.21.15.132:0/2370931169 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55b9554407a0 0x55b955442bd0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f287003bb00 msgr2=0x7f287003dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 --2- 172.21.15.132:0/2370931169 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f287003bb00 0x7f287003dfc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f29980928e0 tx=0x7f2998083000 comp rx=0 tx=0).stop 2024-05-08T18:50:48.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955428cb0 msgr2=0x55b955430160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 --2- 172.21.15.132:0/2370931169 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955428cb0 0x55b955430160 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f29a0045030 tx=0x7f29a0052ca0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 reap_dead start 2024-05-08T18:50:48.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f299f6af640 1 -- 172.21.15.132:0/2370931169 reap_dead start 2024-05-08T18:50:48.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 shutdown_connections 2024-05-08T18:50:48.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 >> 172.21.15.132:0/2370931169 conn(0x55b955424f80 msgr2=0x55b9554225e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 shutdown_connections 2024-05-08T18:50:48.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 -- 172.21.15.132:0/2370931169 wait complete. 2024-05-08T18:50:48.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 -- 172.21.15.132:0/120540612 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f288003bba0 msgr2=0x7f288003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 --2- 172.21.15.132:0/120540612 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f288003bba0 0x7f288003e060 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55b955404d80 tx=0x7f299805d820 comp rx=0 tx=0).stop 2024-05-08T18:50:48.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 -- 172.21.15.132:0/120540612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b95541b9b0 msgr2=0x55b95541bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 --2- 172.21.15.132:0/120540612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b95541b9b0 0x55b95541bdd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x55b955401300 tx=0x7f29a0012fd0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 -- 172.21.15.132:0/120540612 shutdown_connections 2024-05-08T18:50:48.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 --2- 172.21.15.132:0/120540612 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f288003bba0 0x7f288003e060 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 --2- 172.21.15.132:0/120540612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b95541b9b0 0x55b95541bdd0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 -- 172.21.15.132:0/120540612 >> 172.21.15.132:0/120540612 conn(0x55b95540fa50 msgr2=0x55b95540fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 -- 172.21.15.132:0/120540612 shutdown_connections 2024-05-08T18:50:48.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.822+0000 7f29ac125800 1 -- 172.21.15.132:0/120540612 wait complete. 2024-05-08T18:50:48.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.823+0000 7f29ac125800 1 -- 172.21.15.132:0/2044596584 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55b9553044d0 msgr2=0x55b955407680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.823+0000 7f29ac125800 1 --2- 172.21.15.132:0/2044596584 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55b9553044d0 0x55b955407680 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.823+0000 7f29ac125800 1 -- 172.21.15.132:0/2044596584 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55b955409db0 msgr2=0x55b95540c250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.823+0000 7f29ac125800 1 --2- 172.21.15.132:0/2044596584 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55b955409db0 0x55b95540c250 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.823+0000 7f29ac125800 1 -- 172.21.15.132:0/2044596584 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f289003bb50 msgr2=0x7f289003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.823+0000 7f29ac125800 1 --2- 172.21.15.132:0/2044596584 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f289003bb50 0x7f289003e010 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2990001e40 tx=0x7f29900013a0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.823+0000 7f29ac125800 1 -- 172.21.15.132:0/2044596584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955303b70 msgr2=0x55b9554004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.823+0000 7f29ac125800 1 --2- 172.21.15.132:0/2044596584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955303b70 0x55b9554004e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f29980524f0 tx=0x7f2998003020 comp rx=0 tx=0).stop 2024-05-08T18:50:48.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.823+0000 7f29ac125800 1 -- 172.21.15.132:0/2044596584 shutdown_connections 2024-05-08T18:50:48.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.823+0000 7f29ac125800 1 --2- 172.21.15.132:0/2044596584 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55b955409db0 0x55b95540c250 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.823+0000 7f29ac125800 1 --2- 172.21.15.132:0/2044596584 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55b9553044d0 0x55b955407680 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.823+0000 7f29ac125800 1 --2- 172.21.15.132:0/2044596584 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f289003bb50 0x7f289003e010 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.823+0000 7f29ac125800 1 --2- 172.21.15.132:0/2044596584 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b955303b70 0x55b9554004e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.823+0000 7f29ac125800 1 -- 172.21.15.132:0/2044596584 >> 172.21.15.132:0/2044596584 conn(0x55b9552ff730 msgr2=0x55b9553f2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.823+0000 7f29ac125800 1 -- 172.21.15.132:0/2044596584 shutdown_connections 2024-05-08T18:50:48.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.823+0000 7f29ac125800 1 -- 172.21.15.132:0/2044596584 wait complete. 2024-05-08T18:50:48.838 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-08T18:50:48.838 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-08T18:50:48.839 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-05-08T18:50:48.890 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:48.890 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:48.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.892+0000 7f622f335800 1 Processor -- start 2024-05-08T18:50:48.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.892+0000 7f622f335800 1 -- start start 2024-05-08T18:50:48.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.892+0000 7f622f335800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5559520fc6e0 0x5559520fead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.892+0000 7f622f335800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5559520ff0a0 con 0x5559520f82f0 2024-05-08T18:50:48.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.892+0000 7f622f335800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x555951f98e20 con 0x5559520fc6e0 2024-05-08T18:50:48.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.892+0000 7f622a7ad640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5559520fc6e0 0x5559520fead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.892+0000 7f622a7ad640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5559520fc6e0 0x5559520fead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33062/0 (socket says 172.21.15.132:33062) 2024-05-08T18:50:48.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.892+0000 7f622afae640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x5559520f82f0 0x5559520f8710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46990/0 (socket says 172.21.15.132:46990) 2024-05-08T18:50:48.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.892+0000 7f622a7ad640 1 -- 172.21.15.132:0/3111076920 learned_addr learned my addr 172.21.15.132:0/3111076920 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.893+0000 7f622a7ad640 1 -- 172.21.15.132:0/3111076920 >> v1:172.21.15.42:6789/0 conn(0x5559520f82f0 legacy=0x5559520f8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.893+0000 7f622a7ad640 1 -- 172.21.15.132:0/3111076920 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559521002d0 con 0x5559520fc6e0 2024-05-08T18:50:48.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.894+0000 7f622a7ad640 1 --2- 172.21.15.132:0/3111076920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559520fc6e0 0x5559520fead0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f622000a520 tx=0x7f622001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e983e2dbffa1a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.895+0000 7f6229fac640 1 -- 172.21.15.132:0/3111076920 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6220057070 con 0x5559520fc6e0 2024-05-08T18:50:48.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.895+0000 7f6229fac640 1 -- 172.21.15.132:0/3111076920 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6220052570 con 0x5559520fc6e0 2024-05-08T18:50:48.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.895+0000 7f6229fac640 1 -- 172.21.15.132:0/3111076920 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f622004ae60 con 0x5559520fc6e0 2024-05-08T18:50:48.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.895+0000 7f622f335800 1 -- 172.21.15.132:0/3111076920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559520fc6e0 msgr2=0x5559520fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.895+0000 7f622f335800 1 --2- 172.21.15.132:0/3111076920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559520fc6e0 0x5559520fead0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f622000a520 tx=0x7f622001d010 comp rx=0 tx=0).stop 2024-05-08T18:50:48.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.895+0000 7f622f335800 1 -- 172.21.15.132:0/3111076920 shutdown_connections 2024-05-08T18:50:48.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.895+0000 7f622f335800 1 --2- 172.21.15.132:0/3111076920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559520fc6e0 0x5559520fead0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.895+0000 7f622f335800 1 -- 172.21.15.132:0/3111076920 >> 172.21.15.132:0/3111076920 conn(0x5559520f3870 msgr2=0x5559520f5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.896+0000 7f622f335800 1 -- 172.21.15.132:0/3111076920 shutdown_connections 2024-05-08T18:50:48.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.896+0000 7f622f335800 1 -- 172.21.15.132:0/3111076920 wait complete. 2024-05-08T18:50:48.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.909+0000 7f622f335800 1 Processor -- start 2024-05-08T18:50:48.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.909+0000 7f622f335800 1 -- start start 2024-05-08T18:50:48.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.909+0000 7f622f335800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559520f82f0 0x5559521e9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.910+0000 7f622f335800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5559520435f0 con 0x5559520f82f0 2024-05-08T18:50:48.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.910+0000 7f622afae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559520f82f0 0x5559521e9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.910+0000 7f622afae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559520f82f0 0x5559521e9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33070/0 (socket says 172.21.15.132:33070) 2024-05-08T18:50:48.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.910+0000 7f622afae640 1 -- 172.21.15.132:0/474367023 learned_addr learned my addr 172.21.15.132:0/474367023 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.910+0000 7f622afae640 1 -- 172.21.15.132:0/474367023 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559521e9cf0 con 0x5559520f82f0 2024-05-08T18:50:48.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.910+0000 7f622afae640 1 --2- 172.21.15.132:0/474367023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559520f82f0 0x5559521e9720 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f621c00b230 tx=0x7f621c00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0958b9f91d2ded server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.910+0000 7f6118e09640 1 -- 172.21.15.132:0/474367023 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f621c00e5c0 con 0x5559520f82f0 2024-05-08T18:50:48.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.910+0000 7f6118e09640 1 -- 172.21.15.132:0/474367023 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f621c006070 con 0x5559520f82f0 2024-05-08T18:50:48.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.910+0000 7f6118e09640 1 -- 172.21.15.132:0/474367023 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f621c00e890 con 0x5559520f82f0 2024-05-08T18:50:48.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.911+0000 7f622f335800 1 -- 172.21.15.132:0/474367023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559520f82f0 msgr2=0x5559521e9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.911+0000 7f622f335800 1 --2- 172.21.15.132:0/474367023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559520f82f0 0x5559521e9720 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f621c00b230 tx=0x7f621c00b6f0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.911+0000 7f622f335800 1 -- 172.21.15.132:0/474367023 shutdown_connections 2024-05-08T18:50:48.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.911+0000 7f622f335800 1 --2- 172.21.15.132:0/474367023 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559520f82f0 0x5559521e9720 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.911+0000 7f622f335800 1 -- 172.21.15.132:0/474367023 >> 172.21.15.132:0/474367023 conn(0x5559520f3870 msgr2=0x5559521e5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.911+0000 7f622f335800 1 -- 172.21.15.132:0/474367023 shutdown_connections 2024-05-08T18:50:48.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.911+0000 7f622f335800 1 -- 172.21.15.132:0/474367023 wait complete. 2024-05-08T18:50:48.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.911+0000 7f622f335800 1 Processor -- start 2024-05-08T18:50:48.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.912+0000 7f622f335800 1 -- start start 2024-05-08T18:50:48.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.912+0000 7f622f335800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559520f82f0 0x5559521f12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.912+0000 7f622f335800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5559520ff570 con 0x5559520f82f0 2024-05-08T18:50:48.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.912+0000 7f622afae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559520f82f0 0x5559521f12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.912+0000 7f622afae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559520f82f0 0x5559521f12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33072/0 (socket says 172.21.15.132:33072) 2024-05-08T18:50:48.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.912+0000 7f622afae640 1 -- 172.21.15.132:0/3166651748 learned_addr learned my addr 172.21.15.132:0/3166651748 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.912+0000 7f622afae640 1 -- 172.21.15.132:0/3166651748 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559521f1800 con 0x5559520f82f0 2024-05-08T18:50:48.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.912+0000 7f622afae640 1 --2- 172.21.15.132:0/3166651748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559520f82f0 0x5559521f12c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f621c000c00 tx=0x7f621c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.913+0000 7f6117606640 1 -- 172.21.15.132:0/3166651748 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f621c00f8d0 con 0x5559520f82f0 2024-05-08T18:50:48.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.913+0000 7f6117606640 1 -- 172.21.15.132:0/3166651748 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f621c00fa90 con 0x5559520f82f0 2024-05-08T18:50:48.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.913+0000 7f622f335800 1 -- 172.21.15.132:0/3166651748 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559521f1a90 con 0x5559520f82f0 2024-05-08T18:50:48.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.913+0000 7f6117606640 1 -- 172.21.15.132:0/3166651748 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f621c00fdb0 con 0x5559520f82f0 2024-05-08T18:50:48.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.913+0000 7f622f335800 1 -- 172.21.15.132:0/3166651748 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559521f4740 con 0x5559520f82f0 2024-05-08T18:50:48.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.913+0000 7f6117606640 1 -- 172.21.15.132:0/3166651748 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f621c017070 con 0x5559520f82f0 2024-05-08T18:50:48.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.914+0000 7f6117606640 1 --2- 172.21.15.132:0/3166651748 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f611003bb50 0x7f611003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.914+0000 7f6117606640 1 -- 172.21.15.132:0/3166651748 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f621c015020 con 0x5559520f82f0 2024-05-08T18:50:48.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.914+0000 7f622a7ad640 1 --2- 172.21.15.132:0/3166651748 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f611003bb50 0x7f611003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.914+0000 7f622f335800 1 --2- 172.21.15.132:0/3166651748 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5559520fc6e0 0x5559521f8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.914+0000 7f622f335800 1 -- 172.21.15.132:0/3166651748 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5559521f8a80 con 0x5559520fc6e0 2024-05-08T18:50:48.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.914+0000 7f622b7af640 1 --2- 172.21.15.132:0/3166651748 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5559520fc6e0 0x5559521f8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.914+0000 7f622a7ad640 1 --2- 172.21.15.132:0/3166651748 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f611003bb50 0x7f611003e010 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6220054000 tx=0x7f622004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.914+0000 7f622b7af640 1 --2- 172.21.15.132:0/3166651748 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5559520fc6e0 0x5559521f8500 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.915+0000 7f622b7af640 1 -- 172.21.15.132:0/3166651748 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f622400a4a0 con 0x5559520fc6e0 2024-05-08T18:50:48.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.915+0000 7f622f335800 1 -- 172.21.15.132:0/3166651748 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5559521f5ad0 con 0x5559520fc6e0 2024-05-08T18:50:48.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.915+0000 7f622b7af640 1 -- 172.21.15.132:0/3166651748 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f622400a4a0 con 0x5559520fc6e0 2024-05-08T18:50:48.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.915+0000 7f622f335800 1 --2- 172.21.15.132:0/3166651748 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5559521fadb0 0x5559521fd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.915+0000 7f622f335800 1 -- 172.21.15.132:0/3166651748 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5559521fd890 con 0x5559521fadb0 2024-05-08T18:50:48.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.915+0000 7f622afae640 1 --2- 172.21.15.132:0/3166651748 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5559521fadb0 0x5559521fd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.915+0000 7f622afae640 1 --2- 172.21.15.132:0/3166651748 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5559521fadb0 0x5559521fd1a0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.916+0000 7f622afae640 1 -- 172.21.15.132:0/3166651748 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f621c02e070 con 0x5559521fadb0 2024-05-08T18:50:48.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.916+0000 7f622f335800 1 -- 172.21.15.132:0/3166651748 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5559521f9c20 con 0x5559520fc6e0 2024-05-08T18:50:48.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.916+0000 7f622b7af640 1 -- 172.21.15.132:0/3166651748 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f622400a4a0 con 0x5559520fc6e0 2024-05-08T18:50:48.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.916+0000 7f622f335800 1 -- 172.21.15.132:0/3166651748 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5559521fa100 con 0x5559520fc6e0 2024-05-08T18:50:48.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.916+0000 7f622b7af640 1 -- 172.21.15.132:0/3166651748 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f622400a4a0 con 0x5559520fc6e0 2024-05-08T18:50:48.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.916+0000 7f622f335800 1 Processor -- start 2024-05-08T18:50:48.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.917+0000 7f622f335800 1 -- start start 2024-05-08T18:50:48.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.917+0000 7f622f335800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55595206df10 0x55595206c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.917+0000 7f622f335800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555951fe9fc0 con 0x55595206df10 2024-05-08T18:50:48.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.917+0000 7f622b7af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55595206df10 0x55595206c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.917+0000 7f622b7af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55595206df10 0x55595206c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33088/0 (socket says 172.21.15.132:33088) 2024-05-08T18:50:48.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.917+0000 7f622b7af640 1 -- 172.21.15.132:0/2933975405 learned_addr learned my addr 172.21.15.132:0/2933975405 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.917+0000 7f622b7af640 1 -- 172.21.15.132:0/2933975405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55595206c8c0 con 0x55595206df10 2024-05-08T18:50:48.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.917+0000 7f622b7af640 1 --2- 172.21.15.132:0/2933975405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55595206df10 0x55595206c380 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x5559521f8e60 tx=0x7f6224018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.918+0000 7f6114e01640 1 -- 172.21.15.132:0/2933975405 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6224014450 con 0x55595206df10 2024-05-08T18:50:48.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.918+0000 7f6114e01640 1 -- 172.21.15.132:0/2933975405 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6224014610 con 0x55595206df10 2024-05-08T18:50:48.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.918+0000 7f622f335800 1 -- 172.21.15.132:0/2933975405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55595206cb50 con 0x55595206df10 2024-05-08T18:50:48.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.918+0000 7f6114e01640 1 -- 172.21.15.132:0/2933975405 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6224014930 con 0x55595206df10 2024-05-08T18:50:48.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.918+0000 7f622f335800 1 -- 172.21.15.132:0/2933975405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55595206d050 con 0x55595206df10 2024-05-08T18:50:48.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.918+0000 7f6114e01640 1 -- 172.21.15.132:0/2933975405 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6224011040 con 0x55595206df10 2024-05-08T18:50:48.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.919+0000 7f6114e01640 1 --2- 172.21.15.132:0/2933975405 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f610403bba0 0x7f610403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.919+0000 7f6114e01640 1 -- 172.21.15.132:0/2933975405 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f622401e070 con 0x55595206df10 2024-05-08T18:50:48.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.919+0000 7f622afae640 1 --2- 172.21.15.132:0/2933975405 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f610403bba0 0x7f610403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.919+0000 7f622f335800 1 Processor -- start 2024-05-08T18:50:48.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.919+0000 7f622afae640 1 --2- 172.21.15.132:0/2933975405 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f610403bba0 0x7f610403e060 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f621c051950 tx=0x7f621c001540 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.919+0000 7f622f335800 1 -- start start 2024-05-08T18:50:48.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.919+0000 7f622f335800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55595221bc30 0x55595221c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.919+0000 7f622f335800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5559521ea070 con 0x55595221bc30 2024-05-08T18:50:48.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.920+0000 7f622b7af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55595221bc30 0x55595221c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.920+0000 7f622b7af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55595221bc30 0x55595221c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33090/0 (socket says 172.21.15.132:33090) 2024-05-08T18:50:48.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.920+0000 7f622b7af640 1 -- 172.21.15.132:0/637074078 learned_addr learned my addr 172.21.15.132:0/637074078 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.920+0000 7f622b7af640 1 -- 172.21.15.132:0/637074078 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55595221c620 con 0x55595221bc30 2024-05-08T18:50:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.920+0000 7f622b7af640 1 --2- 172.21.15.132:0/637074078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55595221bc30 0x55595221c050 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6224052cb0 tx=0x7f6224011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ba4fc472af65f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.920+0000 7f610e7fc640 1 -- 172.21.15.132:0/637074078 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6224028070 con 0x55595221bc30 2024-05-08T18:50:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.920+0000 7f610e7fc640 1 -- 172.21.15.132:0/637074078 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f622402b350 con 0x55595221bc30 2024-05-08T18:50:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.920+0000 7f610e7fc640 1 -- 172.21.15.132:0/637074078 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62240167e0 con 0x55595221bc30 2024-05-08T18:50:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.921+0000 7f622f335800 1 -- 172.21.15.132:0/637074078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55595221bc30 msgr2=0x55595221c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.921+0000 7f622f335800 1 --2- 172.21.15.132:0/637074078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55595221bc30 0x55595221c050 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6224052cb0 tx=0x7f6224011a80 comp rx=0 tx=0).stop 2024-05-08T18:50:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.921+0000 7f622f335800 1 -- 172.21.15.132:0/637074078 shutdown_connections 2024-05-08T18:50:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.921+0000 7f622f335800 1 --2- 172.21.15.132:0/637074078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55595221bc30 0x55595221c050 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.921+0000 7f622f335800 1 -- 172.21.15.132:0/637074078 >> 172.21.15.132:0/637074078 conn(0x555952217f40 msgr2=0x555952215ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.921+0000 7f622f335800 1 -- 172.21.15.132:0/637074078 shutdown_connections 2024-05-08T18:50:48.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.921+0000 7f622f335800 1 -- 172.21.15.132:0/637074078 wait complete. 2024-05-08T18:50:48.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.921+0000 7f622f335800 1 Processor -- start 2024-05-08T18:50:48.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.921+0000 7f622f335800 1 -- start start 2024-05-08T18:50:48.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.921+0000 7f622f335800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55595221bc30 0x555952223230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.921+0000 7f622f335800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55595221cdf0 con 0x55595221bc30 2024-05-08T18:50:48.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.921+0000 7f622b7af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55595221bc30 0x555952223230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.921+0000 7f622b7af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55595221bc30 0x555952223230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33102/0 (socket says 172.21.15.132:33102) 2024-05-08T18:50:48.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.921+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 learned_addr learned my addr 172.21.15.132:0/2461927969 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:48.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.922+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555952223770 con 0x55595221bc30 2024-05-08T18:50:48.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.922+0000 7f622b7af640 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55595221bc30 0x555952223230 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6224022bf0 tx=0x7f6224052c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.922+0000 7f610cff9640 1 -- 172.21.15.132:0/2461927969 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6224054550 con 0x55595221bc30 2024-05-08T18:50:48.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.922+0000 7f610cff9640 1 -- 172.21.15.132:0/2461927969 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6224031030 con 0x55595221bc30 2024-05-08T18:50:48.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.922+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555952223a00 con 0x55595221bc30 2024-05-08T18:50:48.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.922+0000 7f610cff9640 1 -- 172.21.15.132:0/2461927969 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6224014c20 con 0x55595221bc30 2024-05-08T18:50:48.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.922+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559522266b0 con 0x55595221bc30 2024-05-08T18:50:48.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.923+0000 7f610cff9640 1 -- 172.21.15.132:0/2461927969 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6224054840 con 0x55595221bc30 2024-05-08T18:50:48.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.923+0000 7f610cff9640 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f60f403bba0 0x7f60f403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.923+0000 7f610cff9640 1 -- 172.21.15.132:0/2461927969 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f622400e040 con 0x55595221bc30 2024-05-08T18:50:48.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.923+0000 7f622afae640 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f60f403bba0 0x7f60f403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.923+0000 7f622afae640 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f60f403bba0 0x7f60f403e060 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f621c051bb0 tx=0x7f621c053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.923+0000 7f622f335800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.923+0000 7f622f335800 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55595222ecb0 0x555952231170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.924+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5559522318c0 con 0x55595222ecb0 2024-05-08T18:50:48.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.924+0000 7f622a7ad640 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55595222ecb0 0x555952231170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.924+0000 7f622a7ad640 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55595222ecb0 0x555952231170 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.924+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.924+0000 7f622f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.924+0000 7f622f335800 20 realm 2024-05-08T18:50:48.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.924+0000 7f622f335800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.924+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555952231c90 con 0x55595222ecb0 2024-05-08T18:50:48.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.924+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.924+0000 7f622f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.924+0000 7f622f335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:48.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.924+0000 7f622f335800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.924+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555952232560 con 0x55595222ecb0 2024-05-08T18:50:48.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.925+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.925+0000 7f622f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.925+0000 7f622f335800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.925+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555952232900 con 0x55595222ecb0 2024-05-08T18:50:48.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.925+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.925+0000 7f622f335800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:48.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.925+0000 7f622f335800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.925+0000 7f622f335800 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555952233660 0x555952235a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.925+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555952236060 con 0x555952233660 2024-05-08T18:50:48.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.925+0000 7f622b7af640 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555952233660 0x555952235a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.925+0000 7f622b7af640 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555952233660 0x555952235a50 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.925+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f622402a070 con 0x555952233660 2024-05-08T18:50:48.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.925+0000 7f622f335800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:48.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.925+0000 7f622f335800 20 searching for the correct realm 2024-05-08T18:50:48.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.926+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x555952233660 2024-05-08T18:50:48.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.926+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622402a070 con 0x555952233660 2024-05-08T18:50:48.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.926+0000 7f622b7af640 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6224014070 0x7f622404f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.926+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x7f6224014070 2024-05-08T18:50:48.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.926+0000 7f622afae640 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6224014070 0x7f622404f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.926+0000 7f622afae640 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6224014070 0x7f622404f460 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.927+0000 7f622afae640 1 -- 172.21.15.132:0/2461927969 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621c044d70 con 0x7f6224014070 2024-05-08T18:50:48.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.927+0000 7f622afae640 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f621c00f070 0x7f621c01c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:48.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.927+0000 7f622afae640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x7f621c00f070 2024-05-08T18:50:48.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.927+0000 7f622a7ad640 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f621c00f070 0x7f621c01c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:48.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.927+0000 7f622a7ad640 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f621c00f070 0x7f621c01c820 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:48.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.928+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.928+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x55595222ecb0 2024-05-08T18:50:48.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.928+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.928+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x55595222ecb0 2024-05-08T18:50:48.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.928+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.928+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x7f621c00f070 2024-05-08T18:50:48.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.928+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.928+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x7f621c00f070 2024-05-08T18:50:48.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.929+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.929+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x7f6224014070 2024-05-08T18:50:48.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.929+0000 7f622afae640 1 -- 172.21.15.132:0/2461927969 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621c044d70 con 0x7f6224014070 2024-05-08T18:50:48.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.929+0000 7f622afae640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x555952233660 2024-05-08T18:50:48.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.929+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622402a070 con 0x555952233660 2024-05-08T18:50:48.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.929+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x55595222ecb0 2024-05-08T18:50:48.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.929+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.929+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x7f621c00f070 2024-05-08T18:50:48.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.930+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.930+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x55595222ecb0 2024-05-08T18:50:48.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.930+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.930+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x7f6224014070 2024-05-08T18:50:48.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.930+0000 7f622afae640 1 -- 172.21.15.132:0/2461927969 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f621c044d70 con 0x7f6224014070 2024-05-08T18:50:48.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.930+0000 7f622afae640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x555952233660 2024-05-08T18:50:48.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.930+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f622402a070 con 0x555952233660 2024-05-08T18:50:48.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.930+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x555952233660 2024-05-08T18:50:48.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.931+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622402a070 con 0x555952233660 2024-05-08T18:50:48.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.931+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x7f621c00f070 2024-05-08T18:50:48.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.931+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.931+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x555952233660 2024-05-08T18:50:48.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.931+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622402a070 con 0x555952233660 2024-05-08T18:50:48.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.931+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x555952233660 2024-05-08T18:50:48.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.931+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622402a070 con 0x555952233660 2024-05-08T18:50:48.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.931+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x55595222ecb0 2024-05-08T18:50:48.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.931+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.931+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x55595222ecb0 2024-05-08T18:50:48.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.932+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.932+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x7f621c00f070 2024-05-08T18:50:48.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.932+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.932+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x555952233660 2024-05-08T18:50:48.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.932+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622406b040 con 0x555952233660 2024-05-08T18:50:48.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.932+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x7f6224014070 2024-05-08T18:50:48.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.932+0000 7f622afae640 1 -- 172.21.15.132:0/2461927969 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621c044d70 con 0x7f6224014070 2024-05-08T18:50:48.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.932+0000 7f622afae640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x55595222ecb0 2024-05-08T18:50:48.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.933+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.933+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x7f621c00f070 2024-05-08T18:50:48.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.933+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.933+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x555952233660 2024-05-08T18:50:48.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.933+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622406b040 con 0x555952233660 2024-05-08T18:50:48.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.933+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x7f621c00f070 2024-05-08T18:50:48.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.933+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.933+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x7f6224014070 2024-05-08T18:50:48.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.934+0000 7f622afae640 1 -- 172.21.15.132:0/2461927969 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621c044d70 con 0x7f6224014070 2024-05-08T18:50:48.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.934+0000 7f622afae640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x555952233660 2024-05-08T18:50:48.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.934+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622406b040 con 0x555952233660 2024-05-08T18:50:48.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.934+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x7f621c00f070 2024-05-08T18:50:48.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.934+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.934+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x55595222ecb0 2024-05-08T18:50:48.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.934+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.934+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555952237970 con 0x7f6224014070 2024-05-08T18:50:48.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.935+0000 7f622afae640 1 -- 172.21.15.132:0/2461927969 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f621c044d70 con 0x7f6224014070 2024-05-08T18:50:48.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.935+0000 7f622f335800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:48.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.935+0000 7f622f335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:48.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.935+0000 7f622f335800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:48.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.935+0000 7f622f335800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:48.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.935+0000 7f622f335800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:48.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.935+0000 7f622f335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:48.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.935+0000 7f622f335800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.935+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5559522368b0 con 0x55595222ecb0 2024-05-08T18:50:48.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.935+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.935+0000 7f622f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.935+0000 7f622f335800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.935+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555952236ca0 con 0x55595222ecb0 2024-05-08T18:50:48.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.935+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.935+0000 7f622f335800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:48.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.935+0000 7f622f335800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.935+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555952237df0 con 0x55595222ecb0 2024-05-08T18:50:48.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.935+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.935+0000 7f622f335800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:48.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.936+0000 7f622f335800 20 zone default found 2024-05-08T18:50:48.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.936+0000 7f622f335800 4 Realm: () 2024-05-08T18:50:48.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.936+0000 7f622f335800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:48.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.936+0000 7f622f335800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:48.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.936+0000 7f622f335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:48.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.936+0000 7f622f335800 20 zonegroup default 2024-05-08T18:50:48.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.936+0000 7f622f335800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.936+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5559522381d0 con 0x7f621c00f070 2024-05-08T18:50:48.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.936+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.936+0000 7f622f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.936+0000 7f622f335800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.936+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555952239ff0 con 0x555952233660 2024-05-08T18:50:48.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.936+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f622406b040 con 0x555952233660 2024-05-08T18:50:48.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.936+0000 7f622f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.936+0000 7f622f335800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.936+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55595223a400 con 0x555952233660 2024-05-08T18:50:48.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.936+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f622406b040 con 0x555952233660 2024-05-08T18:50:48.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.936+0000 7f622f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.936+0000 7f622f335800 20 started sync module instance, tier type = 2024-05-08T18:50:48.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.936+0000 7f622f335800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:48.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.936+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555952239490 con 0x7f6224014070 2024-05-08T18:50:48.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.937+0000 7f622afae640 1 -- 172.21.15.132:0/2461927969 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621c044d70 con 0x7f6224014070 2024-05-08T18:50:48.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.937+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93842118514816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5559522390f0 con 0x7f6224014070 2024-05-08T18:50:48.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.938+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55595223b330 con 0x55595222ecb0 2024-05-08T18:50:48.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.938+0000 7f622afae640 1 -- 172.21.15.132:0/2461927969 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93842118514816] v25'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621c044d70 con 0x7f6224014070 2024-05-08T18:50:48.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.939+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.939+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93842118520448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55595223b750 con 0x55595222ecb0 2024-05-08T18:50:48.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.939+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55595223c110 con 0x555952233660 2024-05-08T18:50:48.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.940+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93842118520448] v25'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.940+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622406b040 con 0x555952233660 2024-05-08T18:50:48.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.940+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93842118521984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55595223c110 con 0x555952233660 2024-05-08T18:50:48.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.940+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55595223cb50 con 0x7f6224014070 2024-05-08T18:50:48.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.941+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93842118521984] v25'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622406b040 con 0x555952233660 2024-05-08T18:50:48.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.941+0000 7f622afae640 1 -- 172.21.15.132:0/2461927969 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621c044d70 con 0x7f6224014070 2024-05-08T18:50:48.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.941+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93842118524000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55595223c080 con 0x7f6224014070 2024-05-08T18:50:48.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.941+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55595223da10 con 0x55595222ecb0 2024-05-08T18:50:48.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.942+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.942+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93842118530912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55595223e2b0 con 0x55595222ecb0 2024-05-08T18:50:48.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.943+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55595223ed60 con 0x7f621c00f070 2024-05-08T18:50:48.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.943+0000 7f622afae640 1 -- 172.21.15.132:0/2461927969 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93842118524000] v25'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621c044d70 con 0x7f6224014070 2024-05-08T18:50:48.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.944+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.944+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93842118528832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55595223ed60 con 0x7f621c00f070 2024-05-08T18:50:48.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.944+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55595223f770 con 0x7f621c00f070 2024-05-08T18:50:48.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.944+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93842118530912] v25'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.945+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93842118528832] v25'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.945+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.945+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93842118532608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55595223f2c0 con 0x7f621c00f070 2024-05-08T18:50:48.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.945+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55595223fc80 con 0x7f621c00f070 2024-05-08T18:50:48.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.946+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93842118532608] v25'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.946+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.946+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93842118535232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55595223fc80 con 0x7f621c00f070 2024-05-08T18:50:48.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.946+0000 7f622f335800 20 add_watcher() i=0 2024-05-08T18:50:48.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.946+0000 7f622f335800 20 add_watcher() i=1 2024-05-08T18:50:48.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.946+0000 7f622f335800 20 add_watcher() i=2 2024-05-08T18:50:48.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.946+0000 7f622f335800 20 add_watcher() i=3 2024-05-08T18:50:48.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.946+0000 7f622f335800 20 add_watcher() i=4 2024-05-08T18:50:48.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.946+0000 7f622f335800 20 add_watcher() i=5 2024-05-08T18:50:48.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.946+0000 7f622f335800 20 add_watcher() i=6 2024-05-08T18:50:48.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.947+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93842118535232] v25'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.947+0000 7f622f335800 20 add_watcher() i=7 2024-05-08T18:50:48.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.947+0000 7f622f335800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:48.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.947+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555952242f80 con 0x55595222ecb0 2024-05-08T18:50:48.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.947+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.947+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93842118552032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55595223fdf0 con 0x55595222ecb0 2024-05-08T18:50:48.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.948+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93842118552032] v25'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.948+0000 7f60e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:48.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.948+0000 7f622f335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:48.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.948+0000 7f622f335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:48.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.948+0000 7f622f335800 5 note: GC not initialized 2024-05-08T18:50:48.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.948+0000 7f605bfff640 20 reqs_thread_entry: start 2024-05-08T18:50:48.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.949+0000 7f622f335800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:48.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.949+0000 7f622f335800 20 Filter name: none 2024-05-08T18:50:48.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.949+0000 7f6059ffb640 20 reqs_thread_entry: start 2024-05-08T18:50:48.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.949+0000 7f622f335800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:50:48.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.949+0000 7f622f335800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.949+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555952276530 con 0x7f621c00f070 2024-05-08T18:50:48.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.949+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.949+0000 7f622f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.949+0000 7f622f335800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-08T18:50:48.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.949+0000 7f622f335800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:50:48.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.949+0000 7f622f335800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-08T18:50:48.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.949+0000 7f622f335800 20 rados->read ofs=0 len=0 2024-05-08T18:50:48.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.949+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555952274cd0 con 0x7f621c00f070 2024-05-08T18:50:48.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.949+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.949+0000 7f622f335800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:48.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.949+0000 7f622f335800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-08T18:50:48.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.949+0000 7f622f335800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:50:48.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.950+0000 7f622f335800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T18:50:48.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.950+0000 7f622f335800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T18:50:48.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.950+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5559522755c0 con 0x7f621c00f070 2024-05-08T18:50:48.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.951+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v25'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.951+0000 7f622f335800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-08T18:50:48.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.951+0000 7f622f335800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:50:48.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.951+0000 7f622f335800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-08T18:50:48.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.951+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 93842118758672 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555952279e70 con 0x7f621c00f070 2024-05-08T18:50:48.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.951+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== watch-notify(notify (1) cookie 93842118528832 notify 107374182402 ret 0) ==== 598+0+0 (crc 0 0 0) 0x555952275960 con 0x7f621c00f070 2024-05-08T18:50:48.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.951+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(65 notify.5 [notify cookie 93842118758672 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.951+0000 7f610e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182402 cookie 93842118528832 notifier 4480 bl.length()=556 2024-05-08T18:50:48.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.951+0000 7f610e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-08T18:50:48.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.951+0000 7f610e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:50:48.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.951+0000 7f610e7fc640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f60f0003ea0 con 0x7f621c00f070 2024-05-08T18:50:48.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.951+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.951+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== watch-notify(notify_complete (2) cookie 93842118758672 notify 107374182402 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5559521002d0 con 0x7f621c00f070 2024-05-08T18:50:48.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.951+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5559522750c0 con 0x7f621c00f070 2024-05-08T18:50:48.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.953+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v25'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.953+0000 7f622f335800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:50:48.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.953+0000 7f622f335800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:50:48.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.953+0000 7f622f335800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:50:48.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.953+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93842118758592 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555952279e50 con 0x555952233660 2024-05-08T18:50:48.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.953+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== watch-notify(notify (1) cookie 93842118521984 notify 107374182402 ret 0) ==== 219+0+0 (crc 0 0 0) 0x555952223a00 con 0x555952233660 2024-05-08T18:50:48.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.953+0000 7f610e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182402 cookie 93842118521984 notifier 4480 bl.length()=177 2024-05-08T18:50:48.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.953+0000 7f610e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:50:48.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.953+0000 7f610e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:50:48.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.953+0000 7f610e7fc640 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f60f0003ea0 con 0x555952233660 2024-05-08T18:50:48.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.953+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(68 notify.2 [notify cookie 93842118758592 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f622406b040 con 0x555952233660 2024-05-08T18:50:48.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.954+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== watch-notify(notify_complete (2) cookie 93842118758592 notify 107374182402 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555952223770 con 0x555952233660 2024-05-08T18:50:48.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.954+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622406b040 con 0x555952233660 2024-05-08T18:50:48.976 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-08T18:50:48.951115Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:48.951092Z","tags":[],"group_ids":[]} 2024-05-08T18:50:48.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.954+0000 7f60e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:48.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.954+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93842118552032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555952241c50 con 0x55595222ecb0 2024-05-08T18:50:48.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.955+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93842118552032] v25'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.955+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93842118514816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5559522429e0 con 0x7f6224014070 2024-05-08T18:50:48.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.956+0000 7f622afae640 1 -- 172.21.15.132:0/2461927969 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93842118514816] v25'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621c044d70 con 0x7f6224014070 2024-05-08T18:50:48.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.956+0000 7f622f335800 20 remove_watcher() i=0 2024-05-08T18:50:48.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.956+0000 7f622f335800 2 removed watcher, disabling cache 2024-05-08T18:50:48.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.956+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93842118520448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555952239880 con 0x55595222ecb0 2024-05-08T18:50:48.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.958+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93842118520448] v25'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.958+0000 7f622f335800 20 remove_watcher() i=1 2024-05-08T18:50:48.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.958+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93842118521984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555952239880 con 0x555952233660 2024-05-08T18:50:48.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.959+0000 7f622b7af640 1 -- 172.21.15.132:0/2461927969 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93842118521984] v25'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622406b040 con 0x555952233660 2024-05-08T18:50:48.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.959+0000 7f622f335800 20 remove_watcher() i=2 2024-05-08T18:50:48.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.959+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93842118524000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55595223b480 con 0x7f6224014070 2024-05-08T18:50:48.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.960+0000 7f622afae640 1 -- 172.21.15.132:0/2461927969 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93842118524000] v25'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f621c044d70 con 0x7f6224014070 2024-05-08T18:50:48.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.960+0000 7f622f335800 20 remove_watcher() i=3 2024-05-08T18:50:48.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.960+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93842118530912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555952239880 con 0x55595222ecb0 2024-05-08T18:50:48.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.961+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93842118530912] v25'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622005a040 con 0x55595222ecb0 2024-05-08T18:50:48.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.961+0000 7f622f335800 20 remove_watcher() i=4 2024-05-08T18:50:48.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.961+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93842118528832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55595223bc60 con 0x7f621c00f070 2024-05-08T18:50:48.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.962+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93842118528832] v25'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.962+0000 7f622f335800 20 remove_watcher() i=5 2024-05-08T18:50:48.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.962+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93842118532608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55595223b480 con 0x7f621c00f070 2024-05-08T18:50:48.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.963+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93842118532608] v25'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.963+0000 7f622f335800 20 remove_watcher() i=6 2024-05-08T18:50:48.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.963+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93842118535232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55595223d760 con 0x7f621c00f070 2024-05-08T18:50:48.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.964+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93842118535232] v25'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f622005a040 con 0x7f621c00f070 2024-05-08T18:50:48.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.964+0000 7f622f335800 20 remove_watcher() i=7 2024-05-08T18:50:48.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.964+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f621c00f070 msgr2=0x7f621c01c820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.964+0000 7f622f335800 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f621c00f070 0x7f621c01c820 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.964+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55595222ecb0 msgr2=0x555952231170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.964+0000 7f622f335800 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55595222ecb0 0x555952231170 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.964+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6224014070 msgr2=0x7f622404f460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.964+0000 7f622f335800 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6224014070 0x7f622404f460 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.964+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555952233660 msgr2=0x555952235a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.964+0000 7f622f335800 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555952233660 0x555952235a50 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.964+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f60f403bba0 msgr2=0x7f60f403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.964+0000 7f622f335800 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f60f403bba0 0x7f60f403e060 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f621c051bb0 tx=0x7f621c053000 comp rx=0 tx=0).stop 2024-05-08T18:50:48.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.964+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55595221bc30 msgr2=0x555952223230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.964+0000 7f622a7ad640 1 -- 172.21.15.132:0/2461927969 reap_dead start 2024-05-08T18:50:48.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.964+0000 7f622f335800 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55595221bc30 0x555952223230 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6224022bf0 tx=0x7f6224052c10 comp rx=0 tx=0).stop 2024-05-08T18:50:48.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.964+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 shutdown_connections 2024-05-08T18:50:48.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.964+0000 7f622f335800 1 --2- 172.21.15.132:0/2461927969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55595221bc30 0x555952223230 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.964+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 >> 172.21.15.132:0/2461927969 conn(0x555952217f40 msgr2=0x5559522155f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.964+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 shutdown_connections 2024-05-08T18:50:48.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.964+0000 7f622f335800 1 -- 172.21.15.132:0/2461927969 wait complete. 2024-05-08T18:50:48.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 -- 172.21.15.132:0/2933975405 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f610403bba0 msgr2=0x7f610403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 --2- 172.21.15.132:0/2933975405 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f610403bba0 0x7f610403e060 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f621c051950 tx=0x7f621c001540 comp rx=0 tx=0).stop 2024-05-08T18:50:48.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 -- 172.21.15.132:0/2933975405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55595206df10 msgr2=0x55595206c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 --2- 172.21.15.132:0/2933975405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55595206df10 0x55595206c380 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x5559521f8e60 tx=0x7f6224018830 comp rx=0 tx=0).stop 2024-05-08T18:50:48.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 -- 172.21.15.132:0/2933975405 shutdown_connections 2024-05-08T18:50:48.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 --2- 172.21.15.132:0/2933975405 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f610403bba0 0x7f610403e060 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 --2- 172.21.15.132:0/2933975405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55595206df10 0x55595206c380 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 -- 172.21.15.132:0/2933975405 >> 172.21.15.132:0/2933975405 conn(0x555952200840 msgr2=0x555952200c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 -- 172.21.15.132:0/2933975405 shutdown_connections 2024-05-08T18:50:48.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 -- 172.21.15.132:0/2933975405 wait complete. 2024-05-08T18:50:48.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 -- 172.21.15.132:0/3166651748 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5559520fc6e0 msgr2=0x5559521f8500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 --2- 172.21.15.132:0/3166651748 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5559520fc6e0 0x5559521f8500 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 -- 172.21.15.132:0/3166651748 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5559521fadb0 msgr2=0x5559521fd1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 --2- 172.21.15.132:0/3166651748 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5559521fadb0 0x5559521fd1a0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 -- 172.21.15.132:0/3166651748 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f611003bb50 msgr2=0x7f611003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 --2- 172.21.15.132:0/3166651748 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f611003bb50 0x7f611003e010 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6220054000 tx=0x7f622004e000 comp rx=0 tx=0).stop 2024-05-08T18:50:48.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 -- 172.21.15.132:0/3166651748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559520f82f0 msgr2=0x5559521f12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:48.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 --2- 172.21.15.132:0/3166651748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559520f82f0 0x5559521f12c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f621c000c00 tx=0x7f621c000ed0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 -- 172.21.15.132:0/3166651748 shutdown_connections 2024-05-08T18:50:48.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 --2- 172.21.15.132:0/3166651748 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5559521fadb0 0x5559521fd1a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 --2- 172.21.15.132:0/3166651748 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5559520fc6e0 0x5559521f8500 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 --2- 172.21.15.132:0/3166651748 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f611003bb50 0x7f611003e010 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 --2- 172.21.15.132:0/3166651748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5559520f82f0 0x5559521f12c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:48.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 -- 172.21.15.132:0/3166651748 >> 172.21.15.132:0/3166651748 conn(0x5559520f3870 msgr2=0x5559521e3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:48.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 -- 172.21.15.132:0/3166651748 shutdown_connections 2024-05-08T18:50:48.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:48.965+0000 7f622f335800 1 -- 172.21.15.132:0/3166651748 wait complete. 2024-05-08T18:50:48.988 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-08T18:50:48.951115Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:48.951092Z', 'tags': [], 'group_ids': []} 2024-05-08T18:50:48.993 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-08T18:50:48.997 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:50:48.998 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-05-08T18:50:48.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-05-08T18:50:48.998 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-05-08T18:50:49.041 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:49.041 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:49.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.042+0000 7f2cbc9a2800 1 Processor -- start 2024-05-08T18:50:49.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.042+0000 7f2cbc9a2800 1 -- start start 2024-05-08T18:50:49.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.042+0000 7f2cbc9a2800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55ffbc954d50 0x55ffbc957140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.042+0000 7f2cbc9a2800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ffbc95b190 con 0x55ffbc957680 2024-05-08T18:50:49.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.042+0000 7f2cbc9a2800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55ffbc7f4e20 con 0x55ffbc954d50 2024-05-08T18:50:49.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.043+0000 7f2cba49a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55ffbc954d50 0x55ffbc957140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.043+0000 7f2cba49a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55ffbc954d50 0x55ffbc957140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33104/0 (socket says 172.21.15.132:33104) 2024-05-08T18:50:49.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.043+0000 7f2cba49a640 1 -- 172.21.15.132:0/3281949123 learned_addr learned my addr 172.21.15.132:0/3281949123 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.043+0000 7f2cb1c99640 1 --1- 172.21.15.132:0/3281949123 >> v1:172.21.15.42:6789/0 conn(0x55ffbc957680 0x55ffbc959a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:46998/0 (socket says 172.21.15.132:46998) 2024-05-08T18:50:49.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.043+0000 7f2cba49a640 1 -- 172.21.15.132:0/3281949123 >> v1:172.21.15.42:6789/0 conn(0x55ffbc957680 legacy=0x55ffbc959a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.043+0000 7f2cba49a640 1 -- 172.21.15.132:0/3281949123 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffbc95c370 con 0x55ffbc954d50 2024-05-08T18:50:49.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.043+0000 7f2cb9c99640 1 -- 172.21.15.132:0/3281949123 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3934095088 0 0) 0x55ffbc95b190 con 0x55ffbc957680 2024-05-08T18:50:49.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.045+0000 7f2cba49a640 1 --2- 172.21.15.132:0/3281949123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbc954d50 0x55ffbc957140 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00a520 tx=0x7f2cac01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca76543d1387412 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.045+0000 7f2cb9c99640 1 -- 172.21.15.132:0/3281949123 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cac057070 con 0x55ffbc954d50 2024-05-08T18:50:49.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.045+0000 7f2cb9c99640 1 -- 172.21.15.132:0/3281949123 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cac052570 con 0x55ffbc954d50 2024-05-08T18:50:49.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.045+0000 7f2cb9c99640 1 -- 172.21.15.132:0/3281949123 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cac04ae60 con 0x55ffbc954d50 2024-05-08T18:50:49.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.046+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/3281949123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbc954d50 msgr2=0x55ffbc957140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.046+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/3281949123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbc954d50 0x55ffbc957140 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00a520 tx=0x7f2cac01d010 comp rx=0 tx=0).stop 2024-05-08T18:50:49.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.046+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/3281949123 shutdown_connections 2024-05-08T18:50:49.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.046+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/3281949123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbc954d50 0x55ffbc957140 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.046+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/3281949123 >> 172.21.15.132:0/3281949123 conn(0x55ffbc94e720 msgr2=0x55ffbc950b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.046+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/3281949123 shutdown_connections 2024-05-08T18:50:49.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.046+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/3281949123 wait complete. 2024-05-08T18:50:49.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.059+0000 7f2cbc9a2800 1 Processor -- start 2024-05-08T18:50:49.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.059+0000 7f2cbc9a2800 1 -- start start 2024-05-08T18:50:49.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.059+0000 7f2cbc9a2800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbc954d50 0x55ffbc954690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.059+0000 7f2cbc9a2800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ffbc89f5b0 con 0x55ffbc954d50 2024-05-08T18:50:49.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.059+0000 7f2cba49a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbc954d50 0x55ffbc954690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.059+0000 7f2cba49a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbc954d50 0x55ffbc954690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33108/0 (socket says 172.21.15.132:33108) 2024-05-08T18:50:49.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.059+0000 7f2cba49a640 1 -- 172.21.15.132:0/2004992149 learned_addr learned my addr 172.21.15.132:0/2004992149 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.060+0000 7f2cba49a640 1 -- 172.21.15.132:0/2004992149 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffbc952c50 con 0x55ffbc954d50 2024-05-08T18:50:49.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.060+0000 7f2cba49a640 1 --2- 172.21.15.132:0/2004992149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbc954d50 0x55ffbc954690 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2cac055040 tx=0x7f2cac04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378cded424bfe335 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.060+0000 7f2ba8608640 1 -- 172.21.15.132:0/2004992149 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cac062070 con 0x55ffbc954d50 2024-05-08T18:50:49.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.060+0000 7f2ba8608640 1 -- 172.21.15.132:0/2004992149 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cac052720 con 0x55ffbc954d50 2024-05-08T18:50:49.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.060+0000 7f2ba8608640 1 -- 172.21.15.132:0/2004992149 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cac057040 con 0x55ffbc954d50 2024-05-08T18:50:49.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.061+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/2004992149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbc954d50 msgr2=0x55ffbc954690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.061+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/2004992149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbc954d50 0x55ffbc954690 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2cac055040 tx=0x7f2cac04c000 comp rx=0 tx=0).stop 2024-05-08T18:50:49.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.061+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/2004992149 shutdown_connections 2024-05-08T18:50:49.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.061+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/2004992149 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbc954d50 0x55ffbc954690 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.061+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/2004992149 >> 172.21.15.132:0/2004992149 conn(0x55ffbc94e720 msgr2=0x55ffbca40cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.061+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/2004992149 shutdown_connections 2024-05-08T18:50:49.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.061+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/2004992149 wait complete. 2024-05-08T18:50:49.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.061+0000 7f2cbc9a2800 1 Processor -- start 2024-05-08T18:50:49.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.061+0000 7f2cbc9a2800 1 -- start start 2024-05-08T18:50:49.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.061+0000 7f2cbc9a2800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbc954d50 0x55ffbca4efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.061+0000 7f2cbc9a2800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ffbc95b660 con 0x55ffbc954d50 2024-05-08T18:50:49.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.061+0000 7f2cba49a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbc954d50 0x55ffbca4efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.061+0000 7f2cba49a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbc954d50 0x55ffbca4efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33110/0 (socket says 172.21.15.132:33110) 2024-05-08T18:50:49.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.061+0000 7f2cba49a640 1 -- 172.21.15.132:0/3559489913 learned_addr learned my addr 172.21.15.132:0/3559489913 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.062+0000 7f2cba49a640 1 -- 172.21.15.132:0/3559489913 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffbca4f500 con 0x55ffbc954d50 2024-05-08T18:50:49.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.062+0000 7f2cba49a640 1 --2- 172.21.15.132:0/3559489913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbc954d50 0x55ffbca4efc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2cac055040 tx=0x7f2cac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.062+0000 7f2ba6e05640 1 -- 172.21.15.132:0/3559489913 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cac057070 con 0x55ffbc954d50 2024-05-08T18:50:49.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.062+0000 7f2ba6e05640 1 -- 172.21.15.132:0/3559489913 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cac067450 con 0x55ffbc954d50 2024-05-08T18:50:49.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.062+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/3559489913 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ffbca4f790 con 0x55ffbc954d50 2024-05-08T18:50:49.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.062+0000 7f2ba6e05640 1 -- 172.21.15.132:0/3559489913 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cac062040 con 0x55ffbc954d50 2024-05-08T18:50:49.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.062+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/3559489913 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffbca52440 con 0x55ffbc954d50 2024-05-08T18:50:49.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.063+0000 7f2ba6e05640 1 -- 172.21.15.132:0/3559489913 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2cac067730 con 0x55ffbc954d50 2024-05-08T18:50:49.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.063+0000 7f2ba6e05640 1 --2- 172.21.15.132:0/3559489913 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2ba003bb50 0x7f2ba003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.063+0000 7f2ba6e05640 1 -- 172.21.15.132:0/3559489913 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f2cac094430 con 0x55ffbc954d50 2024-05-08T18:50:49.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.063+0000 7f2cb1c99640 1 --2- 172.21.15.132:0/3559489913 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2ba003bb50 0x7f2ba003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.063+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/3559489913 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ffbc957680 0x55ffbca56200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.063+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/3559489913 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca56780 con 0x55ffbc957680 2024-05-08T18:50:49.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.063+0000 7f2cbac9b640 1 --2- 172.21.15.132:0/3559489913 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ffbc957680 0x55ffbca56200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.064+0000 7f2cb1c99640 1 --2- 172.21.15.132:0/3559489913 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2ba003bb50 0x7f2ba003e010 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4000c00 tx=0x7f2ca40013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.064+0000 7f2cbac9b640 1 --2- 172.21.15.132:0/3559489913 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ffbc957680 0x55ffbca56200 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.064+0000 7f2cbac9b640 1 -- 172.21.15.132:0/3559489913 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2cb400a4a0 con 0x55ffbc957680 2024-05-08T18:50:49.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.064+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/3559489913 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca53790 con 0x55ffbc957680 2024-05-08T18:50:49.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.064+0000 7f2cbac9b640 1 -- 172.21.15.132:0/3559489913 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2cb400a4a0 con 0x55ffbc957680 2024-05-08T18:50:49.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.064+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/3559489913 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ffbca58b00 0x55ffbca5aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.064+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/3559489913 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca5b550 con 0x55ffbca58b00 2024-05-08T18:50:49.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.064+0000 7f2cba49a640 1 --2- 172.21.15.132:0/3559489913 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ffbca58b00 0x55ffbca5aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.065+0000 7f2cba49a640 1 --2- 172.21.15.132:0/3559489913 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ffbca58b00 0x55ffbca5aef0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.065+0000 7f2cba49a640 1 -- 172.21.15.132:0/3559489913 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2cac064070 con 0x55ffbca58b00 2024-05-08T18:50:49.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.065+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/3559489913 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca57970 con 0x55ffbc957680 2024-05-08T18:50:49.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.065+0000 7f2cbac9b640 1 -- 172.21.15.132:0/3559489913 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2cb400a4a0 con 0x55ffbc957680 2024-05-08T18:50:49.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.065+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/3559489913 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca57e50 con 0x55ffbc957680 2024-05-08T18:50:49.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.065+0000 7f2cbac9b640 1 -- 172.21.15.132:0/3559489913 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2cb400a4a0 con 0x55ffbc957680 2024-05-08T18:50:49.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.066+0000 7f2cbc9a2800 1 Processor -- start 2024-05-08T18:50:49.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.066+0000 7f2cbc9a2800 1 -- start start 2024-05-08T18:50:49.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.066+0000 7f2cbc9a2800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbca6a4a0 0x55ffbca6a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.066+0000 7f2cbc9a2800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ffbc845fc0 con 0x55ffbca6a4a0 2024-05-08T18:50:49.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.066+0000 7f2cbac9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbca6a4a0 0x55ffbca6a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.066+0000 7f2cbac9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbca6a4a0 0x55ffbca6a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33122/0 (socket says 172.21.15.132:33122) 2024-05-08T18:50:49.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.066+0000 7f2cbac9b640 1 -- 172.21.15.132:0/1111308222 learned_addr learned my addr 172.21.15.132:0/1111308222 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.067+0000 7f2cbac9b640 1 -- 172.21.15.132:0/1111308222 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffbca6ae00 con 0x55ffbca6a4a0 2024-05-08T18:50:49.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.067+0000 7f2cbac9b640 1 --2- 172.21.15.132:0/1111308222 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbca6a4a0 0x55ffbca6a8c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x55ffbca56b80 tx=0x7f2cb4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.067+0000 7f2b9ffff640 1 -- 172.21.15.132:0/1111308222 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb4014450 con 0x55ffbca6a4a0 2024-05-08T18:50:49.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.067+0000 7f2b9ffff640 1 -- 172.21.15.132:0/1111308222 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb40145f0 con 0x55ffbca6a4a0 2024-05-08T18:50:49.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.067+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/1111308222 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ffbca6b870 con 0x55ffbca6a4a0 2024-05-08T18:50:49.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.067+0000 7f2b9ffff640 1 -- 172.21.15.132:0/1111308222 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb40148d0 con 0x55ffbca6a4a0 2024-05-08T18:50:49.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.067+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/1111308222 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffbca6bd70 con 0x55ffbca6a4a0 2024-05-08T18:50:49.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.068+0000 7f2b9ffff640 1 -- 172.21.15.132:0/1111308222 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2cb4011040 con 0x55ffbca6a4a0 2024-05-08T18:50:49.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.068+0000 7f2b9ffff640 1 --2- 172.21.15.132:0/1111308222 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2b9403bb50 0x7f2b9403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.068+0000 7f2b9ffff640 1 -- 172.21.15.132:0/1111308222 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f2cb401e070 con 0x55ffbca6a4a0 2024-05-08T18:50:49.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.068+0000 7f2cba49a640 1 --2- 172.21.15.132:0/1111308222 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2b9403bb50 0x7f2b9403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.068+0000 7f2cbc9a2800 1 Processor -- start 2024-05-08T18:50:49.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.068+0000 7f2cbc9a2800 1 -- start start 2024-05-08T18:50:49.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.068+0000 7f2cba49a640 1 --2- 172.21.15.132:0/1111308222 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2b9403bb50 0x7f2b9403e010 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2cac000c00 tx=0x7f2cac066f00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.069+0000 7f2cbc9a2800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbca77810 0x55ffbca77c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.069+0000 7f2cbc9a2800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ffbc952f10 con 0x55ffbca77810 2024-05-08T18:50:49.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.069+0000 7f2cbac9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbca77810 0x55ffbca77c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.069+0000 7f2cbac9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbca77810 0x55ffbca77c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33128/0 (socket says 172.21.15.132:33128) 2024-05-08T18:50:49.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.069+0000 7f2cbac9b640 1 -- 172.21.15.132:0/1188556013 learned_addr learned my addr 172.21.15.132:0/1188556013 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.069+0000 7f2cbac9b640 1 -- 172.21.15.132:0/1188556013 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffbca78200 con 0x55ffbca77810 2024-05-08T18:50:49.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.069+0000 7f2cbac9b640 1 --2- 172.21.15.132:0/1188556013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbca77810 0x55ffbca77c30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4018430 tx=0x7f2cb40406d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133ee09dbd1e1d11 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.069+0000 7f2b9dffb640 1 -- 172.21.15.132:0/1188556013 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb40167c0 con 0x55ffbca77810 2024-05-08T18:50:49.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.069+0000 7f2b9dffb640 1 -- 172.21.15.132:0/1188556013 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb4016960 con 0x55ffbca77810 2024-05-08T18:50:49.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.069+0000 7f2b9dffb640 1 -- 172.21.15.132:0/1188556013 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb4014a70 con 0x55ffbca77810 2024-05-08T18:50:49.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.070+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/1188556013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbca77810 msgr2=0x55ffbca77c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.070+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/1188556013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbca77810 0x55ffbca77c30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4018430 tx=0x7f2cb40406d0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.070+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/1188556013 shutdown_connections 2024-05-08T18:50:49.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.070+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/1188556013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbca77810 0x55ffbca77c30 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.070+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/1188556013 >> 172.21.15.132:0/1188556013 conn(0x55ffbca73ae0 msgr2=0x55ffbca71b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.070+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/1188556013 shutdown_connections 2024-05-08T18:50:49.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.070+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/1188556013 wait complete. 2024-05-08T18:50:49.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.070+0000 7f2cbc9a2800 1 Processor -- start 2024-05-08T18:50:49.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.070+0000 7f2cbc9a2800 1 -- start start 2024-05-08T18:50:49.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.070+0000 7f2cbc9a2800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbca77810 0x55ffbca7ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.070+0000 7f2cbc9a2800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ffbca78950 con 0x55ffbca77810 2024-05-08T18:50:49.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.071+0000 7f2cbac9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbca77810 0x55ffbca7ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.071+0000 7f2cbac9b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbca77810 0x55ffbca7ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33134/0 (socket says 172.21.15.132:33134) 2024-05-08T18:50:49.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.071+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 learned_addr learned my addr 172.21.15.132:0/798182078 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.071+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffbca7f240 con 0x55ffbca77810 2024-05-08T18:50:49.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.071+0000 7f2cbac9b640 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbca77810 0x55ffbca7ed00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4011fd0 tx=0x7f2cb4052d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.071+0000 7f2b8bfff640 1 -- 172.21.15.132:0/798182078 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb40167c0 con 0x55ffbca77810 2024-05-08T18:50:49.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.071+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ffbca7f530 con 0x55ffbca77810 2024-05-08T18:50:49.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.071+0000 7f2b8bfff640 1 -- 172.21.15.132:0/798182078 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb4031070 con 0x55ffbca77810 2024-05-08T18:50:49.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.071+0000 7f2b8bfff640 1 -- 172.21.15.132:0/798182078 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb4040ad0 con 0x55ffbca77810 2024-05-08T18:50:49.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.072+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffbca82180 con 0x55ffbca77810 2024-05-08T18:50:49.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.072+0000 7f2b8bfff640 1 -- 172.21.15.132:0/798182078 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2cb4040c70 con 0x55ffbca77810 2024-05-08T18:50:49.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.072+0000 7f2b8bfff640 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2b8403bb50 0x7f2b8403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.072+0000 7f2b8bfff640 1 -- 172.21.15.132:0/798182078 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f2cb400e040 con 0x55ffbca77810 2024-05-08T18:50:49.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.073+0000 7f2cba49a640 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2b8403bb50 0x7f2b8403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.073+0000 7f2cbc9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.073+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ffbca8a9e0 0x55ffbca8cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.073+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca8d5f0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.073+0000 7f2cb1c99640 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ffbca8a9e0 0x55ffbca8cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.073+0000 7f2cba49a640 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2b8403bb50 0x7f2b8403e010 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2cac052fb0 tx=0x7f2cac088000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.073+0000 7f2cb1c99640 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ffbca8a9e0 0x55ffbca8cea0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.073+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ca400f5f0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.073+0000 7f2cbc9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.073+0000 7f2cbc9a2800 20 realm 2024-05-08T18:50:49.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.073+0000 7f2cbc9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.073+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca89e30 con 0x55ffbca8a9e0 2024-05-08T18:50:49.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.074+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ca400f5f0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.074+0000 7f2cbc9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.074+0000 7f2cbc9a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:49.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.074+0000 7f2cbc9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.074+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca8e0d0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.074+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ca400f5f0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.074+0000 7f2cbc9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.074+0000 7f2cbc9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.074+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca8e9a0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.074+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2ca400f5f0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.074+0000 7f2cbc9a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:49.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.074+0000 7f2cbc9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.074+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ffbca8f2a0 0x55ffbca916b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.074+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca91e10 con 0x55ffbca8f2a0 2024-05-08T18:50:49.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.074+0000 7f2cbac9b640 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ffbca8f2a0 0x55ffbca916b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.074+0000 7f2cbac9b640 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ffbca8f2a0 0x55ffbca916b0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.075+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2cb4046020 con 0x55ffbca8f2a0 2024-05-08T18:50:49.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.075+0000 7f2cbc9a2800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:49.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.075+0000 7f2cbc9a2800 20 searching for the correct realm 2024-05-08T18:50:49.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.075+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x55ffbca8f2a0 2024-05-08T18:50:49.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.075+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb4046020 con 0x55ffbca8f2a0 2024-05-08T18:50:49.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.075+0000 7f2cbac9b640 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2cb4014070 0x7f2cb4024970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.075+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x7f2cb4014070 2024-05-08T18:50:49.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.075+0000 7f2cba49a640 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2cb4014070 0x7f2cb4024970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.076+0000 7f2cba49a640 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2cb4014070 0x7f2cb4024970 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.076+0000 7f2cba49a640 1 -- 172.21.15.132:0/798182078 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cac064070 con 0x7f2cb4014070 2024-05-08T18:50:49.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.076+0000 7f2cba49a640 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2cac094810 0x7f2cac0067b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.076+0000 7f2cba49a640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x7f2cac094810 2024-05-08T18:50:49.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.076+0000 7f2cb1c99640 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2cac094810 0x7f2cac0067b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.076+0000 7f2cb1c99640 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2cac094810 0x7f2cac0067b0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.077+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ca400f5f0 con 0x7f2cac094810 2024-05-08T18:50:49.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.077+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.077+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ca400f5f0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.077+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.077+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ca402b040 con 0x55ffbca8a9e0 2024-05-08T18:50:49.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.077+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x7f2cac094810 2024-05-08T18:50:49.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.077+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ca402b040 con 0x7f2cac094810 2024-05-08T18:50:49.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.077+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x7f2cac094810 2024-05-08T18:50:49.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.078+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ca402b040 con 0x7f2cac094810 2024-05-08T18:50:49.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.078+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x7f2cb4014070 2024-05-08T18:50:49.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.078+0000 7f2cba49a640 1 -- 172.21.15.132:0/798182078 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cac064070 con 0x7f2cb4014070 2024-05-08T18:50:49.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.078+0000 7f2cba49a640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x55ffbca8f2a0 2024-05-08T18:50:49.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.078+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb4046020 con 0x55ffbca8f2a0 2024-05-08T18:50:49.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.078+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.078+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ca402b040 con 0x55ffbca8a9e0 2024-05-08T18:50:49.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.078+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x7f2cac094810 2024-05-08T18:50:49.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.079+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ca402b040 con 0x7f2cac094810 2024-05-08T18:50:49.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.079+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.079+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2ca402b040 con 0x55ffbca8a9e0 2024-05-08T18:50:49.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.079+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x7f2cb4014070 2024-05-08T18:50:49.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.079+0000 7f2cba49a640 1 -- 172.21.15.132:0/798182078 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2cac064070 con 0x7f2cb4014070 2024-05-08T18:50:49.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.079+0000 7f2cba49a640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x55ffbca8f2a0 2024-05-08T18:50:49.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.079+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2cb4046020 con 0x55ffbca8f2a0 2024-05-08T18:50:49.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.079+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x55ffbca8f2a0 2024-05-08T18:50:49.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.079+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb4046020 con 0x55ffbca8f2a0 2024-05-08T18:50:49.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.079+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x7f2cac094810 2024-05-08T18:50:49.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.080+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ca402b040 con 0x7f2cac094810 2024-05-08T18:50:49.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.080+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x55ffbca8f2a0 2024-05-08T18:50:49.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.080+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb4046020 con 0x55ffbca8f2a0 2024-05-08T18:50:49.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.080+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x55ffbca8f2a0 2024-05-08T18:50:49.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.080+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb4046020 con 0x55ffbca8f2a0 2024-05-08T18:50:49.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.080+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.081+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ca402b040 con 0x55ffbca8a9e0 2024-05-08T18:50:49.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.081+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.081+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2ca402b040 con 0x55ffbca8a9e0 2024-05-08T18:50:49.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.081+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x7f2cac094810 2024-05-08T18:50:49.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.081+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ca402b040 con 0x7f2cac094810 2024-05-08T18:50:49.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.081+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x55ffbca8f2a0 2024-05-08T18:50:49.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.082+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb4046020 con 0x55ffbca8f2a0 2024-05-08T18:50:49.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.082+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x7f2cb4014070 2024-05-08T18:50:49.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.082+0000 7f2cba49a640 1 -- 172.21.15.132:0/798182078 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cac064070 con 0x7f2cb4014070 2024-05-08T18:50:49.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.082+0000 7f2cba49a640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.082+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ca402b040 con 0x55ffbca8a9e0 2024-05-08T18:50:49.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.082+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x7f2cac094810 2024-05-08T18:50:49.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.082+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ca403b040 con 0x7f2cac094810 2024-05-08T18:50:49.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.082+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x55ffbca8f2a0 2024-05-08T18:50:49.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.083+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb4046020 con 0x55ffbca8f2a0 2024-05-08T18:50:49.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.083+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x7f2cac094810 2024-05-08T18:50:49.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.083+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ca403b040 con 0x7f2cac094810 2024-05-08T18:50:49.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.083+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x7f2cb4014070 2024-05-08T18:50:49.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.083+0000 7f2cba49a640 1 -- 172.21.15.132:0/798182078 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cac064070 con 0x7f2cb4014070 2024-05-08T18:50:49.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.083+0000 7f2cba49a640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x55ffbca8f2a0 2024-05-08T18:50:49.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.083+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cb4046020 con 0x55ffbca8f2a0 2024-05-08T18:50:49.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.083+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x7f2cac094810 2024-05-08T18:50:49.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.084+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ca403b040 con 0x7f2cac094810 2024-05-08T18:50:49.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.084+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.084+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2ca403b040 con 0x55ffbca8a9e0 2024-05-08T18:50:49.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.084+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca937f0 con 0x7f2cb4014070 2024-05-08T18:50:49.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.084+0000 7f2cba49a640 1 -- 172.21.15.132:0/798182078 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2cac064070 con 0x7f2cb4014070 2024-05-08T18:50:49.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.084+0000 7f2cbc9a2800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:49.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.084+0000 7f2cbc9a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:49.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.084+0000 7f2cbc9a2800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:49.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.084+0000 7f2cbc9a2800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:49.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.084+0000 7f2cbc9a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:49.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.084+0000 7f2cbc9a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:49.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.084+0000 7f2cbc9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.084+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca928c0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.084+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ca403b040 con 0x55ffbca8a9e0 2024-05-08T18:50:49.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.084+0000 7f2cbc9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.084+0000 7f2cbc9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.084+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca92500 con 0x55ffbca8a9e0 2024-05-08T18:50:49.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.084+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2ca403b040 con 0x55ffbca8a9e0 2024-05-08T18:50:49.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.084+0000 7f2cbc9a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:49.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.085+0000 7f2cbc9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.085+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca931e0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.085+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2ca403b040 con 0x55ffbca8a9e0 2024-05-08T18:50:49.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.085+0000 7f2cbc9a2800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:49.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.085+0000 7f2cbc9a2800 20 zone default found 2024-05-08T18:50:49.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.085+0000 7f2cbc9a2800 4 Realm: () 2024-05-08T18:50:49.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.085+0000 7f2cbc9a2800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:49.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.085+0000 7f2cbc9a2800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:49.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.085+0000 7f2cbc9a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:49.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.085+0000 7f2cbc9a2800 20 zonegroup default 2024-05-08T18:50:49.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.085+0000 7f2cbc9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.085+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca93cc0 con 0x7f2cac094810 2024-05-08T18:50:49.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.085+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2ca403b040 con 0x7f2cac094810 2024-05-08T18:50:49.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.085+0000 7f2cbc9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.085+0000 7f2cbc9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.085+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca92d70 con 0x55ffbca8f2a0 2024-05-08T18:50:49.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.085+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2cb4046020 con 0x55ffbca8f2a0 2024-05-08T18:50:49.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.085+0000 7f2cbc9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.085+0000 7f2cbc9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.085+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca95c10 con 0x55ffbca8f2a0 2024-05-08T18:50:49.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.086+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2cb4046020 con 0x55ffbca8f2a0 2024-05-08T18:50:49.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.086+0000 7f2cbc9a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.086+0000 7f2cbc9a2800 20 started sync module instance, tier type = 2024-05-08T18:50:49.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.086+0000 7f2cbc9a2800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:49.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.086+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca94f90 con 0x7f2cb4014070 2024-05-08T18:50:49.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.087+0000 7f2cba49a640 1 -- 172.21.15.132:0/798182078 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cac064070 con 0x7f2cb4014070 2024-05-08T18:50:49.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.087+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94556870232800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca96070 con 0x7f2cb4014070 2024-05-08T18:50:49.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.087+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca968c0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.088+0000 7f2cba49a640 1 -- 172.21.15.132:0/798182078 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94556870232800] v25'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cac064070 con 0x7f2cb4014070 2024-05-08T18:50:49.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.088+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca403b040 con 0x55ffbca8a9e0 2024-05-08T18:50:49.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.088+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94556870239248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca96ce0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.088+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca975b0 con 0x55ffbca8f2a0 2024-05-08T18:50:49.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.089+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb4046020 con 0x55ffbca8f2a0 2024-05-08T18:50:49.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.089+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94556870239248] v25'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca403b040 con 0x55ffbca8a9e0 2024-05-08T18:50:49.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.089+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94556870240304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca97100 con 0x55ffbca8f2a0 2024-05-08T18:50:49.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.089+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca980a0 con 0x7f2cb4014070 2024-05-08T18:50:49.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.090+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94556870240304] v25'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb4046020 con 0x55ffbca8f2a0 2024-05-08T18:50:49.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.090+0000 7f2cba49a640 1 -- 172.21.15.132:0/798182078 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cac064070 con 0x7f2cb4014070 2024-05-08T18:50:49.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.090+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94556870241360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca97070 con 0x7f2cb4014070 2024-05-08T18:50:49.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.090+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca98f60 con 0x55ffbca8a9e0 2024-05-08T18:50:49.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.091+0000 7f2cba49a640 1 -- 172.21.15.132:0/798182078 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94556870241360] v25'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cac064070 con 0x7f2cb4014070 2024-05-08T18:50:49.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.091+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca403b040 con 0x55ffbca8a9e0 2024-05-08T18:50:49.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.091+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94556870249136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca99380 con 0x55ffbca8a9e0 2024-05-08T18:50:49.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.091+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca99d40 con 0x7f2cac094810 2024-05-08T18:50:49.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.092+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94556870249136] v25'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca403b040 con 0x55ffbca8a9e0 2024-05-08T18:50:49.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.092+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca403b040 con 0x7f2cac094810 2024-05-08T18:50:49.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.092+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94556870250672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca99d40 con 0x7f2cac094810 2024-05-08T18:50:49.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.092+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca9a700 con 0x7f2cac094810 2024-05-08T18:50:49.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.093+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94556870250672] v25'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca403b040 con 0x7f2cac094810 2024-05-08T18:50:49.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.094+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca403b040 con 0x7f2cac094810 2024-05-08T18:50:49.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.094+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94556870253168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca9a700 con 0x7f2cac094810 2024-05-08T18:50:49.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.094+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca9b0c0 con 0x7f2cac094810 2024-05-08T18:50:49.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.094+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94556870253168] v25'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca403b040 con 0x7f2cac094810 2024-05-08T18:50:49.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.095+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca403b040 con 0x7f2cac094810 2024-05-08T18:50:49.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.095+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94556870255664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca9b0c0 con 0x7f2cac094810 2024-05-08T18:50:49.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.095+0000 7f2cbc9a2800 20 add_watcher() i=0 2024-05-08T18:50:49.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.095+0000 7f2cbc9a2800 20 add_watcher() i=1 2024-05-08T18:50:49.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.095+0000 7f2cbc9a2800 20 add_watcher() i=2 2024-05-08T18:50:49.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.095+0000 7f2cbc9a2800 20 add_watcher() i=3 2024-05-08T18:50:49.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.095+0000 7f2cbc9a2800 20 add_watcher() i=4 2024-05-08T18:50:49.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.095+0000 7f2cbc9a2800 20 add_watcher() i=5 2024-05-08T18:50:49.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.095+0000 7f2cbc9a2800 20 add_watcher() i=6 2024-05-08T18:50:49.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.096+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94556870255664] v25'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca403b040 con 0x7f2cac094810 2024-05-08T18:50:49.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.096+0000 7f2cbc9a2800 20 add_watcher() i=7 2024-05-08T18:50:49.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.096+0000 7f2cbc9a2800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:49.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.096+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca9e3f0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.096+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2ca403b040 con 0x55ffbca8a9e0 2024-05-08T18:50:49.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.096+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94556870270496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca9b230 con 0x55ffbca8a9e0 2024-05-08T18:50:49.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.097+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94556870270496] v25'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2ca403b040 con 0x55ffbca8a9e0 2024-05-08T18:50:49.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.097+0000 7f2b70fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:49.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.097+0000 7f2cbc9a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:49.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.097+0000 7f2cbc9a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:49.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.097+0000 7f2cbc9a2800 5 note: GC not initialized 2024-05-08T18:50:49.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.097+0000 7f2aeb7fe640 20 reqs_thread_entry: start 2024-05-08T18:50:49.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.097+0000 7f2cbc9a2800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:49.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.097+0000 7f2cbc9a2800 20 Filter name: none 2024-05-08T18:50:49.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.098+0000 7f2ae97fa640 20 reqs_thread_entry: start 2024-05-08T18:50:49.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.098+0000 7f2cbc9a2800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.098+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ffbcad1420 con 0x7f2cb4014070 2024-05-08T18:50:49.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.098+0000 7f2cba49a640 1 -- 172.21.15.132:0/798182078 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f2cac064070 con 0x7f2cb4014070 2024-05-08T18:50:49.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.098+0000 7f2cbc9a2800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:50:49.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.099+0000 7f2b70fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:49.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.099+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94556870270496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbcacf3e0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.100+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94556870270496] v25'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2ca403b040 con 0x55ffbca8a9e0 2024-05-08T18:50:49.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.100+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94556870232800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbcacf3e0 con 0x7f2cb4014070 2024-05-08T18:50:49.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.101+0000 7f2cba49a640 1 -- 172.21.15.132:0/798182078 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94556870232800] v25'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cac064070 con 0x7f2cb4014070 2024-05-08T18:50:49.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.101+0000 7f2cbc9a2800 20 remove_watcher() i=0 2024-05-08T18:50:49.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.101+0000 7f2cbc9a2800 2 removed watcher, disabling cache 2024-05-08T18:50:49.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.101+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94556870239248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbcacf3e0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.102+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94556870239248] v25'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca403b040 con 0x55ffbca8a9e0 2024-05-08T18:50:49.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.102+0000 7f2cbc9a2800 20 remove_watcher() i=1 2024-05-08T18:50:49.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.102+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94556870240304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca96410 con 0x55ffbca8f2a0 2024-05-08T18:50:49.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.103+0000 7f2cbac9b640 1 -- 172.21.15.132:0/798182078 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94556870240304] v25'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cb4046020 con 0x55ffbca8f2a0 2024-05-08T18:50:49.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.103+0000 7f2cbc9a2800 20 remove_watcher() i=2 2024-05-08T18:50:49.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.103+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94556870241360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbcacf3e0 con 0x7f2cb4014070 2024-05-08T18:50:49.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.104+0000 7f2cba49a640 1 -- 172.21.15.132:0/798182078 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94556870241360] v25'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2cac064070 con 0x7f2cb4014070 2024-05-08T18:50:49.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.104+0000 7f2cbc9a2800 20 remove_watcher() i=3 2024-05-08T18:50:49.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.104+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94556870249136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbcacf3e0 con 0x55ffbca8a9e0 2024-05-08T18:50:49.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.105+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94556870249136] v25'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca403b040 con 0x55ffbca8a9e0 2024-05-08T18:50:49.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.105+0000 7f2cbc9a2800 20 remove_watcher() i=4 2024-05-08T18:50:49.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.105+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94556870250672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca98ab0 con 0x7f2cac094810 2024-05-08T18:50:49.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.106+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94556870250672] v25'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca403b040 con 0x7f2cac094810 2024-05-08T18:50:49.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.106+0000 7f2cbc9a2800 20 remove_watcher() i=5 2024-05-08T18:50:49.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.106+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94556870253168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbcacf3e0 con 0x7f2cac094810 2024-05-08T18:50:49.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.107+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94556870253168] v25'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca403b040 con 0x7f2cac094810 2024-05-08T18:50:49.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.107+0000 7f2cbc9a2800 20 remove_watcher() i=6 2024-05-08T18:50:49.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.107+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94556870255664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ffbca98ab0 con 0x7f2cac094810 2024-05-08T18:50:49.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.108+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94556870255664] v25'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ca403b040 con 0x7f2cac094810 2024-05-08T18:50:49.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.108+0000 7f2cbc9a2800 20 remove_watcher() i=7 2024-05-08T18:50:49.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.108+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2cac094810 msgr2=0x7f2cac0067b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.108+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2cac094810 0x7f2cac0067b0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.108+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ffbca8a9e0 msgr2=0x55ffbca8cea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.108+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ffbca8a9e0 0x55ffbca8cea0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.108+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2cb4014070 msgr2=0x7f2cb4024970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.108+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2cb4014070 0x7f2cb4024970 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.108+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ffbca8f2a0 msgr2=0x55ffbca916b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.108+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ffbca8f2a0 0x55ffbca916b0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.108+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2b8403bb50 msgr2=0x7f2b8403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.108+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2b8403bb50 0x7f2b8403e010 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2cac052fb0 tx=0x7f2cac088000 comp rx=0 tx=0).stop 2024-05-08T18:50:49.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.108+0000 7f2cb1c99640 1 -- 172.21.15.132:0/798182078 reap_dead start 2024-05-08T18:50:49.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.108+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbca77810 msgr2=0x55ffbca7ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.108+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbca77810 0x55ffbca7ed00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4011fd0 tx=0x7f2cb4052d20 comp rx=0 tx=0).stop 2024-05-08T18:50:49.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.108+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 shutdown_connections 2024-05-08T18:50:49.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.108+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/798182078 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbca77810 0x55ffbca7ed00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.108+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 >> 172.21.15.132:0/798182078 conn(0x55ffbca73ae0 msgr2=0x55ffbca71140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.108+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 shutdown_connections 2024-05-08T18:50:49.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.108+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/798182078 wait complete. 2024-05-08T18:50:49.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/1111308222 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2b9403bb50 msgr2=0x7f2b9403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/1111308222 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2b9403bb50 0x7f2b9403e010 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2cac000c00 tx=0x7f2cac066f00 comp rx=0 tx=0).stop 2024-05-08T18:50:49.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/1111308222 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbca6a4a0 msgr2=0x55ffbca6a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/1111308222 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbca6a4a0 0x55ffbca6a8c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x55ffbca56b80 tx=0x7f2cb4018830 comp rx=0 tx=0).stop 2024-05-08T18:50:49.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/1111308222 shutdown_connections 2024-05-08T18:50:49.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/1111308222 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2b9403bb50 0x7f2b9403e010 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/1111308222 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbca6a4a0 0x55ffbca6a8c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/1111308222 >> 172.21.15.132:0/1111308222 conn(0x55ffbca5e540 msgr2=0x55ffbca5e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/1111308222 shutdown_connections 2024-05-08T18:50:49.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/1111308222 wait complete. 2024-05-08T18:50:49.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/3559489913 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ffbc957680 msgr2=0x55ffbca56200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/3559489913 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ffbc957680 0x55ffbca56200 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/3559489913 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ffbca58b00 msgr2=0x55ffbca5aef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/3559489913 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ffbca58b00 0x55ffbca5aef0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/3559489913 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2ba003bb50 msgr2=0x7f2ba003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/3559489913 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2ba003bb50 0x7f2ba003e010 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4000c00 tx=0x7f2ca40013b0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/3559489913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbc954d50 msgr2=0x55ffbca4efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/3559489913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbc954d50 0x55ffbca4efc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2cac055040 tx=0x7f2cac002fb0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/3559489913 shutdown_connections 2024-05-08T18:50:49.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/3559489913 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ffbca58b00 0x55ffbca5aef0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/3559489913 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ffbc957680 0x55ffbca56200 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/3559489913 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2ba003bb50 0x7f2ba003e010 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 --2- 172.21.15.132:0/3559489913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ffbc954d50 0x55ffbca4efc0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/3559489913 >> 172.21.15.132:0/3559489913 conn(0x55ffbc94e720 msgr2=0x55ffbc953470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/3559489913 shutdown_connections 2024-05-08T18:50:49.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.109+0000 7f2cbc9a2800 1 -- 172.21.15.132:0/3559489913 wait complete. 2024-05-08T18:50:49.133 INFO:teuthology.orchestra.run.smithi132.stdout:{"key":"bucket:myfoo","ver":{"tag":"_bCkpVVuMf7N7QdkJCSWJAY3","ver":2},"mtime":"2024-05-08T18:50:48.811868Z","data":{"bucket":{"name":"myfoo","marker":"bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1","bucket_id":"bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-05-08T18:50:47.727613Z","linked":false,"has_bucket_info":false}} 2024-05-08T18:50:49.133 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_bCkpVVuMf7N7QdkJCSWJAY3', 'ver': 2}, 'mtime': '2024-05-08T18:50:48.811868Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1', 'bucket_id': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-05-08T18:50:47.727613Z', 'linked': False, 'has_bucket_info': False}} 2024-05-08T18:50:49.133 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1'] 2024-05-08T18:50:49.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1'] 2024-05-08T18:50:49.134 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 2024-05-08T18:50:49.221 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:49.221 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:49.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.223+0000 7f451d52e800 1 Processor -- start 2024-05-08T18:50:49.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.223+0000 7f451d52e800 1 -- start start 2024-05-08T18:50:49.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.223+0000 7f451d52e800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55f0b63732d0 0x55f0b63736f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.223+0000 7f451d52e800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f0b6373d70 con 0x55f0b6374490 2024-05-08T18:50:49.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.223+0000 7f451d52e800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55f0b6213e20 con 0x55f0b63732d0 2024-05-08T18:50:49.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.223+0000 7f45192eb640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55f0b63732d0 0x55f0b63736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.223+0000 7f4518aea640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55f0b6374490 0x55f0b6374910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:47004/0 (socket says 172.21.15.132:47004) 2024-05-08T18:50:49.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.223+0000 7f4518aea640 1 -- 172.21.15.132:0/2265540420 learned_addr learned my addr 172.21.15.132:0/2265540420 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:50:49.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.224+0000 7f45192eb640 1 -- 172.21.15.132:0/2265540420 >> v1:172.21.15.42:6789/0 conn(0x55f0b6374490 legacy=0x55f0b6374910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.224+0000 7f45192eb640 1 -- 172.21.15.132:0/2265540420 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0b6375050 con 0x55f0b63732d0 2024-05-08T18:50:49.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.225+0000 7f45192eb640 1 --2- 172.21.15.132:0/2265540420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b63732d0 0x55f0b63736f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f450c00a470 tx=0x7f450c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f68bcfd8d041b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.226+0000 7f450bfff640 1 -- 172.21.15.132:0/2265540420 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f450c057070 con 0x55f0b63732d0 2024-05-08T18:50:49.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.226+0000 7f450bfff640 1 -- 172.21.15.132:0/2265540420 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f450c04adc0 con 0x55f0b63732d0 2024-05-08T18:50:49.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.226+0000 7f450bfff640 1 -- 172.21.15.132:0/2265540420 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f450c052590 con 0x55f0b63732d0 2024-05-08T18:50:49.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.226+0000 7f451d52e800 1 -- 172.21.15.132:0/2265540420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b63732d0 msgr2=0x55f0b63736f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.226+0000 7f451d52e800 1 --2- 172.21.15.132:0/2265540420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b63732d0 0x55f0b63736f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f450c00a470 tx=0x7f450c01ce90 comp rx=0 tx=0).stop 2024-05-08T18:50:49.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.226+0000 7f451d52e800 1 -- 172.21.15.132:0/2265540420 shutdown_connections 2024-05-08T18:50:49.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.226+0000 7f451d52e800 1 --2- 172.21.15.132:0/2265540420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b63732d0 0x55f0b63736f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.226+0000 7f451d52e800 1 -- 172.21.15.132:0/2265540420 >> 172.21.15.132:0/2265540420 conn(0x55f0b636e850 msgr2=0x55f0b6370c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.226+0000 7f451d52e800 1 -- 172.21.15.132:0/2265540420 shutdown_connections 2024-05-08T18:50:49.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.226+0000 7f451d52e800 1 -- 172.21.15.132:0/2265540420 wait complete. 2024-05-08T18:50:49.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.240+0000 7f451d52e800 1 Processor -- start 2024-05-08T18:50:49.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.240+0000 7f451d52e800 1 -- start start 2024-05-08T18:50:49.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.240+0000 7f451d52e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b63732d0 0x55f0b64647f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.240+0000 7f451d52e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f0b62be5d0 con 0x55f0b63732d0 2024-05-08T18:50:49.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.240+0000 7f45192eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b63732d0 0x55f0b64647f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.240+0000 7f45192eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b63732d0 0x55f0b64647f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33148/0 (socket says 172.21.15.132:33148) 2024-05-08T18:50:49.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.240+0000 7f45192eb640 1 -- 172.21.15.132:0/3321873036 learned_addr learned my addr 172.21.15.132:0/3321873036 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.241+0000 7f45192eb640 1 -- 172.21.15.132:0/3321873036 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0b6464dc0 con 0x55f0b63732d0 2024-05-08T18:50:49.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.241+0000 7f45192eb640 1 --2- 172.21.15.132:0/3321873036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b63732d0 0x55f0b64647f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f450c01ced0 tx=0x7f450c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d23574561e12050 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.241+0000 7f4407606640 1 -- 172.21.15.132:0/3321873036 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f450c057040 con 0x55f0b63732d0 2024-05-08T18:50:49.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.241+0000 7f4407606640 1 -- 172.21.15.132:0/3321873036 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f450c063070 con 0x55f0b63732d0 2024-05-08T18:50:49.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.241+0000 7f4407606640 1 -- 172.21.15.132:0/3321873036 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f450c052800 con 0x55f0b63732d0 2024-05-08T18:50:49.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.242+0000 7f451d52e800 1 -- 172.21.15.132:0/3321873036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b63732d0 msgr2=0x55f0b64647f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.242+0000 7f451d52e800 1 --2- 172.21.15.132:0/3321873036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b63732d0 0x55f0b64647f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f450c01ced0 tx=0x7f450c04c000 comp rx=0 tx=0).stop 2024-05-08T18:50:49.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.242+0000 7f451d52e800 1 -- 172.21.15.132:0/3321873036 shutdown_connections 2024-05-08T18:50:49.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.242+0000 7f451d52e800 1 --2- 172.21.15.132:0/3321873036 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b63732d0 0x55f0b64647f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.242+0000 7f451d52e800 1 -- 172.21.15.132:0/3321873036 >> 172.21.15.132:0/3321873036 conn(0x55f0b636e850 msgr2=0x55f0b6460110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.242+0000 7f451d52e800 1 -- 172.21.15.132:0/3321873036 shutdown_connections 2024-05-08T18:50:49.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.242+0000 7f451d52e800 1 -- 172.21.15.132:0/3321873036 wait complete. 2024-05-08T18:50:49.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.242+0000 7f451d52e800 1 Processor -- start 2024-05-08T18:50:49.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.242+0000 7f451d52e800 1 -- start start 2024-05-08T18:50:49.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.242+0000 7f451d52e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b63732d0 0x55f0b62e8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.242+0000 7f451d52e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f0b637c960 con 0x55f0b63732d0 2024-05-08T18:50:49.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.242+0000 7f45192eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b63732d0 0x55f0b62e8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.242+0000 7f45192eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b63732d0 0x55f0b62e8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33150/0 (socket says 172.21.15.132:33150) 2024-05-08T18:50:49.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.242+0000 7f45192eb640 1 -- 172.21.15.132:0/3357066146 learned_addr learned my addr 172.21.15.132:0/3357066146 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.243+0000 7f45192eb640 1 -- 172.21.15.132:0/3357066146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0b62e9130 con 0x55f0b63732d0 2024-05-08T18:50:49.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.243+0000 7f45192eb640 1 --2- 172.21.15.132:0/3357066146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b63732d0 0x55f0b62e8bf0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f450c01ced0 tx=0x7f450c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.243+0000 7f4405e03640 1 -- 172.21.15.132:0/3357066146 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f450c06d070 con 0x55f0b63732d0 2024-05-08T18:50:49.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.243+0000 7f4405e03640 1 -- 172.21.15.132:0/3357066146 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f450c052d20 con 0x55f0b63732d0 2024-05-08T18:50:49.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.243+0000 7f451d52e800 1 -- 172.21.15.132:0/3357066146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0b62e7380 con 0x55f0b63732d0 2024-05-08T18:50:49.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.243+0000 7f4405e03640 1 -- 172.21.15.132:0/3357066146 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f450c057050 con 0x55f0b63732d0 2024-05-08T18:50:49.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.243+0000 7f451d52e800 1 -- 172.21.15.132:0/3357066146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0b62e7900 con 0x55f0b63732d0 2024-05-08T18:50:49.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.244+0000 7f4405e03640 1 -- 172.21.15.132:0/3357066146 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f450c05d470 con 0x55f0b63732d0 2024-05-08T18:50:49.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.244+0000 7f4405e03640 1 --2- 172.21.15.132:0/3357066146 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f440003bb50 0x7f440003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.244+0000 7f4405e03640 1 -- 172.21.15.132:0/3357066146 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f450c093ef0 con 0x55f0b63732d0 2024-05-08T18:50:49.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.244+0000 7f4518aea640 1 --2- 172.21.15.132:0/3357066146 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f440003bb50 0x7f440003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.244+0000 7f451d52e800 1 --2- 172.21.15.132:0/3357066146 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f0b6374490 0x55f0b64756a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.244+0000 7f451d52e800 1 -- 172.21.15.132:0/3357066146 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0b6475be0 con 0x55f0b6374490 2024-05-08T18:50:49.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.244+0000 7f4519aec640 1 --2- 172.21.15.132:0/3357066146 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f0b6374490 0x55f0b64756a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.245+0000 7f4518aea640 1 --2- 172.21.15.132:0/3357066146 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f440003bb50 0x7f440003e010 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4510000f60 tx=0x7f45100012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.245+0000 7f4519aec640 1 --2- 172.21.15.132:0/3357066146 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f0b6374490 0x55f0b64756a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.245+0000 7f4519aec640 1 -- 172.21.15.132:0/3357066146 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f451400a4a0 con 0x55f0b6374490 2024-05-08T18:50:49.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.245+0000 7f451d52e800 1 -- 172.21.15.132:0/3357066146 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0b62e7db0 con 0x55f0b6374490 2024-05-08T18:50:49.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.245+0000 7f4519aec640 1 -- 172.21.15.132:0/3357066146 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f451400a4a0 con 0x55f0b6374490 2024-05-08T18:50:49.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.245+0000 7f451d52e800 1 --2- 172.21.15.132:0/3357066146 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f0b6477f10 0x55f0b647a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.245+0000 7f451d52e800 1 -- 172.21.15.132:0/3357066146 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0b647a9a0 con 0x55f0b6477f10 2024-05-08T18:50:49.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.245+0000 7f45192eb640 1 --2- 172.21.15.132:0/3357066146 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f0b6477f10 0x55f0b647a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.246+0000 7f45192eb640 1 --2- 172.21.15.132:0/3357066146 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f0b6477f10 0x55f0b647a300 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.246+0000 7f45192eb640 1 -- 172.21.15.132:0/3357066146 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f450c078070 con 0x55f0b6477f10 2024-05-08T18:50:49.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.246+0000 7f451d52e800 1 -- 172.21.15.132:0/3357066146 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0b6476db0 con 0x55f0b6374490 2024-05-08T18:50:49.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.246+0000 7f4519aec640 1 -- 172.21.15.132:0/3357066146 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f451400a4a0 con 0x55f0b6374490 2024-05-08T18:50:49.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.246+0000 7f451d52e800 1 -- 172.21.15.132:0/3357066146 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0b6477290 con 0x55f0b6374490 2024-05-08T18:50:49.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.247+0000 7f4519aec640 1 -- 172.21.15.132:0/3357066146 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f451400a4a0 con 0x55f0b6374490 2024-05-08T18:50:49.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.247+0000 7f451d52e800 1 Processor -- start 2024-05-08T18:50:49.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.247+0000 7f451d52e800 1 -- start start 2024-05-08T18:50:49.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.247+0000 7f451d52e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b6489920 0x55f0b6489d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.247+0000 7f451d52e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f0b6264fc0 con 0x55f0b6489920 2024-05-08T18:50:49.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.247+0000 7f4519aec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b6489920 0x55f0b6489d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.247+0000 7f4519aec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b6489920 0x55f0b6489d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33162/0 (socket says 172.21.15.132:33162) 2024-05-08T18:50:49.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.247+0000 7f4519aec640 1 -- 172.21.15.132:0/1265149623 learned_addr learned my addr 172.21.15.132:0/1265149623 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.248+0000 7f4519aec640 1 -- 172.21.15.132:0/1265149623 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0b648a280 con 0x55f0b6489920 2024-05-08T18:50:49.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.248+0000 7f4519aec640 1 --2- 172.21.15.132:0/1265149623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b6489920 0x55f0b6489d40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x55f0b62e85e0 tx=0x7f45140188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.248+0000 7f43feffd640 1 -- 172.21.15.132:0/1265149623 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4514014450 con 0x55f0b6489920 2024-05-08T18:50:49.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.248+0000 7f43feffd640 1 -- 172.21.15.132:0/1265149623 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45140145f0 con 0x55f0b6489920 2024-05-08T18:50:49.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.248+0000 7f43feffd640 1 -- 172.21.15.132:0/1265149623 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45140148d0 con 0x55f0b6489920 2024-05-08T18:50:49.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.248+0000 7f451d52e800 1 -- 172.21.15.132:0/1265149623 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0b648acf0 con 0x55f0b6489920 2024-05-08T18:50:49.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.248+0000 7f451d52e800 1 -- 172.21.15.132:0/1265149623 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0b648b1f0 con 0x55f0b6489920 2024-05-08T18:50:49.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.249+0000 7f43feffd640 1 -- 172.21.15.132:0/1265149623 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4514011040 con 0x55f0b6489920 2024-05-08T18:50:49.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.249+0000 7f43feffd640 1 --2- 172.21.15.132:0/1265149623 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f43f003bba0 0x7f43f003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.249+0000 7f43feffd640 1 -- 172.21.15.132:0/1265149623 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f451401e070 con 0x55f0b6489920 2024-05-08T18:50:49.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.249+0000 7f45192eb640 1 --2- 172.21.15.132:0/1265149623 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f43f003bba0 0x7f43f003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.249+0000 7f451d52e800 1 Processor -- start 2024-05-08T18:50:49.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.249+0000 7f45192eb640 1 --2- 172.21.15.132:0/1265149623 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f43f003bba0 0x7f43f003e060 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55f0b6476030 tx=0x7f450c066ca0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.249+0000 7f451d52e800 1 -- start start 2024-05-08T18:50:49.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.250+0000 7f451d52e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b6496be0 0x55f0b6497000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.250+0000 7f451d52e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f0b6465080 con 0x55f0b6496be0 2024-05-08T18:50:49.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.250+0000 7f4519aec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b6496be0 0x55f0b6497000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.250+0000 7f4519aec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b6496be0 0x55f0b6497000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33178/0 (socket says 172.21.15.132:33178) 2024-05-08T18:50:49.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.250+0000 7f4519aec640 1 -- 172.21.15.132:0/2673668376 learned_addr learned my addr 172.21.15.132:0/2673668376 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.250+0000 7f4519aec640 1 -- 172.21.15.132:0/2673668376 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0b64975d0 con 0x55f0b6496be0 2024-05-08T18:50:49.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.250+0000 7f4519aec640 1 --2- 172.21.15.132:0/2673668376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b6496be0 0x55f0b6497000 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4514052c50 tx=0x7f45140118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=438f033535fc5837 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.250+0000 7f43fcff9640 1 -- 172.21.15.132:0/2673668376 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4514011d30 con 0x55f0b6496be0 2024-05-08T18:50:49.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.250+0000 7f43fcff9640 1 -- 172.21.15.132:0/2673668376 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45140540f0 con 0x55f0b6496be0 2024-05-08T18:50:49.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.250+0000 7f43fcff9640 1 -- 172.21.15.132:0/2673668376 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45140543d0 con 0x55f0b6496be0 2024-05-08T18:50:49.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.251+0000 7f451d52e800 1 -- 172.21.15.132:0/2673668376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b6496be0 msgr2=0x55f0b6497000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.251+0000 7f451d52e800 1 --2- 172.21.15.132:0/2673668376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b6496be0 0x55f0b6497000 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4514052c50 tx=0x7f45140118e0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.251+0000 7f451d52e800 1 -- 172.21.15.132:0/2673668376 shutdown_connections 2024-05-08T18:50:49.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.251+0000 7f451d52e800 1 --2- 172.21.15.132:0/2673668376 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b6496be0 0x55f0b6497000 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.251+0000 7f451d52e800 1 -- 172.21.15.132:0/2673668376 >> 172.21.15.132:0/2673668376 conn(0x55f0b6492f40 msgr2=0x55f0b6490fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.251+0000 7f451d52e800 1 -- 172.21.15.132:0/2673668376 shutdown_connections 2024-05-08T18:50:49.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.251+0000 7f451d52e800 1 -- 172.21.15.132:0/2673668376 wait complete. 2024-05-08T18:50:49.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.251+0000 7f451d52e800 1 Processor -- start 2024-05-08T18:50:49.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.251+0000 7f451d52e800 1 -- start start 2024-05-08T18:50:49.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.251+0000 7f451d52e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b6496be0 0x55f0b649e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.251+0000 7f451d52e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f0b6497d40 con 0x55f0b6496be0 2024-05-08T18:50:49.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.252+0000 7f4519aec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b6496be0 0x55f0b649e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.252+0000 7f4519aec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b6496be0 0x55f0b649e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33182/0 (socket says 172.21.15.132:33182) 2024-05-08T18:50:49.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.252+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 learned_addr learned my addr 172.21.15.132:0/2960290545 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.252+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0b649e6f0 con 0x55f0b6496be0 2024-05-08T18:50:49.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.252+0000 7f4519aec640 1 --2- 172.21.15.132:0/2960290545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b6496be0 0x55f0b649e1b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4514051b40 tx=0x7f4514052bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.252+0000 7f43eeffd640 1 -- 172.21.15.132:0/2960290545 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4514040920 con 0x55f0b6496be0 2024-05-08T18:50:49.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.252+0000 7f43eeffd640 1 -- 172.21.15.132:0/2960290545 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4514045050 con 0x55f0b6496be0 2024-05-08T18:50:49.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.252+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0b649e980 con 0x55f0b6496be0 2024-05-08T18:50:49.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.252+0000 7f43eeffd640 1 -- 172.21.15.132:0/2960290545 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4514040c10 con 0x55f0b6496be0 2024-05-08T18:50:49.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.252+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0b64a1630 con 0x55f0b6496be0 2024-05-08T18:50:49.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.253+0000 7f43eeffd640 1 -- 172.21.15.132:0/2960290545 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f451404e040 con 0x55f0b6496be0 2024-05-08T18:50:49.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.253+0000 7f43eeffd640 1 --2- 172.21.15.132:0/2960290545 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f43e403bba0 0x7f43e403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.253+0000 7f43eeffd640 1 -- 172.21.15.132:0/2960290545 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f451400e040 con 0x55f0b6496be0 2024-05-08T18:50:49.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.253+0000 7f45192eb640 1 --2- 172.21.15.132:0/2960290545 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f43e403bba0 0x7f43e403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.254+0000 7f45192eb640 1 --2- 172.21.15.132:0/2960290545 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f43e403bba0 0x7f43e403e060 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f450c05ce20 tx=0x7f450c072000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.254+0000 7f451d52e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.254+0000 7f451d52e800 1 --2- 172.21.15.132:0/2960290545 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f0b64a9e80 0x55f0b64ac340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.254+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64aca90 con 0x55f0b64a9e80 2024-05-08T18:50:49.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.254+0000 7f4518aea640 1 --2- 172.21.15.132:0/2960290545 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f0b64a9e80 0x55f0b64ac340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.254+0000 7f4518aea640 1 --2- 172.21.15.132:0/2960290545 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f0b64a9e80 0x55f0b64ac340 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.254+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4510009050 con 0x55f0b64a9e80 2024-05-08T18:50:49.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.255+0000 7f451d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.255+0000 7f451d52e800 20 realm 2024-05-08T18:50:49.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.255+0000 7f451d52e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.255+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64a92d0 con 0x55f0b64a9e80 2024-05-08T18:50:49.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.255+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4510009050 con 0x55f0b64a9e80 2024-05-08T18:50:49.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.255+0000 7f451d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.255+0000 7f451d52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:49.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.255+0000 7f451d52e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.255+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64ad580 con 0x55f0b64a9e80 2024-05-08T18:50:49.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.255+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4510009050 con 0x55f0b64a9e80 2024-05-08T18:50:49.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.255+0000 7f451d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.255+0000 7f451d52e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.255+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64ade50 con 0x55f0b64a9e80 2024-05-08T18:50:49.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.255+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4510009050 con 0x55f0b64a9e80 2024-05-08T18:50:49.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.255+0000 7f451d52e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:49.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.255+0000 7f451d52e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.255+0000 7f451d52e800 1 --2- 172.21.15.132:0/2960290545 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f0b64ae790 0x55f0b64b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.255+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b1310 con 0x55f0b64ae790 2024-05-08T18:50:49.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.255+0000 7f4519aec640 1 --2- 172.21.15.132:0/2960290545 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f0b64ae790 0x55f0b64b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.256+0000 7f4519aec640 1 --2- 172.21.15.132:0/2960290545 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f0b64ae790 0x55f0b64b0b80 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.256+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f451403d070 con 0x55f0b64ae790 2024-05-08T18:50:49.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.256+0000 7f451d52e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:49.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.256+0000 7f451d52e800 20 searching for the correct realm 2024-05-08T18:50:49.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.256+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x55f0b64ae790 2024-05-08T18:50:49.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.256+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451403d070 con 0x55f0b64ae790 2024-05-08T18:50:49.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.256+0000 7f4519aec640 1 --2- 172.21.15.132:0/2960290545 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4514014070 0x7f4514050470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.256+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x7f4514014070 2024-05-08T18:50:49.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.257+0000 7f45192eb640 1 --2- 172.21.15.132:0/2960290545 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4514014070 0x7f4514050470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.257+0000 7f45192eb640 1 --2- 172.21.15.132:0/2960290545 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4514014070 0x7f4514050470 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.257+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f450c078070 con 0x7f4514014070 2024-05-08T18:50:49.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.257+0000 7f45192eb640 1 --2- 172.21.15.132:0/2960290545 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f450c08b360 0x7f450c0935e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.257+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x7f450c08b360 2024-05-08T18:50:49.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.257+0000 7f4518aea640 1 --2- 172.21.15.132:0/2960290545 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f450c08b360 0x7f450c0935e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.258+0000 7f4518aea640 1 --2- 172.21.15.132:0/2960290545 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f450c08b360 0x7f450c0935e0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.258+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4510009050 con 0x7f450c08b360 2024-05-08T18:50:49.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.258+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x55f0b64a9e80 2024-05-08T18:50:49.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.258+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4510009050 con 0x55f0b64a9e80 2024-05-08T18:50:49.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.258+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x55f0b64a9e80 2024-05-08T18:50:49.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.258+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4510029040 con 0x55f0b64a9e80 2024-05-08T18:50:49.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.258+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x7f450c08b360 2024-05-08T18:50:49.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.259+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4510029040 con 0x7f450c08b360 2024-05-08T18:50:49.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.259+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x7f450c08b360 2024-05-08T18:50:49.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.259+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4510029040 con 0x7f450c08b360 2024-05-08T18:50:49.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.259+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x7f4514014070 2024-05-08T18:50:49.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.259+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f450c078070 con 0x7f4514014070 2024-05-08T18:50:49.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.259+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x55f0b64ae790 2024-05-08T18:50:49.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.259+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451403d070 con 0x55f0b64ae790 2024-05-08T18:50:49.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.259+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x55f0b64a9e80 2024-05-08T18:50:49.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.260+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4510029040 con 0x55f0b64a9e80 2024-05-08T18:50:49.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.260+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x7f450c08b360 2024-05-08T18:50:49.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.260+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4510029040 con 0x7f450c08b360 2024-05-08T18:50:49.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.260+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x55f0b64a9e80 2024-05-08T18:50:49.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.260+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4510029040 con 0x55f0b64a9e80 2024-05-08T18:50:49.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.260+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x7f4514014070 2024-05-08T18:50:49.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.260+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f450c078070 con 0x7f4514014070 2024-05-08T18:50:49.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.260+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x55f0b64ae790 2024-05-08T18:50:49.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.261+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f451403d070 con 0x55f0b64ae790 2024-05-08T18:50:49.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.261+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x55f0b64ae790 2024-05-08T18:50:49.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.261+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451403d070 con 0x55f0b64ae790 2024-05-08T18:50:49.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.261+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x7f450c08b360 2024-05-08T18:50:49.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.261+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4510029040 con 0x7f450c08b360 2024-05-08T18:50:49.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.261+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x55f0b64ae790 2024-05-08T18:50:49.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.262+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451403d070 con 0x55f0b64ae790 2024-05-08T18:50:49.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.262+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x55f0b64ae790 2024-05-08T18:50:49.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.262+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f451403d070 con 0x55f0b64ae790 2024-05-08T18:50:49.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.262+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x55f0b64a9e80 2024-05-08T18:50:49.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.262+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4510029040 con 0x55f0b64a9e80 2024-05-08T18:50:49.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.262+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x55f0b64a9e80 2024-05-08T18:50:49.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.262+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4510029040 con 0x55f0b64a9e80 2024-05-08T18:50:49.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.262+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x7f450c08b360 2024-05-08T18:50:49.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.262+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4510029040 con 0x7f450c08b360 2024-05-08T18:50:49.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.263+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x55f0b64ae790 2024-05-08T18:50:49.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.263+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4514069040 con 0x55f0b64ae790 2024-05-08T18:50:49.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.263+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x7f4514014070 2024-05-08T18:50:49.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.263+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f450c078070 con 0x7f4514014070 2024-05-08T18:50:49.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.263+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x55f0b64a9e80 2024-05-08T18:50:49.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.263+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4510029040 con 0x55f0b64a9e80 2024-05-08T18:50:49.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.263+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x7f450c08b360 2024-05-08T18:50:49.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.264+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4510029040 con 0x7f450c08b360 2024-05-08T18:50:49.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.264+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x55f0b64ae790 2024-05-08T18:50:49.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.264+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4514069040 con 0x55f0b64ae790 2024-05-08T18:50:49.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.264+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x7f450c08b360 2024-05-08T18:50:49.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.264+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4510029040 con 0x7f450c08b360 2024-05-08T18:50:49.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.264+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x7f4514014070 2024-05-08T18:50:49.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.264+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f450c078070 con 0x7f4514014070 2024-05-08T18:50:49.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.264+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x55f0b64ae790 2024-05-08T18:50:49.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.265+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4514069040 con 0x55f0b64ae790 2024-05-08T18:50:49.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.265+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2c60 con 0x7f450c08b360 2024-05-08T18:50:49.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.265+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4510029040 con 0x7f450c08b360 2024-05-08T18:50:49.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.265+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f451003a040 con 0x55f0b64a9e80 2024-05-08T18:50:49.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.265+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4510029040 con 0x55f0b64a9e80 2024-05-08T18:50:49.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.265+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7f451003a040 con 0x7f4514014070 2024-05-08T18:50:49.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.265+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f450c078070 con 0x7f4514014070 2024-05-08T18:50:49.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:49.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:49.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:49.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:49.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:49.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:49.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b1cd0 con 0x55f0b64a9e80 2024-05-08T18:50:49.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4510029040 con 0x55f0b64a9e80 2024-05-08T18:50:49.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b2570 con 0x55f0b64a9e80 2024-05-08T18:50:49.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4510029040 con 0x55f0b64a9e80 2024-05-08T18:50:49.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:49.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b30e0 con 0x55f0b64a9e80 2024-05-08T18:50:49.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4510029040 con 0x55f0b64a9e80 2024-05-08T18:50:49.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:49.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 20 zone default found 2024-05-08T18:50:49.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 4 Realm: () 2024-05-08T18:50:49.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:49.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:49.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:49.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 20 zonegroup default 2024-05-08T18:50:49.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.266+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b3120 con 0x7f450c08b360 2024-05-08T18:50:49.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.267+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4510029040 con 0x7f450c08b360 2024-05-08T18:50:49.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.267+0000 7f451d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.267+0000 7f451d52e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.267+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b4f40 con 0x55f0b64ae790 2024-05-08T18:50:49.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.267+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4514069040 con 0x55f0b64ae790 2024-05-08T18:50:49.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.267+0000 7f451d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.267+0000 7f451d52e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.267+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b5360 con 0x55f0b64ae790 2024-05-08T18:50:49.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.267+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4514069040 con 0x55f0b64ae790 2024-05-08T18:50:49.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.267+0000 7f451d52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.267+0000 7f451d52e800 20 started sync module instance, tier type = 2024-05-08T18:50:49.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.267+0000 7f451d52e800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:49.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.267+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b43e0 con 0x7f4514014070 2024-05-08T18:50:49.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.268+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f450c078070 con 0x7f4514014070 2024-05-08T18:50:49.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.268+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94492338898896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b5c70 con 0x7f4514014070 2024-05-08T18:50:49.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.268+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b64c0 con 0x55f0b64a9e80 2024-05-08T18:50:49.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.269+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94492338898896] v25'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f450c078070 con 0x7f4514014070 2024-05-08T18:50:49.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.269+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4510029040 con 0x55f0b64a9e80 2024-05-08T18:50:49.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.269+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94492338902976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b6520 con 0x55f0b64a9e80 2024-05-08T18:50:49.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.269+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b7030 con 0x55f0b64ae790 2024-05-08T18:50:49.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.271+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4514069040 con 0x55f0b64ae790 2024-05-08T18:50:49.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.271+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94492338907872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b7030 con 0x55f0b64ae790 2024-05-08T18:50:49.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.271+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b8030 con 0x7f4514014070 2024-05-08T18:50:49.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.271+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94492338902976] v25'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4510029040 con 0x55f0b64a9e80 2024-05-08T18:50:49.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.272+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94492338907872] v25'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4514069040 con 0x55f0b64ae790 2024-05-08T18:50:49.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.272+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f450c078070 con 0x7f4514014070 2024-05-08T18:50:49.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.272+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94492338912032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b7420 con 0x7f4514014070 2024-05-08T18:50:49.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.272+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b8a40 con 0x55f0b64a9e80 2024-05-08T18:50:49.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.273+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4510029040 con 0x55f0b64a9e80 2024-05-08T18:50:49.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.273+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94492338914976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b9110 con 0x55f0b64a9e80 2024-05-08T18:50:49.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.273+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b9c30 con 0x7f450c08b360 2024-05-08T18:50:49.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.273+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94492338912032] v25'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f450c078070 con 0x7f4514014070 2024-05-08T18:50:49.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.274+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94492338914976] v25'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4510029040 con 0x55f0b64a9e80 2024-05-08T18:50:49.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.274+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4510029040 con 0x7f450c08b360 2024-05-08T18:50:49.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.274+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94492338919168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b9bf0 con 0x7f450c08b360 2024-05-08T18:50:49.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.274+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64ba4d0 con 0x7f450c08b360 2024-05-08T18:50:49.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.275+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(56 notify.6 [create] v25'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4510029040 con 0x7f450c08b360 2024-05-08T18:50:49.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.275+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94492338921504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b9bf0 con 0x7f450c08b360 2024-05-08T18:50:49.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.275+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64bb010 con 0x7f450c08b360 2024-05-08T18:50:49.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.275+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94492338919168] v25'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4510029040 con 0x7f450c08b360 2024-05-08T18:50:49.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.276+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94492338921504] v25'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4510029040 con 0x7f450c08b360 2024-05-08T18:50:49.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.276+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4510029040 con 0x7f450c08b360 2024-05-08T18:50:49.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.276+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94492338922560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b6010 con 0x7f450c08b360 2024-05-08T18:50:49.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.276+0000 7f451d52e800 20 add_watcher() i=0 2024-05-08T18:50:49.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.276+0000 7f451d52e800 20 add_watcher() i=1 2024-05-08T18:50:49.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.276+0000 7f451d52e800 20 add_watcher() i=2 2024-05-08T18:50:49.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.276+0000 7f451d52e800 20 add_watcher() i=3 2024-05-08T18:50:49.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.276+0000 7f451d52e800 20 add_watcher() i=4 2024-05-08T18:50:49.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.276+0000 7f451d52e800 20 add_watcher() i=5 2024-05-08T18:50:49.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.276+0000 7f451d52e800 20 add_watcher() i=6 2024-05-08T18:50:49.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.277+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94492338922560] v25'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4510029040 con 0x7f450c08b360 2024-05-08T18:50:49.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.277+0000 7f451d52e800 20 add_watcher() i=7 2024-05-08T18:50:49.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.277+0000 7f451d52e800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:49.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.277+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64be000 con 0x55f0b64a9e80 2024-05-08T18:50:49.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.277+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4510029040 con 0x55f0b64a9e80 2024-05-08T18:50:49.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.277+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94492338924256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64bb480 con 0x55f0b64a9e80 2024-05-08T18:50:49.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.278+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94492338924256] v25'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4510029040 con 0x55f0b64a9e80 2024-05-08T18:50:49.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.278+0000 7f43cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:49.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.278+0000 7f451d52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:49.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.278+0000 7f451d52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:49.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.278+0000 7f451d52e800 5 note: GC not initialized 2024-05-08T18:50:49.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.279+0000 7f43ce7e4640 20 reqs_thread_entry: start 2024-05-08T18:50:49.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.279+0000 7f451d52e800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:49.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.279+0000 7f451d52e800 20 Filter name: none 2024-05-08T18:50:49.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.279+0000 7f433ffff640 20 reqs_thread_entry: start 2024-05-08T18:50:49.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.279+0000 7f451d52e800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:50:49.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.279+0000 7f451d52e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.279+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64f13f0 con 0x7f450c08b360 2024-05-08T18:50:49.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.280+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f4510029040 con 0x7f450c08b360 2024-05-08T18:50:49.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.280+0000 7f451d52e800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:50:49.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.280+0000 7f451d52e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-08T18:50:49.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.280+0000 7f451d52e800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:50:49.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.280+0000 7f451d52e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:49.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.280+0000 7f451d52e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:50:49.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.280+0000 7f451d52e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.280+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64f3370 con 0x7f4514014070 2024-05-08T18:50:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.280+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f450c078070 con 0x7f4514014070 2024-05-08T18:50:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.280+0000 7f451d52e800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:50:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.280+0000 7f451d52e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:50:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.280+0000 7f451d52e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:50:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.280+0000 7f451d52e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 : miss 2024-05-08T18:50:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.280+0000 7f451d52e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.280+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:64 8.1e 8:7ec7f916:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64f4de0 con 0x7f450c08b360 2024-05-08T18:50:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.281+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(64 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4510043040 con 0x7f450c08b360 2024-05-08T18:50:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.281+0000 7f451d52e800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:50:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.281+0000 7f451d52e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 info.flags=0x17 2024-05-08T18:50:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.281+0000 7f451d52e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 to cache LRU end 2024-05-08T18:50:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.281+0000 7f451d52e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.281+0000 7f451d52e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:50:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.281+0000 7f451d52e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 2024-05-08T18:50:49.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.281+0000 7f451d52e800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-05-08T18:50:49.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.281+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64f93e0 con 0x7f4514014070 2024-05-08T18:50:49.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.282+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(65 foo.buckets [call] v25'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f450c078070 con 0x7f4514014070 2024-05-08T18:50:49.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.282+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:66 8.1e 8:7ec7f916:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64ff320 con 0x7f450c08b360 2024-05-08T18:50:49.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.283+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(66 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v25'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f4510043040 con 0x7f450c08b360 2024-05-08T18:50:49.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.283+0000 7f451d52e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 info.flags=0x17 2024-05-08T18:50:49.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.283+0000 7f451d52e800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 to cache LRU end 2024-05-08T18:50:49.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.283+0000 7f451d52e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:50:49.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.283+0000 7f451d52e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1, ofs0, ns] 2024-05-08T18:50:49.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.283+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94492339160688 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64f9810 con 0x7f4514014070 2024-05-08T18:50:49.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.283+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== watch-notify(notify (1) cookie 94492338898896 notify 107374182419 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7f450c0a0040 con 0x7f4514014070 2024-05-08T18:50:49.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.283+0000 7f43fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182419 cookie 94492338898896 notifier 4494 bl.length()=752 2024-05-08T18:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.283+0000 7f43fcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 info.flags=0x17 2024-05-08T18:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.283+0000 7f43fcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 to cache LRU end 2024-05-08T18:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.283+0000 7f43fcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.283+0000 7f43fcff9640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f43dc003ea0 con 0x7f4514014070 2024-05-08T18:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.283+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(67 notify.0 [notify cookie 94492339160688 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f450c078070 con 0x7f4514014070 2024-05-08T18:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.284+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== watch-notify(notify_complete (2) cookie 94492339160688 notify 107374182419 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f0b62e7900 con 0x7f4514014070 2024-05-08T18:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.284+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f450c078070 con 0x7f4514014070 2024-05-08T18:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.284+0000 7f451d52e800 20 handle_bi_update(): bucket=:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): orig_sources= new_sources= 2024-05-08T18:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.284+0000 7f451d52e800 20 handle_bi_update(): bucket=:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): potential sources added=[] removed=[] 2024-05-08T18:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.284+0000 7f451d52e800 20 handle_bi_update(): bucket=:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): orig_dests= new_dests= 2024-05-08T18:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.284+0000 7f451d52e800 20 handle_bi_update(): bucket=:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): potential dests added=[] removed=[] 2024-05-08T18:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.284+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64f4670 con 0x7f450c08b360 2024-05-08T18:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.285+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(69 fud.buckets [call] v25'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4510043040 con 0x7f450c08b360 2024-05-08T18:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.285+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64f4670 con 0x7f4514014070 2024-05-08T18:50:49.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.286+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v25'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f450c078070 con 0x7f4514014070 2024-05-08T18:50:49.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.286+0000 7f451d52e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T18:50:49.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.286+0000 7f451d52e800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:50:49.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.286+0000 7f451d52e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:50:49.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.286+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94492339160688 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64fdfb0 con 0x7f450c08b360 2024-05-08T18:50:49.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.286+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== watch-notify(notify (1) cookie 94492338921504 notify 107374182403 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55f0b64f4310 con 0x7f450c08b360 2024-05-08T18:50:49.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.286+0000 7f43effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182403 cookie 94492338921504 notifier 4494 bl.length()=314 2024-05-08T18:50:49.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.286+0000 7f43effff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T18:50:49.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.286+0000 7f43effff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:50:49.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.286+0000 7f43effff640 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f434c003400 con 0x7f450c08b360 2024-05-08T18:50:49.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.286+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(71 notify.6 [notify cookie 94492339160688 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4510043040 con 0x7f450c08b360 2024-05-08T18:50:49.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.287+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4510043040 con 0x7f450c08b360 2024-05-08T18:50:49.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.287+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== watch-notify(notify_complete (2) cookie 94492339160688 notify 107374182403 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f0b6373d70 con 0x7f450c08b360 2024-05-08T18:50:49.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.288+0000 7f43cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:49.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.288+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94492338924256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64f4670 con 0x55f0b64a9e80 2024-05-08T18:50:49.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.288+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94492338924256] v25'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4510043040 con 0x55f0b64a9e80 2024-05-08T18:50:49.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.289+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94492338898896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64baae0 con 0x7f4514014070 2024-05-08T18:50:49.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.289+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94492338898896] v25'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f450c078070 con 0x7f4514014070 2024-05-08T18:50:49.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.289+0000 7f451d52e800 20 remove_watcher() i=0 2024-05-08T18:50:49.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.289+0000 7f451d52e800 2 removed watcher, disabling cache 2024-05-08T18:50:49.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.289+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94492338902976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64baae0 con 0x55f0b64a9e80 2024-05-08T18:50:49.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.291+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94492338902976] v25'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4510043040 con 0x55f0b64a9e80 2024-05-08T18:50:49.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.291+0000 7f451d52e800 20 remove_watcher() i=1 2024-05-08T18:50:49.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.291+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94492338907872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b57c0 con 0x55f0b64ae790 2024-05-08T18:50:49.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.292+0000 7f4519aec640 1 -- 172.21.15.132:0/2960290545 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94492338907872] v25'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4514069040 con 0x55f0b64ae790 2024-05-08T18:50:49.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.292+0000 7f451d52e800 20 remove_watcher() i=2 2024-05-08T18:50:49.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.292+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94492338912032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64baae0 con 0x7f4514014070 2024-05-08T18:50:49.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.293+0000 7f45192eb640 1 -- 172.21.15.132:0/2960290545 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94492338912032] v25'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f450c078070 con 0x7f4514014070 2024-05-08T18:50:49.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.293+0000 7f451d52e800 20 remove_watcher() i=3 2024-05-08T18:50:49.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.293+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94492338914976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b57c0 con 0x55f0b64a9e80 2024-05-08T18:50:49.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.293+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94492338914976] v25'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4510043040 con 0x55f0b64a9e80 2024-05-08T18:50:49.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.293+0000 7f451d52e800 20 remove_watcher() i=4 2024-05-08T18:50:49.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.293+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94492338919168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64baae0 con 0x7f450c08b360 2024-05-08T18:50:49.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.294+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94492338919168] v25'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4510043040 con 0x7f450c08b360 2024-05-08T18:50:49.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.294+0000 7f451d52e800 20 remove_watcher() i=5 2024-05-08T18:50:49.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.294+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94492338921504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b86a0 con 0x7f450c08b360 2024-05-08T18:50:49.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.295+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94492338921504] v25'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4510043040 con 0x7f450c08b360 2024-05-08T18:50:49.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.295+0000 7f451d52e800 20 remove_watcher() i=6 2024-05-08T18:50:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.295+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94492338922560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f0b64b57c0 con 0x7f450c08b360 2024-05-08T18:50:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.296+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94492338922560] v25'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4510043040 con 0x7f450c08b360 2024-05-08T18:50:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.296+0000 7f451d52e800 20 remove_watcher() i=7 2024-05-08T18:50:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.296+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f450c08b360 msgr2=0x7f450c0935e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 --2- 172.21.15.132:0/2960290545 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f450c08b360 0x7f450c0935e0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f0b64a9e80 msgr2=0x55f0b64ac340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 --2- 172.21.15.132:0/2960290545 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f0b64a9e80 0x55f0b64ac340 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4514014070 msgr2=0x7f4514050470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 --2- 172.21.15.132:0/2960290545 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4514014070 0x7f4514050470 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f0b64ae790 msgr2=0x55f0b64b0b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 --2- 172.21.15.132:0/2960290545 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f0b64ae790 0x55f0b64b0b80 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f43e403bba0 msgr2=0x7f43e403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 --2- 172.21.15.132:0/2960290545 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f43e403bba0 0x7f43e403e060 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f450c05ce20 tx=0x7f450c072000 comp rx=0 tx=0).stop 2024-05-08T18:50:49.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b6496be0 msgr2=0x55f0b649e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 --2- 172.21.15.132:0/2960290545 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b6496be0 0x55f0b649e1b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4514051b40 tx=0x7f4514052bb0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 reap_dead start 2024-05-08T18:50:49.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f4518aea640 1 -- 172.21.15.132:0/2960290545 reap_dead start 2024-05-08T18:50:49.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 shutdown_connections 2024-05-08T18:50:49.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 >> 172.21.15.132:0/2960290545 conn(0x55f0b6492f40 msgr2=0x55f0b64905a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 shutdown_connections 2024-05-08T18:50:49.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 -- 172.21.15.132:0/2960290545 wait complete. 2024-05-08T18:50:49.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 -- 172.21.15.132:0/1265149623 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f43f003bba0 msgr2=0x7f43f003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 --2- 172.21.15.132:0/1265149623 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f43f003bba0 0x7f43f003e060 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55f0b6476030 tx=0x7f450c066ca0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 -- 172.21.15.132:0/1265149623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b6489920 msgr2=0x55f0b6489d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 --2- 172.21.15.132:0/1265149623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b6489920 0x55f0b6489d40 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x55f0b62e85e0 tx=0x7f45140188f0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 -- 172.21.15.132:0/1265149623 shutdown_connections 2024-05-08T18:50:49.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 --2- 172.21.15.132:0/1265149623 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f43f003bba0 0x7f43f003e060 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 --2- 172.21.15.132:0/1265149623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b6489920 0x55f0b6489d40 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 -- 172.21.15.132:0/1265149623 >> 172.21.15.132:0/1265149623 conn(0x55f0b647d9c0 msgr2=0x55f0b647ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 -- 172.21.15.132:0/1265149623 shutdown_connections 2024-05-08T18:50:49.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.297+0000 7f451d52e800 1 -- 172.21.15.132:0/1265149623 wait complete. 2024-05-08T18:50:49.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.298+0000 7f451d52e800 1 -- 172.21.15.132:0/3357066146 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f0b6374490 msgr2=0x55f0b64756a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.298+0000 7f451d52e800 1 --2- 172.21.15.132:0/3357066146 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f0b6374490 0x55f0b64756a0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.298+0000 7f451d52e800 1 -- 172.21.15.132:0/3357066146 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f0b6477f10 msgr2=0x55f0b647a300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.298+0000 7f451d52e800 1 --2- 172.21.15.132:0/3357066146 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f0b6477f10 0x55f0b647a300 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.298+0000 7f451d52e800 1 -- 172.21.15.132:0/3357066146 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f440003bb50 msgr2=0x7f440003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.298+0000 7f451d52e800 1 --2- 172.21.15.132:0/3357066146 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f440003bb50 0x7f440003e010 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4510000f60 tx=0x7f45100012b0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.298+0000 7f451d52e800 1 -- 172.21.15.132:0/3357066146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b63732d0 msgr2=0x55f0b62e8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.298+0000 7f451d52e800 1 --2- 172.21.15.132:0/3357066146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b63732d0 0x55f0b62e8bf0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f450c01ced0 tx=0x7f450c002fb0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.298+0000 7f451d52e800 1 -- 172.21.15.132:0/3357066146 shutdown_connections 2024-05-08T18:50:49.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.298+0000 7f451d52e800 1 --2- 172.21.15.132:0/3357066146 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f0b6477f10 0x55f0b647a300 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.298+0000 7f451d52e800 1 --2- 172.21.15.132:0/3357066146 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f0b6374490 0x55f0b64756a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.298+0000 7f451d52e800 1 --2- 172.21.15.132:0/3357066146 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f440003bb50 0x7f440003e010 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.298+0000 7f451d52e800 1 --2- 172.21.15.132:0/3357066146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f0b63732d0 0x55f0b62e8bf0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.298+0000 7f451d52e800 1 -- 172.21.15.132:0/3357066146 >> 172.21.15.132:0/3357066146 conn(0x55f0b636e850 msgr2=0x55f0b645e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.298+0000 7f451d52e800 1 -- 172.21.15.132:0/3357066146 shutdown_connections 2024-05-08T18:50:49.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.298+0000 7f451d52e800 1 -- 172.21.15.132:0/3357066146 wait complete. 2024-05-08T18:50:49.309 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-05-08T18:50:49.309 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-05-08T18:50:49.309 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-05-08T18:50:49.353 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:49.354 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:49.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.355+0000 7f343fa1f800 1 Processor -- start 2024-05-08T18:50:49.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.355+0000 7f343fa1f800 1 -- start start 2024-05-08T18:50:49.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.355+0000 7f343fa1f800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55f8abfe12b0 0x55f8abfe16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.355+0000 7f343fa1f800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f8abfe1d50 con 0x55f8abfe2470 2024-05-08T18:50:49.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.355+0000 7f343fa1f800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55f8abe81e20 con 0x55f8abfe12b0 2024-05-08T18:50:49.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.356+0000 7f343d517640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55f8abfe12b0 0x55f8abfe16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.356+0000 7f343d517640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55f8abfe12b0 0x55f8abfe16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33190/0 (socket says 172.21.15.132:33190) 2024-05-08T18:50:49.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.356+0000 7f343cd16640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55f8abfe2470 0x55f8abfe28f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:47014/0 (socket says 172.21.15.132:47014) 2024-05-08T18:50:49.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.356+0000 7f343d517640 1 -- 172.21.15.132:0/3826577720 learned_addr learned my addr 172.21.15.132:0/3826577720 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.356+0000 7f343d517640 1 -- 172.21.15.132:0/3826577720 >> v1:172.21.15.42:6789/0 conn(0x55f8abfe2470 legacy=0x55f8abfe28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.356+0000 7f343d517640 1 -- 172.21.15.132:0/3826577720 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8abfe3030 con 0x55f8abfe12b0 2024-05-08T18:50:49.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.358+0000 7f343d517640 1 --2- 172.21.15.132:0/3826577720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abfe12b0 0x55f8abfe16d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f343000a520 tx=0x7f343001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3810702e9e65bc7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.358+0000 7f342ffff640 1 -- 172.21.15.132:0/3826577720 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3430057070 con 0x55f8abfe12b0 2024-05-08T18:50:49.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.358+0000 7f342ffff640 1 -- 172.21.15.132:0/3826577720 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3430052570 con 0x55f8abfe12b0 2024-05-08T18:50:49.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.358+0000 7f342ffff640 1 -- 172.21.15.132:0/3826577720 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3430052870 con 0x55f8abfe12b0 2024-05-08T18:50:49.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.358+0000 7f343fa1f800 1 -- 172.21.15.132:0/3826577720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abfe12b0 msgr2=0x55f8abfe16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.358+0000 7f343fa1f800 1 --2- 172.21.15.132:0/3826577720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abfe12b0 0x55f8abfe16d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f343000a520 tx=0x7f343001d010 comp rx=0 tx=0).stop 2024-05-08T18:50:49.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.358+0000 7f343fa1f800 1 -- 172.21.15.132:0/3826577720 shutdown_connections 2024-05-08T18:50:49.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.358+0000 7f343fa1f800 1 --2- 172.21.15.132:0/3826577720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abfe12b0 0x55f8abfe16d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.358+0000 7f343fa1f800 1 -- 172.21.15.132:0/3826577720 >> 172.21.15.132:0/3826577720 conn(0x55f8abfdc830 msgr2=0x55f8abfdec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.358+0000 7f343fa1f800 1 -- 172.21.15.132:0/3826577720 shutdown_connections 2024-05-08T18:50:49.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.359+0000 7f343fa1f800 1 -- 172.21.15.132:0/3826577720 wait complete. 2024-05-08T18:50:49.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.372+0000 7f343fa1f800 1 Processor -- start 2024-05-08T18:50:49.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.372+0000 7f343fa1f800 1 -- start start 2024-05-08T18:50:49.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.372+0000 7f343fa1f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abfe12b0 0x55f8ac0d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.372+0000 7f343fa1f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f8abf2c5b0 con 0x55f8abfe12b0 2024-05-08T18:50:49.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.372+0000 7f343d517640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abfe12b0 0x55f8ac0d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.372+0000 7f343d517640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abfe12b0 0x55f8ac0d2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33206/0 (socket says 172.21.15.132:33206) 2024-05-08T18:50:49.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.372+0000 7f343d517640 1 -- 172.21.15.132:0/2056584479 learned_addr learned my addr 172.21.15.132:0/2056584479 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.372+0000 7f343d517640 1 -- 172.21.15.132:0/2056584479 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8ac0d2ce0 con 0x55f8abfe12b0 2024-05-08T18:50:49.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.373+0000 7f343d517640 1 --2- 172.21.15.132:0/2056584479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abfe12b0 0x55f8ac0d2710 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f343001d050 tx=0x7f343004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2d2f7b785fb2a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.373+0000 7f332b606640 1 -- 172.21.15.132:0/2056584479 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3430057040 con 0x55f8abfe12b0 2024-05-08T18:50:49.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.373+0000 7f332b606640 1 -- 172.21.15.132:0/2056584479 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3430052850 con 0x55f8abfe12b0 2024-05-08T18:50:49.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.373+0000 7f332b606640 1 -- 172.21.15.132:0/2056584479 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3430052b70 con 0x55f8abfe12b0 2024-05-08T18:50:49.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.374+0000 7f343fa1f800 1 -- 172.21.15.132:0/2056584479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abfe12b0 msgr2=0x55f8ac0d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.374+0000 7f343fa1f800 1 --2- 172.21.15.132:0/2056584479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abfe12b0 0x55f8ac0d2710 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f343001d050 tx=0x7f343004c000 comp rx=0 tx=0).stop 2024-05-08T18:50:49.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.374+0000 7f343fa1f800 1 -- 172.21.15.132:0/2056584479 shutdown_connections 2024-05-08T18:50:49.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.374+0000 7f343fa1f800 1 --2- 172.21.15.132:0/2056584479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abfe12b0 0x55f8ac0d2710 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.374+0000 7f343fa1f800 1 -- 172.21.15.132:0/2056584479 >> 172.21.15.132:0/2056584479 conn(0x55f8abfdc830 msgr2=0x55f8ac0ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.374+0000 7f343fa1f800 1 -- 172.21.15.132:0/2056584479 shutdown_connections 2024-05-08T18:50:49.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.374+0000 7f343fa1f800 1 -- 172.21.15.132:0/2056584479 wait complete. 2024-05-08T18:50:49.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.374+0000 7f343fa1f800 1 Processor -- start 2024-05-08T18:50:49.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.374+0000 7f343fa1f800 1 -- start start 2024-05-08T18:50:49.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.374+0000 7f343fa1f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abfe12b0 0x55f8ac0da0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.374+0000 7f343fa1f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f8abfea940 con 0x55f8abfe12b0 2024-05-08T18:50:49.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.374+0000 7f343d517640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abfe12b0 0x55f8ac0da0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.374+0000 7f343d517640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abfe12b0 0x55f8ac0da0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33218/0 (socket says 172.21.15.132:33218) 2024-05-08T18:50:49.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.374+0000 7f343d517640 1 -- 172.21.15.132:0/2826176259 learned_addr learned my addr 172.21.15.132:0/2826176259 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.375+0000 7f343d517640 1 -- 172.21.15.132:0/2826176259 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8ac0da610 con 0x55f8abfe12b0 2024-05-08T18:50:49.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.375+0000 7f343d517640 1 --2- 172.21.15.132:0/2826176259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abfe12b0 0x55f8ac0da0d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f343001d050 tx=0x7f3430003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.375+0000 7f3329e03640 1 -- 172.21.15.132:0/2826176259 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3430073070 con 0x55f8abfe12b0 2024-05-08T18:50:49.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.375+0000 7f3329e03640 1 -- 172.21.15.132:0/2826176259 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f343005d650 con 0x55f8abfe12b0 2024-05-08T18:50:49.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.375+0000 7f343fa1f800 1 -- 172.21.15.132:0/2826176259 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8ac0da8a0 con 0x55f8abfe12b0 2024-05-08T18:50:49.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.375+0000 7f3329e03640 1 -- 172.21.15.132:0/2826176259 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3430057070 con 0x55f8abfe12b0 2024-05-08T18:50:49.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.375+0000 7f343fa1f800 1 -- 172.21.15.132:0/2826176259 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8ac0dd550 con 0x55f8abfe12b0 2024-05-08T18:50:49.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.376+0000 7f3329e03640 1 -- 172.21.15.132:0/2826176259 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f3430076070 con 0x55f8abfe12b0 2024-05-08T18:50:49.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.376+0000 7f3329e03640 1 --2- 172.21.15.132:0/2826176259 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f332403bb50 0x7f332403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.376+0000 7f3329e03640 1 -- 172.21.15.132:0/2826176259 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f34300940b0 con 0x55f8abfe12b0 2024-05-08T18:50:49.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.376+0000 7f343cd16640 1 --2- 172.21.15.132:0/2826176259 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f332403bb50 0x7f332403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.376+0000 7f343fa1f800 1 --2- 172.21.15.132:0/2826176259 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f8abfe2470 0x55f8ac0e1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.376+0000 7f343fa1f800 1 -- 172.21.15.132:0/2826176259 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac0e1930 con 0x55f8abfe2470 2024-05-08T18:50:49.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.376+0000 7f343dd18640 1 --2- 172.21.15.132:0/2826176259 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f8abfe2470 0x55f8ac0e1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.377+0000 7f343cd16640 1 --2- 172.21.15.132:0/2826176259 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f332403bb50 0x7f332403e010 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3434000f60 tx=0x7f3434001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.377+0000 7f343dd18640 1 --2- 172.21.15.132:0/2826176259 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f8abfe2470 0x55f8ac0e1310 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.377+0000 7f343dd18640 1 -- 172.21.15.132:0/2826176259 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f343800a4a0 con 0x55f8abfe2470 2024-05-08T18:50:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.377+0000 7f343fa1f800 1 -- 172.21.15.132:0/2826176259 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac0de8c0 con 0x55f8abfe2470 2024-05-08T18:50:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.377+0000 7f343dd18640 1 -- 172.21.15.132:0/2826176259 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f343800a4a0 con 0x55f8abfe2470 2024-05-08T18:50:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.377+0000 7f343fa1f800 1 --2- 172.21.15.132:0/2826176259 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f8ac0e3c40 0x55f8ac0e6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.377+0000 7f343fa1f800 1 -- 172.21.15.132:0/2826176259 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac0e66d0 con 0x55f8ac0e3c40 2024-05-08T18:50:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.377+0000 7f343d517640 1 --2- 172.21.15.132:0/2826176259 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f8ac0e3c40 0x55f8ac0e6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.378+0000 7f343d517640 1 --2- 172.21.15.132:0/2826176259 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f8ac0e3c40 0x55f8ac0e6030 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.378+0000 7f343d517640 1 -- 172.21.15.132:0/2826176259 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3430075030 con 0x55f8ac0e3c40 2024-05-08T18:50:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.378+0000 7f343fa1f800 1 -- 172.21.15.132:0/2826176259 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac0e2ae0 con 0x55f8abfe2470 2024-05-08T18:50:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.378+0000 7f343dd18640 1 -- 172.21.15.132:0/2826176259 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f343800a4a0 con 0x55f8abfe2470 2024-05-08T18:50:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.378+0000 7f343fa1f800 1 -- 172.21.15.132:0/2826176259 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac0e2fc0 con 0x55f8abfe2470 2024-05-08T18:50:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.378+0000 7f343dd18640 1 -- 172.21.15.132:0/2826176259 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f343800a4a0 con 0x55f8abfe2470 2024-05-08T18:50:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.379+0000 7f343fa1f800 1 Processor -- start 2024-05-08T18:50:49.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.379+0000 7f343fa1f800 1 -- start start 2024-05-08T18:50:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.379+0000 7f343fa1f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abf56ed0 0x55f8abf55340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.379+0000 7f343fa1f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f8abed2fc0 con 0x55f8abf56ed0 2024-05-08T18:50:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.379+0000 7f343dd18640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abf56ed0 0x55f8abf55340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.379+0000 7f343dd18640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abf56ed0 0x55f8abf55340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33226/0 (socket says 172.21.15.132:33226) 2024-05-08T18:50:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.379+0000 7f343dd18640 1 -- 172.21.15.132:0/3638663683 learned_addr learned my addr 172.21.15.132:0/3638663683 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.380+0000 7f343dd18640 1 -- 172.21.15.132:0/3638663683 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8abf55880 con 0x55f8abf56ed0 2024-05-08T18:50:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.380+0000 7f343dd18640 1 --2- 172.21.15.132:0/3638663683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abf56ed0 0x55f8abf55340 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x55f8ac0dafa0 tx=0x7f34380188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.380+0000 7f3322ffd640 1 -- 172.21.15.132:0/3638663683 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3438014450 con 0x55f8abf56ed0 2024-05-08T18:50:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.380+0000 7f3322ffd640 1 -- 172.21.15.132:0/3638663683 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34380145f0 con 0x55f8abf56ed0 2024-05-08T18:50:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.380+0000 7f3322ffd640 1 -- 172.21.15.132:0/3638663683 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34380148d0 con 0x55f8abf56ed0 2024-05-08T18:50:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.380+0000 7f343fa1f800 1 -- 172.21.15.132:0/3638663683 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8abf55b10 con 0x55f8abf56ed0 2024-05-08T18:50:49.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.380+0000 7f343fa1f800 1 -- 172.21.15.132:0/3638663683 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8abf56010 con 0x55f8abf56ed0 2024-05-08T18:50:49.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.381+0000 7f3322ffd640 1 -- 172.21.15.132:0/3638663683 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f3438011040 con 0x55f8abf56ed0 2024-05-08T18:50:49.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.381+0000 7f3322ffd640 1 --2- 172.21.15.132:0/3638663683 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f331403bba0 0x7f331403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.381+0000 7f3322ffd640 1 -- 172.21.15.132:0/3638663683 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f343801e070 con 0x55f8abf56ed0 2024-05-08T18:50:49.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.381+0000 7f343d517640 1 --2- 172.21.15.132:0/3638663683 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f331403bba0 0x7f331403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.381+0000 7f343fa1f800 1 Processor -- start 2024-05-08T18:50:49.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.381+0000 7f343fa1f800 1 -- start start 2024-05-08T18:50:49.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.381+0000 7f343d517640 1 --2- 172.21.15.132:0/3638663683 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f331403bba0 0x7f331403e060 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55f8ac0e1d80 tx=0x7f3430006a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.381+0000 7f343fa1f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ac104b80 0x55f8ac104fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.381+0000 7f343fa1f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f8ac0d2fa0 con 0x55f8ac104b80 2024-05-08T18:50:49.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.382+0000 7f343dd18640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ac104b80 0x55f8ac104fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.382+0000 7f343dd18640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ac104b80 0x55f8ac104fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33234/0 (socket says 172.21.15.132:33234) 2024-05-08T18:50:49.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.382+0000 7f343dd18640 1 -- 172.21.15.132:0/994061800 learned_addr learned my addr 172.21.15.132:0/994061800 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.382+0000 7f343dd18640 1 -- 172.21.15.132:0/994061800 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8ac105570 con 0x55f8ac104b80 2024-05-08T18:50:49.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.382+0000 7f343dd18640 1 --2- 172.21.15.132:0/994061800 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ac104b80 0x55f8ac104fa0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3438052c50 tx=0x7f34380118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4b338115194981 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.382+0000 7f3320ff9640 1 -- 172.21.15.132:0/994061800 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3438044020 con 0x55f8ac104b80 2024-05-08T18:50:49.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.382+0000 7f3320ff9640 1 -- 172.21.15.132:0/994061800 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3438011c00 con 0x55f8ac104b80 2024-05-08T18:50:49.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.382+0000 7f3320ff9640 1 -- 172.21.15.132:0/994061800 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3438014a70 con 0x55f8ac104b80 2024-05-08T18:50:49.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.383+0000 7f343fa1f800 1 -- 172.21.15.132:0/994061800 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ac104b80 msgr2=0x55f8ac104fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.383+0000 7f343fa1f800 1 --2- 172.21.15.132:0/994061800 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ac104b80 0x55f8ac104fa0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3438052c50 tx=0x7f34380118e0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.383+0000 7f343fa1f800 1 -- 172.21.15.132:0/994061800 shutdown_connections 2024-05-08T18:50:49.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.383+0000 7f343fa1f800 1 --2- 172.21.15.132:0/994061800 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ac104b80 0x55f8ac104fa0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.383+0000 7f343fa1f800 1 -- 172.21.15.132:0/994061800 >> 172.21.15.132:0/994061800 conn(0x55f8ac100e90 msgr2=0x55f8ac0feef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.383+0000 7f343fa1f800 1 -- 172.21.15.132:0/994061800 shutdown_connections 2024-05-08T18:50:49.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.383+0000 7f343fa1f800 1 -- 172.21.15.132:0/994061800 wait complete. 2024-05-08T18:50:49.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.383+0000 7f343fa1f800 1 Processor -- start 2024-05-08T18:50:49.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.383+0000 7f343fa1f800 1 -- start start 2024-05-08T18:50:49.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.383+0000 7f343fa1f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ac104b80 0x55f8ac10c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.383+0000 7f343fa1f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f8ac105cc0 con 0x55f8ac104b80 2024-05-08T18:50:49.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.383+0000 7f343dd18640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ac104b80 0x55f8ac10c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.383+0000 7f343dd18640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ac104b80 0x55f8ac10c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33238/0 (socket says 172.21.15.132:33238) 2024-05-08T18:50:49.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.383+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 learned_addr learned my addr 172.21.15.132:0/1820863185 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.384+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8ac10c680 con 0x55f8ac104b80 2024-05-08T18:50:49.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.384+0000 7f343dd18640 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ac104b80 0x55f8ac10c140 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3438022a80 tx=0x7f3438052bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.384+0000 7f3312ffd640 1 -- 172.21.15.132:0/1820863185 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34380409b0 con 0x55f8ac104b80 2024-05-08T18:50:49.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.384+0000 7f3312ffd640 1 -- 172.21.15.132:0/1820863185 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3438040b50 con 0x55f8ac104b80 2024-05-08T18:50:49.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.384+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8ac10c910 con 0x55f8ac104b80 2024-05-08T18:50:49.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.384+0000 7f3312ffd640 1 -- 172.21.15.132:0/1820863185 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3438051070 con 0x55f8ac104b80 2024-05-08T18:50:49.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.384+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8ac10f5c0 con 0x55f8ac104b80 2024-05-08T18:50:49.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.385+0000 7f3312ffd640 1 -- 172.21.15.132:0/1820863185 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f343804e040 con 0x55f8ac104b80 2024-05-08T18:50:49.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.385+0000 7f3312ffd640 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f330803bba0 0x7f330803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.385+0000 7f3312ffd640 1 -- 172.21.15.132:0/1820863185 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f343800e040 con 0x55f8ac104b80 2024-05-08T18:50:49.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.385+0000 7f343d517640 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f330803bba0 0x7f330803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.386+0000 7f343d517640 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f330803bba0 0x7f330803e060 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f343005cc00 tx=0x7f3430085000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.386+0000 7f343fa1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.386+0000 7f343fa1f800 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f8ac117d90 0x55f8ac11a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.386+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac11a9a0 con 0x55f8ac117d90 2024-05-08T18:50:49.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.386+0000 7f343cd16640 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f8ac117d90 0x55f8ac11a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.386+0000 7f343cd16640 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f8ac117d90 0x55f8ac11a250 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.386+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f343400f610 con 0x55f8ac117d90 2024-05-08T18:50:49.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.386+0000 7f343fa1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.386+0000 7f343fa1f800 20 realm 2024-05-08T18:50:49.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.386+0000 7f343fa1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.386+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac1171e0 con 0x55f8ac117d90 2024-05-08T18:50:49.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.387+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f343400f610 con 0x55f8ac117d90 2024-05-08T18:50:49.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.387+0000 7f343fa1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.387+0000 7f343fa1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:49.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.387+0000 7f343fa1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.387+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac11b490 con 0x55f8ac117d90 2024-05-08T18:50:49.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.387+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f343400f610 con 0x55f8ac117d90 2024-05-08T18:50:49.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.387+0000 7f343fa1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.387+0000 7f343fa1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.387+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac11bd60 con 0x55f8ac117d90 2024-05-08T18:50:49.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.387+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f343400f610 con 0x55f8ac117d90 2024-05-08T18:50:49.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.387+0000 7f343fa1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:49.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.387+0000 7f343fa1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.387+0000 7f343fa1f800 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f8ac11c780 0x55f8ac11eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.387+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac11f260 con 0x55f8ac11c780 2024-05-08T18:50:49.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.387+0000 7f343dd18640 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f8ac11c780 0x55f8ac11eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.387+0000 7f343dd18640 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f8ac11c780 0x55f8ac11eb70 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.388+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.388+0000 7f343fa1f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:49.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.388+0000 7f343fa1f800 20 searching for the correct realm 2024-05-08T18:50:49.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.388+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x55f8ac11c780 2024-05-08T18:50:49.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.388+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.388+0000 7f343dd18640 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f3438014070 0x7f3438055000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.388+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x7f3438014070 2024-05-08T18:50:49.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.388+0000 7f343d517640 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f3438014070 0x7f3438055000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.389+0000 7f343d517640 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f3438014070 0x7f3438055000 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.389+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3430075030 con 0x7f3438014070 2024-05-08T18:50:49.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.389+0000 7f343d517640 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f3430078060 0x7f343005b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.389+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x7f3430078060 2024-05-08T18:50:49.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.389+0000 7f343cd16640 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f3430078060 0x7f343005b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.390+0000 7f343cd16640 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f3430078060 0x7f343005b550 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.390+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343400f610 con 0x7f3430078060 2024-05-08T18:50:49.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.390+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x55f8ac117d90 2024-05-08T18:50:49.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.390+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343400f610 con 0x55f8ac117d90 2024-05-08T18:50:49.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.390+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x55f8ac117d90 2024-05-08T18:50:49.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.390+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343402b040 con 0x55f8ac117d90 2024-05-08T18:50:49.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.390+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x7f3430078060 2024-05-08T18:50:49.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.391+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343402b040 con 0x7f3430078060 2024-05-08T18:50:49.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.391+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x7f3430078060 2024-05-08T18:50:49.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.391+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343402b040 con 0x7f3430078060 2024-05-08T18:50:49.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.391+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x7f3438014070 2024-05-08T18:50:49.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.391+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3430075030 con 0x7f3438014070 2024-05-08T18:50:49.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.391+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x55f8ac11c780 2024-05-08T18:50:49.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.391+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.392+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x55f8ac117d90 2024-05-08T18:50:49.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.392+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343402b040 con 0x55f8ac117d90 2024-05-08T18:50:49.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.392+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x7f3430078060 2024-05-08T18:50:49.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.392+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343402b040 con 0x7f3430078060 2024-05-08T18:50:49.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.392+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x55f8ac117d90 2024-05-08T18:50:49.408 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.392+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f343402b040 con 0x55f8ac117d90 2024-05-08T18:50:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.392+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x7f3438014070 2024-05-08T18:50:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.393+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3430075030 con 0x7f3438014070 2024-05-08T18:50:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.393+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x55f8ac11c780 2024-05-08T18:50:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.393+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.393+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x55f8ac11c780 2024-05-08T18:50:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.393+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.393+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x7f3430078060 2024-05-08T18:50:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.393+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343402b040 con 0x7f3430078060 2024-05-08T18:50:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.394+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x55f8ac11c780 2024-05-08T18:50:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.394+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.394+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x55f8ac11c780 2024-05-08T18:50:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.394+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.394+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x55f8ac117d90 2024-05-08T18:50:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.394+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343402b040 con 0x55f8ac117d90 2024-05-08T18:50:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.394+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x55f8ac117d90 2024-05-08T18:50:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.394+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f343402b040 con 0x55f8ac117d90 2024-05-08T18:50:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.394+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x7f3430078060 2024-05-08T18:50:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.395+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343402b040 con 0x7f3430078060 2024-05-08T18:50:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.395+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x55f8ac11c780 2024-05-08T18:50:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.395+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.395+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x7f3438014070 2024-05-08T18:50:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.395+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3430075030 con 0x7f3438014070 2024-05-08T18:50:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.395+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x55f8ac117d90 2024-05-08T18:50:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.396+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343402b040 con 0x55f8ac117d90 2024-05-08T18:50:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.396+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x7f3430078060 2024-05-08T18:50:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.396+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343403b040 con 0x7f3430078060 2024-05-08T18:50:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.396+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x55f8ac11c780 2024-05-08T18:50:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.396+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.396+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x7f3430078060 2024-05-08T18:50:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.396+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343403b040 con 0x7f3430078060 2024-05-08T18:50:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.396+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x7f3438014070 2024-05-08T18:50:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.397+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3430075030 con 0x7f3438014070 2024-05-08T18:50:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.397+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x55f8ac11c780 2024-05-08T18:50:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.397+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.397+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x7f3430078060 2024-05-08T18:50:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.397+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343403b040 con 0x7f3430078060 2024-05-08T18:50:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.397+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x55f8ac117d90 2024-05-08T18:50:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.398+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f343403b040 con 0x55f8ac117d90 2024-05-08T18:50:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.398+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac120bb0 con 0x7f3438014070 2024-05-08T18:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.398+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3430075030 con 0x7f3438014070 2024-05-08T18:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.398+0000 7f343fa1f800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.398+0000 7f343fa1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.398+0000 7f343fa1f800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.398+0000 7f343fa1f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.398+0000 7f343fa1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.398+0000 7f343fa1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.398+0000 7f343fa1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.398+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac11fc20 con 0x55f8ac117d90 2024-05-08T18:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.398+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f343403b040 con 0x55f8ac117d90 2024-05-08T18:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.398+0000 7f343fa1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.398+0000 7f343fa1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.398+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac1204c0 con 0x55f8ac117d90 2024-05-08T18:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.398+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f343403b040 con 0x55f8ac117d90 2024-05-08T18:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.398+0000 7f343fa1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.398+0000 7f343fa1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.398+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac121030 con 0x55f8ac117d90 2024-05-08T18:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.398+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f343403b040 con 0x55f8ac117d90 2024-05-08T18:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.398+0000 7f343fa1f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.399+0000 7f343fa1f800 20 zone default found 2024-05-08T18:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.399+0000 7f343fa1f800 4 Realm: () 2024-05-08T18:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.399+0000 7f343fa1f800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.399+0000 7f343fa1f800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.399+0000 7f343fa1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.399+0000 7f343fa1f800 20 zonegroup default 2024-05-08T18:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.399+0000 7f343fa1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.399+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac121030 con 0x7f3430078060 2024-05-08T18:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.399+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f343403b040 con 0x7f3430078060 2024-05-08T18:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.399+0000 7f343fa1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.399+0000 7f343fa1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.399+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac122e20 con 0x55f8ac11c780 2024-05-08T18:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.399+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.399+0000 7f343fa1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.399+0000 7f343fa1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.399+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac123240 con 0x55f8ac11c780 2024-05-08T18:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.399+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.399+0000 7f343fa1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.399+0000 7f343fa1f800 20 started sync module instance, tier type = 2024-05-08T18:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.399+0000 7f343fa1f800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.399+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac1222c0 con 0x7f3438014070 2024-05-08T18:50:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.400+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3430075030 con 0x7f3438014070 2024-05-08T18:50:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.400+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94526527121072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac121f20 con 0x7f3438014070 2024-05-08T18:50:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.400+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac124170 con 0x55f8ac117d90 2024-05-08T18:50:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.401+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94526527121072] v25'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3430075030 con 0x7f3438014070 2024-05-08T18:50:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.402+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343403b040 con 0x55f8ac117d90 2024-05-08T18:50:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.402+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94526527126720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac124590 con 0x55f8ac117d90 2024-05-08T18:50:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.402+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac124f50 con 0x55f8ac11c780 2024-05-08T18:50:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.403+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.403+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94526527130272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac1253b0 con 0x55f8ac11c780 2024-05-08T18:50:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.403+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac125ed0 con 0x7f3438014070 2024-05-08T18:50:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.403+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94526527126720] v25'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343403b040 con 0x55f8ac117d90 2024-05-08T18:50:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.404+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94526527130272] v25'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.404+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3430075030 con 0x7f3438014070 2024-05-08T18:50:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.404+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94526527134112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac124ec0 con 0x7f3438014070 2024-05-08T18:50:49.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.404+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac1268e0 con 0x55f8ac117d90 2024-05-08T18:50:49.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.405+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343403b040 con 0x55f8ac117d90 2024-05-08T18:50:49.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.405+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94526527137296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac127040 con 0x55f8ac117d90 2024-05-08T18:50:49.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.405+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac127b60 con 0x7f3430078060 2024-05-08T18:50:49.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.405+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94526527134112] v25'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3430075030 con 0x7f3438014070 2024-05-08T18:50:49.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.406+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343403b040 con 0x7f3430078060 2024-05-08T18:50:49.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.406+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94526527141424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac127b20 con 0x7f3430078060 2024-05-08T18:50:49.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.406+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94526527137296] v25'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343403b040 con 0x55f8ac117d90 2024-05-08T18:50:49.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.406+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac128430 con 0x7f3430078060 2024-05-08T18:50:49.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.407+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94526527141424] v25'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343403b040 con 0x7f3430078060 2024-05-08T18:50:49.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.407+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343403b040 con 0x7f3430078060 2024-05-08T18:50:49.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.407+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94526527127776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac127b20 con 0x7f3430078060 2024-05-08T18:50:49.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.407+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac128a50 con 0x7f3430078060 2024-05-08T18:50:49.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.408+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94526527127776] v25'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343403b040 con 0x7f3430078060 2024-05-08T18:50:49.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.408+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343403b040 con 0x7f3430078060 2024-05-08T18:50:49.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.408+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94526527143808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac128a50 con 0x7f3430078060 2024-05-08T18:50:49.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.408+0000 7f343fa1f800 20 add_watcher() i=0 2024-05-08T18:50:49.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.408+0000 7f343fa1f800 20 add_watcher() i=1 2024-05-08T18:50:49.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.408+0000 7f343fa1f800 20 add_watcher() i=2 2024-05-08T18:50:49.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.408+0000 7f343fa1f800 20 add_watcher() i=3 2024-05-08T18:50:49.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.408+0000 7f343fa1f800 20 add_watcher() i=4 2024-05-08T18:50:49.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.408+0000 7f343fa1f800 20 add_watcher() i=5 2024-05-08T18:50:49.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.408+0000 7f343fa1f800 20 add_watcher() i=6 2024-05-08T18:50:49.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.409+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94526527143808] v25'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343403b040 con 0x7f3430078060 2024-05-08T18:50:49.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.409+0000 7f343fa1f800 20 add_watcher() i=7 2024-05-08T18:50:49.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.409+0000 7f343fa1f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:49.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.409+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac12be50 con 0x55f8ac117d90 2024-05-08T18:50:49.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.409+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f343403b040 con 0x55f8ac117d90 2024-05-08T18:50:49.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.409+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94526527145840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac129370 con 0x55f8ac117d90 2024-05-08T18:50:49.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.410+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94526527145840] v25'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f343403b040 con 0x55f8ac117d90 2024-05-08T18:50:49.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.411+0000 7f32f3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:49.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.411+0000 7f343fa1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:49.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.411+0000 7f343fa1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:49.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.411+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac12bb30 con 0x55f8ac117d90 2024-05-08T18:50:49.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.412+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v25'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f343403b040 con 0x55f8ac117d90 2024-05-08T18:50:49.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.412+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac134ea0 con 0x7f3430078060 2024-05-08T18:50:49.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.413+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v25'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f343403b040 con 0x7f3430078060 2024-05-08T18:50:49.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.413+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac134ea0 con 0x55f8ac11c780 2024-05-08T18:50:49.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.414+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v25'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.414+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac135350 con 0x55f8ac117d90 2024-05-08T18:50:49.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.415+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v25'113 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f343403b040 con 0x55f8ac117d90 2024-05-08T18:50:49.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.415+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac135350 con 0x7f3438014070 2024-05-08T18:50:49.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.416+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v25'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3430075030 con 0x7f3438014070 2024-05-08T18:50:49.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.416+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac135c40 con 0x55f8ac11c780 2024-05-08T18:50:49.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.417+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v25'22 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.417+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac135c40 con 0x55f8ac117d90 2024-05-08T18:50:49.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.419+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v25'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f343403b040 con 0x55f8ac117d90 2024-05-08T18:50:49.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.419+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac135c40 con 0x7f3430078060 2024-05-08T18:50:49.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.420+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v25'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f343403b040 con 0x7f3430078060 2024-05-08T18:50:49.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.420+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac135c40 con 0x7f3438014070 2024-05-08T18:50:49.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.421+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v25'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3430075030 con 0x7f3438014070 2024-05-08T18:50:49.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.421+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac135c40 con 0x55f8ac11c780 2024-05-08T18:50:49.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.422+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v25'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.422+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac136210 con 0x7f3438014070 2024-05-08T18:50:49.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.423+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v25'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3430075030 con 0x7f3438014070 2024-05-08T18:50:49.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.423+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac136150 con 0x7f3430078060 2024-05-08T18:50:49.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.424+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v25'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f343403b040 con 0x7f3430078060 2024-05-08T18:50:49.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.424+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac136150 con 0x7f3438014070 2024-05-08T18:50:49.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.425+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v25'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3430075030 con 0x7f3438014070 2024-05-08T18:50:49.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.425+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac136150 con 0x7f3430078060 2024-05-08T18:50:49.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.426+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v25'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f343403b040 con 0x7f3430078060 2024-05-08T18:50:49.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.426+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac136150 con 0x55f8ac117d90 2024-05-08T18:50:49.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.427+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v25'114 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f343403b040 con 0x55f8ac117d90 2024-05-08T18:50:49.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.427+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac136150 con 0x55f8ac11c780 2024-05-08T18:50:49.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.428+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v25'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.428+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac136150 con 0x7f3438014070 2024-05-08T18:50:49.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.429+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v25'34 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3430075030 con 0x7f3438014070 2024-05-08T18:50:49.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.429+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac136150 con 0x55f8ac11c780 2024-05-08T18:50:49.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.430+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v25'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.430+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac136150 con 0x55f8ac117d90 2024-05-08T18:50:49.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.431+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v25'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f343403b040 con 0x55f8ac117d90 2024-05-08T18:50:49.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.431+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac136150 con 0x55f8ac117d90 2024-05-08T18:50:49.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.432+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v25'115 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f343403b040 con 0x55f8ac117d90 2024-05-08T18:50:49.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.432+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac136150 con 0x55f8ac11c780 2024-05-08T18:50:49.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.433+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v25'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.433+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac136150 con 0x7f3438014070 2024-05-08T18:50:49.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.434+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v25'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3430075030 con 0x7f3438014070 2024-05-08T18:50:49.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.434+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac136150 con 0x55f8ac11c780 2024-05-08T18:50:49.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.435+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v25'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.435+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac136570 con 0x55f8ac11c780 2024-05-08T18:50:49.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.436+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v25'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.436+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac136570 con 0x55f8ac11c780 2024-05-08T18:50:49.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.436+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v25'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.436+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac136570 con 0x55f8ac11c780 2024-05-08T18:50:49.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.437+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v25'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.437+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac136570 con 0x7f3430078060 2024-05-08T18:50:49.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.438+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v25'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f343403b040 con 0x7f3430078060 2024-05-08T18:50:49.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.438+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac136570 con 0x55f8ac11c780 2024-05-08T18:50:49.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.439+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v25'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.439+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac136570 con 0x7f3430078060 2024-05-08T18:50:49.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.440+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v25'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f343403b040 con 0x7f3430078060 2024-05-08T18:50:49.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.440+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac136570 con 0x55f8ac11c780 2024-05-08T18:50:49.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.441+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v25'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.441+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac136570 con 0x7f3430078060 2024-05-08T18:50:49.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.442+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v25'28 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f343403b040 con 0x7f3430078060 2024-05-08T18:50:49.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.442+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac136570 con 0x7f3438014070 2024-05-08T18:50:49.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.443+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v25'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3430075030 con 0x7f3438014070 2024-05-08T18:50:49.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.444+0000 7f32f2fe5640 20 reqs_thread_entry: start 2024-05-08T18:50:49.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.444+0000 7f343fa1f800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:49.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.444+0000 7f343fa1f800 20 Filter name: none 2024-05-08T18:50:49.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.444+0000 7f32f0fe1640 20 reqs_thread_entry: start 2024-05-08T18:50:49.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.444+0000 7f343fa1f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:50:49.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.444+0000 7f343fa1f800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.444+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac161090 con 0x7f3430078060 2024-05-08T18:50:49.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.444+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f343403b040 con 0x7f3430078060 2024-05-08T18:50:49.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.444+0000 7f343fa1f800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:50:49.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.444+0000 7f343fa1f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-08T18:50:49.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.444+0000 7f343fa1f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:50:49.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.444+0000 7f343fa1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:49.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.444+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac1639c0 con 0x7f3430078060 2024-05-08T18:50:49.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.445+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f343403b040 con 0x7f3430078060 2024-05-08T18:50:49.446 INFO:teuthology.orchestra.run.smithi132.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-05-08T18:50:49.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.445+0000 7f32f3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:49.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.445+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94526527145840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac1146e0 con 0x55f8ac117d90 2024-05-08T18:50:49.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.447+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94526527145840] v25'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f343403b040 con 0x55f8ac117d90 2024-05-08T18:50:49.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.447+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94526527121072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac128740 con 0x7f3438014070 2024-05-08T18:50:49.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.447+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94526527121072] v25'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3430075030 con 0x7f3438014070 2024-05-08T18:50:49.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.448+0000 7f343fa1f800 20 remove_watcher() i=0 2024-05-08T18:50:49.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.448+0000 7f343fa1f800 2 removed watcher, disabling cache 2024-05-08T18:50:49.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.448+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94526527126720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac1226b0 con 0x55f8ac117d90 2024-05-08T18:50:49.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.449+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94526527126720] v25'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343403b040 con 0x55f8ac117d90 2024-05-08T18:50:49.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.449+0000 7f343fa1f800 20 remove_watcher() i=1 2024-05-08T18:50:49.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.449+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94526527130272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac1226b0 con 0x55f8ac11c780 2024-05-08T18:50:49.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.450+0000 7f343dd18640 1 -- 172.21.15.132:0/1820863185 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94526527130272] v25'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343802a070 con 0x55f8ac11c780 2024-05-08T18:50:49.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.450+0000 7f343fa1f800 20 remove_watcher() i=2 2024-05-08T18:50:49.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.450+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94526527134112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac124aa0 con 0x7f3438014070 2024-05-08T18:50:49.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.451+0000 7f343d517640 1 -- 172.21.15.132:0/1820863185 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94526527134112] v25'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3430075030 con 0x7f3438014070 2024-05-08T18:50:49.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.451+0000 7f343fa1f800 20 remove_watcher() i=3 2024-05-08T18:50:49.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.451+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94526527137296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac1226b0 con 0x55f8ac117d90 2024-05-08T18:50:49.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.452+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94526527137296] v25'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343403b040 con 0x55f8ac117d90 2024-05-08T18:50:49.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.452+0000 7f343fa1f800 20 remove_watcher() i=4 2024-05-08T18:50:49.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.452+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94526527141424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac124aa0 con 0x7f3430078060 2024-05-08T18:50:49.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.452+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94526527141424] v25'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343403b040 con 0x7f3430078060 2024-05-08T18:50:49.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.453+0000 7f343fa1f800 20 remove_watcher() i=5 2024-05-08T18:50:49.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.453+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94526527127776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac126610 con 0x7f3430078060 2024-05-08T18:50:49.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.454+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94526527127776] v25'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343403b040 con 0x7f3430078060 2024-05-08T18:50:49.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.454+0000 7f343fa1f800 20 remove_watcher() i=6 2024-05-08T18:50:49.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.454+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94526527143808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f8ac1226b0 con 0x7f3430078060 2024-05-08T18:50:49.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 <== osd.0 v2:172.21.15.42:6800/1521799280 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94526527143808] v25'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343403b040 con 0x7f3430078060 2024-05-08T18:50:49.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 20 remove_watcher() i=7 2024-05-08T18:50:49.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f3430078060 msgr2=0x7f343005b550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f3430078060 0x7f343005b550 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f8ac117d90 msgr2=0x55f8ac11a250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f8ac117d90 0x55f8ac11a250 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f3438014070 msgr2=0x7f3438055000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f3438014070 0x7f3438055000 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f8ac11c780 msgr2=0x55f8ac11eb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f8ac11c780 0x55f8ac11eb70 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f330803bba0 msgr2=0x7f330803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f330803bba0 0x7f330803e060 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f343005cc00 tx=0x7f3430085000 comp rx=0 tx=0).stop 2024-05-08T18:50:49.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ac104b80 msgr2=0x55f8ac10c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343cd16640 1 -- 172.21.15.132:0/1820863185 reap_dead start 2024-05-08T18:50:49.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ac104b80 0x55f8ac10c140 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3438022a80 tx=0x7f3438052bb0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 shutdown_connections 2024-05-08T18:50:49.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 --2- 172.21.15.132:0/1820863185 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8ac104b80 0x55f8ac10c140 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 >> 172.21.15.132:0/1820863185 conn(0x55f8ac100e90 msgr2=0x55f8ac0fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 shutdown_connections 2024-05-08T18:50:49.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 -- 172.21.15.132:0/1820863185 wait complete. 2024-05-08T18:50:49.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 -- 172.21.15.132:0/3638663683 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f331403bba0 msgr2=0x7f331403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 --2- 172.21.15.132:0/3638663683 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f331403bba0 0x7f331403e060 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55f8ac0e1d80 tx=0x7f3430006a30 comp rx=0 tx=0).stop 2024-05-08T18:50:49.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 -- 172.21.15.132:0/3638663683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abf56ed0 msgr2=0x55f8abf55340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 --2- 172.21.15.132:0/3638663683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abf56ed0 0x55f8abf55340 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x55f8ac0dafa0 tx=0x7f34380188f0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 -- 172.21.15.132:0/3638663683 shutdown_connections 2024-05-08T18:50:49.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.455+0000 7f343fa1f800 1 --2- 172.21.15.132:0/3638663683 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f331403bba0 0x7f331403e060 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.456+0000 7f343fa1f800 1 --2- 172.21.15.132:0/3638663683 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abf56ed0 0x55f8abf55340 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.456+0000 7f343fa1f800 1 -- 172.21.15.132:0/3638663683 >> 172.21.15.132:0/3638663683 conn(0x55f8ac0e96f0 msgr2=0x55f8ac0e9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.456+0000 7f343fa1f800 1 -- 172.21.15.132:0/3638663683 shutdown_connections 2024-05-08T18:50:49.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.456+0000 7f343fa1f800 1 -- 172.21.15.132:0/3638663683 wait complete. 2024-05-08T18:50:49.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.456+0000 7f343fa1f800 1 -- 172.21.15.132:0/2826176259 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f8abfe2470 msgr2=0x55f8ac0e1310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.456+0000 7f343fa1f800 1 --2- 172.21.15.132:0/2826176259 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f8abfe2470 0x55f8ac0e1310 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.456+0000 7f343fa1f800 1 -- 172.21.15.132:0/2826176259 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f8ac0e3c40 msgr2=0x55f8ac0e6030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.456+0000 7f343fa1f800 1 --2- 172.21.15.132:0/2826176259 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f8ac0e3c40 0x55f8ac0e6030 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.456+0000 7f343fa1f800 1 -- 172.21.15.132:0/2826176259 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f332403bb50 msgr2=0x7f332403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.456+0000 7f343fa1f800 1 --2- 172.21.15.132:0/2826176259 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f332403bb50 0x7f332403e010 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3434000f60 tx=0x7f3434001370 comp rx=0 tx=0).stop 2024-05-08T18:50:49.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.456+0000 7f343fa1f800 1 -- 172.21.15.132:0/2826176259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abfe12b0 msgr2=0x55f8ac0da0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.456+0000 7f343fa1f800 1 --2- 172.21.15.132:0/2826176259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abfe12b0 0x55f8ac0da0d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f343001d050 tx=0x7f3430003020 comp rx=0 tx=0).stop 2024-05-08T18:50:49.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.456+0000 7f343fa1f800 1 -- 172.21.15.132:0/2826176259 shutdown_connections 2024-05-08T18:50:49.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.456+0000 7f343fa1f800 1 --2- 172.21.15.132:0/2826176259 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f8ac0e3c40 0x55f8ac0e6030 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.456+0000 7f343fa1f800 1 --2- 172.21.15.132:0/2826176259 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f8abfe2470 0x55f8ac0e1310 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.456+0000 7f343fa1f800 1 --2- 172.21.15.132:0/2826176259 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f332403bb50 0x7f332403e010 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.456+0000 7f343fa1f800 1 --2- 172.21.15.132:0/2826176259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f8abfe12b0 0x55f8ac0da0d0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.456+0000 7f343fa1f800 1 -- 172.21.15.132:0/2826176259 >> 172.21.15.132:0/2826176259 conn(0x55f8abfdc830 msgr2=0x55f8ac0cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.456+0000 7f343fa1f800 1 -- 172.21.15.132:0/2826176259 shutdown_connections 2024-05-08T18:50:49.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.456+0000 7f343fa1f800 1 -- 172.21.15.132:0/2826176259 wait complete. 2024-05-08T18:50:49.464 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-08T18:50:49.464 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-05-08T18:50:49.464 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-05-08T18:50:49.465 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-05-08T18:50:49.510 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:49.511 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:49.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.512+0000 7f780d80e800 1 Processor -- start 2024-05-08T18:50:49.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.512+0000 7f780d80e800 1 -- start start 2024-05-08T18:50:49.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.512+0000 7f780d80e800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55c4ac3e62c0 0x55c4ac3e66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.512+0000 7f780d80e800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c4ac3e6d60 con 0x55c4ac3e7480 2024-05-08T18:50:49.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.512+0000 7f780d80e800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55c4ac286e20 con 0x55c4ac3e62c0 2024-05-08T18:50:49.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.513+0000 7f780b306640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55c4ac3e62c0 0x55c4ac3e66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.513+0000 7f780b306640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55c4ac3e62c0 0x55c4ac3e66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33246/0 (socket says 172.21.15.132:33246) 2024-05-08T18:50:49.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.513+0000 7f780b306640 1 -- 172.21.15.132:0/212636882 learned_addr learned my addr 172.21.15.132:0/212636882 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.513+0000 7f780b306640 1 -- 172.21.15.132:0/212636882 >> v1:172.21.15.42:6789/0 conn(0x55c4ac3e7480 legacy=0x55c4ac3e7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.513+0000 7f780b306640 1 -- 172.21.15.132:0/212636882 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4ac3e8040 con 0x55c4ac3e62c0 2024-05-08T18:50:49.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.515+0000 7f780b306640 1 --2- 172.21.15.132:0/212636882 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac3e62c0 0x55c4ac3e66e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00a520 tx=0x7f77fc01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2b581132997ca4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.515+0000 7f780ab05640 1 -- 172.21.15.132:0/212636882 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77fc057070 con 0x55c4ac3e62c0 2024-05-08T18:50:49.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.515+0000 7f780ab05640 1 -- 172.21.15.132:0/212636882 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77fc052570 con 0x55c4ac3e62c0 2024-05-08T18:50:49.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.515+0000 7f780ab05640 1 -- 172.21.15.132:0/212636882 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77fc052870 con 0x55c4ac3e62c0 2024-05-08T18:50:49.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.515+0000 7f780d80e800 1 -- 172.21.15.132:0/212636882 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac3e62c0 msgr2=0x55c4ac3e66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.515+0000 7f780d80e800 1 --2- 172.21.15.132:0/212636882 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac3e62c0 0x55c4ac3e66e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00a520 tx=0x7f77fc01d010 comp rx=0 tx=0).stop 2024-05-08T18:50:49.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.515+0000 7f780d80e800 1 -- 172.21.15.132:0/212636882 shutdown_connections 2024-05-08T18:50:49.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.515+0000 7f780d80e800 1 --2- 172.21.15.132:0/212636882 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac3e62c0 0x55c4ac3e66e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.515+0000 7f780d80e800 1 -- 172.21.15.132:0/212636882 >> 172.21.15.132:0/212636882 conn(0x55c4ac3e1840 msgr2=0x55c4ac3e3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.515+0000 7f780d80e800 1 -- 172.21.15.132:0/212636882 shutdown_connections 2024-05-08T18:50:49.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.515+0000 7f780d80e800 1 -- 172.21.15.132:0/212636882 wait complete. 2024-05-08T18:50:49.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.529+0000 7f780d80e800 1 Processor -- start 2024-05-08T18:50:49.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.529+0000 7f780d80e800 1 -- start start 2024-05-08T18:50:49.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.529+0000 7f780d80e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac3e62c0 0x55c4ac4d7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.529+0000 7f780d80e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c4ac3315c0 con 0x55c4ac3e62c0 2024-05-08T18:50:49.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.529+0000 7f780b306640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac3e62c0 0x55c4ac4d7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.529+0000 7f780b306640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac3e62c0 0x55c4ac4d7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33248/0 (socket says 172.21.15.132:33248) 2024-05-08T18:50:49.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.529+0000 7f780b306640 1 -- 172.21.15.132:0/4248907949 learned_addr learned my addr 172.21.15.132:0/4248907949 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.530+0000 7f780b306640 1 -- 172.21.15.132:0/4248907949 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4ac4d7d30 con 0x55c4ac3e62c0 2024-05-08T18:50:49.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.530+0000 7f780b306640 1 --2- 172.21.15.132:0/4248907949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac3e62c0 0x55c4ac4d7760 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f77fc055040 tx=0x7f77fc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec7afae14a07bc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.530+0000 7f76f960a640 1 -- 172.21.15.132:0/4248907949 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77fc057040 con 0x55c4ac3e62c0 2024-05-08T18:50:49.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.530+0000 7f76f960a640 1 -- 172.21.15.132:0/4248907949 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77fc052850 con 0x55c4ac3e62c0 2024-05-08T18:50:49.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.530+0000 7f76f960a640 1 -- 172.21.15.132:0/4248907949 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77fc052b50 con 0x55c4ac3e62c0 2024-05-08T18:50:49.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.531+0000 7f780d80e800 1 -- 172.21.15.132:0/4248907949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac3e62c0 msgr2=0x55c4ac4d7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.531+0000 7f780d80e800 1 --2- 172.21.15.132:0/4248907949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac3e62c0 0x55c4ac4d7760 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f77fc055040 tx=0x7f77fc04c000 comp rx=0 tx=0).stop 2024-05-08T18:50:49.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.531+0000 7f780d80e800 1 -- 172.21.15.132:0/4248907949 shutdown_connections 2024-05-08T18:50:49.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.531+0000 7f780d80e800 1 --2- 172.21.15.132:0/4248907949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac3e62c0 0x55c4ac4d7760 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.531+0000 7f780d80e800 1 -- 172.21.15.132:0/4248907949 >> 172.21.15.132:0/4248907949 conn(0x55c4ac3e1840 msgr2=0x55c4ac4d3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.531+0000 7f780d80e800 1 -- 172.21.15.132:0/4248907949 shutdown_connections 2024-05-08T18:50:49.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.531+0000 7f780d80e800 1 -- 172.21.15.132:0/4248907949 wait complete. 2024-05-08T18:50:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.531+0000 7f780d80e800 1 Processor -- start 2024-05-08T18:50:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.531+0000 7f780d80e800 1 -- start start 2024-05-08T18:50:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.532+0000 7f780d80e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac3e62c0 0x55c4ac4df210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.532+0000 7f780d80e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c4ac3ef950 con 0x55c4ac3e62c0 2024-05-08T18:50:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.532+0000 7f780b306640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac3e62c0 0x55c4ac4df210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.532+0000 7f780b306640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac3e62c0 0x55c4ac4df210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33262/0 (socket says 172.21.15.132:33262) 2024-05-08T18:50:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.532+0000 7f780b306640 1 -- 172.21.15.132:0/960146336 learned_addr learned my addr 172.21.15.132:0/960146336 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.532+0000 7f780b306640 1 -- 172.21.15.132:0/960146336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4ac4df750 con 0x55c4ac3e62c0 2024-05-08T18:50:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.532+0000 7f780b306640 1 --2- 172.21.15.132:0/960146336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac3e62c0 0x55c4ac4df210 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00a520 tx=0x7f77fc003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.532+0000 7f76f7e07640 1 -- 172.21.15.132:0/960146336 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77fc073070 con 0x55c4ac3e62c0 2024-05-08T18:50:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.532+0000 7f76f7e07640 1 -- 172.21.15.132:0/960146336 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77fc05d570 con 0x55c4ac3e62c0 2024-05-08T18:50:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.532+0000 7f780d80e800 1 -- 172.21.15.132:0/960146336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4ac4df9e0 con 0x55c4ac3e62c0 2024-05-08T18:50:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.532+0000 7f76f7e07640 1 -- 172.21.15.132:0/960146336 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77fc057070 con 0x55c4ac3e62c0 2024-05-08T18:50:49.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.532+0000 7f780d80e800 1 -- 172.21.15.132:0/960146336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4ac4e2690 con 0x55c4ac3e62c0 2024-05-08T18:50:49.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.533+0000 7f76f7e07640 1 -- 172.21.15.132:0/960146336 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f77fc076070 con 0x55c4ac3e62c0 2024-05-08T18:50:49.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.533+0000 7f76f7e07640 1 --2- 172.21.15.132:0/960146336 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f76f003bba0 0x7f76f003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.533+0000 7f76f7e07640 1 -- 172.21.15.132:0/960146336 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f77fc093fb0 con 0x55c4ac3e62c0 2024-05-08T18:50:49.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.534+0000 7f7803fff640 1 --2- 172.21.15.132:0/960146336 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f76f003bba0 0x7f76f003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.534+0000 7f780d80e800 1 --2- 172.21.15.132:0/960146336 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c4ac3e7480 0x55c4ac4e6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.534+0000 7f780d80e800 1 -- 172.21.15.132:0/960146336 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac4e6990 con 0x55c4ac3e7480 2024-05-08T18:50:49.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.534+0000 7f780bb07640 1 --2- 172.21.15.132:0/960146336 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c4ac3e7480 0x55c4ac4e6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.534+0000 7f7803fff640 1 --2- 172.21.15.132:0/960146336 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f76f003bba0 0x7f76f003e060 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f77f4001e10 tx=0x7f77f4001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.534+0000 7f780bb07640 1 --2- 172.21.15.132:0/960146336 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c4ac3e7480 0x55c4ac4e6450 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.534+0000 7f780bb07640 1 -- 172.21.15.132:0/960146336 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f780400a4a0 con 0x55c4ac3e7480 2024-05-08T18:50:49.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.534+0000 7f780d80e800 1 -- 172.21.15.132:0/960146336 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac4e3a20 con 0x55c4ac3e7480 2024-05-08T18:50:49.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.535+0000 7f780bb07640 1 -- 172.21.15.132:0/960146336 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f780400a4a0 con 0x55c4ac3e7480 2024-05-08T18:50:49.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.535+0000 7f780d80e800 1 --2- 172.21.15.132:0/960146336 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c4ac4e8cd0 0x55c4ac4eb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.535+0000 7f780d80e800 1 -- 172.21.15.132:0/960146336 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac4eb7b0 con 0x55c4ac4e8cd0 2024-05-08T18:50:49.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.535+0000 7f780b306640 1 --2- 172.21.15.132:0/960146336 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c4ac4e8cd0 0x55c4ac4eb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.535+0000 7f780b306640 1 --2- 172.21.15.132:0/960146336 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c4ac4e8cd0 0x55c4ac4eb0c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.535+0000 7f780b306640 1 -- 172.21.15.132:0/960146336 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f77fc075030 con 0x55c4ac4e8cd0 2024-05-08T18:50:49.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.535+0000 7f780d80e800 1 -- 172.21.15.132:0/960146336 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac4e7b40 con 0x55c4ac3e7480 2024-05-08T18:50:49.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.536+0000 7f780bb07640 1 -- 172.21.15.132:0/960146336 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f780400a4a0 con 0x55c4ac3e7480 2024-05-08T18:50:49.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.536+0000 7f780d80e800 1 -- 172.21.15.132:0/960146336 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac4e8020 con 0x55c4ac3e7480 2024-05-08T18:50:49.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.536+0000 7f780bb07640 1 -- 172.21.15.132:0/960146336 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f780400a4a0 con 0x55c4ac3e7480 2024-05-08T18:50:49.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.536+0000 7f780d80e800 1 Processor -- start 2024-05-08T18:50:49.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.536+0000 7f780d80e800 1 -- start start 2024-05-08T18:50:49.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.536+0000 7f780d80e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac35bee0 0x55c4ac35a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.536+0000 7f780d80e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c4ac2d7fc0 con 0x55c4ac35bee0 2024-05-08T18:50:49.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.537+0000 7f780bb07640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac35bee0 0x55c4ac35a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.537+0000 7f780bb07640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac35bee0 0x55c4ac35a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33266/0 (socket says 172.21.15.132:33266) 2024-05-08T18:50:49.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.537+0000 7f780bb07640 1 -- 172.21.15.132:0/24926726 learned_addr learned my addr 172.21.15.132:0/24926726 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.537+0000 7f780bb07640 1 -- 172.21.15.132:0/24926726 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4ac35a890 con 0x55c4ac35bee0 2024-05-08T18:50:49.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.537+0000 7f780bb07640 1 --2- 172.21.15.132:0/24926726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac35bee0 0x55c4ac35a350 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x55c4ac4e6d30 tx=0x7f7804018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.537+0000 7f76f5602640 1 -- 172.21.15.132:0/24926726 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7804014450 con 0x55c4ac35bee0 2024-05-08T18:50:49.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.537+0000 7f76f5602640 1 -- 172.21.15.132:0/24926726 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7804014610 con 0x55c4ac35bee0 2024-05-08T18:50:49.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.537+0000 7f780d80e800 1 -- 172.21.15.132:0/24926726 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4ac35ab20 con 0x55c4ac35bee0 2024-05-08T18:50:49.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.537+0000 7f76f5602640 1 -- 172.21.15.132:0/24926726 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7804014930 con 0x55c4ac35bee0 2024-05-08T18:50:49.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.537+0000 7f780d80e800 1 -- 172.21.15.132:0/24926726 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4ac35b020 con 0x55c4ac35bee0 2024-05-08T18:50:49.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.538+0000 7f76f5602640 1 -- 172.21.15.132:0/24926726 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f7804011040 con 0x55c4ac35bee0 2024-05-08T18:50:49.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.538+0000 7f76f5602640 1 --2- 172.21.15.132:0/24926726 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f76e403bb50 0x7f76e403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.538+0000 7f76f5602640 1 -- 172.21.15.132:0/24926726 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f780401e070 con 0x55c4ac35bee0 2024-05-08T18:50:49.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.538+0000 7f780b306640 1 --2- 172.21.15.132:0/24926726 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f76e403bb50 0x7f76e403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.538+0000 7f780d80e800 1 Processor -- start 2024-05-08T18:50:49.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.539+0000 7f780d80e800 1 -- start start 2024-05-08T18:50:49.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.539+0000 7f780b306640 1 --2- 172.21.15.132:0/24926726 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f76e403bb50 0x7f76e403e010 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f77fc044830 tx=0x7f77fc066750 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.539+0000 7f780d80e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac509ba0 0x55c4ac509fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.539+0000 7f780d80e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c4ac4d7ff0 con 0x55c4ac509ba0 2024-05-08T18:50:49.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.539+0000 7f780bb07640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac509ba0 0x55c4ac509fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.539+0000 7f780bb07640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac509ba0 0x55c4ac509fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33268/0 (socket says 172.21.15.132:33268) 2024-05-08T18:50:49.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.539+0000 7f780bb07640 1 -- 172.21.15.132:0/2784997199 learned_addr learned my addr 172.21.15.132:0/2784997199 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.539+0000 7f780bb07640 1 -- 172.21.15.132:0/2784997199 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4ac50a590 con 0x55c4ac509ba0 2024-05-08T18:50:49.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.539+0000 7f780bb07640 1 --2- 172.21.15.132:0/2784997199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac509ba0 0x55c4ac509fc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7804013fd0 tx=0x7f78040118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc510c0d689b32c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.539+0000 7f76eeffd640 1 -- 172.21.15.132:0/2784997199 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7804011c00 con 0x55c4ac509ba0 2024-05-08T18:50:49.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.539+0000 7f76eeffd640 1 -- 172.21.15.132:0/2784997199 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7804050070 con 0x55c4ac509ba0 2024-05-08T18:50:49.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.539+0000 7f76eeffd640 1 -- 172.21.15.132:0/2784997199 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7804014ad0 con 0x55c4ac509ba0 2024-05-08T18:50:49.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.540+0000 7f780d80e800 1 -- 172.21.15.132:0/2784997199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac509ba0 msgr2=0x55c4ac509fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.540+0000 7f780d80e800 1 --2- 172.21.15.132:0/2784997199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac509ba0 0x55c4ac509fc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7804013fd0 tx=0x7f78040118e0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.540+0000 7f780d80e800 1 -- 172.21.15.132:0/2784997199 shutdown_connections 2024-05-08T18:50:49.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.540+0000 7f780d80e800 1 --2- 172.21.15.132:0/2784997199 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac509ba0 0x55c4ac509fc0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.540+0000 7f780d80e800 1 -- 172.21.15.132:0/2784997199 >> 172.21.15.132:0/2784997199 conn(0x55c4ac505f00 msgr2=0x55c4ac503f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.540+0000 7f780d80e800 1 -- 172.21.15.132:0/2784997199 shutdown_connections 2024-05-08T18:50:49.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.540+0000 7f780d80e800 1 -- 172.21.15.132:0/2784997199 wait complete. 2024-05-08T18:50:49.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.540+0000 7f780d80e800 1 Processor -- start 2024-05-08T18:50:49.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.540+0000 7f780d80e800 1 -- start start 2024-05-08T18:50:49.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.540+0000 7f780d80e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac509ba0 0x55c4ac511190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.540+0000 7f780d80e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c4ac50ad00 con 0x55c4ac509ba0 2024-05-08T18:50:49.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.541+0000 7f780bb07640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac509ba0 0x55c4ac511190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.541+0000 7f780bb07640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac509ba0 0x55c4ac511190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33270/0 (socket says 172.21.15.132:33270) 2024-05-08T18:50:49.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.541+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 learned_addr learned my addr 172.21.15.132:0/2854066195 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.541+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4ac5116d0 con 0x55c4ac509ba0 2024-05-08T18:50:49.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.541+0000 7f780bb07640 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac509ba0 0x55c4ac511190 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7804051c90 tx=0x7f7804052d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.542+0000 7f76ed7fa640 1 -- 172.21.15.132:0/2854066195 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7804054280 con 0x55c4ac509ba0 2024-05-08T18:50:49.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.542+0000 7f76ed7fa640 1 -- 172.21.15.132:0/2854066195 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7804054420 con 0x55c4ac509ba0 2024-05-08T18:50:49.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.542+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4ac511960 con 0x55c4ac509ba0 2024-05-08T18:50:49.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.542+0000 7f76ed7fa640 1 -- 172.21.15.132:0/2854066195 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78040407c0 con 0x55c4ac509ba0 2024-05-08T18:50:49.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.542+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4ac514610 con 0x55c4ac509ba0 2024-05-08T18:50:49.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.543+0000 7f76ed7fa640 1 -- 172.21.15.132:0/2854066195 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f780403f020 con 0x55c4ac509ba0 2024-05-08T18:50:49.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.543+0000 7f76ed7fa640 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f76d403bba0 0x7f76d403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.543+0000 7f76ed7fa640 1 -- 172.21.15.132:0/2854066195 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f780400e040 con 0x55c4ac509ba0 2024-05-08T18:50:49.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.543+0000 7f780b306640 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f76d403bba0 0x7f76d403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.543+0000 7f780d80e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.543+0000 7f780b306640 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f76d403bba0 0x7f76d403e060 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0927f0 tx=0x7f77fc07f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.543+0000 7f780d80e800 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c4ac51ce00 0x55c4ac51f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.543+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac51fa10 con 0x55c4ac51ce00 2024-05-08T18:50:49.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.543+0000 7f7803fff640 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c4ac51ce00 0x55c4ac51f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.544+0000 7f7803fff640 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c4ac51ce00 0x55c4ac51f2c0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.544+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77f400bdb0 con 0x55c4ac51ce00 2024-05-08T18:50:49.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.544+0000 7f780d80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.544+0000 7f780d80e800 20 realm 2024-05-08T18:50:49.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.544+0000 7f780d80e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.544+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac51c250 con 0x55c4ac51ce00 2024-05-08T18:50:49.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.544+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77f400bdb0 con 0x55c4ac51ce00 2024-05-08T18:50:49.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.544+0000 7f780d80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.544+0000 7f780d80e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:49.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.544+0000 7f780d80e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.544+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac520500 con 0x55c4ac51ce00 2024-05-08T18:50:49.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.544+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77f400bdb0 con 0x55c4ac51ce00 2024-05-08T18:50:49.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.544+0000 7f780d80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.544+0000 7f780d80e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.544+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac520dd0 con 0x55c4ac51ce00 2024-05-08T18:50:49.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.545+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f77f400bdb0 con 0x55c4ac51ce00 2024-05-08T18:50:49.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.545+0000 7f780d80e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:49.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.545+0000 7f780d80e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.545+0000 7f780d80e800 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c4ac521710 0x55c4ac523b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.545+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac5242d0 con 0x55c4ac521710 2024-05-08T18:50:49.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.545+0000 7f780bb07640 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c4ac521710 0x55c4ac523b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.545+0000 7f780bb07640 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c4ac521710 0x55c4ac523b40 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.545+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f780402a070 con 0x55c4ac521710 2024-05-08T18:50:49.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.545+0000 7f780d80e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:49.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.545+0000 7f780d80e800 20 searching for the correct realm 2024-05-08T18:50:49.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.545+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x55c4ac521710 2024-05-08T18:50:49.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.546+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f780402a070 con 0x55c4ac521710 2024-05-08T18:50:49.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.546+0000 7f780bb07640 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f7804014070 0x7f78040549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.546+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x7f7804014070 2024-05-08T18:50:49.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.546+0000 7f780b306640 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f7804014070 0x7f78040549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.546+0000 7f780b306640 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f7804014070 0x7f78040549c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.547+0000 7f780b306640 1 -- 172.21.15.132:0/2854066195 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77fc075030 con 0x7f7804014070 2024-05-08T18:50:49.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.547+0000 7f780b306640 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f77fc078060 0x7f77fc076360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.547+0000 7f780b306640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x7f77fc078060 2024-05-08T18:50:49.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.547+0000 7f7803fff640 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f77fc078060 0x7f77fc076360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.547+0000 7f7803fff640 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f77fc078060 0x7f77fc076360 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.547+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f400bdb0 con 0x7f77fc078060 2024-05-08T18:50:49.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.547+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x55c4ac51ce00 2024-05-08T18:50:49.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.548+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f400bdb0 con 0x55c4ac51ce00 2024-05-08T18:50:49.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.548+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x55c4ac51ce00 2024-05-08T18:50:49.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.548+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f402a040 con 0x55c4ac51ce00 2024-05-08T18:50:49.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.548+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x7f77fc078060 2024-05-08T18:50:49.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.548+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.548+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x7f77fc078060 2024-05-08T18:50:49.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.548+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.548+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x7f7804014070 2024-05-08T18:50:49.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.549+0000 7f780b306640 1 -- 172.21.15.132:0/2854066195 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77fc075030 con 0x7f7804014070 2024-05-08T18:50:49.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.549+0000 7f780b306640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x55c4ac521710 2024-05-08T18:50:49.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.549+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f780402a070 con 0x55c4ac521710 2024-05-08T18:50:49.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.549+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x55c4ac51ce00 2024-05-08T18:50:49.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.549+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f402a040 con 0x55c4ac51ce00 2024-05-08T18:50:49.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.549+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x7f77fc078060 2024-05-08T18:50:49.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.549+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.549+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x55c4ac51ce00 2024-05-08T18:50:49.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.550+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f77f402a040 con 0x55c4ac51ce00 2024-05-08T18:50:49.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.550+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x7f7804014070 2024-05-08T18:50:49.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.550+0000 7f780b306640 1 -- 172.21.15.132:0/2854066195 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f77fc075030 con 0x7f7804014070 2024-05-08T18:50:49.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.550+0000 7f780b306640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x55c4ac521710 2024-05-08T18:50:49.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.550+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f780402a070 con 0x55c4ac521710 2024-05-08T18:50:49.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.550+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x55c4ac521710 2024-05-08T18:50:49.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.550+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f780402a070 con 0x55c4ac521710 2024-05-08T18:50:49.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.550+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x7f77fc078060 2024-05-08T18:50:49.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.551+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.551+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x55c4ac521710 2024-05-08T18:50:49.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.551+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f780402a070 con 0x55c4ac521710 2024-05-08T18:50:49.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.551+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x55c4ac521710 2024-05-08T18:50:49.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.551+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f780402a070 con 0x55c4ac521710 2024-05-08T18:50:49.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.551+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x55c4ac51ce00 2024-05-08T18:50:49.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.551+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f402a040 con 0x55c4ac51ce00 2024-05-08T18:50:49.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.551+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x55c4ac51ce00 2024-05-08T18:50:49.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.551+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f77f402a040 con 0x55c4ac51ce00 2024-05-08T18:50:49.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.552+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x7f77fc078060 2024-05-08T18:50:49.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.552+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.552+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x55c4ac521710 2024-05-08T18:50:49.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.552+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f780402a070 con 0x55c4ac521710 2024-05-08T18:50:49.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.552+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x7f7804014070 2024-05-08T18:50:49.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.552+0000 7f780b306640 1 -- 172.21.15.132:0/2854066195 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77fc075030 con 0x7f7804014070 2024-05-08T18:50:49.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.552+0000 7f780b306640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x55c4ac51ce00 2024-05-08T18:50:49.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.552+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f402a040 con 0x55c4ac51ce00 2024-05-08T18:50:49.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.552+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x7f77fc078060 2024-05-08T18:50:49.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.553+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.553+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x55c4ac521710 2024-05-08T18:50:49.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.553+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f780402a070 con 0x55c4ac521710 2024-05-08T18:50:49.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.553+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x7f77fc078060 2024-05-08T18:50:49.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.553+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.553+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x7f7804014070 2024-05-08T18:50:49.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.554+0000 7f780b306640 1 -- 172.21.15.132:0/2854066195 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77fc075030 con 0x7f7804014070 2024-05-08T18:50:49.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.554+0000 7f780b306640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x55c4ac521710 2024-05-08T18:50:49.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.554+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f780402a070 con 0x55c4ac521710 2024-05-08T18:50:49.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.554+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x7f77fc078060 2024-05-08T18:50:49.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.555+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.555+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x55c4ac51ce00 2024-05-08T18:50:49.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.555+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f77f402a040 con 0x55c4ac51ce00 2024-05-08T18:50:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.555+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525c00 con 0x7f7804014070 2024-05-08T18:50:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.555+0000 7f780b306640 1 -- 172.21.15.132:0/2854066195 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77fc075030 con 0x7f7804014070 2024-05-08T18:50:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.555+0000 7f780d80e800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.555+0000 7f780d80e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.555+0000 7f780d80e800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.555+0000 7f780d80e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.555+0000 7f780d80e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.555+0000 7f780d80e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.555+0000 7f780d80e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.555+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac524cc0 con 0x55c4ac51ce00 2024-05-08T18:50:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.555+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77f402a040 con 0x55c4ac51ce00 2024-05-08T18:50:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.555+0000 7f780d80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.555+0000 7f780d80e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.555+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac525560 con 0x55c4ac51ce00 2024-05-08T18:50:49.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.556+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f77f402a040 con 0x55c4ac51ce00 2024-05-08T18:50:49.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.556+0000 7f780d80e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:49.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.556+0000 7f780d80e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.556+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac526080 con 0x55c4ac51ce00 2024-05-08T18:50:49.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.556+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f77f402a040 con 0x55c4ac51ce00 2024-05-08T18:50:49.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.556+0000 7f780d80e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:49.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.556+0000 7f780d80e800 20 zone default found 2024-05-08T18:50:49.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.556+0000 7f780d80e800 4 Realm: () 2024-05-08T18:50:49.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.556+0000 7f780d80e800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:49.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.556+0000 7f780d80e800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:49.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.556+0000 7f780d80e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:49.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.556+0000 7f780d80e800 20 zonegroup default 2024-05-08T18:50:49.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.556+0000 7f780d80e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.556+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac5260e0 con 0x7f77fc078060 2024-05-08T18:50:49.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.556+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.556+0000 7f780d80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.556+0000 7f780d80e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.556+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac527f00 con 0x55c4ac521710 2024-05-08T18:50:49.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.557+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f780402a070 con 0x55c4ac521710 2024-05-08T18:50:49.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.557+0000 7f780d80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.557+0000 7f780d80e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.557+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac5282d0 con 0x55c4ac521710 2024-05-08T18:50:49.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.557+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f780402a070 con 0x55c4ac521710 2024-05-08T18:50:49.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.557+0000 7f780d80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.557+0000 7f780d80e800 20 started sync module instance, tier type = 2024-05-08T18:50:49.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.557+0000 7f780d80e800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:49.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.557+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac5273a0 con 0x7f7804014070 2024-05-08T18:50:49.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.558+0000 7f780b306640 1 -- 172.21.15.132:0/2854066195 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77fc075030 con 0x7f7804014070 2024-05-08T18:50:49.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.558+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94303193036688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac527000 con 0x7f7804014070 2024-05-08T18:50:49.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.558+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac5291e0 con 0x55c4ac51ce00 2024-05-08T18:50:49.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.559+0000 7f780b306640 1 -- 172.21.15.132:0/2854066195 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94303193036688] v25'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77fc075030 con 0x7f7804014070 2024-05-08T18:50:49.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.559+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f402a040 con 0x55c4ac51ce00 2024-05-08T18:50:49.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.559+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94303193042224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac529600 con 0x55c4ac51ce00 2024-05-08T18:50:49.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.559+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac529fc0 con 0x55c4ac521710 2024-05-08T18:50:49.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.560+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94303193042224] v25'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f402a040 con 0x55c4ac51ce00 2024-05-08T18:50:49.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.560+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f780402a070 con 0x55c4ac521710 2024-05-08T18:50:49.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.560+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94303193046256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac529600 con 0x55c4ac521710 2024-05-08T18:50:49.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.560+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac52aa30 con 0x7f7804014070 2024-05-08T18:50:49.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.561+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94303193046256] v25'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f780402a070 con 0x55c4ac521710 2024-05-08T18:50:49.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.561+0000 7f780b306640 1 -- 172.21.15.132:0/2854066195 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77fc075030 con 0x7f7804014070 2024-05-08T18:50:49.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.561+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94303193043280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac529570 con 0x7f7804014070 2024-05-08T18:50:49.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.561+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac52b8f0 con 0x55c4ac51ce00 2024-05-08T18:50:49.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.562+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f402a040 con 0x55c4ac51ce00 2024-05-08T18:50:49.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.562+0000 7f780b306640 1 -- 172.21.15.132:0/2854066195 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94303193043280] v25'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77fc075030 con 0x7f7804014070 2024-05-08T18:50:49.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.562+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94303193052736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac52c190 con 0x55c4ac51ce00 2024-05-08T18:50:49.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.562+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac52ae40 con 0x7f77fc078060 2024-05-08T18:50:49.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.563+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94303193052736] v25'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f402a040 con 0x55c4ac51ce00 2024-05-08T18:50:49.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.564+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.564+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94303193054352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac52c0b0 con 0x7f77fc078060 2024-05-08T18:50:49.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.564+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac52d0f0 con 0x7f77fc078060 2024-05-08T18:50:49.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.564+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94303193054352] v25'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.565+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.565+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94303193057104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac52d020 con 0x7f77fc078060 2024-05-08T18:50:49.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.565+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac52daf0 con 0x7f77fc078060 2024-05-08T18:50:49.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.567+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94303193057104] v25'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.567+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.568+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94303193060832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac52dcd0 con 0x7f77fc078060 2024-05-08T18:50:49.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.568+0000 7f780d80e800 20 add_watcher() i=0 2024-05-08T18:50:49.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.568+0000 7f780d80e800 20 add_watcher() i=1 2024-05-08T18:50:49.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.568+0000 7f780d80e800 20 add_watcher() i=2 2024-05-08T18:50:49.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.568+0000 7f780d80e800 20 add_watcher() i=3 2024-05-08T18:50:49.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.568+0000 7f780d80e800 20 add_watcher() i=4 2024-05-08T18:50:49.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.568+0000 7f780d80e800 20 add_watcher() i=5 2024-05-08T18:50:49.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.568+0000 7f780d80e800 20 add_watcher() i=6 2024-05-08T18:50:49.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.568+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94303193060832] v25'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.568+0000 7f780d80e800 20 add_watcher() i=7 2024-05-08T18:50:49.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.568+0000 7f780d80e800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:49.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.568+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac5310a0 con 0x55c4ac51ce00 2024-05-08T18:50:49.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.569+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f77f402a040 con 0x55c4ac51ce00 2024-05-08T18:50:49.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.569+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94303193062336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac52e490 con 0x55c4ac51ce00 2024-05-08T18:50:49.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.570+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94303193062336] v25'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f77f402a040 con 0x55c4ac51ce00 2024-05-08T18:50:49.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.570+0000 7f76c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:49.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.570+0000 7f780d80e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:49.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.570+0000 7f780d80e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.570+0000 7f780d80e800 5 note: GC not initialized 2024-05-08T18:50:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.570+0000 7f76c0fe1640 20 reqs_thread_entry: start 2024-05-08T18:50:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.570+0000 7f780d80e800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.571+0000 7f780d80e800 20 Filter name: none 2024-05-08T18:50:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.571+0000 7f763a7fc640 20 reqs_thread_entry: start 2024-05-08T18:50:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.571+0000 7f780d80e800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:50:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.571+0000 7f780d80e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.571+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac564430 con 0x7f77fc078060 2024-05-08T18:50:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.571+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.571+0000 7f780d80e800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:50:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.571+0000 7f780d80e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-08T18:50:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.571+0000 7f780d80e800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:50:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.571+0000 7f780d80e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.571+0000 7f780d80e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:50:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.571+0000 7f780d80e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.571+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac5663b0 con 0x7f7804014070 2024-05-08T18:50:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.572+0000 7f780b306640 1 -- 172.21.15.132:0/2854066195 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f77fc075030 con 0x7f7804014070 2024-05-08T18:50:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.572+0000 7f780d80e800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:50:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.572+0000 7f780d80e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:50:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.572+0000 7f780d80e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:50:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.572+0000 7f780d80e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 : miss 2024-05-08T18:50:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.572+0000 7f780d80e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.572+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:64 8.1e 8:7ec7f916:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac567e30 con 0x7f77fc078060 2024-05-08T18:50:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.572+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(64 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.573+0000 7f780d80e800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:50:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.573+0000 7f780d80e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 info.flags=0x17 2024-05-08T18:50:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.573+0000 7f780d80e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 to cache LRU end 2024-05-08T18:50:49.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.573+0000 7f780d80e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:49.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.573+0000 7f780d80e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:50:49.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.573+0000 7f780d80e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 2024-05-08T18:50:49.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.573+0000 7f780d80e800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-05-08T18:50:49.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.573+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac569370 con 0x7f77fc078060 2024-05-08T18:50:49.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.573+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(65 fud.buckets [call] v25'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.574+0000 7f780d80e800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-05-08T18:50:49.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.574+0000 7f780d80e800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.574+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac569770 con 0x7f7804014070 2024-05-08T18:50:49.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.574+0000 7f780b306640 1 -- 172.21.15.132:0/2854066195 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f77fc075030 con 0x7f7804014070 2024-05-08T18:50:49.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.574+0000 7f780d80e800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:50:49.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.574+0000 7f780d80e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-05-08T18:50:49.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.574+0000 7f780d80e800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:50:49.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.574+0000 7f780d80e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:49.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.574+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac56f360 con 0x7f7804014070 2024-05-08T18:50:49.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.575+0000 7f780b306640 1 -- 172.21.15.132:0/2854066195 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v25'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f77fc075030 con 0x7f7804014070 2024-05-08T18:50:49.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.575+0000 7f780d80e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-08T18:50:49.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.575+0000 7f780d80e800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:50:49.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.575+0000 7f780d80e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:50:49.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.575+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94303193312880 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac56c970 con 0x7f77fc078060 2024-05-08T18:50:49.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.575+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== watch-notify(notify (1) cookie 94303193057104 notify 107374182404 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55c4ac568220 con 0x7f77fc078060 2024-05-08T18:50:49.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.575+0000 7f76eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182404 cookie 94303193057104 notifier 4508 bl.length()=338 2024-05-08T18:50:49.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.575+0000 7f76eeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-08T18:50:49.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.575+0000 7f76eeffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:50:49.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.575+0000 7f76eeffd640 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f76d0003ea0 con 0x7f77fc078060 2024-05-08T18:50:49.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.575+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(68 notify.6 [notify cookie 94303193312880 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.576+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.576+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== watch-notify(notify_complete (2) cookie 94303193312880 notify 107374182404 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c4ac567350 con 0x7f77fc078060 2024-05-08T18:50:49.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.577+0000 7f76c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:49.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.577+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94303193062336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac519f60 con 0x55c4ac51ce00 2024-05-08T18:50:49.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.578+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94303193062336] v25'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f77f402a040 con 0x55c4ac51ce00 2024-05-08T18:50:49.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.578+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94303193036688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac519f60 con 0x7f7804014070 2024-05-08T18:50:49.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.578+0000 7f780b306640 1 -- 172.21.15.132:0/2854066195 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94303193036688] v25'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77fc075030 con 0x7f7804014070 2024-05-08T18:50:49.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.578+0000 7f780d80e800 20 remove_watcher() i=0 2024-05-08T18:50:49.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.578+0000 7f780d80e800 2 removed watcher, disabling cache 2024-05-08T18:50:49.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.578+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94303193042224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac527790 con 0x55c4ac51ce00 2024-05-08T18:50:49.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.579+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94303193042224] v25'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f402a040 con 0x55c4ac51ce00 2024-05-08T18:50:49.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.579+0000 7f780d80e800 20 remove_watcher() i=1 2024-05-08T18:50:49.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.579+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94303193046256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac527790 con 0x55c4ac521710 2024-05-08T18:50:49.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.580+0000 7f780bb07640 1 -- 172.21.15.132:0/2854066195 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94303193046256] v25'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f780402a070 con 0x55c4ac521710 2024-05-08T18:50:49.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.580+0000 7f780d80e800 20 remove_watcher() i=2 2024-05-08T18:50:49.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.580+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94303193043280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac529cf0 con 0x7f7804014070 2024-05-08T18:50:49.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.581+0000 7f780b306640 1 -- 172.21.15.132:0/2854066195 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94303193043280] v25'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77fc075030 con 0x7f7804014070 2024-05-08T18:50:49.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.581+0000 7f780d80e800 20 remove_watcher() i=3 2024-05-08T18:50:49.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.581+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94303193052736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac527790 con 0x55c4ac51ce00 2024-05-08T18:50:49.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.582+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94303193052736] v25'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f402a040 con 0x55c4ac51ce00 2024-05-08T18:50:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.582+0000 7f780d80e800 20 remove_watcher() i=4 2024-05-08T18:50:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.582+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94303193054352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac527790 con 0x7f77fc078060 2024-05-08T18:50:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.583+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94303193054352] v25'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.583+0000 7f780d80e800 20 remove_watcher() i=5 2024-05-08T18:50:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.583+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94303193057104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac52bc90 con 0x7f77fc078060 2024-05-08T18:50:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.584+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94303193057104] v25'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.584+0000 7f780d80e800 20 remove_watcher() i=6 2024-05-08T18:50:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.584+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94303193060832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4ac527790 con 0x7f77fc078060 2024-05-08T18:50:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.585+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94303193060832] v25'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f402a040 con 0x7f77fc078060 2024-05-08T18:50:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.585+0000 7f780d80e800 20 remove_watcher() i=7 2024-05-08T18:50:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.585+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f77fc078060 msgr2=0x7f77fc076360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.585+0000 7f780d80e800 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f77fc078060 0x7f77fc076360 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.585+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c4ac51ce00 msgr2=0x55c4ac51f2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.585+0000 7f780d80e800 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c4ac51ce00 0x55c4ac51f2c0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.585+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f7804014070 msgr2=0x7f78040549c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.585+0000 7f780d80e800 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f7804014070 0x7f78040549c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.585+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c4ac521710 msgr2=0x55c4ac523b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.585+0000 7f780d80e800 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c4ac521710 0x55c4ac523b40 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.585+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f76d403bba0 msgr2=0x7f76d403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.585+0000 7f780d80e800 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f76d403bba0 0x7f76d403e060 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0927f0 tx=0x7f77fc07f000 comp rx=0 tx=0).stop 2024-05-08T18:50:49.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.585+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac509ba0 msgr2=0x55c4ac511190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.585+0000 7f7803fff640 1 -- 172.21.15.132:0/2854066195 reap_dead start 2024-05-08T18:50:49.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.585+0000 7f780d80e800 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac509ba0 0x55c4ac511190 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7804051c90 tx=0x7f7804052d50 comp rx=0 tx=0).stop 2024-05-08T18:50:49.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.585+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 shutdown_connections 2024-05-08T18:50:49.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.585+0000 7f780d80e800 1 --2- 172.21.15.132:0/2854066195 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac509ba0 0x55c4ac511190 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.585+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 >> 172.21.15.132:0/2854066195 conn(0x55c4ac505f00 msgr2=0x55c4ac503560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 shutdown_connections 2024-05-08T18:50:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 -- 172.21.15.132:0/2854066195 wait complete. 2024-05-08T18:50:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 -- 172.21.15.132:0/24926726 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f76e403bb50 msgr2=0x7f76e403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 --2- 172.21.15.132:0/24926726 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f76e403bb50 0x7f76e403e010 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f77fc044830 tx=0x7f77fc066750 comp rx=0 tx=0).stop 2024-05-08T18:50:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 -- 172.21.15.132:0/24926726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac35bee0 msgr2=0x55c4ac35a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 --2- 172.21.15.132:0/24926726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac35bee0 0x55c4ac35a350 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x55c4ac4e6d30 tx=0x7f7804018830 comp rx=0 tx=0).stop 2024-05-08T18:50:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 -- 172.21.15.132:0/24926726 shutdown_connections 2024-05-08T18:50:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 --2- 172.21.15.132:0/24926726 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f76e403bb50 0x7f76e403e010 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 --2- 172.21.15.132:0/24926726 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac35bee0 0x55c4ac35a350 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 -- 172.21.15.132:0/24926726 >> 172.21.15.132:0/24926726 conn(0x55c4ac4ee760 msgr2=0x55c4ac4eeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 -- 172.21.15.132:0/24926726 shutdown_connections 2024-05-08T18:50:49.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 -- 172.21.15.132:0/24926726 wait complete. 2024-05-08T18:50:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 -- 172.21.15.132:0/960146336 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c4ac3e7480 msgr2=0x55c4ac4e6450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 --2- 172.21.15.132:0/960146336 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c4ac3e7480 0x55c4ac4e6450 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 -- 172.21.15.132:0/960146336 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c4ac4e8cd0 msgr2=0x55c4ac4eb0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 --2- 172.21.15.132:0/960146336 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c4ac4e8cd0 0x55c4ac4eb0c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 -- 172.21.15.132:0/960146336 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f76f003bba0 msgr2=0x7f76f003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 --2- 172.21.15.132:0/960146336 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f76f003bba0 0x7f76f003e060 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f77f4001e10 tx=0x7f77f4001390 comp rx=0 tx=0).stop 2024-05-08T18:50:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 -- 172.21.15.132:0/960146336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac3e62c0 msgr2=0x55c4ac4df210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 --2- 172.21.15.132:0/960146336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac3e62c0 0x55c4ac4df210 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00a520 tx=0x7f77fc003020 comp rx=0 tx=0).stop 2024-05-08T18:50:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 -- 172.21.15.132:0/960146336 shutdown_connections 2024-05-08T18:50:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 --2- 172.21.15.132:0/960146336 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c4ac4e8cd0 0x55c4ac4eb0c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 --2- 172.21.15.132:0/960146336 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c4ac3e7480 0x55c4ac4e6450 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 --2- 172.21.15.132:0/960146336 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f76f003bba0 0x7f76f003e060 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 --2- 172.21.15.132:0/960146336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4ac3e62c0 0x55c4ac4df210 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 -- 172.21.15.132:0/960146336 >> 172.21.15.132:0/960146336 conn(0x55c4ac3e1840 msgr2=0x55c4ac4d1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 -- 172.21.15.132:0/960146336 shutdown_connections 2024-05-08T18:50:49.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.586+0000 7f780d80e800 1 -- 172.21.15.132:0/960146336 wait complete. 2024-05-08T18:50:49.599 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1'] 2024-05-08T18:50:49.599 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1'] 2024-05-08T18:50:49.599 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 2024-05-08T18:50:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.648+0000 7fb6e0725800 1 Processor -- start 2024-05-08T18:50:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.648+0000 7fb6e0725800 1 -- start start 2024-05-08T18:50:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.648+0000 7fb6e0725800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55e824100a70 0x55e824195170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.648+0000 7fb6e0725800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e824100fb0 con 0x55e824101e00 2024-05-08T18:50:49.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.648+0000 7fb6e0725800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55e82402ce20 con 0x55e824100a70 2024-05-08T18:50:49.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.649+0000 7fb6dbc51640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55e824100a70 0x55e824195170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.649+0000 7fb6dc452640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55e824101e00 0x55e824100360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:47042/0 (socket says 172.21.15.132:47042) 2024-05-08T18:50:49.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.649+0000 7fb6dc452640 1 -- 172.21.15.132:0/3090893072 learned_addr learned my addr 172.21.15.132:0/3090893072 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:50:49.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.649+0000 7fb6dbc51640 1 -- 172.21.15.132:0/3090893072 >> v1:172.21.15.42:6789/0 conn(0x55e824101e00 legacy=0x55e824100360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.649+0000 7fb6dbc51640 1 -- 172.21.15.132:0/3090893072 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e824101180 con 0x55e824100a70 2024-05-08T18:50:49.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.651+0000 7fb6dbc51640 1 --2- 172.21.15.132:0/3090893072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e824100a70 0x55e824195170 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb6d000a470 tx=0x7fb6d001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72395ba15e79de98 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.651+0000 7fb6db450640 1 -- 172.21.15.132:0/3090893072 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d0057070 con 0x55e824100a70 2024-05-08T18:50:49.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.651+0000 7fb6db450640 1 -- 172.21.15.132:0/3090893072 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d0052570 con 0x55e824100a70 2024-05-08T18:50:49.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.651+0000 7fb6db450640 1 -- 172.21.15.132:0/3090893072 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d0052870 con 0x55e824100a70 2024-05-08T18:50:49.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.651+0000 7fb6e0725800 1 -- 172.21.15.132:0/3090893072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e824100a70 msgr2=0x55e824195170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.651+0000 7fb6e0725800 1 --2- 172.21.15.132:0/3090893072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e824100a70 0x55e824195170 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb6d000a470 tx=0x7fb6d001ce90 comp rx=0 tx=0).stop 2024-05-08T18:50:49.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.652+0000 7fb6e0725800 1 -- 172.21.15.132:0/3090893072 shutdown_connections 2024-05-08T18:50:49.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.652+0000 7fb6e0725800 1 --2- 172.21.15.132:0/3090893072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e824100a70 0x55e824195170 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.652+0000 7fb6e0725800 1 -- 172.21.15.132:0/3090893072 >> 172.21.15.132:0/3090893072 conn(0x55e824187850 msgr2=0x55e824189c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.652+0000 7fb6e0725800 1 -- 172.21.15.132:0/3090893072 shutdown_connections 2024-05-08T18:50:49.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.652+0000 7fb6e0725800 1 -- 172.21.15.132:0/3090893072 wait complete. 2024-05-08T18:50:49.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.665+0000 7fb6e0725800 1 Processor -- start 2024-05-08T18:50:49.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.665+0000 7fb6e0725800 1 -- start start 2024-05-08T18:50:49.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.665+0000 7fb6e0725800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e824100a70 0x55e82427f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.665+0000 7fb6e0725800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e8240d75d0 con 0x55e824100a70 2024-05-08T18:50:49.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.666+0000 7fb6dc452640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e824100a70 0x55e82427f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.666+0000 7fb6dc452640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e824100a70 0x55e82427f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33280/0 (socket says 172.21.15.132:33280) 2024-05-08T18:50:49.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.666+0000 7fb6dc452640 1 -- 172.21.15.132:0/2955973426 learned_addr learned my addr 172.21.15.132:0/2955973426 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.666+0000 7fb6dc452640 1 -- 172.21.15.132:0/2955973426 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e82427fec0 con 0x55e824100a70 2024-05-08T18:50:49.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.666+0000 7fb6dc452640 1 --2- 172.21.15.132:0/2955973426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e824100a70 0x55e82427f8f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc001dd0 tx=0x7fb6cc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c8877e1f500f2c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.666+0000 7fb5ca60c640 1 -- 172.21.15.132:0/2955973426 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6cc012020 con 0x55e824100a70 2024-05-08T18:50:49.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.666+0000 7fb5ca60c640 1 -- 172.21.15.132:0/2955973426 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6cc00e5a0 con 0x55e824100a70 2024-05-08T18:50:49.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.666+0000 7fb5ca60c640 1 -- 172.21.15.132:0/2955973426 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6cc00e900 con 0x55e824100a70 2024-05-08T18:50:49.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.667+0000 7fb6e0725800 1 -- 172.21.15.132:0/2955973426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e824100a70 msgr2=0x55e82427f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.667+0000 7fb6e0725800 1 --2- 172.21.15.132:0/2955973426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e824100a70 0x55e82427f8f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc001dd0 tx=0x7fb6cc00b6c0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.667+0000 7fb6e0725800 1 -- 172.21.15.132:0/2955973426 shutdown_connections 2024-05-08T18:50:49.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.667+0000 7fb6e0725800 1 --2- 172.21.15.132:0/2955973426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e824100a70 0x55e82427f8f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.667+0000 7fb6e0725800 1 -- 172.21.15.132:0/2955973426 >> 172.21.15.132:0/2955973426 conn(0x55e824187850 msgr2=0x55e82427b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.667+0000 7fb6e0725800 1 -- 172.21.15.132:0/2955973426 shutdown_connections 2024-05-08T18:50:49.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.667+0000 7fb6e0725800 1 -- 172.21.15.132:0/2955973426 wait complete. 2024-05-08T18:50:49.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.667+0000 7fb6e0725800 1 Processor -- start 2024-05-08T18:50:49.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.667+0000 7fb6e0725800 1 -- start start 2024-05-08T18:50:49.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.668+0000 7fb6e0725800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e824100a70 0x55e824287470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.668+0000 7fb6e0725800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e824195980 con 0x55e824100a70 2024-05-08T18:50:49.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.668+0000 7fb6dc452640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e824100a70 0x55e824287470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.668+0000 7fb6dc452640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e824100a70 0x55e824287470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33286/0 (socket says 172.21.15.132:33286) 2024-05-08T18:50:49.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.668+0000 7fb6dc452640 1 -- 172.21.15.132:0/948061564 learned_addr learned my addr 172.21.15.132:0/948061564 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.668+0000 7fb6dc452640 1 -- 172.21.15.132:0/948061564 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8242879b0 con 0x55e824100a70 2024-05-08T18:50:49.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.668+0000 7fb6dc452640 1 --2- 172.21.15.132:0/948061564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e824100a70 0x55e824287470 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc001dd0 tx=0x7fb6cc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.669+0000 7fb5c8e09640 1 -- 172.21.15.132:0/948061564 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6cc012030 con 0x55e824100a70 2024-05-08T18:50:49.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.669+0000 7fb5c8e09640 1 -- 172.21.15.132:0/948061564 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6cc01a7a0 con 0x55e824100a70 2024-05-08T18:50:49.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.669+0000 7fb5c8e09640 1 -- 172.21.15.132:0/948061564 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6cc01a990 con 0x55e824100a70 2024-05-08T18:50:49.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.669+0000 7fb6e0725800 1 -- 172.21.15.132:0/948061564 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e824287c40 con 0x55e824100a70 2024-05-08T18:50:49.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.669+0000 7fb6e0725800 1 -- 172.21.15.132:0/948061564 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e82428a8f0 con 0x55e824100a70 2024-05-08T18:50:49.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.670+0000 7fb5c8e09640 1 -- 172.21.15.132:0/948061564 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb6cc015020 con 0x55e824100a70 2024-05-08T18:50:49.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.670+0000 7fb5c8e09640 1 --2- 172.21.15.132:0/948061564 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb5c403bba0 0x7fb5c403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.670+0000 7fb5c8e09640 1 -- 172.21.15.132:0/948061564 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fb6cc020030 con 0x55e824100a70 2024-05-08T18:50:49.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.670+0000 7fb6dbc51640 1 --2- 172.21.15.132:0/948061564 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb5c403bba0 0x7fb5c403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.670+0000 7fb6e0725800 1 --2- 172.21.15.132:0/948061564 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e824101e00 0x55e82428e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.670+0000 7fb6e0725800 1 -- 172.21.15.132:0/948061564 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e82428ebf0 con 0x55e824101e00 2024-05-08T18:50:49.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.670+0000 7fb6dcc53640 1 --2- 172.21.15.132:0/948061564 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e824101e00 0x55e82428e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.670+0000 7fb6dbc51640 1 --2- 172.21.15.132:0/948061564 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb5c403bba0 0x7fb5c403e060 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0054000 tx=0x7fb6d004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.670+0000 7fb6dcc53640 1 --2- 172.21.15.132:0/948061564 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e824101e00 0x55e82428e6b0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.671+0000 7fb6dcc53640 1 -- 172.21.15.132:0/948061564 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6d400a4a0 con 0x55e824101e00 2024-05-08T18:50:49.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.671+0000 7fb6e0725800 1 -- 172.21.15.132:0/948061564 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e82428bc60 con 0x55e824101e00 2024-05-08T18:50:49.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.671+0000 7fb6dcc53640 1 -- 172.21.15.132:0/948061564 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb6d400a4a0 con 0x55e824101e00 2024-05-08T18:50:49.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.671+0000 7fb6e0725800 1 --2- 172.21.15.132:0/948061564 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e824290f10 0x55e824293300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.671+0000 7fb6e0725800 1 -- 172.21.15.132:0/948061564 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8242939f0 con 0x55e824290f10 2024-05-08T18:50:49.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.671+0000 7fb6dc452640 1 --2- 172.21.15.132:0/948061564 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e824290f10 0x55e824293300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.671+0000 7fb6dc452640 1 --2- 172.21.15.132:0/948061564 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e824290f10 0x55e824293300 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.672+0000 7fb6dc452640 1 -- 172.21.15.132:0/948061564 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb6cc03e9f0 con 0x55e824290f10 2024-05-08T18:50:49.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.672+0000 7fb6e0725800 1 -- 172.21.15.132:0/948061564 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e82428fdb0 con 0x55e824101e00 2024-05-08T18:50:49.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.672+0000 7fb6dcc53640 1 -- 172.21.15.132:0/948061564 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb6d400a4a0 con 0x55e824101e00 2024-05-08T18:50:49.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.672+0000 7fb6e0725800 1 -- 172.21.15.132:0/948061564 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e824290290 con 0x55e824101e00 2024-05-08T18:50:49.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.672+0000 7fb6dcc53640 1 -- 172.21.15.132:0/948061564 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb6d400a4a0 con 0x55e824101e00 2024-05-08T18:50:49.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.672+0000 7fb6e0725800 1 Processor -- start 2024-05-08T18:50:49.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.672+0000 7fb6e0725800 1 -- start start 2024-05-08T18:50:49.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.673+0000 7fb6e0725800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8242a2930 0x55e8242a2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.673+0000 7fb6e0725800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e82407dfc0 con 0x55e8242a2930 2024-05-08T18:50:49.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.673+0000 7fb6dcc53640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8242a2930 0x55e8242a2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.673+0000 7fb6dcc53640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8242a2930 0x55e8242a2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33290/0 (socket says 172.21.15.132:33290) 2024-05-08T18:50:49.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.673+0000 7fb6dcc53640 1 -- 172.21.15.132:0/2153247358 learned_addr learned my addr 172.21.15.132:0/2153247358 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.673+0000 7fb6dcc53640 1 -- 172.21.15.132:0/2153247358 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8242a3290 con 0x55e8242a2930 2024-05-08T18:50:49.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.673+0000 7fb6dcc53640 1 --2- 172.21.15.132:0/2153247358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8242a2930 0x55e8242a2d50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x55e82428ef90 tx=0x7fb6d4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.674+0000 7fb5c27fc640 1 -- 172.21.15.132:0/2153247358 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d4014450 con 0x55e8242a2930 2024-05-08T18:50:49.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.674+0000 7fb5c27fc640 1 -- 172.21.15.132:0/2153247358 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d4014610 con 0x55e8242a2930 2024-05-08T18:50:49.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.674+0000 7fb6e0725800 1 -- 172.21.15.132:0/2153247358 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8242a3d00 con 0x55e8242a2930 2024-05-08T18:50:49.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.674+0000 7fb5c27fc640 1 -- 172.21.15.132:0/2153247358 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d4014930 con 0x55e8242a2930 2024-05-08T18:50:49.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.674+0000 7fb6e0725800 1 -- 172.21.15.132:0/2153247358 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8242a4200 con 0x55e8242a2930 2024-05-08T18:50:49.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.674+0000 7fb5c27fc640 1 -- 172.21.15.132:0/2153247358 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb6d4011040 con 0x55e8242a2930 2024-05-08T18:50:49.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.675+0000 7fb5c27fc640 1 --2- 172.21.15.132:0/2153247358 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb5b403bba0 0x7fb5b403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.675+0000 7fb5c27fc640 1 -- 172.21.15.132:0/2153247358 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fb6d401e070 con 0x55e8242a2930 2024-05-08T18:50:49.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.675+0000 7fb6dc452640 1 --2- 172.21.15.132:0/2153247358 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb5b403bba0 0x7fb5b403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.675+0000 7fb6e0725800 1 Processor -- start 2024-05-08T18:50:49.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.675+0000 7fb6e0725800 1 -- start start 2024-05-08T18:50:49.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.675+0000 7fb6dc452640 1 --2- 172.21.15.132:0/2153247358 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb5b403bba0 0x7fb5b403e060 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55e82428f080 tx=0x7fb6cc04c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.675+0000 7fb6e0725800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8242afc20 0x55e8242b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.675+0000 7fb6e0725800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e824280240 con 0x55e8242afc20 2024-05-08T18:50:49.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.675+0000 7fb6dcc53640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8242afc20 0x55e8242b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.675+0000 7fb6dcc53640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8242afc20 0x55e8242b0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33298/0 (socket says 172.21.15.132:33298) 2024-05-08T18:50:49.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.675+0000 7fb6dcc53640 1 -- 172.21.15.132:0/2996176866 learned_addr learned my addr 172.21.15.132:0/2996176866 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.676+0000 7fb6dcc53640 1 -- 172.21.15.132:0/2996176866 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8242b0610 con 0x55e8242afc20 2024-05-08T18:50:49.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.676+0000 7fb6dcc53640 1 --2- 172.21.15.132:0/2996176866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8242afc20 0x55e8242b0040 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4052d70 tx=0x7fb6d40118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6752fbcfd4d9aab5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.676+0000 7fb5bb7fe640 1 -- 172.21.15.132:0/2996176866 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d4014ad0 con 0x55e8242afc20 2024-05-08T18:50:49.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.676+0000 7fb5bb7fe640 1 -- 172.21.15.132:0/2996176866 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d4014c70 con 0x55e8242afc20 2024-05-08T18:50:49.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.676+0000 7fb5bb7fe640 1 -- 172.21.15.132:0/2996176866 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d4011d30 con 0x55e8242afc20 2024-05-08T18:50:49.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.676+0000 7fb6e0725800 1 -- 172.21.15.132:0/2996176866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8242afc20 msgr2=0x55e8242b0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.676+0000 7fb6e0725800 1 --2- 172.21.15.132:0/2996176866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8242afc20 0x55e8242b0040 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4052d70 tx=0x7fb6d40118e0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.676+0000 7fb6e0725800 1 -- 172.21.15.132:0/2996176866 shutdown_connections 2024-05-08T18:50:49.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.676+0000 7fb6e0725800 1 --2- 172.21.15.132:0/2996176866 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8242afc20 0x55e8242b0040 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.676+0000 7fb6e0725800 1 -- 172.21.15.132:0/2996176866 >> 172.21.15.132:0/2996176866 conn(0x55e8242abf30 msgr2=0x55e8242a9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.676+0000 7fb6e0725800 1 -- 172.21.15.132:0/2996176866 shutdown_connections 2024-05-08T18:50:49.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.676+0000 7fb6e0725800 1 -- 172.21.15.132:0/2996176866 wait complete. 2024-05-08T18:50:49.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.677+0000 7fb6e0725800 1 Processor -- start 2024-05-08T18:50:49.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.677+0000 7fb6e0725800 1 -- start start 2024-05-08T18:50:49.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.677+0000 7fb6e0725800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8242afc20 0x55e8242b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.677+0000 7fb6e0725800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e8242b0d60 con 0x55e8242afc20 2024-05-08T18:50:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.677+0000 7fb6dcc53640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8242afc20 0x55e8242b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.677+0000 7fb6dcc53640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8242afc20 0x55e8242b7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33308/0 (socket says 172.21.15.132:33308) 2024-05-08T18:50:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.677+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 learned_addr learned my addr 172.21.15.132:0/1515184071 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.677+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8242b76c0 con 0x55e8242afc20 2024-05-08T18:50:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.678+0000 7fb6dcc53640 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8242afc20 0x55e8242b7180 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4051c90 tx=0x7fb6d4052d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.678+0000 7fb5b9ffb640 1 -- 172.21.15.132:0/1515184071 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d4014ad0 con 0x55e8242afc20 2024-05-08T18:50:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.678+0000 7fb5b9ffb640 1 -- 172.21.15.132:0/1515184071 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d4040d70 con 0x55e8242afc20 2024-05-08T18:50:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.678+0000 7fb5b9ffb640 1 -- 172.21.15.132:0/1515184071 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6d4051210 con 0x55e8242afc20 2024-05-08T18:50:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.678+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8242b7950 con 0x55e8242afc20 2024-05-08T18:50:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.678+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8242ba600 con 0x55e8242afc20 2024-05-08T18:50:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.678+0000 7fb5b9ffb640 1 -- 172.21.15.132:0/1515184071 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb6d40548f0 con 0x55e8242afc20 2024-05-08T18:50:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.679+0000 7fb5b9ffb640 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb5a403bba0 0x7fb5a403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.679+0000 7fb5b9ffb640 1 -- 172.21.15.132:0/1515184071 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fb6d400e040 con 0x55e8242afc20 2024-05-08T18:50:49.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.679+0000 7fb6dc452640 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb5a403bba0 0x7fb5a403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.679+0000 7fb6dc452640 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb5a403bba0 0x7fb5a403e060 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc051150 tx=0x7fb6cc046000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.679+0000 7fb6e0725800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.679+0000 7fb6e0725800 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e8242c2de0 0x55e8242c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.679+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8242c59f0 con 0x55e8242c2de0 2024-05-08T18:50:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.679+0000 7fb6dbc51640 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e8242c2de0 0x55e8242c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.680+0000 7fb6dbc51640 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e8242c2de0 0x55e8242c52a0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.680+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6d005a040 con 0x55e8242c2de0 2024-05-08T18:50:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.680+0000 7fb6e0725800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.680+0000 7fb6e0725800 20 realm 2024-05-08T18:50:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.680+0000 7fb6e0725800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.680+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8242c5dc0 con 0x55e8242c2de0 2024-05-08T18:50:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.680+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6d005a040 con 0x55e8242c2de0 2024-05-08T18:50:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.680+0000 7fb6e0725800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.680+0000 7fb6e0725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:49.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.680+0000 7fb6e0725800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.680+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8242c6690 con 0x55e8242c2de0 2024-05-08T18:50:49.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.680+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6d005a040 con 0x55e8242c2de0 2024-05-08T18:50:49.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.680+0000 7fb6e0725800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.680+0000 7fb6e0725800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.680+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8242c6a30 con 0x55e8242c2de0 2024-05-08T18:50:49.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.681+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb6d005a040 con 0x55e8242c2de0 2024-05-08T18:50:49.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.681+0000 7fb6e0725800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:49.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.681+0000 7fb6e0725800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.681+0000 7fb6e0725800 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e8242c7790 0x55e8242c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.681+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8242ca140 con 0x55e8242c7790 2024-05-08T18:50:49.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.681+0000 7fb6dcc53640 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e8242c7790 0x55e8242c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.681+0000 7fb6dcc53640 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e8242c7790 0x55e8242c9b80 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.681+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb6d402a070 con 0x55e8242c7790 2024-05-08T18:50:49.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.681+0000 7fb6e0725800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:49.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.681+0000 7fb6e0725800 20 searching for the correct realm 2024-05-08T18:50:49.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.681+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x55e8242c7790 2024-05-08T18:50:49.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.682+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d402a070 con 0x55e8242c7790 2024-05-08T18:50:49.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.682+0000 7fb6dcc53640 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb6d404a030 0x7fb6d4023420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.682+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x7fb6d404a030 2024-05-08T18:50:49.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.682+0000 7fb6dc452640 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb6d404a030 0x7fb6d4023420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.682+0000 7fb6dc452640 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb6d404a030 0x7fb6d4023420 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.683+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6cc03e9f0 con 0x7fb6d404a030 2024-05-08T18:50:49.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.683+0000 7fb6dc452640 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb6cc017050 0x7fb6cc03d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.683+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x7fb6cc017050 2024-05-08T18:50:49.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.683+0000 7fb6dbc51640 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb6cc017050 0x7fb6cc03d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.683+0000 7fb6dbc51640 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb6cc017050 0x7fb6cc03d040 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.684+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d005a040 con 0x7fb6cc017050 2024-05-08T18:50:49.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.684+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x55e8242c2de0 2024-05-08T18:50:49.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.684+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d005a040 con 0x55e8242c2de0 2024-05-08T18:50:49.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.684+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x55e8242c2de0 2024-05-08T18:50:49.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.684+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d005a040 con 0x55e8242c2de0 2024-05-08T18:50:49.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.684+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x7fb6cc017050 2024-05-08T18:50:49.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.684+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d005a040 con 0x7fb6cc017050 2024-05-08T18:50:49.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.684+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x7fb6cc017050 2024-05-08T18:50:49.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.685+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d005a040 con 0x7fb6cc017050 2024-05-08T18:50:49.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.685+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x7fb6d404a030 2024-05-08T18:50:49.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.685+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6cc03e9f0 con 0x7fb6d404a030 2024-05-08T18:50:49.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.685+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x55e8242c7790 2024-05-08T18:50:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.685+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d402a070 con 0x55e8242c7790 2024-05-08T18:50:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.685+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x55e8242c2de0 2024-05-08T18:50:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.685+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d005a040 con 0x55e8242c2de0 2024-05-08T18:50:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.685+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x7fb6cc017050 2024-05-08T18:50:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.685+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d005a040 con 0x7fb6cc017050 2024-05-08T18:50:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.685+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x55e8242c2de0 2024-05-08T18:50:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.686+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb6d005a040 con 0x55e8242c2de0 2024-05-08T18:50:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.686+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x7fb6d404a030 2024-05-08T18:50:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.686+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb6cc03e9f0 con 0x7fb6d404a030 2024-05-08T18:50:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.686+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x55e8242c7790 2024-05-08T18:50:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.686+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb6d402a070 con 0x55e8242c7790 2024-05-08T18:50:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.686+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x55e8242c7790 2024-05-08T18:50:49.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.686+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d402a070 con 0x55e8242c7790 2024-05-08T18:50:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.686+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x7fb6cc017050 2024-05-08T18:50:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.687+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d005a040 con 0x7fb6cc017050 2024-05-08T18:50:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.687+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x55e8242c7790 2024-05-08T18:50:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.687+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d402a070 con 0x55e8242c7790 2024-05-08T18:50:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.687+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x55e8242c7790 2024-05-08T18:50:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.687+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d402a070 con 0x55e8242c7790 2024-05-08T18:50:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.687+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x55e8242c2de0 2024-05-08T18:50:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.687+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d005a040 con 0x55e8242c2de0 2024-05-08T18:50:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.687+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x55e8242c2de0 2024-05-08T18:50:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.688+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb6d005a040 con 0x55e8242c2de0 2024-05-08T18:50:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.688+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x7fb6cc017050 2024-05-08T18:50:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.688+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d007d040 con 0x7fb6cc017050 2024-05-08T18:50:49.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.688+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x55e8242c7790 2024-05-08T18:50:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.688+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d402a070 con 0x55e8242c7790 2024-05-08T18:50:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.688+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x7fb6d404a030 2024-05-08T18:50:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.688+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6cc03e9f0 con 0x7fb6d404a030 2024-05-08T18:50:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.688+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x55e8242c2de0 2024-05-08T18:50:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.689+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d007d040 con 0x55e8242c2de0 2024-05-08T18:50:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.689+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x7fb6cc017050 2024-05-08T18:50:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.689+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d007d040 con 0x7fb6cc017050 2024-05-08T18:50:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.689+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x55e8242c7790 2024-05-08T18:50:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.689+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d402a070 con 0x55e8242c7790 2024-05-08T18:50:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.689+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x7fb6cc017050 2024-05-08T18:50:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.689+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d007d040 con 0x7fb6cc017050 2024-05-08T18:50:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.689+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x7fb6d404a030 2024-05-08T18:50:49.702 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.690+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6cc03e9f0 con 0x7fb6d404a030 2024-05-08T18:50:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.690+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x55e8242c7790 2024-05-08T18:50:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.690+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d402a070 con 0x55e8242c7790 2024-05-08T18:50:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.690+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x7fb6cc017050 2024-05-08T18:50:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.690+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6d007d040 con 0x7fb6cc017050 2024-05-08T18:50:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.690+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x55e8242c2de0 2024-05-08T18:50:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.690+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb6d007d040 con 0x55e8242c2de0 2024-05-08T18:50:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.690+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cbac0 con 0x7fb6d404a030 2024-05-08T18:50:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.691+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6cc03e9f0 con 0x7fb6d404a030 2024-05-08T18:50:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.691+0000 7fb6e0725800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.691+0000 7fb6e0725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.691+0000 7fb6e0725800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.691+0000 7fb6e0725800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.691+0000 7fb6e0725800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:49.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.691+0000 7fb6e0725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.691+0000 7fb6e0725800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.691+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cb690 con 0x55e8242c2de0 2024-05-08T18:50:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.691+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6d007d040 con 0x55e8242c2de0 2024-05-08T18:50:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.691+0000 7fb6e0725800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.691+0000 7fb6e0725800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.691+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8242caf00 con 0x55e8242c2de0 2024-05-08T18:50:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.691+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb6d007d040 con 0x55e8242c2de0 2024-05-08T18:50:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.691+0000 7fb6e0725800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.691+0000 7fb6e0725800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.691+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8242ca640 con 0x55e8242c2de0 2024-05-08T18:50:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.692+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb6d007d040 con 0x55e8242c2de0 2024-05-08T18:50:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.692+0000 7fb6e0725800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.692+0000 7fb6e0725800 20 zone default found 2024-05-08T18:50:49.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.692+0000 7fb6e0725800 4 Realm: () 2024-05-08T18:50:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.692+0000 7fb6e0725800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.692+0000 7fb6e0725800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.692+0000 7fb6e0725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.692+0000 7fb6e0725800 20 zonegroup default 2024-05-08T18:50:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.692+0000 7fb6e0725800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.692+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cc3f0 con 0x7fb6cc017050 2024-05-08T18:50:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.692+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb6d007d040 con 0x7fb6cc017050 2024-05-08T18:50:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.692+0000 7fb6e0725800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.692+0000 7fb6e0725800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.692+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8242ce620 con 0x55e8242c7790 2024-05-08T18:50:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.692+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb6d402a070 con 0x55e8242c7790 2024-05-08T18:50:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.692+0000 7fb6e0725800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.692+0000 7fb6e0725800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.693+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8242ce9c0 con 0x55e8242c7790 2024-05-08T18:50:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.693+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb6d402a070 con 0x55e8242c7790 2024-05-08T18:50:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.693+0000 7fb6e0725800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.693+0000 7fb6e0725800 20 started sync module instance, tier type = 2024-05-08T18:50:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.693+0000 7fb6e0725800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.693+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cdab0 con 0x7fb6d404a030 2024-05-08T18:50:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.694+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6cc03e9f0 con 0x7fb6d404a030 2024-05-08T18:50:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.694+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94455527693984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cd710 con 0x7fb6d404a030 2024-05-08T18:50:49.706 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.694+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cf720 con 0x55e8242c2de0 2024-05-08T18:50:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.695+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94455527693984] v25'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6cc03e9f0 con 0x7fb6d404a030 2024-05-08T18:50:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.695+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d007d040 con 0x55e8242c2de0 2024-05-08T18:50:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.695+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94455527697760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cfb40 con 0x55e8242c2de0 2024-05-08T18:50:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.695+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242d0560 con 0x55e8242c7790 2024-05-08T18:50:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.696+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94455527697760] v25'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d007d040 con 0x55e8242c2de0 2024-05-08T18:50:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.697+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d402a070 con 0x55e8242c7790 2024-05-08T18:50:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.697+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94455527702608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242d0520 con 0x55e8242c7790 2024-05-08T18:50:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.697+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242d0fe0 con 0x7fb6d404a030 2024-05-08T18:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.697+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94455527702608] v25'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d402a070 con 0x55e8242c7790 2024-05-08T18:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.698+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6cc03e9f0 con 0x7fb6d404a030 2024-05-08T18:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.698+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94455527698816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242d13d0 con 0x7fb6d404a030 2024-05-08T18:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.698+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242d1e50 con 0x55e8242c2de0 2024-05-08T18:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.699+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94455527698816] v25'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6cc03e9f0 con 0x7fb6d404a030 2024-05-08T18:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.699+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d007d040 con 0x55e8242c2de0 2024-05-08T18:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.699+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94455527708992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242d2240 con 0x55e8242c2de0 2024-05-08T18:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.699+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242d2c60 con 0x7fb6cc017050 2024-05-08T18:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.700+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94455527708992] v25'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d007d040 con 0x55e8242c2de0 2024-05-08T18:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.700+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d007d040 con 0x7fb6cc017050 2024-05-08T18:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.700+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94455527712592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242d2c20 con 0x7fb6cc017050 2024-05-08T18:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.700+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242d3670 con 0x7fb6cc017050 2024-05-08T18:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.701+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(56 notify.6 [create] v25'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d007d040 con 0x7fb6cc017050 2024-05-08T18:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.701+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94455527715264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242d3a90 con 0x7fb6cc017050 2024-05-08T18:50:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.701+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242d4550 con 0x7fb6cc017050 2024-05-08T18:50:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.701+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94455527712592] v25'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d007d040 con 0x7fb6cc017050 2024-05-08T18:50:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.702+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94455527715264] v25'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d007d040 con 0x7fb6cc017050 2024-05-08T18:50:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.702+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d007d040 con 0x7fb6cc017050 2024-05-08T18:50:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.702+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94455527719040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242d35e0 con 0x7fb6cc017050 2024-05-08T18:50:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.702+0000 7fb6e0725800 20 add_watcher() i=0 2024-05-08T18:50:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.702+0000 7fb6e0725800 20 add_watcher() i=1 2024-05-08T18:50:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.702+0000 7fb6e0725800 20 add_watcher() i=2 2024-05-08T18:50:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.702+0000 7fb6e0725800 20 add_watcher() i=3 2024-05-08T18:50:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.702+0000 7fb6e0725800 20 add_watcher() i=4 2024-05-08T18:50:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.702+0000 7fb6e0725800 20 add_watcher() i=5 2024-05-08T18:50:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.702+0000 7fb6e0725800 20 add_watcher() i=6 2024-05-08T18:50:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.704+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94455527719040] v25'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d007d040 con 0x7fb6cc017050 2024-05-08T18:50:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.704+0000 7fb6e0725800 20 add_watcher() i=7 2024-05-08T18:50:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.704+0000 7fb6e0725800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.704+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8242d7580 con 0x55e8242c2de0 2024-05-08T18:50:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.705+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb6d007d040 con 0x55e8242c2de0 2024-05-08T18:50:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.705+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94455527705328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242d4a00 con 0x55e8242c2de0 2024-05-08T18:50:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.706+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94455527705328] v25'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb6d007d040 con 0x55e8242c2de0 2024-05-08T18:50:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.706+0000 7fb592fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.706+0000 7fb6e0725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.706+0000 7fb6e0725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.706+0000 7fb6e0725800 5 note: GC not initialized 2024-05-08T18:50:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.706+0000 7fb591fdb640 20 reqs_thread_entry: start 2024-05-08T18:50:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.706+0000 7fb6e0725800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.706+0000 7fb6e0725800 20 Filter name: none 2024-05-08T18:50:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.706+0000 7fb5037fe640 20 reqs_thread_entry: start 2024-05-08T18:50:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.706+0000 7fb6e0725800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:50:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.706+0000 7fb6e0725800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.706+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e82430a900 con 0x55e8242c2de0 2024-05-08T18:50:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.707+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb6d007d040 con 0x55e8242c2de0 2024-05-08T18:50:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.707+0000 7fb6e0725800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.707+0000 7fb6e0725800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:50:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.707+0000 7fb6e0725800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.707+0000 7fb6e0725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.707+0000 7fb6e0725800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:50:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.707+0000 7fb6e0725800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.707+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e82430c880 con 0x7fb6d404a030 2024-05-08T18:50:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.707+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb6cc03e9f0 con 0x7fb6d404a030 2024-05-08T18:50:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.707+0000 7fb6e0725800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:50:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.707+0000 7fb6e0725800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:50:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.707+0000 7fb6e0725800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:50:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.707+0000 7fb6e0725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 : miss 2024-05-08T18:50:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.707+0000 7fb6e0725800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.707+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:64 8.1e 8:7ec7f916:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e82430e100 con 0x7fb6cc017050 2024-05-08T18:50:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.708+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(64 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fb6d007d040 con 0x7fb6cc017050 2024-05-08T18:50:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.708+0000 7fb6e0725800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:50:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.708+0000 7fb6e0725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 info.flags=0x17 2024-05-08T18:50:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.708+0000 7fb6e0725800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 to cache LRU end 2024-05-08T18:50:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.708+0000 7fb6e0725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.708+0000 7fb6e0725800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:50:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.708+0000 7fb6e0725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 2024-05-08T18:50:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.708+0000 7fb6e0725800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-05-08T18:50:49.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.708+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e824312910 con 0x7fb6cc017050 2024-05-08T18:50:49.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.709+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(65 fud.buckets [call] v25'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb6d007d040 con 0x7fb6cc017050 2024-05-08T18:50:49.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.709+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:66 8.1e 8:7ec7f916:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e824318870 con 0x7fb6cc017050 2024-05-08T18:50:49.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.710+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(66 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v25'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fb6d007d040 con 0x7fb6cc017050 2024-05-08T18:50:49.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.710+0000 7fb6e0725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 info.flags=0x17 2024-05-08T18:50:49.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.710+0000 7fb6e0725800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 to cache LRU end 2024-05-08T18:50:49.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.710+0000 7fb6e0725800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:50:49.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.710+0000 7fb6e0725800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1, ofs0, ns] 2024-05-08T18:50:49.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.710+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94455527958464 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e824312d40 con 0x7fb6d404a030 2024-05-08T18:50:49.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.710+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== watch-notify(notify (1) cookie 94455527693984 notify 107374182420 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7fb6cc05b040 con 0x7fb6d404a030 2024-05-08T18:50:49.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.710+0000 7fb5bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182420 cookie 94455527693984 notifier 4515 bl.length()=752 2024-05-08T18:50:49.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.710+0000 7fb5bb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 info.flags=0x17 2024-05-08T18:50:49.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.710+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(67 notify.0 [notify cookie 94455527958464 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb6cc03e9f0 con 0x7fb6d404a030 2024-05-08T18:50:49.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.710+0000 7fb5bb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 to cache LRU end 2024-05-08T18:50:49.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.710+0000 7fb5bb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:50:49.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.710+0000 7fb5bb7fe640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7fb5a8003ea0 con 0x7fb6d404a030 2024-05-08T18:50:49.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.711+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6cc03e9f0 con 0x7fb6d404a030 2024-05-08T18:50:49.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.711+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== watch-notify(notify_complete (2) cookie 94455527958464 notify 107374182420 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb6cc064040 con 0x7fb6d404a030 2024-05-08T18:50:49.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.711+0000 7fb6e0725800 20 handle_bi_update(): bucket=:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): orig_sources= new_sources= 2024-05-08T18:50:49.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.711+0000 7fb6e0725800 20 handle_bi_update(): bucket=:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): potential sources added=[] removed=[] 2024-05-08T18:50:49.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.711+0000 7fb6e0725800 20 handle_bi_update(): bucket=:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): orig_dests= new_dests= 2024-05-08T18:50:49.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.711+0000 7fb6e0725800 20 handle_bi_update(): bucket=:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): potential dests added=[] removed=[] 2024-05-08T18:50:49.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.711+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e824317030 con 0x7fb6d404a030 2024-05-08T18:50:49.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.712+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(69 foo.buckets [call] v25'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb6cc03e9f0 con 0x7fb6d404a030 2024-05-08T18:50:49.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.712+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e824318040 con 0x7fb6d404a030 2024-05-08T18:50:49.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.713+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v25'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fb6cc03e9f0 con 0x7fb6d404a030 2024-05-08T18:50:49.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.713+0000 7fb6e0725800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T18:50:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.713+0000 7fb6e0725800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:50:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.713+0000 7fb6e0725800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:50:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.713+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94455527958432 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e8243174e0 con 0x7fb6cc017050 2024-05-08T18:50:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.713+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== watch-notify(notify (1) cookie 94455527715264 notify 107374182405 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55e82430d620 con 0x7fb6cc017050 2024-05-08T18:50:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.713+0000 7fb5bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182405 cookie 94455527715264 notifier 4515 bl.length()=314 2024-05-08T18:50:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.713+0000 7fb5bb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T18:50:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.713+0000 7fb5bb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:50:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.713+0000 7fb5bb7fe640 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7fb5a8003ea0 con 0x7fb6cc017050 2024-05-08T18:50:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.713+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(71 notify.6 [notify cookie 94455527958432 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb6d007d040 con 0x7fb6cc017050 2024-05-08T18:50:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.713+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d007d040 con 0x7fb6cc017050 2024-05-08T18:50:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.714+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== watch-notify(notify_complete (2) cookie 94455527958432 notify 107374182405 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e824101180 con 0x7fb6cc017050 2024-05-08T18:50:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.714+0000 7fb592fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.714+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94455527705328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e82430f350 con 0x55e8242c2de0 2024-05-08T18:50:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.715+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94455527705328] v25'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb6d007d040 con 0x55e8242c2de0 2024-05-08T18:50:49.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.715+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94455527693984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242d0af0 con 0x7fb6d404a030 2024-05-08T18:50:49.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.716+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94455527693984] v25'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6cc03e9f0 con 0x7fb6d404a030 2024-05-08T18:50:49.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.716+0000 7fb6e0725800 20 remove_watcher() i=0 2024-05-08T18:50:49.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.716+0000 7fb6e0725800 2 removed watcher, disabling cache 2024-05-08T18:50:49.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.716+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94455527697760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cdea0 con 0x55e8242c2de0 2024-05-08T18:50:49.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.717+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94455527697760] v25'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d007d040 con 0x55e8242c2de0 2024-05-08T18:50:49.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.717+0000 7fb6e0725800 20 remove_watcher() i=1 2024-05-08T18:50:49.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.717+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94455527702608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242cdea0 con 0x55e8242c7790 2024-05-08T18:50:49.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.718+0000 7fb6dcc53640 1 -- 172.21.15.132:0/1515184071 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94455527702608] v25'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d402a070 con 0x55e8242c7790 2024-05-08T18:50:49.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.718+0000 7fb6e0725800 20 remove_watcher() i=2 2024-05-08T18:50:49.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.718+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94455527698816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242d0050 con 0x7fb6d404a030 2024-05-08T18:50:49.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.719+0000 7fb6dc452640 1 -- 172.21.15.132:0/1515184071 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94455527698816] v25'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6cc03e9f0 con 0x7fb6d404a030 2024-05-08T18:50:49.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.719+0000 7fb6e0725800 20 remove_watcher() i=3 2024-05-08T18:50:49.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.719+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94455527708992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242d0050 con 0x55e8242c2de0 2024-05-08T18:50:49.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.720+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94455527708992] v25'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d007d040 con 0x55e8242c2de0 2024-05-08T18:50:49.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.720+0000 7fb6e0725800 20 remove_watcher() i=4 2024-05-08T18:50:49.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.720+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94455527712592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242d1940 con 0x7fb6cc017050 2024-05-08T18:50:49.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.721+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94455527712592] v25'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d007d040 con 0x7fb6cc017050 2024-05-08T18:50:49.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.721+0000 7fb6e0725800 20 remove_watcher() i=5 2024-05-08T18:50:49.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.721+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94455527715264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242d0050 con 0x7fb6cc017050 2024-05-08T18:50:49.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.722+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94455527715264] v25'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d007d040 con 0x7fb6cc017050 2024-05-08T18:50:49.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.722+0000 7fb6e0725800 20 remove_watcher() i=6 2024-05-08T18:50:49.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.722+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94455527719040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e8242d2750 con 0x7fb6cc017050 2024-05-08T18:50:49.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.723+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94455527719040] v25'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6d007d040 con 0x7fb6cc017050 2024-05-08T18:50:49.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.723+0000 7fb6e0725800 20 remove_watcher() i=7 2024-05-08T18:50:49.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.723+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb6cc017050 msgr2=0x7fb6cc03d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.723+0000 7fb6e0725800 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb6cc017050 0x7fb6cc03d040 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.723+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e8242c2de0 msgr2=0x55e8242c52a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.723+0000 7fb6e0725800 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e8242c2de0 0x55e8242c52a0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.723+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb6d404a030 msgr2=0x7fb6d4023420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.723+0000 7fb6e0725800 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb6d404a030 0x7fb6d4023420 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.723+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e8242c7790 msgr2=0x55e8242c9b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.723+0000 7fb6e0725800 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e8242c7790 0x55e8242c9b80 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb5a403bba0 msgr2=0x7fb5a403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb5a403bba0 0x7fb5a403e060 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc051150 tx=0x7fb6cc046000 comp rx=0 tx=0).stop 2024-05-08T18:50:49.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8242afc20 msgr2=0x55e8242b7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6dbc51640 1 -- 172.21.15.132:0/1515184071 reap_dead start 2024-05-08T18:50:49.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8242afc20 0x55e8242b7180 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4051c90 tx=0x7fb6d4052d00 comp rx=0 tx=0).stop 2024-05-08T18:50:49.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 shutdown_connections 2024-05-08T18:50:49.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 --2- 172.21.15.132:0/1515184071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8242afc20 0x55e8242b7180 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 >> 172.21.15.132:0/1515184071 conn(0x55e8242abf30 msgr2=0x55e8242a9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 shutdown_connections 2024-05-08T18:50:49.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 -- 172.21.15.132:0/1515184071 wait complete. 2024-05-08T18:50:49.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 -- 172.21.15.132:0/2153247358 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb5b403bba0 msgr2=0x7fb5b403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 --2- 172.21.15.132:0/2153247358 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb5b403bba0 0x7fb5b403e060 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55e82428f080 tx=0x7fb6cc04c040 comp rx=0 tx=0).stop 2024-05-08T18:50:49.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 -- 172.21.15.132:0/2153247358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8242a2930 msgr2=0x55e8242a2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 --2- 172.21.15.132:0/2153247358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8242a2930 0x55e8242a2d50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x55e82428ef90 tx=0x7fb6d4018830 comp rx=0 tx=0).stop 2024-05-08T18:50:49.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 -- 172.21.15.132:0/2153247358 shutdown_connections 2024-05-08T18:50:49.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 --2- 172.21.15.132:0/2153247358 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb5b403bba0 0x7fb5b403e060 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 --2- 172.21.15.132:0/2153247358 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e8242a2930 0x55e8242a2d50 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 -- 172.21.15.132:0/2153247358 >> 172.21.15.132:0/2153247358 conn(0x55e8242969d0 msgr2=0x55e824296dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 -- 172.21.15.132:0/2153247358 shutdown_connections 2024-05-08T18:50:49.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 -- 172.21.15.132:0/2153247358 wait complete. 2024-05-08T18:50:49.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 -- 172.21.15.132:0/948061564 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e824101e00 msgr2=0x55e82428e6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 --2- 172.21.15.132:0/948061564 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e824101e00 0x55e82428e6b0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 -- 172.21.15.132:0/948061564 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e824290f10 msgr2=0x55e824293300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 --2- 172.21.15.132:0/948061564 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e824290f10 0x55e824293300 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 -- 172.21.15.132:0/948061564 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb5c403bba0 msgr2=0x7fb5c403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.724+0000 7fb6e0725800 1 --2- 172.21.15.132:0/948061564 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb5c403bba0 0x7fb5c403e060 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0054000 tx=0x7fb6d004e000 comp rx=0 tx=0).stop 2024-05-08T18:50:49.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.725+0000 7fb6e0725800 1 -- 172.21.15.132:0/948061564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e824100a70 msgr2=0x55e824287470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.725+0000 7fb6e0725800 1 --2- 172.21.15.132:0/948061564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e824100a70 0x55e824287470 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc001dd0 tx=0x7fb6cc000ed0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.725+0000 7fb6e0725800 1 -- 172.21.15.132:0/948061564 shutdown_connections 2024-05-08T18:50:49.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.725+0000 7fb6e0725800 1 --2- 172.21.15.132:0/948061564 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e824290f10 0x55e824293300 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.725+0000 7fb6e0725800 1 --2- 172.21.15.132:0/948061564 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e824101e00 0x55e82428e6b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.725+0000 7fb6e0725800 1 --2- 172.21.15.132:0/948061564 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb5c403bba0 0x7fb5c403e060 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.725+0000 7fb6e0725800 1 --2- 172.21.15.132:0/948061564 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e824100a70 0x55e824287470 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.725+0000 7fb6e0725800 1 -- 172.21.15.132:0/948061564 >> 172.21.15.132:0/948061564 conn(0x55e824187850 msgr2=0x55e824279a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.725+0000 7fb6e0725800 1 -- 172.21.15.132:0/948061564 shutdown_connections 2024-05-08T18:50:49.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.725+0000 7fb6e0725800 1 -- 172.21.15.132:0/948061564 wait complete. 2024-05-08T18:50:49.735 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-05-08T18:50:49.735 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-05-08T18:50:49.735 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-05-08T18:50:49.779 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:49.779 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:49.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.781+0000 7faa4a010800 1 Processor -- start 2024-05-08T18:50:49.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.781+0000 7faa4a010800 1 -- start start 2024-05-08T18:50:49.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.781+0000 7faa4a010800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55d25d27fdc0 0x55d25d27e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.781+0000 7faa4a010800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d25d27ed10 con 0x55d25d27e860 2024-05-08T18:50:49.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.781+0000 7faa4a010800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55d25d1aae20 con 0x55d25d27fdc0 2024-05-08T18:50:49.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.781+0000 7faa45676640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55d25d27fdc0 0x55d25d27e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.781+0000 7faa45676640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55d25d27fdc0 0x55d25d27e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33324/0 (socket says 172.21.15.132:33324) 2024-05-08T18:50:49.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.781+0000 7faa45676640 1 -- 172.21.15.132:0/997326294 learned_addr learned my addr 172.21.15.132:0/997326294 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.781+0000 7faa3ce75640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55d25d27e860 0x55d25d312160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:47046/0 (socket says 172.21.15.132:47046) 2024-05-08T18:50:49.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.781+0000 7faa45676640 1 -- 172.21.15.132:0/997326294 >> v1:172.21.15.42:6789/0 conn(0x55d25d27e860 legacy=0x55d25d312160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.781+0000 7faa45676640 1 -- 172.21.15.132:0/997326294 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d25d27ef30 con 0x55d25d27fdc0 2024-05-08T18:50:49.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.783+0000 7faa45676640 1 --2- 172.21.15.132:0/997326294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d27fdc0 0x55d25d27e320 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7faa3800a520 tx=0x7faa3801d0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a196853f3bb47426 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.783+0000 7faa44e75640 1 -- 172.21.15.132:0/997326294 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa38057070 con 0x55d25d27fdc0 2024-05-08T18:50:49.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.783+0000 7faa44e75640 1 -- 172.21.15.132:0/997326294 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa38052570 con 0x55d25d27fdc0 2024-05-08T18:50:49.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.784+0000 7faa44e75640 1 -- 172.21.15.132:0/997326294 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa38052870 con 0x55d25d27fdc0 2024-05-08T18:50:49.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.784+0000 7faa4a010800 1 -- 172.21.15.132:0/997326294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d27fdc0 msgr2=0x55d25d27e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.784+0000 7faa4a010800 1 --2- 172.21.15.132:0/997326294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d27fdc0 0x55d25d27e320 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7faa3800a520 tx=0x7faa3801d0a0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.784+0000 7faa4a010800 1 -- 172.21.15.132:0/997326294 shutdown_connections 2024-05-08T18:50:49.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.784+0000 7faa4a010800 1 --2- 172.21.15.132:0/997326294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d27fdc0 0x55d25d27e320 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.784+0000 7faa4a010800 1 -- 172.21.15.132:0/997326294 >> 172.21.15.132:0/997326294 conn(0x55d25d305830 msgr2=0x55d25d307c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.784+0000 7faa4a010800 1 -- 172.21.15.132:0/997326294 shutdown_connections 2024-05-08T18:50:49.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.784+0000 7faa4a010800 1 -- 172.21.15.132:0/997326294 wait complete. 2024-05-08T18:50:49.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.798+0000 7faa4a010800 1 Processor -- start 2024-05-08T18:50:49.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.798+0000 7faa4a010800 1 -- start start 2024-05-08T18:50:49.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.798+0000 7faa4a010800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d27e860 0x55d25d3fd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.798+0000 7faa4a010800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d25d2555b0 con 0x55d25d27e860 2024-05-08T18:50:49.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.799+0000 7faa45676640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d27e860 0x55d25d3fd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.799+0000 7faa45676640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d27e860 0x55d25d3fd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33336/0 (socket says 172.21.15.132:33336) 2024-05-08T18:50:49.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.799+0000 7faa45676640 1 -- 172.21.15.132:0/550386016 learned_addr learned my addr 172.21.15.132:0/550386016 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.799+0000 7faa45676640 1 -- 172.21.15.132:0/550386016 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d25d3fdea0 con 0x55d25d27e860 2024-05-08T18:50:49.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.799+0000 7faa45676640 1 --2- 172.21.15.132:0/550386016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d27e860 0x55d25d3fd8d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7faa3801d0e0 tx=0x7faa3804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206bebd898e5f02 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.799+0000 7fa933606640 1 -- 172.21.15.132:0/550386016 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa38057040 con 0x55d25d27e860 2024-05-08T18:50:49.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.799+0000 7fa933606640 1 -- 172.21.15.132:0/550386016 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa38052850 con 0x55d25d27e860 2024-05-08T18:50:49.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.799+0000 7fa933606640 1 -- 172.21.15.132:0/550386016 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa38052b70 con 0x55d25d27e860 2024-05-08T18:50:49.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.800+0000 7faa4a010800 1 -- 172.21.15.132:0/550386016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d27e860 msgr2=0x55d25d3fd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.800+0000 7faa4a010800 1 --2- 172.21.15.132:0/550386016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d27e860 0x55d25d3fd8d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7faa3801d0e0 tx=0x7faa3804c000 comp rx=0 tx=0).stop 2024-05-08T18:50:49.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.800+0000 7faa4a010800 1 -- 172.21.15.132:0/550386016 shutdown_connections 2024-05-08T18:50:49.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.800+0000 7faa4a010800 1 --2- 172.21.15.132:0/550386016 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d27e860 0x55d25d3fd8d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.800+0000 7faa4a010800 1 -- 172.21.15.132:0/550386016 >> 172.21.15.132:0/550386016 conn(0x55d25d305830 msgr2=0x55d25d3f91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.800+0000 7faa4a010800 1 -- 172.21.15.132:0/550386016 shutdown_connections 2024-05-08T18:50:49.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.800+0000 7faa4a010800 1 -- 172.21.15.132:0/550386016 wait complete. 2024-05-08T18:50:49.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.800+0000 7faa4a010800 1 Processor -- start 2024-05-08T18:50:49.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.801+0000 7faa4a010800 1 -- start start 2024-05-08T18:50:49.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.801+0000 7faa4a010800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d27e860 0x55d25d405290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.801+0000 7faa4a010800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d25d315b30 con 0x55d25d27e860 2024-05-08T18:50:49.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.801+0000 7faa45676640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d27e860 0x55d25d405290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.801+0000 7faa45676640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d27e860 0x55d25d405290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33348/0 (socket says 172.21.15.132:33348) 2024-05-08T18:50:49.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.801+0000 7faa45676640 1 -- 172.21.15.132:0/2423331206 learned_addr learned my addr 172.21.15.132:0/2423331206 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.801+0000 7faa45676640 1 -- 172.21.15.132:0/2423331206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d25d4057d0 con 0x55d25d27e860 2024-05-08T18:50:49.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.801+0000 7faa45676640 1 --2- 172.21.15.132:0/2423331206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d27e860 0x55d25d405290 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7faa3801d0e0 tx=0x7faa38003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.802+0000 7fa931e03640 1 -- 172.21.15.132:0/2423331206 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa38073070 con 0x55d25d27e860 2024-05-08T18:50:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.802+0000 7fa931e03640 1 -- 172.21.15.132:0/2423331206 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa3805d650 con 0x55d25d27e860 2024-05-08T18:50:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.802+0000 7faa4a010800 1 -- 172.21.15.132:0/2423331206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d25d405a60 con 0x55d25d27e860 2024-05-08T18:50:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.802+0000 7fa931e03640 1 -- 172.21.15.132:0/2423331206 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa38057070 con 0x55d25d27e860 2024-05-08T18:50:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.802+0000 7faa4a010800 1 -- 172.21.15.132:0/2423331206 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d25d408710 con 0x55d25d27e860 2024-05-08T18:50:49.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.802+0000 7fa931e03640 1 -- 172.21.15.132:0/2423331206 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7faa38076070 con 0x55d25d27e860 2024-05-08T18:50:49.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.803+0000 7fa931e03640 1 --2- 172.21.15.132:0/2423331206 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa92c03bb50 0x7fa92c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.803+0000 7fa931e03640 1 -- 172.21.15.132:0/2423331206 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7faa380940b0 con 0x55d25d27e860 2024-05-08T18:50:49.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.803+0000 7faa3ce75640 1 --2- 172.21.15.132:0/2423331206 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa92c03bb50 0x7fa92c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.803+0000 7faa4a010800 1 --2- 172.21.15.132:0/2423331206 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d25d27fdc0 0x55d25d40c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.803+0000 7faa4a010800 1 -- 172.21.15.132:0/2423331206 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d25d40caf0 con 0x55d25d27fdc0 2024-05-08T18:50:49.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.803+0000 7faa45e77640 1 --2- 172.21.15.132:0/2423331206 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d25d27fdc0 0x55d25d40c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.803+0000 7faa3ce75640 1 --2- 172.21.15.132:0/2423331206 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa92c03bb50 0x7fa92c03e010 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faa30000f60 tx=0x7faa30001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.803+0000 7faa45e77640 1 --2- 172.21.15.132:0/2423331206 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d25d27fdc0 0x55d25d40c4d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.804+0000 7faa45e77640 1 -- 172.21.15.132:0/2423331206 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa4000a4a0 con 0x55d25d27fdc0 2024-05-08T18:50:49.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.804+0000 7faa4a010800 1 -- 172.21.15.132:0/2423331206 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d25d409aa0 con 0x55d25d27fdc0 2024-05-08T18:50:49.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.804+0000 7faa45e77640 1 -- 172.21.15.132:0/2423331206 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faa4000a4a0 con 0x55d25d27fdc0 2024-05-08T18:50:49.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.804+0000 7faa4a010800 1 --2- 172.21.15.132:0/2423331206 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d25d40ee00 0x55d25d4111f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.804+0000 7faa4a010800 1 -- 172.21.15.132:0/2423331206 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d25d411890 con 0x55d25d40ee00 2024-05-08T18:50:49.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.804+0000 7faa45676640 1 --2- 172.21.15.132:0/2423331206 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d25d40ee00 0x55d25d4111f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.804+0000 7faa45676640 1 --2- 172.21.15.132:0/2423331206 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d25d40ee00 0x55d25d4111f0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.804+0000 7faa45676640 1 -- 172.21.15.132:0/2423331206 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faa38075030 con 0x55d25d40ee00 2024-05-08T18:50:49.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.805+0000 7faa4a010800 1 -- 172.21.15.132:0/2423331206 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d25d40dca0 con 0x55d25d27fdc0 2024-05-08T18:50:49.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.805+0000 7faa45e77640 1 -- 172.21.15.132:0/2423331206 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faa4000a4a0 con 0x55d25d27fdc0 2024-05-08T18:50:49.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.805+0000 7faa4a010800 1 -- 172.21.15.132:0/2423331206 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d25d40e180 con 0x55d25d27fdc0 2024-05-08T18:50:49.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.805+0000 7faa45e77640 1 -- 172.21.15.132:0/2423331206 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faa4000a4a0 con 0x55d25d27fdc0 2024-05-08T18:50:49.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.805+0000 7faa4a010800 1 Processor -- start 2024-05-08T18:50:49.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.805+0000 7faa4a010800 1 -- start start 2024-05-08T18:50:49.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.806+0000 7faa4a010800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d420810 0x55d25d420c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.806+0000 7faa4a010800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d25d1fbfc0 con 0x55d25d420810 2024-05-08T18:50:49.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.806+0000 7faa45e77640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d420810 0x55d25d420c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.806+0000 7faa45e77640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d420810 0x55d25d420c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33358/0 (socket says 172.21.15.132:33358) 2024-05-08T18:50:49.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.806+0000 7faa45e77640 1 -- 172.21.15.132:0/2970506537 learned_addr learned my addr 172.21.15.132:0/2970506537 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.806+0000 7faa45e77640 1 -- 172.21.15.132:0/2970506537 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d25d421170 con 0x55d25d420810 2024-05-08T18:50:49.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.806+0000 7faa45e77640 1 --2- 172.21.15.132:0/2970506537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d420810 0x55d25d420c30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x55d25d406160 tx=0x7faa400188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.807+0000 7fa92affd640 1 -- 172.21.15.132:0/2970506537 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa40014450 con 0x55d25d420810 2024-05-08T18:50:49.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.807+0000 7fa92affd640 1 -- 172.21.15.132:0/2970506537 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa400145f0 con 0x55d25d420810 2024-05-08T18:50:49.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.807+0000 7faa4a010800 1 -- 172.21.15.132:0/2970506537 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d25d421be0 con 0x55d25d420810 2024-05-08T18:50:49.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.807+0000 7fa92affd640 1 -- 172.21.15.132:0/2970506537 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa400148d0 con 0x55d25d420810 2024-05-08T18:50:49.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.807+0000 7faa4a010800 1 -- 172.21.15.132:0/2970506537 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d25d4220e0 con 0x55d25d420810 2024-05-08T18:50:49.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.807+0000 7fa92affd640 1 -- 172.21.15.132:0/2970506537 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7faa40011040 con 0x55d25d420810 2024-05-08T18:50:49.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.808+0000 7fa92affd640 1 --2- 172.21.15.132:0/2970506537 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa91c03bba0 0x7fa91c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.808+0000 7fa92affd640 1 -- 172.21.15.132:0/2970506537 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7faa4001e070 con 0x55d25d420810 2024-05-08T18:50:49.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.808+0000 7faa45676640 1 --2- 172.21.15.132:0/2970506537 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa91c03bba0 0x7fa91c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.808+0000 7faa4a010800 1 Processor -- start 2024-05-08T18:50:49.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.808+0000 7faa45676640 1 --2- 172.21.15.132:0/2970506537 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa91c03bba0 0x7fa91c03e060 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55d25d40cf20 tx=0x7faa38006a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.808+0000 7faa4a010800 1 -- start start 2024-05-08T18:50:49.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.808+0000 7faa4a010800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d42daa0 0x55d25d42dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.808+0000 7faa4a010800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d25d3fe160 con 0x55d25d42daa0 2024-05-08T18:50:49.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.808+0000 7faa45e77640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d42daa0 0x55d25d42dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.808+0000 7faa45e77640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d42daa0 0x55d25d42dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33368/0 (socket says 172.21.15.132:33368) 2024-05-08T18:50:49.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.808+0000 7faa45e77640 1 -- 172.21.15.132:0/3566280673 learned_addr learned my addr 172.21.15.132:0/3566280673 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.809+0000 7faa45e77640 1 -- 172.21.15.132:0/3566280673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d25d42e490 con 0x55d25d42daa0 2024-05-08T18:50:49.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.809+0000 7faa45e77640 1 --2- 172.21.15.132:0/3566280673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d42daa0 0x55d25d42dec0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7faa40052c50 tx=0x7faa400118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f6b8a8e5d0e684 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.809+0000 7fa928ff9640 1 -- 172.21.15.132:0/3566280673 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa40044020 con 0x55d25d42daa0 2024-05-08T18:50:49.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.809+0000 7fa928ff9640 1 -- 172.21.15.132:0/3566280673 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa40011c00 con 0x55d25d42daa0 2024-05-08T18:50:49.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.809+0000 7fa928ff9640 1 -- 172.21.15.132:0/3566280673 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa40014a70 con 0x55d25d42daa0 2024-05-08T18:50:49.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.809+0000 7faa4a010800 1 -- 172.21.15.132:0/3566280673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d42daa0 msgr2=0x55d25d42dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.809+0000 7faa4a010800 1 --2- 172.21.15.132:0/3566280673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d42daa0 0x55d25d42dec0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7faa40052c50 tx=0x7faa400118e0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.809+0000 7faa4a010800 1 -- 172.21.15.132:0/3566280673 shutdown_connections 2024-05-08T18:50:49.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.809+0000 7faa4a010800 1 --2- 172.21.15.132:0/3566280673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d42daa0 0x55d25d42dec0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.809+0000 7faa4a010800 1 -- 172.21.15.132:0/3566280673 >> 172.21.15.132:0/3566280673 conn(0x55d25d429e50 msgr2=0x55d25d427eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.809+0000 7faa4a010800 1 -- 172.21.15.132:0/3566280673 shutdown_connections 2024-05-08T18:50:49.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.809+0000 7faa4a010800 1 -- 172.21.15.132:0/3566280673 wait complete. 2024-05-08T18:50:49.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.810+0000 7faa4a010800 1 Processor -- start 2024-05-08T18:50:49.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.810+0000 7faa4a010800 1 -- start start 2024-05-08T18:50:49.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.810+0000 7faa4a010800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d42daa0 0x55d25d434fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.810+0000 7faa4a010800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d25d42ebf0 con 0x55d25d42daa0 2024-05-08T18:50:49.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.810+0000 7faa45e77640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d42daa0 0x55d25d434fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.810+0000 7faa45e77640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d42daa0 0x55d25d434fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33376/0 (socket says 172.21.15.132:33376) 2024-05-08T18:50:49.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.810+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 learned_addr learned my addr 172.21.15.132:0/4112951648 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.810+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d25d435510 con 0x55d25d42daa0 2024-05-08T18:50:49.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.811+0000 7faa45e77640 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d42daa0 0x55d25d434fd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7faa40013010 tx=0x7faa40052bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.811+0000 7fa91affd640 1 -- 172.21.15.132:0/4112951648 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa400409b0 con 0x55d25d42daa0 2024-05-08T18:50:49.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.811+0000 7fa91affd640 1 -- 172.21.15.132:0/4112951648 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa40040b50 con 0x55d25d42daa0 2024-05-08T18:50:49.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.811+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d25d4357a0 con 0x55d25d42daa0 2024-05-08T18:50:49.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.811+0000 7fa91affd640 1 -- 172.21.15.132:0/4112951648 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa40051070 con 0x55d25d42daa0 2024-05-08T18:50:49.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.811+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d25d438450 con 0x55d25d42daa0 2024-05-08T18:50:49.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.811+0000 7fa91affd640 1 -- 172.21.15.132:0/4112951648 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7faa4004e040 con 0x55d25d42daa0 2024-05-08T18:50:49.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.812+0000 7fa91affd640 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa91003bba0 0x7fa91003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.812+0000 7fa91affd640 1 -- 172.21.15.132:0/4112951648 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7faa4000e040 con 0x55d25d42daa0 2024-05-08T18:50:49.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.812+0000 7faa45676640 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa91003bba0 0x7fa91003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.812+0000 7faa45676640 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa91003bba0 0x7fa91003e060 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faa3805cc00 tx=0x7faa38085000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.812+0000 7faa4a010800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.812+0000 7faa4a010800 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d25d440cc0 0x55d25d443180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.812+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d25d4438d0 con 0x55d25d440cc0 2024-05-08T18:50:49.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.813+0000 7faa3ce75640 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d25d440cc0 0x55d25d443180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.813+0000 7faa3ce75640 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d25d440cc0 0x55d25d443180 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.813+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa3000f610 con 0x55d25d440cc0 2024-05-08T18:50:49.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.813+0000 7faa4a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.813+0000 7faa4a010800 20 realm 2024-05-08T18:50:49.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.813+0000 7faa4a010800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.813+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d25d440110 con 0x55d25d440cc0 2024-05-08T18:50:49.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.813+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa3000f610 con 0x55d25d440cc0 2024-05-08T18:50:49.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.813+0000 7faa4a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.813+0000 7faa4a010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:49.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.813+0000 7faa4a010800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.813+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d25d4443c0 con 0x55d25d440cc0 2024-05-08T18:50:49.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.814+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa3000f610 con 0x55d25d440cc0 2024-05-08T18:50:49.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.814+0000 7faa4a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.814+0000 7faa4a010800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.814+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d25d444c90 con 0x55d25d440cc0 2024-05-08T18:50:49.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.814+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faa3000f610 con 0x55d25d440cc0 2024-05-08T18:50:49.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.814+0000 7faa4a010800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:49.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.814+0000 7faa4a010800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.814+0000 7faa4a010800 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d25d4456b0 0x55d25d447aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.814+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d25d448190 con 0x55d25d4456b0 2024-05-08T18:50:49.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.814+0000 7faa45e77640 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d25d4456b0 0x55d25d447aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.814+0000 7faa45e77640 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d25d4456b0 0x55d25d447aa0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.814+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.815+0000 7faa4a010800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:49.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.815+0000 7faa4a010800 20 searching for the correct realm 2024-05-08T18:50:49.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.815+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x55d25d4456b0 2024-05-08T18:50:49.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.815+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.815+0000 7faa45e77640 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7faa40014070 0x7faa40023860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.815+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x7faa40014070 2024-05-08T18:50:49.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.815+0000 7faa45676640 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7faa40014070 0x7faa40023860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.815+0000 7faa45676640 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7faa40014070 0x7faa40023860 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.816+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa38075030 con 0x7faa40014070 2024-05-08T18:50:49.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.816+0000 7faa45676640 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7faa38078060 0x7faa3805b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.816+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x7faa38078060 2024-05-08T18:50:49.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.816+0000 7faa3ce75640 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7faa38078060 0x7faa3805b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.816+0000 7faa3ce75640 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7faa38078060 0x7faa3805b550 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.817+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3000f610 con 0x7faa38078060 2024-05-08T18:50:49.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.817+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x55d25d440cc0 2024-05-08T18:50:49.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.817+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3000f610 con 0x55d25d440cc0 2024-05-08T18:50:49.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.817+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x55d25d440cc0 2024-05-08T18:50:49.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.817+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3002b040 con 0x55d25d440cc0 2024-05-08T18:50:49.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.817+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x7faa38078060 2024-05-08T18:50:49.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.817+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3002b040 con 0x7faa38078060 2024-05-08T18:50:49.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.817+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x7faa38078060 2024-05-08T18:50:49.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.818+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3002b040 con 0x7faa38078060 2024-05-08T18:50:49.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.818+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x7faa40014070 2024-05-08T18:50:49.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.818+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa38075030 con 0x7faa40014070 2024-05-08T18:50:49.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.818+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x55d25d4456b0 2024-05-08T18:50:49.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.818+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.818+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x55d25d440cc0 2024-05-08T18:50:49.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.818+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3002b040 con 0x55d25d440cc0 2024-05-08T18:50:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.818+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x7faa38078060 2024-05-08T18:50:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.819+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3002b040 con 0x7faa38078060 2024-05-08T18:50:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.819+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x55d25d440cc0 2024-05-08T18:50:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.819+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7faa3002b040 con 0x55d25d440cc0 2024-05-08T18:50:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.819+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x7faa40014070 2024-05-08T18:50:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.819+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faa38075030 con 0x7faa40014070 2024-05-08T18:50:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.819+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x55d25d4456b0 2024-05-08T18:50:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.819+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.819+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x55d25d4456b0 2024-05-08T18:50:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.820+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.820+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x7faa38078060 2024-05-08T18:50:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.820+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3002b040 con 0x7faa38078060 2024-05-08T18:50:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.820+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x55d25d4456b0 2024-05-08T18:50:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.820+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.820+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x55d25d4456b0 2024-05-08T18:50:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.820+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.820+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x55d25d440cc0 2024-05-08T18:50:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.821+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3002b040 con 0x55d25d440cc0 2024-05-08T18:50:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.821+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x55d25d440cc0 2024-05-08T18:50:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.821+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faa3002b040 con 0x55d25d440cc0 2024-05-08T18:50:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.821+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x7faa38078060 2024-05-08T18:50:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.821+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3002b040 con 0x7faa38078060 2024-05-08T18:50:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.821+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x55d25d4456b0 2024-05-08T18:50:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.821+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.821+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x7faa40014070 2024-05-08T18:50:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.822+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa38075030 con 0x7faa40014070 2024-05-08T18:50:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.822+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x55d25d440cc0 2024-05-08T18:50:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.822+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3002b040 con 0x55d25d440cc0 2024-05-08T18:50:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.822+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x7faa38078060 2024-05-08T18:50:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.822+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.822+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x55d25d4456b0 2024-05-08T18:50:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.822+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.822+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x7faa38078060 2024-05-08T18:50:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.823+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.823+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x7faa40014070 2024-05-08T18:50:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.823+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa38075030 con 0x7faa40014070 2024-05-08T18:50:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.823+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x55d25d4456b0 2024-05-08T18:50:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.823+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.823+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x7faa38078060 2024-05-08T18:50:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.824+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.824+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x55d25d440cc0 2024-05-08T18:50:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.824+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faa3003b040 con 0x55d25d440cc0 2024-05-08T18:50:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.824+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449ae0 con 0x7faa40014070 2024-05-08T18:50:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.824+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faa38075030 con 0x7faa40014070 2024-05-08T18:50:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.824+0000 7faa4a010800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.824+0000 7faa4a010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.824+0000 7faa4a010800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.824+0000 7faa4a010800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.824+0000 7faa4a010800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.824+0000 7faa4a010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.824+0000 7faa4a010800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.824+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d25d448b50 con 0x55d25d440cc0 2024-05-08T18:50:49.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.824+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x55d25d440cc0 2024-05-08T18:50:49.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.824+0000 7faa4a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.824+0000 7faa4a010800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.824+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d25d4493f0 con 0x55d25d440cc0 2024-05-08T18:50:49.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.824+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faa3003b040 con 0x55d25d440cc0 2024-05-08T18:50:49.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.824+0000 7faa4a010800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:49.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.825+0000 7faa4a010800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.825+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449f60 con 0x55d25d440cc0 2024-05-08T18:50:49.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.825+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faa3003b040 con 0x55d25d440cc0 2024-05-08T18:50:49.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.825+0000 7faa4a010800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:49.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.825+0000 7faa4a010800 20 zone default found 2024-05-08T18:50:49.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.825+0000 7faa4a010800 4 Realm: () 2024-05-08T18:50:49.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.825+0000 7faa4a010800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:49.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.825+0000 7faa4a010800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:49.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.825+0000 7faa4a010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:49.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.825+0000 7faa4a010800 20 zonegroup default 2024-05-08T18:50:49.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.825+0000 7faa4a010800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.825+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d25d449f60 con 0x7faa38078060 2024-05-08T18:50:49.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.825+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.825+0000 7faa4a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.825+0000 7faa4a010800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.825+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d25d44bd50 con 0x55d25d4456b0 2024-05-08T18:50:49.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.825+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.825+0000 7faa4a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.825+0000 7faa4a010800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.825+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d25d44c160 con 0x55d25d4456b0 2024-05-08T18:50:49.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.826+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.826+0000 7faa4a010800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.826+0000 7faa4a010800 20 started sync module instance, tier type = 2024-05-08T18:50:49.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.826+0000 7faa4a010800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:49.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.826+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d44b1f0 con 0x7faa40014070 2024-05-08T18:50:49.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.826+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa38075030 con 0x7faa40014070 2024-05-08T18:50:49.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.827+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94361996277216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d44ca70 con 0x7faa40014070 2024-05-08T18:50:49.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.827+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d44d2c0 con 0x55d25d440cc0 2024-05-08T18:50:49.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.827+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94361996277216] v25'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa38075030 con 0x7faa40014070 2024-05-08T18:50:49.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.828+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x55d25d440cc0 2024-05-08T18:50:49.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.828+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94361996281280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d44d2c0 con 0x55d25d440cc0 2024-05-08T18:50:49.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.828+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d44dde0 con 0x55d25d4456b0 2024-05-08T18:50:49.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.829+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.829+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94361996286128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d44dde0 con 0x55d25d4456b0 2024-05-08T18:50:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.829+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d44edd0 con 0x7faa40014070 2024-05-08T18:50:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.829+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94361996281280] v25'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x55d25d440cc0 2024-05-08T18:50:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.830+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94361996286128] v25'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.830+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa38075030 con 0x7faa40014070 2024-05-08T18:50:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.830+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94361996288464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d44ce10 con 0x7faa40014070 2024-05-08T18:50:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.830+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d44f7e0 con 0x55d25d440cc0 2024-05-08T18:50:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.831+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x55d25d440cc0 2024-05-08T18:50:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.831+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94361996293184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d44fed0 con 0x55d25d440cc0 2024-05-08T18:50:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.831+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d4509f0 con 0x7faa38078060 2024-05-08T18:50:49.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.831+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94361996288464] v25'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa38075030 con 0x7faa40014070 2024-05-08T18:50:49.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.832+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94361996293184] v25'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x55d25d440cc0 2024-05-08T18:50:49.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.832+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.832+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94361996297408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d4509b0 con 0x7faa38078060 2024-05-08T18:50:49.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.832+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d451290 con 0x7faa38078060 2024-05-08T18:50:49.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.833+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94361996297408] v25'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.833+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.833+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94361996290208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d4509b0 con 0x7faa38078060 2024-05-08T18:50:49.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.833+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d4518b0 con 0x7faa38078060 2024-05-08T18:50:49.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.835+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94361996290208] v25'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.835+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.835+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94361996299664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d4518b0 con 0x7faa38078060 2024-05-08T18:50:49.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.835+0000 7faa4a010800 20 add_watcher() i=0 2024-05-08T18:50:49.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.835+0000 7faa4a010800 20 add_watcher() i=1 2024-05-08T18:50:49.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.835+0000 7faa4a010800 20 add_watcher() i=2 2024-05-08T18:50:49.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.835+0000 7faa4a010800 20 add_watcher() i=3 2024-05-08T18:50:49.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.835+0000 7faa4a010800 20 add_watcher() i=4 2024-05-08T18:50:49.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.835+0000 7faa4a010800 20 add_watcher() i=5 2024-05-08T18:50:49.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.835+0000 7faa4a010800 20 add_watcher() i=6 2024-05-08T18:50:49.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.836+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94361996299664] v25'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.836+0000 7faa4a010800 20 add_watcher() i=7 2024-05-08T18:50:49.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.836+0000 7faa4a010800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:49.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.836+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d25d454bf0 con 0x55d25d440cc0 2024-05-08T18:50:49.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.836+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faa3003b040 con 0x55d25d440cc0 2024-05-08T18:50:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.836+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94361996314128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d451a20 con 0x55d25d440cc0 2024-05-08T18:50:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.837+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94361996314128] v25'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x55d25d440cc0 2024-05-08T18:50:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.837+0000 7fa8fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.837+0000 7faa4a010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.837+0000 7faa4a010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.837+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d453eb0 con 0x55d25d440cc0 2024-05-08T18:50:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.838+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v25'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x55d25d440cc0 2024-05-08T18:50:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.838+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45dcb0 con 0x7faa38078060 2024-05-08T18:50:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.839+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v25'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.839+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45dcb0 con 0x55d25d4456b0 2024-05-08T18:50:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.840+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v25'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.840+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45e160 con 0x55d25d440cc0 2024-05-08T18:50:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.841+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v25'122 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x55d25d440cc0 2024-05-08T18:50:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.841+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45e160 con 0x7faa40014070 2024-05-08T18:50:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.842+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v25'35 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa38075030 con 0x7faa40014070 2024-05-08T18:50:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.842+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45ebc0 con 0x55d25d4456b0 2024-05-08T18:50:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.843+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v25'24 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.843+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45ebc0 con 0x55d25d440cc0 2024-05-08T18:50:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.844+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v25'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x55d25d440cc0 2024-05-08T18:50:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.844+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45ebc0 con 0x7faa38078060 2024-05-08T18:50:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.845+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v25'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.846+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45ebc0 con 0x7faa40014070 2024-05-08T18:50:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.846+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v25'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa38075030 con 0x7faa40014070 2024-05-08T18:50:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.846+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45ec50 con 0x55d25d4456b0 2024-05-08T18:50:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.847+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v25'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.847+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45f100 con 0x7faa40014070 2024-05-08T18:50:49.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.848+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v25'36 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa38075030 con 0x7faa40014070 2024-05-08T18:50:49.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.848+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45f100 con 0x7faa38078060 2024-05-08T18:50:49.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.849+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v25'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.849+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45f100 con 0x7faa40014070 2024-05-08T18:50:49.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.850+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v25'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa38075030 con 0x7faa40014070 2024-05-08T18:50:49.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.850+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45edb0 con 0x7faa38078060 2024-05-08T18:50:49.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.852+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v25'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.852+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45edb0 con 0x55d25d440cc0 2024-05-08T18:50:49.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.853+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v25'123 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x55d25d440cc0 2024-05-08T18:50:49.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.853+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45edb0 con 0x55d25d4456b0 2024-05-08T18:50:49.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.854+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v25'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.854+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45edb0 con 0x7faa40014070 2024-05-08T18:50:49.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.855+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v25'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa38075030 con 0x7faa40014070 2024-05-08T18:50:49.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.855+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45edb0 con 0x55d25d4456b0 2024-05-08T18:50:49.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.856+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v25'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.856+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45edb0 con 0x55d25d440cc0 2024-05-08T18:50:49.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.857+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v25'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x55d25d440cc0 2024-05-08T18:50:49.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.857+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45edb0 con 0x55d25d440cc0 2024-05-08T18:50:49.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.858+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v25'124 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x55d25d440cc0 2024-05-08T18:50:49.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.858+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45edb0 con 0x55d25d4456b0 2024-05-08T18:50:49.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.859+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v25'30 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.859+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45edb0 con 0x7faa40014070 2024-05-08T18:50:49.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.860+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v25'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa38075030 con 0x7faa40014070 2024-05-08T18:50:49.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.860+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45edb0 con 0x55d25d4456b0 2024-05-08T18:50:49.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.861+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v25'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.861+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45edb0 con 0x55d25d4456b0 2024-05-08T18:50:49.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.862+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v25'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.862+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45edb0 con 0x55d25d4456b0 2024-05-08T18:50:49.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.862+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v25'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.863+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45edb0 con 0x55d25d4456b0 2024-05-08T18:50:49.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.863+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v25'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.863+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45edb0 con 0x7faa38078060 2024-05-08T18:50:49.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.864+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v25'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.864+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45edb0 con 0x55d25d4456b0 2024-05-08T18:50:49.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.865+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v25'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.865+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45edb0 con 0x7faa38078060 2024-05-08T18:50:49.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.867+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v25'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.867+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45edb0 con 0x55d25d4456b0 2024-05-08T18:50:49.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.868+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v25'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.868+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45edb0 con 0x7faa38078060 2024-05-08T18:50:49.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.869+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v25'30 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.869+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d45edb0 con 0x7faa40014070 2024-05-08T18:50:49.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.870+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v25'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faa38075030 con 0x7faa40014070 2024-05-08T18:50:49.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.870+0000 7fa8fa7e4640 20 reqs_thread_entry: start 2024-05-08T18:50:49.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.870+0000 7faa4a010800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:49.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.870+0000 7faa4a010800 20 Filter name: none 2024-05-08T18:50:49.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.870+0000 7fa86bfff640 20 reqs_thread_entry: start 2024-05-08T18:50:49.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.871+0000 7faa4a010800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:50:49.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.871+0000 7faa4a010800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.871+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d25d489ec0 con 0x7faa38078060 2024-05-08T18:50:49.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.871+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.871+0000 7faa4a010800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:50:49.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.871+0000 7faa4a010800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-08T18:50:49.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.871+0000 7faa4a010800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:50:49.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.871+0000 7faa4a010800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:49.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.871+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d25d48c7b0 con 0x7faa38078060 2024-05-08T18:50:49.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.871+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.871+0000 7faa4a010800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-05-08T18:50:49.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.871+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d48a790 con 0x7faa38078060 2024-05-08T18:50:49.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.872+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v25'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.872+0000 7faa4a010800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:50:49.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.872+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94361996538400 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d25d48cdc0 con 0x55d25d4456b0 2024-05-08T18:50:49.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.872+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== watch-notify(notify (1) cookie 94361996286128 notify 107374182403 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55d25d454040 con 0x55d25d4456b0 2024-05-08T18:50:49.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.872+0000 7fa928ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182403 cookie 94361996286128 notifier 4522 bl.length()=170 2024-05-08T18:50:49.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.872+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 28 ==== osd_op_reply(97 notify.2 [notify cookie 94361996538400 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.872+0000 7fa928ff9640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7fa908003d60 con 0x55d25d4456b0 2024-05-08T18:50:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.873+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.873+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 30 ==== watch-notify(notify_complete (2) cookie 94361996538400 notify 107374182403 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d25d4357a0 con 0x55d25d4456b0 2024-05-08T18:50:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.873+0000 7faa4a010800 10 removing email index: 2024-05-08T18:50:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.873+0000 7faa4a010800 10 removing user buckets index 2024-05-08T18:50:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.873+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d48cd40 con 0x7faa38078060 2024-05-08T18:50:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.874+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== osd_op_reply(99 fud.buckets [delete] v25'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.874+0000 7faa4a010800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-05-08T18:50:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.874+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94361996545344 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d25d48c200 con 0x7faa38078060 2024-05-08T18:50:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.874+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 28 ==== watch-notify(notify (1) cookie 94361996290208 notify 107374182406 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55d25d453930 con 0x7faa38078060 2024-05-08T18:50:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.874+0000 7fa91bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182406 cookie 94361996290208 notifier 4522 bl.length()=160 2024-05-08T18:50:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.874+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 29 ==== osd_op_reply(100 notify.6 [notify cookie 94361996545344 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.874+0000 7fa91bfff640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7fa8780032c0 con 0x7faa38078060 2024-05-08T18:50:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.874+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 30 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.874+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 31 ==== watch-notify(notify_complete (2) cookie 94361996545344 notify 107374182406 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d25d453e70 con 0x7faa38078060 2024-05-08T18:50:49.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.874+0000 7faa4a010800 10 removing user index: fud 2024-05-08T18:50:49.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.874+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d48cd40 con 0x7faa38078060 2024-05-08T18:50:49.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.875+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 32 ==== osd_op_reply(102 fud [call,call,delete] v25'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.875+0000 7faa4a010800 10 removing default.rgw.meta+users.uid+fud from cache 2024-05-08T18:50:49.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.875+0000 7faa4a010800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-08T18:50:49.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.875+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94361996545344 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d25d48b1f0 con 0x7faa38078060 2024-05-08T18:50:49.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.876+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 33 ==== watch-notify(notify (1) cookie 94361996297408 notify 107374182407 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55d25d453e70 con 0x7faa38078060 2024-05-08T18:50:49.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.876+0000 7fa928ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182407 cookie 94361996297408 notifier 4522 bl.length()=152 2024-05-08T18:50:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.876+0000 7fa928ff9640 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7fa908003d60 con 0x7faa38078060 2024-05-08T18:50:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.876+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 34 ==== osd_op_reply(103 notify.5 [notify cookie 94361996545344 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.876+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 35 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.876+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 36 ==== watch-notify(notify_complete (2) cookie 94361996545344 notify 107374182407 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d25d454250 con 0x7faa38078060 2024-05-08T18:50:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.877+0000 7fa8fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.877+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94361996314128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d48cd40 con 0x55d25d440cc0 2024-05-08T18:50:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.878+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94361996314128] v25'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x55d25d440cc0 2024-05-08T18:50:49.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.878+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94361996277216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d48cd40 con 0x7faa40014070 2024-05-08T18:50:49.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.879+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94361996277216] v25'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa38075030 con 0x7faa40014070 2024-05-08T18:50:49.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.879+0000 7faa4a010800 20 remove_watcher() i=0 2024-05-08T18:50:49.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.879+0000 7faa4a010800 2 removed watcher, disabling cache 2024-05-08T18:50:49.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.879+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94361996281280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d48cd40 con 0x55d25d440cc0 2024-05-08T18:50:49.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.880+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94361996281280] v25'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x55d25d440cc0 2024-05-08T18:50:49.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.880+0000 7faa4a010800 20 remove_watcher() i=1 2024-05-08T18:50:49.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.880+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94361996286128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d44c5c0 con 0x55d25d4456b0 2024-05-08T18:50:49.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.881+0000 7faa45e77640 1 -- 172.21.15.132:0/4112951648 <== osd.3 v2:172.21.15.132:6816/17827703 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94361996286128] v25'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa4003e070 con 0x55d25d4456b0 2024-05-08T18:50:49.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.881+0000 7faa4a010800 20 remove_watcher() i=2 2024-05-08T18:50:49.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.881+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94361996288464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d44c5c0 con 0x7faa40014070 2024-05-08T18:50:49.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.882+0000 7faa45676640 1 -- 172.21.15.132:0/4112951648 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94361996288464] v25'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa38075030 con 0x7faa40014070 2024-05-08T18:50:49.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.882+0000 7faa4a010800 20 remove_watcher() i=3 2024-05-08T18:50:49.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.882+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94361996293184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d44e1d0 con 0x55d25d440cc0 2024-05-08T18:50:49.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.882+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94361996293184] v25'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x55d25d440cc0 2024-05-08T18:50:49.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.883+0000 7faa4a010800 20 remove_watcher() i=4 2024-05-08T18:50:49.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.883+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94361996297408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d44c5c0 con 0x7faa38078060 2024-05-08T18:50:49.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.884+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94361996297408] v25'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.884+0000 7faa4a010800 20 remove_watcher() i=5 2024-05-08T18:50:49.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.884+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94361996290208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d44f440 con 0x7faa38078060 2024-05-08T18:50:49.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.884+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94361996290208] v25'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.884+0000 7faa4a010800 20 remove_watcher() i=6 2024-05-08T18:50:49.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.884+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94361996299664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d25d44c5c0 con 0x7faa38078060 2024-05-08T18:50:49.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.885+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 <== osd.0 v2:172.21.15.42:6800/1521799280 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94361996299664] v25'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faa3003b040 con 0x7faa38078060 2024-05-08T18:50:49.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.885+0000 7faa4a010800 20 remove_watcher() i=7 2024-05-08T18:50:49.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7faa38078060 msgr2=0x7faa3805b550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7faa38078060 0x7faa3805b550 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d25d440cc0 msgr2=0x55d25d443180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d25d440cc0 0x55d25d443180 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7faa40014070 msgr2=0x7faa40023860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7faa40014070 0x7faa40023860 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d25d4456b0 msgr2=0x55d25d447aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d25d4456b0 0x55d25d447aa0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa91003bba0 msgr2=0x7fa91003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa91003bba0 0x7fa91003e060 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faa3805cc00 tx=0x7faa38085000 comp rx=0 tx=0).stop 2024-05-08T18:50:49.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d42daa0 msgr2=0x55d25d434fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa3ce75640 1 -- 172.21.15.132:0/4112951648 reap_dead start 2024-05-08T18:50:49.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d42daa0 0x55d25d434fd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7faa40013010 tx=0x7faa40052bb0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 shutdown_connections 2024-05-08T18:50:49.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 --2- 172.21.15.132:0/4112951648 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d42daa0 0x55d25d434fd0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 >> 172.21.15.132:0/4112951648 conn(0x55d25d429e50 msgr2=0x55d25d42f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 shutdown_connections 2024-05-08T18:50:49.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 -- 172.21.15.132:0/4112951648 wait complete. 2024-05-08T18:50:49.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 -- 172.21.15.132:0/2970506537 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa91c03bba0 msgr2=0x7fa91c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 --2- 172.21.15.132:0/2970506537 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa91c03bba0 0x7fa91c03e060 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55d25d40cf20 tx=0x7faa38006a30 comp rx=0 tx=0).stop 2024-05-08T18:50:49.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 -- 172.21.15.132:0/2970506537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d420810 msgr2=0x55d25d420c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 --2- 172.21.15.132:0/2970506537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d420810 0x55d25d420c30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x55d25d406160 tx=0x7faa400188f0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 -- 172.21.15.132:0/2970506537 shutdown_connections 2024-05-08T18:50:49.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 --2- 172.21.15.132:0/2970506537 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa91c03bba0 0x7fa91c03e060 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 --2- 172.21.15.132:0/2970506537 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d420810 0x55d25d420c30 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 -- 172.21.15.132:0/2970506537 >> 172.21.15.132:0/2970506537 conn(0x55d25d4148b0 msgr2=0x55d25d414cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 -- 172.21.15.132:0/2970506537 shutdown_connections 2024-05-08T18:50:49.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.886+0000 7faa4a010800 1 -- 172.21.15.132:0/2970506537 wait complete. 2024-05-08T18:50:49.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.887+0000 7faa4a010800 1 -- 172.21.15.132:0/2423331206 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d25d27fdc0 msgr2=0x55d25d40c4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.887+0000 7faa4a010800 1 --2- 172.21.15.132:0/2423331206 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d25d27fdc0 0x55d25d40c4d0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.887+0000 7faa4a010800 1 -- 172.21.15.132:0/2423331206 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d25d40ee00 msgr2=0x55d25d4111f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.887+0000 7faa4a010800 1 --2- 172.21.15.132:0/2423331206 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d25d40ee00 0x55d25d4111f0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.887+0000 7faa4a010800 1 -- 172.21.15.132:0/2423331206 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa92c03bb50 msgr2=0x7fa92c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.887+0000 7faa4a010800 1 --2- 172.21.15.132:0/2423331206 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa92c03bb50 0x7fa92c03e010 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faa30000f60 tx=0x7faa30001370 comp rx=0 tx=0).stop 2024-05-08T18:50:49.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.887+0000 7faa4a010800 1 -- 172.21.15.132:0/2423331206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d27e860 msgr2=0x55d25d405290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.887+0000 7faa4a010800 1 --2- 172.21.15.132:0/2423331206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d27e860 0x55d25d405290 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7faa3801d0e0 tx=0x7faa38003020 comp rx=0 tx=0).stop 2024-05-08T18:50:49.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.887+0000 7faa4a010800 1 -- 172.21.15.132:0/2423331206 shutdown_connections 2024-05-08T18:50:49.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.887+0000 7faa4a010800 1 --2- 172.21.15.132:0/2423331206 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d25d40ee00 0x55d25d4111f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.887+0000 7faa4a010800 1 --2- 172.21.15.132:0/2423331206 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d25d27fdc0 0x55d25d40c4d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.887+0000 7faa4a010800 1 --2- 172.21.15.132:0/2423331206 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa92c03bb50 0x7fa92c03e010 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.887+0000 7faa4a010800 1 --2- 172.21.15.132:0/2423331206 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d25d27e860 0x55d25d405290 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.887+0000 7faa4a010800 1 -- 172.21.15.132:0/2423331206 >> 172.21.15.132:0/2423331206 conn(0x55d25d305830 msgr2=0x55d25d3f79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.887+0000 7faa4a010800 1 -- 172.21.15.132:0/2423331206 shutdown_connections 2024-05-08T18:50:49.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.887+0000 7faa4a010800 1 -- 172.21.15.132:0/2423331206 wait complete. 2024-05-08T18:50:49.895 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-08T18:50:49.895 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-08T18:50:49.895 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-05-08T18:50:49.949 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:49.950 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:49.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.951+0000 7fad8b212800 1 Processor -- start 2024-05-08T18:50:49.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.951+0000 7fad8b212800 1 -- start start 2024-05-08T18:50:49.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.951+0000 7fad8b212800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x562bec413e00 0x562bec412360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.951+0000 7fad8b212800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562bec412d50 con 0x562bec4128a0 2024-05-08T18:50:49.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.951+0000 7fad8b212800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x562bec33ee20 con 0x562bec413e00 2024-05-08T18:50:49.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.952+0000 7fad86876640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x562bec413e00 0x562bec412360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.952+0000 7fad86876640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x562bec413e00 0x562bec412360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33382/0 (socket says 172.21.15.132:33382) 2024-05-08T18:50:49.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.952+0000 7fad7ffff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x562bec4128a0 0x562bec4a61a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:47060/0 (socket says 172.21.15.132:47060) 2024-05-08T18:50:49.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.952+0000 7fad86876640 1 -- 172.21.15.132:0/14654841 learned_addr learned my addr 172.21.15.132:0/14654841 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.952+0000 7fad86876640 1 -- 172.21.15.132:0/14654841 >> v1:172.21.15.42:6789/0 conn(0x562bec4128a0 legacy=0x562bec4a61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.952+0000 7fad86876640 1 -- 172.21.15.132:0/14654841 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bec412f70 con 0x562bec413e00 2024-05-08T18:50:49.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.954+0000 7fad86876640 1 --2- 172.21.15.132:0/14654841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec413e00 0x562bec412360 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fad7800a520 tx=0x7fad7801d0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64005466134a464e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.954+0000 7fad86075640 1 -- 172.21.15.132:0/14654841 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad78057070 con 0x562bec413e00 2024-05-08T18:50:49.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.954+0000 7fad86075640 1 -- 172.21.15.132:0/14654841 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad78052570 con 0x562bec413e00 2024-05-08T18:50:49.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.954+0000 7fad86075640 1 -- 172.21.15.132:0/14654841 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad78052870 con 0x562bec413e00 2024-05-08T18:50:49.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.955+0000 7fad8b212800 1 -- 172.21.15.132:0/14654841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec413e00 msgr2=0x562bec412360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.955+0000 7fad8b212800 1 --2- 172.21.15.132:0/14654841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec413e00 0x562bec412360 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fad7800a520 tx=0x7fad7801d0a0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.955+0000 7fad8b212800 1 -- 172.21.15.132:0/14654841 shutdown_connections 2024-05-08T18:50:49.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.955+0000 7fad8b212800 1 --2- 172.21.15.132:0/14654841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec413e00 0x562bec412360 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.955+0000 7fad8b212800 1 -- 172.21.15.132:0/14654841 >> 172.21.15.132:0/14654841 conn(0x562bec499870 msgr2=0x562bec49bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.955+0000 7fad8b212800 1 -- 172.21.15.132:0/14654841 shutdown_connections 2024-05-08T18:50:49.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.955+0000 7fad8b212800 1 -- 172.21.15.132:0/14654841 wait complete. 2024-05-08T18:50:49.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.969+0000 7fad8b212800 1 Processor -- start 2024-05-08T18:50:49.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.969+0000 7fad8b212800 1 -- start start 2024-05-08T18:50:49.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.969+0000 7fad8b212800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec4128a0 0x562bec5919d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.969+0000 7fad8b212800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562bec3e96b0 con 0x562bec4128a0 2024-05-08T18:50:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.969+0000 7fad86876640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec4128a0 0x562bec5919d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.969+0000 7fad86876640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec4128a0 0x562bec5919d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33394/0 (socket says 172.21.15.132:33394) 2024-05-08T18:50:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.969+0000 7fad86876640 1 -- 172.21.15.132:0/643104268 learned_addr learned my addr 172.21.15.132:0/643104268 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.969+0000 7fad86876640 1 -- 172.21.15.132:0/643104268 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bec591fa0 con 0x562bec4128a0 2024-05-08T18:50:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.970+0000 7fad86876640 1 --2- 172.21.15.132:0/643104268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec4128a0 0x562bec5919d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fad7801d0e0 tx=0x7fad7804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a67b5c06bfc2a556 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.970+0000 7fac74e09640 1 -- 172.21.15.132:0/643104268 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad78057040 con 0x562bec4128a0 2024-05-08T18:50:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.970+0000 7fac74e09640 1 -- 172.21.15.132:0/643104268 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad78052850 con 0x562bec4128a0 2024-05-08T18:50:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.970+0000 7fac74e09640 1 -- 172.21.15.132:0/643104268 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad78052b70 con 0x562bec4128a0 2024-05-08T18:50:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.970+0000 7fad8b212800 1 -- 172.21.15.132:0/643104268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec4128a0 msgr2=0x562bec5919d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.970+0000 7fad8b212800 1 --2- 172.21.15.132:0/643104268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec4128a0 0x562bec5919d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fad7801d0e0 tx=0x7fad7804c000 comp rx=0 tx=0).stop 2024-05-08T18:50:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.970+0000 7fad8b212800 1 -- 172.21.15.132:0/643104268 shutdown_connections 2024-05-08T18:50:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.970+0000 7fad8b212800 1 --2- 172.21.15.132:0/643104268 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec4128a0 0x562bec5919d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.970+0000 7fad8b212800 1 -- 172.21.15.132:0/643104268 >> 172.21.15.132:0/643104268 conn(0x562bec499870 msgr2=0x562bec58d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.971+0000 7fad8b212800 1 -- 172.21.15.132:0/643104268 shutdown_connections 2024-05-08T18:50:49.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.971+0000 7fad8b212800 1 -- 172.21.15.132:0/643104268 wait complete. 2024-05-08T18:50:49.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.971+0000 7fad8b212800 1 Processor -- start 2024-05-08T18:50:49.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.971+0000 7fad8b212800 1 -- start start 2024-05-08T18:50:49.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.971+0000 7fad8b212800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec4128a0 0x562bec599390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.971+0000 7fad8b212800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562bec4a9b70 con 0x562bec4128a0 2024-05-08T18:50:49.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.971+0000 7fad86876640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec4128a0 0x562bec599390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.971+0000 7fad86876640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec4128a0 0x562bec599390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33404/0 (socket says 172.21.15.132:33404) 2024-05-08T18:50:49.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.971+0000 7fad86876640 1 -- 172.21.15.132:0/916789578 learned_addr learned my addr 172.21.15.132:0/916789578 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.972+0000 7fad86876640 1 -- 172.21.15.132:0/916789578 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bec5998d0 con 0x562bec4128a0 2024-05-08T18:50:49.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.972+0000 7fad86876640 1 --2- 172.21.15.132:0/916789578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec4128a0 0x562bec599390 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fad7801d0e0 tx=0x7fad78003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.972+0000 7fac73606640 1 -- 172.21.15.132:0/916789578 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad78073070 con 0x562bec4128a0 2024-05-08T18:50:49.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.972+0000 7fac73606640 1 -- 172.21.15.132:0/916789578 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad7805d650 con 0x562bec4128a0 2024-05-08T18:50:49.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.972+0000 7fad8b212800 1 -- 172.21.15.132:0/916789578 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562bec599b60 con 0x562bec4128a0 2024-05-08T18:50:49.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.972+0000 7fac73606640 1 -- 172.21.15.132:0/916789578 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad78057070 con 0x562bec4128a0 2024-05-08T18:50:49.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.972+0000 7fad8b212800 1 -- 172.21.15.132:0/916789578 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bec59c810 con 0x562bec4128a0 2024-05-08T18:50:49.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.973+0000 7fac73606640 1 -- 172.21.15.132:0/916789578 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fad78076070 con 0x562bec4128a0 2024-05-08T18:50:49.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.973+0000 7fac73606640 1 --2- 172.21.15.132:0/916789578 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac6c03bba0 0x7fac6c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.973+0000 7fac73606640 1 -- 172.21.15.132:0/916789578 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fad78094240 con 0x562bec4128a0 2024-05-08T18:50:49.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.973+0000 7fad7ffff640 1 --2- 172.21.15.132:0/916789578 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac6c03bba0 0x7fac6c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.973+0000 7fad8b212800 1 --2- 172.21.15.132:0/916789578 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562bec413e00 0x562bec5a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.973+0000 7fad8b212800 1 -- 172.21.15.132:0/916789578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562bec5a0ba0 con 0x562bec413e00 2024-05-08T18:50:49.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.973+0000 7fad87077640 1 --2- 172.21.15.132:0/916789578 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562bec413e00 0x562bec5a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.974+0000 7fad7ffff640 1 --2- 172.21.15.132:0/916789578 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac6c03bba0 0x7fac6c03e060 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fad70000f60 tx=0x7fad70001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.974+0000 7fad87077640 1 --2- 172.21.15.132:0/916789578 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562bec413e00 0x562bec5a05d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.974+0000 7fad87077640 1 -- 172.21.15.132:0/916789578 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad8000a4a0 con 0x562bec413e00 2024-05-08T18:50:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.974+0000 7fad8b212800 1 -- 172.21.15.132:0/916789578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562bec59dba0 con 0x562bec413e00 2024-05-08T18:50:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.974+0000 7fad87077640 1 -- 172.21.15.132:0/916789578 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fad8000a4a0 con 0x562bec413e00 2024-05-08T18:50:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.974+0000 7fad8b212800 1 --2- 172.21.15.132:0/916789578 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562bec5a2ed0 0x562bec5a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.974+0000 7fad8b212800 1 -- 172.21.15.132:0/916789578 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562bec5a59b0 con 0x562bec5a2ed0 2024-05-08T18:50:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.974+0000 7fad86876640 1 --2- 172.21.15.132:0/916789578 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562bec5a2ed0 0x562bec5a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.975+0000 7fad86876640 1 --2- 172.21.15.132:0/916789578 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562bec5a2ed0 0x562bec5a52c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.975+0000 7fad86876640 1 -- 172.21.15.132:0/916789578 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fad78075030 con 0x562bec5a2ed0 2024-05-08T18:50:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.975+0000 7fad8b212800 1 -- 172.21.15.132:0/916789578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562bec5a1d70 con 0x562bec413e00 2024-05-08T18:50:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.975+0000 7fad87077640 1 -- 172.21.15.132:0/916789578 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fad8000a4a0 con 0x562bec413e00 2024-05-08T18:50:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.975+0000 7fad8b212800 1 -- 172.21.15.132:0/916789578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562bec5a2250 con 0x562bec413e00 2024-05-08T18:50:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.975+0000 7fad87077640 1 -- 172.21.15.132:0/916789578 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fad8000a4a0 con 0x562bec413e00 2024-05-08T18:50:49.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.976+0000 7fad8b212800 1 Processor -- start 2024-05-08T18:50:49.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.976+0000 7fad8b212800 1 -- start start 2024-05-08T18:50:49.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.976+0000 7fad8b212800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec5b48f0 0x562bec5b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.976+0000 7fad8b212800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562bec38ffc0 con 0x562bec5b48f0 2024-05-08T18:50:49.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.976+0000 7fad87077640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec5b48f0 0x562bec5b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.976+0000 7fad87077640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec5b48f0 0x562bec5b4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33414/0 (socket says 172.21.15.132:33414) 2024-05-08T18:50:49.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.976+0000 7fad87077640 1 -- 172.21.15.132:0/3681073082 learned_addr learned my addr 172.21.15.132:0/3681073082 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.977+0000 7fad87077640 1 -- 172.21.15.132:0/3681073082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bec5b5250 con 0x562bec5b48f0 2024-05-08T18:50:49.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.977+0000 7fad87077640 1 --2- 172.21.15.132:0/3681073082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec5b48f0 0x562bec5b4d10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x562bec5a0f80 tx=0x7fad80018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.977+0000 7fac70e01640 1 -- 172.21.15.132:0/3681073082 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad80014450 con 0x562bec5b48f0 2024-05-08T18:50:49.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.977+0000 7fac70e01640 1 -- 172.21.15.132:0/3681073082 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad80014610 con 0x562bec5b48f0 2024-05-08T18:50:49.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.977+0000 7fac70e01640 1 -- 172.21.15.132:0/3681073082 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad80014930 con 0x562bec5b48f0 2024-05-08T18:50:49.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.977+0000 7fad8b212800 1 -- 172.21.15.132:0/3681073082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562bec5b5cc0 con 0x562bec5b48f0 2024-05-08T18:50:49.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.977+0000 7fad8b212800 1 -- 172.21.15.132:0/3681073082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bec5b61c0 con 0x562bec5b48f0 2024-05-08T18:50:49.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.978+0000 7fac70e01640 1 -- 172.21.15.132:0/3681073082 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fad80011040 con 0x562bec5b48f0 2024-05-08T18:50:49.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.978+0000 7fac70e01640 1 --2- 172.21.15.132:0/3681073082 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac6003bb50 0x7fac6003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.978+0000 7fac70e01640 1 -- 172.21.15.132:0/3681073082 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fad8001e070 con 0x562bec5b48f0 2024-05-08T18:50:49.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.978+0000 7fad86876640 1 --2- 172.21.15.132:0/3681073082 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac6003bb50 0x7fac6003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.978+0000 7fad8b212800 1 Processor -- start 2024-05-08T18:50:49.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.978+0000 7fad8b212800 1 -- start start 2024-05-08T18:50:49.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.978+0000 7fad86876640 1 --2- 172.21.15.132:0/3681073082 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac6003bb50 0x7fac6003e010 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x562bec5a1020 tx=0x7fad780926b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.978+0000 7fad8b212800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec5c1bd0 0x562bec5c1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.978+0000 7fad8b212800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562bec592260 con 0x562bec5c1bd0 2024-05-08T18:50:49.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.979+0000 7fad87077640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec5c1bd0 0x562bec5c1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.979+0000 7fad87077640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec5c1bd0 0x562bec5c1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33416/0 (socket says 172.21.15.132:33416) 2024-05-08T18:50:49.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.979+0000 7fad87077640 1 -- 172.21.15.132:0/1748039093 learned_addr learned my addr 172.21.15.132:0/1748039093 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.979+0000 7fad87077640 1 -- 172.21.15.132:0/1748039093 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bec5c25c0 con 0x562bec5c1bd0 2024-05-08T18:50:49.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.979+0000 7fad87077640 1 --2- 172.21.15.132:0/1748039093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec5c1bd0 0x562bec5c1ff0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fad80052cd0 tx=0x7fad8002b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32663304dddf702 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.979+0000 7fac6a7fc640 1 -- 172.21.15.132:0/1748039093 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad80028070 con 0x562bec5c1bd0 2024-05-08T18:50:49.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.979+0000 7fac6a7fc640 1 -- 172.21.15.132:0/1748039093 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad80016e00 con 0x562bec5c1bd0 2024-05-08T18:50:49.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.979+0000 7fac6a7fc640 1 -- 172.21.15.132:0/1748039093 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad800165b0 con 0x562bec5c1bd0 2024-05-08T18:50:49.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.980+0000 7fad8b212800 1 -- 172.21.15.132:0/1748039093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec5c1bd0 msgr2=0x562bec5c1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:49.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.980+0000 7fad8b212800 1 --2- 172.21.15.132:0/1748039093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec5c1bd0 0x562bec5c1ff0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fad80052cd0 tx=0x7fad8002b720 comp rx=0 tx=0).stop 2024-05-08T18:50:49.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.980+0000 7fad8b212800 1 -- 172.21.15.132:0/1748039093 shutdown_connections 2024-05-08T18:50:49.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.980+0000 7fad8b212800 1 --2- 172.21.15.132:0/1748039093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec5c1bd0 0x562bec5c1ff0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:49.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.980+0000 7fad8b212800 1 -- 172.21.15.132:0/1748039093 >> 172.21.15.132:0/1748039093 conn(0x562bec5bdf30 msgr2=0x562bec5bbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:49.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.980+0000 7fad8b212800 1 -- 172.21.15.132:0/1748039093 shutdown_connections 2024-05-08T18:50:49.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.980+0000 7fad8b212800 1 -- 172.21.15.132:0/1748039093 wait complete. 2024-05-08T18:50:49.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.980+0000 7fad8b212800 1 Processor -- start 2024-05-08T18:50:49.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.980+0000 7fad8b212800 1 -- start start 2024-05-08T18:50:49.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.980+0000 7fad8b212800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec5c1bd0 0x562bec5c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.980+0000 7fad8b212800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562bec5c2d30 con 0x562bec5c1bd0 2024-05-08T18:50:49.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.981+0000 7fad87077640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec5c1bd0 0x562bec5c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.981+0000 7fad87077640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec5c1bd0 0x562bec5c91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33432/0 (socket says 172.21.15.132:33432) 2024-05-08T18:50:49.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.981+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 learned_addr learned my addr 172.21.15.132:0/1212400578 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:49.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.981+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bec5c96e0 con 0x562bec5c1bd0 2024-05-08T18:50:49.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.981+0000 7fad87077640 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec5c1bd0 0x562bec5c91a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fad80016c90 tx=0x7fad80052c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.981+0000 7fac68ff9640 1 -- 172.21.15.132:0/1212400578 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad80031070 con 0x562bec5c1bd0 2024-05-08T18:50:49.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.981+0000 7fac68ff9640 1 -- 172.21.15.132:0/1212400578 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad80011850 con 0x562bec5c1bd0 2024-05-08T18:50:49.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.981+0000 7fac68ff9640 1 -- 172.21.15.132:0/1212400578 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad80044030 con 0x562bec5c1bd0 2024-05-08T18:50:49.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.981+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562bec5c9970 con 0x562bec5c1bd0 2024-05-08T18:50:49.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.981+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bec5cc620 con 0x562bec5c1bd0 2024-05-08T18:50:49.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.982+0000 7fac68ff9640 1 -- 172.21.15.132:0/1212400578 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fad80034070 con 0x562bec5c1bd0 2024-05-08T18:50:49.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.982+0000 7fac68ff9640 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac5003bba0 0x7fac5003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.982+0000 7fac68ff9640 1 -- 172.21.15.132:0/1212400578 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fad8000e040 con 0x562bec5c1bd0 2024-05-08T18:50:49.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.982+0000 7fad86876640 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac5003bba0 0x7fac5003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.983+0000 7fad86876640 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac5003bba0 0x7fac5003e060 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fad78077fd0 tx=0x7fad78088000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.983+0000 7fad8b212800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.983+0000 7fad8b212800 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562bec5d4ce0 0x562bec5d71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.983+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562bec5d78f0 con 0x562bec5d4ce0 2024-05-08T18:50:49.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.983+0000 7fad7ffff640 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562bec5d4ce0 0x562bec5d71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.983+0000 7fad7ffff640 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562bec5d4ce0 0x562bec5d71a0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.983+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad7000f610 con 0x562bec5d4ce0 2024-05-08T18:50:49.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.983+0000 7fad8b212800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.983+0000 7fad8b212800 20 realm 2024-05-08T18:50:49.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.983+0000 7fad8b212800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.983+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562bec5d4130 con 0x562bec5d4ce0 2024-05-08T18:50:49.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.984+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad7000f610 con 0x562bec5d4ce0 2024-05-08T18:50:49.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.984+0000 7fad8b212800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.984+0000 7fad8b212800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:49.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.984+0000 7fad8b212800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.984+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562bec5d83e0 con 0x562bec5d4ce0 2024-05-08T18:50:49.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.984+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad7000f610 con 0x562bec5d4ce0 2024-05-08T18:50:49.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.984+0000 7fad8b212800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:49.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.984+0000 7fad8b212800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.984+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562bec5d8cb0 con 0x562bec5d4ce0 2024-05-08T18:50:49.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.984+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fad7000f610 con 0x562bec5d4ce0 2024-05-08T18:50:49.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.984+0000 7fad8b212800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:49.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.984+0000 7fad8b212800 20 rados->read ofs=0 len=0 2024-05-08T18:50:49.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.984+0000 7fad8b212800 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562bec5d96d0 0x562bec5dbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.984+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562bec5dc1b0 con 0x562bec5d96d0 2024-05-08T18:50:49.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.984+0000 7fad87077640 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562bec5d96d0 0x562bec5dbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.984+0000 7fad87077640 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562bec5d96d0 0x562bec5dbac0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.985+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fad80033030 con 0x562bec5d96d0 2024-05-08T18:50:49.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.985+0000 7fad8b212800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:49.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.985+0000 7fad8b212800 20 searching for the correct realm 2024-05-08T18:50:49.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.985+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x562bec5d96d0 2024-05-08T18:50:49.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.985+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad80033030 con 0x562bec5d96d0 2024-05-08T18:50:49.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.985+0000 7fad87077640 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fad80036070 0x7fad80023a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.985+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x7fad80036070 2024-05-08T18:50:49.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.985+0000 7fad86876640 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fad80036070 0x7fad80023a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.986+0000 7fad86876640 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fad80036070 0x7fad80023a50 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:49.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.986+0000 7fad86876640 1 -- 172.21.15.132:0/1212400578 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad78075030 con 0x7fad80036070 2024-05-08T18:50:49.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.986+0000 7fad86876640 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fad78086040 0x7fad78080750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:49.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.986+0000 7fad86876640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x7fad78086040 2024-05-08T18:50:49.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.986+0000 7fad7ffff640 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fad78086040 0x7fad78080750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:49.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.987+0000 7fad7ffff640 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fad78086040 0x7fad78080750 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.987+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad7000f610 con 0x7fad78086040 2024-05-08T18:50:50.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.987+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x562bec5d4ce0 2024-05-08T18:50:50.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.987+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad7000f610 con 0x562bec5d4ce0 2024-05-08T18:50:50.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.987+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x562bec5d4ce0 2024-05-08T18:50:50.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.987+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad7002b040 con 0x562bec5d4ce0 2024-05-08T18:50:50.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.987+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x7fad78086040 2024-05-08T18:50:50.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.988+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad7002b040 con 0x7fad78086040 2024-05-08T18:50:50.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.988+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x7fad78086040 2024-05-08T18:50:50.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.988+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad7002b040 con 0x7fad78086040 2024-05-08T18:50:50.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.988+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x7fad80036070 2024-05-08T18:50:50.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.988+0000 7fad86876640 1 -- 172.21.15.132:0/1212400578 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad78075030 con 0x7fad80036070 2024-05-08T18:50:50.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.988+0000 7fad86876640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x562bec5d96d0 2024-05-08T18:50:50.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.988+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad80033030 con 0x562bec5d96d0 2024-05-08T18:50:50.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.988+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x562bec5d4ce0 2024-05-08T18:50:50.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.989+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad7002b040 con 0x562bec5d4ce0 2024-05-08T18:50:50.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.989+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x7fad78086040 2024-05-08T18:50:50.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.989+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad7002b040 con 0x7fad78086040 2024-05-08T18:50:50.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.989+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x562bec5d4ce0 2024-05-08T18:50:50.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.989+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fad7002b040 con 0x562bec5d4ce0 2024-05-08T18:50:50.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.989+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x7fad80036070 2024-05-08T18:50:50.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.990+0000 7fad86876640 1 -- 172.21.15.132:0/1212400578 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fad78075030 con 0x7fad80036070 2024-05-08T18:50:50.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.990+0000 7fad86876640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x562bec5d96d0 2024-05-08T18:50:50.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.990+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fad80033030 con 0x562bec5d96d0 2024-05-08T18:50:50.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.990+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x562bec5d96d0 2024-05-08T18:50:50.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.990+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad80033030 con 0x562bec5d96d0 2024-05-08T18:50:50.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.990+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x7fad78086040 2024-05-08T18:50:50.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.990+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad7002b040 con 0x7fad78086040 2024-05-08T18:50:50.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.990+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x562bec5d96d0 2024-05-08T18:50:50.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.991+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad80033030 con 0x562bec5d96d0 2024-05-08T18:50:50.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.991+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x562bec5d96d0 2024-05-08T18:50:50.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.991+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad80033030 con 0x562bec5d96d0 2024-05-08T18:50:50.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.991+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x562bec5d4ce0 2024-05-08T18:50:50.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.991+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad7002b040 con 0x562bec5d4ce0 2024-05-08T18:50:50.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.991+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x562bec5d4ce0 2024-05-08T18:50:50.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.991+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fad7002b040 con 0x562bec5d4ce0 2024-05-08T18:50:50.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.991+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x7fad78086040 2024-05-08T18:50:50.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.992+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad7002b040 con 0x7fad78086040 2024-05-08T18:50:50.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.992+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x562bec5d96d0 2024-05-08T18:50:50.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.992+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad80033030 con 0x562bec5d96d0 2024-05-08T18:50:50.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.992+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x7fad80036070 2024-05-08T18:50:50.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.992+0000 7fad86876640 1 -- 172.21.15.132:0/1212400578 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad78075030 con 0x7fad80036070 2024-05-08T18:50:50.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.992+0000 7fad86876640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x562bec5d4ce0 2024-05-08T18:50:50.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.992+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad7002b040 con 0x562bec5d4ce0 2024-05-08T18:50:50.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.992+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x7fad78086040 2024-05-08T18:50:50.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.993+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad7003b040 con 0x7fad78086040 2024-05-08T18:50:50.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.993+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x562bec5d96d0 2024-05-08T18:50:50.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.993+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad80033030 con 0x562bec5d96d0 2024-05-08T18:50:50.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.993+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x7fad78086040 2024-05-08T18:50:50.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.993+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad7003b040 con 0x7fad78086040 2024-05-08T18:50:50.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.993+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x7fad80036070 2024-05-08T18:50:50.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.993+0000 7fad86876640 1 -- 172.21.15.132:0/1212400578 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad78075030 con 0x7fad80036070 2024-05-08T18:50:50.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.993+0000 7fad86876640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x562bec5d96d0 2024-05-08T18:50:50.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.994+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad80033030 con 0x562bec5d96d0 2024-05-08T18:50:50.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.994+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x7fad78086040 2024-05-08T18:50:50.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.994+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad7003b040 con 0x7fad78086040 2024-05-08T18:50:50.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.994+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x562bec5d4ce0 2024-05-08T18:50:50.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.994+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fad7003b040 con 0x562bec5d4ce0 2024-05-08T18:50:50.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.994+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddb00 con 0x7fad80036070 2024-05-08T18:50:50.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad86876640 1 -- 172.21.15.132:0/1212400578 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad78075030 con 0x7fad80036070 2024-05-08T18:50:50.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:50.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:50.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:50.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:50.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:50.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:50.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562bec5dcba0 con 0x562bec5d4ce0 2024-05-08T18:50:50.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x562bec5d4ce0 2024-05-08T18:50:50.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562bec5dd440 con 0x562bec5d4ce0 2024-05-08T18:50:50.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fad7003b040 con 0x562bec5d4ce0 2024-05-08T18:50:50.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:50.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddf80 con 0x562bec5d4ce0 2024-05-08T18:50:50.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fad7003b040 con 0x562bec5d4ce0 2024-05-08T18:50:50.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:50.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 20 zone default found 2024-05-08T18:50:50.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 4 Realm: () 2024-05-08T18:50:50.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:50.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:50.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:50.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 20 zonegroup default 2024-05-08T18:50:50.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.995+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562bec5ddfa0 con 0x7fad78086040 2024-05-08T18:50:50.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.996+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x7fad78086040 2024-05-08T18:50:50.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.996+0000 7fad8b212800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.996+0000 7fad8b212800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.996+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562bec5dfdc0 con 0x562bec5d96d0 2024-05-08T18:50:50.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.996+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fad80033030 con 0x562bec5d96d0 2024-05-08T18:50:50.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.996+0000 7fad8b212800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.996+0000 7fad8b212800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.996+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e01e0 con 0x562bec5d96d0 2024-05-08T18:50:50.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.996+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fad80033030 con 0x562bec5d96d0 2024-05-08T18:50:50.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.996+0000 7fad8b212800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.996+0000 7fad8b212800 20 started sync module instance, tier type = 2024-05-08T18:50:50.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.996+0000 7fad8b212800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:50.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.996+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5df260 con 0x7fad80036070 2024-05-08T18:50:50.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.997+0000 7fad86876640 1 -- 172.21.15.132:0/1212400578 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad78075030 con 0x7fad80036070 2024-05-08T18:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.997+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94746649163344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5deec0 con 0x7fad80036070 2024-05-08T18:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.997+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e10f0 con 0x562bec5d4ce0 2024-05-08T18:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.998+0000 7fad86876640 1 -- 172.21.15.132:0/1212400578 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94746649163344] v25'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad78075030 con 0x7fad80036070 2024-05-08T18:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.998+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x562bec5d4ce0 2024-05-08T18:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.998+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94746649168960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e1510 con 0x562bec5d4ce0 2024-05-08T18:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:49.998+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e1ed0 con 0x562bec5d96d0 2024-05-08T18:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.000+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94746649168960] v25'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x562bec5d4ce0 2024-05-08T18:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.000+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad80033030 con 0x562bec5d96d0 2024-05-08T18:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.000+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94746649170496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e1ed0 con 0x562bec5d96d0 2024-05-08T18:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.000+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e28f0 con 0x7fad80036070 2024-05-08T18:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.001+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94746649170496] v25'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad80033030 con 0x562bec5d96d0 2024-05-08T18:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.001+0000 7fad86876640 1 -- 172.21.15.132:0/1212400578 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad78075030 con 0x7fad80036070 2024-05-08T18:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.001+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94746649172512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e1e40 con 0x7fad80036070 2024-05-08T18:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.001+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e37b0 con 0x562bec5d4ce0 2024-05-08T18:50:50.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.002+0000 7fad86876640 1 -- 172.21.15.132:0/1212400578 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94746649172512] v25'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad78075030 con 0x7fad80036070 2024-05-08T18:50:50.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.002+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x562bec5d4ce0 2024-05-08T18:50:50.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.002+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94746649178880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e3720 con 0x562bec5d4ce0 2024-05-08T18:50:50.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.002+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e4670 con 0x7fad78086040 2024-05-08T18:50:50.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.003+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94746649178880] v25'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x562bec5d4ce0 2024-05-08T18:50:50.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.003+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x7fad78086040 2024-05-08T18:50:50.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.004+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94746649181008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e4670 con 0x7fad78086040 2024-05-08T18:50:50.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.004+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e5080 con 0x7fad78086040 2024-05-08T18:50:50.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.004+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94746649181008] v25'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x7fad78086040 2024-05-08T18:50:50.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.005+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x7fad78086040 2024-05-08T18:50:50.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.005+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94746649183136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e5080 con 0x7fad78086040 2024-05-08T18:50:50.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.005+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e5a40 con 0x7fad78086040 2024-05-08T18:50:50.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.005+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94746649183136] v25'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x7fad78086040 2024-05-08T18:50:50.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.006+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x7fad78086040 2024-05-08T18:50:50.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.006+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94746649185712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e5a40 con 0x7fad78086040 2024-05-08T18:50:50.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.006+0000 7fad8b212800 20 add_watcher() i=0 2024-05-08T18:50:50.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.006+0000 7fad8b212800 20 add_watcher() i=1 2024-05-08T18:50:50.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.006+0000 7fad8b212800 20 add_watcher() i=2 2024-05-08T18:50:50.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.006+0000 7fad8b212800 20 add_watcher() i=3 2024-05-08T18:50:50.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.006+0000 7fad8b212800 20 add_watcher() i=4 2024-05-08T18:50:50.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.006+0000 7fad8b212800 20 add_watcher() i=5 2024-05-08T18:50:50.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.006+0000 7fad8b212800 20 add_watcher() i=6 2024-05-08T18:50:50.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.006+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94746649185712] v25'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x7fad78086040 2024-05-08T18:50:50.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.006+0000 7fad8b212800 20 add_watcher() i=7 2024-05-08T18:50:50.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.006+0000 7fad8b212800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:50.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.006+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e8da0 con 0x562bec5d4ce0 2024-05-08T18:50:50.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.007+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fad7003b040 con 0x562bec5d4ce0 2024-05-08T18:50:50.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.007+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94746649188096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e5fd0 con 0x562bec5d4ce0 2024-05-08T18:50:50.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.008+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94746649188096] v25'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x562bec5d4ce0 2024-05-08T18:50:50.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.008+0000 7fac3d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:50.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.008+0000 7fad8b212800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:50.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.008+0000 7fad8b212800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:50.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.008+0000 7fad8b212800 5 note: GC not initialized 2024-05-08T18:50:50.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.008+0000 7fabb7fff640 20 reqs_thread_entry: start 2024-05-08T18:50:50.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.008+0000 7fad8b212800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:50.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.008+0000 7fad8b212800 20 Filter name: none 2024-05-08T18:50:50.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.008+0000 7fabb5ffb640 20 reqs_thread_entry: start 2024-05-08T18:50:50.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.008+0000 7fad8b212800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-05-08T18:50:50.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.008+0000 7fad8b212800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.008+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562bec61c550 con 0x7fad78086040 2024-05-08T18:50:50.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.009+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x7fad78086040 2024-05-08T18:50:50.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.009+0000 7fad8b212800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.009+0000 7fad8b212800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-05-08T18:50:50.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.009+0000 7fad8b212800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-08T18:50:50.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.009+0000 7fad8b212800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-08T18:50:50.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.009+0000 7fad8b212800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.009+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562bec61ac40 con 0x7fad78086040 2024-05-08T18:50:50.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.009+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x7fad78086040 2024-05-08T18:50:50.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.009+0000 7fad8b212800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.009+0000 7fad8b212800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-08T18:50:50.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.009+0000 7fad8b212800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:50:50.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.009+0000 7fad8b212800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T18:50:50.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.009+0000 7fad8b212800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T18:50:50.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.009+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec61f120 con 0x7fad78086040 2024-05-08T18:50:50.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.011+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v25'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x7fad78086040 2024-05-08T18:50:50.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.011+0000 7fad8b212800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-05-08T18:50:50.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.011+0000 7fad8b212800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-08T18:50:50.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.011+0000 7fad8b212800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-05-08T18:50:50.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.011+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94746649422528 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562bec61fc70 con 0x7fad80036070 2024-05-08T18:50:50.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.011+0000 7fad86876640 1 -- 172.21.15.132:0/1212400578 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== watch-notify(notify (1) cookie 94746649172512 notify 107374182421 ret 0) ==== 652+0+0 (crc 0 0 0) 0x562bec59c810 con 0x7fad80036070 2024-05-08T18:50:50.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.011+0000 7fac6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182421 cookie 94746649172512 notifier 4529 bl.length()=610 2024-05-08T18:50:50.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.011+0000 7fad86876640 1 -- 172.21.15.132:0/1212400578 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(65 notify.3 [notify cookie 94746649422528 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fad78075030 con 0x7fad80036070 2024-05-08T18:50:50.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.011+0000 7fac6a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-05-08T18:50:50.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.011+0000 7fac6a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-08T18:50:50.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.011+0000 7fac6a7fc640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7fac4c003ea0 con 0x7fad80036070 2024-05-08T18:50:50.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.011+0000 7fad86876640 1 -- 172.21.15.132:0/1212400578 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== watch-notify(notify_complete (2) cookie 94746649422528 notify 107374182421 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562bec599b60 con 0x7fad80036070 2024-05-08T18:50:50.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.011+0000 7fad86876640 1 -- 172.21.15.132:0/1212400578 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad78075030 con 0x7fad80036070 2024-05-08T18:50:50.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.011+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec61ea90 con 0x7fad78086040 2024-05-08T18:50:50.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.012+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v25'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x7fad78086040 2024-05-08T18:50:50.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.012+0000 7fad8b212800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:50:50.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.012+0000 7fad8b212800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:50:50.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.012+0000 7fad8b212800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:50:50.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.012+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94746649422432 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x562bec61dad0 con 0x562bec5d96d0 2024-05-08T18:50:50.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.013+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== watch-notify(notify (1) cookie 94746649170496 notify 107374182404 ret 0) ==== 234+0+0 (crc 0 0 0) 0x562bec5c9970 con 0x562bec5d96d0 2024-05-08T18:50:50.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.013+0000 7fac6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182404 cookie 94746649170496 notifier 4529 bl.length()=192 2024-05-08T18:50:50.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.013+0000 7fac6a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:50:50.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.013+0000 7fac6a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:50:50.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.013+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(68 notify.2 [notify cookie 94746649422432 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fad80033030 con 0x562bec5d96d0 2024-05-08T18:50:50.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.013+0000 7fac6a7fc640 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7fac4c003ea0 con 0x562bec5d96d0 2024-05-08T18:50:50.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.013+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad80033030 con 0x562bec5d96d0 2024-05-08T18:50:50.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.013+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== watch-notify(notify_complete (2) cookie 94746649422432 notify 107374182404 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562bec5c96e0 con 0x562bec5d96d0 2024-05-08T18:50:50.028 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-08T18:50:50.010961Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:50.010943Z","tags":[],"group_ids":[]} 2024-05-08T18:50:50.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.014+0000 7fac3d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:50.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.014+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94746649188096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e8410 con 0x562bec5d4ce0 2024-05-08T18:50:50.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.015+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94746649188096] v25'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x562bec5d4ce0 2024-05-08T18:50:50.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.015+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94746649163344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e5700 con 0x7fad80036070 2024-05-08T18:50:50.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.016+0000 7fad86876640 1 -- 172.21.15.132:0/1212400578 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94746649163344] v25'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad78075030 con 0x7fad80036070 2024-05-08T18:50:50.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.016+0000 7fad8b212800 20 remove_watcher() i=0 2024-05-08T18:50:50.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.016+0000 7fad8b212800 2 removed watcher, disabling cache 2024-05-08T18:50:50.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.016+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94746649168960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e5700 con 0x562bec5d4ce0 2024-05-08T18:50:50.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.017+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94746649168960] v25'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x562bec5d4ce0 2024-05-08T18:50:50.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.017+0000 7fad8b212800 20 remove_watcher() i=1 2024-05-08T18:50:50.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.017+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94746649170496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e0c40 con 0x562bec5d96d0 2024-05-08T18:50:50.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.018+0000 7fad87077640 1 -- 172.21.15.132:0/1212400578 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94746649170496] v25'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad80033030 con 0x562bec5d96d0 2024-05-08T18:50:50.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.018+0000 7fad8b212800 20 remove_watcher() i=2 2024-05-08T18:50:50.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.018+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94746649172512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e5700 con 0x7fad80036070 2024-05-08T18:50:50.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.019+0000 7fad86876640 1 -- 172.21.15.132:0/1212400578 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94746649172512] v25'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad78075030 con 0x7fad80036070 2024-05-08T18:50:50.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.019+0000 7fad8b212800 20 remove_watcher() i=3 2024-05-08T18:50:50.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.019+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94746649178880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e0c40 con 0x562bec5d4ce0 2024-05-08T18:50:50.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.020+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94746649178880] v25'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x562bec5d4ce0 2024-05-08T18:50:50.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.020+0000 7fad8b212800 20 remove_watcher() i=4 2024-05-08T18:50:50.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.020+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94746649181008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e1a20 con 0x7fad78086040 2024-05-08T18:50:50.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.021+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94746649181008] v25'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x7fad78086040 2024-05-08T18:50:50.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.021+0000 7fad8b212800 20 remove_watcher() i=5 2024-05-08T18:50:50.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.021+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94746649183136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e5700 con 0x7fad78086040 2024-05-08T18:50:50.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.022+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94746649183136] v25'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x7fad78086040 2024-05-08T18:50:50.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.022+0000 7fad8b212800 20 remove_watcher() i=6 2024-05-08T18:50:50.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.022+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94746649185712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x562bec5e3300 con 0x7fad78086040 2024-05-08T18:50:50.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.023+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94746649185712] v25'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad7003b040 con 0x7fad78086040 2024-05-08T18:50:50.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.023+0000 7fad8b212800 20 remove_watcher() i=7 2024-05-08T18:50:50.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.023+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fad78086040 msgr2=0x7fad78080750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.023+0000 7fad8b212800 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fad78086040 0x7fad78080750 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.023+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562bec5d4ce0 msgr2=0x562bec5d71a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.023+0000 7fad8b212800 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562bec5d4ce0 0x562bec5d71a0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.023+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fad80036070 msgr2=0x7fad80023a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.023+0000 7fad8b212800 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fad80036070 0x7fad80023a50 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.023+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562bec5d96d0 msgr2=0x562bec5dbac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.023+0000 7fad8b212800 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562bec5d96d0 0x562bec5dbac0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.023+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac5003bba0 msgr2=0x7fac5003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.023+0000 7fad8b212800 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac5003bba0 0x7fac5003e060 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fad78077fd0 tx=0x7fad78088000 comp rx=0 tx=0).stop 2024-05-08T18:50:50.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.023+0000 7fad7ffff640 1 -- 172.21.15.132:0/1212400578 reap_dead start 2024-05-08T18:50:50.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.023+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec5c1bd0 msgr2=0x562bec5c91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.023+0000 7fad8b212800 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec5c1bd0 0x562bec5c91a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fad80016c90 tx=0x7fad80052c60 comp rx=0 tx=0).stop 2024-05-08T18:50:50.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.023+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 shutdown_connections 2024-05-08T18:50:50.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.023+0000 7fad8b212800 1 --2- 172.21.15.132:0/1212400578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec5c1bd0 0x562bec5c91a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.023+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 >> 172.21.15.132:0/1212400578 conn(0x562bec5bdf30 msgr2=0x562bec5bb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.024+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 shutdown_connections 2024-05-08T18:50:50.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.024+0000 7fad8b212800 1 -- 172.21.15.132:0/1212400578 wait complete. 2024-05-08T18:50:50.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.024+0000 7fad8b212800 1 -- 172.21.15.132:0/3681073082 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac6003bb50 msgr2=0x7fac6003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.024+0000 7fad8b212800 1 --2- 172.21.15.132:0/3681073082 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac6003bb50 0x7fac6003e010 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x562bec5a1020 tx=0x7fad780926b0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.024+0000 7fad8b212800 1 -- 172.21.15.132:0/3681073082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec5b48f0 msgr2=0x562bec5b4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.024+0000 7fad8b212800 1 --2- 172.21.15.132:0/3681073082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec5b48f0 0x562bec5b4d10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x562bec5a0f80 tx=0x7fad80018830 comp rx=0 tx=0).stop 2024-05-08T18:50:50.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.024+0000 7fad8b212800 1 -- 172.21.15.132:0/3681073082 shutdown_connections 2024-05-08T18:50:50.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.024+0000 7fad8b212800 1 --2- 172.21.15.132:0/3681073082 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac6003bb50 0x7fac6003e010 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.024+0000 7fad8b212800 1 --2- 172.21.15.132:0/3681073082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec5b48f0 0x562bec5b4d10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.024+0000 7fad8b212800 1 -- 172.21.15.132:0/3681073082 >> 172.21.15.132:0/3681073082 conn(0x562bec5a8990 msgr2=0x562bec5a8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.024+0000 7fad8b212800 1 -- 172.21.15.132:0/3681073082 shutdown_connections 2024-05-08T18:50:50.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.024+0000 7fad8b212800 1 -- 172.21.15.132:0/3681073082 wait complete. 2024-05-08T18:50:50.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.025+0000 7fad8b212800 1 -- 172.21.15.132:0/916789578 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562bec413e00 msgr2=0x562bec5a05d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.025+0000 7fad8b212800 1 --2- 172.21.15.132:0/916789578 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562bec413e00 0x562bec5a05d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.025+0000 7fad8b212800 1 -- 172.21.15.132:0/916789578 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562bec5a2ed0 msgr2=0x562bec5a52c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.025+0000 7fad8b212800 1 --2- 172.21.15.132:0/916789578 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562bec5a2ed0 0x562bec5a52c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.025+0000 7fad8b212800 1 -- 172.21.15.132:0/916789578 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac6c03bba0 msgr2=0x7fac6c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.025+0000 7fad8b212800 1 --2- 172.21.15.132:0/916789578 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac6c03bba0 0x7fac6c03e060 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fad70000f60 tx=0x7fad70001370 comp rx=0 tx=0).stop 2024-05-08T18:50:50.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.025+0000 7fad8b212800 1 -- 172.21.15.132:0/916789578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec4128a0 msgr2=0x562bec599390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.025+0000 7fad8b212800 1 --2- 172.21.15.132:0/916789578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec4128a0 0x562bec599390 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fad7801d0e0 tx=0x7fad78003020 comp rx=0 tx=0).stop 2024-05-08T18:50:50.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.025+0000 7fad8b212800 1 -- 172.21.15.132:0/916789578 shutdown_connections 2024-05-08T18:50:50.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.025+0000 7fad8b212800 1 --2- 172.21.15.132:0/916789578 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562bec5a2ed0 0x562bec5a52c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.025+0000 7fad8b212800 1 --2- 172.21.15.132:0/916789578 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562bec413e00 0x562bec5a05d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.025+0000 7fad8b212800 1 --2- 172.21.15.132:0/916789578 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fac6c03bba0 0x7fac6c03e060 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.025+0000 7fad8b212800 1 --2- 172.21.15.132:0/916789578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562bec4128a0 0x562bec599390 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.025+0000 7fad8b212800 1 -- 172.21.15.132:0/916789578 >> 172.21.15.132:0/916789578 conn(0x562bec499870 msgr2=0x562bec58baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.025+0000 7fad8b212800 1 -- 172.21.15.132:0/916789578 shutdown_connections 2024-05-08T18:50:50.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.025+0000 7fad8b212800 1 -- 172.21.15.132:0/916789578 wait complete. 2024-05-08T18:50:50.040 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-08T18:50:50.010961Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:50.010943Z', 'tags': [], 'group_ids': []} 2024-05-08T18:50:50.040 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-08T18:50:50.040 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-08T18:50:50.040 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-05-08T18:50:50.088 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:50.088 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:50.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.090+0000 7f7fcaa11800 1 Processor -- start 2024-05-08T18:50:50.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.090+0000 7f7fcaa11800 1 -- start start 2024-05-08T18:50:50.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.090+0000 7f7fcaa11800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5608da174660 0x5608da174a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.090+0000 7f7fcaa11800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5608da175100 con 0x5608da1753e0 2024-05-08T18:50:50.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.090+0000 7f7fcaa11800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x5608da015e20 con 0x5608da174660 2024-05-08T18:50:50.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.090+0000 7f7fc600d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5608da174660 0x5608da174a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.090+0000 7f7fc600d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5608da174660 0x5608da174a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33444/0 (socket says 172.21.15.132:33444) 2024-05-08T18:50:50.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.090+0000 7f7fc600d640 1 -- 172.21.15.132:0/2676977120 learned_addr learned my addr 172.21.15.132:0/2676977120 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.090+0000 7f7fc580c640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x5608da1753e0 0x5608da175890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:47068/0 (socket says 172.21.15.132:47068) 2024-05-08T18:50:50.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.091+0000 7f7fc600d640 1 -- 172.21.15.132:0/2676977120 >> v1:172.21.15.42:6789/0 conn(0x5608da1753e0 legacy=0x5608da175890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.091+0000 7f7fc500b640 1 -- 172.21.15.132:0/2676977120 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 383027588 0 0) 0x5608da175100 con 0x5608da1753e0 2024-05-08T18:50:50.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.091+0000 7f7fc600d640 1 -- 172.21.15.132:0/2676977120 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608da175fa0 con 0x5608da174660 2024-05-08T18:50:50.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.093+0000 7f7fc600d640 1 --2- 172.21.15.132:0/2676977120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da174660 0x5608da174a80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8005fd0 tx=0x7f7fb801cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134edb406efdb79a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.093+0000 7f7fc500b640 1 -- 172.21.15.132:0/2676977120 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb8052540 con 0x5608da174660 2024-05-08T18:50:50.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.093+0000 7f7fc500b640 1 -- 172.21.15.132:0/2676977120 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb804e070 con 0x5608da174660 2024-05-08T18:50:50.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.093+0000 7f7fc500b640 1 -- 172.21.15.132:0/2676977120 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb8052850 con 0x5608da174660 2024-05-08T18:50:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.093+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2676977120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da174660 msgr2=0x5608da174a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.093+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/2676977120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da174660 0x5608da174a80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8005fd0 tx=0x7f7fb801cd80 comp rx=0 tx=0).stop 2024-05-08T18:50:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.093+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2676977120 shutdown_connections 2024-05-08T18:50:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.093+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/2676977120 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da174660 0x5608da174a80 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.093+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2676977120 >> 172.21.15.132:0/2676977120 conn(0x5608da16eec0 msgr2=0x5608da1712e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.093+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2676977120 shutdown_connections 2024-05-08T18:50:50.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.093+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2676977120 wait complete. 2024-05-08T18:50:50.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.107+0000 7f7fcaa11800 1 Processor -- start 2024-05-08T18:50:50.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.107+0000 7f7fcaa11800 1 -- start start 2024-05-08T18:50:50.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.107+0000 7f7fcaa11800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da174660 0x5608da173d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.107+0000 7f7fcaa11800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5608da0c05d0 con 0x5608da174660 2024-05-08T18:50:50.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.107+0000 7f7fc600d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da174660 0x5608da173d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.107+0000 7f7fc600d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da174660 0x5608da173d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33452/0 (socket says 172.21.15.132:33452) 2024-05-08T18:50:50.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.107+0000 7f7fc600d640 1 -- 172.21.15.132:0/2001996571 learned_addr learned my addr 172.21.15.132:0/2001996571 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.108+0000 7f7fc600d640 1 -- 172.21.15.132:0/2001996571 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608da269200 con 0x5608da174660 2024-05-08T18:50:50.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.108+0000 7f7fc600d640 1 --2- 172.21.15.132:0/2001996571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da174660 0x5608da173d60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800a190 tx=0x7f7fb804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c010ed6aae6575c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.108+0000 7f7eb4608640 1 -- 172.21.15.132:0/2001996571 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb8052410 con 0x5608da174660 2024-05-08T18:50:50.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.108+0000 7f7eb4608640 1 -- 172.21.15.132:0/2001996571 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb8062070 con 0x5608da174660 2024-05-08T18:50:50.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.108+0000 7f7eb4608640 1 -- 172.21.15.132:0/2001996571 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb8052700 con 0x5608da174660 2024-05-08T18:50:50.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.109+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2001996571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da174660 msgr2=0x5608da173d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.109+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/2001996571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da174660 0x5608da173d60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800a190 tx=0x7f7fb804c000 comp rx=0 tx=0).stop 2024-05-08T18:50:50.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.109+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2001996571 shutdown_connections 2024-05-08T18:50:50.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.109+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/2001996571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da174660 0x5608da173d60 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.109+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2001996571 >> 172.21.15.132:0/2001996571 conn(0x5608da16eec0 msgr2=0x5608da260cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.109+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2001996571 shutdown_connections 2024-05-08T18:50:50.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.109+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2001996571 wait complete. 2024-05-08T18:50:50.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.109+0000 7f7fcaa11800 1 Processor -- start 2024-05-08T18:50:50.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.109+0000 7f7fcaa11800 1 -- start start 2024-05-08T18:50:50.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.109+0000 7f7fcaa11800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da174660 0x5608da26df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.109+0000 7f7fcaa11800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5608da17d8b0 con 0x5608da174660 2024-05-08T18:50:50.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.109+0000 7f7fc600d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da174660 0x5608da26df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.109+0000 7f7fc600d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da174660 0x5608da26df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33458/0 (socket says 172.21.15.132:33458) 2024-05-08T18:50:50.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.109+0000 7f7fc600d640 1 -- 172.21.15.132:0/4269360430 learned_addr learned my addr 172.21.15.132:0/4269360430 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.110+0000 7f7fc600d640 1 -- 172.21.15.132:0/4269360430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608da26e490 con 0x5608da174660 2024-05-08T18:50:50.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.110+0000 7f7fc600d640 1 --2- 172.21.15.132:0/4269360430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da174660 0x5608da26df50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7fb805f040 tx=0x7f7fb8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.110+0000 7f7eb2e05640 1 -- 172.21.15.132:0/4269360430 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb805d630 con 0x5608da174660 2024-05-08T18:50:50.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.110+0000 7f7eb2e05640 1 -- 172.21.15.132:0/4269360430 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb8058040 con 0x5608da174660 2024-05-08T18:50:50.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.110+0000 7f7fcaa11800 1 -- 172.21.15.132:0/4269360430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608da26e720 con 0x5608da174660 2024-05-08T18:50:50.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.110+0000 7f7eb2e05640 1 -- 172.21.15.132:0/4269360430 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb805d920 con 0x5608da174660 2024-05-08T18:50:50.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.110+0000 7f7fcaa11800 1 -- 172.21.15.132:0/4269360430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608da2713d0 con 0x5608da174660 2024-05-08T18:50:50.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.111+0000 7f7eb2e05640 1 -- 172.21.15.132:0/4269360430 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f7fb8050070 con 0x5608da174660 2024-05-08T18:50:50.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.111+0000 7f7eb2e05640 1 --2- 172.21.15.132:0/4269360430 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7eac03bba0 0x7f7eac03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.111+0000 7f7eb2e05640 1 -- 172.21.15.132:0/4269360430 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f7fb80947a0 con 0x5608da174660 2024-05-08T18:50:50.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.111+0000 7f7fc580c640 1 --2- 172.21.15.132:0/4269360430 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7eac03bba0 0x7f7eac03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.111+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/4269360430 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5608da1753e0 0x5608da275190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.111+0000 7f7fcaa11800 1 -- 172.21.15.132:0/4269360430 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da2756d0 con 0x5608da1753e0 2024-05-08T18:50:50.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.111+0000 7f7fc680e640 1 --2- 172.21.15.132:0/4269360430 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5608da1753e0 0x5608da275190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.112+0000 7f7fc580c640 1 --2- 172.21.15.132:0/4269360430 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7eac03bba0 0x7f7eac03e060 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc000c00 tx=0x7f7fbc0013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.112+0000 7f7fc680e640 1 --2- 172.21.15.132:0/4269360430 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5608da1753e0 0x5608da275190 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.112+0000 7f7fc680e640 1 -- 172.21.15.132:0/4269360430 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fc00083e0 con 0x5608da1753e0 2024-05-08T18:50:50.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.112+0000 7f7fcaa11800 1 -- 172.21.15.132:0/4269360430 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da272720 con 0x5608da1753e0 2024-05-08T18:50:50.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.112+0000 7f7fc680e640 1 -- 172.21.15.132:0/4269360430 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7fc00083e0 con 0x5608da1753e0 2024-05-08T18:50:50.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.112+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/4269360430 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5608da2779a0 0x5608da279d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.112+0000 7f7fcaa11800 1 -- 172.21.15.132:0/4269360430 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da27a460 con 0x5608da2779a0 2024-05-08T18:50:50.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.112+0000 7f7fc600d640 1 --2- 172.21.15.132:0/4269360430 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5608da2779a0 0x5608da279d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.113+0000 7f7fc600d640 1 --2- 172.21.15.132:0/4269360430 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5608da2779a0 0x5608da279d90 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.113+0000 7f7fc600d640 1 -- 172.21.15.132:0/4269360430 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7fb8077020 con 0x5608da2779a0 2024-05-08T18:50:50.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.113+0000 7f7fcaa11800 1 -- 172.21.15.132:0/4269360430 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da276810 con 0x5608da1753e0 2024-05-08T18:50:50.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.113+0000 7f7fc680e640 1 -- 172.21.15.132:0/4269360430 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7fc00083e0 con 0x5608da1753e0 2024-05-08T18:50:50.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.113+0000 7f7fcaa11800 1 -- 172.21.15.132:0/4269360430 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da276cf0 con 0x5608da1753e0 2024-05-08T18:50:50.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.113+0000 7f7fc680e640 1 -- 172.21.15.132:0/4269360430 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7fc00083e0 con 0x5608da1753e0 2024-05-08T18:50:50.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.114+0000 7f7fcaa11800 1 Processor -- start 2024-05-08T18:50:50.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.114+0000 7f7fcaa11800 1 -- start start 2024-05-08T18:50:50.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.114+0000 7f7fcaa11800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da2893c0 0x5608da2897e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.114+0000 7f7fcaa11800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5608da066fc0 con 0x5608da2893c0 2024-05-08T18:50:50.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.114+0000 7f7fc680e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da2893c0 0x5608da2897e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.114+0000 7f7fc680e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da2893c0 0x5608da2897e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33460/0 (socket says 172.21.15.132:33460) 2024-05-08T18:50:50.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.114+0000 7f7fc680e640 1 -- 172.21.15.132:0/21602913 learned_addr learned my addr 172.21.15.132:0/21602913 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.114+0000 7f7fc680e640 1 -- 172.21.15.132:0/21602913 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608da289d20 con 0x5608da2893c0 2024-05-08T18:50:50.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.114+0000 7f7fc680e640 1 --2- 172.21.15.132:0/21602913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da2893c0 0x5608da2897e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x5608da275a70 tx=0x7f7fc000aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.115+0000 7f7eabfff640 1 -- 172.21.15.132:0/21602913 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc0007d00 con 0x5608da2893c0 2024-05-08T18:50:50.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.115+0000 7f7eabfff640 1 -- 172.21.15.132:0/21602913 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc001e020 con 0x5608da2893c0 2024-05-08T18:50:50.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.115+0000 7f7fcaa11800 1 -- 172.21.15.132:0/21602913 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608da28a790 con 0x5608da2893c0 2024-05-08T18:50:50.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.115+0000 7f7eabfff640 1 -- 172.21.15.132:0/21602913 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc0019420 con 0x5608da2893c0 2024-05-08T18:50:50.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.115+0000 7f7fcaa11800 1 -- 172.21.15.132:0/21602913 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608da28ac90 con 0x5608da2893c0 2024-05-08T18:50:50.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.115+0000 7f7eabfff640 1 -- 172.21.15.132:0/21602913 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f7fc0016040 con 0x5608da2893c0 2024-05-08T18:50:50.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.116+0000 7f7eabfff640 1 --2- 172.21.15.132:0/21602913 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7ea003bba0 0x7f7ea003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.116+0000 7f7eabfff640 1 -- 172.21.15.132:0/21602913 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f7fc001f030 con 0x5608da2893c0 2024-05-08T18:50:50.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.116+0000 7f7fc600d640 1 --2- 172.21.15.132:0/21602913 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7ea003bba0 0x7f7ea003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.116+0000 7f7fcaa11800 1 Processor -- start 2024-05-08T18:50:50.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.116+0000 7f7fc600d640 1 --2- 172.21.15.132:0/21602913 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7ea003bba0 0x7f7ea003e060 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8044850 tx=0x7f7fb8092cd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.116+0000 7f7fcaa11800 1 -- start start 2024-05-08T18:50:50.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.116+0000 7f7fcaa11800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da296680 0x5608da296aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.116+0000 7f7fcaa11800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5608da269490 con 0x5608da296680 2024-05-08T18:50:50.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.116+0000 7f7fc680e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da296680 0x5608da296aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.116+0000 7f7fc680e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da296680 0x5608da296aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33472/0 (socket says 172.21.15.132:33472) 2024-05-08T18:50:50.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.116+0000 7f7fc680e640 1 -- 172.21.15.132:0/2657013611 learned_addr learned my addr 172.21.15.132:0/2657013611 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.117+0000 7f7fc680e640 1 -- 172.21.15.132:0/2657013611 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608da297070 con 0x5608da296680 2024-05-08T18:50:50.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.117+0000 7f7fc680e640 1 --2- 172.21.15.132:0/2657013611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da296680 0x5608da296aa0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0052c30 tx=0x7f7fc0015fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77681e85cbb92776 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.117+0000 7f7ea9ffb640 1 -- 172.21.15.132:0/2657013611 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc001d070 con 0x5608da296680 2024-05-08T18:50:50.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.117+0000 7f7ea9ffb640 1 -- 172.21.15.132:0/2657013611 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc0017bf0 con 0x5608da296680 2024-05-08T18:50:50.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.117+0000 7f7ea9ffb640 1 -- 172.21.15.132:0/2657013611 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc0054070 con 0x5608da296680 2024-05-08T18:50:50.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.117+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2657013611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da296680 msgr2=0x5608da296aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.117+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/2657013611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da296680 0x5608da296aa0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0052c30 tx=0x7f7fc0015fd0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.117+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2657013611 shutdown_connections 2024-05-08T18:50:50.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.117+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/2657013611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da296680 0x5608da296aa0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.118+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2657013611 >> 172.21.15.132:0/2657013611 conn(0x5608da292990 msgr2=0x5608da290a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.118+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2657013611 shutdown_connections 2024-05-08T18:50:50.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.118+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2657013611 wait complete. 2024-05-08T18:50:50.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.118+0000 7f7fcaa11800 1 Processor -- start 2024-05-08T18:50:50.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.118+0000 7f7fcaa11800 1 -- start start 2024-05-08T18:50:50.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.118+0000 7f7fcaa11800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da296680 0x5608da266b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.118+0000 7f7fcaa11800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5608da297840 con 0x5608da296680 2024-05-08T18:50:50.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.118+0000 7f7fc680e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da296680 0x5608da266b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.118+0000 7f7fc680e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da296680 0x5608da266b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33486/0 (socket says 172.21.15.132:33486) 2024-05-08T18:50:50.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.118+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 learned_addr learned my addr 172.21.15.132:0/2753425900 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.119+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608da265220 con 0x5608da296680 2024-05-08T18:50:50.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.119+0000 7f7fc680e640 1 --2- 172.21.15.132:0/2753425900 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da296680 0x5608da266b30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0016010 tx=0x7f7fc0052b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.119+0000 7f7e97fff640 1 -- 172.21.15.132:0/2753425900 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc0030020 con 0x5608da296680 2024-05-08T18:50:50.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.119+0000 7f7e97fff640 1 -- 172.21.15.132:0/2753425900 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc0048040 con 0x5608da296680 2024-05-08T18:50:50.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.119+0000 7f7e97fff640 1 -- 172.21.15.132:0/2753425900 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc0047070 con 0x5608da296680 2024-05-08T18:50:50.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.119+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608da2654b0 con 0x5608da296680 2024-05-08T18:50:50.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.119+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608da2659b0 con 0x5608da296680 2024-05-08T18:50:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.120+0000 7f7e97fff640 1 -- 172.21.15.132:0/2753425900 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f7fc0033020 con 0x5608da296680 2024-05-08T18:50:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.120+0000 7f7e97fff640 1 --2- 172.21.15.132:0/2753425900 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7e9003bba0 0x7f7e9003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.120+0000 7f7e97fff640 1 -- 172.21.15.132:0/2753425900 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f7fc0041b20 con 0x5608da296680 2024-05-08T18:50:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.120+0000 7f7fc600d640 1 --2- 172.21.15.132:0/2753425900 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7e9003bba0 0x7f7e9003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.121+0000 7f7fc600d640 1 --2- 172.21.15.132:0/2753425900 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7e9003bba0 0x7f7e9003e060 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80448a0 tx=0x7f7fb8086000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.121+0000 7f7fcaa11800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.121+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/2753425900 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5608da2ab920 0x5608da2adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.121+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da2ae530 con 0x5608da2ab920 2024-05-08T18:50:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.121+0000 7f7fc580c640 1 --2- 172.21.15.132:0/2753425900 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5608da2ab920 0x5608da2adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.121+0000 7f7fc580c640 1 --2- 172.21.15.132:0/2753425900 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5608da2ab920 0x5608da2adde0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.121+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fbc00f5f0 con 0x5608da2ab920 2024-05-08T18:50:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.122+0000 7f7fcaa11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.122+0000 7f7fcaa11800 20 realm 2024-05-08T18:50:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.122+0000 7f7fcaa11800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.122+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da2aad70 con 0x5608da2ab920 2024-05-08T18:50:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.122+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fbc00f5f0 con 0x5608da2ab920 2024-05-08T18:50:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.122+0000 7f7fcaa11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.122+0000 7f7fcaa11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.122+0000 7f7fcaa11800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.122+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da2af020 con 0x5608da2ab920 2024-05-08T18:50:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.122+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fbc00f5f0 con 0x5608da2ab920 2024-05-08T18:50:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.122+0000 7f7fcaa11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.122+0000 7f7fcaa11800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.122+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da2af8f0 con 0x5608da2ab920 2024-05-08T18:50:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.122+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7fbc00f5f0 con 0x5608da2ab920 2024-05-08T18:50:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.122+0000 7f7fcaa11800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.122+0000 7f7fcaa11800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.122+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/2753425900 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5608da2b0310 0x5608da2b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.122+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b2e70 con 0x5608da2b0310 2024-05-08T18:50:50.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.122+0000 7f7fc680e640 1 --2- 172.21.15.132:0/2753425900 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5608da2b0310 0x5608da2b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.123+0000 7f7fc680e640 1 --2- 172.21.15.132:0/2753425900 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5608da2b0310 0x5608da2b2700 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.123+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7fc00083e0 con 0x5608da2b0310 2024-05-08T18:50:50.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.123+0000 7f7fcaa11800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:50.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.123+0000 7f7fcaa11800 20 searching for the correct realm 2024-05-08T18:50:50.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.123+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x5608da2b0310 2024-05-08T18:50:50.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.123+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc00083e0 con 0x5608da2b0310 2024-05-08T18:50:50.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.123+0000 7f7fc680e640 1 --2- 172.21.15.132:0/2753425900 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f7fc0035020 0x7f7fc0023810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.123+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x7f7fc0035020 2024-05-08T18:50:50.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.123+0000 7f7fc600d640 1 --2- 172.21.15.132:0/2753425900 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f7fc0035020 0x7f7fc0023810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.124+0000 7f7fc600d640 1 --2- 172.21.15.132:0/2753425900 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f7fc0035020 0x7f7fc0023810 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.124+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb8077020 con 0x7f7fc0035020 2024-05-08T18:50:50.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.124+0000 7f7fc600d640 1 --2- 172.21.15.132:0/2753425900 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f7fb8052030 0x7f7fb80657c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.124+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x7f7fb8052030 2024-05-08T18:50:50.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.124+0000 7f7fc580c640 1 --2- 172.21.15.132:0/2753425900 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f7fb8052030 0x7f7fb80657c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.125+0000 7f7fc580c640 1 --2- 172.21.15.132:0/2753425900 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f7fb8052030 0x7f7fb80657c0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.125+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fbc00f5f0 con 0x7f7fb8052030 2024-05-08T18:50:50.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.125+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x5608da2ab920 2024-05-08T18:50:50.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.125+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fbc00f5f0 con 0x5608da2ab920 2024-05-08T18:50:50.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.125+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x5608da2ab920 2024-05-08T18:50:50.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.125+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fbc02b040 con 0x5608da2ab920 2024-05-08T18:50:50.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.125+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x7f7fb8052030 2024-05-08T18:50:50.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.126+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fbc02b040 con 0x7f7fb8052030 2024-05-08T18:50:50.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.126+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x7f7fb8052030 2024-05-08T18:50:50.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.126+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fbc02b040 con 0x7f7fb8052030 2024-05-08T18:50:50.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.126+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x7f7fc0035020 2024-05-08T18:50:50.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.126+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb8077020 con 0x7f7fc0035020 2024-05-08T18:50:50.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.126+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x5608da2b0310 2024-05-08T18:50:50.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.126+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc00083e0 con 0x5608da2b0310 2024-05-08T18:50:50.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.126+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x5608da2ab920 2024-05-08T18:50:50.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.127+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fbc02b040 con 0x5608da2ab920 2024-05-08T18:50:50.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.127+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x7f7fb8052030 2024-05-08T18:50:50.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.127+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fbc02b040 con 0x7f7fb8052030 2024-05-08T18:50:50.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.127+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x5608da2ab920 2024-05-08T18:50:50.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.127+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7fbc02b040 con 0x5608da2ab920 2024-05-08T18:50:50.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.127+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x7f7fc0035020 2024-05-08T18:50:50.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.127+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7fb8077020 con 0x7f7fc0035020 2024-05-08T18:50:50.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.127+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x5608da2b0310 2024-05-08T18:50:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.128+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7fc00083e0 con 0x5608da2b0310 2024-05-08T18:50:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.128+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x5608da2b0310 2024-05-08T18:50:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.128+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc00083e0 con 0x5608da2b0310 2024-05-08T18:50:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.128+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x7f7fb8052030 2024-05-08T18:50:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.128+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fbc02b040 con 0x7f7fb8052030 2024-05-08T18:50:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.128+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x5608da2b0310 2024-05-08T18:50:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.129+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc00083e0 con 0x5608da2b0310 2024-05-08T18:50:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.129+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x5608da2b0310 2024-05-08T18:50:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.129+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc00083e0 con 0x5608da2b0310 2024-05-08T18:50:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.129+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x5608da2ab920 2024-05-08T18:50:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.129+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fbc02b040 con 0x5608da2ab920 2024-05-08T18:50:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.129+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x5608da2ab920 2024-05-08T18:50:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.129+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7fbc02b040 con 0x5608da2ab920 2024-05-08T18:50:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.129+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x7f7fb8052030 2024-05-08T18:50:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.130+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fbc02b040 con 0x7f7fb8052030 2024-05-08T18:50:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.130+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x5608da2b0310 2024-05-08T18:50:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.130+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc00083e0 con 0x5608da2b0310 2024-05-08T18:50:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.130+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x7f7fc0035020 2024-05-08T18:50:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.130+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb8077020 con 0x7f7fc0035020 2024-05-08T18:50:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.130+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x5608da2ab920 2024-05-08T18:50:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.130+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fbc02b040 con 0x5608da2ab920 2024-05-08T18:50:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.130+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x7f7fb8052030 2024-05-08T18:50:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.131+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fbc03b040 con 0x7f7fb8052030 2024-05-08T18:50:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.131+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x5608da2b0310 2024-05-08T18:50:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.131+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc00083e0 con 0x5608da2b0310 2024-05-08T18:50:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.131+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x7f7fb8052030 2024-05-08T18:50:50.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.131+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fbc03b040 con 0x7f7fb8052030 2024-05-08T18:50:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.131+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x7f7fc0035020 2024-05-08T18:50:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.131+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb8077020 con 0x7f7fc0035020 2024-05-08T18:50:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.131+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x5608da2b0310 2024-05-08T18:50:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.132+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc00083e0 con 0x5608da2b0310 2024-05-08T18:50:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.132+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x7f7fb8052030 2024-05-08T18:50:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.132+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fbc03b040 con 0x7f7fb8052030 2024-05-08T18:50:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.132+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x5608da2ab920 2024-05-08T18:50:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.132+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7fbc03b040 con 0x5608da2ab920 2024-05-08T18:50:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.132+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b47c0 con 0x7f7fc0035020 2024-05-08T18:50:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb8077020 con 0x7f7fc0035020 2024-05-08T18:50:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:50.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:50.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:50.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:50.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b3830 con 0x5608da2ab920 2024-05-08T18:50:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x5608da2ab920 2024-05-08T18:50:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b40d0 con 0x5608da2ab920 2024-05-08T18:50:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7fbc03b040 con 0x5608da2ab920 2024-05-08T18:50:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b3470 con 0x5608da2ab920 2024-05-08T18:50:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7fbc03b040 con 0x5608da2ab920 2024-05-08T18:50:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 20 zone default found 2024-05-08T18:50:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 4 Realm: () 2024-05-08T18:50:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 20 zonegroup default 2024-05-08T18:50:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.133+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b4c40 con 0x7f7fb8052030 2024-05-08T18:50:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.134+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x7f7fb8052030 2024-05-08T18:50:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.134+0000 7f7fcaa11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.134+0000 7f7fcaa11800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.134+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b6a40 con 0x5608da2b0310 2024-05-08T18:50:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.134+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7fc00083e0 con 0x5608da2b0310 2024-05-08T18:50:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.134+0000 7f7fcaa11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.134+0000 7f7fcaa11800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.134+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b6de0 con 0x5608da2b0310 2024-05-08T18:50:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.134+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7fc00083e0 con 0x5608da2b0310 2024-05-08T18:50:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.134+0000 7f7fcaa11800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.134+0000 7f7fcaa11800 20 started sync module instance, tier type = 2024-05-08T18:50:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.134+0000 7f7fcaa11800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.134+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b5ee0 con 0x7f7fc0035020 2024-05-08T18:50:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.135+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb8077020 con 0x7f7fc0035020 2024-05-08T18:50:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.135+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94596020001328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b7210 con 0x7f7fc0035020 2024-05-08T18:50:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.135+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b7a60 con 0x5608da2ab920 2024-05-08T18:50:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.136+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94596020001328] v25'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb8077020 con 0x7f7fc0035020 2024-05-08T18:50:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.137+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x5608da2ab920 2024-05-08T18:50:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.137+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94596020008368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b7e80 con 0x5608da2ab920 2024-05-08T18:50:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.137+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b8710 con 0x5608da2b0310 2024-05-08T18:50:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.138+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc00083e0 con 0x5608da2b0310 2024-05-08T18:50:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.138+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94596020010624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b8320 con 0x5608da2b0310 2024-05-08T18:50:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.138+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b96c0 con 0x7f7fc0035020 2024-05-08T18:50:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.138+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94596020008368] v25'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x5608da2ab920 2024-05-08T18:50:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.139+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94596020010624] v25'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc00083e0 con 0x5608da2b0310 2024-05-08T18:50:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.139+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb8077020 con 0x7f7fc0035020 2024-05-08T18:50:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.139+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94596020013824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b91d0 con 0x7f7fc0035020 2024-05-08T18:50:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.139+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2ba100 con 0x5608da2ab920 2024-05-08T18:50:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.140+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x5608da2ab920 2024-05-08T18:50:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.140+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94596020018736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2ba840 con 0x5608da2ab920 2024-05-08T18:50:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.140+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2bb360 con 0x7f7fb8052030 2024-05-08T18:50:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.140+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94596020013824] v25'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb8077020 con 0x7f7fc0035020 2024-05-08T18:50:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.140+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94596020018736] v25'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x5608da2ab920 2024-05-08T18:50:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.141+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x7f7fb8052030 2024-05-08T18:50:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.141+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94596020022832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2bb320 con 0x7f7fb8052030 2024-05-08T18:50:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.141+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2bbc00 con 0x7f7fb8052030 2024-05-08T18:50:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.142+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94596020022832] v25'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x7f7fb8052030 2024-05-08T18:50:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.142+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x7f7fb8052030 2024-05-08T18:50:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.142+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94596020009424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2bb320 con 0x7f7fb8052030 2024-05-08T18:50:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.142+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2bc220 con 0x7f7fb8052030 2024-05-08T18:50:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.143+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94596020009424] v25'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x7f7fb8052030 2024-05-08T18:50:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.143+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x7f7fb8052030 2024-05-08T18:50:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.143+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94596020025088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2bc220 con 0x7f7fb8052030 2024-05-08T18:50:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.143+0000 7f7fcaa11800 20 add_watcher() i=0 2024-05-08T18:50:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.143+0000 7f7fcaa11800 20 add_watcher() i=1 2024-05-08T18:50:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.143+0000 7f7fcaa11800 20 add_watcher() i=2 2024-05-08T18:50:50.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.143+0000 7f7fcaa11800 20 add_watcher() i=3 2024-05-08T18:50:50.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.143+0000 7f7fcaa11800 20 add_watcher() i=4 2024-05-08T18:50:50.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.143+0000 7f7fcaa11800 20 add_watcher() i=5 2024-05-08T18:50:50.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.143+0000 7f7fcaa11800 20 add_watcher() i=6 2024-05-08T18:50:50.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.144+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94596020025088] v25'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x7f7fb8052030 2024-05-08T18:50:50.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.144+0000 7f7fcaa11800 20 add_watcher() i=7 2024-05-08T18:50:50.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.144+0000 7f7fcaa11800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:50.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.144+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da2bf530 con 0x5608da2ab920 2024-05-08T18:50:50.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.144+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7fbc03b040 con 0x5608da2ab920 2024-05-08T18:50:50.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.144+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94596020027104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2bc7b0 con 0x5608da2ab920 2024-05-08T18:50:50.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.145+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94596020027104] v25'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x5608da2ab920 2024-05-08T18:50:50.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.145+0000 7f7e7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:50.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.145+0000 7f7fcaa11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:50.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.145+0000 7f7fcaa11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:50.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.145+0000 7f7fcaa11800 5 note: GC not initialized 2024-05-08T18:50:50.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.146+0000 7f7df77fe640 20 reqs_thread_entry: start 2024-05-08T18:50:50.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.146+0000 7f7fcaa11800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:50.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.146+0000 7f7fcaa11800 20 Filter name: none 2024-05-08T18:50:50.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.146+0000 7f7df57fa640 20 reqs_thread_entry: start 2024-05-08T18:50:50.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.146+0000 7f7fcaa11800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-05-08T18:50:50.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.146+0000 7f7fcaa11800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.146+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da2f2c70 con 0x7f7fb8052030 2024-05-08T18:50:50.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.147+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f7fbc03b040 con 0x7f7fb8052030 2024-05-08T18:50:50.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.147+0000 7f7fcaa11800 20 rados_obj.operate() r=0 bl.length=419 2024-05-08T18:50:50.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.147+0000 7f7fcaa11800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-05-08T18:50:50.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.147+0000 7f7fcaa11800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-08T18:50:50.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.147+0000 7f7fcaa11800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:50.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.147+0000 7f7fcaa11800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:50:50.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.147+0000 7f7fcaa11800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.147+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da2f26c0 con 0x7f7fc0035020 2024-05-08T18:50:50.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.147+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f7fb8077020 con 0x7f7fc0035020 2024-05-08T18:50:50.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.147+0000 7f7fcaa11800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:50:50.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.147+0000 7f7fcaa11800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:50:50.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.147+0000 7f7fcaa11800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:50:50.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.147+0000 7f7fcaa11800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 : miss 2024-05-08T18:50:50.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.147+0000 7f7fcaa11800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.147+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:64 8.1e 8:7ec7f916:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da2f66f0 con 0x7f7fb8052030 2024-05-08T18:50:50.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.148+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(64 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f7fbc03b040 con 0x7f7fb8052030 2024-05-08T18:50:50.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.148+0000 7f7fcaa11800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:50:50.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.148+0000 7f7fcaa11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 info.flags=0x17 2024-05-08T18:50:50.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.148+0000 7f7fcaa11800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 to cache LRU end 2024-05-08T18:50:50.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.148+0000 7f7fcaa11800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:50.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.148+0000 7f7fcaa11800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:50:50.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.148+0000 7f7fcaa11800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 2024-05-08T18:50:50.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.148+0000 7f7fcaa11800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-05-08T18:50:50.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.148+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2fadd0 con 0x7f7fc0035020 2024-05-08T18:50:50.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.149+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(65 foo.buckets [call] v25'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7fb8077020 con 0x7f7fc0035020 2024-05-08T18:50:50.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.149+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:66 8.1d 8:bea43900:root::.bucket.meta.testx%3amyfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2fe6e0 con 0x7f7fb8052030 2024-05-08T18:50:50.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.150+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [create,call,writefull 0~412,setxattr (203)] v25'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x7f7fb8052030 2024-05-08T18:50:50.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.150+0000 7f7fcaa11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 info.flags=0x7 2024-05-08T18:50:50.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.150+0000 7f7fcaa11800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 to cache LRU end 2024-05-08T18:50:50.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.150+0000 7f7fcaa11800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-05-08T18:50:50.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.150+0000 7f7fcaa11800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1, ofs0, ns] 2024-05-08T18:50:50.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.150+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94596020290832 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da2fe1f0 con 0x7f7fb8052030 2024-05-08T18:50:50.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.150+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== watch-notify(notify (1) cookie 94596020025088 notify 107374182408 ret 0) ==== 889+0+0 (crc 0 0 0) 0x5608da2fea80 con 0x7f7fb8052030 2024-05-08T18:50:50.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.150+0000 7f7ea9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182408 cookie 94596020025088 notifier 4536 bl.length()=847 2024-05-08T18:50:50.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.150+0000 7f7ea9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 info.flags=0x7 2024-05-08T18:50:50.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.150+0000 7f7ea9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 to cache LRU end 2024-05-08T18:50:50.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.150+0000 7f7ea9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-05-08T18:50:50.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.150+0000 7f7ea9ffb640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f7e8c003ea0 con 0x7f7fb8052030 2024-05-08T18:50:50.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.150+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(67 notify.7 [notify cookie 94596020290832 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7fbc03b040 con 0x7f7fb8052030 2024-05-08T18:50:50.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.151+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x7f7fb8052030 2024-05-08T18:50:50.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.151+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== watch-notify(notify_complete (2) cookie 94596020290832 notify 107374182408 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5608da2fa8d0 con 0x7f7fb8052030 2024-05-08T18:50:50.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.151+0000 7f7fcaa11800 20 handle_bi_update(): bucket=testx:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): orig_sources= new_sources= 2024-05-08T18:50:50.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.151+0000 7f7fcaa11800 20 handle_bi_update(): bucket=testx:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): potential sources added=[] removed=[] 2024-05-08T18:50:50.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.151+0000 7f7fcaa11800 20 handle_bi_update(): bucket=testx:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): orig_dests= new_dests= 2024-05-08T18:50:50.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.151+0000 7f7fcaa11800 20 handle_bi_update(): bucket=testx:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): potential dests added=[] removed=[] 2024-05-08T18:50:50.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.151+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2fe190 con 0x5608da2ab920 2024-05-08T18:50:50.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.152+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v25'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x5608da2ab920 2024-05-08T18:50:50.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.152+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2fe190 con 0x5608da2ab920 2024-05-08T18:50:50.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.153+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v25'3 uv3 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x5608da2ab920 2024-05-08T18:50:50.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.153+0000 7f7fcaa11800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-05-08T18:50:50.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.153+0000 7f7fcaa11800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-05-08T18:50:50.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.153+0000 7f7fcaa11800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-05-08T18:50:50.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.153+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94596020296928 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da2fe100 con 0x5608da2ab920 2024-05-08T18:50:50.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.153+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== watch-notify(notify (1) cookie 94596020018736 notify 107374182411 ret 0) ==== 390+0+0 (crc 0 0 0) 0x5608da2fe530 con 0x5608da2ab920 2024-05-08T18:50:50.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.153+0000 7f7ea97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182411 cookie 94596020018736 notifier 4536 bl.length()=348 2024-05-08T18:50:50.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.153+0000 7f7ea97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-05-08T18:50:50.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.153+0000 7f7ea97fa640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-05-08T18:50:50.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.153+0000 7f7ea97fa640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f7dfc003400 con 0x5608da2ab920 2024-05-08T18:50:50.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.153+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(71 notify.4 [notify cookie 94596020296928 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7fbc03b040 con 0x5608da2ab920 2024-05-08T18:50:50.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.154+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x5608da2ab920 2024-05-08T18:50:50.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.154+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== watch-notify(notify_complete (2) cookie 94596020296928 notify 107374182411 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5608da2fd520 con 0x5608da2ab920 2024-05-08T18:50:50.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.154+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2fe190 con 0x7f7fc0035020 2024-05-08T18:50:50.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.155+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(73 myfoo [call,delete] v25'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f7fb8077020 con 0x7f7fc0035020 2024-05-08T18:50:50.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.155+0000 7f7fcaa11800 10 removing default.rgw.meta+root+myfoo from cache 2024-05-08T18:50:50.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.155+0000 7f7fcaa11800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:50:50.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.155+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94596020296928 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da2fe100 con 0x7f7fb8052030 2024-05-08T18:50:50.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.155+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== watch-notify(notify (1) cookie 94596020009424 notify 107374182409 ret 0) ==== 191+0+0 (crc 0 0 0) 0x5608da2fd520 con 0x7f7fb8052030 2024-05-08T18:50:50.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.155+0000 7f7ea9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182409 cookie 94596020009424 notifier 4536 bl.length()=149 2024-05-08T18:50:50.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.155+0000 7f7ea9ffb640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f7e8c003ea0 con 0x7f7fb8052030 2024-05-08T18:50:50.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.155+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(74 notify.6 [notify cookie 94596020296928 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7fbc03b040 con 0x7f7fb8052030 2024-05-08T18:50:50.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.156+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x7f7fb8052030 2024-05-08T18:50:50.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.156+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== watch-notify(notify_complete (2) cookie 94596020296928 notify 107374182409 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5608da2fa8d0 con 0x7f7fb8052030 2024-05-08T18:50:50.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.156+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:76 8.1e 8:7ec7f916:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2fe190 con 0x7f7fb8052030 2024-05-08T18:50:50.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.157+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 28 ==== osd_op_reply(76 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [call,delete] v25'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x7f7fb8052030 2024-05-08T18:50:50.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.157+0000 7f7fcaa11800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 from cache 2024-05-08T18:50:50.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.157+0000 7f7fcaa11800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1, ofs0, ns] 2024-05-08T18:50:50.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.157+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94596020268400 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5608da2fe190 con 0x7f7fc0035020 2024-05-08T18:50:50.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.157+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== watch-notify(notify (1) cookie 94596020001328 notify 107374182422 ret 0) ==== 248+0+0 (crc 0 0 0) 0x7f7fb80a8060 con 0x7f7fc0035020 2024-05-08T18:50:50.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.157+0000 7f7ea97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182422 cookie 94596020001328 notifier 4536 bl.length()=206 2024-05-08T18:50:50.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.157+0000 7f7ea97fa640 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f7dfc003400 con 0x7f7fc0035020 2024-05-08T18:50:50.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.157+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(77 notify.0 [notify cookie 94596020268400 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7fb8077020 con 0x7f7fc0035020 2024-05-08T18:50:50.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.158+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== watch-notify(notify_complete (2) cookie 94596020268400 notify 107374182422 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5608da2713d0 con 0x7f7fc0035020 2024-05-08T18:50:50.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.158+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(78 notify.0 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb8077020 con 0x7f7fc0035020 2024-05-08T18:50:50.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.158+0000 7f7e7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:50.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.158+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94596020027104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2fdce0 con 0x5608da2ab920 2024-05-08T18:50:50.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.159+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94596020027104] v25'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x5608da2ab920 2024-05-08T18:50:50.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.159+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94596020001328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2bbee0 con 0x7f7fc0035020 2024-05-08T18:50:50.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.160+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94596020001328] v25'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb8077020 con 0x7f7fc0035020 2024-05-08T18:50:50.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.160+0000 7f7fcaa11800 20 remove_watcher() i=0 2024-05-08T18:50:50.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.160+0000 7f7fcaa11800 2 removed watcher, disabling cache 2024-05-08T18:50:50.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.160+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94596020008368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2bbee0 con 0x5608da2ab920 2024-05-08T18:50:50.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.162+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94596020008368] v25'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x5608da2ab920 2024-05-08T18:50:50.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.162+0000 7f7fcaa11800 20 remove_watcher() i=1 2024-05-08T18:50:50.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.162+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94596020010624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b75b0 con 0x5608da2b0310 2024-05-08T18:50:50.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.163+0000 7f7fc680e640 1 -- 172.21.15.132:0/2753425900 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94596020010624] v25'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc00083e0 con 0x5608da2b0310 2024-05-08T18:50:50.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.163+0000 7f7fcaa11800 20 remove_watcher() i=2 2024-05-08T18:50:50.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.163+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94596020013824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2bbee0 con 0x7f7fc0035020 2024-05-08T18:50:50.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.164+0000 7f7fc600d640 1 -- 172.21.15.132:0/2753425900 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94596020013824] v25'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb8077020 con 0x7f7fc0035020 2024-05-08T18:50:50.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.164+0000 7f7fcaa11800 20 remove_watcher() i=3 2024-05-08T18:50:50.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.164+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94596020018736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b7e80 con 0x5608da2ab920 2024-05-08T18:50:50.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.165+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94596020018736] v25'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x5608da2ab920 2024-05-08T18:50:50.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.165+0000 7f7fcaa11800 20 remove_watcher() i=4 2024-05-08T18:50:50.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.165+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94596020022832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2b75b0 con 0x7f7fb8052030 2024-05-08T18:50:50.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.166+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 29 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94596020022832] v25'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x7f7fb8052030 2024-05-08T18:50:50.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.166+0000 7f7fcaa11800 20 remove_watcher() i=5 2024-05-08T18:50:50.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.166+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94596020009424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2bbee0 con 0x7f7fb8052030 2024-05-08T18:50:50.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.167+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 30 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94596020009424] v25'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x7f7fb8052030 2024-05-08T18:50:50.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.167+0000 7f7fcaa11800 20 remove_watcher() i=6 2024-05-08T18:50:50.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.167+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94596020025088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5608da2bbee0 con 0x7f7fb8052030 2024-05-08T18:50:50.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.168+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 <== osd.0 v2:172.21.15.42:6800/1521799280 31 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94596020025088] v25'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fbc03b040 con 0x7f7fb8052030 2024-05-08T18:50:50.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.168+0000 7f7fcaa11800 20 remove_watcher() i=7 2024-05-08T18:50:50.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.168+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f7fb8052030 msgr2=0x7f7fb80657c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.168+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/2753425900 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f7fb8052030 0x7f7fb80657c0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.168+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5608da2ab920 msgr2=0x5608da2adde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.168+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/2753425900 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5608da2ab920 0x5608da2adde0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.168+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f7fc0035020 msgr2=0x7f7fc0023810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.168+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/2753425900 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f7fc0035020 0x7f7fc0023810 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.168+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5608da2b0310 msgr2=0x5608da2b2700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.168+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/2753425900 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5608da2b0310 0x5608da2b2700 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.168+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7e9003bba0 msgr2=0x7f7e9003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.168+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/2753425900 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7e9003bba0 0x7f7e9003e060 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80448a0 tx=0x7f7fb8086000 comp rx=0 tx=0).stop 2024-05-08T18:50:50.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.168+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da296680 msgr2=0x5608da266b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.168+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/2753425900 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da296680 0x5608da266b30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0016010 tx=0x7f7fc0052b90 comp rx=0 tx=0).stop 2024-05-08T18:50:50.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.168+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 reap_dead start 2024-05-08T18:50:50.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.168+0000 7f7fc580c640 1 -- 172.21.15.132:0/2753425900 reap_dead start 2024-05-08T18:50:50.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.168+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 shutdown_connections 2024-05-08T18:50:50.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.168+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 >> 172.21.15.132:0/2753425900 conn(0x5608da292990 msgr2=0x5608da290040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.168+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 shutdown_connections 2024-05-08T18:50:50.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.168+0000 7f7fcaa11800 1 -- 172.21.15.132:0/2753425900 wait complete. 2024-05-08T18:50:50.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 -- 172.21.15.132:0/21602913 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7ea003bba0 msgr2=0x7f7ea003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/21602913 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7ea003bba0 0x7f7ea003e060 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8044850 tx=0x7f7fb8092cd0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 -- 172.21.15.132:0/21602913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da2893c0 msgr2=0x5608da2897e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/21602913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da2893c0 0x5608da2897e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x5608da275a70 tx=0x7f7fc000aea0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 -- 172.21.15.132:0/21602913 shutdown_connections 2024-05-08T18:50:50.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/21602913 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7ea003bba0 0x7f7ea003e060 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/21602913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da2893c0 0x5608da2897e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 -- 172.21.15.132:0/21602913 >> 172.21.15.132:0/21602913 conn(0x5608da27d460 msgr2=0x5608da27d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 -- 172.21.15.132:0/21602913 shutdown_connections 2024-05-08T18:50:50.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 -- 172.21.15.132:0/21602913 wait complete. 2024-05-08T18:50:50.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 -- 172.21.15.132:0/4269360430 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5608da1753e0 msgr2=0x5608da275190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/4269360430 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5608da1753e0 0x5608da275190 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 -- 172.21.15.132:0/4269360430 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5608da2779a0 msgr2=0x5608da279d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/4269360430 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5608da2779a0 0x5608da279d90 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 -- 172.21.15.132:0/4269360430 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7eac03bba0 msgr2=0x7f7eac03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/4269360430 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7eac03bba0 0x7f7eac03e060 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc000c00 tx=0x7f7fbc0013b0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 -- 172.21.15.132:0/4269360430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da174660 msgr2=0x5608da26df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/4269360430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da174660 0x5608da26df50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7fb805f040 tx=0x7f7fb8003330 comp rx=0 tx=0).stop 2024-05-08T18:50:50.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 -- 172.21.15.132:0/4269360430 shutdown_connections 2024-05-08T18:50:50.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/4269360430 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5608da2779a0 0x5608da279d90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/4269360430 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5608da1753e0 0x5608da275190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/4269360430 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7eac03bba0 0x7f7eac03e060 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 --2- 172.21.15.132:0/4269360430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5608da174660 0x5608da26df50 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 -- 172.21.15.132:0/4269360430 >> 172.21.15.132:0/4269360430 conn(0x5608da16eec0 msgr2=0x5608da25f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 -- 172.21.15.132:0/4269360430 shutdown_connections 2024-05-08T18:50:50.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.169+0000 7f7fcaa11800 1 -- 172.21.15.132:0/4269360430 wait complete. 2024-05-08T18:50:50.182 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-05-08T18:50:50.182 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-05-08T18:50:50.182 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-05-08T18:50:50.225 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:50.225 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:50.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.227+0000 7f2289127800 1 Processor -- start 2024-05-08T18:50:50.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.227+0000 7f2289127800 1 -- start start 2024-05-08T18:50:50.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.227+0000 7f2289127800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x563d6633a690 0x563d6633ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.227+0000 7f2289127800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563d6633cfc0 con 0x563d66337740 2024-05-08T18:50:50.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.227+0000 7f2289127800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x563d661d7e20 con 0x563d6633a690 2024-05-08T18:50:50.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.227+0000 7f227ffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x563d6633a690 0x563d6633ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.227+0000 7f227ffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x563d6633a690 0x563d6633ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33496/0 (socket says 172.21.15.132:33496) 2024-05-08T18:50:50.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.227+0000 7f227ffff640 1 -- 172.21.15.132:0/1833829027 learned_addr learned my addr 172.21.15.132:0/1833829027 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.228+0000 7f227ffff640 1 -- 172.21.15.132:0/1833829027 >> v1:172.21.15.42:6789/0 conn(0x563d66337740 legacy=0x563d66337b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.228+0000 7f227ffff640 1 -- 172.21.15.132:0/1833829027 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d6633e1d0 con 0x563d6633a690 2024-05-08T18:50:50.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.230+0000 7f227ffff640 1 --2- 172.21.15.132:0/1833829027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6633a690 0x563d6633ca80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f227000a520 tx=0x7f227001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fe1cb20625c3c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.230+0000 7f227f7fe640 1 -- 172.21.15.132:0/1833829027 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2270057070 con 0x563d6633a690 2024-05-08T18:50:50.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.230+0000 7f227f7fe640 1 -- 172.21.15.132:0/1833829027 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2270052570 con 0x563d6633a690 2024-05-08T18:50:50.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.230+0000 7f227f7fe640 1 -- 172.21.15.132:0/1833829027 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f227004ae60 con 0x563d6633a690 2024-05-08T18:50:50.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.230+0000 7f2289127800 1 -- 172.21.15.132:0/1833829027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6633a690 msgr2=0x563d6633ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.230+0000 7f2289127800 1 --2- 172.21.15.132:0/1833829027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6633a690 0x563d6633ca80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f227000a520 tx=0x7f227001d010 comp rx=0 tx=0).stop 2024-05-08T18:50:50.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.230+0000 7f2289127800 1 -- 172.21.15.132:0/1833829027 shutdown_connections 2024-05-08T18:50:50.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.230+0000 7f2289127800 1 --2- 172.21.15.132:0/1833829027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6633a690 0x563d6633ca80 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.230+0000 7f2289127800 1 -- 172.21.15.132:0/1833829027 >> 172.21.15.132:0/1833829027 conn(0x563d66330ea0 msgr2=0x563d663332c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.230+0000 7f2289127800 1 -- 172.21.15.132:0/1833829027 shutdown_connections 2024-05-08T18:50:50.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.230+0000 7f2289127800 1 -- 172.21.15.132:0/1833829027 wait complete. 2024-05-08T18:50:50.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.244+0000 7f2289127800 1 Processor -- start 2024-05-08T18:50:50.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.244+0000 7f2289127800 1 -- start start 2024-05-08T18:50:50.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.244+0000 7f2289127800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d66337740 0x563d66427550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.244+0000 7f2289127800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563d662825b0 con 0x563d66337740 2024-05-08T18:50:50.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.245+0000 7f2284ee4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d66337740 0x563d66427550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.245+0000 7f2284ee4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d66337740 0x563d66427550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33508/0 (socket says 172.21.15.132:33508) 2024-05-08T18:50:50.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.245+0000 7f2284ee4640 1 -- 172.21.15.132:0/4287432613 learned_addr learned my addr 172.21.15.132:0/4287432613 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.245+0000 7f2284ee4640 1 -- 172.21.15.132:0/4287432613 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d66427b20 con 0x563d66337740 2024-05-08T18:50:50.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.245+0000 7f2284ee4640 1 --2- 172.21.15.132:0/4287432613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d66337740 0x563d66427550 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2278001e90 tx=0x7f227800d880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a94d33ed74c92 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.245+0000 7f2172e05640 1 -- 172.21.15.132:0/4287432613 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f227800b7d0 con 0x563d66337740 2024-05-08T18:50:50.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.245+0000 7f2172e05640 1 -- 172.21.15.132:0/4287432613 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f227800b9b0 con 0x563d66337740 2024-05-08T18:50:50.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.245+0000 7f2172e05640 1 -- 172.21.15.132:0/4287432613 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f227800bd10 con 0x563d66337740 2024-05-08T18:50:50.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.246+0000 7f2289127800 1 -- 172.21.15.132:0/4287432613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d66337740 msgr2=0x563d66427550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.246+0000 7f2289127800 1 --2- 172.21.15.132:0/4287432613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d66337740 0x563d66427550 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2278001e90 tx=0x7f227800d880 comp rx=0 tx=0).stop 2024-05-08T18:50:50.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.246+0000 7f2289127800 1 -- 172.21.15.132:0/4287432613 shutdown_connections 2024-05-08T18:50:50.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.246+0000 7f2289127800 1 --2- 172.21.15.132:0/4287432613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d66337740 0x563d66427550 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.246+0000 7f2289127800 1 -- 172.21.15.132:0/4287432613 >> 172.21.15.132:0/4287432613 conn(0x563d66330ea0 msgr2=0x563d66422e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.246+0000 7f2289127800 1 -- 172.21.15.132:0/4287432613 shutdown_connections 2024-05-08T18:50:50.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.246+0000 7f2289127800 1 -- 172.21.15.132:0/4287432613 wait complete. 2024-05-08T18:50:50.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.246+0000 7f2289127800 1 Processor -- start 2024-05-08T18:50:50.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.246+0000 7f2289127800 1 -- start start 2024-05-08T18:50:50.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.247+0000 7f2289127800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d66337740 0x563d664323c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.247+0000 7f2289127800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563d6633d490 con 0x563d66337740 2024-05-08T18:50:50.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.247+0000 7f2284ee4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d66337740 0x563d664323c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.247+0000 7f2284ee4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d66337740 0x563d664323c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33518/0 (socket says 172.21.15.132:33518) 2024-05-08T18:50:50.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.247+0000 7f2284ee4640 1 -- 172.21.15.132:0/3535017822 learned_addr learned my addr 172.21.15.132:0/3535017822 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.247+0000 7f2284ee4640 1 -- 172.21.15.132:0/3535017822 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d66432900 con 0x563d66337740 2024-05-08T18:50:50.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.247+0000 7f2284ee4640 1 --2- 172.21.15.132:0/3535017822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d66337740 0x563d664323c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2278002000 tx=0x7f2278000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.247+0000 7f2171602640 1 -- 172.21.15.132:0/3535017822 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2278016690 con 0x563d66337740 2024-05-08T18:50:50.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.247+0000 7f2171602640 1 -- 172.21.15.132:0/3535017822 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2278016830 con 0x563d66337740 2024-05-08T18:50:50.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.247+0000 7f2289127800 1 -- 172.21.15.132:0/3535017822 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d66432b90 con 0x563d66337740 2024-05-08T18:50:50.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.247+0000 7f2171602640 1 -- 172.21.15.132:0/3535017822 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2278016b30 con 0x563d66337740 2024-05-08T18:50:50.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.248+0000 7f2289127800 1 -- 172.21.15.132:0/3535017822 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d66435840 con 0x563d66337740 2024-05-08T18:50:50.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.248+0000 7f2171602640 1 -- 172.21.15.132:0/3535017822 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2278016cd0 con 0x563d66337740 2024-05-08T18:50:50.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.249+0000 7f2171602640 1 --2- 172.21.15.132:0/3535017822 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f216c03bb50 0x7f216c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.249+0000 7f2171602640 1 -- 172.21.15.132:0/3535017822 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f2278051f50 con 0x563d66337740 2024-05-08T18:50:50.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.249+0000 7f227ffff640 1 --2- 172.21.15.132:0/3535017822 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f216c03bb50 0x7f216c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.249+0000 7f2289127800 1 --2- 172.21.15.132:0/3535017822 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x563d6633a690 0x563d66439600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.249+0000 7f2289127800 1 -- 172.21.15.132:0/3535017822 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563d66439b40 con 0x563d6633a690 2024-05-08T18:50:50.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.249+0000 7f22856e5640 1 --2- 172.21.15.132:0/3535017822 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x563d6633a690 0x563d66439600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.249+0000 7f227ffff640 1 --2- 172.21.15.132:0/3535017822 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f216c03bb50 0x7f216c03e010 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2270054000 tx=0x7f227004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.249+0000 7f22856e5640 1 --2- 172.21.15.132:0/3535017822 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x563d6633a690 0x563d66439600 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.250+0000 7f22856e5640 1 -- 172.21.15.132:0/3535017822 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f228000a4a0 con 0x563d6633a690 2024-05-08T18:50:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.250+0000 7f2289127800 1 -- 172.21.15.132:0/3535017822 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563d66436bd0 con 0x563d6633a690 2024-05-08T18:50:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.250+0000 7f22856e5640 1 -- 172.21.15.132:0/3535017822 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f228000a4a0 con 0x563d6633a690 2024-05-08T18:50:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.250+0000 7f2289127800 1 --2- 172.21.15.132:0/3535017822 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x563d6643be90 0x563d6643e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.250+0000 7f2289127800 1 -- 172.21.15.132:0/3535017822 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563d6643e970 con 0x563d6643be90 2024-05-08T18:50:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.250+0000 7f2284ee4640 1 --2- 172.21.15.132:0/3535017822 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x563d6643be90 0x563d6643e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.250+0000 7f2284ee4640 1 --2- 172.21.15.132:0/3535017822 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x563d6643be90 0x563d6643e280 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.250+0000 7f2284ee4640 1 -- 172.21.15.132:0/3535017822 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2278027020 con 0x563d6643be90 2024-05-08T18:50:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.250+0000 7f2289127800 1 -- 172.21.15.132:0/3535017822 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563d6643ad30 con 0x563d6633a690 2024-05-08T18:50:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.251+0000 7f22856e5640 1 -- 172.21.15.132:0/3535017822 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f228000a4a0 con 0x563d6633a690 2024-05-08T18:50:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.251+0000 7f2289127800 1 -- 172.21.15.132:0/3535017822 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563d6643b210 con 0x563d6633a690 2024-05-08T18:50:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.251+0000 7f22856e5640 1 -- 172.21.15.132:0/3535017822 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f228000a4a0 con 0x563d6633a690 2024-05-08T18:50:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.251+0000 7f2289127800 1 Processor -- start 2024-05-08T18:50:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.251+0000 7f2289127800 1 -- start start 2024-05-08T18:50:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.251+0000 7f2289127800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6644d8f0 0x563d6644dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.251+0000 7f2289127800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563d66228fc0 con 0x563d6644d8f0 2024-05-08T18:50:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.252+0000 7f22856e5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6644d8f0 0x563d6644dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.252+0000 7f22856e5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6644d8f0 0x563d6644dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33534/0 (socket says 172.21.15.132:33534) 2024-05-08T18:50:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.252+0000 7f22856e5640 1 -- 172.21.15.132:0/1817381001 learned_addr learned my addr 172.21.15.132:0/1817381001 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.252+0000 7f22856e5640 1 -- 172.21.15.132:0/1817381001 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d6644e250 con 0x563d6644d8f0 2024-05-08T18:50:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.252+0000 7f22856e5640 1 --2- 172.21.15.132:0/1817381001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6644d8f0 0x563d6644dd10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x563d66439f40 tx=0x7f2280018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.252+0000 7f216a7fc640 1 -- 172.21.15.132:0/1817381001 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2280014450 con 0x563d6644d8f0 2024-05-08T18:50:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.253+0000 7f216a7fc640 1 -- 172.21.15.132:0/1817381001 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2280014610 con 0x563d6644d8f0 2024-05-08T18:50:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.253+0000 7f216a7fc640 1 -- 172.21.15.132:0/1817381001 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2280014930 con 0x563d6644d8f0 2024-05-08T18:50:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.253+0000 7f2289127800 1 -- 172.21.15.132:0/1817381001 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d6644ecc0 con 0x563d6644d8f0 2024-05-08T18:50:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.253+0000 7f2289127800 1 -- 172.21.15.132:0/1817381001 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d6644f1c0 con 0x563d6644d8f0 2024-05-08T18:50:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.253+0000 7f216a7fc640 1 -- 172.21.15.132:0/1817381001 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2280011040 con 0x563d6644d8f0 2024-05-08T18:50:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.253+0000 7f216a7fc640 1 --2- 172.21.15.132:0/1817381001 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f215c03bba0 0x7f215c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.254+0000 7f216a7fc640 1 -- 172.21.15.132:0/1817381001 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f228001e070 con 0x563d6644d8f0 2024-05-08T18:50:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.254+0000 7f2284ee4640 1 --2- 172.21.15.132:0/1817381001 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f215c03bba0 0x7f215c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.254+0000 7f2289127800 1 Processor -- start 2024-05-08T18:50:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.254+0000 7f2284ee4640 1 --2- 172.21.15.132:0/1817381001 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f215c03bba0 0x7f215c03e060 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x563d66439fe0 tx=0x7f227803e050 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.254+0000 7f2289127800 1 -- start start 2024-05-08T18:50:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.254+0000 7f2289127800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6645ab20 0x563d6645af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.254+0000 7f2289127800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563d66427ea0 con 0x563d6645ab20 2024-05-08T18:50:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.254+0000 7f22856e5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6645ab20 0x563d6645af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.254+0000 7f22856e5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6645ab20 0x563d6645af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33544/0 (socket says 172.21.15.132:33544) 2024-05-08T18:50:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.254+0000 7f22856e5640 1 -- 172.21.15.132:0/1122059671 learned_addr learned my addr 172.21.15.132:0/1122059671 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.255+0000 7f22856e5640 1 -- 172.21.15.132:0/1122059671 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d6645b510 con 0x563d6645ab20 2024-05-08T18:50:50.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.255+0000 7f22856e5640 1 --2- 172.21.15.132:0/1122059671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6645ab20 0x563d6645af40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2280052c50 tx=0x7f2280011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9b65c9ca043693 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.255+0000 7f215bfff640 1 -- 172.21.15.132:0/1122059671 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2280047070 con 0x563d6645ab20 2024-05-08T18:50:50.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.255+0000 7f215bfff640 1 -- 172.21.15.132:0/1122059671 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f228002b350 con 0x563d6645ab20 2024-05-08T18:50:50.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.255+0000 7f215bfff640 1 -- 172.21.15.132:0/1122059671 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2280028070 con 0x563d6645ab20 2024-05-08T18:50:50.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.255+0000 7f2289127800 1 -- 172.21.15.132:0/1122059671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6645ab20 msgr2=0x563d6645af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.255+0000 7f2289127800 1 --2- 172.21.15.132:0/1122059671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6645ab20 0x563d6645af40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2280052c50 tx=0x7f2280011a80 comp rx=0 tx=0).stop 2024-05-08T18:50:50.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.255+0000 7f2289127800 1 -- 172.21.15.132:0/1122059671 shutdown_connections 2024-05-08T18:50:50.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.255+0000 7f2289127800 1 --2- 172.21.15.132:0/1122059671 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6645ab20 0x563d6645af40 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.255+0000 7f2289127800 1 -- 172.21.15.132:0/1122059671 >> 172.21.15.132:0/1122059671 conn(0x563d66456e80 msgr2=0x563d66454ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.255+0000 7f2289127800 1 -- 172.21.15.132:0/1122059671 shutdown_connections 2024-05-08T18:50:50.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.255+0000 7f2289127800 1 -- 172.21.15.132:0/1122059671 wait complete. 2024-05-08T18:50:50.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.256+0000 7f2289127800 1 Processor -- start 2024-05-08T18:50:50.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.256+0000 7f2289127800 1 -- start start 2024-05-08T18:50:50.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.256+0000 7f2289127800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6645ab20 0x563d664620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.256+0000 7f2289127800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563d6645bc80 con 0x563d6645ab20 2024-05-08T18:50:50.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.256+0000 7f22856e5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6645ab20 0x563d664620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.256+0000 7f22856e5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6645ab20 0x563d664620f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33558/0 (socket says 172.21.15.132:33558) 2024-05-08T18:50:50.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.256+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 learned_addr learned my addr 172.21.15.132:0/3638644857 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.256+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d66462630 con 0x563d6645ab20 2024-05-08T18:50:50.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.256+0000 7f22856e5640 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6645ab20 0x563d664620f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2280014fd0 tx=0x7f2280052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.257+0000 7f215a7fc640 1 -- 172.21.15.132:0/3638644857 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2280047030 con 0x563d6645ab20 2024-05-08T18:50:50.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.257+0000 7f215a7fc640 1 -- 172.21.15.132:0/3638644857 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2280045070 con 0x563d6645ab20 2024-05-08T18:50:50.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.257+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563d664628c0 con 0x563d6645ab20 2024-05-08T18:50:50.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.257+0000 7f215a7fc640 1 -- 172.21.15.132:0/3638644857 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2280001770 con 0x563d6645ab20 2024-05-08T18:50:50.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.257+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d66465570 con 0x563d6645ab20 2024-05-08T18:50:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.257+0000 7f215a7fc640 1 -- 172.21.15.132:0/3638644857 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2280034020 con 0x563d6645ab20 2024-05-08T18:50:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.258+0000 7f215a7fc640 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f215003bba0 0x7f215003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.258+0000 7f215a7fc640 1 -- 172.21.15.132:0/3638644857 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f2280032020 con 0x563d6645ab20 2024-05-08T18:50:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.258+0000 7f2284ee4640 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f215003bba0 0x7f215003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.258+0000 7f2289127800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.258+0000 7f2289127800 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x563d6646dde0 0x563d66470280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.258+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563d664709d0 con 0x563d6646dde0 2024-05-08T18:50:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.258+0000 7f2284ee4640 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f215003bba0 0x7f215003e060 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2278020f20 tx=0x7f2278046000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.258+0000 7f227ffff640 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x563d6646dde0 0x563d66470280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.259+0000 7f227ffff640 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x563d6646dde0 0x563d66470280 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.259+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.259+0000 7f2289127800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.259+0000 7f2289127800 20 realm 2024-05-08T18:50:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.259+0000 7f2289127800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.259+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563d66470da0 con 0x563d6646dde0 2024-05-08T18:50:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.259+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.259+0000 7f2289127800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.259+0000 7f2289127800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.259+0000 7f2289127800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.259+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563d66471670 con 0x563d6646dde0 2024-05-08T18:50:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.259+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.259+0000 7f2289127800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.259+0000 7f2289127800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.259+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563d66471a10 con 0x563d6646dde0 2024-05-08T18:50:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.260+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.260+0000 7f2289127800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.260+0000 7f2289127800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.260+0000 7f2289127800 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x563d664724c0 0x563d664748b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.260+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563d66475010 con 0x563d664724c0 2024-05-08T18:50:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.260+0000 7f22856e5640 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x563d664724c0 0x563d664748b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.260+0000 7f22856e5640 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x563d664724c0 0x563d664748b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.260+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f228002a070 con 0x563d664724c0 2024-05-08T18:50:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.260+0000 7f2289127800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.260+0000 7f2289127800 20 searching for the correct realm 2024-05-08T18:50:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.260+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x563d664724c0 2024-05-08T18:50:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.261+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228002a070 con 0x563d664724c0 2024-05-08T18:50:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.261+0000 7f22856e5640 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2280014070 0x7f228002ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.261+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x7f2280014070 2024-05-08T18:50:50.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.261+0000 7f2284ee4640 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2280014070 0x7f228002ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.261+0000 7f2284ee4640 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2280014070 0x7f228002ca50 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.261+0000 7f2284ee4640 1 -- 172.21.15.132:0/3638644857 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2278027020 con 0x7f2280014070 2024-05-08T18:50:50.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.261+0000 7f2284ee4640 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f227801f370 0x7f227804a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.261+0000 7f2284ee4640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x7f227801f370 2024-05-08T18:50:50.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.262+0000 7f227ffff640 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f227801f370 0x7f227804a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.262+0000 7f227ffff640 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f227801f370 0x7f227804a430 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.262+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f227005a040 con 0x7f227801f370 2024-05-08T18:50:50.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.262+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x563d6646dde0 2024-05-08T18:50:50.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.262+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.262+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x563d6646dde0 2024-05-08T18:50:50.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.263+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.263+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x7f227801f370 2024-05-08T18:50:50.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.263+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f227005a040 con 0x7f227801f370 2024-05-08T18:50:50.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.263+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x7f227801f370 2024-05-08T18:50:50.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.263+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f227005a040 con 0x7f227801f370 2024-05-08T18:50:50.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.263+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x7f2280014070 2024-05-08T18:50:50.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.263+0000 7f2284ee4640 1 -- 172.21.15.132:0/3638644857 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2278027020 con 0x7f2280014070 2024-05-08T18:50:50.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.263+0000 7f2284ee4640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x563d664724c0 2024-05-08T18:50:50.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.264+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228002a070 con 0x563d664724c0 2024-05-08T18:50:50.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.264+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x563d6646dde0 2024-05-08T18:50:50.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.264+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.264+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x7f227801f370 2024-05-08T18:50:50.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.264+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f227005a040 con 0x7f227801f370 2024-05-08T18:50:50.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.264+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x563d6646dde0 2024-05-08T18:50:50.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.264+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.264+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x7f2280014070 2024-05-08T18:50:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.265+0000 7f2284ee4640 1 -- 172.21.15.132:0/3638644857 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2278027020 con 0x7f2280014070 2024-05-08T18:50:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.265+0000 7f2284ee4640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x563d664724c0 2024-05-08T18:50:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.265+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f228002a070 con 0x563d664724c0 2024-05-08T18:50:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.265+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x563d664724c0 2024-05-08T18:50:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.265+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228002a070 con 0x563d664724c0 2024-05-08T18:50:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.265+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x7f227801f370 2024-05-08T18:50:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.265+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f227005a040 con 0x7f227801f370 2024-05-08T18:50:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.265+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x563d664724c0 2024-05-08T18:50:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.266+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228002a070 con 0x563d664724c0 2024-05-08T18:50:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.266+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x563d664724c0 2024-05-08T18:50:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.266+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228002a070 con 0x563d664724c0 2024-05-08T18:50:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.266+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x563d6646dde0 2024-05-08T18:50:50.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.266+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.266+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x563d6646dde0 2024-05-08T18:50:50.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.266+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.266+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x7f227801f370 2024-05-08T18:50:50.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.267+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f227005a040 con 0x7f227801f370 2024-05-08T18:50:50.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.267+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x563d664724c0 2024-05-08T18:50:50.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.267+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228002a070 con 0x563d664724c0 2024-05-08T18:50:50.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.267+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x7f2280014070 2024-05-08T18:50:50.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.267+0000 7f2284ee4640 1 -- 172.21.15.132:0/3638644857 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2278027020 con 0x7f2280014070 2024-05-08T18:50:50.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.267+0000 7f2284ee4640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x563d6646dde0 2024-05-08T18:50:50.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.267+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.267+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x7f227801f370 2024-05-08T18:50:50.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.268+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f227005a040 con 0x7f227801f370 2024-05-08T18:50:50.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.268+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x563d664724c0 2024-05-08T18:50:50.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.268+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228002a070 con 0x563d664724c0 2024-05-08T18:50:50.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.268+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x7f227801f370 2024-05-08T18:50:50.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.268+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f227005a040 con 0x7f227801f370 2024-05-08T18:50:50.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.268+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x7f2280014070 2024-05-08T18:50:50.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.269+0000 7f2284ee4640 1 -- 172.21.15.132:0/3638644857 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2278027020 con 0x7f2280014070 2024-05-08T18:50:50.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.269+0000 7f2284ee4640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x563d664724c0 2024-05-08T18:50:50.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.269+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f228002a070 con 0x563d664724c0 2024-05-08T18:50:50.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.269+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x7f227801f370 2024-05-08T18:50:50.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.269+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f227005a040 con 0x7f227801f370 2024-05-08T18:50:50.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.269+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x563d6646dde0 2024-05-08T18:50:50.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.269+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.269+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x563d664769f0 con 0x7f2280014070 2024-05-08T18:50:50.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.270+0000 7f2284ee4640 1 -- 172.21.15.132:0/3638644857 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2278027020 con 0x7f2280014070 2024-05-08T18:50:50.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.270+0000 7f2289127800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:50.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.270+0000 7f2289127800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:50.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.270+0000 7f2289127800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:50.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.270+0000 7f2289127800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:50.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.270+0000 7f2289127800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:50.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.270+0000 7f2289127800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:50.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.270+0000 7f2289127800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.270+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563d66475ac0 con 0x563d6646dde0 2024-05-08T18:50:50.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.270+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.270+0000 7f2289127800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.270+0000 7f2289127800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.270+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563d66476360 con 0x563d6646dde0 2024-05-08T18:50:50.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.270+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.270+0000 7f2289127800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.270+0000 7f2289127800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.270+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563d66475700 con 0x563d6646dde0 2024-05-08T18:50:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f2289127800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f2289127800 20 zone default found 2024-05-08T18:50:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f2289127800 4 Realm: () 2024-05-08T18:50:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f2289127800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f2289127800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f2289127800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f2289127800 20 zonegroup default 2024-05-08T18:50:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f2289127800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563d66477370 con 0x7f227801f370 2024-05-08T18:50:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f227005a040 con 0x7f227801f370 2024-05-08T18:50:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f2289127800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f2289127800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563d66478db0 con 0x563d664724c0 2024-05-08T18:50:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f228002a070 con 0x563d664724c0 2024-05-08T18:50:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f2289127800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f2289127800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563d664792c0 con 0x563d664724c0 2024-05-08T18:50:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f228002a070 con 0x563d664724c0 2024-05-08T18:50:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f2289127800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f2289127800 20 started sync module instance, tier type = 2024-05-08T18:50:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f2289127800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.271+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d66478190 con 0x7f2280014070 2024-05-08T18:50:50.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.272+0000 7f2284ee4640 1 -- 172.21.15.132:0/3638644857 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2278027020 con 0x7f2280014070 2024-05-08T18:50:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.272+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94821708954848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d66479720 con 0x7f2280014070 2024-05-08T18:50:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.272+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d66479f70 con 0x563d6646dde0 2024-05-08T18:50:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.273+0000 7f2284ee4640 1 -- 172.21.15.132:0/3638644857 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94821708954848] v25'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2278027020 con 0x7f2280014070 2024-05-08T18:50:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.274+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.274+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94821708962496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d6647a390 con 0x563d6646dde0 2024-05-08T18:50:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.274+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d6647ac20 con 0x563d664724c0 2024-05-08T18:50:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.275+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f228002a070 con 0x563d664724c0 2024-05-08T18:50:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.275+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94821708964752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d6647a830 con 0x563d664724c0 2024-05-08T18:50:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.275+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d6647bbf0 con 0x7f2280014070 2024-05-08T18:50:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.275+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94821708962496] v25'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.276+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94821708964752] v25'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f228002a070 con 0x563d664724c0 2024-05-08T18:50:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.276+0000 7f2284ee4640 1 -- 172.21.15.132:0/3638644857 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2278027020 con 0x7f2280014070 2024-05-08T18:50:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.276+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94821708967952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d6647bbb0 con 0x7f2280014070 2024-05-08T18:50:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.276+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d6647c490 con 0x563d6646dde0 2024-05-08T18:50:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.277+0000 7f2284ee4640 1 -- 172.21.15.132:0/3638644857 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94821708967952] v25'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2278027020 con 0x7f2280014070 2024-05-08T18:50:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.277+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.277+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94821708969696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d6647bbb0 con 0x563d6646dde0 2024-05-08T18:50:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.277+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d6647cb90 con 0x7f227801f370 2024-05-08T18:50:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.278+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94821708969696] v25'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.278+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f227005a040 con 0x7f227801f370 2024-05-08T18:50:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.278+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94821708973664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d6647cb50 con 0x7f227801f370 2024-05-08T18:50:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.278+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d6647d5a0 con 0x7f227801f370 2024-05-08T18:50:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.279+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(56 notify.6 [create] v25'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f227005a040 con 0x7f227801f370 2024-05-08T18:50:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.279+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94821708973664] v25'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f227005a040 con 0x7f227801f370 2024-05-08T18:50:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.279+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94821708976368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d6647d9c0 con 0x7f227801f370 2024-05-08T18:50:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.279+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d6647c000 con 0x7f227801f370 2024-05-08T18:50:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.280+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(58 notify.7 [create] v25'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f227005a040 con 0x7f227801f370 2024-05-08T18:50:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.281+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94821708976368] v25'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f227005a040 con 0x7f227801f370 2024-05-08T18:50:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.281+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94821708972032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d6647e460 con 0x7f227801f370 2024-05-08T18:50:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.281+0000 7f2289127800 20 add_watcher() i=0 2024-05-08T18:50:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.281+0000 7f2289127800 20 add_watcher() i=1 2024-05-08T18:50:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.281+0000 7f2289127800 20 add_watcher() i=2 2024-05-08T18:50:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.281+0000 7f2289127800 20 add_watcher() i=3 2024-05-08T18:50:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.281+0000 7f2289127800 20 add_watcher() i=4 2024-05-08T18:50:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.281+0000 7f2289127800 20 add_watcher() i=5 2024-05-08T18:50:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.281+0000 7f2289127800 20 add_watcher() i=6 2024-05-08T18:50:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.282+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94821708972032] v25'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f227005a040 con 0x7f227801f370 2024-05-08T18:50:50.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.282+0000 7f2289127800 20 add_watcher() i=7 2024-05-08T18:50:50.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.282+0000 7f2289127800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:50.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.282+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563d66481490 con 0x563d6646dde0 2024-05-08T18:50:50.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.282+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.282+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94821708980144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d6647e8b0 con 0x563d6646dde0 2024-05-08T18:50:50.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.283+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94821708980144] v25'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.283+0000 7f213b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:50.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.283+0000 7f2289127800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:50.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.283+0000 7f2289127800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:50.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.283+0000 7f2289127800 5 note: GC not initialized 2024-05-08T18:50:50.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.283+0000 7f213a7e4640 20 reqs_thread_entry: start 2024-05-08T18:50:50.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.283+0000 7f2289127800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:50.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.283+0000 7f2289127800 20 Filter name: none 2024-05-08T18:50:50.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.284+0000 7f2133fff640 20 reqs_thread_entry: start 2024-05-08T18:50:50.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.284+0000 7f2289127800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.284+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x563d664b42e0 con 0x563d6646dde0 2024-05-08T18:50:50.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.284+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.284+0000 7f2289127800 20 rados_obj.operate() r=0 bl.length=193 2024-05-08T18:50:50.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.285+0000 7f213b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:50.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.285+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94821708980144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d6647f180 con 0x563d6646dde0 2024-05-08T18:50:50.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.286+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94821708980144] v25'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.286+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94821708954848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d6647dfb0 con 0x7f2280014070 2024-05-08T18:50:50.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.287+0000 7f2284ee4640 1 -- 172.21.15.132:0/3638644857 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94821708954848] v25'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2278027020 con 0x7f2280014070 2024-05-08T18:50:50.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.287+0000 7f2289127800 20 remove_watcher() i=0 2024-05-08T18:50:50.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.287+0000 7f2289127800 2 removed watcher, disabling cache 2024-05-08T18:50:50.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.287+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94821708962496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d6647dfb0 con 0x563d6646dde0 2024-05-08T18:50:50.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.288+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94821708962496] v25'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.288+0000 7f2289127800 20 remove_watcher() i=1 2024-05-08T18:50:50.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.288+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94821708964752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d66479ac0 con 0x563d664724c0 2024-05-08T18:50:50.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.289+0000 7f22856e5640 1 -- 172.21.15.132:0/3638644857 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94821708964752] v25'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f228002a070 con 0x563d664724c0 2024-05-08T18:50:50.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.289+0000 7f2289127800 20 remove_watcher() i=2 2024-05-08T18:50:50.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.289+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94821708967952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d6647dfb0 con 0x7f2280014070 2024-05-08T18:50:50.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.290+0000 7f2284ee4640 1 -- 172.21.15.132:0/3638644857 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94821708967952] v25'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2278027020 con 0x7f2280014070 2024-05-08T18:50:50.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.290+0000 7f2289127800 20 remove_watcher() i=3 2024-05-08T18:50:50.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.290+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94821708969696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d6647a390 con 0x563d6646dde0 2024-05-08T18:50:50.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.291+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94821708969696] v25'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f227005a040 con 0x563d6646dde0 2024-05-08T18:50:50.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.291+0000 7f2289127800 20 remove_watcher() i=4 2024-05-08T18:50:50.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.291+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94821708973664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d66479ac0 con 0x7f227801f370 2024-05-08T18:50:50.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.292+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94821708973664] v25'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f227005a040 con 0x7f227801f370 2024-05-08T18:50:50.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.292+0000 7f2289127800 20 remove_watcher() i=5 2024-05-08T18:50:50.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.292+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94821708976368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d6647dfb0 con 0x7f227801f370 2024-05-08T18:50:50.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.293+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94821708976368] v25'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f227005a040 con 0x7f227801f370 2024-05-08T18:50:50.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.293+0000 7f2289127800 20 remove_watcher() i=6 2024-05-08T18:50:50.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.293+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94821708972032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x563d6647dfb0 con 0x7f227801f370 2024-05-08T18:50:50.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.294+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94821708972032] v25'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f227005a040 con 0x7f227801f370 2024-05-08T18:50:50.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.294+0000 7f2289127800 20 remove_watcher() i=7 2024-05-08T18:50:50.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.294+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f227801f370 msgr2=0x7f227804a430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.294+0000 7f2289127800 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f227801f370 0x7f227804a430 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.294+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x563d6646dde0 msgr2=0x563d66470280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.294+0000 7f2289127800 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x563d6646dde0 0x563d66470280 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.294+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2280014070 msgr2=0x7f228002ca50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.294+0000 7f2289127800 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2280014070 0x7f228002ca50 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.294+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x563d664724c0 msgr2=0x563d664748b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.294+0000 7f2289127800 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x563d664724c0 0x563d664748b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.294+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f215003bba0 msgr2=0x7f215003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.294+0000 7f2289127800 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f215003bba0 0x7f215003e060 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2278020f20 tx=0x7f2278046000 comp rx=0 tx=0).stop 2024-05-08T18:50:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.294+0000 7f227ffff640 1 -- 172.21.15.132:0/3638644857 reap_dead start 2024-05-08T18:50:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.294+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6645ab20 msgr2=0x563d664620f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.294+0000 7f2289127800 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6645ab20 0x563d664620f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2280014fd0 tx=0x7f2280052be0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.294+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 shutdown_connections 2024-05-08T18:50:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.294+0000 7f2289127800 1 --2- 172.21.15.132:0/3638644857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6645ab20 0x563d664620f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.294+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 >> 172.21.15.132:0/3638644857 conn(0x563d66456e80 msgr2=0x563d664544e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.294+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 shutdown_connections 2024-05-08T18:50:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.294+0000 7f2289127800 1 -- 172.21.15.132:0/3638644857 wait complete. 2024-05-08T18:50:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 -- 172.21.15.132:0/1817381001 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f215c03bba0 msgr2=0x7f215c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 --2- 172.21.15.132:0/1817381001 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f215c03bba0 0x7f215c03e060 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x563d66439fe0 tx=0x7f227803e050 comp rx=0 tx=0).stop 2024-05-08T18:50:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 -- 172.21.15.132:0/1817381001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6644d8f0 msgr2=0x563d6644dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 --2- 172.21.15.132:0/1817381001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6644d8f0 0x563d6644dd10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x563d66439f40 tx=0x7f2280018830 comp rx=0 tx=0).stop 2024-05-08T18:50:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 -- 172.21.15.132:0/1817381001 shutdown_connections 2024-05-08T18:50:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 --2- 172.21.15.132:0/1817381001 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f215c03bba0 0x7f215c03e060 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 --2- 172.21.15.132:0/1817381001 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d6644d8f0 0x563d6644dd10 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 -- 172.21.15.132:0/1817381001 >> 172.21.15.132:0/1817381001 conn(0x563d66441990 msgr2=0x563d66441d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 -- 172.21.15.132:0/1817381001 shutdown_connections 2024-05-08T18:50:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 -- 172.21.15.132:0/1817381001 wait complete. 2024-05-08T18:50:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 -- 172.21.15.132:0/3535017822 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x563d6633a690 msgr2=0x563d66439600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 --2- 172.21.15.132:0/3535017822 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x563d6633a690 0x563d66439600 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 -- 172.21.15.132:0/3535017822 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x563d6643be90 msgr2=0x563d6643e280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 --2- 172.21.15.132:0/3535017822 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x563d6643be90 0x563d6643e280 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 -- 172.21.15.132:0/3535017822 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f216c03bb50 msgr2=0x7f216c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 --2- 172.21.15.132:0/3535017822 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f216c03bb50 0x7f216c03e010 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2270054000 tx=0x7f227004e000 comp rx=0 tx=0).stop 2024-05-08T18:50:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 -- 172.21.15.132:0/3535017822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d66337740 msgr2=0x563d664323c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 --2- 172.21.15.132:0/3535017822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d66337740 0x563d664323c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2278002000 tx=0x7f2278000bc0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 -- 172.21.15.132:0/3535017822 shutdown_connections 2024-05-08T18:50:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 --2- 172.21.15.132:0/3535017822 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x563d6643be90 0x563d6643e280 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 --2- 172.21.15.132:0/3535017822 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x563d6633a690 0x563d66439600 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 --2- 172.21.15.132:0/3535017822 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f216c03bb50 0x7f216c03e010 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 --2- 172.21.15.132:0/3535017822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x563d66337740 0x563d664323c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 -- 172.21.15.132:0/3535017822 >> 172.21.15.132:0/3535017822 conn(0x563d66330ea0 msgr2=0x563d663354e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 -- 172.21.15.132:0/3535017822 shutdown_connections 2024-05-08T18:50:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.295+0000 7f2289127800 1 -- 172.21.15.132:0/3535017822 wait complete. 2024-05-08T18:50:50.305 INFO:teuthology.orchestra.run.smithi132.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"QL6H8lEoEpV6VcUyTxt80vSG","ver":2},"mtime":"2024-05-08T18:50:50.153440Z","data":{"bucket":{"name":"myfoo","marker":"bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1","bucket_id":"bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-05-08T18:50:47.727613Z","linked":true,"has_bucket_info":false}} 2024-05-08T18:50:50.305 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'QL6H8lEoEpV6VcUyTxt80vSG', 'ver': 2}, 'mtime': '2024-05-08T18:50:50.153440Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1', 'bucket_id': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-05-08T18:50:47.727613Z', 'linked': True, 'has_bucket_info': False}} 2024-05-08T18:50:50.306 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-05-08T18:50:50.306 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-05-08T18:50:50.306 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-05-08T18:50:50.391 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:50.391 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.393+0000 7fc867751800 1 Processor -- start 2024-05-08T18:50:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.393+0000 7fc867751800 1 -- start start 2024-05-08T18:50:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.393+0000 7fc867751800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55f76f78e2c0 0x55f76f78e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.393+0000 7fc867751800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f76f78ed60 con 0x55f76f78f480 2024-05-08T18:50:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.393+0000 7fc867751800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55f76f62ee20 con 0x55f76f78e2c0 2024-05-08T18:50:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.393+0000 7fc865250640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55f76f78e2c0 0x55f76f78e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.393+0000 7fc85ca4f640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55f76f78f480 0x55f76f78f900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:47086/0 (socket says 172.21.15.132:47086) 2024-05-08T18:50:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.393+0000 7fc85ca4f640 1 -- 172.21.15.132:0/1948645114 learned_addr learned my addr 172.21.15.132:0/1948645114 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:50:50.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.393+0000 7fc865250640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55f76f78e2c0 0x55f76f78e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33574/0 (socket says 172.21.15.132:33574) 2024-05-08T18:50:50.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.394+0000 7fc865250640 1 -- 172.21.15.132:0/1948645114 >> v1:172.21.15.42:6789/0 conn(0x55f76f78f480 legacy=0x55f76f78f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.394+0000 7fc865250640 1 -- 172.21.15.132:0/1948645114 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f76f790040 con 0x55f76f78e2c0 2024-05-08T18:50:50.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.395+0000 7fc865250640 1 --2- 172.21.15.132:0/1948645114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f78e2c0 0x55f76f78e6e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc85800a470 tx=0x7fc85801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0ad48125e32422 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.396+0000 7fc864a4f640 1 -- 172.21.15.132:0/1948645114 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc858057070 con 0x55f76f78e2c0 2024-05-08T18:50:50.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.396+0000 7fc864a4f640 1 -- 172.21.15.132:0/1948645114 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc85804adc0 con 0x55f76f78e2c0 2024-05-08T18:50:50.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.396+0000 7fc864a4f640 1 -- 172.21.15.132:0/1948645114 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc858052590 con 0x55f76f78e2c0 2024-05-08T18:50:50.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.396+0000 7fc867751800 1 -- 172.21.15.132:0/1948645114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f78e2c0 msgr2=0x55f76f78e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.396+0000 7fc867751800 1 --2- 172.21.15.132:0/1948645114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f78e2c0 0x55f76f78e6e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc85800a470 tx=0x7fc85801ce90 comp rx=0 tx=0).stop 2024-05-08T18:50:50.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.396+0000 7fc867751800 1 -- 172.21.15.132:0/1948645114 shutdown_connections 2024-05-08T18:50:50.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.396+0000 7fc867751800 1 --2- 172.21.15.132:0/1948645114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f78e2c0 0x55f76f78e6e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.396+0000 7fc867751800 1 -- 172.21.15.132:0/1948645114 >> 172.21.15.132:0/1948645114 conn(0x55f76f789840 msgr2=0x55f76f78bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.396+0000 7fc867751800 1 -- 172.21.15.132:0/1948645114 shutdown_connections 2024-05-08T18:50:50.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.396+0000 7fc867751800 1 -- 172.21.15.132:0/1948645114 wait complete. 2024-05-08T18:50:50.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.410+0000 7fc867751800 1 Processor -- start 2024-05-08T18:50:50.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.410+0000 7fc867751800 1 -- start start 2024-05-08T18:50:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.410+0000 7fc867751800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f78e2c0 0x55f76f87f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.410+0000 7fc867751800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f76f6d95c0 con 0x55f76f78e2c0 2024-05-08T18:50:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.410+0000 7fc865250640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f78e2c0 0x55f76f87f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.410+0000 7fc865250640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f78e2c0 0x55f76f87f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33576/0 (socket says 172.21.15.132:33576) 2024-05-08T18:50:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.410+0000 7fc865250640 1 -- 172.21.15.132:0/3643284639 learned_addr learned my addr 172.21.15.132:0/3643284639 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.411+0000 7fc865250640 1 -- 172.21.15.132:0/3643284639 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f76f87fcf0 con 0x55f76f78e2c0 2024-05-08T18:50:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.411+0000 7fc865250640 1 --2- 172.21.15.132:0/3643284639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f78e2c0 0x55f76f87f720 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc85801ced0 tx=0x7fc85804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c5b92b7aea142a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.411+0000 7fc753606640 1 -- 172.21.15.132:0/3643284639 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc858057040 con 0x55f76f78e2c0 2024-05-08T18:50:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.411+0000 7fc753606640 1 -- 172.21.15.132:0/3643284639 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc858063070 con 0x55f76f78e2c0 2024-05-08T18:50:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.411+0000 7fc753606640 1 -- 172.21.15.132:0/3643284639 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc858052800 con 0x55f76f78e2c0 2024-05-08T18:50:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.412+0000 7fc867751800 1 -- 172.21.15.132:0/3643284639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f78e2c0 msgr2=0x55f76f87f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.412+0000 7fc867751800 1 --2- 172.21.15.132:0/3643284639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f78e2c0 0x55f76f87f720 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc85801ced0 tx=0x7fc85804c000 comp rx=0 tx=0).stop 2024-05-08T18:50:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.412+0000 7fc867751800 1 -- 172.21.15.132:0/3643284639 shutdown_connections 2024-05-08T18:50:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.412+0000 7fc867751800 1 --2- 172.21.15.132:0/3643284639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f78e2c0 0x55f76f87f720 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.412+0000 7fc867751800 1 -- 172.21.15.132:0/3643284639 >> 172.21.15.132:0/3643284639 conn(0x55f76f789840 msgr2=0x55f76f87b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.412+0000 7fc867751800 1 -- 172.21.15.132:0/3643284639 shutdown_connections 2024-05-08T18:50:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.412+0000 7fc867751800 1 -- 172.21.15.132:0/3643284639 wait complete. 2024-05-08T18:50:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.412+0000 7fc867751800 1 Processor -- start 2024-05-08T18:50:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.412+0000 7fc867751800 1 -- start start 2024-05-08T18:50:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.412+0000 7fc867751800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f78e2c0 0x55f76f8871e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.412+0000 7fc867751800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f76f797950 con 0x55f76f78e2c0 2024-05-08T18:50:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.412+0000 7fc865250640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f78e2c0 0x55f76f8871e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.412+0000 7fc865250640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f78e2c0 0x55f76f8871e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33578/0 (socket says 172.21.15.132:33578) 2024-05-08T18:50:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.412+0000 7fc865250640 1 -- 172.21.15.132:0/355903509 learned_addr learned my addr 172.21.15.132:0/355903509 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.413+0000 7fc865250640 1 -- 172.21.15.132:0/355903509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f76f887720 con 0x55f76f78e2c0 2024-05-08T18:50:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.413+0000 7fc865250640 1 --2- 172.21.15.132:0/355903509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f78e2c0 0x55f76f8871e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc85801ced0 tx=0x7fc858002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.413+0000 7fc751e03640 1 -- 172.21.15.132:0/355903509 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc85806d070 con 0x55f76f78e2c0 2024-05-08T18:50:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.413+0000 7fc751e03640 1 -- 172.21.15.132:0/355903509 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc858052d20 con 0x55f76f78e2c0 2024-05-08T18:50:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.413+0000 7fc867751800 1 -- 172.21.15.132:0/355903509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f76f8879b0 con 0x55f76f78e2c0 2024-05-08T18:50:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.413+0000 7fc751e03640 1 -- 172.21.15.132:0/355903509 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc858057050 con 0x55f76f78e2c0 2024-05-08T18:50:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.413+0000 7fc867751800 1 -- 172.21.15.132:0/355903509 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f76f88a5c0 con 0x55f76f78e2c0 2024-05-08T18:50:50.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.414+0000 7fc751e03640 1 -- 172.21.15.132:0/355903509 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc85805d470 con 0x55f76f78e2c0 2024-05-08T18:50:50.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.414+0000 7fc751e03640 1 --2- 172.21.15.132:0/355903509 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc74c03bb50 0x7fc74c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.414+0000 7fc751e03640 1 -- 172.21.15.132:0/355903509 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fc858093ef0 con 0x55f76f78e2c0 2024-05-08T18:50:50.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.414+0000 7fc85ca4f640 1 --2- 172.21.15.132:0/355903509 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc74c03bb50 0x7fc74c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.414+0000 7fc867751800 1 --2- 172.21.15.132:0/355903509 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f76f78f480 0x55f76f88e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.414+0000 7fc867751800 1 -- 172.21.15.132:0/355903509 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f88e950 con 0x55f76f78f480 2024-05-08T18:50:50.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.415+0000 7fc865a51640 1 --2- 172.21.15.132:0/355903509 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f76f78f480 0x55f76f88e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.415+0000 7fc85ca4f640 1 --2- 172.21.15.132:0/355903509 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc74c03bb50 0x7fc74c03e010 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc850000f60 tx=0x7fc8500012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.415+0000 7fc865a51640 1 --2- 172.21.15.132:0/355903509 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f76f78f480 0x55f76f88e380 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.415+0000 7fc865a51640 1 -- 172.21.15.132:0/355903509 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc86000a4a0 con 0x55f76f78f480 2024-05-08T18:50:50.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.415+0000 7fc867751800 1 -- 172.21.15.132:0/355903509 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f88b950 con 0x55f76f78f480 2024-05-08T18:50:50.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.415+0000 7fc865a51640 1 -- 172.21.15.132:0/355903509 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc86000a4a0 con 0x55f76f78f480 2024-05-08T18:50:50.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.415+0000 7fc867751800 1 --2- 172.21.15.132:0/355903509 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f76f890cb0 0x55f76f8930a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.415+0000 7fc867751800 1 -- 172.21.15.132:0/355903509 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f893740 con 0x55f76f890cb0 2024-05-08T18:50:50.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.416+0000 7fc865250640 1 --2- 172.21.15.132:0/355903509 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f76f890cb0 0x55f76f8930a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.416+0000 7fc865250640 1 --2- 172.21.15.132:0/355903509 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f76f890cb0 0x55f76f8930a0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.416+0000 7fc865250640 1 -- 172.21.15.132:0/355903509 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc858078070 con 0x55f76f890cb0 2024-05-08T18:50:50.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.416+0000 7fc867751800 1 -- 172.21.15.132:0/355903509 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f88fb50 con 0x55f76f78f480 2024-05-08T18:50:50.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.416+0000 7fc865a51640 1 -- 172.21.15.132:0/355903509 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc86000a4a0 con 0x55f76f78f480 2024-05-08T18:50:50.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.416+0000 7fc867751800 1 -- 172.21.15.132:0/355903509 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f890030 con 0x55f76f78f480 2024-05-08T18:50:50.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.417+0000 7fc865a51640 1 -- 172.21.15.132:0/355903509 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc86000a4a0 con 0x55f76f78f480 2024-05-08T18:50:50.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.417+0000 7fc867751800 1 Processor -- start 2024-05-08T18:50:50.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.417+0000 7fc867751800 1 -- start start 2024-05-08T18:50:50.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.417+0000 7fc867751800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f8a26c0 0x55f76f8a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.417+0000 7fc867751800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f76f67ffc0 con 0x55f76f8a26c0 2024-05-08T18:50:50.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.417+0000 7fc865a51640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f8a26c0 0x55f76f8a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.417+0000 7fc865a51640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f8a26c0 0x55f76f8a2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33584/0 (socket says 172.21.15.132:33584) 2024-05-08T18:50:50.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.417+0000 7fc865a51640 1 -- 172.21.15.132:0/4173096089 learned_addr learned my addr 172.21.15.132:0/4173096089 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.418+0000 7fc865a51640 1 -- 172.21.15.132:0/4173096089 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f76f8a3020 con 0x55f76f8a26c0 2024-05-08T18:50:50.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.418+0000 7fc865a51640 1 --2- 172.21.15.132:0/4173096089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f8a26c0 0x55f76f8a2ae0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x55f76f88ed10 tx=0x7fc860018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.418+0000 7fc74affd640 1 -- 172.21.15.132:0/4173096089 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc860014450 con 0x55f76f8a26c0 2024-05-08T18:50:50.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.418+0000 7fc74affd640 1 -- 172.21.15.132:0/4173096089 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8600145f0 con 0x55f76f8a26c0 2024-05-08T18:50:50.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.418+0000 7fc867751800 1 -- 172.21.15.132:0/4173096089 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f76f8a3a90 con 0x55f76f8a26c0 2024-05-08T18:50:50.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.418+0000 7fc74affd640 1 -- 172.21.15.132:0/4173096089 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8600148d0 con 0x55f76f8a26c0 2024-05-08T18:50:50.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.418+0000 7fc867751800 1 -- 172.21.15.132:0/4173096089 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f76f8a3f90 con 0x55f76f8a26c0 2024-05-08T18:50:50.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.419+0000 7fc74affd640 1 -- 172.21.15.132:0/4173096089 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc860011040 con 0x55f76f8a26c0 2024-05-08T18:50:50.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.419+0000 7fc74affd640 1 --2- 172.21.15.132:0/4173096089 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc73c03bba0 0x7fc73c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.419+0000 7fc74affd640 1 -- 172.21.15.132:0/4173096089 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fc86001e070 con 0x55f76f8a26c0 2024-05-08T18:50:50.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.419+0000 7fc865250640 1 --2- 172.21.15.132:0/4173096089 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc73c03bba0 0x7fc73c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.419+0000 7fc867751800 1 Processor -- start 2024-05-08T18:50:50.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.419+0000 7fc865250640 1 --2- 172.21.15.132:0/4173096089 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc73c03bba0 0x7fc73c03e060 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55f76f88edd0 tx=0x7fc858066ca0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.419+0000 7fc867751800 1 -- start start 2024-05-08T18:50:50.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.420+0000 7fc867751800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f8af940 0x55f76f8afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.420+0000 7fc867751800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f76f87ffb0 con 0x55f76f8af940 2024-05-08T18:50:50.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.420+0000 7fc865a51640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f8af940 0x55f76f8afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.420+0000 7fc865a51640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f8af940 0x55f76f8afd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33594/0 (socket says 172.21.15.132:33594) 2024-05-08T18:50:50.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.420+0000 7fc865a51640 1 -- 172.21.15.132:0/1219812622 learned_addr learned my addr 172.21.15.132:0/1219812622 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.420+0000 7fc865a51640 1 -- 172.21.15.132:0/1219812622 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f76f8b0330 con 0x55f76f8af940 2024-05-08T18:50:50.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.420+0000 7fc865a51640 1 --2- 172.21.15.132:0/1219812622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f8af940 0x55f76f8afd60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc860013010 tx=0x7fc8600118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa83b1a4ae20f58 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.420+0000 7fc748ff9640 1 -- 172.21.15.132:0/1219812622 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc860011c00 con 0x55f76f8af940 2024-05-08T18:50:50.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.420+0000 7fc748ff9640 1 -- 172.21.15.132:0/1219812622 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc860011da0 con 0x55f76f8af940 2024-05-08T18:50:50.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.420+0000 7fc748ff9640 1 -- 172.21.15.132:0/1219812622 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc860014a70 con 0x55f76f8af940 2024-05-08T18:50:50.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.421+0000 7fc867751800 1 -- 172.21.15.132:0/1219812622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f8af940 msgr2=0x55f76f8afd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.421+0000 7fc867751800 1 --2- 172.21.15.132:0/1219812622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f8af940 0x55f76f8afd60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc860013010 tx=0x7fc8600118e0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.421+0000 7fc867751800 1 -- 172.21.15.132:0/1219812622 shutdown_connections 2024-05-08T18:50:50.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.421+0000 7fc867751800 1 --2- 172.21.15.132:0/1219812622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f8af940 0x55f76f8afd60 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.421+0000 7fc867751800 1 -- 172.21.15.132:0/1219812622 >> 172.21.15.132:0/1219812622 conn(0x55f76f8abca0 msgr2=0x55f76f8a9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.421+0000 7fc867751800 1 -- 172.21.15.132:0/1219812622 shutdown_connections 2024-05-08T18:50:50.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.421+0000 7fc867751800 1 -- 172.21.15.132:0/1219812622 wait complete. 2024-05-08T18:50:50.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.421+0000 7fc867751800 1 Processor -- start 2024-05-08T18:50:50.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.421+0000 7fc867751800 1 -- start start 2024-05-08T18:50:50.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.421+0000 7fc867751800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f8af940 0x55f76f703ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.421+0000 7fc867751800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f76f8b0aa0 con 0x55f76f8af940 2024-05-08T18:50:50.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.422+0000 7fc865a51640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f8af940 0x55f76f703ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.422+0000 7fc865a51640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f8af940 0x55f76f703ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:33610/0 (socket says 172.21.15.132:33610) 2024-05-08T18:50:50.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.422+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 learned_addr learned my addr 172.21.15.132:0/3667526383 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.422+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f76f702390 con 0x55f76f8af940 2024-05-08T18:50:50.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.422+0000 7fc865a51640 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f8af940 0x55f76f703ca0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc860024fd0 tx=0x7fc860052d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.422+0000 7fc73affd640 1 -- 172.21.15.132:0/3667526383 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc860016440 con 0x55f76f8af940 2024-05-08T18:50:50.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.422+0000 7fc73affd640 1 -- 172.21.15.132:0/3667526383 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8600409a0 con 0x55f76f8af940 2024-05-08T18:50:50.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.422+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f76f702620 con 0x55f76f8af940 2024-05-08T18:50:50.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.422+0000 7fc73affd640 1 -- 172.21.15.132:0/3667526383 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc860040c80 con 0x55f76f8af940 2024-05-08T18:50:50.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.422+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f76f702ac0 con 0x55f76f8af940 2024-05-08T18:50:50.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.423+0000 7fc73affd640 1 -- 172.21.15.132:0/3667526383 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc860051210 con 0x55f76f8af940 2024-05-08T18:50:50.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.423+0000 7fc73affd640 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc73003bba0 0x7fc73003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.423+0000 7fc73affd640 1 -- 172.21.15.132:0/3667526383 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fc86000e040 con 0x55f76f8af940 2024-05-08T18:50:50.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.423+0000 7fc865250640 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc73003bba0 0x7fc73003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.424+0000 7fc865250640 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc73003bba0 0x7fc73003e060 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc85805ce20 tx=0x7fc858072000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.424+0000 7fc867751800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.424+0000 7fc867751800 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f76f8c4e70 0x55f76f8c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.424+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8c7a80 con 0x55f76f8c4e70 2024-05-08T18:50:50.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.424+0000 7fc85ca4f640 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f76f8c4e70 0x55f76f8c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.424+0000 7fc85ca4f640 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f76f8c4e70 0x55f76f8c7330 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.425+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc850009050 con 0x55f76f8c4e70 2024-05-08T18:50:50.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.425+0000 7fc867751800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.425+0000 7fc867751800 20 realm 2024-05-08T18:50:50.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.425+0000 7fc867751800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.425+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8c42c0 con 0x55f76f8c4e70 2024-05-08T18:50:50.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.425+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc850009050 con 0x55f76f8c4e70 2024-05-08T18:50:50.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.425+0000 7fc867751800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.425+0000 7fc867751800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:50.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.425+0000 7fc867751800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.425+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8c8570 con 0x55f76f8c4e70 2024-05-08T18:50:50.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.425+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc850009050 con 0x55f76f8c4e70 2024-05-08T18:50:50.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.425+0000 7fc867751800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.425+0000 7fc867751800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.425+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8c8e40 con 0x55f76f8c4e70 2024-05-08T18:50:50.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.425+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc850009050 con 0x55f76f8c4e70 2024-05-08T18:50:50.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.425+0000 7fc867751800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:50.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.425+0000 7fc867751800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.425+0000 7fc867751800 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f76f8c9780 0x55f76f8cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.425+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cc300 con 0x55f76f8c9780 2024-05-08T18:50:50.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.426+0000 7fc865a51640 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f76f8c9780 0x55f76f8cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.426+0000 7fc865a51640 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f76f8c9780 0x55f76f8cbb70 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.426+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc860046020 con 0x55f76f8c9780 2024-05-08T18:50:50.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.426+0000 7fc867751800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:50.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.426+0000 7fc867751800 20 searching for the correct realm 2024-05-08T18:50:50.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.426+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x55f76f8c9780 2024-05-08T18:50:50.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.427+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc860046020 con 0x55f76f8c9780 2024-05-08T18:50:50.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.427+0000 7fc865a51640 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fc860014070 0x7fc8600399d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.427+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x7fc860014070 2024-05-08T18:50:50.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.427+0000 7fc865250640 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fc860014070 0x7fc8600399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.427+0000 7fc865250640 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fc860014070 0x7fc8600399d0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.427+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc858078070 con 0x7fc860014070 2024-05-08T18:50:50.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.427+0000 7fc865250640 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fc85808b360 0x7fc8580935e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.427+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x7fc85808b360 2024-05-08T18:50:50.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.427+0000 7fc85ca4f640 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fc85808b360 0x7fc8580935e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.428+0000 7fc85ca4f640 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fc85808b360 0x7fc8580935e0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.428+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850009050 con 0x7fc85808b360 2024-05-08T18:50:50.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.428+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x55f76f8c4e70 2024-05-08T18:50:50.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.428+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850009050 con 0x55f76f8c4e70 2024-05-08T18:50:50.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.428+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x55f76f8c4e70 2024-05-08T18:50:50.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.428+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850029040 con 0x55f76f8c4e70 2024-05-08T18:50:50.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.428+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x7fc85808b360 2024-05-08T18:50:50.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.429+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850029040 con 0x7fc85808b360 2024-05-08T18:50:50.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.429+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x7fc85808b360 2024-05-08T18:50:50.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.429+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850029040 con 0x7fc85808b360 2024-05-08T18:50:50.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.429+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x7fc860014070 2024-05-08T18:50:50.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.429+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc858078070 con 0x7fc860014070 2024-05-08T18:50:50.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.429+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x55f76f8c9780 2024-05-08T18:50:50.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.429+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc860061040 con 0x55f76f8c9780 2024-05-08T18:50:50.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.429+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x55f76f8c4e70 2024-05-08T18:50:50.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.430+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850029040 con 0x55f76f8c4e70 2024-05-08T18:50:50.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.430+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x7fc85808b360 2024-05-08T18:50:50.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.430+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850029040 con 0x7fc85808b360 2024-05-08T18:50:50.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.430+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x55f76f8c4e70 2024-05-08T18:50:50.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.430+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc850029040 con 0x55f76f8c4e70 2024-05-08T18:50:50.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.430+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x7fc860014070 2024-05-08T18:50:50.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.430+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc858078070 con 0x7fc860014070 2024-05-08T18:50:50.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.430+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x55f76f8c9780 2024-05-08T18:50:50.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.431+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc860061040 con 0x55f76f8c9780 2024-05-08T18:50:50.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.431+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x55f76f8c9780 2024-05-08T18:50:50.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.431+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc860061040 con 0x55f76f8c9780 2024-05-08T18:50:50.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.431+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x7fc85808b360 2024-05-08T18:50:50.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.431+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850029040 con 0x7fc85808b360 2024-05-08T18:50:50.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.431+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x55f76f8c9780 2024-05-08T18:50:50.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.431+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc860061040 con 0x55f76f8c9780 2024-05-08T18:50:50.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.431+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x55f76f8c9780 2024-05-08T18:50:50.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.432+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc860061040 con 0x55f76f8c9780 2024-05-08T18:50:50.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.432+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x55f76f8c4e70 2024-05-08T18:50:50.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.432+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850029040 con 0x55f76f8c4e70 2024-05-08T18:50:50.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.432+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x55f76f8c4e70 2024-05-08T18:50:50.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.432+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc850029040 con 0x55f76f8c4e70 2024-05-08T18:50:50.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.432+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x7fc85808b360 2024-05-08T18:50:50.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.432+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850029040 con 0x7fc85808b360 2024-05-08T18:50:50.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.432+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x55f76f8c9780 2024-05-08T18:50:50.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.432+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc860061040 con 0x55f76f8c9780 2024-05-08T18:50:50.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.432+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x7fc860014070 2024-05-08T18:50:50.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.433+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc858078070 con 0x7fc860014070 2024-05-08T18:50:50.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.433+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x55f76f8c4e70 2024-05-08T18:50:50.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.433+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850029040 con 0x55f76f8c4e70 2024-05-08T18:50:50.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.433+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x7fc85808b360 2024-05-08T18:50:50.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.433+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850029040 con 0x7fc85808b360 2024-05-08T18:50:50.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.433+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x55f76f8c9780 2024-05-08T18:50:50.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.434+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc860061040 con 0x55f76f8c9780 2024-05-08T18:50:50.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.434+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x7fc85808b360 2024-05-08T18:50:50.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.434+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850029040 con 0x7fc85808b360 2024-05-08T18:50:50.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.434+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x7fc860014070 2024-05-08T18:50:50.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.434+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc858078070 con 0x7fc860014070 2024-05-08T18:50:50.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.434+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x55f76f8c9780 2024-05-08T18:50:50.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.434+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc860061040 con 0x55f76f8c9780 2024-05-08T18:50:50.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.434+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cdc50 con 0x7fc85808b360 2024-05-08T18:50:50.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.435+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc850029040 con 0x7fc85808b360 2024-05-08T18:50:50.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.435+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fc85003a040 con 0x55f76f8c4e70 2024-05-08T18:50:50.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.435+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc850029040 con 0x55f76f8c4e70 2024-05-08T18:50:50.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.435+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x7fc85003a040 con 0x7fc860014070 2024-05-08T18:50:50.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.435+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc858078070 con 0x7fc860014070 2024-05-08T18:50:50.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.435+0000 7fc867751800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:50.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.435+0000 7fc867751800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:50.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.435+0000 7fc867751800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:50.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.435+0000 7fc867751800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:50.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.435+0000 7fc867751800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:50.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.435+0000 7fc867751800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:50.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.435+0000 7fc867751800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.435+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cccc0 con 0x55f76f8c4e70 2024-05-08T18:50:50.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.435+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc850029040 con 0x55f76f8c4e70 2024-05-08T18:50:50.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.435+0000 7fc867751800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.435+0000 7fc867751800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.435+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cd560 con 0x55f76f8c4e70 2024-05-08T18:50:50.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.436+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc850029040 con 0x55f76f8c4e70 2024-05-08T18:50:50.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.436+0000 7fc867751800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:50.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.436+0000 7fc867751800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.436+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8ce0d0 con 0x55f76f8c4e70 2024-05-08T18:50:50.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.436+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc850029040 con 0x55f76f8c4e70 2024-05-08T18:50:50.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.436+0000 7fc867751800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:50.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.436+0000 7fc867751800 20 zone default found 2024-05-08T18:50:50.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.436+0000 7fc867751800 4 Realm: () 2024-05-08T18:50:50.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.436+0000 7fc867751800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:50.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.436+0000 7fc867751800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:50.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.436+0000 7fc867751800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:50.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.436+0000 7fc867751800 20 zonegroup default 2024-05-08T18:50:50.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.436+0000 7fc867751800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.436+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8ce130 con 0x7fc85808b360 2024-05-08T18:50:50.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.436+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc850029040 con 0x7fc85808b360 2024-05-08T18:50:50.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.436+0000 7fc867751800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.436+0000 7fc867751800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.436+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cff50 con 0x55f76f8c9780 2024-05-08T18:50:50.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.437+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc860061040 con 0x55f76f8c9780 2024-05-08T18:50:50.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.437+0000 7fc867751800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.437+0000 7fc867751800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.437+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8d0320 con 0x55f76f8c9780 2024-05-08T18:50:50.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.437+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc860061040 con 0x55f76f8c9780 2024-05-08T18:50:50.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.437+0000 7fc867751800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.437+0000 7fc867751800 20 started sync module instance, tier type = 2024-05-08T18:50:50.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.437+0000 7fc867751800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:50.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.437+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cf3f0 con 0x7fc860014070 2024-05-08T18:50:50.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.438+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc858078070 con 0x7fc860014070 2024-05-08T18:50:50.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.438+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94521216790336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8d0780 con 0x7fc860014070 2024-05-08T18:50:50.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.438+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8d0fd0 con 0x55f76f8c4e70 2024-05-08T18:50:50.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.439+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94521216790336] v25'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc858078070 con 0x7fc860014070 2024-05-08T18:50:50.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.439+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850029040 con 0x55f76f8c4e70 2024-05-08T18:50:50.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.439+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94521216797472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8d13f0 con 0x55f76f8c4e70 2024-05-08T18:50:50.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.439+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8d1c80 con 0x55f76f8c9780 2024-05-08T18:50:50.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.440+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94521216797472] v25'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850029040 con 0x55f76f8c4e70 2024-05-08T18:50:50.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.440+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc860061040 con 0x55f76f8c9780 2024-05-08T18:50:50.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.441+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94521216798528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8d1810 con 0x55f76f8c9780 2024-05-08T18:50:50.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.441+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8d2720 con 0x7fc860014070 2024-05-08T18:50:50.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.442+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc858078070 con 0x7fc860014070 2024-05-08T18:50:50.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.442+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94521216798528] v25'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc860061040 con 0x55f76f8c9780 2024-05-08T18:50:50.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.442+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94521216803344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8d2fc0 con 0x7fc860014070 2024-05-08T18:50:50.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.442+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8d13a0 con 0x55f76f8c4e70 2024-05-08T18:50:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.443+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850029040 con 0x55f76f8c4e70 2024-05-08T18:50:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.443+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94521216808320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8d3e50 con 0x55f76f8c4e70 2024-05-08T18:50:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.443+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8d48c0 con 0x7fc85808b360 2024-05-08T18:50:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.443+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94521216803344] v25'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc858078070 con 0x7fc860014070 2024-05-08T18:50:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.443+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94521216808320] v25'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850029040 con 0x55f76f8c4e70 2024-05-08T18:50:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.444+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850029040 con 0x7fc85808b360 2024-05-08T18:50:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.444+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94521216811920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8d39a0 con 0x7fc85808b360 2024-05-08T18:50:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.444+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8d5160 con 0x7fc85808b360 2024-05-08T18:50:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.445+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(56 notify.6 [create] v25'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850029040 con 0x7fc85808b360 2024-05-08T18:50:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.445+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94521216813936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8d5440 con 0x7fc85808b360 2024-05-08T18:50:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.445+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8d5c90 con 0x7fc85808b360 2024-05-08T18:50:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.445+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94521216811920] v25'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850029040 con 0x7fc85808b360 2024-05-08T18:50:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.446+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94521216813936] v25'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850029040 con 0x7fc85808b360 2024-05-08T18:50:50.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.446+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850029040 con 0x7fc85808b360 2024-05-08T18:50:50.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.446+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94521216814992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8d5860 con 0x7fc85808b360 2024-05-08T18:50:50.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.446+0000 7fc867751800 20 add_watcher() i=0 2024-05-08T18:50:50.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.446+0000 7fc867751800 20 add_watcher() i=1 2024-05-08T18:50:50.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.446+0000 7fc867751800 20 add_watcher() i=2 2024-05-08T18:50:50.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.446+0000 7fc867751800 20 add_watcher() i=3 2024-05-08T18:50:50.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.446+0000 7fc867751800 20 add_watcher() i=4 2024-05-08T18:50:50.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.446+0000 7fc867751800 20 add_watcher() i=5 2024-05-08T18:50:50.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.446+0000 7fc867751800 20 add_watcher() i=6 2024-05-08T18:50:50.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.447+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94521216814992] v25'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850029040 con 0x7fc85808b360 2024-05-08T18:50:50.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.447+0000 7fc867751800 20 add_watcher() i=7 2024-05-08T18:50:50.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.447+0000 7fc867751800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:50.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.447+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8d8b20 con 0x55f76f8c4e70 2024-05-08T18:50:50.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.447+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc850029040 con 0x55f76f8c4e70 2024-05-08T18:50:50.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.447+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94521216816416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8d5df0 con 0x55f76f8c4e70 2024-05-08T18:50:50.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.448+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94521216816416] v25'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc850029040 con 0x55f76f8c4e70 2024-05-08T18:50:50.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.448+0000 7fc71bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:50.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.448+0000 7fc867751800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:50.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.448+0000 7fc867751800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:50.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.448+0000 7fc867751800 5 note: GC not initialized 2024-05-08T18:50:50.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.449+0000 7fc71afe5640 20 reqs_thread_entry: start 2024-05-08T18:50:50.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.449+0000 7fc867751800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:50.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.449+0000 7fc867751800 20 Filter name: none 2024-05-08T18:50:50.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.449+0000 7fc718fe1640 20 reqs_thread_entry: start 2024-05-08T18:50:50.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.449+0000 7fc867751800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:50:50.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.449+0000 7fc867751800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.449+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f90c080 con 0x55f76f8c4e70 2024-05-08T18:50:50.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.449+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc850029040 con 0x55f76f8c4e70 2024-05-08T18:50:50.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.449+0000 7fc867751800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:50.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.449+0000 7fc867751800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:50:50.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.449+0000 7fc867751800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:50.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.449+0000 7fc867751800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:50.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.449+0000 7fc867751800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-05-08T18:50:50.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.449+0000 7fc867751800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.449+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f90e000 con 0x55f76f8c4e70 2024-05-08T18:50:50.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.450+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv3 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7fc850043040 con 0x55f76f8c4e70 2024-05-08T18:50:50.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.450+0000 7fc867751800 20 rados_obj.operate() r=0 bl.length=193 2024-05-08T18:50:50.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.450+0000 7fc867751800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-05-08T18:50:50.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.450+0000 7fc867751800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-05-08T18:50:50.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.450+0000 7fc867751800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 : miss 2024-05-08T18:50:50.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.450+0000 7fc867751800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.450+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:64 8.1d 8:bea43900:root::.bucket.meta.testx%3amyfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f90f860 con 0x7fc85808b360 2024-05-08T18:50:50.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.450+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7fc850043040 con 0x7fc85808b360 2024-05-08T18:50:50.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.450+0000 7fc867751800 20 rados_obj.operate() r=0 bl.length=412 2024-05-08T18:50:50.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.450+0000 7fc867751800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 info.flags=0x17 2024-05-08T18:50:50.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.450+0000 7fc867751800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 to cache LRU end 2024-05-08T18:50:50.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.450+0000 7fc867751800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:50.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.450+0000 7fc867751800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-05-08T18:50:50.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.450+0000 7fc867751800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 2024-05-08T18:50:50.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.450+0000 7fc867751800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-05-08T18:50:50.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.450+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f913ee0 con 0x55f76f8c4e70 2024-05-08T18:50:50.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.451+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v25'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fc850043040 con 0x55f76f8c4e70 2024-05-08T18:50:50.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.451+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:66 8.1e 8:7ec7f916:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f9177f0 con 0x7fc85808b360 2024-05-08T18:50:50.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.453+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(66 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [create,call,writefull 0~379,setxattr (123)] v25'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7fc850043040 con 0x7fc85808b360 2024-05-08T18:50:50.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.453+0000 7fc867751800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 info.flags=0x7 2024-05-08T18:50:50.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.453+0000 7fc867751800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 to cache LRU end 2024-05-08T18:50:50.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.453+0000 7fc867751800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:50:50.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.453+0000 7fc867751800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1, ofs0, ns] 2024-05-08T18:50:50.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.453+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94521217078672 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f9171d0 con 0x7fc860014070 2024-05-08T18:50:50.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.453+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== watch-notify(notify (1) cookie 94521216790336 notify 107374182423 ret 0) ==== 770+0+0 (crc 0 0 0) 0x7fc8580a0040 con 0x7fc860014070 2024-05-08T18:50:50.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.453+0000 7fc748ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182423 cookie 94521216790336 notifier 4550 bl.length()=728 2024-05-08T18:50:50.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.453+0000 7fc748ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 info.flags=0x7 2024-05-08T18:50:50.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.453+0000 7fc748ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 to cache LRU end 2024-05-08T18:50:50.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.453+0000 7fc748ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:50:50.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.453+0000 7fc748ff9640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7fc728003ea0 con 0x7fc860014070 2024-05-08T18:50:50.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.453+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(67 notify.0 [notify cookie 94521217078672 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc858078070 con 0x7fc860014070 2024-05-08T18:50:50.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.453+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc858078070 con 0x7fc860014070 2024-05-08T18:50:50.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.454+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== watch-notify(notify_complete (2) cookie 94521217078672 notify 107374182423 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f76f88a5c0 con 0x7fc860014070 2024-05-08T18:50:50.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.454+0000 7fc867751800 20 handle_bi_update(): bucket=:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): orig_sources= new_sources= 2024-05-08T18:50:50.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.454+0000 7fc867751800 20 handle_bi_update(): bucket=:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): potential sources added=[] removed=[] 2024-05-08T18:50:50.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.454+0000 7fc867751800 20 handle_bi_update(): bucket=:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): orig_dests= new_dests= 2024-05-08T18:50:50.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.454+0000 7fc867751800 20 handle_bi_update(): bucket=:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): potential dests added=[] removed=[] 2024-05-08T18:50:50.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.454+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f917270 con 0x7fc860014070 2024-05-08T18:50:50.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.455+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(69 foo.buckets [call] v25'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc858078070 con 0x7fc860014070 2024-05-08T18:50:50.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.455+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f917270 con 0x7fc860014070 2024-05-08T18:50:50.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.456+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v25'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fc858078070 con 0x7fc860014070 2024-05-08T18:50:50.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.456+0000 7fc867751800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T18:50:50.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.456+0000 7fc867751800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:50:50.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.456+0000 7fc867751800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:50:50.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.456+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94521217084864 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f9171e0 con 0x7fc85808b360 2024-05-08T18:50:50.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.456+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== watch-notify(notify (1) cookie 94521216813936 notify 107374182410 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55f76f913910 con 0x7fc85808b360 2024-05-08T18:50:50.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.456+0000 7fc73bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182410 cookie 94521216813936 notifier 4550 bl.length()=314 2024-05-08T18:50:50.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.456+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(71 notify.6 [notify cookie 94521217084864 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc850043040 con 0x7fc85808b360 2024-05-08T18:50:50.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.456+0000 7fc73bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T18:50:50.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.456+0000 7fc73bfff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:50:50.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.456+0000 7fc73bfff640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7fc68c003400 con 0x7fc85808b360 2024-05-08T18:50:50.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.456+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850043040 con 0x7fc85808b360 2024-05-08T18:50:50.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.457+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== watch-notify(notify_complete (2) cookie 94521217084864 notify 107374182410 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f76f90fc50 con 0x7fc85808b360 2024-05-08T18:50:50.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.457+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f917270 con 0x55f76f8c4e70 2024-05-08T18:50:50.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.457+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(73 testx/myfoo [call,delete] v25'4 uv4 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fc850043040 con 0x55f76f8c4e70 2024-05-08T18:50:50.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.457+0000 7fc867751800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-05-08T18:50:50.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.457+0000 7fc867751800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-05-08T18:50:50.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.457+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94521217084864 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f9171e0 con 0x55f76f8c4e70 2024-05-08T18:50:50.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.458+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== watch-notify(notify (1) cookie 94521216808320 notify 107374182412 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55f76f90fc50 con 0x55f76f8c4e70 2024-05-08T18:50:50.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.458+0000 7fc73bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182412 cookie 94521216808320 notifier 4550 bl.length()=155 2024-05-08T18:50:50.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.458+0000 7fc73bfff640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7fc68c003400 con 0x55f76f8c4e70 2024-05-08T18:50:50.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.458+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(74 notify.4 [notify cookie 94521217084864 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc850043040 con 0x55f76f8c4e70 2024-05-08T18:50:50.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.458+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== watch-notify(notify_complete (2) cookie 94521217084864 notify 107374182412 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f76f90edc0 con 0x55f76f8c4e70 2024-05-08T18:50:50.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.458+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850043040 con 0x55f76f8c4e70 2024-05-08T18:50:50.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.458+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:76 8.1d 8:bea43900:root::.bucket.meta.testx%3amyfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f917270 con 0x7fc85808b360 2024-05-08T18:50:50.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.459+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [call,delete] v25'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7fc850043040 con 0x7fc85808b360 2024-05-08T18:50:50.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.459+0000 7fc867751800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 from cache 2024-05-08T18:50:50.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.459+0000 7fc867751800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1, ofs0, ns] 2024-05-08T18:50:50.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.459+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [notify cookie 94521217053008 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55f76f917270 con 0x7fc85808b360 2024-05-08T18:50:50.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.459+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== watch-notify(notify (1) cookie 94521216814992 notify 107374182411 ret 0) ==== 254+0+0 (crc 0 0 0) 0x55f76f90edc0 con 0x7fc85808b360 2024-05-08T18:50:50.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.459+0000 7fc748ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182411 cookie 94521216814992 notifier 4550 bl.length()=212 2024-05-08T18:50:50.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.459+0000 7fc748ff9640 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7fc728003ea0 con 0x7fc85808b360 2024-05-08T18:50:50.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.459+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(77 notify.7 [notify cookie 94521217053008 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc850043040 con 0x7fc85808b360 2024-05-08T18:50:50.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.460+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(78 notify.7 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850043040 con 0x7fc85808b360 2024-05-08T18:50:50.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.460+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== watch-notify(notify_complete (2) cookie 94521217053008 notify 107374182411 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f76f78ed60 con 0x7fc85808b360 2024-05-08T18:50:50.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.461+0000 7fc71bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:50.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.461+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94521216816416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f916dc0 con 0x55f76f8c4e70 2024-05-08T18:50:50.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.462+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94521216816416] v25'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc850043040 con 0x55f76f8c4e70 2024-05-08T18:50:50.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.462+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94521216790336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f916dc0 con 0x7fc860014070 2024-05-08T18:50:50.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.463+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94521216790336] v25'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc858078070 con 0x7fc860014070 2024-05-08T18:50:50.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.463+0000 7fc867751800 20 remove_watcher() i=0 2024-05-08T18:50:50.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.463+0000 7fc867751800 2 removed watcher, disabling cache 2024-05-08T18:50:50.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.463+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94521216797472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cef40 con 0x55f76f8c4e70 2024-05-08T18:50:50.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.464+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94521216797472] v25'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850043040 con 0x55f76f8c4e70 2024-05-08T18:50:50.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.464+0000 7fc867751800 20 remove_watcher() i=1 2024-05-08T18:50:50.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.464+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94521216798528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cef40 con 0x55f76f8c9780 2024-05-08T18:50:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.465+0000 7fc865a51640 1 -- 172.21.15.132:0/3667526383 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94521216798528] v25'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc860061040 con 0x55f76f8c9780 2024-05-08T18:50:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.465+0000 7fc867751800 20 remove_watcher() i=2 2024-05-08T18:50:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.465+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94521216803344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cef40 con 0x7fc860014070 2024-05-08T18:50:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.466+0000 7fc865250640 1 -- 172.21.15.132:0/3667526383 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94521216803344] v25'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc858078070 con 0x7fc860014070 2024-05-08T18:50:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.466+0000 7fc867751800 20 remove_watcher() i=3 2024-05-08T18:50:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.466+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94521216808320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cef40 con 0x55f76f8c4e70 2024-05-08T18:50:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.467+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.1 v2:172.21.15.132:6800/3697320277 32 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94521216808320] v25'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850043040 con 0x55f76f8c4e70 2024-05-08T18:50:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.467+0000 7fc867751800 20 remove_watcher() i=4 2024-05-08T18:50:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.467+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94521216811920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f9177e0 con 0x7fc85808b360 2024-05-08T18:50:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.468+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 28 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94521216811920] v25'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850043040 con 0x7fc85808b360 2024-05-08T18:50:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.468+0000 7fc867751800 20 remove_watcher() i=5 2024-05-08T18:50:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.468+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94521216813936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8d3580 con 0x7fc85808b360 2024-05-08T18:50:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.469+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 29 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94521216813936] v25'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850043040 con 0x7fc85808b360 2024-05-08T18:50:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.469+0000 7fc867751800 20 remove_watcher() i=6 2024-05-08T18:50:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.469+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94521216814992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55f76f8cef40 con 0x7fc85808b360 2024-05-08T18:50:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.470+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 <== osd.0 v2:172.21.15.42:6800/1521799280 30 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94521216814992] v25'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc850043040 con 0x7fc85808b360 2024-05-08T18:50:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.470+0000 7fc867751800 20 remove_watcher() i=7 2024-05-08T18:50:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.470+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fc85808b360 msgr2=0x7fc8580935e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.470+0000 7fc867751800 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fc85808b360 0x7fc8580935e0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.470+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f76f8c4e70 msgr2=0x55f76f8c7330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.470+0000 7fc867751800 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f76f8c4e70 0x55f76f8c7330 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.470+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fc860014070 msgr2=0x7fc8600399d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.470+0000 7fc867751800 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fc860014070 0x7fc8600399d0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.470+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f76f8c9780 msgr2=0x55f76f8cbb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.470+0000 7fc867751800 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f76f8c9780 0x55f76f8cbb70 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.470+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc73003bba0 msgr2=0x7fc73003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.470+0000 7fc867751800 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc73003bba0 0x7fc73003e060 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc85805ce20 tx=0x7fc858072000 comp rx=0 tx=0).stop 2024-05-08T18:50:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.470+0000 7fc85ca4f640 1 -- 172.21.15.132:0/3667526383 reap_dead start 2024-05-08T18:50:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.470+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f8af940 msgr2=0x55f76f703ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f8af940 0x55f76f703ca0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc860024fd0 tx=0x7fc860052d20 comp rx=0 tx=0).stop 2024-05-08T18:50:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 shutdown_connections 2024-05-08T18:50:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 --2- 172.21.15.132:0/3667526383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f8af940 0x55f76f703ca0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 >> 172.21.15.132:0/3667526383 conn(0x55f76f8abca0 msgr2=0x55f76f8a9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 shutdown_connections 2024-05-08T18:50:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 -- 172.21.15.132:0/3667526383 wait complete. 2024-05-08T18:50:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 -- 172.21.15.132:0/4173096089 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc73c03bba0 msgr2=0x7fc73c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 --2- 172.21.15.132:0/4173096089 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc73c03bba0 0x7fc73c03e060 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55f76f88edd0 tx=0x7fc858066ca0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 -- 172.21.15.132:0/4173096089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f8a26c0 msgr2=0x55f76f8a2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 --2- 172.21.15.132:0/4173096089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f8a26c0 0x55f76f8a2ae0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x55f76f88ed10 tx=0x7fc860018830 comp rx=0 tx=0).stop 2024-05-08T18:50:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 -- 172.21.15.132:0/4173096089 shutdown_connections 2024-05-08T18:50:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 --2- 172.21.15.132:0/4173096089 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc73c03bba0 0x7fc73c03e060 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 --2- 172.21.15.132:0/4173096089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f8a26c0 0x55f76f8a2ae0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 -- 172.21.15.132:0/4173096089 >> 172.21.15.132:0/4173096089 conn(0x55f76f896760 msgr2=0x55f76f896b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 -- 172.21.15.132:0/4173096089 shutdown_connections 2024-05-08T18:50:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 -- 172.21.15.132:0/4173096089 wait complete. 2024-05-08T18:50:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 -- 172.21.15.132:0/355903509 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f76f78f480 msgr2=0x55f76f88e380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 --2- 172.21.15.132:0/355903509 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f76f78f480 0x55f76f88e380 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 -- 172.21.15.132:0/355903509 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f76f890cb0 msgr2=0x55f76f8930a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 --2- 172.21.15.132:0/355903509 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f76f890cb0 0x55f76f8930a0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 -- 172.21.15.132:0/355903509 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc74c03bb50 msgr2=0x7fc74c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 --2- 172.21.15.132:0/355903509 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc74c03bb50 0x7fc74c03e010 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc850000f60 tx=0x7fc8500012b0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 -- 172.21.15.132:0/355903509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f78e2c0 msgr2=0x55f76f8871e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 --2- 172.21.15.132:0/355903509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f78e2c0 0x55f76f8871e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc85801ced0 tx=0x7fc858002fb0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.471+0000 7fc867751800 1 -- 172.21.15.132:0/355903509 shutdown_connections 2024-05-08T18:50:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.472+0000 7fc867751800 1 --2- 172.21.15.132:0/355903509 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f76f890cb0 0x55f76f8930a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.472+0000 7fc867751800 1 --2- 172.21.15.132:0/355903509 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f76f78f480 0x55f76f88e380 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.472+0000 7fc867751800 1 --2- 172.21.15.132:0/355903509 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc74c03bb50 0x7fc74c03e010 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.472+0000 7fc867751800 1 --2- 172.21.15.132:0/355903509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f76f78e2c0 0x55f76f8871e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.472+0000 7fc867751800 1 -- 172.21.15.132:0/355903509 >> 172.21.15.132:0/355903509 conn(0x55f76f789840 msgr2=0x55f76f879840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.472+0000 7fc867751800 1 -- 172.21.15.132:0/355903509 shutdown_connections 2024-05-08T18:50:50.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.472+0000 7fc867751800 1 -- 172.21.15.132:0/355903509 wait complete. 2024-05-08T18:50:50.484 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-08T18:50:50.484 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-08T18:50:50.484 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-05-08T18:50:50.530 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:50.530 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:50.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.532+0000 7efe07496800 1 Processor -- start 2024-05-08T18:50:50.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.532+0000 7efe07496800 1 -- start start 2024-05-08T18:50:50.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.532+0000 7efe07496800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x555a9468a2c0 0x555a9468a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.532+0000 7efe07496800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555a9468ad60 con 0x555a9468b480 2024-05-08T18:50:50.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.532+0000 7efe07496800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x555a9452ae20 con 0x555a9468a2c0 2024-05-08T18:50:50.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.532+0000 7efe04f8e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x555a9468a2c0 0x555a9468a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.532+0000 7efe04f8e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x555a9468a2c0 0x555a9468a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40242/0 (socket says 172.21.15.132:40242) 2024-05-08T18:50:50.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.532+0000 7efe04f8e640 1 -- 172.21.15.132:0/829212083 learned_addr learned my addr 172.21.15.132:0/829212083 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.532+0000 7efdfc78d640 1 --1- 172.21.15.132:0/829212083 >> v1:172.21.15.42:6789/0 conn(0x555a9468b480 0x555a9468b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:43586/0 (socket says 172.21.15.132:43586) 2024-05-08T18:50:50.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.533+0000 7efe04f8e640 1 -- 172.21.15.132:0/829212083 >> v1:172.21.15.42:6789/0 conn(0x555a9468b480 legacy=0x555a9468b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.533+0000 7efe04f8e640 1 -- 172.21.15.132:0/829212083 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a9468c040 con 0x555a9468a2c0 2024-05-08T18:50:50.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.534+0000 7efe04f8e640 1 --2- 172.21.15.132:0/829212083 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9468a2c0 0x555a9468a6e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efdf400a520 tx=0x7efdf401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93daa685206c94a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.535+0000 7efdfffff640 1 -- 172.21.15.132:0/829212083 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf4057070 con 0x555a9468a2c0 2024-05-08T18:50:50.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.535+0000 7efdfffff640 1 -- 172.21.15.132:0/829212083 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf4052570 con 0x555a9468a2c0 2024-05-08T18:50:50.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.535+0000 7efdfffff640 1 -- 172.21.15.132:0/829212083 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf4052870 con 0x555a9468a2c0 2024-05-08T18:50:50.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.535+0000 7efe07496800 1 -- 172.21.15.132:0/829212083 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9468a2c0 msgr2=0x555a9468a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.535+0000 7efe07496800 1 --2- 172.21.15.132:0/829212083 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9468a2c0 0x555a9468a6e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efdf400a520 tx=0x7efdf401d010 comp rx=0 tx=0).stop 2024-05-08T18:50:50.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.535+0000 7efe07496800 1 -- 172.21.15.132:0/829212083 shutdown_connections 2024-05-08T18:50:50.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.535+0000 7efe07496800 1 --2- 172.21.15.132:0/829212083 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9468a2c0 0x555a9468a6e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.535+0000 7efe07496800 1 -- 172.21.15.132:0/829212083 >> 172.21.15.132:0/829212083 conn(0x555a94685840 msgr2=0x555a94687c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.535+0000 7efe07496800 1 -- 172.21.15.132:0/829212083 shutdown_connections 2024-05-08T18:50:50.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.535+0000 7efe07496800 1 -- 172.21.15.132:0/829212083 wait complete. 2024-05-08T18:50:50.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.548+0000 7efe07496800 1 Processor -- start 2024-05-08T18:50:50.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.549+0000 7efe07496800 1 -- start start 2024-05-08T18:50:50.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.549+0000 7efe07496800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9468a2c0 0x555a9477b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.549+0000 7efe07496800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555a945d55c0 con 0x555a9468a2c0 2024-05-08T18:50:50.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.549+0000 7efe04f8e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9468a2c0 0x555a9477b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.549+0000 7efe04f8e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9468a2c0 0x555a9477b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40244/0 (socket says 172.21.15.132:40244) 2024-05-08T18:50:50.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.549+0000 7efe04f8e640 1 -- 172.21.15.132:0/1309101108 learned_addr learned my addr 172.21.15.132:0/1309101108 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.549+0000 7efe04f8e640 1 -- 172.21.15.132:0/1309101108 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a9477bcf0 con 0x555a9468a2c0 2024-05-08T18:50:50.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.549+0000 7efe04f8e640 1 --2- 172.21.15.132:0/1309101108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9468a2c0 0x555a9477b720 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efdf401d050 tx=0x7efdf404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a351705de226eec server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.550+0000 7efcf2e0d640 1 -- 172.21.15.132:0/1309101108 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf4057040 con 0x555a9468a2c0 2024-05-08T18:50:50.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.550+0000 7efcf2e0d640 1 -- 172.21.15.132:0/1309101108 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf4052850 con 0x555a9468a2c0 2024-05-08T18:50:50.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.550+0000 7efcf2e0d640 1 -- 172.21.15.132:0/1309101108 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf4052b70 con 0x555a9468a2c0 2024-05-08T18:50:50.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.550+0000 7efe07496800 1 -- 172.21.15.132:0/1309101108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9468a2c0 msgr2=0x555a9477b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.550+0000 7efe07496800 1 --2- 172.21.15.132:0/1309101108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9468a2c0 0x555a9477b720 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efdf401d050 tx=0x7efdf404c000 comp rx=0 tx=0).stop 2024-05-08T18:50:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.550+0000 7efe07496800 1 -- 172.21.15.132:0/1309101108 shutdown_connections 2024-05-08T18:50:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.550+0000 7efe07496800 1 --2- 172.21.15.132:0/1309101108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9468a2c0 0x555a9477b720 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.550+0000 7efe07496800 1 -- 172.21.15.132:0/1309101108 >> 172.21.15.132:0/1309101108 conn(0x555a94685840 msgr2=0x555a94777040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.550+0000 7efe07496800 1 -- 172.21.15.132:0/1309101108 shutdown_connections 2024-05-08T18:50:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.551+0000 7efe07496800 1 -- 172.21.15.132:0/1309101108 wait complete. 2024-05-08T18:50:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.551+0000 7efe07496800 1 Processor -- start 2024-05-08T18:50:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.551+0000 7efe07496800 1 -- start start 2024-05-08T18:50:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.551+0000 7efe07496800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9468a2c0 0x555a947830e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.551+0000 7efe07496800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555a94693950 con 0x555a9468a2c0 2024-05-08T18:50:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.551+0000 7efe04f8e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9468a2c0 0x555a947830e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.551+0000 7efe04f8e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9468a2c0 0x555a947830e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40250/0 (socket says 172.21.15.132:40250) 2024-05-08T18:50:50.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.551+0000 7efe04f8e640 1 -- 172.21.15.132:0/1445999100 learned_addr learned my addr 172.21.15.132:0/1445999100 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.551+0000 7efe04f8e640 1 -- 172.21.15.132:0/1445999100 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a94783620 con 0x555a9468a2c0 2024-05-08T18:50:50.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.552+0000 7efe04f8e640 1 --2- 172.21.15.132:0/1445999100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9468a2c0 0x555a947830e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efdf401d050 tx=0x7efdf4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.552+0000 7efcf160a640 1 -- 172.21.15.132:0/1445999100 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf4073070 con 0x555a9468a2c0 2024-05-08T18:50:50.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.552+0000 7efcf160a640 1 -- 172.21.15.132:0/1445999100 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf405d650 con 0x555a9468a2c0 2024-05-08T18:50:50.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.552+0000 7efe07496800 1 -- 172.21.15.132:0/1445999100 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a947838b0 con 0x555a9468a2c0 2024-05-08T18:50:50.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.552+0000 7efcf160a640 1 -- 172.21.15.132:0/1445999100 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf4057070 con 0x555a9468a2c0 2024-05-08T18:50:50.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.552+0000 7efe07496800 1 -- 172.21.15.132:0/1445999100 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a94786560 con 0x555a9468a2c0 2024-05-08T18:50:50.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.553+0000 7efcf160a640 1 -- 172.21.15.132:0/1445999100 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7efdf4076070 con 0x555a9468a2c0 2024-05-08T18:50:50.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.553+0000 7efcf160a640 1 --2- 172.21.15.132:0/1445999100 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efcec03bba0 0x7efcec03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.553+0000 7efcf160a640 1 -- 172.21.15.132:0/1445999100 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7efdf4094170 con 0x555a9468a2c0 2024-05-08T18:50:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.553+0000 7efdfc78d640 1 --2- 172.21.15.132:0/1445999100 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efcec03bba0 0x7efcec03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.553+0000 7efe07496800 1 --2- 172.21.15.132:0/1445999100 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555a9468b480 0x555a9478a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.553+0000 7efe07496800 1 -- 172.21.15.132:0/1445999100 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555a9478a900 con 0x555a9468b480 2024-05-08T18:50:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.553+0000 7efe0578f640 1 --2- 172.21.15.132:0/1445999100 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555a9468b480 0x555a9478a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.553+0000 7efdfc78d640 1 --2- 172.21.15.132:0/1445999100 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efcec03bba0 0x7efcec03e060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efdec000f60 tx=0x7efdec001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.554+0000 7efe0578f640 1 --2- 172.21.15.132:0/1445999100 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555a9468b480 0x555a9478a320 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.554+0000 7efe0578f640 1 -- 172.21.15.132:0/1445999100 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe0000a4a0 con 0x555a9468b480 2024-05-08T18:50:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.554+0000 7efe07496800 1 -- 172.21.15.132:0/1445999100 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555a947878f0 con 0x555a9468b480 2024-05-08T18:50:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.554+0000 7efe0578f640 1 -- 172.21.15.132:0/1445999100 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efe0000a4a0 con 0x555a9468b480 2024-05-08T18:50:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.554+0000 7efe07496800 1 --2- 172.21.15.132:0/1445999100 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555a9478cc50 0x555a9478f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.554+0000 7efe07496800 1 -- 172.21.15.132:0/1445999100 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555a9478f730 con 0x555a9478cc50 2024-05-08T18:50:50.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.554+0000 7efe04f8e640 1 --2- 172.21.15.132:0/1445999100 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555a9478cc50 0x555a9478f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.554+0000 7efe04f8e640 1 --2- 172.21.15.132:0/1445999100 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555a9478cc50 0x555a9478f040 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.555+0000 7efe04f8e640 1 -- 172.21.15.132:0/1445999100 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efdf4075030 con 0x555a9478cc50 2024-05-08T18:50:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.555+0000 7efe07496800 1 -- 172.21.15.132:0/1445999100 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555a9478baf0 con 0x555a9468b480 2024-05-08T18:50:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.555+0000 7efe0578f640 1 -- 172.21.15.132:0/1445999100 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efe0000a4a0 con 0x555a9468b480 2024-05-08T18:50:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.555+0000 7efe07496800 1 -- 172.21.15.132:0/1445999100 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555a9478bfd0 con 0x555a9468b480 2024-05-08T18:50:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.555+0000 7efe0578f640 1 -- 172.21.15.132:0/1445999100 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efe0000a4a0 con 0x555a9468b480 2024-05-08T18:50:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.556+0000 7efe07496800 1 Processor -- start 2024-05-08T18:50:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.556+0000 7efe07496800 1 -- start start 2024-05-08T18:50:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.556+0000 7efe07496800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9479e670 0x555a9479ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.556+0000 7efe07496800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555a9457bfc0 con 0x555a9479e670 2024-05-08T18:50:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.556+0000 7efe0578f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9479e670 0x555a9479ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.556+0000 7efe0578f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9479e670 0x555a9479ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40256/0 (socket says 172.21.15.132:40256) 2024-05-08T18:50:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.556+0000 7efe0578f640 1 -- 172.21.15.132:0/1250720472 learned_addr learned my addr 172.21.15.132:0/1250720472 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.557+0000 7efe0578f640 1 -- 172.21.15.132:0/1250720472 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a9479efd0 con 0x555a9479e670 2024-05-08T18:50:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.557+0000 7efe0578f640 1 --2- 172.21.15.132:0/1250720472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9479e670 0x555a9479ea90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x555a9478ad00 tx=0x7efe00018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.557+0000 7efcea7fc640 1 -- 172.21.15.132:0/1250720472 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe00014450 con 0x555a9479e670 2024-05-08T18:50:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.557+0000 7efcea7fc640 1 -- 172.21.15.132:0/1250720472 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe00014610 con 0x555a9479e670 2024-05-08T18:50:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.557+0000 7efe07496800 1 -- 172.21.15.132:0/1250720472 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a9479fa40 con 0x555a9479e670 2024-05-08T18:50:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.557+0000 7efcea7fc640 1 -- 172.21.15.132:0/1250720472 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe00014930 con 0x555a9479e670 2024-05-08T18:50:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.557+0000 7efe07496800 1 -- 172.21.15.132:0/1250720472 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a9479ff40 con 0x555a9479e670 2024-05-08T18:50:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.558+0000 7efcea7fc640 1 -- 172.21.15.132:0/1250720472 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7efe00011040 con 0x555a9479e670 2024-05-08T18:50:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.558+0000 7efcea7fc640 1 --2- 172.21.15.132:0/1250720472 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efcdc03bbf0 0x7efcdc03e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.558+0000 7efcea7fc640 1 -- 172.21.15.132:0/1250720472 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7efe0001e070 con 0x555a9479e670 2024-05-08T18:50:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.558+0000 7efe04f8e640 1 --2- 172.21.15.132:0/1250720472 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efcdc03bbf0 0x7efcdc03e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.558+0000 7efe07496800 1 Processor -- start 2024-05-08T18:50:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.558+0000 7efe04f8e640 1 --2- 172.21.15.132:0/1250720472 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efcdc03bbf0 0x7efcdc03e0b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x555a9478ada0 tx=0x7efdf40925e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.558+0000 7efe07496800 1 -- start start 2024-05-08T18:50:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.558+0000 7efe07496800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a947ab8f0 0x555a947abd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.558+0000 7efe07496800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555a9477bfb0 con 0x555a947ab8f0 2024-05-08T18:50:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.559+0000 7efe0578f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a947ab8f0 0x555a947abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.559+0000 7efe0578f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a947ab8f0 0x555a947abd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40260/0 (socket says 172.21.15.132:40260) 2024-05-08T18:50:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.559+0000 7efe0578f640 1 -- 172.21.15.132:0/1525300504 learned_addr learned my addr 172.21.15.132:0/1525300504 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.559+0000 7efe0578f640 1 -- 172.21.15.132:0/1525300504 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a947ac2e0 con 0x555a947ab8f0 2024-05-08T18:50:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.559+0000 7efe0578f640 1 --2- 172.21.15.132:0/1525300504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a947ab8f0 0x555a947abd10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efe00013fd0 tx=0x7efe00011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5760a1d034bdd7ff server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.559+0000 7efcdbfff640 1 -- 172.21.15.132:0/1525300504 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe00014c00 con 0x555a947ab8f0 2024-05-08T18:50:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.559+0000 7efcdbfff640 1 -- 172.21.15.132:0/1525300504 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe0002bc50 con 0x555a947ab8f0 2024-05-08T18:50:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.559+0000 7efcdbfff640 1 -- 172.21.15.132:0/1525300504 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe000167c0 con 0x555a947ab8f0 2024-05-08T18:50:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.560+0000 7efe07496800 1 -- 172.21.15.132:0/1525300504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a947ab8f0 msgr2=0x555a947abd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.560+0000 7efe07496800 1 --2- 172.21.15.132:0/1525300504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a947ab8f0 0x555a947abd10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efe00013fd0 tx=0x7efe00011e80 comp rx=0 tx=0).stop 2024-05-08T18:50:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.560+0000 7efe07496800 1 -- 172.21.15.132:0/1525300504 shutdown_connections 2024-05-08T18:50:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.560+0000 7efe07496800 1 --2- 172.21.15.132:0/1525300504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a947ab8f0 0x555a947abd10 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.560+0000 7efe07496800 1 -- 172.21.15.132:0/1525300504 >> 172.21.15.132:0/1525300504 conn(0x555a947a7c00 msgr2=0x555a947a5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.560+0000 7efe07496800 1 -- 172.21.15.132:0/1525300504 shutdown_connections 2024-05-08T18:50:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.560+0000 7efe07496800 1 -- 172.21.15.132:0/1525300504 wait complete. 2024-05-08T18:50:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.560+0000 7efe07496800 1 Processor -- start 2024-05-08T18:50:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.560+0000 7efe07496800 1 -- start start 2024-05-08T18:50:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.560+0000 7efe07496800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a947ab8f0 0x555a947b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.560+0000 7efe07496800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555a947acab0 con 0x555a947ab8f0 2024-05-08T18:50:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.561+0000 7efe0578f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a947ab8f0 0x555a947b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.561+0000 7efe0578f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a947ab8f0 0x555a947b2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40268/0 (socket says 172.21.15.132:40268) 2024-05-08T18:50:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.561+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 learned_addr learned my addr 172.21.15.132:0/934341661 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.561+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a947b3360 con 0x555a947ab8f0 2024-05-08T18:50:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.561+0000 7efe0578f640 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a947ab8f0 0x555a947b2e20 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7efe00013fd0 tx=0x7efe00052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.561+0000 7efcda7fc640 1 -- 172.21.15.132:0/934341661 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe00054530 con 0x555a947ab8f0 2024-05-08T18:50:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.561+0000 7efcda7fc640 1 -- 172.21.15.132:0/934341661 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe00045050 con 0x555a947ab8f0 2024-05-08T18:50:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.561+0000 7efcda7fc640 1 -- 172.21.15.132:0/934341661 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe000408d0 con 0x555a947ab8f0 2024-05-08T18:50:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.561+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a947b35f0 con 0x555a947ab8f0 2024-05-08T18:50:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.561+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a947b62a0 con 0x555a947ab8f0 2024-05-08T18:50:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.562+0000 7efcda7fc640 1 -- 172.21.15.132:0/934341661 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7efe00040a70 con 0x555a947ab8f0 2024-05-08T18:50:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.562+0000 7efcda7fc640 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efcd003bba0 0x7efcd003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.562+0000 7efcda7fc640 1 -- 172.21.15.132:0/934341661 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7efe0000e040 con 0x555a947ab8f0 2024-05-08T18:50:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.562+0000 7efe04f8e640 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efcd003bba0 0x7efcd003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.563+0000 7efe04f8e640 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efcd003bba0 0x7efcd003e060 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efdf4092710 tx=0x7efdf4085000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.563+0000 7efe07496800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.563+0000 7efe07496800 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555a947beaa0 0x555a947c0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.563+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555a947c16b0 con 0x555a947beaa0 2024-05-08T18:50:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.563+0000 7efdfc78d640 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555a947beaa0 0x555a947c0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.563+0000 7efdfc78d640 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555a947beaa0 0x555a947c0f60 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.564+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdec00f610 con 0x555a947beaa0 2024-05-08T18:50:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.564+0000 7efe07496800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.564+0000 7efe07496800 20 realm 2024-05-08T18:50:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.564+0000 7efe07496800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.564+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555a947bdef0 con 0x555a947beaa0 2024-05-08T18:50:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.564+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdec00f610 con 0x555a947beaa0 2024-05-08T18:50:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.564+0000 7efe07496800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.564+0000 7efe07496800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.564+0000 7efe07496800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.564+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555a947c21a0 con 0x555a947beaa0 2024-05-08T18:50:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.564+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdec00f610 con 0x555a947beaa0 2024-05-08T18:50:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.564+0000 7efe07496800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.564+0000 7efe07496800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.564+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555a947c2a70 con 0x555a947beaa0 2024-05-08T18:50:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.564+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efdec00f610 con 0x555a947beaa0 2024-05-08T18:50:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.564+0000 7efe07496800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.564+0000 7efe07496800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.564+0000 7efe07496800 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555a947c3490 0x555a947c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.564+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555a947c5fc0 con 0x555a947c3490 2024-05-08T18:50:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.564+0000 7efe0578f640 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555a947c3490 0x555a947c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.565+0000 7efe0578f640 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555a947c3490 0x555a947c5880 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.565+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efe0003d070 con 0x555a947c3490 2024-05-08T18:50:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.565+0000 7efe07496800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.565+0000 7efe07496800 20 searching for the correct realm 2024-05-08T18:50:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.565+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x555a947c3490 2024-05-08T18:50:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.565+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe0003d070 con 0x555a947c3490 2024-05-08T18:50:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.565+0000 7efe0578f640 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7efe00014070 0x7efe0004fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.566+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x7efe00014070 2024-05-08T18:50:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.566+0000 7efe04f8e640 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7efe00014070 0x7efe0004fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.566+0000 7efe04f8e640 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7efe00014070 0x7efe0004fa50 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.566+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf4075030 con 0x7efe00014070 2024-05-08T18:50:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.566+0000 7efe04f8e640 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7efdf4078060 0x7efdf405b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.566+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x7efdf4078060 2024-05-08T18:50:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.566+0000 7efdfc78d640 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7efdf4078060 0x7efdf405b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.567+0000 7efdfc78d640 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7efdf4078060 0x7efdf405b550 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.567+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec00f610 con 0x7efdf4078060 2024-05-08T18:50:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.567+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x555a947beaa0 2024-05-08T18:50:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.567+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec00f610 con 0x555a947beaa0 2024-05-08T18:50:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.567+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x555a947beaa0 2024-05-08T18:50:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.567+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec02b040 con 0x555a947beaa0 2024-05-08T18:50:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.567+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x7efdf4078060 2024-05-08T18:50:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.568+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec02b040 con 0x7efdf4078060 2024-05-08T18:50:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.568+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x7efdf4078060 2024-05-08T18:50:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.568+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec02b040 con 0x7efdf4078060 2024-05-08T18:50:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.568+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x7efe00014070 2024-05-08T18:50:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.568+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf4075030 con 0x7efe00014070 2024-05-08T18:50:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.568+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x555a947c3490 2024-05-08T18:50:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.568+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe0003d070 con 0x555a947c3490 2024-05-08T18:50:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.568+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x555a947beaa0 2024-05-08T18:50:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.569+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec02b040 con 0x555a947beaa0 2024-05-08T18:50:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.569+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x7efdf4078060 2024-05-08T18:50:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.569+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec02b040 con 0x7efdf4078060 2024-05-08T18:50:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.569+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x555a947beaa0 2024-05-08T18:50:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.569+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efdec02b040 con 0x555a947beaa0 2024-05-08T18:50:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.569+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x7efe00014070 2024-05-08T18:50:50.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.569+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efdf4075030 con 0x7efe00014070 2024-05-08T18:50:50.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.569+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x555a947c3490 2024-05-08T18:50:50.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.570+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efe0003d070 con 0x555a947c3490 2024-05-08T18:50:50.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.570+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x555a947c3490 2024-05-08T18:50:50.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.570+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe0003d070 con 0x555a947c3490 2024-05-08T18:50:50.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.570+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x7efdf4078060 2024-05-08T18:50:50.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.570+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec02b040 con 0x7efdf4078060 2024-05-08T18:50:50.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.570+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x555a947c3490 2024-05-08T18:50:50.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.571+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe0003d070 con 0x555a947c3490 2024-05-08T18:50:50.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.571+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x555a947c3490 2024-05-08T18:50:50.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.571+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe0003d070 con 0x555a947c3490 2024-05-08T18:50:50.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.571+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x555a947beaa0 2024-05-08T18:50:50.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.571+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec02b040 con 0x555a947beaa0 2024-05-08T18:50:50.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.571+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x555a947beaa0 2024-05-08T18:50:50.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.571+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efdec02b040 con 0x555a947beaa0 2024-05-08T18:50:50.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.571+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x7efdf4078060 2024-05-08T18:50:50.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.572+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec02b040 con 0x7efdf4078060 2024-05-08T18:50:50.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.572+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x555a947c3490 2024-05-08T18:50:50.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.572+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe00069040 con 0x555a947c3490 2024-05-08T18:50:50.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.572+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x7efe00014070 2024-05-08T18:50:50.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.572+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf4075030 con 0x7efe00014070 2024-05-08T18:50:50.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.572+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x555a947beaa0 2024-05-08T18:50:50.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.572+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec02b040 con 0x555a947beaa0 2024-05-08T18:50:50.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.572+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x7efdf4078060 2024-05-08T18:50:50.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.573+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.573+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x555a947c3490 2024-05-08T18:50:50.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.573+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe00069040 con 0x555a947c3490 2024-05-08T18:50:50.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.573+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x7efdf4078060 2024-05-08T18:50:50.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.573+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.573+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x7efe00014070 2024-05-08T18:50:50.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.573+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf4075030 con 0x7efe00014070 2024-05-08T18:50:50.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.573+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x555a947c3490 2024-05-08T18:50:50.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.574+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe00069040 con 0x555a947c3490 2024-05-08T18:50:50.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.574+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x7efdf4078060 2024-05-08T18:50:50.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.574+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.574+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x555a947beaa0 2024-05-08T18:50:50.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.574+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.574+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x555a947c78d0 con 0x7efe00014070 2024-05-08T18:50:50.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.574+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf4075030 con 0x7efe00014070 2024-05-08T18:50:50.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.574+0000 7efe07496800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:50.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.574+0000 7efe07496800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:50.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.574+0000 7efe07496800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:50.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.574+0000 7efe07496800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:50.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.574+0000 7efe07496800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:50.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.574+0000 7efe07496800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:50.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.574+0000 7efe07496800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.574+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555a947c6810 con 0x555a947beaa0 2024-05-08T18:50:50.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.575+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.575+0000 7efe07496800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.575+0000 7efe07496800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.575+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555a947c6c00 con 0x555a947beaa0 2024-05-08T18:50:50.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.575+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.575+0000 7efe07496800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:50.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.575+0000 7efe07496800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.575+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555a947c7d50 con 0x555a947beaa0 2024-05-08T18:50:50.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.575+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.575+0000 7efe07496800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:50.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.575+0000 7efe07496800 20 zone default found 2024-05-08T18:50:50.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.575+0000 7efe07496800 4 Realm: () 2024-05-08T18:50:50.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.575+0000 7efe07496800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:50.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.575+0000 7efe07496800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:50.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.575+0000 7efe07496800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:50.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.575+0000 7efe07496800 20 zonegroup default 2024-05-08T18:50:50.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.575+0000 7efe07496800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.575+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555a947c7db0 con 0x7efdf4078060 2024-05-08T18:50:50.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.576+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.576+0000 7efe07496800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.576+0000 7efe07496800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.576+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555a947c9bd0 con 0x555a947c3490 2024-05-08T18:50:50.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.576+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efe00069040 con 0x555a947c3490 2024-05-08T18:50:50.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.576+0000 7efe07496800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.576+0000 7efe07496800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.576+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555a947c9fa0 con 0x555a947c3490 2024-05-08T18:50:50.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.576+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efe00069040 con 0x555a947c3490 2024-05-08T18:50:50.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.576+0000 7efe07496800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.576+0000 7efe07496800 20 started sync module instance, tier type = 2024-05-08T18:50:50.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.576+0000 7efe07496800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:50.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.576+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947c9070 con 0x7efe00014070 2024-05-08T18:50:50.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.577+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf4075030 con 0x7efe00014070 2024-05-08T18:50:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.577+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93847526610016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947ca8b0 con 0x7efe00014070 2024-05-08T18:50:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.577+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947cb100 con 0x555a947beaa0 2024-05-08T18:50:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.578+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93847526610016] v25'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf4075030 con 0x7efe00014070 2024-05-08T18:50:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.579+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.579+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93847526614016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947cb140 con 0x555a947beaa0 2024-05-08T18:50:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.579+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947cbc50 con 0x555a947c3490 2024-05-08T18:50:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.580+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93847526614016] v25'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.580+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe00069040 con 0x555a947c3490 2024-05-08T18:50:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.580+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93847526618880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947cbc10 con 0x555a947c3490 2024-05-08T18:50:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.580+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947cc700 con 0x7efe00014070 2024-05-08T18:50:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.581+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93847526618880] v25'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe00069040 con 0x555a947c3490 2024-05-08T18:50:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.581+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf4075030 con 0x7efe00014070 2024-05-08T18:50:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.581+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93847526621712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947ccaf0 con 0x7efe00014070 2024-05-08T18:50:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.581+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947cd530 con 0x555a947beaa0 2024-05-08T18:50:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.582+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.582+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93847526625280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947cddd0 con 0x555a947beaa0 2024-05-08T18:50:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.582+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947ce8d0 con 0x7efdf4078060 2024-05-08T18:50:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.582+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93847526621712] v25'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf4075030 con 0x7efe00014070 2024-05-08T18:50:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.583+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93847526625280] v25'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.583+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.583+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93847526630336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947cd8d0 con 0x7efdf4078060 2024-05-08T18:50:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.583+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947cf170 con 0x7efdf4078060 2024-05-08T18:50:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.584+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93847526630336] v25'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.584+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.584+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93847526616144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947cd8d0 con 0x7efdf4078060 2024-05-08T18:50:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.584+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947cf720 con 0x7efdf4078060 2024-05-08T18:50:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.585+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93847526616144] v25'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.585+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.585+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93847526632528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947cf720 con 0x7efdf4078060 2024-05-08T18:50:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.585+0000 7efe07496800 20 add_watcher() i=0 2024-05-08T18:50:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.585+0000 7efe07496800 20 add_watcher() i=1 2024-05-08T18:50:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.585+0000 7efe07496800 20 add_watcher() i=2 2024-05-08T18:50:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.585+0000 7efe07496800 20 add_watcher() i=3 2024-05-08T18:50:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.585+0000 7efe07496800 20 add_watcher() i=4 2024-05-08T18:50:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.585+0000 7efe07496800 20 add_watcher() i=5 2024-05-08T18:50:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.585+0000 7efe07496800 20 add_watcher() i=6 2024-05-08T18:50:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.586+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93847526632528] v25'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.586+0000 7efe07496800 20 add_watcher() i=7 2024-05-08T18:50:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.586+0000 7efe07496800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.586+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555a947d2b20 con 0x555a947beaa0 2024-05-08T18:50:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.587+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.587+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93847526634560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947d0040 con 0x555a947beaa0 2024-05-08T18:50:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.587+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93847526634560] v25'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.588+0000 7efcbafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.588+0000 7efe07496800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.588+0000 7efe07496800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.588+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947db4f0 con 0x555a947beaa0 2024-05-08T18:50:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.589+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v25'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.589+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dbb40 con 0x7efdf4078060 2024-05-08T18:50:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.590+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v25'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.590+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dbfa0 con 0x555a947c3490 2024-05-08T18:50:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.591+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v25'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe00069040 con 0x555a947c3490 2024-05-08T18:50:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.591+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dbf40 con 0x555a947beaa0 2024-05-08T18:50:50.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.592+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v25'135 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.592+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dbf80 con 0x7efe00014070 2024-05-08T18:50:50.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.593+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v25'38 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efdf4075030 con 0x7efe00014070 2024-05-08T18:50:50.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.593+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dc980 con 0x555a947c3490 2024-05-08T18:50:50.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.594+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v25'26 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe00069040 con 0x555a947c3490 2024-05-08T18:50:50.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.594+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dc980 con 0x555a947beaa0 2024-05-08T18:50:50.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.595+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v25'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.595+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dc980 con 0x7efdf4078060 2024-05-08T18:50:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.596+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v25'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.596+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dc980 con 0x7efe00014070 2024-05-08T18:50:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.597+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v25'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efdf4075030 con 0x7efe00014070 2024-05-08T18:50:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.597+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dc980 con 0x555a947c3490 2024-05-08T18:50:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.598+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v25'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efe00069040 con 0x555a947c3490 2024-05-08T18:50:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.598+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dca10 con 0x7efe00014070 2024-05-08T18:50:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.599+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v25'39 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efdf4075030 con 0x7efe00014070 2024-05-08T18:50:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.599+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dce30 con 0x7efdf4078060 2024-05-08T18:50:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.600+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v25'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.600+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dce30 con 0x7efe00014070 2024-05-08T18:50:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.601+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v25'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efdf4075030 con 0x7efe00014070 2024-05-08T18:50:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.601+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dce30 con 0x7efdf4078060 2024-05-08T18:50:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.602+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v25'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.602+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dce30 con 0x555a947beaa0 2024-05-08T18:50:50.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.603+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v25'136 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.603+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dce30 con 0x555a947c3490 2024-05-08T18:50:50.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.604+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v25'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe00069040 con 0x555a947c3490 2024-05-08T18:50:50.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.604+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dce30 con 0x7efe00014070 2024-05-08T18:50:50.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.605+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v25'40 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efdf4075030 con 0x7efe00014070 2024-05-08T18:50:50.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.605+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dce30 con 0x555a947c3490 2024-05-08T18:50:50.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.606+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v25'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe00069040 con 0x555a947c3490 2024-05-08T18:50:50.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.606+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dce30 con 0x555a947beaa0 2024-05-08T18:50:50.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.607+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v25'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.607+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dce30 con 0x555a947beaa0 2024-05-08T18:50:50.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.608+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v25'137 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.608+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dce30 con 0x555a947c3490 2024-05-08T18:50:50.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.609+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v25'33 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe00069040 con 0x555a947c3490 2024-05-08T18:50:50.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.609+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dce30 con 0x7efe00014070 2024-05-08T18:50:50.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.610+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v25'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efdf4075030 con 0x7efe00014070 2024-05-08T18:50:50.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.610+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dce30 con 0x555a947c3490 2024-05-08T18:50:50.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.611+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v25'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe00069040 con 0x555a947c3490 2024-05-08T18:50:50.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.611+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dce30 con 0x555a947c3490 2024-05-08T18:50:50.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.612+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v25'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe00069040 con 0x555a947c3490 2024-05-08T18:50:50.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.612+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dce30 con 0x555a947c3490 2024-05-08T18:50:50.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.613+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v25'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe00069040 con 0x555a947c3490 2024-05-08T18:50:50.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.613+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dce30 con 0x555a947c3490 2024-05-08T18:50:50.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.614+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v25'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe00069040 con 0x555a947c3490 2024-05-08T18:50:50.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.614+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dce30 con 0x7efdf4078060 2024-05-08T18:50:50.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.615+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v25'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.615+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dce30 con 0x555a947c3490 2024-05-08T18:50:50.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.616+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v25'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe00069040 con 0x555a947c3490 2024-05-08T18:50:50.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.616+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dce30 con 0x7efdf4078060 2024-05-08T18:50:50.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.617+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v25'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.617+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dce30 con 0x555a947c3490 2024-05-08T18:50:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.618+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v25'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efe00069040 con 0x555a947c3490 2024-05-08T18:50:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.618+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dce30 con 0x7efdf4078060 2024-05-08T18:50:50.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.619+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v25'32 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.619+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a947dce30 con 0x7efe00014070 2024-05-08T18:50:50.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.620+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v25'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efdf4075030 con 0x7efe00014070 2024-05-08T18:50:50.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.621+0000 7efcb9fe3640 20 reqs_thread_entry: start 2024-05-08T18:50:50.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.621+0000 7efe07496800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:50.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.621+0000 7efe07496800 20 Filter name: none 2024-05-08T18:50:50.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.621+0000 7efc2b7fe640 20 reqs_thread_entry: start 2024-05-08T18:50:50.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.621+0000 7efe07496800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-05-08T18:50:50.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.621+0000 7efe07496800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.621+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555a94808150 con 0x7efdf4078060 2024-05-08T18:50:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.621+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.621+0000 7efe07496800 20 rados_obj.operate() r=0 bl.length=419 2024-05-08T18:50:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.621+0000 7efe07496800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-05-08T18:50:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.621+0000 7efe07496800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-08T18:50:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.621+0000 7efe07496800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.622+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555a94807c10 con 0x555a947beaa0 2024-05-08T18:50:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.622+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.622+0000 7efe07496800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-05-08T18:50:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.622+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a94807c10 con 0x7efdf4078060 2024-05-08T18:50:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.623+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v25'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.623+0000 7efe07496800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:50:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.623+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 93847526868320 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555a9480af80 con 0x555a947c3490 2024-05-08T18:50:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.623+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== watch-notify(notify (1) cookie 93847526618880 notify 107374182405 ret 0) ==== 212+0+0 (crc 0 0 0) 0x555a947dd230 con 0x555a947c3490 2024-05-08T18:50:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.623+0000 7efcdbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182405 cookie 93847526618880 notifier 4557 bl.length()=170 2024-05-08T18:50:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.623+0000 7efcdbfff640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7efcc8003d60 con 0x555a947c3490 2024-05-08T18:50:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.623+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 28 ==== osd_op_reply(97 notify.2 [notify cookie 93847526868320 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efe00069040 con 0x555a947c3490 2024-05-08T18:50:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.623+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe00069040 con 0x555a947c3490 2024-05-08T18:50:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.624+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 30 ==== watch-notify(notify_complete (2) cookie 93847526868320 notify 107374182405 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555a947b35f0 con 0x555a947c3490 2024-05-08T18:50:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.624+0000 7efe07496800 10 removing email index: 2024-05-08T18:50:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.624+0000 7efe07496800 10 removing user buckets index 2024-05-08T18:50:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.624+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a94808560 con 0x555a947beaa0 2024-05-08T18:50:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.624+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v25'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.624+0000 7efe07496800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-05-08T18:50:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.624+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 93847526873792 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555a94808560 con 0x555a947beaa0 2024-05-08T18:50:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.625+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== watch-notify(notify (1) cookie 93847526625280 notify 107374182413 ret 0) ==== 217+0+0 (crc 0 0 0) 0x555a947dbb40 con 0x555a947beaa0 2024-05-08T18:50:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.625+0000 7efcdb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182413 cookie 93847526625280 notifier 4557 bl.length()=175 2024-05-08T18:50:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.625+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(100 notify.4 [notify cookie 93847526873792 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.625+0000 7efcdb7fe640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7efc380032c0 con 0x555a947beaa0 2024-05-08T18:50:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.625+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 32 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.625+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 33 ==== watch-notify(notify_complete (2) cookie 93847526873792 notify 107374182413 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555a947db4b0 con 0x555a947beaa0 2024-05-08T18:50:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.625+0000 7efe07496800 10 removing user index: testx$tenanteduser 2024-05-08T18:50:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.625+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a94808560 con 0x7efdf4078060 2024-05-08T18:50:50.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.626+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v25'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.626+0000 7efe07496800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-05-08T18:50:50.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.626+0000 7efe07496800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-05-08T18:50:50.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.626+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 93847526869600 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x555a94808560 con 0x7efe00014070 2024-05-08T18:50:50.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.627+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== watch-notify(notify (1) cookie 93847526621712 notify 107374182424 ret 0) ==== 209+0+0 (crc 0 0 0) 0x555a947dae80 con 0x7efe00014070 2024-05-08T18:50:50.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.627+0000 7efcdbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182424 cookie 93847526621712 notifier 4557 bl.length()=167 2024-05-08T18:50:50.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.627+0000 7efcdbfff640 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7efcc8003d60 con 0x7efe00014070 2024-05-08T18:50:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.627+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(103 notify.3 [notify cookie 93847526869600 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efdf4075030 con 0x7efe00014070 2024-05-08T18:50:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.627+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 20 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf4075030 con 0x7efe00014070 2024-05-08T18:50:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.627+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 21 ==== watch-notify(notify_complete (2) cookie 93847526869600 notify 107374182424 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7efdf4091040 con 0x7efe00014070 2024-05-08T18:50:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.628+0000 7efcbafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.628+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93847526634560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a94808560 con 0x555a947beaa0 2024-05-08T18:50:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.629+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 34 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 93847526634560] v25'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.629+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93847526610016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a94808560 con 0x7efe00014070 2024-05-08T18:50:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.630+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 93847526610016] v25'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf4075030 con 0x7efe00014070 2024-05-08T18:50:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.630+0000 7efe07496800 20 remove_watcher() i=0 2024-05-08T18:50:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.630+0000 7efe07496800 2 removed watcher, disabling cache 2024-05-08T18:50:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.630+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93847526614016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a94808560 con 0x555a947beaa0 2024-05-08T18:50:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.631+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 35 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 93847526614016] v25'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.631+0000 7efe07496800 20 remove_watcher() i=1 2024-05-08T18:50:50.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.631+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93847526618880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a94808560 con 0x555a947c3490 2024-05-08T18:50:50.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.632+0000 7efe0578f640 1 -- 172.21.15.132:0/934341661 <== osd.3 v2:172.21.15.132:6816/17827703 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 93847526618880] v25'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe00069040 con 0x555a947c3490 2024-05-08T18:50:50.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.632+0000 7efe07496800 20 remove_watcher() i=2 2024-05-08T18:50:50.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.632+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93847526621712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a94808560 con 0x7efe00014070 2024-05-08T18:50:50.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.633+0000 7efe04f8e640 1 -- 172.21.15.132:0/934341661 <== osd.2 v2:172.21.15.132:6808/1108348591 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 93847526621712] v25'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf4075030 con 0x7efe00014070 2024-05-08T18:50:50.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.633+0000 7efe07496800 20 remove_watcher() i=3 2024-05-08T18:50:50.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.633+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93847526625280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a94808560 con 0x555a947beaa0 2024-05-08T18:50:50.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.634+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.1 v2:172.21.15.132:6800/3697320277 36 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 93847526625280] v25'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x555a947beaa0 2024-05-08T18:50:50.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.634+0000 7efe07496800 20 remove_watcher() i=4 2024-05-08T18:50:50.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.634+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93847526630336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a94808560 con 0x7efdf4078060 2024-05-08T18:50:50.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.635+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 93847526630336] v25'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.635+0000 7efe07496800 20 remove_watcher() i=5 2024-05-08T18:50:50.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.635+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93847526616144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a94808560 con 0x7efdf4078060 2024-05-08T18:50:50.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.636+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 93847526616144] v25'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.636+0000 7efe07496800 20 remove_watcher() i=6 2024-05-08T18:50:50.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.636+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93847526632528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x555a94808560 con 0x7efdf4078060 2024-05-08T18:50:50.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.637+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 <== osd.0 v2:172.21.15.42:6800/1521799280 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 93847526632528] v25'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec03b040 con 0x7efdf4078060 2024-05-08T18:50:50.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.637+0000 7efe07496800 20 remove_watcher() i=7 2024-05-08T18:50:50.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.637+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7efdf4078060 msgr2=0x7efdf405b550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.637+0000 7efe07496800 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7efdf4078060 0x7efdf405b550 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.637+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555a947beaa0 msgr2=0x555a947c0f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.637+0000 7efe07496800 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555a947beaa0 0x555a947c0f60 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.637+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7efe00014070 msgr2=0x7efe0004fa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.637+0000 7efe07496800 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7efe00014070 0x7efe0004fa50 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.637+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555a947c3490 msgr2=0x555a947c5880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.637+0000 7efe07496800 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555a947c3490 0x555a947c5880 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.637+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efcd003bba0 msgr2=0x7efcd003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.637+0000 7efe07496800 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efcd003bba0 0x7efcd003e060 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efdf4092710 tx=0x7efdf4085000 comp rx=0 tx=0).stop 2024-05-08T18:50:50.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.637+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a947ab8f0 msgr2=0x555a947b2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.637+0000 7efdfc78d640 1 -- 172.21.15.132:0/934341661 reap_dead start 2024-05-08T18:50:50.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.637+0000 7efe07496800 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a947ab8f0 0x555a947b2e20 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7efe00013fd0 tx=0x7efe00052be0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.637+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 shutdown_connections 2024-05-08T18:50:50.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.637+0000 7efe07496800 1 --2- 172.21.15.132:0/934341661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a947ab8f0 0x555a947b2e20 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.637+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 >> 172.21.15.132:0/934341661 conn(0x555a947a7c00 msgr2=0x555a947a52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.637+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 shutdown_connections 2024-05-08T18:50:50.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.637+0000 7efe07496800 1 -- 172.21.15.132:0/934341661 wait complete. 2024-05-08T18:50:50.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 -- 172.21.15.132:0/1250720472 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efcdc03bbf0 msgr2=0x7efcdc03e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 --2- 172.21.15.132:0/1250720472 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efcdc03bbf0 0x7efcdc03e0b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x555a9478ada0 tx=0x7efdf40925e0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 -- 172.21.15.132:0/1250720472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9479e670 msgr2=0x555a9479ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 --2- 172.21.15.132:0/1250720472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9479e670 0x555a9479ea90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x555a9478ad00 tx=0x7efe00018830 comp rx=0 tx=0).stop 2024-05-08T18:50:50.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 -- 172.21.15.132:0/1250720472 shutdown_connections 2024-05-08T18:50:50.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 --2- 172.21.15.132:0/1250720472 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efcdc03bbf0 0x7efcdc03e0b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 --2- 172.21.15.132:0/1250720472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9479e670 0x555a9479ea90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 -- 172.21.15.132:0/1250720472 >> 172.21.15.132:0/1250720472 conn(0x555a94792710 msgr2=0x555a94792b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 -- 172.21.15.132:0/1250720472 shutdown_connections 2024-05-08T18:50:50.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 -- 172.21.15.132:0/1250720472 wait complete. 2024-05-08T18:50:50.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 -- 172.21.15.132:0/1445999100 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555a9468b480 msgr2=0x555a9478a320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 --2- 172.21.15.132:0/1445999100 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555a9468b480 0x555a9478a320 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 -- 172.21.15.132:0/1445999100 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555a9478cc50 msgr2=0x555a9478f040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 --2- 172.21.15.132:0/1445999100 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555a9478cc50 0x555a9478f040 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 -- 172.21.15.132:0/1445999100 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efcec03bba0 msgr2=0x7efcec03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 --2- 172.21.15.132:0/1445999100 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efcec03bba0 0x7efcec03e060 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efdec000f60 tx=0x7efdec001370 comp rx=0 tx=0).stop 2024-05-08T18:50:50.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 -- 172.21.15.132:0/1445999100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9468a2c0 msgr2=0x555a947830e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 --2- 172.21.15.132:0/1445999100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9468a2c0 0x555a947830e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efdf401d050 tx=0x7efdf4003020 comp rx=0 tx=0).stop 2024-05-08T18:50:50.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 -- 172.21.15.132:0/1445999100 shutdown_connections 2024-05-08T18:50:50.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 --2- 172.21.15.132:0/1445999100 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555a9478cc50 0x555a9478f040 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 --2- 172.21.15.132:0/1445999100 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555a9468b480 0x555a9478a320 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 --2- 172.21.15.132:0/1445999100 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7efcec03bba0 0x7efcec03e060 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 --2- 172.21.15.132:0/1445999100 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555a9468a2c0 0x555a947830e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 -- 172.21.15.132:0/1445999100 >> 172.21.15.132:0/1445999100 conn(0x555a94685840 msgr2=0x555a94775840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 -- 172.21.15.132:0/1445999100 shutdown_connections 2024-05-08T18:50:50.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.638+0000 7efe07496800 1 -- 172.21.15.132:0/1445999100 wait complete. 2024-05-08T18:50:50.652 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-05-08T18:50:50.655 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-05-08T18:50:50.698 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:50:50.699 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-05-08T18:50:50.699 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-05-08T18:50:50.699 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-05-08T18:50:50.745 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:50.745 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:50.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.747+0000 7fee1bd46800 1 Processor -- start 2024-05-08T18:50:50.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.747+0000 7fee1bd46800 1 -- start start 2024-05-08T18:50:50.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.747+0000 7fee1bd46800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55cf1f67e5e0 0x55cf1f6809d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.747+0000 7fee1bd46800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cf1f680fa0 con 0x55cf1f67a150 2024-05-08T18:50:50.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.747+0000 7fee1bd46800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55cf1f51be20 con 0x55cf1f67e5e0 2024-05-08T18:50:50.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.747+0000 7fee13fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55cf1f67e5e0 0x55cf1f6809d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.747+0000 7fee1983e640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55cf1f67a150 0x55cf1f67a570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:43600/0 (socket says 172.21.15.132:43600) 2024-05-08T18:50:50.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.747+0000 7fee1983e640 1 -- 172.21.15.132:0/2744630541 learned_addr learned my addr 172.21.15.132:0/2744630541 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:50:50.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.748+0000 7fee1903d640 1 -- 172.21.15.132:0/2744630541 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3201237523 0 0) 0x55cf1f680fa0 con 0x55cf1f67a150 2024-05-08T18:50:50.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.748+0000 7fee1903d640 1 -- 172.21.15.132:0/2744630541 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee08001e10 con 0x55cf1f67a150 2024-05-08T18:50:50.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.748+0000 7fee13fff640 1 -- 172.21.15.132:0/2744630541 >> v1:172.21.15.42:6789/0 conn(0x55cf1f67a150 legacy=0x55cf1f67a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.748+0000 7fee13fff640 1 -- 172.21.15.132:0/2744630541 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf1f6821d0 con 0x55cf1f67e5e0 2024-05-08T18:50:50.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.749+0000 7fee13fff640 1 --2- 172.21.15.132:0/2744630541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f67e5e0 0x55cf1f6809d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fee0400a470 tx=0x7fee0401cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54a594d9333d3c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.750+0000 7fee1903d640 1 -- 172.21.15.132:0/2744630541 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee04057070 con 0x55cf1f67e5e0 2024-05-08T18:50:50.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.750+0000 7fee1903d640 1 -- 172.21.15.132:0/2744630541 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee04052570 con 0x55cf1f67e5e0 2024-05-08T18:50:50.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.750+0000 7fee1903d640 1 -- 172.21.15.132:0/2744630541 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee04052850 con 0x55cf1f67e5e0 2024-05-08T18:50:50.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.750+0000 7fee1bd46800 1 -- 172.21.15.132:0/2744630541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f67e5e0 msgr2=0x55cf1f6809d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.750+0000 7fee1bd46800 1 --2- 172.21.15.132:0/2744630541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f67e5e0 0x55cf1f6809d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fee0400a470 tx=0x7fee0401cdb0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.750+0000 7fee1bd46800 1 -- 172.21.15.132:0/2744630541 shutdown_connections 2024-05-08T18:50:50.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.750+0000 7fee1bd46800 1 --2- 172.21.15.132:0/2744630541 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f67e5e0 0x55cf1f6809d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.750+0000 7fee1bd46800 1 -- 172.21.15.132:0/2744630541 >> 172.21.15.132:0/2744630541 conn(0x55cf1f675730 msgr2=0x55cf1f677b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.750+0000 7fee1bd46800 1 -- 172.21.15.132:0/2744630541 shutdown_connections 2024-05-08T18:50:50.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.750+0000 7fee1bd46800 1 -- 172.21.15.132:0/2744630541 wait complete. 2024-05-08T18:50:50.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.764+0000 7fee1bd46800 1 Processor -- start 2024-05-08T18:50:50.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.764+0000 7fee1bd46800 1 -- start start 2024-05-08T18:50:50.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.764+0000 7fee1bd46800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f67a150 0x55cf1f5ee2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.764+0000 7fee1bd46800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cf1f5c65c0 con 0x55cf1f67a150 2024-05-08T18:50:50.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.764+0000 7fee1983e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f67a150 0x55cf1f5ee2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.764+0000 7fee1983e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f67a150 0x55cf1f5ee2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40274/0 (socket says 172.21.15.132:40274) 2024-05-08T18:50:50.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.764+0000 7fee1983e640 1 -- 172.21.15.132:0/1990663255 learned_addr learned my addr 172.21.15.132:0/1990663255 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.764+0000 7fee1983e640 1 -- 172.21.15.132:0/1990663255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf1f76f0f0 con 0x55cf1f67a150 2024-05-08T18:50:50.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.765+0000 7fee1983e640 1 --2- 172.21.15.132:0/1990663255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f67a150 0x55cf1f5ee2d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fee0c001db0 tx=0x7fee0c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bcd4f01d8c8a3d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.765+0000 7fed07e07640 1 -- 172.21.15.132:0/1990663255 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee0c012020 con 0x55cf1f67a150 2024-05-08T18:50:50.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.765+0000 7fed07e07640 1 -- 172.21.15.132:0/1990663255 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee0c00e5a0 con 0x55cf1f67a150 2024-05-08T18:50:50.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.765+0000 7fed07e07640 1 -- 172.21.15.132:0/1990663255 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee0c00e940 con 0x55cf1f67a150 2024-05-08T18:50:50.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.765+0000 7fee1bd46800 1 -- 172.21.15.132:0/1990663255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f67a150 msgr2=0x55cf1f5ee2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.765+0000 7fee1bd46800 1 --2- 172.21.15.132:0/1990663255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f67a150 0x55cf1f5ee2d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fee0c001db0 tx=0x7fee0c00b6c0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.765+0000 7fee1bd46800 1 -- 172.21.15.132:0/1990663255 shutdown_connections 2024-05-08T18:50:50.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.765+0000 7fee1bd46800 1 --2- 172.21.15.132:0/1990663255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f67a150 0x55cf1f5ee2d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.765+0000 7fee1bd46800 1 -- 172.21.15.132:0/1990663255 >> 172.21.15.132:0/1990663255 conn(0x55cf1f675730 msgr2=0x55cf1f766be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.766+0000 7fee1bd46800 1 -- 172.21.15.132:0/1990663255 shutdown_connections 2024-05-08T18:50:50.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.766+0000 7fee1bd46800 1 -- 172.21.15.132:0/1990663255 wait complete. 2024-05-08T18:50:50.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.766+0000 7fee1bd46800 1 Processor -- start 2024-05-08T18:50:50.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.766+0000 7fee1bd46800 1 -- start start 2024-05-08T18:50:50.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.766+0000 7fee1bd46800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f67a150 0x55cf1f773f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.766+0000 7fee1bd46800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cf1f681470 con 0x55cf1f67a150 2024-05-08T18:50:50.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.766+0000 7fee1983e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f67a150 0x55cf1f773f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.766+0000 7fee1983e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f67a150 0x55cf1f773f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40276/0 (socket says 172.21.15.132:40276) 2024-05-08T18:50:50.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.766+0000 7fee1983e640 1 -- 172.21.15.132:0/1331515818 learned_addr learned my addr 172.21.15.132:0/1331515818 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.767+0000 7fee1983e640 1 -- 172.21.15.132:0/1331515818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf1f774470 con 0x55cf1f67a150 2024-05-08T18:50:50.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.767+0000 7fee1983e640 1 --2- 172.21.15.132:0/1331515818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f67a150 0x55cf1f773f30 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x55cf1f5ed900 tx=0x7fee0c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.767+0000 7fed06604640 1 -- 172.21.15.132:0/1331515818 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee0c012030 con 0x55cf1f67a150 2024-05-08T18:50:50.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.767+0000 7fed06604640 1 -- 172.21.15.132:0/1331515818 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee0c001430 con 0x55cf1f67a150 2024-05-08T18:50:50.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.767+0000 7fee1bd46800 1 -- 172.21.15.132:0/1331515818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf1f774700 con 0x55cf1f67a150 2024-05-08T18:50:50.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.767+0000 7fed06604640 1 -- 172.21.15.132:0/1331515818 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee0c01a8a0 con 0x55cf1f67a150 2024-05-08T18:50:50.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.767+0000 7fee1bd46800 1 -- 172.21.15.132:0/1331515818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf1f7773b0 con 0x55cf1f67a150 2024-05-08T18:50:50.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.768+0000 7fed06604640 1 -- 172.21.15.132:0/1331515818 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fee0c015020 con 0x55cf1f67a150 2024-05-08T18:50:50.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.768+0000 7fed06604640 1 --2- 172.21.15.132:0/1331515818 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fed0003bba0 0x7fed0003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.768+0000 7fed06604640 1 -- 172.21.15.132:0/1331515818 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fee0c020030 con 0x55cf1f67a150 2024-05-08T18:50:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.768+0000 7fee13fff640 1 --2- 172.21.15.132:0/1331515818 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fed0003bba0 0x7fed0003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.768+0000 7fee1bd46800 1 --2- 172.21.15.132:0/1331515818 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cf1f67e5e0 0x55cf1f77b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.768+0000 7fee1bd46800 1 -- 172.21.15.132:0/1331515818 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f77b6b0 con 0x55cf1f67e5e0 2024-05-08T18:50:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.769+0000 7fee1a03f640 1 --2- 172.21.15.132:0/1331515818 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cf1f67e5e0 0x55cf1f77b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.769+0000 7fee13fff640 1 --2- 172.21.15.132:0/1331515818 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fed0003bba0 0x7fed0003e060 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fee04054000 tx=0x7fee0404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.769+0000 7fee1a03f640 1 --2- 172.21.15.132:0/1331515818 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cf1f67e5e0 0x55cf1f77b170 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.769+0000 7fee1a03f640 1 -- 172.21.15.132:0/1331515818 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee1400a4a0 con 0x55cf1f67e5e0 2024-05-08T18:50:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.769+0000 7fee1bd46800 1 -- 172.21.15.132:0/1331515818 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f778740 con 0x55cf1f67e5e0 2024-05-08T18:50:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.769+0000 7fee1a03f640 1 -- 172.21.15.132:0/1331515818 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fee1400a4a0 con 0x55cf1f67e5e0 2024-05-08T18:50:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.769+0000 7fee1bd46800 1 --2- 172.21.15.132:0/1331515818 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cf1f77d9e0 0x55cf1f77fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.770+0000 7fee1bd46800 1 -- 172.21.15.132:0/1331515818 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7804c0 con 0x55cf1f77d9e0 2024-05-08T18:50:50.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.770+0000 7fee1983e640 1 --2- 172.21.15.132:0/1331515818 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cf1f77d9e0 0x55cf1f77fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.770+0000 7fee1983e640 1 --2- 172.21.15.132:0/1331515818 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cf1f77d9e0 0x55cf1f77fdd0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.770+0000 7fee1983e640 1 -- 172.21.15.132:0/1331515818 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fee0c0430c0 con 0x55cf1f77d9e0 2024-05-08T18:50:50.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.770+0000 7fee1bd46800 1 -- 172.21.15.132:0/1331515818 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f77c880 con 0x55cf1f67e5e0 2024-05-08T18:50:50.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.770+0000 7fee1a03f640 1 -- 172.21.15.132:0/1331515818 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fee1400a4a0 con 0x55cf1f67e5e0 2024-05-08T18:50:50.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.770+0000 7fee1bd46800 1 -- 172.21.15.132:0/1331515818 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f77cd60 con 0x55cf1f67e5e0 2024-05-08T18:50:50.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.771+0000 7fee1a03f640 1 -- 172.21.15.132:0/1331515818 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fee1400a4a0 con 0x55cf1f67e5e0 2024-05-08T18:50:50.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.771+0000 7fee1bd46800 1 Processor -- start 2024-05-08T18:50:50.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.771+0000 7fee1bd46800 1 -- start start 2024-05-08T18:50:50.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.771+0000 7fee1bd46800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f78f440 0x55cf1f78f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.771+0000 7fee1bd46800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cf1f56cfc0 con 0x55cf1f78f440 2024-05-08T18:50:50.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.772+0000 7fee1a03f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f78f440 0x55cf1f78f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.772+0000 7fee1a03f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f78f440 0x55cf1f78f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40286/0 (socket says 172.21.15.132:40286) 2024-05-08T18:50:50.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.772+0000 7fee1a03f640 1 -- 172.21.15.132:0/812685062 learned_addr learned my addr 172.21.15.132:0/812685062 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.772+0000 7fee1a03f640 1 -- 172.21.15.132:0/812685062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf1f78fda0 con 0x55cf1f78f440 2024-05-08T18:50:50.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.772+0000 7fee1a03f640 1 --2- 172.21.15.132:0/812685062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f78f440 0x55cf1f78f860 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x55cf1f77ba90 tx=0x7fee14018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.772+0000 7fecff7fe640 1 -- 172.21.15.132:0/812685062 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee14014450 con 0x55cf1f78f440 2024-05-08T18:50:50.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.772+0000 7fecff7fe640 1 -- 172.21.15.132:0/812685062 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee14014610 con 0x55cf1f78f440 2024-05-08T18:50:50.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.772+0000 7fee1bd46800 1 -- 172.21.15.132:0/812685062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf1f790810 con 0x55cf1f78f440 2024-05-08T18:50:50.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.772+0000 7fecff7fe640 1 -- 172.21.15.132:0/812685062 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee14014930 con 0x55cf1f78f440 2024-05-08T18:50:50.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.772+0000 7fee1bd46800 1 -- 172.21.15.132:0/812685062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf1f790d10 con 0x55cf1f78f440 2024-05-08T18:50:50.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.773+0000 7fecff7fe640 1 -- 172.21.15.132:0/812685062 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fee14011040 con 0x55cf1f78f440 2024-05-08T18:50:50.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.773+0000 7fecff7fe640 1 --2- 172.21.15.132:0/812685062 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fecf403bba0 0x7fecf403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.773+0000 7fecff7fe640 1 -- 172.21.15.132:0/812685062 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fee1401e070 con 0x55cf1f78f440 2024-05-08T18:50:50.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.773+0000 7fee1983e640 1 --2- 172.21.15.132:0/812685062 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fecf403bba0 0x7fecf403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.773+0000 7fee1bd46800 1 Processor -- start 2024-05-08T18:50:50.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.774+0000 7fee1bd46800 1 -- start start 2024-05-08T18:50:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.774+0000 7fee1983e640 1 --2- 172.21.15.132:0/812685062 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fecf403bba0 0x7fecf403e060 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55cf1f77bb30 tx=0x7fee0c01af70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.774+0000 7fee1bd46800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f79c670 0x55cf1f79ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.774+0000 7fee1bd46800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cf1f76f440 con 0x55cf1f79c670 2024-05-08T18:50:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.774+0000 7fee1a03f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f79c670 0x55cf1f79ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.774+0000 7fee1a03f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f79c670 0x55cf1f79ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40302/0 (socket says 172.21.15.132:40302) 2024-05-08T18:50:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.774+0000 7fee1a03f640 1 -- 172.21.15.132:0/3349102401 learned_addr learned my addr 172.21.15.132:0/3349102401 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.774+0000 7fee1a03f640 1 -- 172.21.15.132:0/3349102401 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf1f79d060 con 0x55cf1f79c670 2024-05-08T18:50:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.774+0000 7fee1a03f640 1 --2- 172.21.15.132:0/3349102401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f79c670 0x55cf1f79ca90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fee14052c50 tx=0x7fee14011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb94aa7a8c762f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.774+0000 7fecfd7fa640 1 -- 172.21.15.132:0/3349102401 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee14047070 con 0x55cf1f79c670 2024-05-08T18:50:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.774+0000 7fecfd7fa640 1 -- 172.21.15.132:0/3349102401 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1402b350 con 0x55cf1f79c670 2024-05-08T18:50:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.774+0000 7fecfd7fa640 1 -- 172.21.15.132:0/3349102401 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee14028070 con 0x55cf1f79c670 2024-05-08T18:50:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.775+0000 7fee1bd46800 1 -- 172.21.15.132:0/3349102401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f79c670 msgr2=0x55cf1f79ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.775+0000 7fee1bd46800 1 --2- 172.21.15.132:0/3349102401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f79c670 0x55cf1f79ca90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fee14052c50 tx=0x7fee14011a80 comp rx=0 tx=0).stop 2024-05-08T18:50:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.775+0000 7fee1bd46800 1 -- 172.21.15.132:0/3349102401 shutdown_connections 2024-05-08T18:50:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.775+0000 7fee1bd46800 1 --2- 172.21.15.132:0/3349102401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f79c670 0x55cf1f79ca90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.775+0000 7fee1bd46800 1 -- 172.21.15.132:0/3349102401 >> 172.21.15.132:0/3349102401 conn(0x55cf1f7989d0 msgr2=0x55cf1f796a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.775+0000 7fee1bd46800 1 -- 172.21.15.132:0/3349102401 shutdown_connections 2024-05-08T18:50:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.775+0000 7fee1bd46800 1 -- 172.21.15.132:0/3349102401 wait complete. 2024-05-08T18:50:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.775+0000 7fee1bd46800 1 Processor -- start 2024-05-08T18:50:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.775+0000 7fee1bd46800 1 -- start start 2024-05-08T18:50:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.775+0000 7fee1bd46800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f79c670 0x55cf1f7a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.775+0000 7fee1bd46800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cf1f79d7d0 con 0x55cf1f79c670 2024-05-08T18:50:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.776+0000 7fee1a03f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f79c670 0x55cf1f7a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.776+0000 7fee1a03f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f79c670 0x55cf1f7a3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40312/0 (socket says 172.21.15.132:40312) 2024-05-08T18:50:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.776+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 learned_addr learned my addr 172.21.15.132:0/3708536327 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.776+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf1f7a41f0 con 0x55cf1f79c670 2024-05-08T18:50:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.776+0000 7fee1a03f640 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f79c670 0x55cf1f7a3cb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fee14051b70 tx=0x7fee14052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.776+0000 7feceb7fe640 1 -- 172.21.15.132:0/3708536327 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee14044030 con 0x55cf1f79c670 2024-05-08T18:50:50.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.776+0000 7feceb7fe640 1 -- 172.21.15.132:0/3708536327 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee14011330 con 0x55cf1f79c670 2024-05-08T18:50:50.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.776+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf1f7a4480 con 0x55cf1f79c670 2024-05-08T18:50:50.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.776+0000 7feceb7fe640 1 -- 172.21.15.132:0/3708536327 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee14047040 con 0x55cf1f79c670 2024-05-08T18:50:50.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.776+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf1f7a7130 con 0x55cf1f79c670 2024-05-08T18:50:50.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.777+0000 7feceb7fe640 1 -- 172.21.15.132:0/3708536327 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fee14034020 con 0x55cf1f79c670 2024-05-08T18:50:50.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.777+0000 7feceb7fe640 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fece403bb50 0x7fece403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.777+0000 7feceb7fe640 1 -- 172.21.15.132:0/3708536327 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fee14032020 con 0x55cf1f79c670 2024-05-08T18:50:50.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.777+0000 7fee1983e640 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fece403bb50 0x7fece403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.778+0000 7fee1983e640 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fece403bb50 0x7fece403e010 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00bc10 tx=0x7fee0c049000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.778+0000 7fee1bd46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.778+0000 7fee1bd46800 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cf1f7af970 0x55cf1f7b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.778+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b2580 con 0x55cf1f7af970 2024-05-08T18:50:50.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.778+0000 7fee13fff640 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cf1f7af970 0x55cf1f7b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.778+0000 7fee13fff640 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cf1f7af970 0x55cf1f7b1e30 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.779+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee0405a040 con 0x55cf1f7af970 2024-05-08T18:50:50.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.779+0000 7fee1bd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.779+0000 7fee1bd46800 20 realm 2024-05-08T18:50:50.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.779+0000 7fee1bd46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.779+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b2950 con 0x55cf1f7af970 2024-05-08T18:50:50.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.779+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee0405a040 con 0x55cf1f7af970 2024-05-08T18:50:50.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.779+0000 7fee1bd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.779+0000 7fee1bd46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:50.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.779+0000 7fee1bd46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.779+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b3220 con 0x55cf1f7af970 2024-05-08T18:50:50.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.779+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee0405a040 con 0x55cf1f7af970 2024-05-08T18:50:50.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.779+0000 7fee1bd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.779+0000 7fee1bd46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.779+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b35c0 con 0x55cf1f7af970 2024-05-08T18:50:50.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.779+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fee0405a040 con 0x55cf1f7af970 2024-05-08T18:50:50.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.779+0000 7fee1bd46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:50.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.779+0000 7fee1bd46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.779+0000 7fee1bd46800 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cf1f7b4320 0x55cf1f7b6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.779+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x55cf1f7b4320 2024-05-08T18:50:50.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.780+0000 7fee1a03f640 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cf1f7b4320 0x55cf1f7b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.780+0000 7fee1a03f640 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cf1f7b4320 0x55cf1f7b6710 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.780+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fee1404a040 con 0x55cf1f7b4320 2024-05-08T18:50:50.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.780+0000 7fee1bd46800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:50.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.780+0000 7fee1bd46800 20 searching for the correct realm 2024-05-08T18:50:50.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.780+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b8620 con 0x55cf1f7b4320 2024-05-08T18:50:50.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.781+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1404a040 con 0x55cf1f7b4320 2024-05-08T18:50:50.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.781+0000 7fee1a03f640 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fee14014070 0x7fee14036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.781+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x7fee14014070 2024-05-08T18:50:50.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.781+0000 7fee1983e640 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fee14014070 0x7fee14036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.781+0000 7fee1983e640 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fee14014070 0x7fee14036410 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.781+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0c0430c0 con 0x7fee14014070 2024-05-08T18:50:50.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.781+0000 7fee1983e640 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fee0c017050 0x7fee0c0167a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.781+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x7fee0c017050 2024-05-08T18:50:50.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.781+0000 7fee13fff640 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fee0c017050 0x7fee0c0167a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.782+0000 7fee13fff640 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fee0c017050 0x7fee0c0167a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.782+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0405a040 con 0x7fee0c017050 2024-05-08T18:50:50.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.782+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x55cf1f7af970 2024-05-08T18:50:50.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.782+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0405a040 con 0x55cf1f7af970 2024-05-08T18:50:50.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.782+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x55cf1f7af970 2024-05-08T18:50:50.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.783+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0405a040 con 0x55cf1f7af970 2024-05-08T18:50:50.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.783+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x7fee0c017050 2024-05-08T18:50:50.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.783+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0405a040 con 0x7fee0c017050 2024-05-08T18:50:50.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.783+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x7fee0c017050 2024-05-08T18:50:50.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.783+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0405a040 con 0x7fee0c017050 2024-05-08T18:50:50.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.783+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x7fee14014070 2024-05-08T18:50:50.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.783+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0c0430c0 con 0x7fee14014070 2024-05-08T18:50:50.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.783+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x55cf1f7b4320 2024-05-08T18:50:50.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.784+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee1404a040 con 0x55cf1f7b4320 2024-05-08T18:50:50.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.784+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x55cf1f7af970 2024-05-08T18:50:50.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.784+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0405a040 con 0x55cf1f7af970 2024-05-08T18:50:50.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.784+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x7fee0c017050 2024-05-08T18:50:50.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.784+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0405a040 con 0x7fee0c017050 2024-05-08T18:50:50.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.784+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x55cf1f7af970 2024-05-08T18:50:50.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.784+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fee0405a040 con 0x55cf1f7af970 2024-05-08T18:50:50.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.784+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x7fee14014070 2024-05-08T18:50:50.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.785+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fee0c0430c0 con 0x7fee14014070 2024-05-08T18:50:50.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.785+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x55cf1f7b4320 2024-05-08T18:50:50.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.785+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fee1404a040 con 0x55cf1f7b4320 2024-05-08T18:50:50.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.785+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x55cf1f7b4320 2024-05-08T18:50:50.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.785+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.785+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x7fee0c017050 2024-05-08T18:50:50.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.785+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0405a040 con 0x7fee0c017050 2024-05-08T18:50:50.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.785+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x55cf1f7b4320 2024-05-08T18:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.786+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.786+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x55cf1f7b4320 2024-05-08T18:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.786+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.786+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x55cf1f7af970 2024-05-08T18:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.786+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0405a040 con 0x55cf1f7af970 2024-05-08T18:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.786+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x55cf1f7af970 2024-05-08T18:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.786+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fee0405a040 con 0x55cf1f7af970 2024-05-08T18:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.786+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x7fee0c017050 2024-05-08T18:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.786+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0407d040 con 0x7fee0c017050 2024-05-08T18:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.786+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x55cf1f7b4320 2024-05-08T18:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.787+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.787+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x7fee14014070 2024-05-08T18:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.787+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0c0430c0 con 0x7fee14014070 2024-05-08T18:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.787+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x55cf1f7af970 2024-05-08T18:50:50.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.787+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0407d040 con 0x55cf1f7af970 2024-05-08T18:50:50.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.787+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x7fee0c017050 2024-05-08T18:50:50.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.787+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0407d040 con 0x7fee0c017050 2024-05-08T18:50:50.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.787+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x55cf1f7b4320 2024-05-08T18:50:50.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.788+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.788+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x7fee0c017050 2024-05-08T18:50:50.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.788+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0407d040 con 0x7fee0c017050 2024-05-08T18:50:50.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.788+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x7fee14014070 2024-05-08T18:50:50.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.788+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0c0430c0 con 0x7fee14014070 2024-05-08T18:50:50.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.788+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x55cf1f7b4320 2024-05-08T18:50:50.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.788+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.788+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x7fee0c017050 2024-05-08T18:50:50.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.789+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0407d040 con 0x7fee0c017050 2024-05-08T18:50:50.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.789+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x55cf1f7af970 2024-05-08T18:50:50.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.789+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fee0407d040 con 0x55cf1f7af970 2024-05-08T18:50:50.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.789+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b6cd0 con 0x7fee14014070 2024-05-08T18:50:50.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.789+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fee0c0430c0 con 0x7fee14014070 2024-05-08T18:50:50.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.789+0000 7fee1bd46800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:50.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.789+0000 7fee1bd46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:50.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.789+0000 7fee1bd46800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:50.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.789+0000 7fee1bd46800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:50.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.789+0000 7fee1bd46800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:50.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.789+0000 7fee1bd46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:50.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.789+0000 7fee1bd46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.789+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b7590 con 0x55cf1f7af970 2024-05-08T18:50:50.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.790+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x55cf1f7af970 2024-05-08T18:50:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.790+0000 7fee1bd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.790+0000 7fee1bd46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.790+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b7980 con 0x55cf1f7af970 2024-05-08T18:50:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.790+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fee0407d040 con 0x55cf1f7af970 2024-05-08T18:50:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.790+0000 7fee1bd46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.790+0000 7fee1bd46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.790+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b7da0 con 0x55cf1f7af970 2024-05-08T18:50:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.790+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fee0407d040 con 0x55cf1f7af970 2024-05-08T18:50:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.790+0000 7fee1bd46800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.790+0000 7fee1bd46800 20 zone default found 2024-05-08T18:50:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.790+0000 7fee1bd46800 4 Realm: () 2024-05-08T18:50:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.790+0000 7fee1bd46800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:50.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.790+0000 7fee1bd46800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:50.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.790+0000 7fee1bd46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:50.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.790+0000 7fee1bd46800 20 zonegroup default 2024-05-08T18:50:50.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.790+0000 7fee1bd46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.790+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b8b30 con 0x7fee0c017050 2024-05-08T18:50:50.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.790+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x7fee0c017050 2024-05-08T18:50:50.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.790+0000 7fee1bd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.790+0000 7fee1bd46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.791+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7ba950 con 0x55cf1f7b4320 2024-05-08T18:50:50.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.791+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.791+0000 7fee1bd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.791+0000 7fee1bd46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.791+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7bacf0 con 0x55cf1f7b4320 2024-05-08T18:50:50.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.791+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.791+0000 7fee1bd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.791+0000 7fee1bd46800 20 started sync module instance, tier type = 2024-05-08T18:50:50.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.791+0000 7fee1bd46800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:50.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.791+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7b9df0 con 0x7fee14014070 2024-05-08T18:50:50.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.792+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0c0430c0 con 0x7fee14014070 2024-05-08T18:50:50.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.792+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94348074785088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7bb120 con 0x7fee14014070 2024-05-08T18:50:50.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.792+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7bb970 con 0x55cf1f7af970 2024-05-08T18:50:50.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.793+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94348074785088] v25'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0c0430c0 con 0x7fee14014070 2024-05-08T18:50:50.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.793+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x55cf1f7af970 2024-05-08T18:50:50.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.793+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94348074792128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7bbd90 con 0x55cf1f7af970 2024-05-08T18:50:50.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.793+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7bc620 con 0x55cf1f7b4320 2024-05-08T18:50:50.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.794+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94348074792128] v25'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x55cf1f7af970 2024-05-08T18:50:50.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.794+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.794+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94348074793184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7bc1b0 con 0x55cf1f7b4320 2024-05-08T18:50:50.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.795+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7bd0a0 con 0x7fee14014070 2024-05-08T18:50:50.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.795+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94348074793184] v25'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.796+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0c0430c0 con 0x7fee14014070 2024-05-08T18:50:50.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.796+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94348074794240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7bc120 con 0x7fee14014070 2024-05-08T18:50:50.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.796+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7bdf60 con 0x55cf1f7af970 2024-05-08T18:50:50.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.797+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94348074794240] v25'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0c0430c0 con 0x7fee14014070 2024-05-08T18:50:50.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.797+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x55cf1f7af970 2024-05-08T18:50:50.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.797+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94348074801840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7be380 con 0x55cf1f7af970 2024-05-08T18:50:50.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.797+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7bed40 con 0x7fee0c017050 2024-05-08T18:50:50.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.798+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94348074801840] v25'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x55cf1f7af970 2024-05-08T18:50:50.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.798+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x7fee0c017050 2024-05-08T18:50:50.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.798+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94348074803376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7bed40 con 0x7fee0c017050 2024-05-08T18:50:50.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.798+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7bf700 con 0x7fee0c017050 2024-05-08T18:50:50.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.799+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(56 notify.6 [create] v25'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x7fee0c017050 2024-05-08T18:50:50.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.799+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94348074807888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7bfb20 con 0x7fee0c017050 2024-05-08T18:50:50.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.799+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7c0620 con 0x7fee0c017050 2024-05-08T18:50:50.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.799+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94348074803376] v25'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x7fee0c017050 2024-05-08T18:50:50.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.800+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(58 notify.7 [create] v25'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x7fee0c017050 2024-05-08T18:50:50.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.800+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94348074811664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7c05e0 con 0x7fee0c017050 2024-05-08T18:50:50.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.800+0000 7fee1bd46800 20 add_watcher() i=0 2024-05-08T18:50:50.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.800+0000 7fee1bd46800 20 add_watcher() i=1 2024-05-08T18:50:50.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.800+0000 7fee1bd46800 20 add_watcher() i=2 2024-05-08T18:50:50.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.800+0000 7fee1bd46800 20 add_watcher() i=3 2024-05-08T18:50:50.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.800+0000 7fee1bd46800 20 add_watcher() i=4 2024-05-08T18:50:50.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.800+0000 7fee1bd46800 20 add_watcher() i=5 2024-05-08T18:50:50.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.800+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94348074807888] v25'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x7fee0c017050 2024-05-08T18:50:50.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.800+0000 7fee1bd46800 20 add_watcher() i=6 2024-05-08T18:50:50.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.801+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94348074811664] v25'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x7fee0c017050 2024-05-08T18:50:50.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.801+0000 7fee1bd46800 20 add_watcher() i=7 2024-05-08T18:50:50.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.801+0000 7fee1bd46800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:50.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.801+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7bf670 con 0x55cf1f7af970 2024-05-08T18:50:50.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.801+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fee0407d040 con 0x55cf1f7af970 2024-05-08T18:50:50.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.801+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94348074805392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7bf670 con 0x55cf1f7af970 2024-05-08T18:50:50.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.802+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94348074805392] v25'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x55cf1f7af970 2024-05-08T18:50:50.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.802+0000 7feccb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:50.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.802+0000 7fee1bd46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:50.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.802+0000 7fee1bd46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:50.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.802+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cbeb0 con 0x55cf1f7af970 2024-05-08T18:50:50.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.804+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v25'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x55cf1f7af970 2024-05-08T18:50:50.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.804+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cc580 con 0x7fee0c017050 2024-05-08T18:50:50.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.805+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v25'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x7fee0c017050 2024-05-08T18:50:50.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.805+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cc9a0 con 0x55cf1f7b4320 2024-05-08T18:50:50.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.805+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v25'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.805+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cc9a0 con 0x55cf1f7af970 2024-05-08T18:50:50.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.806+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v25'140 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x55cf1f7af970 2024-05-08T18:50:50.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.806+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7ccf10 con 0x7fee14014070 2024-05-08T18:50:50.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.807+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v25'41 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee0c0430c0 con 0x7fee14014070 2024-05-08T18:50:50.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.807+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cd3c0 con 0x55cf1f7b4320 2024-05-08T18:50:50.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.808+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v25'28 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.808+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cd470 con 0x55cf1f7af970 2024-05-08T18:50:50.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.809+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v25'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x55cf1f7af970 2024-05-08T18:50:50.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.809+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cd470 con 0x7fee0c017050 2024-05-08T18:50:50.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.810+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v25'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x7fee0c017050 2024-05-08T18:50:50.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.810+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cd470 con 0x7fee14014070 2024-05-08T18:50:50.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.811+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v25'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee0c0430c0 con 0x7fee14014070 2024-05-08T18:50:50.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.811+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cda40 con 0x55cf1f7b4320 2024-05-08T18:50:50.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.812+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v25'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.812+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cda40 con 0x7fee14014070 2024-05-08T18:50:50.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.813+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v25'42 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee0c0430c0 con 0x7fee14014070 2024-05-08T18:50:50.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.813+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cda40 con 0x7fee0c017050 2024-05-08T18:50:50.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.814+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v25'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x7fee0c017050 2024-05-08T18:50:50.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.814+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cda40 con 0x7fee14014070 2024-05-08T18:50:50.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.815+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v25'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee0c0430c0 con 0x7fee14014070 2024-05-08T18:50:50.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.815+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cda40 con 0x7fee0c017050 2024-05-08T18:50:50.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.816+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v25'33 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x7fee0c017050 2024-05-08T18:50:50.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.816+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cda40 con 0x55cf1f7af970 2024-05-08T18:50:50.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.817+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v25'141 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x55cf1f7af970 2024-05-08T18:50:50.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.817+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cda40 con 0x55cf1f7b4320 2024-05-08T18:50:50.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.818+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v25'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.819+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cdad0 con 0x7fee14014070 2024-05-08T18:50:50.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.819+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v25'43 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee0c0430c0 con 0x7fee14014070 2024-05-08T18:50:50.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.819+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cdad0 con 0x55cf1f7b4320 2024-05-08T18:50:50.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.821+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v25'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.821+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cdaf0 con 0x55cf1f7af970 2024-05-08T18:50:50.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.822+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v25'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x55cf1f7af970 2024-05-08T18:50:50.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.822+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cdaf0 con 0x55cf1f7af970 2024-05-08T18:50:50.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.822+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v25'142 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x55cf1f7af970 2024-05-08T18:50:50.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.822+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cdaf0 con 0x55cf1f7b4320 2024-05-08T18:50:50.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.824+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v25'36 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.824+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cdaf0 con 0x7fee14014070 2024-05-08T18:50:50.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.824+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v25'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee0c0430c0 con 0x7fee14014070 2024-05-08T18:50:50.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.825+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cdaf0 con 0x55cf1f7b4320 2024-05-08T18:50:50.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.825+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v25'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.825+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cdaf0 con 0x55cf1f7b4320 2024-05-08T18:50:50.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.826+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v25'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.826+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cdaf0 con 0x55cf1f7b4320 2024-05-08T18:50:50.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.827+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v25'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.827+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cdaf0 con 0x55cf1f7b4320 2024-05-08T18:50:50.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.828+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v25'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.828+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cdaf0 con 0x7fee0c017050 2024-05-08T18:50:50.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.830+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v25'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x7fee0c017050 2024-05-08T18:50:50.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.830+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cdaf0 con 0x55cf1f7b4320 2024-05-08T18:50:50.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.831+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v25'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.831+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cdaf0 con 0x7fee0c017050 2024-05-08T18:50:50.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.832+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v25'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x7fee0c017050 2024-05-08T18:50:50.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.832+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cdaf0 con 0x55cf1f7b4320 2024-05-08T18:50:50.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.833+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v25'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.833+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cdaf0 con 0x7fee0c017050 2024-05-08T18:50:50.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.835+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v25'34 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x7fee0c017050 2024-05-08T18:50:50.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.835+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7cdaf0 con 0x7fee14014070 2024-05-08T18:50:50.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.836+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v25'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fee0c0430c0 con 0x7fee14014070 2024-05-08T18:50:50.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.836+0000 7fecca7fc640 20 reqs_thread_entry: start 2024-05-08T18:50:50.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.836+0000 7fee1bd46800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:50.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.836+0000 7fee1bd46800 20 Filter name: none 2024-05-08T18:50:50.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.836+0000 7fec3ffff640 20 reqs_thread_entry: start 2024-05-08T18:50:50.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.836+0000 7fee1bd46800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:50:50.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.836+0000 7fee1bd46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.836+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7f8db0 con 0x7fee14014070 2024-05-08T18:50:50.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.836+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fee0c0430c0 con 0x7fee14014070 2024-05-08T18:50:50.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.837+0000 7fee1bd46800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:50:50.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.837+0000 7fee1bd46800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:50:50.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.837+0000 7fee1bd46800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:50:50.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.837+0000 7fee1bd46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 : miss 2024-05-08T18:50:50.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.837+0000 7fee1bd46800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.837+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:95 8.1e 8:7ec7f916:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7fa810 con 0x7fee0c017050 2024-05-08T18:50:50.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.837+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(95 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fee0407d040 con 0x7fee0c017050 2024-05-08T18:50:50.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.837+0000 7fee1bd46800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:50:50.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.837+0000 7fee1bd46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 info.flags=0x17 2024-05-08T18:50:50.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.837+0000 7fee1bd46800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 to cache LRU end 2024-05-08T18:50:50.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.837+0000 7fee1bd46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:50.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.837+0000 7fee1bd46800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:50:50.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.837+0000 7fee1bd46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 2024-05-08T18:50:50.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.837+0000 7fee1bd46800 20 get_obj_state: octx=0x7fee04052c80 obj=myfoo:four state=0x55cf1f7fbaf8 s->prefetch_data=0 2024-05-08T18:50:50.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.837+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:96 3.30 3:0cf8ddd1:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7fc920 con 0x55cf1f7b4320 2024-05-08T18:50:50.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.837+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== osd_op_reply(96 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1_four [getxattrs out=851b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+867 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.837+0000 7fee1bd46800 10 manifest: total_size = 4 2024-05-08T18:50:50.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.837+0000 7fee1bd46800 20 get_obj_state: setting s->obj_tag to bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.14051086885575359140 2024-05-08T18:50:50.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.837+0000 7fee1bd46800 20 get_obj_state: octx=0x7fee04052c80 obj=myfoo:four state=0x55cf1f7fbaf8 s->prefetch_data=0 2024-05-08T18:50:50.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.837+0000 7fee1bd46800 20 prepare_atomic_modification: state is not atomic. state=0x55cf1f7fbaf8 2024-05-08T18:50:50.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.837+0000 7fee1bd46800 20 bucket index object: :.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.6 2024-05-08T18:50:50.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.838+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:97 4.2a 4:56da7a03:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f801280 con 0x55cf1f7af970 2024-05-08T18:50:50.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.839+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(97 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.6 [stat,call,call] v25'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x55cf1f7af970 2024-05-08T18:50:50.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.839+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:98 3.30 3:0cf8ddd1:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f801280 con 0x55cf1f7b4320 2024-05-08T18:50:50.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.840+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 28 ==== osd_op_reply(98 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1_four [call] v25'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.840+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:99 4.2a 4:56da7a03:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f801bb0 con 0x55cf1f7af970 2024-05-08T18:50:50.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.840+0000 7feccb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:50.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.841+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94348074805392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f801bb0 con 0x55cf1f7af970 2024-05-08T18:50:50.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.841+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(99 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.6 [stat,call,call] v25'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x55cf1f7af970 2024-05-08T18:50:50.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.841+0000 7fecfd7fa640 20 handle_completion(): completion ok for obj=four 2024-05-08T18:50:50.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.841+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94348074805392] v25'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x55cf1f7af970 2024-05-08T18:50:50.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.842+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94348074785088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f801bb0 con 0x7fee14014070 2024-05-08T18:50:50.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.843+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94348074785088] v25'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0c0430c0 con 0x7fee14014070 2024-05-08T18:50:50.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.843+0000 7fee1bd46800 20 remove_watcher() i=0 2024-05-08T18:50:50.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.843+0000 7fee1bd46800 2 removed watcher, disabling cache 2024-05-08T18:50:50.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.843+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94348074792128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f801bb0 con 0x55cf1f7af970 2024-05-08T18:50:50.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.844+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94348074792128] v25'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x55cf1f7af970 2024-05-08T18:50:50.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.844+0000 7fee1bd46800 20 remove_watcher() i=1 2024-05-08T18:50:50.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.844+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94348074793184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f801bb0 con 0x55cf1f7b4320 2024-05-08T18:50:50.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.845+0000 7fee1a03f640 1 -- 172.21.15.132:0/3708536327 <== osd.3 v2:172.21.15.132:6816/17827703 29 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94348074793184] v25'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee14062040 con 0x55cf1f7b4320 2024-05-08T18:50:50.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.845+0000 7fee1bd46800 20 remove_watcher() i=2 2024-05-08T18:50:50.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.845+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94348074794240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f7be890 con 0x7fee14014070 2024-05-08T18:50:50.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.846+0000 7fee1983e640 1 -- 172.21.15.132:0/3708536327 <== osd.2 v2:172.21.15.132:6808/1108348591 20 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94348074794240] v25'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0c0430c0 con 0x7fee14014070 2024-05-08T18:50:50.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.846+0000 7fee1bd46800 20 remove_watcher() i=3 2024-05-08T18:50:50.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.846+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94348074801840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f801bb0 con 0x55cf1f7af970 2024-05-08T18:50:50.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.847+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.1 v2:172.21.15.132:6800/3697320277 32 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94348074801840] v25'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x55cf1f7af970 2024-05-08T18:50:50.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.847+0000 7fee1bd46800 20 remove_watcher() i=4 2024-05-08T18:50:50.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.847+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94348074803376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f801bb0 con 0x7fee0c017050 2024-05-08T18:50:50.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.848+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94348074803376] v25'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x7fee0c017050 2024-05-08T18:50:50.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.848+0000 7fee1bd46800 20 remove_watcher() i=5 2024-05-08T18:50:50.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.848+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94348074807888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f801bb0 con 0x7fee0c017050 2024-05-08T18:50:50.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.849+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94348074807888] v25'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x7fee0c017050 2024-05-08T18:50:50.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.849+0000 7fee1bd46800 20 remove_watcher() i=6 2024-05-08T18:50:50.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.849+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94348074811664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55cf1f801bb0 con 0x7fee0c017050 2024-05-08T18:50:50.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.850+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94348074811664] v25'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fee0407d040 con 0x7fee0c017050 2024-05-08T18:50:50.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.850+0000 7fee1bd46800 20 remove_watcher() i=7 2024-05-08T18:50:50.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.850+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fee0c017050 msgr2=0x7fee0c0167a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.850+0000 7fee1bd46800 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fee0c017050 0x7fee0c0167a0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.850+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cf1f7af970 msgr2=0x55cf1f7b1e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.850+0000 7fee1bd46800 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cf1f7af970 0x55cf1f7b1e30 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.850+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fee14014070 msgr2=0x7fee14036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.850+0000 7fee1bd46800 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fee14014070 0x7fee14036410 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.850+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cf1f7b4320 msgr2=0x55cf1f7b6710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.850+0000 7fee1bd46800 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cf1f7b4320 0x55cf1f7b6710 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.850+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fece403bb50 msgr2=0x7fece403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.850+0000 7fee1bd46800 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fece403bb50 0x7fece403e010 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00bc10 tx=0x7fee0c049000 comp rx=0 tx=0).stop 2024-05-08T18:50:50.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.850+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f79c670 msgr2=0x55cf1f7a3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.850+0000 7fee13fff640 1 -- 172.21.15.132:0/3708536327 reap_dead start 2024-05-08T18:50:50.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.850+0000 7fee1bd46800 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f79c670 0x55cf1f7a3cb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fee14051b70 tx=0x7fee14052be0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 shutdown_connections 2024-05-08T18:50:50.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 --2- 172.21.15.132:0/3708536327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f79c670 0x55cf1f7a3cb0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 >> 172.21.15.132:0/3708536327 conn(0x55cf1f7989d0 msgr2=0x55cf1f796030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 shutdown_connections 2024-05-08T18:50:50.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 -- 172.21.15.132:0/3708536327 wait complete. 2024-05-08T18:50:50.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 -- 172.21.15.132:0/812685062 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fecf403bba0 msgr2=0x7fecf403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 --2- 172.21.15.132:0/812685062 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fecf403bba0 0x7fecf403e060 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55cf1f77bb30 tx=0x7fee0c01af70 comp rx=0 tx=0).stop 2024-05-08T18:50:50.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 -- 172.21.15.132:0/812685062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f78f440 msgr2=0x55cf1f78f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 --2- 172.21.15.132:0/812685062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f78f440 0x55cf1f78f860 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x55cf1f77ba90 tx=0x7fee14018830 comp rx=0 tx=0).stop 2024-05-08T18:50:50.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 -- 172.21.15.132:0/812685062 shutdown_connections 2024-05-08T18:50:50.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 --2- 172.21.15.132:0/812685062 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fecf403bba0 0x7fecf403e060 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 --2- 172.21.15.132:0/812685062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f78f440 0x55cf1f78f860 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 -- 172.21.15.132:0/812685062 >> 172.21.15.132:0/812685062 conn(0x55cf1f7834e0 msgr2=0x55cf1f7838e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 -- 172.21.15.132:0/812685062 shutdown_connections 2024-05-08T18:50:50.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 -- 172.21.15.132:0/812685062 wait complete. 2024-05-08T18:50:50.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 -- 172.21.15.132:0/1331515818 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cf1f67e5e0 msgr2=0x55cf1f77b170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 --2- 172.21.15.132:0/1331515818 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cf1f67e5e0 0x55cf1f77b170 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 -- 172.21.15.132:0/1331515818 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cf1f77d9e0 msgr2=0x55cf1f77fdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 --2- 172.21.15.132:0/1331515818 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cf1f77d9e0 0x55cf1f77fdd0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 -- 172.21.15.132:0/1331515818 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fed0003bba0 msgr2=0x7fed0003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 --2- 172.21.15.132:0/1331515818 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fed0003bba0 0x7fed0003e060 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fee04054000 tx=0x7fee0404e000 comp rx=0 tx=0).stop 2024-05-08T18:50:50.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 -- 172.21.15.132:0/1331515818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f67a150 msgr2=0x55cf1f773f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 --2- 172.21.15.132:0/1331515818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f67a150 0x55cf1f773f30 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x55cf1f5ed900 tx=0x7fee0c000bc0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 -- 172.21.15.132:0/1331515818 shutdown_connections 2024-05-08T18:50:50.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 --2- 172.21.15.132:0/1331515818 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cf1f77d9e0 0x55cf1f77fdd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.851+0000 7fee1bd46800 1 --2- 172.21.15.132:0/1331515818 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cf1f67e5e0 0x55cf1f77b170 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.852+0000 7fee1bd46800 1 --2- 172.21.15.132:0/1331515818 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fed0003bba0 0x7fed0003e060 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.852+0000 7fee1bd46800 1 --2- 172.21.15.132:0/1331515818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf1f67a150 0x55cf1f773f30 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.852+0000 7fee1bd46800 1 -- 172.21.15.132:0/1331515818 >> 172.21.15.132:0/1331515818 conn(0x55cf1f675730 msgr2=0x55cf1f7653e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.852+0000 7fee1bd46800 1 -- 172.21.15.132:0/1331515818 shutdown_connections 2024-05-08T18:50:50.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.852+0000 7fee1bd46800 1 -- 172.21.15.132:0/1331515818 wait complete. 2024-05-08T18:50:50.860 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T18:50:50.860 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T18:50:50.860 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-05-08T18:50:50.904 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:50.904 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:50.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.905+0000 7f5a69933800 1 Processor -- start 2024-05-08T18:50:50.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.905+0000 7f5a69933800 1 -- start start 2024-05-08T18:50:50.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.905+0000 7f5a69933800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55566bb355d0 0x55566bb379c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.905+0000 7f5a69933800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55566bb37f90 con 0x55566bb31140 2024-05-08T18:50:50.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.905+0000 7f5a69933800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55566b9d2e20 con 0x55566bb355d0 2024-05-08T18:50:50.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.906+0000 7f5a64eea640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55566bb355d0 0x55566bb379c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.906+0000 7f5a64eea640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55566bb355d0 0x55566bb379c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40328/0 (socket says 172.21.15.132:40328) 2024-05-08T18:50:50.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.906+0000 7f5a64eea640 1 -- 172.21.15.132:0/594103291 learned_addr learned my addr 172.21.15.132:0/594103291 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.906+0000 7f5a656eb640 1 --1- 172.21.15.132:0/594103291 >> v1:172.21.15.42:6789/0 conn(0x55566bb31140 0x55566bb31560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:43616/0 (socket says 172.21.15.132:43616) 2024-05-08T18:50:50.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.906+0000 7f5a57fff640 1 -- 172.21.15.132:0/594103291 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2255840295 0 0) 0x55566bb37f90 con 0x55566bb31140 2024-05-08T18:50:50.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.906+0000 7f5a57fff640 1 -- 172.21.15.132:0/594103291 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a50001e10 con 0x55566bb31140 2024-05-08T18:50:50.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.906+0000 7f5a64eea640 1 -- 172.21.15.132:0/594103291 >> v1:172.21.15.42:6789/0 conn(0x55566bb31140 legacy=0x55566bb31560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.906+0000 7f5a64eea640 1 -- 172.21.15.132:0/594103291 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55566baa4780 con 0x55566bb355d0 2024-05-08T18:50:50.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.908+0000 7f5a64eea640 1 --2- 172.21.15.132:0/594103291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bb355d0 0x55566bb379c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00a520 tx=0x7f5a5c01cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e737733238958e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.908+0000 7f5a57fff640 1 -- 172.21.15.132:0/594103291 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a5c057070 con 0x55566bb355d0 2024-05-08T18:50:50.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.908+0000 7f5a57fff640 1 -- 172.21.15.132:0/594103291 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a5c052570 con 0x55566bb355d0 2024-05-08T18:50:50.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.908+0000 7f5a57fff640 1 -- 172.21.15.132:0/594103291 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a5c052850 con 0x55566bb355d0 2024-05-08T18:50:50.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.908+0000 7f5a69933800 1 -- 172.21.15.132:0/594103291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bb355d0 msgr2=0x55566bb379c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.909+0000 7f5a69933800 1 --2- 172.21.15.132:0/594103291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bb355d0 0x55566bb379c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00a520 tx=0x7f5a5c01cf30 comp rx=0 tx=0).stop 2024-05-08T18:50:50.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.909+0000 7f5a69933800 1 -- 172.21.15.132:0/594103291 shutdown_connections 2024-05-08T18:50:50.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.909+0000 7f5a69933800 1 --2- 172.21.15.132:0/594103291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bb355d0 0x55566bb379c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.909+0000 7f5a69933800 1 -- 172.21.15.132:0/594103291 >> 172.21.15.132:0/594103291 conn(0x55566bb2c720 msgr2=0x55566bb2eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.909+0000 7f5a69933800 1 -- 172.21.15.132:0/594103291 shutdown_connections 2024-05-08T18:50:50.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.909+0000 7f5a69933800 1 -- 172.21.15.132:0/594103291 wait complete. 2024-05-08T18:50:50.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.922+0000 7f5a69933800 1 Processor -- start 2024-05-08T18:50:50.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.922+0000 7f5a69933800 1 -- start start 2024-05-08T18:50:50.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.922+0000 7f5a69933800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bb31140 0x55566bc233c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.922+0000 7f5a69933800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55566ba7d5b0 con 0x55566bb31140 2024-05-08T18:50:50.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.922+0000 7f5a656eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bb31140 0x55566bc233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.922+0000 7f5a656eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bb31140 0x55566bc233c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40338/0 (socket says 172.21.15.132:40338) 2024-05-08T18:50:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.922+0000 7f5a656eb640 1 -- 172.21.15.132:0/3989121095 learned_addr learned my addr 172.21.15.132:0/3989121095 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.923+0000 7f5a656eb640 1 -- 172.21.15.132:0/3989121095 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55566bc23990 con 0x55566bb31140 2024-05-08T18:50:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.923+0000 7f5a656eb640 1 --2- 172.21.15.132:0/3989121095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bb31140 0x55566bc233c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5a58001e60 tx=0x7f5a5800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6ae35b9f3e2a5f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.923+0000 7f5953606640 1 -- 172.21.15.132:0/3989121095 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a5800e5c0 con 0x55566bb31140 2024-05-08T18:50:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.923+0000 7f5953606640 1 -- 172.21.15.132:0/3989121095 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a58006070 con 0x55566bb31140 2024-05-08T18:50:50.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.923+0000 7f5953606640 1 -- 172.21.15.132:0/3989121095 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a5800e910 con 0x55566bb31140 2024-05-08T18:50:50.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.924+0000 7f5a69933800 1 -- 172.21.15.132:0/3989121095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bb31140 msgr2=0x55566bc233c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.924+0000 7f5a69933800 1 --2- 172.21.15.132:0/3989121095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bb31140 0x55566bc233c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5a58001e60 tx=0x7f5a5800b6c0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.924+0000 7f5a69933800 1 -- 172.21.15.132:0/3989121095 shutdown_connections 2024-05-08T18:50:50.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.924+0000 7f5a69933800 1 --2- 172.21.15.132:0/3989121095 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bb31140 0x55566bc233c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.924+0000 7f5a69933800 1 -- 172.21.15.132:0/3989121095 >> 172.21.15.132:0/3989121095 conn(0x55566bb2c720 msgr2=0x55566bc1ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.924+0000 7f5a69933800 1 -- 172.21.15.132:0/3989121095 shutdown_connections 2024-05-08T18:50:50.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.924+0000 7f5a69933800 1 -- 172.21.15.132:0/3989121095 wait complete. 2024-05-08T18:50:50.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.924+0000 7f5a69933800 1 Processor -- start 2024-05-08T18:50:50.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.924+0000 7f5a69933800 1 -- start start 2024-05-08T18:50:50.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.924+0000 7f5a69933800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bb31140 0x55566bc2af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.924+0000 7f5a69933800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55566baa4d10 con 0x55566bb31140 2024-05-08T18:50:50.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.924+0000 7f5a656eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bb31140 0x55566bc2af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.924+0000 7f5a656eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bb31140 0x55566bc2af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40342/0 (socket says 172.21.15.132:40342) 2024-05-08T18:50:50.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.924+0000 7f5a656eb640 1 -- 172.21.15.132:0/4237503847 learned_addr learned my addr 172.21.15.132:0/4237503847 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.925+0000 7f5a656eb640 1 -- 172.21.15.132:0/4237503847 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55566bc2b4c0 con 0x55566bb31140 2024-05-08T18:50:50.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.925+0000 7f5a656eb640 1 --2- 172.21.15.132:0/4237503847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bb31140 0x55566bc2af80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800bc10 tx=0x7f5a58000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.925+0000 7f5951e03640 1 -- 172.21.15.132:0/4237503847 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a5800f8d0 con 0x55566bb31140 2024-05-08T18:50:50.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.925+0000 7f5951e03640 1 -- 172.21.15.132:0/4237503847 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a5800fa70 con 0x55566bb31140 2024-05-08T18:50:50.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.925+0000 7f5951e03640 1 -- 172.21.15.132:0/4237503847 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a5800fd50 con 0x55566bb31140 2024-05-08T18:50:50.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.925+0000 7f5a69933800 1 -- 172.21.15.132:0/4237503847 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55566bc2b750 con 0x55566bb31140 2024-05-08T18:50:50.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.925+0000 7f5a69933800 1 -- 172.21.15.132:0/4237503847 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55566bc2e400 con 0x55566bb31140 2024-05-08T18:50:50.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.926+0000 7f5951e03640 1 -- 172.21.15.132:0/4237503847 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5a58017070 con 0x55566bb31140 2024-05-08T18:50:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.926+0000 7f5951e03640 1 --2- 172.21.15.132:0/4237503847 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f594c03bba0 0x7f594c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.926+0000 7f5951e03640 1 -- 172.21.15.132:0/4237503847 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f5a58015020 con 0x55566bb31140 2024-05-08T18:50:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.926+0000 7f5a64eea640 1 --2- 172.21.15.132:0/4237503847 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f594c03bba0 0x7f594c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.927+0000 7f5a69933800 1 --2- 172.21.15.132:0/4237503847 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55566bb355d0 0x55566bc321c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.927+0000 7f5a69933800 1 -- 172.21.15.132:0/4237503847 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bc32750 con 0x55566bb355d0 2024-05-08T18:50:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.927+0000 7f5a65eec640 1 --2- 172.21.15.132:0/4237503847 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55566bb355d0 0x55566bc321c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.927+0000 7f5a64eea640 1 --2- 172.21.15.132:0/4237503847 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f594c03bba0 0x7f594c03e060 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c054000 tx=0x7f5a5c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.927+0000 7f5a65eec640 1 --2- 172.21.15.132:0/4237503847 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55566bb355d0 0x55566bc321c0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.927+0000 7f5a65eec640 1 -- 172.21.15.132:0/4237503847 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a6000a4a0 con 0x55566bb355d0 2024-05-08T18:50:50.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.927+0000 7f5a69933800 1 -- 172.21.15.132:0/4237503847 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bc2f790 con 0x55566bb355d0 2024-05-08T18:50:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.928+0000 7f5a65eec640 1 -- 172.21.15.132:0/4237503847 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5a6000a4a0 con 0x55566bb355d0 2024-05-08T18:50:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.928+0000 7f5a69933800 1 --2- 172.21.15.132:0/4237503847 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55566bc34aa0 0x55566bc36e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.928+0000 7f5a69933800 1 -- 172.21.15.132:0/4237503847 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bc37580 con 0x55566bc34aa0 2024-05-08T18:50:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.928+0000 7f5a656eb640 1 --2- 172.21.15.132:0/4237503847 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55566bc34aa0 0x55566bc36e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.928+0000 7f5a656eb640 1 --2- 172.21.15.132:0/4237503847 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55566bc34aa0 0x55566bc36e90 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.928+0000 7f5a656eb640 1 -- 172.21.15.132:0/4237503847 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5a5802e070 con 0x55566bc34aa0 2024-05-08T18:50:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.928+0000 7f5a69933800 1 -- 172.21.15.132:0/4237503847 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bc33940 con 0x55566bb355d0 2024-05-08T18:50:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.929+0000 7f5a65eec640 1 -- 172.21.15.132:0/4237503847 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5a6000a4a0 con 0x55566bb355d0 2024-05-08T18:50:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.929+0000 7f5a69933800 1 -- 172.21.15.132:0/4237503847 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bc33e20 con 0x55566bb355d0 2024-05-08T18:50:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.929+0000 7f5a65eec640 1 -- 172.21.15.132:0/4237503847 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5a6000a4a0 con 0x55566bb355d0 2024-05-08T18:50:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.929+0000 7f5a69933800 1 Processor -- start 2024-05-08T18:50:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.929+0000 7f5a69933800 1 -- start start 2024-05-08T18:50:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.929+0000 7f5a69933800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bc464c0 0x55566bc468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.929+0000 7f5a69933800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55566ba23fc0 con 0x55566bc464c0 2024-05-08T18:50:50.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.930+0000 7f5a65eec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bc464c0 0x55566bc468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.930+0000 7f5a65eec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bc464c0 0x55566bc468e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40354/0 (socket says 172.21.15.132:40354) 2024-05-08T18:50:50.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.930+0000 7f5a65eec640 1 -- 172.21.15.132:0/3420311156 learned_addr learned my addr 172.21.15.132:0/3420311156 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.930+0000 7f5a65eec640 1 -- 172.21.15.132:0/3420311156 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55566bc46e20 con 0x55566bc464c0 2024-05-08T18:50:50.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.930+0000 7f5a65eec640 1 --2- 172.21.15.132:0/3420311156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bc464c0 0x55566bc468e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x55566bc32b50 tx=0x7f5a60018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.930+0000 7f594affd640 1 -- 172.21.15.132:0/3420311156 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a60014450 con 0x55566bc464c0 2024-05-08T18:50:50.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.930+0000 7f594affd640 1 -- 172.21.15.132:0/3420311156 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a60014610 con 0x55566bc464c0 2024-05-08T18:50:50.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.930+0000 7f594affd640 1 -- 172.21.15.132:0/3420311156 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a60014930 con 0x55566bc464c0 2024-05-08T18:50:50.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.930+0000 7f5a69933800 1 -- 172.21.15.132:0/3420311156 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55566bc47890 con 0x55566bc464c0 2024-05-08T18:50:50.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.930+0000 7f5a69933800 1 -- 172.21.15.132:0/3420311156 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55566bc47d90 con 0x55566bc464c0 2024-05-08T18:50:50.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.931+0000 7f594affd640 1 -- 172.21.15.132:0/3420311156 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5a60011040 con 0x55566bc464c0 2024-05-08T18:50:50.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.931+0000 7f594affd640 1 --2- 172.21.15.132:0/3420311156 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f594003bb50 0x7f594003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.931+0000 7f594affd640 1 -- 172.21.15.132:0/3420311156 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f5a6001e070 con 0x55566bc464c0 2024-05-08T18:50:50.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.931+0000 7f5a656eb640 1 --2- 172.21.15.132:0/3420311156 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f594003bb50 0x7f594003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.932+0000 7f5a69933800 1 Processor -- start 2024-05-08T18:50:50.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.932+0000 7f5a656eb640 1 --2- 172.21.15.132:0/3420311156 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f594003bb50 0x7f594003e010 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55566bc32bf0 tx=0x7f5a5801c610 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.932+0000 7f5a69933800 1 -- start start 2024-05-08T18:50:50.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.932+0000 7f5a69933800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bc53830 0x55566bc53c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.932+0000 7f5a69933800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55566bc23d10 con 0x55566bc53830 2024-05-08T18:50:50.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.932+0000 7f5a65eec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bc53830 0x55566bc53c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.932+0000 7f5a65eec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bc53830 0x55566bc53c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40370/0 (socket says 172.21.15.132:40370) 2024-05-08T18:50:50.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.932+0000 7f5a65eec640 1 -- 172.21.15.132:0/1128365031 learned_addr learned my addr 172.21.15.132:0/1128365031 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.932+0000 7f5a65eec640 1 -- 172.21.15.132:0/1128365031 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55566bc54220 con 0x55566bc53830 2024-05-08T18:50:50.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.932+0000 7f5a65eec640 1 --2- 172.21.15.132:0/1128365031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bc53830 0x55566bc53c50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5a60052cd0 tx=0x7f5a6002b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929bc73797fb5e78 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.933+0000 7f5948ff9640 1 -- 172.21.15.132:0/1128365031 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a60028070 con 0x55566bc53830 2024-05-08T18:50:50.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.933+0000 7f5948ff9640 1 -- 172.21.15.132:0/1128365031 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a60016440 con 0x55566bc53830 2024-05-08T18:50:50.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.933+0000 7f5948ff9640 1 -- 172.21.15.132:0/1128365031 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a60011a80 con 0x55566bc53830 2024-05-08T18:50:50.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.933+0000 7f5a69933800 1 -- 172.21.15.132:0/1128365031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bc53830 msgr2=0x55566bc53c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.933+0000 7f5a69933800 1 --2- 172.21.15.132:0/1128365031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bc53830 0x55566bc53c50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5a60052cd0 tx=0x7f5a6002b720 comp rx=0 tx=0).stop 2024-05-08T18:50:50.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.933+0000 7f5a69933800 1 -- 172.21.15.132:0/1128365031 shutdown_connections 2024-05-08T18:50:50.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.933+0000 7f5a69933800 1 --2- 172.21.15.132:0/1128365031 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bc53830 0x55566bc53c50 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.933+0000 7f5a69933800 1 -- 172.21.15.132:0/1128365031 >> 172.21.15.132:0/1128365031 conn(0x55566bc4fb00 msgr2=0x55566bc4db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.933+0000 7f5a69933800 1 -- 172.21.15.132:0/1128365031 shutdown_connections 2024-05-08T18:50:50.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.933+0000 7f5a69933800 1 -- 172.21.15.132:0/1128365031 wait complete. 2024-05-08T18:50:50.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.933+0000 7f5a69933800 1 Processor -- start 2024-05-08T18:50:50.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.933+0000 7f5a69933800 1 -- start start 2024-05-08T18:50:50.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.934+0000 7f5a69933800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bc53830 0x55566bc5acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.934+0000 7f5a69933800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55566bc54970 con 0x55566bc53830 2024-05-08T18:50:50.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.934+0000 7f5a65eec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bc53830 0x55566bc5acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.934+0000 7f5a65eec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bc53830 0x55566bc5acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40378/0 (socket says 172.21.15.132:40378) 2024-05-08T18:50:50.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.934+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 learned_addr learned my addr 172.21.15.132:0/577096984 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:50.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.934+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55566bc5b230 con 0x55566bc53830 2024-05-08T18:50:50.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.934+0000 7f5a65eec640 1 --2- 172.21.15.132:0/577096984 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bc53830 0x55566bc5acf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5a60051ba0 tx=0x7f5a60052c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.934+0000 7f5936ffd640 1 -- 172.21.15.132:0/577096984 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a60031020 con 0x55566bc53830 2024-05-08T18:50:50.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.934+0000 7f5936ffd640 1 -- 172.21.15.132:0/577096984 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a60014e20 con 0x55566bc53830 2024-05-08T18:50:50.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.934+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55566bc5b4c0 con 0x55566bc53830 2024-05-08T18:50:50.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.934+0000 7f5936ffd640 1 -- 172.21.15.132:0/577096984 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a60044030 con 0x55566bc53830 2024-05-08T18:50:50.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.935+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55566bc5e170 con 0x55566bc53830 2024-05-08T18:50:50.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.935+0000 7f5936ffd640 1 -- 172.21.15.132:0/577096984 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5a60034020 con 0x55566bc53830 2024-05-08T18:50:50.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.935+0000 7f5936ffd640 1 --2- 172.21.15.132:0/577096984 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f593003bba0 0x7f593003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.935+0000 7f5936ffd640 1 -- 172.21.15.132:0/577096984 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f5a6000e040 con 0x55566bc53830 2024-05-08T18:50:50.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.936+0000 7f5a656eb640 1 --2- 172.21.15.132:0/577096984 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f593003bba0 0x7f593003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.936+0000 7f5a69933800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.936+0000 7f5a69933800 1 --2- 172.21.15.132:0/577096984 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55566bc667e0 0x55566bc68ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.936+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bc693f0 con 0x55566bc667e0 2024-05-08T18:50:50.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.936+0000 7f5a64eea640 1 --2- 172.21.15.132:0/577096984 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55566bc667e0 0x55566bc68ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.936+0000 7f5a656eb640 1 --2- 172.21.15.132:0/577096984 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f593003bba0 0x7f593003e060 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5a58001670 tx=0x7f5a58052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.936+0000 7f5a64eea640 1 --2- 172.21.15.132:0/577096984 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55566bc667e0 0x55566bc68ca0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.936+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a5c05a040 con 0x55566bc667e0 2024-05-08T18:50:50.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.936+0000 7f5a69933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.936+0000 7f5a69933800 20 realm 2024-05-08T18:50:50.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.936+0000 7f5a69933800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.936+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bc697c0 con 0x55566bc667e0 2024-05-08T18:50:50.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.937+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a5c05a040 con 0x55566bc667e0 2024-05-08T18:50:50.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.937+0000 7f5a69933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.937+0000 7f5a69933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:50.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.937+0000 7f5a69933800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.937+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6a090 con 0x55566bc667e0 2024-05-08T18:50:50.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.937+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a5c05a040 con 0x55566bc667e0 2024-05-08T18:50:50.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.937+0000 7f5a69933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.937+0000 7f5a69933800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.937+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6a430 con 0x55566bc667e0 2024-05-08T18:50:50.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.937+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5a5c05a040 con 0x55566bc667e0 2024-05-08T18:50:50.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.937+0000 7f5a69933800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:50.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.937+0000 7f5a69933800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.937+0000 7f5a69933800 1 --2- 172.21.15.132:0/577096984 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55566bc6aee0 0x55566bc6d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.937+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6da70 con 0x55566bc6aee0 2024-05-08T18:50:50.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.937+0000 7f5a65eec640 1 --2- 172.21.15.132:0/577096984 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55566bc6aee0 0x55566bc6d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.937+0000 7f5a65eec640 1 --2- 172.21.15.132:0/577096984 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55566bc6aee0 0x55566bc6d310 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.938+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5a6002a070 con 0x55566bc6aee0 2024-05-08T18:50:50.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.938+0000 7f5a69933800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:50.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.938+0000 7f5a69933800 20 searching for the correct realm 2024-05-08T18:50:50.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.938+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x55566bc6aee0 2024-05-08T18:50:50.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.938+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a6002a070 con 0x55566bc6aee0 2024-05-08T18:50:50.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.938+0000 7f5a65eec640 1 --2- 172.21.15.132:0/577096984 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f5a60036020 0x7f5a600373f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.938+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x7f5a60036020 2024-05-08T18:50:50.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.939+0000 7f5a656eb640 1 --2- 172.21.15.132:0/577096984 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f5a60036020 0x7f5a600373f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.939+0000 7f5a656eb640 1 --2- 172.21.15.132:0/577096984 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f5a60036020 0x7f5a600373f0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.939+0000 7f5a656eb640 1 -- 172.21.15.132:0/577096984 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5803a030 con 0x7f5a60036020 2024-05-08T18:50:50.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.939+0000 7f5a656eb640 1 --2- 172.21.15.132:0/577096984 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f5a5800f070 0x7f5a5804a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:50.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.939+0000 7f5a656eb640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x7f5a5800f070 2024-05-08T18:50:50.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.939+0000 7f5a64eea640 1 --2- 172.21.15.132:0/577096984 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f5a5800f070 0x7f5a5804a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:50.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.940+0000 7f5a64eea640 1 --2- 172.21.15.132:0/577096984 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f5a5800f070 0x7f5a5804a720 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:50.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.940+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c05a040 con 0x7f5a5800f070 2024-05-08T18:50:50.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.940+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x55566bc667e0 2024-05-08T18:50:50.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.940+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c05a040 con 0x55566bc667e0 2024-05-08T18:50:50.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.940+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x55566bc667e0 2024-05-08T18:50:50.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.940+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c05a040 con 0x55566bc667e0 2024-05-08T18:50:50.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.940+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x7f5a5800f070 2024-05-08T18:50:50.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.941+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c05a040 con 0x7f5a5800f070 2024-05-08T18:50:50.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.941+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x7f5a5800f070 2024-05-08T18:50:50.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.941+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c05a040 con 0x7f5a5800f070 2024-05-08T18:50:50.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.941+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x7f5a60036020 2024-05-08T18:50:50.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.941+0000 7f5a656eb640 1 -- 172.21.15.132:0/577096984 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5803a030 con 0x7f5a60036020 2024-05-08T18:50:50.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.941+0000 7f5a656eb640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x55566bc6aee0 2024-05-08T18:50:50.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.941+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a60061040 con 0x55566bc6aee0 2024-05-08T18:50:50.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.941+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x55566bc667e0 2024-05-08T18:50:50.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.942+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c05a040 con 0x55566bc667e0 2024-05-08T18:50:50.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.942+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x7f5a5800f070 2024-05-08T18:50:50.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.942+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c05a040 con 0x7f5a5800f070 2024-05-08T18:50:50.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.942+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x55566bc667e0 2024-05-08T18:50:50.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.942+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5a5c05a040 con 0x55566bc667e0 2024-05-08T18:50:50.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.942+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x7f5a60036020 2024-05-08T18:50:50.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.942+0000 7f5a656eb640 1 -- 172.21.15.132:0/577096984 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5a5803a030 con 0x7f5a60036020 2024-05-08T18:50:50.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.942+0000 7f5a656eb640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x55566bc6aee0 2024-05-08T18:50:50.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.943+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5a60061040 con 0x55566bc6aee0 2024-05-08T18:50:50.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.943+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x55566bc6aee0 2024-05-08T18:50:50.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.943+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a60061040 con 0x55566bc6aee0 2024-05-08T18:50:50.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.943+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x7f5a5800f070 2024-05-08T18:50:50.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.943+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c05a040 con 0x7f5a5800f070 2024-05-08T18:50:50.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.943+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x55566bc6aee0 2024-05-08T18:50:50.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.943+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a60061040 con 0x55566bc6aee0 2024-05-08T18:50:50.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.943+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x55566bc6aee0 2024-05-08T18:50:50.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.943+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a60061040 con 0x55566bc6aee0 2024-05-08T18:50:50.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.943+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x55566bc667e0 2024-05-08T18:50:50.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.944+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c05a040 con 0x55566bc667e0 2024-05-08T18:50:50.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.944+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x55566bc667e0 2024-05-08T18:50:50.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.944+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5a5c05a040 con 0x55566bc667e0 2024-05-08T18:50:50.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.944+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x7f5a5800f070 2024-05-08T18:50:50.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.944+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c07d040 con 0x7f5a5800f070 2024-05-08T18:50:50.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.944+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x55566bc6aee0 2024-05-08T18:50:50.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.945+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a60061040 con 0x55566bc6aee0 2024-05-08T18:50:50.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.945+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x7f5a60036020 2024-05-08T18:50:50.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.945+0000 7f5a656eb640 1 -- 172.21.15.132:0/577096984 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5803a030 con 0x7f5a60036020 2024-05-08T18:50:50.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.945+0000 7f5a656eb640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x55566bc667e0 2024-05-08T18:50:50.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.945+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c07d040 con 0x55566bc667e0 2024-05-08T18:50:50.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.945+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x7f5a5800f070 2024-05-08T18:50:50.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.945+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c07d040 con 0x7f5a5800f070 2024-05-08T18:50:50.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.945+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x55566bc6aee0 2024-05-08T18:50:50.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.946+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a60061040 con 0x55566bc6aee0 2024-05-08T18:50:50.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.946+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x7f5a5800f070 2024-05-08T18:50:50.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.946+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c07d040 con 0x7f5a5800f070 2024-05-08T18:50:50.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.946+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x7f5a60036020 2024-05-08T18:50:50.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.946+0000 7f5a656eb640 1 -- 172.21.15.132:0/577096984 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5803a030 con 0x7f5a60036020 2024-05-08T18:50:50.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.946+0000 7f5a656eb640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x55566bc6aee0 2024-05-08T18:50:50.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.947+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a60061040 con 0x55566bc6aee0 2024-05-08T18:50:50.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.947+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x7f5a5800f070 2024-05-08T18:50:50.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.947+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c07d040 con 0x7f5a5800f070 2024-05-08T18:50:50.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.947+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x55566bc667e0 2024-05-08T18:50:50.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.947+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5a5c07d040 con 0x55566bc667e0 2024-05-08T18:50:50.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.947+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6f440 con 0x7f5a60036020 2024-05-08T18:50:50.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.947+0000 7f5a656eb640 1 -- 172.21.15.132:0/577096984 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5803a030 con 0x7f5a60036020 2024-05-08T18:50:50.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.947+0000 7f5a69933800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:50.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.947+0000 7f5a69933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:50.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.947+0000 7f5a69933800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:50.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.947+0000 7f5a69933800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:50.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.947+0000 7f5a69933800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:50.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.947+0000 7f5a69933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:50.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.947+0000 7f5a69933800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.947+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6e510 con 0x55566bc667e0 2024-05-08T18:50:50.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.948+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a5c07d040 con 0x55566bc667e0 2024-05-08T18:50:50.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.948+0000 7f5a69933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.948+0000 7f5a69933800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.948+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6edb0 con 0x55566bc667e0 2024-05-08T18:50:50.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.948+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5a5c07d040 con 0x55566bc667e0 2024-05-08T18:50:50.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.948+0000 7f5a69933800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:50.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.948+0000 7f5a69933800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.948+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6e150 con 0x55566bc667e0 2024-05-08T18:50:50.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.948+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5a5c07d040 con 0x55566bc667e0 2024-05-08T18:50:50.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.948+0000 7f5a69933800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:50.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.948+0000 7f5a69933800 20 zone default found 2024-05-08T18:50:50.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.948+0000 7f5a69933800 4 Realm: () 2024-05-08T18:50:50.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.948+0000 7f5a69933800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:50.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.948+0000 7f5a69933800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:50.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.948+0000 7f5a69933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:50.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.948+0000 7f5a69933800 20 zonegroup default 2024-05-08T18:50:50.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.948+0000 7f5a69933800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.948+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bc6fdc0 con 0x7f5a5800f070 2024-05-08T18:50:50.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.949+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5a5c07d040 con 0x7f5a5800f070 2024-05-08T18:50:50.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.949+0000 7f5a69933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.949+0000 7f5a69933800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.949+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bc717a0 con 0x55566bc6aee0 2024-05-08T18:50:50.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.949+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5a60061040 con 0x55566bc6aee0 2024-05-08T18:50:50.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.949+0000 7f5a69933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.949+0000 7f5a69933800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.949+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bc71c60 con 0x55566bc6aee0 2024-05-08T18:50:50.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.949+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5a60061040 con 0x55566bc6aee0 2024-05-08T18:50:50.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.949+0000 7f5a69933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:50.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.949+0000 7f5a69933800 20 started sync module instance, tier type = 2024-05-08T18:50:50.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.949+0000 7f5a69933800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:50.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.949+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bc70be0 con 0x7f5a60036020 2024-05-08T18:50:50.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.950+0000 7f5a656eb640 1 -- 172.21.15.132:0/577096984 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5803a030 con 0x7f5a60036020 2024-05-08T18:50:50.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.950+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93829663754032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bc720a0 con 0x7f5a60036020 2024-05-08T18:50:50.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.950+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bc728f0 con 0x55566bc667e0 2024-05-08T18:50:50.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.951+0000 7f5a656eb640 1 -- 172.21.15.132:0/577096984 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93829663754032] v25'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5803a030 con 0x7f5a60036020 2024-05-08T18:50:50.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.951+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c07d040 con 0x55566bc667e0 2024-05-08T18:50:50.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.951+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93829663761472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bc72d10 con 0x55566bc667e0 2024-05-08T18:50:50.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.951+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bc736d0 con 0x55566bc6aee0 2024-05-08T18:50:50.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.952+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93829663761472] v25'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c07d040 con 0x55566bc667e0 2024-05-08T18:50:50.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.953+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a60061040 con 0x55566bc6aee0 2024-05-08T18:50:50.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.953+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93829663763008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bc736d0 con 0x55566bc6aee0 2024-05-08T18:50:50.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.953+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bc74090 con 0x7f5a60036020 2024-05-08T18:50:50.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.954+0000 7f5a656eb640 1 -- 172.21.15.132:0/577096984 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5803a030 con 0x7f5a60036020 2024-05-08T18:50:50.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.954+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93829663767520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bc74930 con 0x7f5a60036020 2024-05-08T18:50:50.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.954+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93829663763008] v25'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a60061040 con 0x55566bc6aee0 2024-05-08T18:50:50.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.954+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bc74ec0 con 0x55566bc667e0 2024-05-08T18:50:50.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.955+0000 7f5a656eb640 1 -- 172.21.15.132:0/577096984 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93829663767520] v25'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5803a030 con 0x7f5a60036020 2024-05-08T18:50:50.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.955+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c07d040 con 0x55566bc667e0 2024-05-08T18:50:50.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.955+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93829663765024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bc752b0 con 0x55566bc667e0 2024-05-08T18:50:50.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.955+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bc75cd0 con 0x7f5a5800f070 2024-05-08T18:50:50.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.956+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93829663765024] v25'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c07d040 con 0x55566bc667e0 2024-05-08T18:50:50.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.956+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c07d040 con 0x7f5a5800f070 2024-05-08T18:50:50.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.956+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93829663774656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bc75c90 con 0x7f5a5800f070 2024-05-08T18:50:50.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.956+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bc766e0 con 0x7f5a5800f070 2024-05-08T18:50:50.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.957+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(56 notify.6 [create] v25'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c07d040 con 0x7f5a5800f070 2024-05-08T18:50:50.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.957+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93829663777328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bc76b00 con 0x7f5a5800f070 2024-05-08T18:50:50.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.957+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bc77620 con 0x7f5a5800f070 2024-05-08T18:50:50.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.957+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93829663774656] v25'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c07d040 con 0x7f5a5800f070 2024-05-08T18:50:50.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.958+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(58 notify.7 [create] v25'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c07d040 con 0x7f5a5800f070 2024-05-08T18:50:50.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.958+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93829663777328] v25'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c07d040 con 0x7f5a5800f070 2024-05-08T18:50:50.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.958+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93829663781104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bc74480 con 0x7f5a5800f070 2024-05-08T18:50:50.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.958+0000 7f5a69933800 20 add_watcher() i=0 2024-05-08T18:50:50.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.958+0000 7f5a69933800 20 add_watcher() i=1 2024-05-08T18:50:50.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.958+0000 7f5a69933800 20 add_watcher() i=2 2024-05-08T18:50:50.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.958+0000 7f5a69933800 20 add_watcher() i=3 2024-05-08T18:50:50.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.958+0000 7f5a69933800 20 add_watcher() i=4 2024-05-08T18:50:50.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.958+0000 7f5a69933800 20 add_watcher() i=5 2024-05-08T18:50:50.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.958+0000 7f5a69933800 20 add_watcher() i=6 2024-05-08T18:50:50.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.959+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93829663781104] v25'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c07d040 con 0x7f5a5800f070 2024-05-08T18:50:50.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.959+0000 7f5a69933800 20 add_watcher() i=7 2024-05-08T18:50:50.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.959+0000 7f5a69933800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:50.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.959+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bc7a610 con 0x55566bc667e0 2024-05-08T18:50:50.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.959+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5a5c07d040 con 0x55566bc667e0 2024-05-08T18:50:50.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.959+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93829663778384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bc77a90 con 0x55566bc667e0 2024-05-08T18:50:50.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.960+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93829663778384] v25'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5a5c07d040 con 0x55566bc667e0 2024-05-08T18:50:50.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.960+0000 7f591b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:50.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.961+0000 7f5a69933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:50.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.961+0000 7f5a69933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:50.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.961+0000 7f5a69933800 5 note: GC not initialized 2024-05-08T18:50:50.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.961+0000 7f591a7e4640 20 reqs_thread_entry: start 2024-05-08T18:50:50.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.961+0000 7f5a69933800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:50.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.961+0000 7f5a69933800 20 Filter name: none 2024-05-08T18:50:50.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.961+0000 7f588bfff640 20 reqs_thread_entry: start 2024-05-08T18:50:50.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.961+0000 7f5a69933800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.961+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bcad9f0 con 0x7f5a60036020 2024-05-08T18:50:50.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.961+0000 7f5a656eb640 1 -- 172.21.15.132:0/577096984 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5a5803a030 con 0x7f5a60036020 2024-05-08T18:50:50.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.961+0000 7f5a69933800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:50:50.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.962+0000 7f5a69933800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.962+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 8.1e 8:7ec7f916:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bcae5c0 con 0x7f5a5800f070 2024-05-08T18:50:50.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.962+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(63 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f5a5c07d040 con 0x7f5a5800f070 2024-05-08T18:50:50.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.962+0000 7f5a69933800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:50:50.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.962+0000 7f5a69933800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:50:50.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.962+0000 7f5a69933800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.962+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bcae570 con 0x7f5a60036020 2024-05-08T18:50:50.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.962+0000 7f5a656eb640 1 -- 172.21.15.132:0/577096984 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5a5803a030 con 0x7f5a60036020 2024-05-08T18:50:50.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.963+0000 7f5a69933800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:50:50.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.963+0000 7f5a69933800 20 rados->read ofs=0 len=0 2024-05-08T18:50:50.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.963+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:65 8.1e 8:7ec7f916:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bcafc90 con 0x7f5a5800f070 2024-05-08T18:50:50.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.963+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(65 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f5a5c07d040 con 0x7f5a5800f070 2024-05-08T18:50:50.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.963+0000 7f5a69933800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:50:50.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.963+0000 7f5a69933800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:50:50.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.963+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:66 4.3d 4:beedfbf8:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bcb1700 con 0x55566bc6aee0 2024-05-08T18:50:50.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.963+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 4.0 4:01e493d7:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bcb42a0 con 0x55566bc6aee0 2024-05-08T18:50:50.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.963+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:68 4.3a 4:5c1a59ec:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bcb6da0 con 0x55566bc6aee0 2024-05-08T18:50:50.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.963+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 4.4 4:2155dbb4:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bcb42a0 con 0x7f5a5800f070 2024-05-08T18:50:50.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.963+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:70 4.30 4:0edbbef1:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bcbbd30 con 0x55566bc6aee0 2024-05-08T18:50:50.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.963+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 4.2 4:435b253f:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bcbe710 con 0x55566bc667e0 2024-05-08T18:50:50.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.963+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 4.2a 4:56da7a03:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bcbe750 con 0x55566bc667e0 2024-05-08T18:50:50.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.963+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:73 4.29 4:96c53c8a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bcc36b0 con 0x55566bc6aee0 2024-05-08T18:50:50.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.963+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 4.1a 4:5ae0f416:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bcc6550 con 0x7f5a60036020 2024-05-08T18:50:50.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.963+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(69 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a5c07d040 con 0x7f5a5800f070 2024-05-08T18:50:50.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.963+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:75 4.c 4:33d05922:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bcc36b0 con 0x55566bc667e0 2024-05-08T18:50:50.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.963+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(66 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a60061040 con 0x55566bc6aee0 2024-05-08T18:50:50.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.963+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a60061040 con 0x55566bc6aee0 2024-05-08T18:50:50.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.963+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(68 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a60061040 con 0x55566bc6aee0 2024-05-08T18:50:50.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.963+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:76 4.13 4:cba0e3e9:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55566bcc6550 con 0x7f5a60036020 2024-05-08T18:50:50.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.964+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(73 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a60061040 con 0x55566bc6aee0 2024-05-08T18:50:50.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.964+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(70 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a60061040 con 0x55566bc6aee0 2024-05-08T18:50:50.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.964+0000 7f5a656eb640 1 -- 172.21.15.132:0/577096984 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(74 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.8 [call out=124b] v0'0 uv11 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5a5803a030 con 0x7f5a60036020 2024-05-08T18:50:50.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.964+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(71 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5a5c07d040 con 0x55566bc667e0 2024-05-08T18:50:50.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.964+0000 7f5a656eb640 1 -- 172.21.15.132:0/577096984 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(76 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5a5803a030 con 0x7f5a60036020 2024-05-08T18:50:50.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.964+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(72 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5a5c07d040 con 0x55566bc667e0 2024-05-08T18:50:50.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.964+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(75 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a5c07d040 con 0x55566bc667e0 2024-05-08T18:50:50.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.965+0000 7f591b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:50.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.965+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93829663778384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bcc6550 con 0x55566bc667e0 2024-05-08T18:50:50.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.966+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 93829663778384] v25'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5a5c07d040 con 0x55566bc667e0 2024-05-08T18:50:50.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.966+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93829663754032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bc95f50 con 0x7f5a60036020 2024-05-08T18:50:50.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.967+0000 7f5a656eb640 1 -- 172.21.15.132:0/577096984 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 93829663754032] v25'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5803a030 con 0x7f5a60036020 2024-05-08T18:50:50.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.967+0000 7f5a69933800 20 remove_watcher() i=0 2024-05-08T18:50:50.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.967+0000 7f5a69933800 2 removed watcher, disabling cache 2024-05-08T18:50:50.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.967+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93829663761472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bcc6520 con 0x55566bc667e0 2024-05-08T18:50:50.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.968+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 93829663761472] v25'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c07d040 con 0x55566bc667e0 2024-05-08T18:50:50.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.968+0000 7f5a69933800 20 remove_watcher() i=1 2024-05-08T18:50:50.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.968+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93829663763008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bc95f50 con 0x55566bc6aee0 2024-05-08T18:50:50.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.969+0000 7f5a65eec640 1 -- 172.21.15.132:0/577096984 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 93829663763008] v25'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a60061040 con 0x55566bc6aee0 2024-05-08T18:50:50.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.969+0000 7f5a69933800 20 remove_watcher() i=2 2024-05-08T18:50:50.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.969+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93829663767520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bcc6520 con 0x7f5a60036020 2024-05-08T18:50:50.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.970+0000 7f5a656eb640 1 -- 172.21.15.132:0/577096984 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 93829663767520] v25'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5803a030 con 0x7f5a60036020 2024-05-08T18:50:50.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.970+0000 7f5a69933800 20 remove_watcher() i=3 2024-05-08T18:50:50.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.970+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93829663765024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bc95f50 con 0x55566bc667e0 2024-05-08T18:50:50.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.971+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 93829663765024] v25'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c07d040 con 0x55566bc667e0 2024-05-08T18:50:50.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.971+0000 7f5a69933800 20 remove_watcher() i=4 2024-05-08T18:50:50.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.971+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93829663774656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bcc6520 con 0x7f5a5800f070 2024-05-08T18:50:50.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.972+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 93829663774656] v25'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c07d040 con 0x7f5a5800f070 2024-05-08T18:50:50.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.972+0000 7f5a69933800 20 remove_watcher() i=5 2024-05-08T18:50:50.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.972+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93829663777328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bc95f50 con 0x7f5a5800f070 2024-05-08T18:50:50.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.973+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 93829663777328] v25'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c07d040 con 0x7f5a5800f070 2024-05-08T18:50:50.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.973+0000 7f5a69933800 20 remove_watcher() i=6 2024-05-08T18:50:50.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.973+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93829663781104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55566bcc6520 con 0x7f5a5800f070 2024-05-08T18:50:50.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 93829663781104] v25'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c07d040 con 0x7f5a5800f070 2024-05-08T18:50:50.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a69933800 20 remove_watcher() i=7 2024-05-08T18:50:50.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f5a5800f070 msgr2=0x7f5a5804a720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a69933800 1 --2- 172.21.15.132:0/577096984 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f5a5800f070 0x7f5a5804a720 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55566bc667e0 msgr2=0x55566bc68ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a69933800 1 --2- 172.21.15.132:0/577096984 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55566bc667e0 0x55566bc68ca0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f5a60036020 msgr2=0x7f5a600373f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a69933800 1 --2- 172.21.15.132:0/577096984 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f5a60036020 0x7f5a600373f0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55566bc6aee0 msgr2=0x55566bc6d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a69933800 1 --2- 172.21.15.132:0/577096984 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55566bc6aee0 0x55566bc6d310 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f593003bba0 msgr2=0x7f593003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a69933800 1 --2- 172.21.15.132:0/577096984 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f593003bba0 0x7f593003e060 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5a58001670 tx=0x7f5a58052000 comp rx=0 tx=0).stop 2024-05-08T18:50:50.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bc53830 msgr2=0x55566bc5acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a69933800 1 --2- 172.21.15.132:0/577096984 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bc53830 0x55566bc5acf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5a60051ba0 tx=0x7f5a60052c60 comp rx=0 tx=0).stop 2024-05-08T18:50:50.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a64eea640 1 -- 172.21.15.132:0/577096984 reap_dead start 2024-05-08T18:50:50.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 shutdown_connections 2024-05-08T18:50:50.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 >> 172.21.15.132:0/577096984 conn(0x55566bc4fb00 msgr2=0x55566bc4d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 shutdown_connections 2024-05-08T18:50:50.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a69933800 1 -- 172.21.15.132:0/577096984 wait complete. 2024-05-08T18:50:50.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a69933800 1 -- 172.21.15.132:0/3420311156 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f594003bb50 msgr2=0x7f594003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a69933800 1 --2- 172.21.15.132:0/3420311156 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f594003bb50 0x7f594003e010 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55566bc32bf0 tx=0x7f5a5801c610 comp rx=0 tx=0).stop 2024-05-08T18:50:50.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a69933800 1 -- 172.21.15.132:0/3420311156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bc464c0 msgr2=0x55566bc468e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.974+0000 7f5a69933800 1 --2- 172.21.15.132:0/3420311156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bc464c0 0x55566bc468e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x55566bc32b50 tx=0x7f5a60018830 comp rx=0 tx=0).stop 2024-05-08T18:50:50.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.975+0000 7f5a69933800 1 -- 172.21.15.132:0/3420311156 shutdown_connections 2024-05-08T18:50:50.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.975+0000 7f5a69933800 1 --2- 172.21.15.132:0/3420311156 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f594003bb50 0x7f594003e010 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.975+0000 7f5a69933800 1 --2- 172.21.15.132:0/3420311156 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bc464c0 0x55566bc468e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.975+0000 7f5a69933800 1 -- 172.21.15.132:0/3420311156 >> 172.21.15.132:0/3420311156 conn(0x55566bc3a560 msgr2=0x55566bc3a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.975+0000 7f5a69933800 1 -- 172.21.15.132:0/3420311156 shutdown_connections 2024-05-08T18:50:50.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.975+0000 7f5a69933800 1 -- 172.21.15.132:0/3420311156 wait complete. 2024-05-08T18:50:50.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.975+0000 7f5a69933800 1 -- 172.21.15.132:0/4237503847 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55566bb355d0 msgr2=0x55566bc321c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.975+0000 7f5a69933800 1 --2- 172.21.15.132:0/4237503847 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55566bb355d0 0x55566bc321c0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.975+0000 7f5a69933800 1 -- 172.21.15.132:0/4237503847 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55566bc34aa0 msgr2=0x55566bc36e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.975+0000 7f5a69933800 1 --2- 172.21.15.132:0/4237503847 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55566bc34aa0 0x55566bc36e90 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.975+0000 7f5a69933800 1 -- 172.21.15.132:0/4237503847 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f594c03bba0 msgr2=0x7f594c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.975+0000 7f5a69933800 1 --2- 172.21.15.132:0/4237503847 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f594c03bba0 0x7f594c03e060 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c054000 tx=0x7f5a5c04e000 comp rx=0 tx=0).stop 2024-05-08T18:50:50.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.975+0000 7f5a69933800 1 -- 172.21.15.132:0/4237503847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bb31140 msgr2=0x55566bc2af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:50.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.975+0000 7f5a69933800 1 --2- 172.21.15.132:0/4237503847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bb31140 0x55566bc2af80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5a5800bc10 tx=0x7f5a58000bc0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.975+0000 7f5a69933800 1 -- 172.21.15.132:0/4237503847 shutdown_connections 2024-05-08T18:50:50.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.975+0000 7f5a69933800 1 --2- 172.21.15.132:0/4237503847 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55566bc34aa0 0x55566bc36e90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.975+0000 7f5a69933800 1 --2- 172.21.15.132:0/4237503847 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55566bb355d0 0x55566bc321c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.975+0000 7f5a69933800 1 --2- 172.21.15.132:0/4237503847 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f594c03bba0 0x7f594c03e060 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.975+0000 7f5a69933800 1 --2- 172.21.15.132:0/4237503847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55566bb31140 0x55566bc2af80 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:50.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.975+0000 7f5a69933800 1 -- 172.21.15.132:0/4237503847 >> 172.21.15.132:0/4237503847 conn(0x55566bb2c720 msgr2=0x55566bc1d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:50.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.975+0000 7f5a69933800 1 -- 172.21.15.132:0/4237503847 shutdown_connections 2024-05-08T18:50:50.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:50.975+0000 7f5a69933800 1 -- 172.21.15.132:0/4237503847 wait complete. 2024-05-08T18:50:50.989 INFO:teuthology.orchestra.run.smithi132.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"23dcc2a0-b283-45fd-8c01-831457a34b43","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1","marker":"bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-08T18:50:50.452952Z","creation_time":"2024-05-08T18:50:47.727613Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-05-08T18:50:50.989 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '23dcc2a0-b283-45fd-8c01-831457a34b43', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1', 'marker': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:50:50.452952Z', 'creation_time': '2024-05-08T18:50:47.727613Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T18:50:50.990 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-05-08T18:50:50.990 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-05-08T18:50:50.990 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-05-08T18:50:51.031 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:51.032 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:51.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.033+0000 7f8d94925800 1 Processor -- start 2024-05-08T18:50:51.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.033+0000 7f8d94925800 1 -- start start 2024-05-08T18:50:51.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.033+0000 7f8d94925800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55c4dc246a80 0x55c4dc2db100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.033+0000 7f8d94925800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c4dc246fc0 con 0x55c4dc247e10 2024-05-08T18:50:51.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.033+0000 7f8d94925800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55c4dc172e20 con 0x55c4dc246a80 2024-05-08T18:50:51.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.034+0000 7f8d8feaf640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55c4dc246a80 0x55c4dc2db100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.034+0000 7f8d8feaf640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55c4dc246a80 0x55c4dc2db100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40386/0 (socket says 172.21.15.132:40386) 2024-05-08T18:50:51.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.034+0000 7f8d8feaf640 1 -- 172.21.15.132:0/2041412697 learned_addr learned my addr 172.21.15.132:0/2041412697 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:51.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.034+0000 7f8d906b0640 1 --1- 172.21.15.132:0/2041412697 >> v1:172.21.15.42:6789/0 conn(0x55c4dc247e10 0x55c4dc246370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:43626/0 (socket says 172.21.15.132:43626) 2024-05-08T18:50:51.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.034+0000 7f8d8feaf640 1 -- 172.21.15.132:0/2041412697 >> v1:172.21.15.42:6789/0 conn(0x55c4dc247e10 legacy=0x55c4dc246370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.034+0000 7f8d8feaf640 1 -- 172.21.15.132:0/2041412697 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4dc2dc650 con 0x55c4dc246a80 2024-05-08T18:50:51.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.036+0000 7f8d8feaf640 1 --2- 172.21.15.132:0/2041412697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc246a80 0x55c4dc2db100 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8d8400a520 tx=0x7f8d8401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80dad7e8bbc0b26c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.036+0000 7f8d8f6ae640 1 -- 172.21.15.132:0/2041412697 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d84057070 con 0x55c4dc246a80 2024-05-08T18:50:51.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.036+0000 7f8d8f6ae640 1 -- 172.21.15.132:0/2041412697 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d84052570 con 0x55c4dc246a80 2024-05-08T18:50:51.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.036+0000 7f8d8f6ae640 1 -- 172.21.15.132:0/2041412697 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d8404ae60 con 0x55c4dc246a80 2024-05-08T18:50:51.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.036+0000 7f8d94925800 1 -- 172.21.15.132:0/2041412697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc246a80 msgr2=0x55c4dc2db100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.036+0000 7f8d94925800 1 --2- 172.21.15.132:0/2041412697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc246a80 0x55c4dc2db100 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8d8400a520 tx=0x7f8d8401d010 comp rx=0 tx=0).stop 2024-05-08T18:50:51.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.036+0000 7f8d94925800 1 -- 172.21.15.132:0/2041412697 shutdown_connections 2024-05-08T18:50:51.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.036+0000 7f8d94925800 1 --2- 172.21.15.132:0/2041412697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc246a80 0x55c4dc2db100 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.036+0000 7f8d94925800 1 -- 172.21.15.132:0/2041412697 >> 172.21.15.132:0/2041412697 conn(0x55c4dc2cd820 msgr2=0x55c4dc2cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:51.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.037+0000 7f8d94925800 1 -- 172.21.15.132:0/2041412697 shutdown_connections 2024-05-08T18:50:51.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.037+0000 7f8d94925800 1 -- 172.21.15.132:0/2041412697 wait complete. 2024-05-08T18:50:51.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.050+0000 7f8d94925800 1 Processor -- start 2024-05-08T18:50:51.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.050+0000 7f8d94925800 1 -- start start 2024-05-08T18:50:51.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.051+0000 7f8d94925800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc246a80 0x55c4dc3c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.051+0000 7f8d94925800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c4dc21d5a0 con 0x55c4dc246a80 2024-05-08T18:50:51.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.051+0000 7f8d906b0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc246a80 0x55c4dc3c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.051+0000 7f8d906b0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc246a80 0x55c4dc3c57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40392/0 (socket says 172.21.15.132:40392) 2024-05-08T18:50:51.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.051+0000 7f8d906b0640 1 -- 172.21.15.132:0/297160324 learned_addr learned my addr 172.21.15.132:0/297160324 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:51.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.051+0000 7f8d906b0640 1 -- 172.21.15.132:0/297160324 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4dc3c5d70 con 0x55c4dc246a80 2024-05-08T18:50:51.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.051+0000 7f8d906b0640 1 --2- 172.21.15.132:0/297160324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc246a80 0x55c4dc3c57a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8d80001670 tx=0x7f8d80001b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28b34509805b939 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.051+0000 7f8c7e60c640 1 -- 172.21.15.132:0/297160324 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d80013420 con 0x55c4dc246a80 2024-05-08T18:50:51.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.051+0000 7f8c7e60c640 1 -- 172.21.15.132:0/297160324 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d800135c0 con 0x55c4dc246a80 2024-05-08T18:50:51.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.051+0000 7f8c7e60c640 1 -- 172.21.15.132:0/297160324 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d80013920 con 0x55c4dc246a80 2024-05-08T18:50:51.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.052+0000 7f8d94925800 1 -- 172.21.15.132:0/297160324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc246a80 msgr2=0x55c4dc3c57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.052+0000 7f8d94925800 1 --2- 172.21.15.132:0/297160324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc246a80 0x55c4dc3c57a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8d80001670 tx=0x7f8d80001b30 comp rx=0 tx=0).stop 2024-05-08T18:50:51.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.052+0000 7f8d94925800 1 -- 172.21.15.132:0/297160324 shutdown_connections 2024-05-08T18:50:51.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.052+0000 7f8d94925800 1 --2- 172.21.15.132:0/297160324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc246a80 0x55c4dc3c57a0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.052+0000 7f8d94925800 1 -- 172.21.15.132:0/297160324 >> 172.21.15.132:0/297160324 conn(0x55c4dc2cd820 msgr2=0x55c4dc3c10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:51.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.052+0000 7f8d94925800 1 -- 172.21.15.132:0/297160324 shutdown_connections 2024-05-08T18:50:51.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.052+0000 7f8d94925800 1 -- 172.21.15.132:0/297160324 wait complete. 2024-05-08T18:50:51.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.052+0000 7f8d94925800 1 Processor -- start 2024-05-08T18:50:51.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.052+0000 7f8d94925800 1 -- start start 2024-05-08T18:50:51.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.053+0000 7f8d94925800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc246a80 0x55c4dc3cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.053+0000 7f8d94925800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c4dc2db880 con 0x55c4dc246a80 2024-05-08T18:50:51.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.053+0000 7f8d906b0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc246a80 0x55c4dc3cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.053+0000 7f8d906b0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc246a80 0x55c4dc3cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40400/0 (socket says 172.21.15.132:40400) 2024-05-08T18:50:51.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.053+0000 7f8d906b0640 1 -- 172.21.15.132:0/2346736855 learned_addr learned my addr 172.21.15.132:0/2346736855 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:51.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.053+0000 7f8d906b0640 1 -- 172.21.15.132:0/2346736855 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4dc3cd7f0 con 0x55c4dc246a80 2024-05-08T18:50:51.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.053+0000 7f8d906b0640 1 --2- 172.21.15.132:0/2346736855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc246a80 0x55c4dc3cd2b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8d800065f0 tx=0x7f8d80000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.054+0000 7f8c7ce09640 1 -- 172.21.15.132:0/2346736855 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d80022020 con 0x55c4dc246a80 2024-05-08T18:50:51.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.054+0000 7f8c7ce09640 1 -- 172.21.15.132:0/2346736855 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d80004a40 con 0x55c4dc246a80 2024-05-08T18:50:51.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.054+0000 7f8d94925800 1 -- 172.21.15.132:0/2346736855 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4dc3cda80 con 0x55c4dc246a80 2024-05-08T18:50:51.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.054+0000 7f8c7ce09640 1 -- 172.21.15.132:0/2346736855 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d80004d60 con 0x55c4dc246a80 2024-05-08T18:50:51.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.054+0000 7f8d94925800 1 -- 172.21.15.132:0/2346736855 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4dc3d0730 con 0x55c4dc246a80 2024-05-08T18:50:51.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.054+0000 7f8c7ce09640 1 -- 172.21.15.132:0/2346736855 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8d80025020 con 0x55c4dc246a80 2024-05-08T18:50:51.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.055+0000 7f8c7ce09640 1 --2- 172.21.15.132:0/2346736855 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c7803bba0 0x7f8c7803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.055+0000 7f8c7ce09640 1 -- 172.21.15.132:0/2346736855 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f8d80018030 con 0x55c4dc246a80 2024-05-08T18:50:51.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.055+0000 7f8d8feaf640 1 --2- 172.21.15.132:0/2346736855 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c7803bba0 0x7f8c7803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.055+0000 7f8d94925800 1 --2- 172.21.15.132:0/2346736855 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c4dc247e10 0x55c4dc3d44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.055+0000 7f8d94925800 1 -- 172.21.15.132:0/2346736855 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc3d4a80 con 0x55c4dc247e10 2024-05-08T18:50:51.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.055+0000 7f8d90eb1640 1 --2- 172.21.15.132:0/2346736855 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c4dc247e10 0x55c4dc3d44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.055+0000 7f8d8feaf640 1 --2- 172.21.15.132:0/2346736855 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c7803bba0 0x7f8c7803e060 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8d84054000 tx=0x7f8d8404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.055+0000 7f8d90eb1640 1 --2- 172.21.15.132:0/2346736855 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c4dc247e10 0x55c4dc3d44f0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.056+0000 7f8d90eb1640 1 -- 172.21.15.132:0/2346736855 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc247e10 2024-05-08T18:50:51.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.056+0000 7f8d94925800 1 -- 172.21.15.132:0/2346736855 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc3d1aa0 con 0x55c4dc247e10 2024-05-08T18:50:51.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.056+0000 7f8d90eb1640 1 -- 172.21.15.132:0/2346736855 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc247e10 2024-05-08T18:50:51.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.056+0000 7f8d94925800 1 --2- 172.21.15.132:0/2346736855 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c4dc3d6e00 0x55c4dc3d91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.056+0000 7f8d94925800 1 -- 172.21.15.132:0/2346736855 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc3d98e0 con 0x55c4dc3d6e00 2024-05-08T18:50:51.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.056+0000 7f8d906b0640 1 --2- 172.21.15.132:0/2346736855 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c4dc3d6e00 0x55c4dc3d91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.056+0000 7f8d906b0640 1 --2- 172.21.15.132:0/2346736855 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c4dc3d6e00 0x55c4dc3d91f0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.056+0000 7f8d906b0640 1 -- 172.21.15.132:0/2346736855 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8d8001b070 con 0x55c4dc3d6e00 2024-05-08T18:50:51.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.057+0000 7f8d94925800 1 -- 172.21.15.132:0/2346736855 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc3d5ca0 con 0x55c4dc247e10 2024-05-08T18:50:51.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.057+0000 7f8d90eb1640 1 -- 172.21.15.132:0/2346736855 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc247e10 2024-05-08T18:50:51.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.057+0000 7f8d94925800 1 -- 172.21.15.132:0/2346736855 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc3d6140 con 0x55c4dc247e10 2024-05-08T18:50:51.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.057+0000 7f8d90eb1640 1 -- 172.21.15.132:0/2346736855 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc247e10 2024-05-08T18:50:51.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.057+0000 7f8d94925800 1 Processor -- start 2024-05-08T18:50:51.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.057+0000 7f8d94925800 1 -- start start 2024-05-08T18:50:51.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.058+0000 7f8d94925800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc3e8860 0x55c4dc3e8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.058+0000 7f8d94925800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c4dc1c3fc0 con 0x55c4dc3e8860 2024-05-08T18:50:51.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.058+0000 7f8d90eb1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc3e8860 0x55c4dc3e8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.058+0000 7f8d90eb1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc3e8860 0x55c4dc3e8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40414/0 (socket says 172.21.15.132:40414) 2024-05-08T18:50:51.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.058+0000 7f8d90eb1640 1 -- 172.21.15.132:0/2351825612 learned_addr learned my addr 172.21.15.132:0/2351825612 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:51.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.058+0000 7f8d90eb1640 1 -- 172.21.15.132:0/2351825612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4dc3e91c0 con 0x55c4dc3e8860 2024-05-08T18:50:51.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.058+0000 7f8d90eb1640 1 --2- 172.21.15.132:0/2351825612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc3e8860 0x55c4dc3e8c80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x55c4dc3ce180 tx=0x7f8d8800aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.059+0000 7f8c75ffb640 1 -- 172.21.15.132:0/2351825612 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d88007d00 con 0x55c4dc3e8860 2024-05-08T18:50:51.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.059+0000 7f8c75ffb640 1 -- 172.21.15.132:0/2351825612 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d8801e020 con 0x55c4dc3e8860 2024-05-08T18:50:51.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.059+0000 7f8c75ffb640 1 -- 172.21.15.132:0/2351825612 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d88019420 con 0x55c4dc3e8860 2024-05-08T18:50:51.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.059+0000 7f8d94925800 1 -- 172.21.15.132:0/2351825612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4dc3e9c30 con 0x55c4dc3e8860 2024-05-08T18:50:51.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.059+0000 7f8d94925800 1 -- 172.21.15.132:0/2351825612 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4dc3ea130 con 0x55c4dc3e8860 2024-05-08T18:50:51.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.059+0000 7f8c75ffb640 1 -- 172.21.15.132:0/2351825612 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8d88016040 con 0x55c4dc3e8860 2024-05-08T18:50:51.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.060+0000 7f8c75ffb640 1 --2- 172.21.15.132:0/2351825612 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c6803bba0 0x7f8c6803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.060+0000 7f8c75ffb640 1 -- 172.21.15.132:0/2351825612 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f8d8801f030 con 0x55c4dc3e8860 2024-05-08T18:50:51.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.060+0000 7f8d906b0640 1 --2- 172.21.15.132:0/2351825612 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c6803bba0 0x7f8c6803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.060+0000 7f8d94925800 1 Processor -- start 2024-05-08T18:50:51.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.060+0000 7f8d906b0640 1 --2- 172.21.15.132:0/2351825612 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c6803bba0 0x7f8c6803e060 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55c4dc3d4f70 tx=0x7f8d80051000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.060+0000 7f8d94925800 1 -- start start 2024-05-08T18:50:51.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.060+0000 7f8d94925800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc3f5b20 0x55c4dc3f5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.060+0000 7f8d94925800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c4dc3c60f0 con 0x55c4dc3f5b20 2024-05-08T18:50:51.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.060+0000 7f8d90eb1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc3f5b20 0x55c4dc3f5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.060+0000 7f8d90eb1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc3f5b20 0x55c4dc3f5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40430/0 (socket says 172.21.15.132:40430) 2024-05-08T18:50:51.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.060+0000 7f8d90eb1640 1 -- 172.21.15.132:0/968630046 learned_addr learned my addr 172.21.15.132:0/968630046 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:51.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.061+0000 7f8d90eb1640 1 -- 172.21.15.132:0/968630046 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4dc3f6510 con 0x55c4dc3f5b20 2024-05-08T18:50:51.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.061+0000 7f8d90eb1640 1 --2- 172.21.15.132:0/968630046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc3f5b20 0x55c4dc3f5f40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8d88052bb0 tx=0x7f8d88017b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d18e96368d00a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.061+0000 7f8c677fe640 1 -- 172.21.15.132:0/968630046 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d8801d070 con 0x55c4dc3f5b20 2024-05-08T18:50:51.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.061+0000 7f8c677fe640 1 -- 172.21.15.132:0/968630046 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d88015e50 con 0x55c4dc3f5b20 2024-05-08T18:50:51.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.061+0000 7f8c677fe640 1 -- 172.21.15.132:0/968630046 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d88018500 con 0x55c4dc3f5b20 2024-05-08T18:50:51.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.061+0000 7f8d94925800 1 -- 172.21.15.132:0/968630046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc3f5b20 msgr2=0x55c4dc3f5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.061+0000 7f8d94925800 1 --2- 172.21.15.132:0/968630046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc3f5b20 0x55c4dc3f5f40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8d88052bb0 tx=0x7f8d88017b10 comp rx=0 tx=0).stop 2024-05-08T18:50:51.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.061+0000 7f8d94925800 1 -- 172.21.15.132:0/968630046 shutdown_connections 2024-05-08T18:50:51.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.061+0000 7f8d94925800 1 --2- 172.21.15.132:0/968630046 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc3f5b20 0x55c4dc3f5f40 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.061+0000 7f8d94925800 1 -- 172.21.15.132:0/968630046 >> 172.21.15.132:0/968630046 conn(0x55c4dc3f1e80 msgr2=0x55c4dc3efee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:51.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.061+0000 7f8d94925800 1 -- 172.21.15.132:0/968630046 shutdown_connections 2024-05-08T18:50:51.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.061+0000 7f8d94925800 1 -- 172.21.15.132:0/968630046 wait complete. 2024-05-08T18:50:51.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.062+0000 7f8d94925800 1 Processor -- start 2024-05-08T18:50:51.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.062+0000 7f8d94925800 1 -- start start 2024-05-08T18:50:51.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.062+0000 7f8d94925800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc3f5b20 0x55c4dc401590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.062+0000 7f8d94925800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c4dc3f6c80 con 0x55c4dc3f5b20 2024-05-08T18:50:51.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.062+0000 7f8d90eb1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc3f5b20 0x55c4dc401590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.062+0000 7f8d90eb1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc3f5b20 0x55c4dc401590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40444/0 (socket says 172.21.15.132:40444) 2024-05-08T18:50:51.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.062+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 learned_addr learned my addr 172.21.15.132:0/3139595159 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:51.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.062+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4dc401ad0 con 0x55c4dc3f5b20 2024-05-08T18:50:51.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.063+0000 7f8d90eb1640 1 --2- 172.21.15.132:0/3139595159 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc3f5b20 0x55c4dc401590 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8d88014a60 tx=0x7f8d88052b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.063+0000 7f8c65ffb640 1 -- 172.21.15.132:0/3139595159 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d88032070 con 0x55c4dc3f5b20 2024-05-08T18:50:51.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.063+0000 7f8c65ffb640 1 -- 172.21.15.132:0/3139595159 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d88045070 con 0x55c4dc3f5b20 2024-05-08T18:50:51.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.063+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4dc401d60 con 0x55c4dc3f5b20 2024-05-08T18:50:51.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.063+0000 7f8c65ffb640 1 -- 172.21.15.132:0/3139595159 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d88054410 con 0x55c4dc3f5b20 2024-05-08T18:50:51.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.063+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4dc404a10 con 0x55c4dc3f5b20 2024-05-08T18:50:51.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.063+0000 7f8c65ffb640 1 -- 172.21.15.132:0/3139595159 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8d8804f030 con 0x55c4dc3f5b20 2024-05-08T18:50:51.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.064+0000 7f8c65ffb640 1 --2- 172.21.15.132:0/3139595159 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c5803bb00 0x7f8c5803dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.064+0000 7f8c65ffb640 1 -- 172.21.15.132:0/3139595159 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f8d8803b860 con 0x55c4dc3f5b20 2024-05-08T18:50:51.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.064+0000 7f8d906b0640 1 --2- 172.21.15.132:0/3139595159 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c5803bb00 0x7f8c5803dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.064+0000 7f8d906b0640 1 --2- 172.21.15.132:0/3139595159 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c5803bb00 0x7f8c5803dfc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8d80002080 tx=0x7f8d80046000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.064+0000 7f8d94925800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.064+0000 7f8d94925800 1 --2- 172.21.15.132:0/3139595159 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c4dc40cfe0 0x55c4dc40f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.064+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc40fbf0 con 0x55c4dc40cfe0 2024-05-08T18:50:51.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.064+0000 7f8d8feaf640 1 --2- 172.21.15.132:0/3139595159 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c4dc40cfe0 0x55c4dc40f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.065+0000 7f8d8feaf640 1 --2- 172.21.15.132:0/3139595159 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c4dc40cfe0 0x55c4dc40f4a0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.065+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.065+0000 7f8d94925800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:51.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.065+0000 7f8d94925800 20 realm 2024-05-08T18:50:51.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.065+0000 7f8d94925800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.065+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc40ffc0 con 0x55c4dc40cfe0 2024-05-08T18:50:51.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.065+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.065+0000 7f8d94925800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:51.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.065+0000 7f8d94925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:51.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.065+0000 7f8d94925800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.065+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc410890 con 0x55c4dc40cfe0 2024-05-08T18:50:51.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.065+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.065+0000 7f8d94925800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:51.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.065+0000 7f8d94925800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.065+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc410c30 con 0x55c4dc40cfe0 2024-05-08T18:50:51.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.065+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.065+0000 7f8d94925800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.065+0000 7f8d94925800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.066+0000 7f8d94925800 1 --2- 172.21.15.132:0/3139595159 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c4dc4116e0 0x55c4dc413af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.066+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc414250 con 0x55c4dc4116e0 2024-05-08T18:50:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.066+0000 7f8d90eb1640 1 --2- 172.21.15.132:0/3139595159 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c4dc4116e0 0x55c4dc413af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.066+0000 7f8d90eb1640 1 --2- 172.21.15.132:0/3139595159 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c4dc4116e0 0x55c4dc413af0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.066+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.066+0000 7f8d94925800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.066+0000 7f8d94925800 20 searching for the correct realm 2024-05-08T18:50:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.066+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x55c4dc4116e0 2024-05-08T18:50:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.067+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.067+0000 7f8d90eb1640 1 --2- 172.21.15.132:0/3139595159 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f8d88019040 0x7f8d8803b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.067+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x7f8d88019040 2024-05-08T18:50:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.067+0000 7f8d906b0640 1 --2- 172.21.15.132:0/3139595159 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f8d88019040 0x7f8d8803b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.067+0000 7f8d906b0640 1 --2- 172.21.15.132:0/3139595159 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f8d88019040 0x7f8d8803b220 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.067+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d8001b070 con 0x7f8d88019040 2024-05-08T18:50:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.067+0000 7f8d906b0640 1 --2- 172.21.15.132:0/3139595159 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f8d80027020 0x7f8d8002e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.067+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x7f8d80027020 2024-05-08T18:50:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.068+0000 7f8d8feaf640 1 --2- 172.21.15.132:0/3139595159 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f8d80027020 0x7f8d8002e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.068+0000 7f8d8feaf640 1 --2- 172.21.15.132:0/3139595159 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f8d80027020 0x7f8d8002e300 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.068+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.068+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x55c4dc40cfe0 2024-05-08T18:50:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.068+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.068+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x55c4dc40cfe0 2024-05-08T18:50:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.069+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.069+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x7f8d80027020 2024-05-08T18:50:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.069+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.069+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x7f8d80027020 2024-05-08T18:50:51.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.069+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.069+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x7f8d88019040 2024-05-08T18:50:51.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.069+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d8001b070 con 0x7f8d88019040 2024-05-08T18:50:51.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.069+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x55c4dc4116e0 2024-05-08T18:50:51.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.070+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.070+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x55c4dc40cfe0 2024-05-08T18:50:51.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.070+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.070+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x7f8d80027020 2024-05-08T18:50:51.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.070+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.070+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x55c4dc40cfe0 2024-05-08T18:50:51.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.070+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.070+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x7f8d88019040 2024-05-08T18:50:51.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.071+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8d8001b070 con 0x7f8d88019040 2024-05-08T18:50:51.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.071+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x55c4dc4116e0 2024-05-08T18:50:51.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.071+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.071+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x55c4dc4116e0 2024-05-08T18:50:51.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.071+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.071+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x7f8d80027020 2024-05-08T18:50:51.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.071+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.071+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x55c4dc4116e0 2024-05-08T18:50:51.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.072+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.072+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x55c4dc4116e0 2024-05-08T18:50:51.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.072+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.072+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x55c4dc40cfe0 2024-05-08T18:50:51.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.072+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.072+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x55c4dc40cfe0 2024-05-08T18:50:51.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.072+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.072+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x7f8d80027020 2024-05-08T18:50:51.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.072+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.072+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x55c4dc4116e0 2024-05-08T18:50:51.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.073+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.073+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x7f8d88019040 2024-05-08T18:50:51.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.073+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d8001b070 con 0x7f8d88019040 2024-05-08T18:50:51.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.073+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x55c4dc40cfe0 2024-05-08T18:50:51.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.073+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.073+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x7f8d80027020 2024-05-08T18:50:51.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.073+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.073+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x55c4dc4116e0 2024-05-08T18:50:51.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.074+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.074+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x7f8d80027020 2024-05-08T18:50:51.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.074+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.074+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x7f8d88019040 2024-05-08T18:50:51.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.074+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d8001b070 con 0x7f8d88019040 2024-05-08T18:50:51.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.074+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x55c4dc4116e0 2024-05-08T18:50:51.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.074+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.074+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x7f8d80027020 2024-05-08T18:50:51.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.075+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.075+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x55c4dc40cfe0 2024-05-08T18:50:51.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.075+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.075+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc415c30 con 0x7f8d88019040 2024-05-08T18:50:51.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.075+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d8001b070 con 0x7f8d88019040 2024-05-08T18:50:51.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.075+0000 7f8d94925800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:51.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.075+0000 7f8d94925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:51.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.075+0000 7f8d94925800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:51.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.075+0000 7f8d94925800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:51.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.075+0000 7f8d94925800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:51.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.075+0000 7f8d94925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:51.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.075+0000 7f8d94925800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.075+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc414d00 con 0x55c4dc40cfe0 2024-05-08T18:50:51.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.075+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.075+0000 7f8d94925800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:51.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.075+0000 7f8d94925800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.075+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc4155a0 con 0x55c4dc40cfe0 2024-05-08T18:50:51.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.076+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.076+0000 7f8d94925800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.076+0000 7f8d94925800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.076+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc414940 con 0x55c4dc40cfe0 2024-05-08T18:50:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.076+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.076+0000 7f8d94925800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.076+0000 7f8d94925800 20 zone default found 2024-05-08T18:50:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.076+0000 7f8d94925800 4 Realm: () 2024-05-08T18:50:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.076+0000 7f8d94925800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.076+0000 7f8d94925800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.076+0000 7f8d94925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.076+0000 7f8d94925800 20 zonegroup default 2024-05-08T18:50:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.076+0000 7f8d94925800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.076+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc4165b0 con 0x7f8d80027020 2024-05-08T18:50:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.076+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.076+0000 7f8d94925800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.076+0000 7f8d94925800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.076+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc417ff0 con 0x55c4dc4116e0 2024-05-08T18:50:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.077+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.077+0000 7f8d94925800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.077+0000 7f8d94925800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.077+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc4184e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.077+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.077+0000 7f8d94925800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.077+0000 7f8d94925800 20 started sync module instance, tier type = 2024-05-08T18:50:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.077+0000 7f8d94925800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.077+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc4173d0 con 0x7f8d88019040 2024-05-08T18:50:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.078+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d8001b070 con 0x7f8d88019040 2024-05-08T18:50:51.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.078+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94303997226784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc418940 con 0x7f8d88019040 2024-05-08T18:50:51.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.078+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc419190 con 0x55c4dc40cfe0 2024-05-08T18:50:51.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.079+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94303997226784] v25'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d8001b070 con 0x7f8d88019040 2024-05-08T18:50:51.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.079+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.079+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94303997234400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc4195b0 con 0x55c4dc40cfe0 2024-05-08T18:50:51.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.079+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc419e00 con 0x55c4dc4116e0 2024-05-08T18:50:51.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.080+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94303997234400] v25'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.080+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.080+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94303997235936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc419d10 con 0x55c4dc4116e0 2024-05-08T18:50:51.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.080+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41a890 con 0x7f8d88019040 2024-05-08T18:50:51.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.081+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94303997235936] v25'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.081+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d8001b070 con 0x7f8d88019040 2024-05-08T18:50:51.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.081+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94303997240160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x7f8d88019040 2024-05-08T18:50:51.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.081+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41b6f0 con 0x55c4dc40cfe0 2024-05-08T18:50:51.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.082+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94303997240160] v25'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d8001b070 con 0x7f8d88019040 2024-05-08T18:50:51.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.083+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.083+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94303997243840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41bae0 con 0x55c4dc40cfe0 2024-05-08T18:50:51.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.083+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41c510 con 0x7f8d80027020 2024-05-08T18:50:51.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.084+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94303997243840] v25'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.084+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.084+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94303997247520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41c510 con 0x7f8d80027020 2024-05-08T18:50:51.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.084+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41cf10 con 0x7f8d80027020 2024-05-08T18:50:51.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.085+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94303997247520] v25'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.085+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.085+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94303997237088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ced0 con 0x7f8d80027020 2024-05-08T18:50:51.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.085+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41d910 con 0x7f8d80027020 2024-05-08T18:50:51.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.086+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94303997237088] v25'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.086+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.086+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94303997252576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41daf0 con 0x7f8d80027020 2024-05-08T18:50:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.086+0000 7f8d94925800 20 add_watcher() i=0 2024-05-08T18:50:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.086+0000 7f8d94925800 20 add_watcher() i=1 2024-05-08T18:50:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.086+0000 7f8d94925800 20 add_watcher() i=2 2024-05-08T18:50:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.086+0000 7f8d94925800 20 add_watcher() i=3 2024-05-08T18:50:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.086+0000 7f8d94925800 20 add_watcher() i=4 2024-05-08T18:50:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.086+0000 7f8d94925800 20 add_watcher() i=5 2024-05-08T18:50:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.086+0000 7f8d94925800 20 add_watcher() i=6 2024-05-08T18:50:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.087+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94303997252576] v25'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.087+0000 7f8d94925800 20 add_watcher() i=7 2024-05-08T18:50:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.087+0000 7f8d94925800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.087+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc420ec0 con 0x55c4dc40cfe0 2024-05-08T18:50:51.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.087+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.087+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94303997254112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41e2b0 con 0x55c4dc40cfe0 2024-05-08T18:50:51.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.088+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94303997254112] v25'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.088+0000 7f8c467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:51.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.089+0000 7f8d94925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:51.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.089+0000 7f8d94925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:51.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.089+0000 7f8d94925800 5 note: GC not initialized 2024-05-08T18:50:51.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.089+0000 7f8c457e2640 20 reqs_thread_entry: start 2024-05-08T18:50:51.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.089+0000 7f8d94925800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:51.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.089+0000 7f8d94925800 20 Filter name: none 2024-05-08T18:50:51.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.089+0000 7f8bb6ffd640 20 reqs_thread_entry: start 2024-05-08T18:50:51.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.089+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc453810 con 0x7f8d80027020 2024-05-08T18:50:51.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.090+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(62 [pgnls start_epoch 25 out=254b] v25'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.090+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc414940 con 0x7f8d80027020 2024-05-08T18:50:51.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.091+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(63 [pgnls start_epoch 25 out=131b] v25'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.091+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc414940 con 0x55c4dc4116e0 2024-05-08T18:50:51.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.091+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(64 [pgnls start_epoch 25 out=295b] v25'24 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.091+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc417ff0 con 0x7f8d80027020 2024-05-08T18:50:51.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.091+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(65 [pgnls start_epoch 25 out=172b] v25'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.091+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc417ff0 con 0x55c4dc40cfe0 2024-05-08T18:50:51.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.092+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(66 [pgnls start_epoch 25 out=335b] v25'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.092+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc417ff0 con 0x7f8d88019040 2024-05-08T18:50:51.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.092+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(67 [pgnls start_epoch 25 out=213b] v25'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f8d8001b070 con 0x7f8d88019040 2024-05-08T18:50:51.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.092+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x55c4dc4116e0 2024-05-08T18:50:51.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.092+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(68 [pgnls start_epoch 25 out=254b] v25'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.092+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x55c4dc4116e0 2024-05-08T18:50:51.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.092+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(69 [pgnls start_epoch 25 out=295b] v25'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.092+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x55c4dc4116e0 2024-05-08T18:50:51.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.093+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(70 [pgnls start_epoch 25 out=213b] v25'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.093+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x7f8d88019040 2024-05-08T18:50:51.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.093+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(71 [pgnls start_epoch 25 out=172b] v25'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8d8001b070 con 0x7f8d88019040 2024-05-08T18:50:51.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.093+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x7f8d88019040 2024-05-08T18:50:51.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.093+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(72 [pgnls start_epoch 25 out=336b] v25'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7f8d8001b070 con 0x7f8d88019040 2024-05-08T18:50:51.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.093+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x55c4dc4116e0 2024-05-08T18:50:51.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.094+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(73 [pgnls start_epoch 25 out=131b] v25'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.094+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x55c4dc4116e0 2024-05-08T18:50:51.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.094+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(74 [pgnls start_epoch 25 out=254b] v25'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.094+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x55c4dc4116e0 2024-05-08T18:50:51.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.094+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(75 [pgnls start_epoch 25 out=90b] v25'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.094+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x55c4dc40cfe0 2024-05-08T18:50:51.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.094+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(76 [pgnls start_epoch 25 out=213b] v25'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.094+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x55c4dc4116e0 2024-05-08T18:50:51.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.095+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(77 [pgnls start_epoch 25 out=254b] v25'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.095+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x55c4dc40cfe0 2024-05-08T18:50:51.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.095+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(78 [pgnls start_epoch 25 out=254b] v25'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.095+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x55c4dc4116e0 2024-05-08T18:50:51.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.095+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(79 [pgnls start_epoch 25 out=213b] v25'20 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.095+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x55c4dc4116e0 2024-05-08T18:50:51.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.095+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(80 [pgnls start_epoch 25 out=172b] v25'29 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.095+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x55c4dc40cfe0 2024-05-08T18:50:51.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.096+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(81 [pgnls start_epoch 25 out=295b] v25'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.096+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x7f8d88019040 2024-05-08T18:50:51.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.096+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(82 [pgnls start_epoch 25 out=276b] v25'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7f8d8001b070 con 0x7f8d88019040 2024-05-08T18:50:51.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.096+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x7f8d88019040 2024-05-08T18:50:51.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.096+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(83 [pgnls start_epoch 25 out=172b] v25'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8d8001b070 con 0x7f8d88019040 2024-05-08T18:50:51.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.096+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x55c4dc40cfe0 2024-05-08T18:50:51.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.097+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(84 [pgnls start_epoch 25 out=295b] v25'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.097+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x7f8d80027020 2024-05-08T18:50:51.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.097+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(85 [pgnls start_epoch 25 out=172b] v25'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.097+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x7f8d88019040 2024-05-08T18:50:51.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.097+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(86 [pgnls start_epoch 25 out=213b] v25'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f8d8001b070 con 0x7f8d88019040 2024-05-08T18:50:51.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.098+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x7f8d80027020 2024-05-08T18:50:51.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.098+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(87 [pgnls start_epoch 25 out=172b] v25'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.098+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x55c4dc4116e0 2024-05-08T18:50:51.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.098+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(88 [pgnls start_epoch 25 out=172b] v25'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.098+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x55c4dc4116e0 2024-05-08T18:50:51.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.098+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(89 [pgnls start_epoch 25 out=90b] v25'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.098+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x55c4dc4116e0 2024-05-08T18:50:51.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.099+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== osd_op_reply(90 [pgnls start_epoch 25 out=90b] v25'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.099+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x55c4dc40cfe0 2024-05-08T18:50:51.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.099+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(91 [pgnls start_epoch 25 out=131b] v25'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.099+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x7f8d88019040 2024-05-08T18:50:51.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.099+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(92 [pgnls start_epoch 25 out=295b] v25'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f8d8001b070 con 0x7f8d88019040 2024-05-08T18:50:51.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.099+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41ac80 con 0x7f8d80027020 2024-05-08T18:50:51.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.100+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(93 [pgnls start_epoch 25 out=213b] v25'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.110 INFO:teuthology.orchestra.run.smithi132.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-05-08T18:50:51.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.101+0000 7f8c467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.101+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94303997254112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc451d00 con 0x55c4dc40cfe0 2024-05-08T18:50:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.102+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94303997254112] v25'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.102+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94303997226784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc451d00 con 0x7f8d88019040 2024-05-08T18:50:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.103+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94303997226784] v25'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d8001b070 con 0x7f8d88019040 2024-05-08T18:50:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.103+0000 7f8d94925800 20 remove_watcher() i=0 2024-05-08T18:50:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.103+0000 7f8d94925800 2 removed watcher, disabling cache 2024-05-08T18:50:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.103+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94303997234400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc417f90 con 0x55c4dc40cfe0 2024-05-08T18:50:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.105+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94303997234400] v25'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.105+0000 7f8d94925800 20 remove_watcher() i=1 2024-05-08T18:50:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.105+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94303997235936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc417f90 con 0x55c4dc4116e0 2024-05-08T18:50:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.106+0000 7f8d90eb1640 1 -- 172.21.15.132:0/3139595159 <== osd.3 v2:172.21.15.132:6816/17827703 28 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94303997235936] v25'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d880083e0 con 0x55c4dc4116e0 2024-05-08T18:50:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.106+0000 7f8d94925800 20 remove_watcher() i=2 2024-05-08T18:50:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.106+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94303997240160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc418ce0 con 0x7f8d88019040 2024-05-08T18:50:51.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.107+0000 7f8d906b0640 1 -- 172.21.15.132:0/3139595159 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94303997240160] v25'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d8001b070 con 0x7f8d88019040 2024-05-08T18:50:51.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.107+0000 7f8d94925800 20 remove_watcher() i=3 2024-05-08T18:50:51.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.107+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94303997243840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc4192e0 con 0x55c4dc40cfe0 2024-05-08T18:50:51.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.108+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94303997243840] v25'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d8405a040 con 0x55c4dc40cfe0 2024-05-08T18:50:51.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.108+0000 7f8d94925800 20 remove_watcher() i=4 2024-05-08T18:50:51.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.108+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94303997247520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc41a360 con 0x7f8d80027020 2024-05-08T18:50:51.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.109+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94303997247520] v25'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.109+0000 7f8d94925800 20 remove_watcher() i=5 2024-05-08T18:50:51.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.109+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94303997237088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc418ce0 con 0x7f8d80027020 2024-05-08T18:50:51.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.110+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94303997237088] v25'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.110+0000 7f8d94925800 20 remove_watcher() i=6 2024-05-08T18:50:51.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.110+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94303997252576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c4dc4192e0 con 0x7f8d80027020 2024-05-08T18:50:51.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94303997252576] v25'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d8405a040 con 0x7f8d80027020 2024-05-08T18:50:51.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d94925800 20 remove_watcher() i=7 2024-05-08T18:50:51.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f8d80027020 msgr2=0x7f8d8002e300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d94925800 1 --2- 172.21.15.132:0/3139595159 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f8d80027020 0x7f8d8002e300 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c4dc40cfe0 msgr2=0x55c4dc40f4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d94925800 1 --2- 172.21.15.132:0/3139595159 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c4dc40cfe0 0x55c4dc40f4a0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f8d88019040 msgr2=0x7f8d8803b220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d94925800 1 --2- 172.21.15.132:0/3139595159 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f8d88019040 0x7f8d8803b220 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c4dc4116e0 msgr2=0x55c4dc413af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d94925800 1 --2- 172.21.15.132:0/3139595159 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c4dc4116e0 0x55c4dc413af0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c5803bb00 msgr2=0x7f8c5803dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d94925800 1 --2- 172.21.15.132:0/3139595159 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c5803bb00 0x7f8c5803dfc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8d80002080 tx=0x7f8d80046000 comp rx=0 tx=0).stop 2024-05-08T18:50:51.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc3f5b20 msgr2=0x55c4dc401590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d94925800 1 --2- 172.21.15.132:0/3139595159 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc3f5b20 0x55c4dc401590 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8d88014a60 tx=0x7f8d88052b10 comp rx=0 tx=0).stop 2024-05-08T18:50:51.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 reap_dead start 2024-05-08T18:50:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d8feaf640 1 -- 172.21.15.132:0/3139595159 reap_dead start 2024-05-08T18:50:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 shutdown_connections 2024-05-08T18:50:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 >> 172.21.15.132:0/3139595159 conn(0x55c4dc3f1e80 msgr2=0x55c4dc3ef4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 shutdown_connections 2024-05-08T18:50:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d94925800 1 -- 172.21.15.132:0/3139595159 wait complete. 2024-05-08T18:50:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d94925800 1 -- 172.21.15.132:0/2351825612 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c6803bba0 msgr2=0x7f8c6803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d94925800 1 --2- 172.21.15.132:0/2351825612 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c6803bba0 0x7f8c6803e060 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55c4dc3d4f70 tx=0x7f8d80051000 comp rx=0 tx=0).stop 2024-05-08T18:50:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.111+0000 7f8d94925800 1 -- 172.21.15.132:0/2351825612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc3e8860 msgr2=0x55c4dc3e8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 --2- 172.21.15.132:0/2351825612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc3e8860 0x55c4dc3e8c80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x55c4dc3ce180 tx=0x7f8d8800aea0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 -- 172.21.15.132:0/2351825612 shutdown_connections 2024-05-08T18:50:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 --2- 172.21.15.132:0/2351825612 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c6803bba0 0x7f8c6803e060 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 --2- 172.21.15.132:0/2351825612 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc3e8860 0x55c4dc3e8c80 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 -- 172.21.15.132:0/2351825612 >> 172.21.15.132:0/2351825612 conn(0x55c4dc3dc900 msgr2=0x55c4dc3dcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:51.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 -- 172.21.15.132:0/2351825612 shutdown_connections 2024-05-08T18:50:51.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 -- 172.21.15.132:0/2351825612 wait complete. 2024-05-08T18:50:51.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 -- 172.21.15.132:0/2346736855 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c4dc247e10 msgr2=0x55c4dc3d44f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 --2- 172.21.15.132:0/2346736855 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c4dc247e10 0x55c4dc3d44f0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 -- 172.21.15.132:0/2346736855 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c4dc3d6e00 msgr2=0x55c4dc3d91f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 --2- 172.21.15.132:0/2346736855 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c4dc3d6e00 0x55c4dc3d91f0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 -- 172.21.15.132:0/2346736855 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c7803bba0 msgr2=0x7f8c7803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 --2- 172.21.15.132:0/2346736855 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c7803bba0 0x7f8c7803e060 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8d84054000 tx=0x7f8d8404e000 comp rx=0 tx=0).stop 2024-05-08T18:50:51.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 -- 172.21.15.132:0/2346736855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc246a80 msgr2=0x55c4dc3cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 --2- 172.21.15.132:0/2346736855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc246a80 0x55c4dc3cd2b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8d800065f0 tx=0x7f8d80000f40 comp rx=0 tx=0).stop 2024-05-08T18:50:51.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 -- 172.21.15.132:0/2346736855 shutdown_connections 2024-05-08T18:50:51.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 --2- 172.21.15.132:0/2346736855 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c4dc3d6e00 0x55c4dc3d91f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 --2- 172.21.15.132:0/2346736855 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c4dc247e10 0x55c4dc3d44f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 --2- 172.21.15.132:0/2346736855 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8c7803bba0 0x7f8c7803e060 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 --2- 172.21.15.132:0/2346736855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c4dc246a80 0x55c4dc3cd2b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 -- 172.21.15.132:0/2346736855 >> 172.21.15.132:0/2346736855 conn(0x55c4dc2cd820 msgr2=0x55c4dc3bf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:51.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 -- 172.21.15.132:0/2346736855 shutdown_connections 2024-05-08T18:50:51.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.112+0000 7f8d94925800 1 -- 172.21.15.132:0/2346736855 wait complete. 2024-05-08T18:50:51.122 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-05-08T18:50:51.122 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-05-08T18:50:51.122 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-05-08T18:50:51.122 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-05-08T18:50:51.206 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:51.206 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:51.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.207+0000 7fa4e57dc800 1 Processor -- start 2024-05-08T18:50:51.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.207+0000 7fa4e57dc800 1 -- start start 2024-05-08T18:50:51.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.207+0000 7fa4e57dc800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55e384574140 0x55e384574560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.207+0000 7fa4e57dc800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e384574be0 con 0x55e3845753a0 2024-05-08T18:50:51.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.207+0000 7fa4e57dc800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55e384415e20 con 0x55e384574140 2024-05-08T18:50:51.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.208+0000 7fa4e32db640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55e384574140 0x55e384574560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.208+0000 7fa4e32db640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55e384574140 0x55e384574560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40450/0 (socket says 172.21.15.132:40450) 2024-05-08T18:50:51.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.208+0000 7fa4e32db640 1 -- 172.21.15.132:0/692897614 learned_addr learned my addr 172.21.15.132:0/692897614 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:51.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.208+0000 7fa4daada640 1 --1- 172.21.15.132:0/692897614 >> v1:172.21.15.42:6789/0 conn(0x55e3845753a0 0x55e384575820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:43634/0 (socket says 172.21.15.132:43634) 2024-05-08T18:50:51.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.208+0000 7fa4e32db640 1 -- 172.21.15.132:0/692897614 >> v1:172.21.15.42:6789/0 conn(0x55e3845753a0 legacy=0x55e384575820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.208+0000 7fa4e32db640 1 -- 172.21.15.132:0/692897614 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e384575f60 con 0x55e384574140 2024-05-08T18:50:51.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.208+0000 7fa4e2ada640 1 -- 172.21.15.132:0/692897614 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3113774317 0 0) 0x55e384574be0 con 0x55e3845753a0 2024-05-08T18:50:51.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.210+0000 7fa4e32db640 1 --2- 172.21.15.132:0/692897614 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384574140 0x55e384574560 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400a520 tx=0x7fa4d401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34431d4c73655685 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.210+0000 7fa4e2ada640 1 -- 172.21.15.132:0/692897614 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4d4057070 con 0x55e384574140 2024-05-08T18:50:51.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.210+0000 7fa4e2ada640 1 -- 172.21.15.132:0/692897614 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d4052570 con 0x55e384574140 2024-05-08T18:50:51.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.210+0000 7fa4e2ada640 1 -- 172.21.15.132:0/692897614 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4d4052870 con 0x55e384574140 2024-05-08T18:50:51.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.211+0000 7fa4e57dc800 1 -- 172.21.15.132:0/692897614 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384574140 msgr2=0x55e384574560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.211+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/692897614 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384574140 0x55e384574560 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400a520 tx=0x7fa4d401d010 comp rx=0 tx=0).stop 2024-05-08T18:50:51.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.211+0000 7fa4e57dc800 1 -- 172.21.15.132:0/692897614 shutdown_connections 2024-05-08T18:50:51.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.211+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/692897614 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384574140 0x55e384574560 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.211+0000 7fa4e57dc800 1 -- 172.21.15.132:0/692897614 >> 172.21.15.132:0/692897614 conn(0x55e38456f720 msgr2=0x55e384571b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:51.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.211+0000 7fa4e57dc800 1 -- 172.21.15.132:0/692897614 shutdown_connections 2024-05-08T18:50:51.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.211+0000 7fa4e57dc800 1 -- 172.21.15.132:0/692897614 wait complete. 2024-05-08T18:50:51.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.224+0000 7fa4e57dc800 1 Processor -- start 2024-05-08T18:50:51.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.224+0000 7fa4e57dc800 1 -- start start 2024-05-08T18:50:51.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.224+0000 7fa4e57dc800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384574140 0x55e384664480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.224+0000 7fa4e57dc800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e3844c05b0 con 0x55e384574140 2024-05-08T18:50:51.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.224+0000 7fa4e32db640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384574140 0x55e384664480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.225+0000 7fa4e32db640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384574140 0x55e384664480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40462/0 (socket says 172.21.15.132:40462) 2024-05-08T18:50:51.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.225+0000 7fa4e32db640 1 -- 172.21.15.132:0/159325829 learned_addr learned my addr 172.21.15.132:0/159325829 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:51.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.225+0000 7fa4e32db640 1 -- 172.21.15.132:0/159325829 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e384664a50 con 0x55e384574140 2024-05-08T18:50:51.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.225+0000 7fa4e32db640 1 --2- 172.21.15.132:0/159325829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384574140 0x55e384664480 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4055040 tx=0x7fa4d404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a55e6b2f1fc7b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.225+0000 7fa3d160a640 1 -- 172.21.15.132:0/159325829 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4d4057040 con 0x55e384574140 2024-05-08T18:50:51.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.225+0000 7fa3d160a640 1 -- 172.21.15.132:0/159325829 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d4052850 con 0x55e384574140 2024-05-08T18:50:51.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.225+0000 7fa3d160a640 1 -- 172.21.15.132:0/159325829 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4d4052b50 con 0x55e384574140 2024-05-08T18:50:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.226+0000 7fa4e57dc800 1 -- 172.21.15.132:0/159325829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384574140 msgr2=0x55e384664480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.226+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/159325829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384574140 0x55e384664480 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4055040 tx=0x7fa4d404c000 comp rx=0 tx=0).stop 2024-05-08T18:50:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.226+0000 7fa4e57dc800 1 -- 172.21.15.132:0/159325829 shutdown_connections 2024-05-08T18:50:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.226+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/159325829 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384574140 0x55e384664480 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.226+0000 7fa4e57dc800 1 -- 172.21.15.132:0/159325829 >> 172.21.15.132:0/159325829 conn(0x55e38456f720 msgr2=0x55e38465fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.226+0000 7fa4e57dc800 1 -- 172.21.15.132:0/159325829 shutdown_connections 2024-05-08T18:50:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.226+0000 7fa4e57dc800 1 -- 172.21.15.132:0/159325829 wait complete. 2024-05-08T18:50:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.226+0000 7fa4e57dc800 1 Processor -- start 2024-05-08T18:50:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.226+0000 7fa4e57dc800 1 -- start start 2024-05-08T18:50:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.226+0000 7fa4e57dc800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384574140 0x55e38466bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.226+0000 7fa4e57dc800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e3844e79f0 con 0x55e384574140 2024-05-08T18:50:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.227+0000 7fa4e32db640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384574140 0x55e38466bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.227+0000 7fa4e32db640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384574140 0x55e38466bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40474/0 (socket says 172.21.15.132:40474) 2024-05-08T18:50:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.227+0000 7fa4e32db640 1 -- 172.21.15.132:0/3864359349 learned_addr learned my addr 172.21.15.132:0/3864359349 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.227+0000 7fa4e32db640 1 -- 172.21.15.132:0/3864359349 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e38466c410 con 0x55e384574140 2024-05-08T18:50:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.227+0000 7fa4e32db640 1 --2- 172.21.15.132:0/3864359349 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384574140 0x55e38466bed0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4052540 tx=0x7fa4d4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.227+0000 7fa3cfe07640 1 -- 172.21.15.132:0/3864359349 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4d4073070 con 0x55e384574140 2024-05-08T18:50:51.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.227+0000 7fa3cfe07640 1 -- 172.21.15.132:0/3864359349 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d405d570 con 0x55e384574140 2024-05-08T18:50:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.227+0000 7fa4e57dc800 1 -- 172.21.15.132:0/3864359349 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e38466c6a0 con 0x55e384574140 2024-05-08T18:50:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.227+0000 7fa3cfe07640 1 -- 172.21.15.132:0/3864359349 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4d4057070 con 0x55e384574140 2024-05-08T18:50:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.228+0000 7fa4e57dc800 1 -- 172.21.15.132:0/3864359349 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e38466f350 con 0x55e384574140 2024-05-08T18:50:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.228+0000 7fa3cfe07640 1 -- 172.21.15.132:0/3864359349 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa4d4076070 con 0x55e384574140 2024-05-08T18:50:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.228+0000 7fa3cfe07640 1 --2- 172.21.15.132:0/3864359349 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3c803bba0 0x7fa3c803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.229+0000 7fa3cfe07640 1 -- 172.21.15.132:0/3864359349 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fa4d4093f30 con 0x55e384574140 2024-05-08T18:50:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.229+0000 7fa4daada640 1 --2- 172.21.15.132:0/3864359349 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3c803bba0 0x7fa3c803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.229+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/3864359349 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e3845753a0 0x55e384673110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.229+0000 7fa4e57dc800 1 -- 172.21.15.132:0/3864359349 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e384673650 con 0x55e3845753a0 2024-05-08T18:50:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.229+0000 7fa4e3adc640 1 --2- 172.21.15.132:0/3864359349 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e3845753a0 0x55e384673110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.229+0000 7fa4daada640 1 --2- 172.21.15.132:0/3864359349 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3c803bba0 0x7fa3c803e060 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc000c00 tx=0x7fa4cc0013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.229+0000 7fa4e3adc640 1 --2- 172.21.15.132:0/3864359349 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e3845753a0 0x55e384673110 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.229+0000 7fa4e3adc640 1 -- 172.21.15.132:0/3864359349 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4dc00a4a0 con 0x55e3845753a0 2024-05-08T18:50:51.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.229+0000 7fa4e57dc800 1 -- 172.21.15.132:0/3864359349 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e3846706a0 con 0x55e3845753a0 2024-05-08T18:50:51.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.230+0000 7fa4e3adc640 1 -- 172.21.15.132:0/3864359349 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa4dc00a4a0 con 0x55e3845753a0 2024-05-08T18:50:51.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.230+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/3864359349 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e384675940 0x55e384677d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.230+0000 7fa4e57dc800 1 -- 172.21.15.132:0/3864359349 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e384678400 con 0x55e384675940 2024-05-08T18:50:51.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.230+0000 7fa4e32db640 1 --2- 172.21.15.132:0/3864359349 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e384675940 0x55e384677d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.230+0000 7fa4e32db640 1 --2- 172.21.15.132:0/3864359349 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e384675940 0x55e384677d30 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.230+0000 7fa4e32db640 1 -- 172.21.15.132:0/3864359349 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa4d4075030 con 0x55e384675940 2024-05-08T18:50:51.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.230+0000 7fa4e57dc800 1 -- 172.21.15.132:0/3864359349 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e3846747e0 con 0x55e3845753a0 2024-05-08T18:50:51.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.231+0000 7fa4e3adc640 1 -- 172.21.15.132:0/3864359349 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa4dc00a4a0 con 0x55e3845753a0 2024-05-08T18:50:51.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.231+0000 7fa4e57dc800 1 -- 172.21.15.132:0/3864359349 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e384674cc0 con 0x55e3845753a0 2024-05-08T18:50:51.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.231+0000 7fa4e3adc640 1 -- 172.21.15.132:0/3864359349 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa4dc00a4a0 con 0x55e3845753a0 2024-05-08T18:50:51.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.231+0000 7fa4e57dc800 1 Processor -- start 2024-05-08T18:50:51.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.231+0000 7fa4e57dc800 1 -- start start 2024-05-08T18:50:51.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.231+0000 7fa4e57dc800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384687340 0x55e384687760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.231+0000 7fa4e57dc800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e384466fc0 con 0x55e384687340 2024-05-08T18:50:51.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.232+0000 7fa4e3adc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384687340 0x55e384687760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.232+0000 7fa4e3adc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384687340 0x55e384687760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40490/0 (socket says 172.21.15.132:40490) 2024-05-08T18:50:51.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.232+0000 7fa4e3adc640 1 -- 172.21.15.132:0/2158753725 learned_addr learned my addr 172.21.15.132:0/2158753725 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:51.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.232+0000 7fa4e3adc640 1 -- 172.21.15.132:0/2158753725 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e384687ca0 con 0x55e384687340 2024-05-08T18:50:51.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.232+0000 7fa4e3adc640 1 --2- 172.21.15.132:0/2158753725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384687340 0x55e384687760 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x55e38466cf60 tx=0x7fa4dc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.233+0000 7fa3cd602640 1 -- 172.21.15.132:0/2158753725 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4dc014450 con 0x55e384687340 2024-05-08T18:50:51.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.233+0000 7fa3cd602640 1 -- 172.21.15.132:0/2158753725 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4dc014610 con 0x55e384687340 2024-05-08T18:50:51.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.233+0000 7fa4e57dc800 1 -- 172.21.15.132:0/2158753725 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e384688710 con 0x55e384687340 2024-05-08T18:50:51.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.233+0000 7fa3cd602640 1 -- 172.21.15.132:0/2158753725 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4dc014930 con 0x55e384687340 2024-05-08T18:50:51.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.233+0000 7fa4e57dc800 1 -- 172.21.15.132:0/2158753725 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e384688c10 con 0x55e384687340 2024-05-08T18:50:51.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.233+0000 7fa3cd602640 1 -- 172.21.15.132:0/2158753725 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa4dc011040 con 0x55e384687340 2024-05-08T18:50:51.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.234+0000 7fa3cd602640 1 --2- 172.21.15.132:0/2158753725 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3bc03bb50 0x7fa3bc03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.234+0000 7fa3cd602640 1 -- 172.21.15.132:0/2158753725 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fa4dc01e070 con 0x55e384687340 2024-05-08T18:50:51.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.234+0000 7fa4e32db640 1 --2- 172.21.15.132:0/2158753725 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3bc03bb50 0x7fa3bc03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.234+0000 7fa4e57dc800 1 Processor -- start 2024-05-08T18:50:51.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.234+0000 7fa4e57dc800 1 -- start start 2024-05-08T18:50:51.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.234+0000 7fa4e32db640 1 --2- 172.21.15.132:0/2158753725 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3bc03bb50 0x7fa3bc03e010 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55e384673a70 tx=0x7fa4d4006f10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.234+0000 7fa4e57dc800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384694690 0x55e384694ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.234+0000 7fa4e57dc800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e384664d10 con 0x55e384694690 2024-05-08T18:50:51.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.235+0000 7fa4e3adc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384694690 0x55e384694ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.235+0000 7fa4e3adc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384694690 0x55e384694ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40504/0 (socket says 172.21.15.132:40504) 2024-05-08T18:50:51.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.235+0000 7fa4e3adc640 1 -- 172.21.15.132:0/3402201068 learned_addr learned my addr 172.21.15.132:0/3402201068 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:51.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.235+0000 7fa4e3adc640 1 -- 172.21.15.132:0/3402201068 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e384695080 con 0x55e384694690 2024-05-08T18:50:51.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.235+0000 7fa4e3adc640 1 --2- 172.21.15.132:0/3402201068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384694690 0x55e384694ab0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc052dc0 tx=0x7fa4dc0118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee8521dd1308bcf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.235+0000 7fa3c6ffd640 1 -- 172.21.15.132:0/3402201068 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4dc011c00 con 0x55e384694690 2024-05-08T18:50:51.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.235+0000 7fa3c6ffd640 1 -- 172.21.15.132:0/3402201068 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4dc050070 con 0x55e384694690 2024-05-08T18:50:51.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.235+0000 7fa3c6ffd640 1 -- 172.21.15.132:0/3402201068 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4dc014ad0 con 0x55e384694690 2024-05-08T18:50:51.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.236+0000 7fa4e57dc800 1 -- 172.21.15.132:0/3402201068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384694690 msgr2=0x55e384694ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.236+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/3402201068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384694690 0x55e384694ab0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc052dc0 tx=0x7fa4dc0118e0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.236+0000 7fa4e57dc800 1 -- 172.21.15.132:0/3402201068 shutdown_connections 2024-05-08T18:50:51.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.236+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/3402201068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384694690 0x55e384694ab0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.236+0000 7fa4e57dc800 1 -- 172.21.15.132:0/3402201068 >> 172.21.15.132:0/3402201068 conn(0x55e3846909a0 msgr2=0x55e38468ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:51.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.236+0000 7fa4e57dc800 1 -- 172.21.15.132:0/3402201068 shutdown_connections 2024-05-08T18:50:51.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.236+0000 7fa4e57dc800 1 -- 172.21.15.132:0/3402201068 wait complete. 2024-05-08T18:50:51.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.236+0000 7fa4e57dc800 1 Processor -- start 2024-05-08T18:50:51.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.236+0000 7fa4e57dc800 1 -- start start 2024-05-08T18:50:51.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.236+0000 7fa4e57dc800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384694690 0x55e3846a0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.236+0000 7fa4e57dc800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e3846957d0 con 0x55e384694690 2024-05-08T18:50:51.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.236+0000 7fa4e3adc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384694690 0x55e3846a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.236+0000 7fa4e3adc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384694690 0x55e3846a0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40518/0 (socket says 172.21.15.132:40518) 2024-05-08T18:50:51.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.236+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 learned_addr learned my addr 172.21.15.132:0/1767176260 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:51.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.237+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3846a05c0 con 0x55e384694690 2024-05-08T18:50:51.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.237+0000 7fa4e3adc640 1 --2- 172.21.15.132:0/1767176260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384694690 0x55e3846a0080 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc052d20 tx=0x7fa4dc052d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.237+0000 7fa3c57fa640 1 -- 172.21.15.132:0/1767176260 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4dc031070 con 0x55e384694690 2024-05-08T18:50:51.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.237+0000 7fa3c57fa640 1 -- 172.21.15.132:0/1767176260 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4dc0545b0 con 0x55e384694690 2024-05-08T18:50:51.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.237+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e3846a0850 con 0x55e384694690 2024-05-08T18:50:51.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.237+0000 7fa3c57fa640 1 -- 172.21.15.132:0/1767176260 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4dc0409d0 con 0x55e384694690 2024-05-08T18:50:51.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.237+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3846a3500 con 0x55e384694690 2024-05-08T18:50:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.238+0000 7fa3c57fa640 1 -- 172.21.15.132:0/1767176260 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa4dc034070 con 0x55e384694690 2024-05-08T18:50:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.238+0000 7fa3c57fa640 1 --2- 172.21.15.132:0/1767176260 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3ac03bb50 0x7fa3ac03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.238+0000 7fa3c57fa640 1 -- 172.21.15.132:0/1767176260 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fa4dc00e040 con 0x55e384694690 2024-05-08T18:50:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.238+0000 7fa4e32db640 1 --2- 172.21.15.132:0/1767176260 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3ac03bb50 0x7fa3ac03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.238+0000 7fa4e32db640 1 --2- 172.21.15.132:0/1767176260 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3ac03bb50 0x7fa3ac03e010 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4066fd0 tx=0x7fa4d407f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.238+0000 7fa4e57dc800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.238+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/1767176260 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e3846abd10 0x55e3846ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.238+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e3846ae920 con 0x55e3846abd10 2024-05-08T18:50:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.239+0000 7fa4daada640 1 --2- 172.21.15.132:0/1767176260 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e3846abd10 0x55e3846ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.239+0000 7fa4daada640 1 --2- 172.21.15.132:0/1767176260 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e3846abd10 0x55e3846ae1d0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.239+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.239+0000 7fa4e57dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:51.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.239+0000 7fa4e57dc800 20 realm 2024-05-08T18:50:51.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.239+0000 7fa4e57dc800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.239+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e3846ab160 con 0x55e3846abd10 2024-05-08T18:50:51.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.239+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.239+0000 7fa4e57dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:51.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.239+0000 7fa4e57dc800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:51.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.239+0000 7fa4e57dc800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.239+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e3846af410 con 0x55e3846abd10 2024-05-08T18:50:51.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.239+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.239+0000 7fa4e57dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:51.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.239+0000 7fa4e57dc800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.239+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e3846afce0 con 0x55e3846abd10 2024-05-08T18:50:51.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.240+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.240+0000 7fa4e57dc800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:51.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.240+0000 7fa4e57dc800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.240+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/1767176260 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e3846b0700 0x55e3846b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.240+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b3230 con 0x55e3846b0700 2024-05-08T18:50:51.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.240+0000 7fa4e3adc640 1 --2- 172.21.15.132:0/1767176260 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e3846b0700 0x55e3846b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.240+0000 7fa4e3adc640 1 --2- 172.21.15.132:0/1767176260 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e3846b0700 0x55e3846b2af0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.240+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa4dc03d070 con 0x55e3846b0700 2024-05-08T18:50:51.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.240+0000 7fa4e57dc800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:51.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.240+0000 7fa4e57dc800 20 searching for the correct realm 2024-05-08T18:50:51.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.240+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x55e3846b0700 2024-05-08T18:50:51.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.241+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4dc03d070 con 0x55e3846b0700 2024-05-08T18:50:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.241+0000 7fa4e3adc640 1 --2- 172.21.15.132:0/1767176260 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa4dc036070 0x7fa4dc0549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.241+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x7fa4dc036070 2024-05-08T18:50:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.241+0000 7fa4e32db640 1 --2- 172.21.15.132:0/1767176260 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa4dc036070 0x7fa4dc0549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.241+0000 7fa4e32db640 1 --2- 172.21.15.132:0/1767176260 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa4dc036070 0x7fa4dc0549c0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.242+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d4075030 con 0x7fa4dc036070 2024-05-08T18:50:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.242+0000 7fa4e32db640 1 --2- 172.21.15.132:0/1767176260 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa4d4078060 0x7fa4d408b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.242+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x7fa4d4078060 2024-05-08T18:50:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.242+0000 7fa4daada640 1 --2- 172.21.15.132:0/1767176260 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa4d4078060 0x7fa4d408b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.242+0000 7fa4daada640 1 --2- 172.21.15.132:0/1767176260 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa4d4078060 0x7fa4d408b3e0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.242+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4cc018410 con 0x7fa4d4078060 2024-05-08T18:50:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.242+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x55e3846abd10 2024-05-08T18:50:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.243+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.243+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x55e3846abd10 2024-05-08T18:50:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.243+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.243+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x7fa4d4078060 2024-05-08T18:50:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.243+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4cc018410 con 0x7fa4d4078060 2024-05-08T18:50:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.243+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x7fa4d4078060 2024-05-08T18:50:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.243+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4cc018410 con 0x7fa4d4078060 2024-05-08T18:50:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.243+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x7fa4dc036070 2024-05-08T18:50:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.244+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d4075030 con 0x7fa4dc036070 2024-05-08T18:50:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.244+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x55e3846b0700 2024-05-08T18:50:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.244+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4dc03d070 con 0x55e3846b0700 2024-05-08T18:50:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.244+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x55e3846abd10 2024-05-08T18:50:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.244+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.244+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x7fa4d4078060 2024-05-08T18:50:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.244+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4cc018410 con 0x7fa4d4078060 2024-05-08T18:50:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.244+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x55e3846abd10 2024-05-08T18:50:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.244+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.245+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x7fa4dc036070 2024-05-08T18:50:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.245+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa4d4075030 con 0x7fa4dc036070 2024-05-08T18:50:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.245+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x55e3846b0700 2024-05-08T18:50:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.245+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa4dc03d070 con 0x55e3846b0700 2024-05-08T18:50:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.245+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x55e3846b0700 2024-05-08T18:50:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.245+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4dc03d070 con 0x55e3846b0700 2024-05-08T18:50:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.245+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x7fa4d4078060 2024-05-08T18:50:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.245+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4cc018410 con 0x7fa4d4078060 2024-05-08T18:50:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.246+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x55e3846b0700 2024-05-08T18:50:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.246+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4dc03d070 con 0x55e3846b0700 2024-05-08T18:50:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.246+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x55e3846b0700 2024-05-08T18:50:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.246+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4dc03d070 con 0x55e3846b0700 2024-05-08T18:50:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.246+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x55e3846abd10 2024-05-08T18:50:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.246+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.246+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x55e3846abd10 2024-05-08T18:50:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.246+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.246+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x7fa4d4078060 2024-05-08T18:50:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.247+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4cc018410 con 0x7fa4d4078060 2024-05-08T18:50:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.247+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x55e3846b0700 2024-05-08T18:50:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.247+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4dc03d070 con 0x55e3846b0700 2024-05-08T18:50:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.247+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x7fa4dc036070 2024-05-08T18:50:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.247+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d4075030 con 0x7fa4dc036070 2024-05-08T18:50:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.247+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x55e3846abd10 2024-05-08T18:50:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.247+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.247+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x7fa4d4078060 2024-05-08T18:50:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.248+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4cc018410 con 0x7fa4d4078060 2024-05-08T18:50:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.248+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x55e3846b0700 2024-05-08T18:50:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.248+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4dc03d070 con 0x55e3846b0700 2024-05-08T18:50:51.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.248+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x7fa4d4078060 2024-05-08T18:50:51.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.249+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4cc018410 con 0x7fa4d4078060 2024-05-08T18:50:51.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.249+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x7fa4dc036070 2024-05-08T18:50:51.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.249+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d4075030 con 0x7fa4dc036070 2024-05-08T18:50:51.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.249+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x55e3846b0700 2024-05-08T18:50:51.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.249+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4dc03d070 con 0x55e3846b0700 2024-05-08T18:50:51.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.249+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x7fa4d4078060 2024-05-08T18:50:51.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.249+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4cc018410 con 0x7fa4d4078060 2024-05-08T18:50:51.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.249+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x55e3846abd10 2024-05-08T18:50:51.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.250+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.250+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4b60 con 0x7fa4dc036070 2024-05-08T18:50:51.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.250+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4d4075030 con 0x7fa4dc036070 2024-05-08T18:50:51.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.250+0000 7fa4e57dc800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:51.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.250+0000 7fa4e57dc800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.250+0000 7fa4e57dc800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.250+0000 7fa4e57dc800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.250+0000 7fa4e57dc800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.250+0000 7fa4e57dc800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.250+0000 7fa4e57dc800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.250+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b3bf0 con 0x55e3846abd10 2024-05-08T18:50:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.250+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.250+0000 7fa4e57dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.250+0000 7fa4e57dc800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.250+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b4490 con 0x55e3846abd10 2024-05-08T18:50:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.250+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.250+0000 7fa4e57dc800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.250+0000 7fa4e57dc800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.250+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b3830 con 0x55e3846abd10 2024-05-08T18:50:51.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.251+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.251+0000 7fa4e57dc800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:51.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.251+0000 7fa4e57dc800 20 zone default found 2024-05-08T18:50:51.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.251+0000 7fa4e57dc800 4 Realm: () 2024-05-08T18:50:51.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.251+0000 7fa4e57dc800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:51.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.251+0000 7fa4e57dc800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:51.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.251+0000 7fa4e57dc800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:51.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.251+0000 7fa4e57dc800 20 zonegroup default 2024-05-08T18:50:51.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.251+0000 7fa4e57dc800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.251+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b5490 con 0x7fa4d4078060 2024-05-08T18:50:51.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.251+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x7fa4d4078060 2024-05-08T18:50:51.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.251+0000 7fa4e57dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:51.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.251+0000 7fa4e57dc800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.251+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b70e0 con 0x55e3846b0700 2024-05-08T18:50:51.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.251+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa4dc03d070 con 0x55e3846b0700 2024-05-08T18:50:51.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.251+0000 7fa4e57dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:51.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.251+0000 7fa4e57dc800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.251+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b7570 con 0x55e3846b0700 2024-05-08T18:50:51.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.252+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa4dc03d070 con 0x55e3846b0700 2024-05-08T18:50:51.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.252+0000 7fa4e57dc800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:51.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.252+0000 7fa4e57dc800 20 started sync module instance, tier type = 2024-05-08T18:50:51.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.252+0000 7fa4e57dc800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:51.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.252+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b5fe0 con 0x7fa4dc036070 2024-05-08T18:50:51.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.253+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4d4075030 con 0x7fa4dc036070 2024-05-08T18:50:51.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.253+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94435667567568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b5c40 con 0x7fa4dc036070 2024-05-08T18:50:51.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.253+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b83b0 con 0x55e3846abd10 2024-05-08T18:50:51.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.254+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94435667567568] v25'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4d4075030 con 0x7fa4dc036070 2024-05-08T18:50:51.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.254+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.254+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94435667573200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b87a0 con 0x55e3846abd10 2024-05-08T18:50:51.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.254+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b91a0 con 0x55e3846b0700 2024-05-08T18:50:51.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.255+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94435667573200] v25'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.256+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4dc03d070 con 0x55e3846b0700 2024-05-08T18:50:51.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.256+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94435667574256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b9160 con 0x55e3846b0700 2024-05-08T18:50:51.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.256+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b9cd0 con 0x7fa4dc036070 2024-05-08T18:50:51.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.256+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4d4075030 con 0x7fa4dc036070 2024-05-08T18:50:51.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.257+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94435667580848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846ba570 con 0x7fa4dc036070 2024-05-08T18:50:51.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.257+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846bb060 con 0x55e3846abd10 2024-05-08T18:50:51.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.257+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94435667574256] v25'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4dc03d070 con 0x55e3846b0700 2024-05-08T18:50:51.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.258+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94435667580848] v25'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4d4075030 con 0x7fa4dc036070 2024-05-08T18:50:51.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.258+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.258+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94435667583168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b8cb0 con 0x55e3846abd10 2024-05-08T18:50:51.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.258+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846bb940 con 0x7fa4d4078060 2024-05-08T18:50:51.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.259+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94435667583168] v25'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.259+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x7fa4d4078060 2024-05-08T18:50:51.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.259+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94435667585840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846bb8b0 con 0x7fa4d4078060 2024-05-08T18:50:51.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.259+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846bc350 con 0x7fa4d4078060 2024-05-08T18:50:51.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.260+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(56 notify.6 [create] v25'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x7fa4d4078060 2024-05-08T18:50:51.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.260+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94435667590816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846bc770 con 0x7fa4d4078060 2024-05-08T18:50:51.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.260+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846bd250 con 0x7fa4d4078060 2024-05-08T18:50:51.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.260+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94435667585840] v25'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x7fa4d4078060 2024-05-08T18:50:51.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.261+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94435667590816] v25'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x7fa4d4078060 2024-05-08T18:50:51.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.261+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x7fa4d4078060 2024-05-08T18:50:51.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.261+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94435667594592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846bc2c0 con 0x7fa4d4078060 2024-05-08T18:50:51.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.261+0000 7fa4e57dc800 20 add_watcher() i=0 2024-05-08T18:50:51.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.261+0000 7fa4e57dc800 20 add_watcher() i=1 2024-05-08T18:50:51.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.261+0000 7fa4e57dc800 20 add_watcher() i=2 2024-05-08T18:50:51.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.261+0000 7fa4e57dc800 20 add_watcher() i=3 2024-05-08T18:50:51.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.261+0000 7fa4e57dc800 20 add_watcher() i=4 2024-05-08T18:50:51.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.261+0000 7fa4e57dc800 20 add_watcher() i=5 2024-05-08T18:50:51.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.261+0000 7fa4e57dc800 20 add_watcher() i=6 2024-05-08T18:50:51.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.262+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94435667594592] v25'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x7fa4d4078060 2024-05-08T18:50:51.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.262+0000 7fa4e57dc800 20 add_watcher() i=7 2024-05-08T18:50:51.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.262+0000 7fa4e57dc800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:51.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.262+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e3846c0350 con 0x55e3846abd10 2024-05-08T18:50:51.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.262+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.262+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94435667588096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846bd7d0 con 0x55e3846abd10 2024-05-08T18:50:51.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.263+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94435667588096] v25'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.263+0000 7fa39a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:51.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.263+0000 7fa4e57dc800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:51.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.263+0000 7fa4e57dc800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:51.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.263+0000 7fa4e57dc800 5 note: GC not initialized 2024-05-08T18:50:51.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.264+0000 7fa3997e2640 20 reqs_thread_entry: start 2024-05-08T18:50:51.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.264+0000 7fa4e57dc800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:51.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.264+0000 7fa4e57dc800 20 Filter name: none 2024-05-08T18:50:51.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.264+0000 7fa3927fc640 20 reqs_thread_entry: start 2024-05-08T18:50:51.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.264+0000 7fa4e57dc800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:50:51.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.264+0000 7fa4e57dc800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.264+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e3846f35c0 con 0x55e3846abd10 2024-05-08T18:50:51.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.264+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.264+0000 7fa4e57dc800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:51.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.264+0000 7fa4e57dc800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:50:51.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.264+0000 7fa4e57dc800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:51.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.264+0000 7fa4e57dc800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:51.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.264+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e3846f30e0 con 0x7fa4dc036070 2024-05-08T18:50:51.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.265+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fa4d4075030 con 0x7fa4dc036070 2024-05-08T18:50:51.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.265+0000 7fa4e57dc800 20 disabling bucket name=myfoo 2024-05-08T18:50:51.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.265+0000 7fa4e57dc800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:50:51.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.265+0000 7fa4e57dc800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.265+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e3846f3ed0 con 0x7fa4dc036070 2024-05-08T18:50:51.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.265+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fa4d4075030 con 0x7fa4dc036070 2024-05-08T18:50:51.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.265+0000 7fa4e57dc800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:50:51.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.265+0000 7fa4e57dc800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-05-08T18:50:51.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.265+0000 7fa4e57dc800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:50:51.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.265+0000 7fa4e57dc800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 : miss 2024-05-08T18:50:51.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.265+0000 7fa4e57dc800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.265+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:65 8.1e 8:7ec7f916:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e3846f5800 con 0x7fa4d4078060 2024-05-08T18:50:51.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.266+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(65 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa4cc018410 con 0x7fa4d4078060 2024-05-08T18:50:51.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.266+0000 7fa4e57dc800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:50:51.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.266+0000 7fa4e57dc800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 info.flags=0x17 2024-05-08T18:50:51.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.266+0000 7fa4e57dc800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 to cache LRU end 2024-05-08T18:50:51.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.266+0000 7fa4e57dc800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:51.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.266+0000 7fa4e57dc800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:50:51.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.266+0000 7fa4e57dc800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 2024-05-08T18:50:51.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.266+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:66 8.1e 8:7ec7f916:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846fe4e0 con 0x7fa4d4078060 2024-05-08T18:50:51.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.267+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(66 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v25'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x7fa4d4078060 2024-05-08T18:50:51.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.267+0000 7fa4e57dc800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 info.flags=0x17 2024-05-08T18:50:51.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.267+0000 7fa4e57dc800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 to cache LRU end 2024-05-08T18:50:51.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.267+0000 7fa4e57dc800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:50:51.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.267+0000 7fa4e57dc800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1, ofs0, ns] 2024-05-08T18:50:51.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.267+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94435667860784 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e3846f9b40 con 0x7fa4dc036070 2024-05-08T18:50:51.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.267+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== watch-notify(notify (1) cookie 94435667567568 notify 107374182425 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55e38466f350 con 0x7fa4dc036070 2024-05-08T18:50:51.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.267+0000 7fa3c6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182425 cookie 94435667567568 notifier 4585 bl.length()=752 2024-05-08T18:50:51.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.267+0000 7fa3c6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 info.flags=0x17 2024-05-08T18:50:51.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.267+0000 7fa3c6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 to cache LRU end 2024-05-08T18:50:51.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.267+0000 7fa3c6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:50:51.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.267+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(67 notify.0 [notify cookie 94435667860784 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa4d4075030 con 0x7fa4dc036070 2024-05-08T18:50:51.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.267+0000 7fa3c6ffd640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7fa3a8003ea0 con 0x7fa4dc036070 2024-05-08T18:50:51.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.267+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4d4075030 con 0x7fa4dc036070 2024-05-08T18:50:51.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.268+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== watch-notify(notify_complete (2) cookie 94435667860784 notify 107374182425 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e38466c6a0 con 0x7fa4dc036070 2024-05-08T18:50:51.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.268+0000 7fa4e57dc800 20 handle_bi_update(): bucket=:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): orig_sources= new_sources= 2024-05-08T18:50:51.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.268+0000 7fa4e57dc800 20 handle_bi_update(): bucket=:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): potential sources added=[] removed=[] 2024-05-08T18:50:51.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.268+0000 7fa4e57dc800 20 handle_bi_update(): bucket=:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): orig_dests= new_dests= 2024-05-08T18:50:51.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.268+0000 7fa4e57dc800 20 handle_bi_update(): bucket=:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): potential dests added=[] removed=[] 2024-05-08T18:50:51.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.268+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846f5f70 con 0x55e3846abd10 2024-05-08T18:50:51.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.269+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v25'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.269+0000 7fa4e57dc800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:51.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.269+0000 7fa4e57dc800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:51.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.269+0000 7fa4e57dc800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:50:51.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.269+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94435667811616 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55e3846f5f70 con 0x55e3846abd10 2024-05-08T18:50:51.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.269+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== watch-notify(notify (1) cookie 94435667583168 notify 107374182414 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55e3846f5bf0 con 0x55e3846abd10 2024-05-08T18:50:51.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.269+0000 7fa3c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182414 cookie 94435667583168 notifier 4585 bl.length()=567 2024-05-08T18:50:51.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.269+0000 7fa3c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:51.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.269+0000 7fa3c67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:51.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.269+0000 7fa3c67fc640 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7fa30c003430 con 0x55e3846abd10 2024-05-08T18:50:51.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.269+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(70 notify.4 [notify cookie 94435667811616 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.269+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== watch-notify(notify_complete (2) cookie 94435667811616 notify 107374182414 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e3846f3ca0 con 0x55e3846abd10 2024-05-08T18:50:51.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.269+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.280 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:50:44.835566Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:44.835553Z","tags":[],"group_ids":[]} 2024-05-08T18:50:51.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.270+0000 7fa39a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:51.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.270+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94435667588096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846fc180 con 0x55e3846abd10 2024-05-08T18:50:51.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.271+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94435667588096] v25'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.271+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94435667567568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846bb400 con 0x7fa4dc036070 2024-05-08T18:50:51.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.272+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94435667567568] v25'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4d4075030 con 0x7fa4dc036070 2024-05-08T18:50:51.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.272+0000 7fa4e57dc800 20 remove_watcher() i=0 2024-05-08T18:50:51.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.272+0000 7fa4e57dc800 2 removed watcher, disabling cache 2024-05-08T18:50:51.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.272+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94435667573200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b63d0 con 0x55e3846abd10 2024-05-08T18:50:51.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.273+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94435667573200] v25'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.273+0000 7fa4e57dc800 20 remove_watcher() i=1 2024-05-08T18:50:51.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.273+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94435667574256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b63d0 con 0x55e3846b0700 2024-05-08T18:50:51.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.274+0000 7fa4e3adc640 1 -- 172.21.15.132:0/1767176260 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94435667574256] v25'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4dc03d070 con 0x55e3846b0700 2024-05-08T18:50:51.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.274+0000 7fa4e57dc800 20 remove_watcher() i=2 2024-05-08T18:50:51.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.274+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94435667580848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b7e80 con 0x7fa4dc036070 2024-05-08T18:50:51.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.275+0000 7fa4e32db640 1 -- 172.21.15.132:0/1767176260 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94435667580848] v25'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4d4075030 con 0x7fa4dc036070 2024-05-08T18:50:51.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.275+0000 7fa4e57dc800 20 remove_watcher() i=3 2024-05-08T18:50:51.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.275+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94435667583168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b7e80 con 0x55e3846abd10 2024-05-08T18:50:51.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.277+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94435667583168] v25'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x55e3846abd10 2024-05-08T18:50:51.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.277+0000 7fa4e57dc800 20 remove_watcher() i=4 2024-05-08T18:50:51.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.277+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94435667585840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b7e80 con 0x7fa4d4078060 2024-05-08T18:50:51.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.278+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94435667585840] v25'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x7fa4d4078060 2024-05-08T18:50:51.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.278+0000 7fa4e57dc800 20 remove_watcher() i=5 2024-05-08T18:50:51.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.278+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94435667590816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b7e80 con 0x7fa4d4078060 2024-05-08T18:50:51.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.279+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94435667590816] v25'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x7fa4d4078060 2024-05-08T18:50:51.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.279+0000 7fa4e57dc800 20 remove_watcher() i=6 2024-05-08T18:50:51.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.279+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94435667594592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55e3846b7e80 con 0x7fa4d4078060 2024-05-08T18:50:51.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.280+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94435667594592] v25'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4cc018410 con 0x7fa4d4078060 2024-05-08T18:50:51.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.280+0000 7fa4e57dc800 20 remove_watcher() i=7 2024-05-08T18:50:51.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.280+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa4d4078060 msgr2=0x7fa4d408b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.280+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/1767176260 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa4d4078060 0x7fa4d408b3e0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.280+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e3846abd10 msgr2=0x55e3846ae1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.280+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/1767176260 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e3846abd10 0x55e3846ae1d0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.280+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa4dc036070 msgr2=0x7fa4dc0549c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.280+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/1767176260 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa4dc036070 0x7fa4dc0549c0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.280+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e3846b0700 msgr2=0x55e3846b2af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.280+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/1767176260 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e3846b0700 0x55e3846b2af0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.280+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3ac03bb50 msgr2=0x7fa3ac03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.280+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/1767176260 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3ac03bb50 0x7fa3ac03e010 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4066fd0 tx=0x7fa4d407f000 comp rx=0 tx=0).stop 2024-05-08T18:50:51.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.280+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384694690 msgr2=0x55e3846a0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.280+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/1767176260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384694690 0x55e3846a0080 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc052d20 tx=0x7fa4dc052d50 comp rx=0 tx=0).stop 2024-05-08T18:50:51.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.280+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 reap_dead start 2024-05-08T18:50:51.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.280+0000 7fa4daada640 1 -- 172.21.15.132:0/1767176260 reap_dead start 2024-05-08T18:50:51.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.280+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 shutdown_connections 2024-05-08T18:50:51.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.280+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 >> 172.21.15.132:0/1767176260 conn(0x55e3846909a0 msgr2=0x55e38468e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:51.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.280+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 shutdown_connections 2024-05-08T18:50:51.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.280+0000 7fa4e57dc800 1 -- 172.21.15.132:0/1767176260 wait complete. 2024-05-08T18:50:51.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 -- 172.21.15.132:0/2158753725 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3bc03bb50 msgr2=0x7fa3bc03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/2158753725 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3bc03bb50 0x7fa3bc03e010 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55e384673a70 tx=0x7fa4d4006f10 comp rx=0 tx=0).stop 2024-05-08T18:50:51.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 -- 172.21.15.132:0/2158753725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384687340 msgr2=0x55e384687760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/2158753725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384687340 0x55e384687760 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x55e38466cf60 tx=0x7fa4dc018830 comp rx=0 tx=0).stop 2024-05-08T18:50:51.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 -- 172.21.15.132:0/2158753725 shutdown_connections 2024-05-08T18:50:51.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/2158753725 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3bc03bb50 0x7fa3bc03e010 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/2158753725 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384687340 0x55e384687760 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 -- 172.21.15.132:0/2158753725 >> 172.21.15.132:0/2158753725 conn(0x55e38467b3e0 msgr2=0x55e38467b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:51.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 -- 172.21.15.132:0/2158753725 shutdown_connections 2024-05-08T18:50:51.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 -- 172.21.15.132:0/2158753725 wait complete. 2024-05-08T18:50:51.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 -- 172.21.15.132:0/3864359349 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e3845753a0 msgr2=0x55e384673110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/3864359349 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e3845753a0 0x55e384673110 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 -- 172.21.15.132:0/3864359349 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e384675940 msgr2=0x55e384677d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/3864359349 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e384675940 0x55e384677d30 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 -- 172.21.15.132:0/3864359349 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3c803bba0 msgr2=0x7fa3c803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/3864359349 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3c803bba0 0x7fa3c803e060 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc000c00 tx=0x7fa4cc0013b0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 -- 172.21.15.132:0/3864359349 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384574140 msgr2=0x55e38466bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/3864359349 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384574140 0x55e38466bed0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4052540 tx=0x7fa4d4003020 comp rx=0 tx=0).stop 2024-05-08T18:50:51.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 -- 172.21.15.132:0/3864359349 shutdown_connections 2024-05-08T18:50:51.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/3864359349 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e384675940 0x55e384677d30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/3864359349 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e3845753a0 0x55e384673110 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/3864359349 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa3c803bba0 0x7fa3c803e060 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 --2- 172.21.15.132:0/3864359349 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e384574140 0x55e38466bed0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 -- 172.21.15.132:0/3864359349 >> 172.21.15.132:0/3864359349 conn(0x55e38456f720 msgr2=0x55e38465e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:51.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 -- 172.21.15.132:0/3864359349 shutdown_connections 2024-05-08T18:50:51.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.281+0000 7fa4e57dc800 1 -- 172.21.15.132:0/3864359349 wait complete. 2024-05-08T18:50:51.291 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:50:44.835566Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:44.835553Z', 'tags': [], 'group_ids': []} 2024-05-08T18:50:51.293 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-05-08T18:50:51.293 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-05-08T18:50:51.293 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-05-08T18:50:51.375 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:50:51.375 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:50:51.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.376+0000 7f1dbe83b800 1 Processor -- start 2024-05-08T18:50:51.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.376+0000 7f1dbe83b800 1 -- start start 2024-05-08T18:50:51.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.377+0000 7f1dbe83b800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55b1c46235d0 0x55b1c46259c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.377+0000 7f1dbe83b800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b1c4625f90 con 0x55b1c461f140 2024-05-08T18:50:51.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.377+0000 7f1dbe83b800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55b1c44c0e20 con 0x55b1c46235d0 2024-05-08T18:50:51.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.377+0000 7f1db3fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55b1c46235d0 0x55b1c46259c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.377+0000 7f1dbc333640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55b1c461f140 0x55b1c461f560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:43638/0 (socket says 172.21.15.132:43638) 2024-05-08T18:50:51.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.377+0000 7f1db3fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55b1c46235d0 0x55b1c46259c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40522/0 (socket says 172.21.15.132:40522) 2024-05-08T18:50:51.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.377+0000 7f1dbc333640 1 -- 172.21.15.132:0/1659983689 learned_addr learned my addr 172.21.15.132:0/1659983689 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:50:51.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.377+0000 7f1db3fff640 1 -- 172.21.15.132:0/1659983689 >> v1:172.21.15.42:6789/0 conn(0x55b1c461f140 legacy=0x55b1c461f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.377+0000 7f1db3fff640 1 -- 172.21.15.132:0/1659983689 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1c46271c0 con 0x55b1c46235d0 2024-05-08T18:50:51.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.379+0000 7f1db3fff640 1 --2- 172.21.15.132:0/1659983689 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c46235d0 0x55b1c46259c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1da400a470 tx=0x7f1da401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d87f608dc347c04 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.379+0000 7f1dbbb32640 1 -- 172.21.15.132:0/1659983689 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1da4057070 con 0x55b1c46235d0 2024-05-08T18:50:51.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.379+0000 7f1dbbb32640 1 -- 172.21.15.132:0/1659983689 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da4052570 con 0x55b1c46235d0 2024-05-08T18:50:51.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.379+0000 7f1dbbb32640 1 -- 172.21.15.132:0/1659983689 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1da4052870 con 0x55b1c46235d0 2024-05-08T18:50:51.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.380+0000 7f1dbe83b800 1 -- 172.21.15.132:0/1659983689 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c46235d0 msgr2=0x55b1c46259c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.380+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/1659983689 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c46235d0 0x55b1c46259c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1da400a470 tx=0x7f1da401ce90 comp rx=0 tx=0).stop 2024-05-08T18:50:51.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.380+0000 7f1dbe83b800 1 -- 172.21.15.132:0/1659983689 shutdown_connections 2024-05-08T18:50:51.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.380+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/1659983689 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c46235d0 0x55b1c46259c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.380+0000 7f1dbe83b800 1 -- 172.21.15.132:0/1659983689 >> 172.21.15.132:0/1659983689 conn(0x55b1c461a720 msgr2=0x55b1c461cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:51.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.380+0000 7f1dbe83b800 1 -- 172.21.15.132:0/1659983689 shutdown_connections 2024-05-08T18:50:51.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.380+0000 7f1dbe83b800 1 -- 172.21.15.132:0/1659983689 wait complete. 2024-05-08T18:50:51.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.394+0000 7f1dbe83b800 1 Processor -- start 2024-05-08T18:50:51.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.394+0000 7f1dbe83b800 1 -- start start 2024-05-08T18:50:51.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.394+0000 7f1dbe83b800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c461f140 0x55b1c4710540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.394+0000 7f1dbe83b800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b1c456b5b0 con 0x55b1c461f140 2024-05-08T18:50:51.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.394+0000 7f1dbc333640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c461f140 0x55b1c4710540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.394+0000 7f1dbc333640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c461f140 0x55b1c4710540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40524/0 (socket says 172.21.15.132:40524) 2024-05-08T18:50:51.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.394+0000 7f1dbc333640 1 -- 172.21.15.132:0/1308443778 learned_addr learned my addr 172.21.15.132:0/1308443778 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:51.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.394+0000 7f1dbc333640 1 -- 172.21.15.132:0/1308443778 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1c4710b10 con 0x55b1c461f140 2024-05-08T18:50:51.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.395+0000 7f1dbc333640 1 --2- 172.21.15.132:0/1308443778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c461f140 0x55b1c4710540 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1dac001e10 tx=0x7f1dac00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf08a6bbe60bb5d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.395+0000 7f1caa60c640 1 -- 172.21.15.132:0/1308443778 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dac012020 con 0x55b1c461f140 2024-05-08T18:50:51.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.395+0000 7f1caa60c640 1 -- 172.21.15.132:0/1308443778 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dac00e5a0 con 0x55b1c461f140 2024-05-08T18:50:51.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.395+0000 7f1caa60c640 1 -- 172.21.15.132:0/1308443778 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dac00e8e0 con 0x55b1c461f140 2024-05-08T18:50:51.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.395+0000 7f1dbe83b800 1 -- 172.21.15.132:0/1308443778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c461f140 msgr2=0x55b1c4710540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.395+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/1308443778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c461f140 0x55b1c4710540 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1dac001e10 tx=0x7f1dac00b780 comp rx=0 tx=0).stop 2024-05-08T18:50:51.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.395+0000 7f1dbe83b800 1 -- 172.21.15.132:0/1308443778 shutdown_connections 2024-05-08T18:50:51.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.395+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/1308443778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c461f140 0x55b1c4710540 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.395+0000 7f1dbe83b800 1 -- 172.21.15.132:0/1308443778 >> 172.21.15.132:0/1308443778 conn(0x55b1c461a720 msgr2=0x55b1c470be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:51.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.395+0000 7f1dbe83b800 1 -- 172.21.15.132:0/1308443778 shutdown_connections 2024-05-08T18:50:51.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.395+0000 7f1dbe83b800 1 -- 172.21.15.132:0/1308443778 wait complete. 2024-05-08T18:50:51.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.396+0000 7f1dbe83b800 1 Processor -- start 2024-05-08T18:50:51.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.396+0000 7f1dbe83b800 1 -- start start 2024-05-08T18:50:51.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.396+0000 7f1dbe83b800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c461f140 0x55b1c471b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.396+0000 7f1dbe83b800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b1c4626460 con 0x55b1c461f140 2024-05-08T18:50:51.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.396+0000 7f1dbc333640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c461f140 0x55b1c471b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.396+0000 7f1dbc333640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c461f140 0x55b1c471b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40532/0 (socket says 172.21.15.132:40532) 2024-05-08T18:50:51.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.396+0000 7f1dbc333640 1 -- 172.21.15.132:0/3590055614 learned_addr learned my addr 172.21.15.132:0/3590055614 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:51.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.396+0000 7f1dbc333640 1 -- 172.21.15.132:0/3590055614 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1c471b8d0 con 0x55b1c461f140 2024-05-08T18:50:51.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.397+0000 7f1dbc333640 1 --2- 172.21.15.132:0/3590055614 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c461f140 0x55b1c471b390 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00b7c0 tx=0x7f1dac000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.397+0000 7f1ca8e09640 1 -- 172.21.15.132:0/3590055614 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dac012030 con 0x55b1c461f140 2024-05-08T18:50:51.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.397+0000 7f1ca8e09640 1 -- 172.21.15.132:0/3590055614 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dac001470 con 0x55b1c461f140 2024-05-08T18:50:51.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.397+0000 7f1ca8e09640 1 -- 172.21.15.132:0/3590055614 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1dac01a8d0 con 0x55b1c461f140 2024-05-08T18:50:51.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.397+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3590055614 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1c471bb60 con 0x55b1c461f140 2024-05-08T18:50:51.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.397+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3590055614 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1c471e810 con 0x55b1c461f140 2024-05-08T18:50:51.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.398+0000 7f1ca8e09640 1 -- 172.21.15.132:0/3590055614 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1dac015020 con 0x55b1c461f140 2024-05-08T18:50:51.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.398+0000 7f1ca8e09640 1 --2- 172.21.15.132:0/3590055614 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1ca403bba0 0x7f1ca403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.398+0000 7f1ca8e09640 1 -- 172.21.15.132:0/3590055614 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f1dac020030 con 0x55b1c461f140 2024-05-08T18:50:51.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.398+0000 7f1db3fff640 1 --2- 172.21.15.132:0/3590055614 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1ca403bba0 0x7f1ca403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.398+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/3590055614 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55b1c46235d0 0x55b1c47225d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.398+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3590055614 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4722b10 con 0x55b1c46235d0 2024-05-08T18:50:51.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.398+0000 7f1dbcb34640 1 --2- 172.21.15.132:0/3590055614 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55b1c46235d0 0x55b1c47225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.398+0000 7f1db3fff640 1 --2- 172.21.15.132:0/3590055614 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1ca403bba0 0x7f1ca403e060 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1da4054000 tx=0x7f1da404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.398+0000 7f1dbcb34640 1 --2- 172.21.15.132:0/3590055614 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55b1c46235d0 0x55b1c47225d0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.399+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3590055614 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1db400a4a0 con 0x55b1c46235d0 2024-05-08T18:50:51.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.399+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3590055614 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c471fba0 con 0x55b1c46235d0 2024-05-08T18:50:51.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.399+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3590055614 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1db400a4a0 con 0x55b1c46235d0 2024-05-08T18:50:51.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.399+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/3590055614 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55b1c4724e60 0x55b1c4727250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.399+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3590055614 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4727940 con 0x55b1c4724e60 2024-05-08T18:50:51.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.399+0000 7f1dbc333640 1 --2- 172.21.15.132:0/3590055614 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55b1c4724e60 0x55b1c4727250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.399+0000 7f1dbc333640 1 --2- 172.21.15.132:0/3590055614 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55b1c4724e60 0x55b1c4727250 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.400+0000 7f1dbc333640 1 -- 172.21.15.132:0/3590055614 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1dac01ac50 con 0x55b1c4724e60 2024-05-08T18:50:51.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.400+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3590055614 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4723d00 con 0x55b1c46235d0 2024-05-08T18:50:51.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.400+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3590055614 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1db400a4a0 con 0x55b1c46235d0 2024-05-08T18:50:51.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.400+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3590055614 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c47241e0 con 0x55b1c46235d0 2024-05-08T18:50:51.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.400+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3590055614 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1db400a4a0 con 0x55b1c46235d0 2024-05-08T18:50:51.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.400+0000 7f1dbe83b800 1 Processor -- start 2024-05-08T18:50:51.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.401+0000 7f1dbe83b800 1 -- start start 2024-05-08T18:50:51.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.401+0000 7f1dbe83b800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c47368c0 0x55b1c4736ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.401+0000 7f1dbe83b800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b1c4511fc0 con 0x55b1c47368c0 2024-05-08T18:50:51.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.401+0000 7f1dbcb34640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c47368c0 0x55b1c4736ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.401+0000 7f1dbcb34640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c47368c0 0x55b1c4736ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40544/0 (socket says 172.21.15.132:40544) 2024-05-08T18:50:51.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.401+0000 7f1dbcb34640 1 -- 172.21.15.132:0/4063332306 learned_addr learned my addr 172.21.15.132:0/4063332306 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:51.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.401+0000 7f1dbcb34640 1 -- 172.21.15.132:0/4063332306 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1c4737220 con 0x55b1c47368c0 2024-05-08T18:50:51.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.401+0000 7f1dbcb34640 1 --2- 172.21.15.132:0/4063332306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c47368c0 0x55b1c4736ce0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x55b1c4722f10 tx=0x7f1db4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.402+0000 7f1ca1ffb640 1 -- 172.21.15.132:0/4063332306 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db4014450 con 0x55b1c47368c0 2024-05-08T18:50:51.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.402+0000 7f1ca1ffb640 1 -- 172.21.15.132:0/4063332306 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db4014610 con 0x55b1c47368c0 2024-05-08T18:50:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.402+0000 7f1ca1ffb640 1 -- 172.21.15.132:0/4063332306 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db4014930 con 0x55b1c47368c0 2024-05-08T18:50:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.402+0000 7f1dbe83b800 1 -- 172.21.15.132:0/4063332306 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1c4737c90 con 0x55b1c47368c0 2024-05-08T18:50:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.402+0000 7f1dbe83b800 1 -- 172.21.15.132:0/4063332306 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1c4738190 con 0x55b1c47368c0 2024-05-08T18:50:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.403+0000 7f1ca1ffb640 1 -- 172.21.15.132:0/4063332306 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1db4011040 con 0x55b1c47368c0 2024-05-08T18:50:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.403+0000 7f1ca1ffb640 1 --2- 172.21.15.132:0/4063332306 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c9403bba0 0x7f1c9403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.403+0000 7f1ca1ffb640 1 -- 172.21.15.132:0/4063332306 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f1db401e070 con 0x55b1c47368c0 2024-05-08T18:50:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.403+0000 7f1dbc333640 1 --2- 172.21.15.132:0/4063332306 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c9403bba0 0x7f1c9403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.403+0000 7f1dbe83b800 1 Processor -- start 2024-05-08T18:50:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.403+0000 7f1dbc333640 1 --2- 172.21.15.132:0/4063332306 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c9403bba0 0x7f1c9403e060 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55b1c4722fb0 tx=0x7f1dac04c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.403+0000 7f1dbe83b800 1 -- start start 2024-05-08T18:50:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.403+0000 7f1dbe83b800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c4743b80 0x55b1c4743fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.403+0000 7f1dbe83b800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b1c4710e60 con 0x55b1c4743b80 2024-05-08T18:50:51.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.404+0000 7f1dbcb34640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c4743b80 0x55b1c4743fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.404+0000 7f1dbcb34640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c4743b80 0x55b1c4743fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40548/0 (socket says 172.21.15.132:40548) 2024-05-08T18:50:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.404+0000 7f1dbcb34640 1 -- 172.21.15.132:0/2659005792 learned_addr learned my addr 172.21.15.132:0/2659005792 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.404+0000 7f1dbcb34640 1 -- 172.21.15.132:0/2659005792 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1c4744570 con 0x55b1c4743b80 2024-05-08T18:50:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.404+0000 7f1dbcb34640 1 --2- 172.21.15.132:0/2659005792 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c4743b80 0x55b1c4743fa0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1db4013fd0 tx=0x7f1db40013d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1bf03f780417f25 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.404+0000 7f1c937fe640 1 -- 172.21.15.132:0/2659005792 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db40167c0 con 0x55b1c4743b80 2024-05-08T18:50:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.404+0000 7f1c937fe640 1 -- 172.21.15.132:0/2659005792 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db4016960 con 0x55b1c4743b80 2024-05-08T18:50:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.404+0000 7f1c937fe640 1 -- 172.21.15.132:0/2659005792 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db4014ad0 con 0x55b1c4743b80 2024-05-08T18:50:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.405+0000 7f1dbe83b800 1 -- 172.21.15.132:0/2659005792 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c4743b80 msgr2=0x55b1c4743fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.405+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/2659005792 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c4743b80 0x55b1c4743fa0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1db4013fd0 tx=0x7f1db40013d0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.405+0000 7f1dbe83b800 1 -- 172.21.15.132:0/2659005792 shutdown_connections 2024-05-08T18:50:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.405+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/2659005792 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c4743b80 0x55b1c4743fa0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.405+0000 7f1dbe83b800 1 -- 172.21.15.132:0/2659005792 >> 172.21.15.132:0/2659005792 conn(0x55b1c473fe50 msgr2=0x55b1c473deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:51.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.405+0000 7f1dbe83b800 1 -- 172.21.15.132:0/2659005792 shutdown_connections 2024-05-08T18:50:51.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.405+0000 7f1dbe83b800 1 -- 172.21.15.132:0/2659005792 wait complete. 2024-05-08T18:50:51.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.405+0000 7f1dbe83b800 1 Processor -- start 2024-05-08T18:50:51.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.405+0000 7f1dbe83b800 1 -- start start 2024-05-08T18:50:51.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.405+0000 7f1dbe83b800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c4743b80 0x55b1c474b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.405+0000 7f1dbe83b800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55b1c4744cc0 con 0x55b1c4743b80 2024-05-08T18:50:51.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.405+0000 7f1dbcb34640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c4743b80 0x55b1c474b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.405+0000 7f1dbcb34640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c4743b80 0x55b1c474b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:40564/0 (socket says 172.21.15.132:40564) 2024-05-08T18:50:51.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.405+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 learned_addr learned my addr 172.21.15.132:0/3493024496 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:50:51.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.406+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1c474b5f0 con 0x55b1c4743b80 2024-05-08T18:50:51.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.406+0000 7f1dbcb34640 1 --2- 172.21.15.132:0/3493024496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c4743b80 0x55b1c474b0b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1db40014b0 tx=0x7f1db4052bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.406+0000 7f1c91ffb640 1 -- 172.21.15.132:0/3493024496 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db40167c0 con 0x55b1c4743b80 2024-05-08T18:50:51.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.406+0000 7f1c91ffb640 1 -- 172.21.15.132:0/3493024496 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db4045070 con 0x55b1c4743b80 2024-05-08T18:50:51.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.406+0000 7f1c91ffb640 1 -- 172.21.15.132:0/3493024496 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1db402b4c0 con 0x55b1c4743b80 2024-05-08T18:50:51.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.406+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1c474b880 con 0x55b1c4743b80 2024-05-08T18:50:51.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.406+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1c474e530 con 0x55b1c4743b80 2024-05-08T18:50:51.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.407+0000 7f1c91ffb640 1 -- 172.21.15.132:0/3493024496 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1db404e040 con 0x55b1c4743b80 2024-05-08T18:50:51.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.407+0000 7f1c91ffb640 1 --2- 172.21.15.132:0/3493024496 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c8403bb50 0x7f1c8403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.407+0000 7f1c91ffb640 1 -- 172.21.15.132:0/3493024496 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f1db400e040 con 0x55b1c4743b80 2024-05-08T18:50:51.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.407+0000 7f1dbc333640 1 --2- 172.21.15.132:0/3493024496 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c8403bb50 0x7f1c8403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.407+0000 7f1dbc333640 1 --2- 172.21.15.132:0/3493024496 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c8403bb50 0x7f1c8403e010 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1dac041010 tx=0x7f1dac04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.407+0000 7f1dbe83b800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.408+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/3493024496 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55b1c4756da0 0x55b1c4759260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.408+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c47599b0 con 0x55b1c4756da0 2024-05-08T18:50:51.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.408+0000 7f1db3fff640 1 --2- 172.21.15.132:0/3493024496 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55b1c4756da0 0x55b1c4759260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.408+0000 7f1db3fff640 1 --2- 172.21.15.132:0/3493024496 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55b1c4756da0 0x55b1c4759260 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.408+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1da405a040 con 0x55b1c4756da0 2024-05-08T18:50:51.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.408+0000 7f1dbe83b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:51.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.408+0000 7f1dbe83b800 20 realm 2024-05-08T18:50:51.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.408+0000 7f1dbe83b800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.408+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4759d80 con 0x55b1c4756da0 2024-05-08T18:50:51.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.408+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1da405a040 con 0x55b1c4756da0 2024-05-08T18:50:51.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.408+0000 7f1dbe83b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:51.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.408+0000 7f1dbe83b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:50:51.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.408+0000 7f1dbe83b800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.408+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475a650 con 0x55b1c4756da0 2024-05-08T18:50:51.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.409+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1da405a040 con 0x55b1c4756da0 2024-05-08T18:50:51.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.409+0000 7f1dbe83b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:51.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.409+0000 7f1dbe83b800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.409+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475a9f0 con 0x55b1c4756da0 2024-05-08T18:50:51.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.409+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1da405a040 con 0x55b1c4756da0 2024-05-08T18:50:51.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.409+0000 7f1dbe83b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:51.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.409+0000 7f1dbe83b800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.409+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/3493024496 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55b1c475b750 0x55b1c475db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.409+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475e100 con 0x55b1c475b750 2024-05-08T18:50:51.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.409+0000 7f1dbcb34640 1 --2- 172.21.15.132:0/3493024496 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55b1c475b750 0x55b1c475db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.409+0000 7f1dbcb34640 1 --2- 172.21.15.132:0/3493024496 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55b1c475b750 0x55b1c475db40 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.409+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1db402a070 con 0x55b1c475b750 2024-05-08T18:50:51.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.409+0000 7f1dbe83b800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:50:51.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.409+0000 7f1dbe83b800 20 searching for the correct realm 2024-05-08T18:50:51.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.409+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x55b1c475b750 2024-05-08T18:50:51.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.410+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db402a070 con 0x55b1c475b750 2024-05-08T18:50:51.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.410+0000 7f1dbcb34640 1 --2- 172.21.15.132:0/3493024496 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1db4014070 0x7f1db4001520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.410+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x7f1db4014070 2024-05-08T18:50:51.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.410+0000 7f1dbc333640 1 --2- 172.21.15.132:0/3493024496 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1db4014070 0x7f1db4001520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.410+0000 7f1dbc333640 1 --2- 172.21.15.132:0/3493024496 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1db4014070 0x7f1db4001520 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.411+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dac036040 con 0x7f1db4014070 2024-05-08T18:50:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.411+0000 7f1dbc333640 1 --2- 172.21.15.132:0/3493024496 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1dac017050 0x7f1dac03d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:50:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.411+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x7f1dac017050 2024-05-08T18:50:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.411+0000 7f1db3fff640 1 --2- 172.21.15.132:0/3493024496 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1dac017050 0x7f1dac03d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:50:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.411+0000 7f1db3fff640 1 --2- 172.21.15.132:0/3493024496 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1dac017050 0x7f1dac03d7c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:50:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.412+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da405a040 con 0x7f1dac017050 2024-05-08T18:50:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.412+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x55b1c4756da0 2024-05-08T18:50:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.412+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da405a040 con 0x55b1c4756da0 2024-05-08T18:50:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.412+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x55b1c4756da0 2024-05-08T18:50:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.412+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da405a040 con 0x55b1c4756da0 2024-05-08T18:50:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.412+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x7f1dac017050 2024-05-08T18:50:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.412+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da405a040 con 0x7f1dac017050 2024-05-08T18:50:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.412+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x7f1dac017050 2024-05-08T18:50:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.412+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da405a040 con 0x7f1dac017050 2024-05-08T18:50:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.412+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x7f1db4014070 2024-05-08T18:50:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.413+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dac036040 con 0x7f1db4014070 2024-05-08T18:50:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.413+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x55b1c475b750 2024-05-08T18:50:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.413+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db402a070 con 0x55b1c475b750 2024-05-08T18:50:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.413+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x55b1c4756da0 2024-05-08T18:50:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.413+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da405a040 con 0x55b1c4756da0 2024-05-08T18:50:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.413+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x7f1dac017050 2024-05-08T18:50:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.414+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da405a040 con 0x7f1dac017050 2024-05-08T18:50:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.414+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x55b1c4756da0 2024-05-08T18:50:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.414+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1da405a040 con 0x55b1c4756da0 2024-05-08T18:50:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.414+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x7f1db4014070 2024-05-08T18:50:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.414+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1dac036040 con 0x7f1db4014070 2024-05-08T18:50:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.414+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x55b1c475b750 2024-05-08T18:50:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.414+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1db402a070 con 0x55b1c475b750 2024-05-08T18:50:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.414+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x55b1c475b750 2024-05-08T18:50:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.414+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db402a070 con 0x55b1c475b750 2024-05-08T18:50:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.415+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x7f1dac017050 2024-05-08T18:50:51.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.415+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da405a040 con 0x7f1dac017050 2024-05-08T18:50:51.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.415+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x55b1c475b750 2024-05-08T18:50:51.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.415+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db402a070 con 0x55b1c475b750 2024-05-08T18:50:51.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.415+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x55b1c475b750 2024-05-08T18:50:51.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.415+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db402a070 con 0x55b1c475b750 2024-05-08T18:50:51.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.415+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x55b1c4756da0 2024-05-08T18:50:51.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.416+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da405a040 con 0x55b1c4756da0 2024-05-08T18:50:51.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.416+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x55b1c4756da0 2024-05-08T18:50:51.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.416+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1da405a040 con 0x55b1c4756da0 2024-05-08T18:50:51.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.416+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x7f1dac017050 2024-05-08T18:50:51.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.416+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da407d040 con 0x7f1dac017050 2024-05-08T18:50:51.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.416+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x55b1c475b750 2024-05-08T18:50:51.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.416+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db402a070 con 0x55b1c475b750 2024-05-08T18:50:51.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.416+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x7f1db4014070 2024-05-08T18:50:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.417+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dac036040 con 0x7f1db4014070 2024-05-08T18:50:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.417+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x55b1c4756da0 2024-05-08T18:50:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.417+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da407d040 con 0x55b1c4756da0 2024-05-08T18:50:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.417+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x7f1dac017050 2024-05-08T18:50:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.417+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da407d040 con 0x7f1dac017050 2024-05-08T18:50:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.417+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x55b1c475b750 2024-05-08T18:50:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.417+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db402a070 con 0x55b1c475b750 2024-05-08T18:50:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.417+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x7f1dac017050 2024-05-08T18:50:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.418+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da407d040 con 0x7f1dac017050 2024-05-08T18:50:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.418+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x7f1db4014070 2024-05-08T18:50:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.418+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dac036040 con 0x7f1db4014070 2024-05-08T18:50:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.418+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x55b1c475b750 2024-05-08T18:50:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.418+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1db402a070 con 0x55b1c475b750 2024-05-08T18:50:51.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.418+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x7f1dac017050 2024-05-08T18:50:51.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.418+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1da407d040 con 0x7f1dac017050 2024-05-08T18:50:51.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.419+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x55b1c4756da0 2024-05-08T18:50:51.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.419+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1da407d040 con 0x55b1c4756da0 2024-05-08T18:50:51.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.419+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475fa50 con 0x7f1db4014070 2024-05-08T18:50:51.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.419+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1dac036040 con 0x7f1db4014070 2024-05-08T18:50:51.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.419+0000 7f1dbe83b800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:50:51.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.419+0000 7f1dbe83b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:50:51.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.419+0000 7f1dbe83b800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:50:51.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.419+0000 7f1dbe83b800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:50:51.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.419+0000 7f1dbe83b800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:50:51.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.419+0000 7f1dbe83b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:50:51.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.419+0000 7f1dbe83b800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.419+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475eac0 con 0x55b1c4756da0 2024-05-08T18:50:51.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.419+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1da407d040 con 0x55b1c4756da0 2024-05-08T18:50:51.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.419+0000 7f1dbe83b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:51.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.419+0000 7f1dbe83b800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.419+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475f360 con 0x55b1c4756da0 2024-05-08T18:50:51.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.419+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1da407d040 con 0x55b1c4756da0 2024-05-08T18:50:51.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.419+0000 7f1dbe83b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:50:51.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.419+0000 7f1dbe83b800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.419+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c475e700 con 0x55b1c4756da0 2024-05-08T18:50:51.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.420+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1da407d040 con 0x55b1c4756da0 2024-05-08T18:50:51.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.420+0000 7f1dbe83b800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:50:51.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.420+0000 7f1dbe83b800 20 zone default found 2024-05-08T18:50:51.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.420+0000 7f1dbe83b800 4 Realm: () 2024-05-08T18:50:51.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.420+0000 7f1dbe83b800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:50:51.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.420+0000 7f1dbe83b800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:50:51.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.420+0000 7f1dbe83b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:50:51.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.420+0000 7f1dbe83b800 20 zonegroup default 2024-05-08T18:50:51.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.420+0000 7f1dbe83b800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.420+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4760380 con 0x7f1dac017050 2024-05-08T18:50:51.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.420+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1da407d040 con 0x7f1dac017050 2024-05-08T18:50:51.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.420+0000 7f1dbe83b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:51.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.420+0000 7f1dbe83b800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.420+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4761fc0 con 0x55b1c475b750 2024-05-08T18:50:51.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.420+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1db402a070 con 0x55b1c475b750 2024-05-08T18:50:51.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.420+0000 7f1dbe83b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:51.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.420+0000 7f1dbe83b800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.420+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4762490 con 0x55b1c475b750 2024-05-08T18:50:51.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.421+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1db402a070 con 0x55b1c475b750 2024-05-08T18:50:51.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.421+0000 7f1dbe83b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:50:51.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.421+0000 7f1dbe83b800 20 started sync module instance, tier type = 2024-05-08T18:50:51.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.421+0000 7f1dbe83b800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:50:51.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.421+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4760e90 con 0x7f1db4014070 2024-05-08T18:50:51.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.422+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dac036040 con 0x7f1db4014070 2024-05-08T18:50:51.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.422+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94221993644672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4762da0 con 0x7f1db4014070 2024-05-08T18:50:51.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.422+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c47635f0 con 0x55b1c4756da0 2024-05-08T18:50:51.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.423+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94221993644672] v25'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dac036040 con 0x7f1db4014070 2024-05-08T18:50:51.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.423+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da407d040 con 0x55b1c4756da0 2024-05-08T18:50:51.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.423+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94221993650416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4763630 con 0x55b1c4756da0 2024-05-08T18:50:51.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.423+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4764130 con 0x55b1c475b750 2024-05-08T18:50:51.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.424+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94221993650416] v25'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da407d040 con 0x55b1c4756da0 2024-05-08T18:50:51.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.424+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db402a070 con 0x55b1c475b750 2024-05-08T18:50:51.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.424+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94221993655328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c47640f0 con 0x55b1c475b750 2024-05-08T18:50:51.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.424+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4764bb0 con 0x7f1db4014070 2024-05-08T18:50:51.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.425+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94221993655328] v25'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db402a070 con 0x55b1c475b750 2024-05-08T18:50:51.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.425+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dac036040 con 0x7f1db4014070 2024-05-08T18:50:51.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.425+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94221993658048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4764fa0 con 0x7f1db4014070 2024-05-08T18:50:51.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.425+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4765a20 con 0x55b1c4756da0 2024-05-08T18:50:51.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.426+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da407d040 con 0x55b1c4756da0 2024-05-08T18:50:51.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.426+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94221993661712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c47662c0 con 0x55b1c4756da0 2024-05-08T18:50:51.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.426+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4766da0 con 0x7f1dac017050 2024-05-08T18:50:51.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.426+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94221993658048] v25'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dac036040 con 0x7f1db4014070 2024-05-08T18:50:51.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.427+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94221993661712] v25'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da407d040 con 0x55b1c4756da0 2024-05-08T18:50:51.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.428+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da407d040 con 0x7f1dac017050 2024-05-08T18:50:51.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.428+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94221993666736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4765d40 con 0x7f1dac017050 2024-05-08T18:50:51.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.428+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4767640 con 0x7f1dac017050 2024-05-08T18:50:51.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.429+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94221993666736] v25'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da407d040 con 0x7f1dac017050 2024-05-08T18:50:51.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.429+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da407d040 con 0x7f1dac017050 2024-05-08T18:50:51.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.429+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94221993652544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4765d40 con 0x7f1dac017050 2024-05-08T18:50:51.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.429+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4767bc0 con 0x7f1dac017050 2024-05-08T18:50:51.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.430+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94221993652544] v25'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da407d040 con 0x7f1dac017050 2024-05-08T18:50:51.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.430+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da407d040 con 0x7f1dac017050 2024-05-08T18:50:51.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.430+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94221993668704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4767b80 con 0x7f1dac017050 2024-05-08T18:50:51.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.430+0000 7f1dbe83b800 20 add_watcher() i=0 2024-05-08T18:50:51.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.430+0000 7f1dbe83b800 20 add_watcher() i=1 2024-05-08T18:50:51.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.430+0000 7f1dbe83b800 20 add_watcher() i=2 2024-05-08T18:50:51.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.430+0000 7f1dbe83b800 20 add_watcher() i=3 2024-05-08T18:50:51.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.430+0000 7f1dbe83b800 20 add_watcher() i=4 2024-05-08T18:50:51.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.430+0000 7f1dbe83b800 20 add_watcher() i=5 2024-05-08T18:50:51.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.430+0000 7f1dbe83b800 20 add_watcher() i=6 2024-05-08T18:50:51.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.431+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94221993668704] v25'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da407d040 con 0x7f1dac017050 2024-05-08T18:50:51.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.431+0000 7f1dbe83b800 20 add_watcher() i=7 2024-05-08T18:50:51.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.431+0000 7f1dbe83b800 2 all 8 watchers are set, enabling cache 2024-05-08T18:50:51.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.431+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c476afb0 con 0x55b1c4756da0 2024-05-08T18:50:51.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.431+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1da407d040 con 0x55b1c4756da0 2024-05-08T18:50:51.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.431+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94221993670816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c47684d0 con 0x55b1c4756da0 2024-05-08T18:50:51.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.434+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94221993670816] v25'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1da407d040 con 0x55b1c4756da0 2024-05-08T18:50:51.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.434+0000 7f1c72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:51.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.434+0000 7f1dbe83b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:50:51.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.434+0000 7f1dbe83b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:50:51.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.434+0000 7f1dbe83b800 5 note: GC not initialized 2024-05-08T18:50:51.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.434+0000 7f1c71fdb640 20 reqs_thread_entry: start 2024-05-08T18:50:51.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.434+0000 7f1dbe83b800 20 init_complete bucket index max shards: 11 2024-05-08T18:50:51.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.434+0000 7f1dbe83b800 20 Filter name: none 2024-05-08T18:50:51.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.434+0000 7f1be37fe640 20 reqs_thread_entry: start 2024-05-08T18:50:51.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.434+0000 7f1dbe83b800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:50:51.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.434+0000 7f1dbe83b800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.434+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c479e490 con 0x55b1c4756da0 2024-05-08T18:50:51.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.435+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1da407d040 con 0x55b1c4756da0 2024-05-08T18:50:51.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.435+0000 7f1dbe83b800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:50:51.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.435+0000 7f1dbe83b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:50:51.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.435+0000 7f1dbe83b800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:51.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.435+0000 7f1dbe83b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:51.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.435+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c47a0dc0 con 0x7f1db4014070 2024-05-08T18:50:51.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.435+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f1dac036040 con 0x7f1db4014070 2024-05-08T18:50:51.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.435+0000 7f1dbe83b800 20 enabling bucket name=myfoo 2024-05-08T18:50:51.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.435+0000 7f1dbe83b800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:50:51.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.435+0000 7f1dbe83b800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.435+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c479eda0 con 0x7f1db4014070 2024-05-08T18:50:51.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.436+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f1dac036040 con 0x7f1db4014070 2024-05-08T18:50:51.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.436+0000 7f1dbe83b800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:50:51.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.436+0000 7f1dbe83b800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-05-08T18:50:51.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.436+0000 7f1dbe83b800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:50:51.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.436+0000 7f1dbe83b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 : miss 2024-05-08T18:50:51.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.436+0000 7f1dbe83b800 20 rados->read ofs=0 len=0 2024-05-08T18:50:51.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.436+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:65 8.1e 8:7ec7f916:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c47a16e0 con 0x7f1dac017050 2024-05-08T18:50:51.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.436+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(65 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1da407d040 con 0x7f1dac017050 2024-05-08T18:50:51.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.436+0000 7f1dbe83b800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:50:51.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.436+0000 7f1dbe83b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 info.flags=0x17 2024-05-08T18:50:51.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.436+0000 7f1dbe83b800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 to cache LRU end 2024-05-08T18:50:51.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.436+0000 7f1dbe83b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:50:51.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.436+0000 7f1dbe83b800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:50:51.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.436+0000 7f1dbe83b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 2024-05-08T18:50:51.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.436+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:66 8.1e 8:7ec7f916:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c47a9220 con 0x7f1dac017050 2024-05-08T18:50:51.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.438+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(66 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v25'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f1da407d040 con 0x7f1dac017050 2024-05-08T18:50:51.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.438+0000 7f1dbe83b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 info.flags=0x17 2024-05-08T18:50:51.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.438+0000 7f1dbe83b800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 to cache LRU end 2024-05-08T18:50:51.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.438+0000 7f1dbe83b800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:50:51.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.438+0000 7f1dbe83b800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1, ofs0, ns] 2024-05-08T18:50:51.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.438+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94221993909632 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c47a37a0 con 0x7f1db4014070 2024-05-08T18:50:51.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.438+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== watch-notify(notify (1) cookie 94221993644672 notify 107374182426 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7f1dac05b060 con 0x7f1db4014070 2024-05-08T18:50:51.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.438+0000 7f1c937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182426 cookie 94221993644672 notifier 4592 bl.length()=752 2024-05-08T18:50:51.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.438+0000 7f1c937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 info.flags=0x17 2024-05-08T18:50:51.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.438+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(67 notify.0 [notify cookie 94221993909632 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1dac036040 con 0x7f1db4014070 2024-05-08T18:50:51.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.438+0000 7f1c937fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1 to cache LRU end 2024-05-08T18:50:51.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.438+0000 7f1c937fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:50:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.438+0000 7f1c937fe640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f1c88003ea0 con 0x7f1db4014070 2024-05-08T18:50:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.438+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dac036040 con 0x7f1db4014070 2024-05-08T18:50:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.438+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== watch-notify(notify_complete (2) cookie 94221993909632 notify 107374182426 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b1c471e810 con 0x7f1db4014070 2024-05-08T18:50:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.438+0000 7f1dbe83b800 20 handle_bi_update(): bucket=:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): orig_sources= new_sources= 2024-05-08T18:50:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.438+0000 7f1dbe83b800 20 handle_bi_update(): bucket=:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): potential sources added=[] removed=[] 2024-05-08T18:50:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.438+0000 7f1dbe83b800 20 handle_bi_update(): bucket=:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): orig_dests= new_dests= 2024-05-08T18:50:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.438+0000 7f1dbe83b800 20 handle_bi_update(): bucket=:myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1]): potential dests added=[] removed=[] 2024-05-08T18:50:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.438+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c479ff20 con 0x55b1c4756da0 2024-05-08T18:50:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.439+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v25'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1da407d040 con 0x55b1c4756da0 2024-05-08T18:50:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.439+0000 7f1dbe83b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.439+0000 7f1dbe83b800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.439+0000 7f1dbe83b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:50:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.439+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94221993903392 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55b1c479ff20 con 0x55b1c4756da0 2024-05-08T18:50:51.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.440+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== watch-notify(notify (1) cookie 94221993661712 notify 107374182415 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55b1c47a1ad0 con 0x55b1c4756da0 2024-05-08T18:50:51.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.440+0000 7f1c937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182415 cookie 94221993661712 notifier 4592 bl.length()=567 2024-05-08T18:50:51.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.440+0000 7f1c937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:50:51.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.440+0000 7f1c937fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:50:51.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.440+0000 7f1c937fe640 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f1c88003ea0 con 0x55b1c4756da0 2024-05-08T18:50:51.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.440+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(70 notify.4 [notify cookie 94221993903392 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1da407d040 con 0x55b1c4756da0 2024-05-08T18:50:51.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.440+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da407d040 con 0x55b1c4756da0 2024-05-08T18:50:51.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.440+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== watch-notify(notify_complete (2) cookie 94221993903392 notify 107374182415 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b1c47a0c20 con 0x55b1c4756da0 2024-05-08T18:50:51.451 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:50:44.835566Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:44.835553Z","tags":[],"group_ids":[]} 2024-05-08T18:50:51.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.441+0000 7f1c72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:50:51.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.441+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94221993670816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4752850 con 0x55b1c4756da0 2024-05-08T18:50:51.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.442+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94221993670816] v25'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1da407d040 con 0x55b1c4756da0 2024-05-08T18:50:51.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.442+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94221993644672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c479fd70 con 0x7f1db4014070 2024-05-08T18:50:51.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.443+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94221993644672] v25'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dac036040 con 0x7f1db4014070 2024-05-08T18:50:51.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.443+0000 7f1dbe83b800 20 remove_watcher() i=0 2024-05-08T18:50:51.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.443+0000 7f1dbe83b800 2 removed watcher, disabling cache 2024-05-08T18:50:51.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.443+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94221993650416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4761280 con 0x55b1c4756da0 2024-05-08T18:50:51.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.444+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94221993650416] v25'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da407d040 con 0x55b1c4756da0 2024-05-08T18:50:51.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.444+0000 7f1dbe83b800 20 remove_watcher() i=1 2024-05-08T18:50:51.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.444+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94221993655328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4761280 con 0x55b1c475b750 2024-05-08T18:50:51.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.445+0000 7f1dbcb34640 1 -- 172.21.15.132:0/3493024496 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94221993655328] v25'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1db402a070 con 0x55b1c475b750 2024-05-08T18:50:51.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.445+0000 7f1dbe83b800 20 remove_watcher() i=2 2024-05-08T18:50:51.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.445+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94221993658048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4761280 con 0x7f1db4014070 2024-05-08T18:50:51.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.446+0000 7f1dbc333640 1 -- 172.21.15.132:0/3493024496 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94221993658048] v25'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1dac036040 con 0x7f1db4014070 2024-05-08T18:50:51.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.446+0000 7f1dbe83b800 20 remove_watcher() i=3 2024-05-08T18:50:51.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.446+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94221993661712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4761280 con 0x55b1c4756da0 2024-05-08T18:50:51.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.447+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94221993661712] v25'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da407d040 con 0x55b1c4756da0 2024-05-08T18:50:51.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.447+0000 7f1dbe83b800 20 remove_watcher() i=4 2024-05-08T18:50:51.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.447+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94221993666736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4761280 con 0x7f1dac017050 2024-05-08T18:50:51.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.448+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94221993666736] v25'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da407d040 con 0x7f1dac017050 2024-05-08T18:50:51.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.448+0000 7f1dbe83b800 20 remove_watcher() i=5 2024-05-08T18:50:51.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.448+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94221993652544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c47668b0 con 0x7f1dac017050 2024-05-08T18:50:51.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.449+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94221993652544] v25'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da407d040 con 0x7f1dac017050 2024-05-08T18:50:51.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.449+0000 7f1dbe83b800 20 remove_watcher() i=6 2024-05-08T18:50:51.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.449+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94221993668704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55b1c4761280 con 0x7f1dac017050 2024-05-08T18:50:51.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.450+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94221993668704] v25'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1da407d040 con 0x7f1dac017050 2024-05-08T18:50:51.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.450+0000 7f1dbe83b800 20 remove_watcher() i=7 2024-05-08T18:50:51.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.450+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1dac017050 msgr2=0x7f1dac03d7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.450+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/3493024496 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1dac017050 0x7f1dac03d7c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.450+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55b1c4756da0 msgr2=0x55b1c4759260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.450+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/3493024496 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55b1c4756da0 0x55b1c4759260 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.450+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1db4014070 msgr2=0x7f1db4001520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.450+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/3493024496 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1db4014070 0x7f1db4001520 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.450+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55b1c475b750 msgr2=0x55b1c475db40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.450+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/3493024496 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55b1c475b750 0x55b1c475db40 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.450+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c8403bb50 msgr2=0x7f1c8403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.450+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/3493024496 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c8403bb50 0x7f1c8403e010 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1dac041010 tx=0x7f1dac04e000 comp rx=0 tx=0).stop 2024-05-08T18:50:51.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.450+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c4743b80 msgr2=0x55b1c474b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.450+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/3493024496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c4743b80 0x55b1c474b0b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1db40014b0 tx=0x7f1db4052bb0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.450+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 reap_dead start 2024-05-08T18:50:51.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.450+0000 7f1db3fff640 1 -- 172.21.15.132:0/3493024496 reap_dead start 2024-05-08T18:50:51.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.450+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 shutdown_connections 2024-05-08T18:50:51.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.450+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 >> 172.21.15.132:0/3493024496 conn(0x55b1c473fe50 msgr2=0x55b1c473d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:51.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 shutdown_connections 2024-05-08T18:50:51.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3493024496 wait complete. 2024-05-08T18:50:51.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 -- 172.21.15.132:0/4063332306 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c9403bba0 msgr2=0x7f1c9403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/4063332306 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c9403bba0 0x7f1c9403e060 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55b1c4722fb0 tx=0x7f1dac04c040 comp rx=0 tx=0).stop 2024-05-08T18:50:51.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 -- 172.21.15.132:0/4063332306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c47368c0 msgr2=0x55b1c4736ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/4063332306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c47368c0 0x55b1c4736ce0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x55b1c4722f10 tx=0x7f1db4018830 comp rx=0 tx=0).stop 2024-05-08T18:50:51.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 -- 172.21.15.132:0/4063332306 shutdown_connections 2024-05-08T18:50:51.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/4063332306 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1c9403bba0 0x7f1c9403e060 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/4063332306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c47368c0 0x55b1c4736ce0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 -- 172.21.15.132:0/4063332306 >> 172.21.15.132:0/4063332306 conn(0x55b1c472a960 msgr2=0x55b1c472ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:51.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 -- 172.21.15.132:0/4063332306 shutdown_connections 2024-05-08T18:50:51.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 -- 172.21.15.132:0/4063332306 wait complete. 2024-05-08T18:50:51.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3590055614 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55b1c46235d0 msgr2=0x55b1c47225d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/3590055614 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55b1c46235d0 0x55b1c47225d0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3590055614 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55b1c4724e60 msgr2=0x55b1c4727250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/3590055614 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55b1c4724e60 0x55b1c4727250 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3590055614 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1ca403bba0 msgr2=0x7f1ca403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/3590055614 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1ca403bba0 0x7f1ca403e060 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1da4054000 tx=0x7f1da404e000 comp rx=0 tx=0).stop 2024-05-08T18:50:51.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3590055614 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c461f140 msgr2=0x55b1c471b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:50:51.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/3590055614 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c461f140 0x55b1c471b390 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00b7c0 tx=0x7f1dac000ed0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3590055614 shutdown_connections 2024-05-08T18:50:51.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/3590055614 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55b1c4724e60 0x55b1c4727250 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/3590055614 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55b1c46235d0 0x55b1c47225d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/3590055614 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1ca403bba0 0x7f1ca403e060 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 --2- 172.21.15.132:0/3590055614 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b1c461f140 0x55b1c471b390 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:50:51.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3590055614 >> 172.21.15.132:0/3590055614 conn(0x55b1c461a720 msgr2=0x55b1c4592920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:50:51.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.451+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3590055614 shutdown_connections 2024-05-08T18:50:51.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:50:51.452+0000 7f1dbe83b800 1 -- 172.21.15.132:0/3590055614 wait complete. 2024-05-08T18:50:51.463 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:50:44.835566Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:44.835553Z', 'tags': [], 'group_ids': []} 2024-05-08T18:50:51.468 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-08T18:50:51.718 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-05-08T18:50:51.725 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:51:06.726 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-05-08T18:51:06.726 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-05-08T18:51:06.726 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-05-08T18:51:06.777 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:06.777 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:06.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.779+0000 7f7d74933800 1 Processor -- start 2024-05-08T18:51:06.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.779+0000 7f7d74933800 1 -- start start 2024-05-08T18:51:06.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.779+0000 7f7d74933800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55c9ef1c0750 0x55c9ef1c0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:06.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.779+0000 7f7d74933800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c9ef1c11f0 con 0x55c9ef1bf410 2024-05-08T18:51:06.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.779+0000 7f7d74933800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55c9ef060e20 con 0x55c9ef1c0750 2024-05-08T18:51:06.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.779+0000 7f7d705ca640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55c9ef1c0750 0x55c9ef1c0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:06.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.779+0000 7f7d6fdc9640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55c9ef1bf410 0x55c9ef1bf8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:55680/0 (socket says 172.21.15.132:55680) 2024-05-08T18:51:06.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.779+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2601833359 learned_addr learned my addr 172.21.15.132:0/2601833359 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:51:06.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.780+0000 7f7d6f5c8640 1 -- 172.21.15.132:0/2601833359 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2020142474 0 0) 0x55c9ef1c11f0 con 0x55c9ef1bf410 2024-05-08T18:51:06.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.780+0000 7f7d6f5c8640 1 -- 172.21.15.132:0/2601833359 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d5c001e10 con 0x55c9ef1bf410 2024-05-08T18:51:06.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.780+0000 7f7d705ca640 1 -- 172.21.15.132:0/2601833359 >> v1:172.21.15.42:6789/0 conn(0x55c9ef1bf410 legacy=0x55c9ef1bf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:06.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.780+0000 7f7d705ca640 1 -- 172.21.15.132:0/2601833359 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9ef1bffd0 con 0x55c9ef1c0750 2024-05-08T18:51:06.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.782+0000 7f7d705ca640 1 --2- 172.21.15.132:0/2601833359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef1c0750 0x55c9ef1c0b70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000a470 tx=0x7f7d6001cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0bfc07356ebd071 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:06.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.782+0000 7f7d6f5c8640 1 -- 172.21.15.132:0/2601833359 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d60057070 con 0x55c9ef1c0750 2024-05-08T18:51:06.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.782+0000 7f7d6f5c8640 1 -- 172.21.15.132:0/2601833359 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d60052570 con 0x55c9ef1c0750 2024-05-08T18:51:06.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.782+0000 7f7d6f5c8640 1 -- 172.21.15.132:0/2601833359 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d60052850 con 0x55c9ef1c0750 2024-05-08T18:51:06.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.782+0000 7f7d74933800 1 -- 172.21.15.132:0/2601833359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef1c0750 msgr2=0x55c9ef1c0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:06.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.782+0000 7f7d74933800 1 --2- 172.21.15.132:0/2601833359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef1c0750 0x55c9ef1c0b70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000a470 tx=0x7f7d6001cdb0 comp rx=0 tx=0).stop 2024-05-08T18:51:06.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.782+0000 7f7d74933800 1 -- 172.21.15.132:0/2601833359 shutdown_connections 2024-05-08T18:51:06.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.782+0000 7f7d74933800 1 --2- 172.21.15.132:0/2601833359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef1c0750 0x55c9ef1c0b70 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:06.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.783+0000 7f7d74933800 1 -- 172.21.15.132:0/2601833359 >> 172.21.15.132:0/2601833359 conn(0x55c9ef1b9ea0 msgr2=0x55c9ef1bc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:06.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.783+0000 7f7d74933800 1 -- 172.21.15.132:0/2601833359 shutdown_connections 2024-05-08T18:51:06.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.783+0000 7f7d74933800 1 -- 172.21.15.132:0/2601833359 wait complete. 2024-05-08T18:51:06.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.798+0000 7f7d74933800 1 Processor -- start 2024-05-08T18:51:06.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.799+0000 7f7d74933800 1 -- start start 2024-05-08T18:51:06.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.799+0000 7f7d74933800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef1bf410 0x55c9ef1bee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:06.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.799+0000 7f7d74933800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c9ef10b5b0 con 0x55c9ef1bf410 2024-05-08T18:51:06.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.799+0000 7f7d705ca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef1bf410 0x55c9ef1bee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:06.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.799+0000 7f7d705ca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef1bf410 0x55c9ef1bee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51174/0 (socket says 172.21.15.132:51174) 2024-05-08T18:51:06.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.799+0000 7f7d705ca640 1 -- 172.21.15.132:0/29570660 learned_addr learned my addr 172.21.15.132:0/29570660 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:06.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.799+0000 7f7d705ca640 1 -- 172.21.15.132:0/29570660 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9ef2b42c0 con 0x55c9ef1bf410 2024-05-08T18:51:06.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.800+0000 7f7d705ca640 1 --2- 172.21.15.132:0/29570660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef1bf410 0x55c9ef1bee40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7d6001cdf0 tx=0x7f7d6004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb8d24801095894 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:06.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.800+0000 7f7c5e60c640 1 -- 172.21.15.132:0/29570660 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d60057040 con 0x55c9ef1bf410 2024-05-08T18:51:06.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.800+0000 7f7c5e60c640 1 -- 172.21.15.132:0/29570660 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d60052950 con 0x55c9ef1bf410 2024-05-08T18:51:06.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.800+0000 7f7c5e60c640 1 -- 172.21.15.132:0/29570660 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d60052c70 con 0x55c9ef1bf410 2024-05-08T18:51:06.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.801+0000 7f7d74933800 1 -- 172.21.15.132:0/29570660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef1bf410 msgr2=0x55c9ef1bee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:06.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.801+0000 7f7d74933800 1 --2- 172.21.15.132:0/29570660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef1bf410 0x55c9ef1bee40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7d6001cdf0 tx=0x7f7d6004c000 comp rx=0 tx=0).stop 2024-05-08T18:51:06.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.801+0000 7f7d74933800 1 -- 172.21.15.132:0/29570660 shutdown_connections 2024-05-08T18:51:06.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.801+0000 7f7d74933800 1 --2- 172.21.15.132:0/29570660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef1bf410 0x55c9ef1bee40 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:06.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.801+0000 7f7d74933800 1 -- 172.21.15.132:0/29570660 >> 172.21.15.132:0/29570660 conn(0x55c9ef1b9ea0 msgr2=0x55c9ef2abdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:06.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.801+0000 7f7d74933800 1 -- 172.21.15.132:0/29570660 shutdown_connections 2024-05-08T18:51:06.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.801+0000 7f7d74933800 1 -- 172.21.15.132:0/29570660 wait complete. 2024-05-08T18:51:06.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.801+0000 7f7d74933800 1 Processor -- start 2024-05-08T18:51:06.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.801+0000 7f7d74933800 1 -- start start 2024-05-08T18:51:06.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.801+0000 7f7d74933800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef1bf410 0x55c9ef2b8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:06.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.801+0000 7f7d74933800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c9ef1c8920 con 0x55c9ef1bf410 2024-05-08T18:51:06.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.802+0000 7f7d705ca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef1bf410 0x55c9ef2b8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:06.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.802+0000 7f7d705ca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef1bf410 0x55c9ef2b8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51182/0 (socket says 172.21.15.132:51182) 2024-05-08T18:51:06.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.802+0000 7f7d705ca640 1 -- 172.21.15.132:0/3886953605 learned_addr learned my addr 172.21.15.132:0/3886953605 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:06.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.802+0000 7f7d705ca640 1 -- 172.21.15.132:0/3886953605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9ef2b94d0 con 0x55c9ef1bf410 2024-05-08T18:51:06.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.802+0000 7f7d705ca640 1 --2- 172.21.15.132:0/3886953605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef1bf410 0x55c9ef2b8f90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7d60005870 tx=0x7f7d60003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:06.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.802+0000 7f7c5ce09640 1 -- 172.21.15.132:0/3886953605 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d60073070 con 0x55c9ef1bf410 2024-05-08T18:51:06.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.802+0000 7f7c5ce09640 1 -- 172.21.15.132:0/3886953605 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d6005d570 con 0x55c9ef1bf410 2024-05-08T18:51:06.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.802+0000 7f7d74933800 1 -- 172.21.15.132:0/3886953605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9ef2b9760 con 0x55c9ef1bf410 2024-05-08T18:51:06.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.802+0000 7f7c5ce09640 1 -- 172.21.15.132:0/3886953605 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d60057070 con 0x55c9ef1bf410 2024-05-08T18:51:06.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.803+0000 7f7d74933800 1 -- 172.21.15.132:0/3886953605 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9ef2bc410 con 0x55c9ef1bf410 2024-05-08T18:51:06.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.803+0000 7f7c5ce09640 1 -- 172.21.15.132:0/3886953605 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f7d60076070 con 0x55c9ef1bf410 2024-05-08T18:51:06.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.804+0000 7f7c5ce09640 1 --2- 172.21.15.132:0/3886953605 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7c5803bb50 0x7f7c5803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:06.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.804+0000 7f7c5ce09640 1 -- 172.21.15.132:0/3886953605 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f7d60093fa0 con 0x55c9ef1bf410 2024-05-08T18:51:06.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.804+0000 7f7d6fdc9640 1 --2- 172.21.15.132:0/3886953605 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7c5803bb50 0x7f7c5803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:06.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.804+0000 7f7d74933800 1 --2- 172.21.15.132:0/3886953605 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c9ef1c0750 0x55c9ef2c01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:06.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.804+0000 7f7d74933800 1 -- 172.21.15.132:0/3886953605 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2c0710 con 0x55c9ef1c0750 2024-05-08T18:51:06.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.804+0000 7f7d70dcb640 1 --2- 172.21.15.132:0/3886953605 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c9ef1c0750 0x55c9ef2c01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:06.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.804+0000 7f7d6fdc9640 1 --2- 172.21.15.132:0/3886953605 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7c5803bb50 0x7f7c5803e010 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7d58000f60 tx=0x7f7d580010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:06.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.804+0000 7f7d70dcb640 1 --2- 172.21.15.132:0/3886953605 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c9ef1c0750 0x55c9ef2c01d0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:06.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.805+0000 7f7d70dcb640 1 -- 172.21.15.132:0/3886953605 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d6800a4a0 con 0x55c9ef1c0750 2024-05-08T18:51:06.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.805+0000 7f7d74933800 1 -- 172.21.15.132:0/3886953605 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2bd780 con 0x55c9ef1c0750 2024-05-08T18:51:06.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.805+0000 7f7d70dcb640 1 -- 172.21.15.132:0/3886953605 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d6800a4a0 con 0x55c9ef1c0750 2024-05-08T18:51:06.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.805+0000 7f7d74933800 1 --2- 172.21.15.132:0/3886953605 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c9ef2c2a90 0x55c9ef2c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:06.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.805+0000 7f7d74933800 1 -- 172.21.15.132:0/3886953605 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2c5520 con 0x55c9ef2c2a90 2024-05-08T18:51:06.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.805+0000 7f7d705ca640 1 --2- 172.21.15.132:0/3886953605 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c9ef2c2a90 0x55c9ef2c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:06.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.805+0000 7f7d705ca640 1 --2- 172.21.15.132:0/3886953605 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c9ef2c2a90 0x55c9ef2c4e80 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:06.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.806+0000 7f7d705ca640 1 -- 172.21.15.132:0/3886953605 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7d60075030 con 0x55c9ef2c2a90 2024-05-08T18:51:06.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.806+0000 7f7d74933800 1 -- 172.21.15.132:0/3886953605 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2c1900 con 0x55c9ef1c0750 2024-05-08T18:51:06.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.806+0000 7f7d70dcb640 1 -- 172.21.15.132:0/3886953605 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d6800a4a0 con 0x55c9ef1c0750 2024-05-08T18:51:06.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.806+0000 7f7d74933800 1 -- 172.21.15.132:0/3886953605 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2c1de0 con 0x55c9ef1c0750 2024-05-08T18:51:06.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.806+0000 7f7d70dcb640 1 -- 172.21.15.132:0/3886953605 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7d6800a4a0 con 0x55c9ef1c0750 2024-05-08T18:51:06.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.807+0000 7f7d74933800 1 Processor -- start 2024-05-08T18:51:06.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.807+0000 7f7d74933800 1 -- start start 2024-05-08T18:51:06.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.807+0000 7f7d74933800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef2d44b0 0x55c9ef2d48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:06.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.807+0000 7f7d74933800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c9ef0b1fc0 con 0x55c9ef2d44b0 2024-05-08T18:51:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.807+0000 7f7d70dcb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef2d44b0 0x55c9ef2d48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.807+0000 7f7d70dcb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef2d44b0 0x55c9ef2d48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51192/0 (socket says 172.21.15.132:51192) 2024-05-08T18:51:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.807+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2138694109 learned_addr learned my addr 172.21.15.132:0/2138694109 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.808+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2138694109 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9ef2d4e10 con 0x55c9ef2d44b0 2024-05-08T18:51:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.808+0000 7f7d70dcb640 1 --2- 172.21.15.132:0/2138694109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef2d44b0 0x55c9ef2d48d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x55c9ef2c0b10 tx=0x7f7d68018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.808+0000 7f7c55ffb640 1 -- 172.21.15.132:0/2138694109 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d68014450 con 0x55c9ef2d44b0 2024-05-08T18:51:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.808+0000 7f7c55ffb640 1 -- 172.21.15.132:0/2138694109 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d680145f0 con 0x55c9ef2d44b0 2024-05-08T18:51:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.808+0000 7f7d74933800 1 -- 172.21.15.132:0/2138694109 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9ef2d5880 con 0x55c9ef2d44b0 2024-05-08T18:51:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.808+0000 7f7c55ffb640 1 -- 172.21.15.132:0/2138694109 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d680148d0 con 0x55c9ef2d44b0 2024-05-08T18:51:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.808+0000 7f7d74933800 1 -- 172.21.15.132:0/2138694109 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9ef2d5d80 con 0x55c9ef2d44b0 2024-05-08T18:51:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.809+0000 7f7c55ffb640 1 -- 172.21.15.132:0/2138694109 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f7d68011040 con 0x55c9ef2d44b0 2024-05-08T18:51:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.809+0000 7f7c55ffb640 1 --2- 172.21.15.132:0/2138694109 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7c4803bb50 0x7f7c4803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:06.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.809+0000 7f7c55ffb640 1 -- 172.21.15.132:0/2138694109 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f7d6801e070 con 0x55c9ef2d44b0 2024-05-08T18:51:06.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.809+0000 7f7d705ca640 1 --2- 172.21.15.132:0/2138694109 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7c4803bb50 0x7f7c4803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:06.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.810+0000 7f7d74933800 1 Processor -- start 2024-05-08T18:51:06.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.810+0000 7f7d705ca640 1 --2- 172.21.15.132:0/2138694109 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7c4803bb50 0x7f7c4803e010 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7d60007000 tx=0x7f7d60006e90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:06.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.810+0000 7f7d74933800 1 -- start start 2024-05-08T18:51:06.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.810+0000 7f7d74933800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef2e3660 0x55c9ef2e3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:06.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.810+0000 7f7d74933800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c9ef2b4550 con 0x55c9ef2e3660 2024-05-08T18:51:06.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.810+0000 7f7d70dcb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef2e3660 0x55c9ef2e3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:06.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.810+0000 7f7d70dcb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef2e3660 0x55c9ef2e3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51200/0 (socket says 172.21.15.132:51200) 2024-05-08T18:51:06.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.810+0000 7f7d70dcb640 1 -- 172.21.15.132:0/842329110 learned_addr learned my addr 172.21.15.132:0/842329110 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:06.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.811+0000 7f7d70dcb640 1 -- 172.21.15.132:0/842329110 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9ef2e4050 con 0x55c9ef2e3660 2024-05-08T18:51:06.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.811+0000 7f7d70dcb640 1 --2- 172.21.15.132:0/842329110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef2e3660 0x55c9ef2e3a80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7d68018430 tx=0x7f7d680118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ebd9db38a8323a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:06.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.811+0000 7f7c4f7fe640 1 -- 172.21.15.132:0/842329110 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d68044020 con 0x55c9ef2e3660 2024-05-08T18:51:06.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.811+0000 7f7c4f7fe640 1 -- 172.21.15.132:0/842329110 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d68011d30 con 0x55c9ef2e3660 2024-05-08T18:51:06.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.811+0000 7f7c4f7fe640 1 -- 172.21.15.132:0/842329110 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d68022db0 con 0x55c9ef2e3660 2024-05-08T18:51:06.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.811+0000 7f7d74933800 1 -- 172.21.15.132:0/842329110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef2e3660 msgr2=0x55c9ef2e3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:06.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.811+0000 7f7d74933800 1 --2- 172.21.15.132:0/842329110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef2e3660 0x55c9ef2e3a80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7d68018430 tx=0x7f7d680118e0 comp rx=0 tx=0).stop 2024-05-08T18:51:06.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.811+0000 7f7d74933800 1 -- 172.21.15.132:0/842329110 shutdown_connections 2024-05-08T18:51:06.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.811+0000 7f7d74933800 1 --2- 172.21.15.132:0/842329110 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef2e3660 0x55c9ef2e3a80 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:06.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.811+0000 7f7d74933800 1 -- 172.21.15.132:0/842329110 >> 172.21.15.132:0/842329110 conn(0x55c9ef2b0320 msgr2=0x55c9ef2b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:06.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.811+0000 7f7d74933800 1 -- 172.21.15.132:0/842329110 shutdown_connections 2024-05-08T18:51:06.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.812+0000 7f7d74933800 1 -- 172.21.15.132:0/842329110 wait complete. 2024-05-08T18:51:06.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.812+0000 7f7d74933800 1 Processor -- start 2024-05-08T18:51:06.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.812+0000 7f7d74933800 1 -- start start 2024-05-08T18:51:06.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.812+0000 7f7d74933800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef2e3660 0x55c9ef2eaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:06.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.812+0000 7f7d74933800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55c9ef2e4af0 con 0x55c9ef2e3660 2024-05-08T18:51:06.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.812+0000 7f7d70dcb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef2e3660 0x55c9ef2eaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:06.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.812+0000 7f7d70dcb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef2e3660 0x55c9ef2eaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51208/0 (socket says 172.21.15.132:51208) 2024-05-08T18:51:06.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.812+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 learned_addr learned my addr 172.21.15.132:0/2195101204 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:06.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.812+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9ef2eb3f0 con 0x55c9ef2e3660 2024-05-08T18:51:06.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.813+0000 7f7d70dcb640 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef2e3660 0x55c9ef2eaeb0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7d68018430 tx=0x7f7d68052cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:06.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.813+0000 7f7c4dffb640 1 -- 172.21.15.132:0/2195101204 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d68040890 con 0x55c9ef2e3660 2024-05-08T18:51:06.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.813+0000 7f7c4dffb640 1 -- 172.21.15.132:0/2195101204 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d68040a30 con 0x55c9ef2e3660 2024-05-08T18:51:06.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.813+0000 7f7c4dffb640 1 -- 172.21.15.132:0/2195101204 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d68040d10 con 0x55c9ef2e3660 2024-05-08T18:51:06.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.813+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9ef2eb680 con 0x55c9ef2e3660 2024-05-08T18:51:06.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.813+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9ef2ee330 con 0x55c9ef2e3660 2024-05-08T18:51:06.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.814+0000 7f7c4dffb640 1 -- 172.21.15.132:0/2195101204 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f7d68051170 con 0x55c9ef2e3660 2024-05-08T18:51:06.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.814+0000 7f7c4dffb640 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7c4003bb50 0x7f7c4003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:06.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.814+0000 7f7d74933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:06.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.814+0000 7f7c4dffb640 1 -- 172.21.15.132:0/2195101204 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f7d6800e040 con 0x55c9ef2e3660 2024-05-08T18:51:06.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.814+0000 7f7d705ca640 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7c4003bb50 0x7f7c4003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:06.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.814+0000 7f7d74933800 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c9ef2f6ba0 0x55c9ef2f9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:06.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.814+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2f9790 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.815+0000 7f7d6fdc9640 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c9ef2f6ba0 0x55c9ef2f9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:06.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.815+0000 7f7d705ca640 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7c4003bb50 0x7f7c4003e010 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7d600912a0 tx=0x7f7d6007f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:06.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.815+0000 7f7d6fdc9640 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c9ef2f6ba0 0x55c9ef2f9040 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:06.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.815+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d58009050 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.815+0000 7f7d74933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:06.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.815+0000 7f7d74933800 20 realm 2024-05-08T18:51:06.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.815+0000 7f7d74933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:06.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.815+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2f6070 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.816+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d58009050 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.816+0000 7f7d74933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:06.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.816+0000 7f7d74933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:06.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.816+0000 7f7d74933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:06.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.816+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2fa270 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.816+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d58009050 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.816+0000 7f7d74933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:06.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.816+0000 7f7d74933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:06.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.816+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2fab40 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.816+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d58009050 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.816+0000 7f7d74933800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:06.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.816+0000 7f7d74933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:06.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.816+0000 7f7d74933800 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c9ef2fb440 0x55c9ef2fd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:06.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.816+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2fdf90 con 0x55c9ef2fb440 2024-05-08T18:51:06.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.816+0000 7f7d70dcb640 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c9ef2fb440 0x55c9ef2fd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:06.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.817+0000 7f7d70dcb640 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c9ef2fb440 0x55c9ef2fd830 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:06.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.817+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.817+0000 7f7d74933800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:06.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.817+0000 7f7d74933800 20 searching for the correct realm 2024-05-08T18:51:06.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.817+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x55c9ef2fb440 2024-05-08T18:51:06.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.817+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.817+0000 7f7d70dcb640 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f7d68014070 0x7f7d6802f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:06.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.817+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x7f7d68014070 2024-05-08T18:51:06.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.818+0000 7f7d705ca640 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f7d68014070 0x7f7d6802f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:06.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.818+0000 7f7d705ca640 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f7d68014070 0x7f7d6802f980 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:06.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.818+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.818+0000 7f7d705ca640 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f7d600a3040 0x7f7d60092860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:06.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.818+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x7f7d600a3040 2024-05-08T18:51:06.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.818+0000 7f7d6fdc9640 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f7d600a3040 0x7f7d60092860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:06.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.819+0000 7f7d6fdc9640 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f7d600a3040 0x7f7d60092860 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:06.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.819+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d58009050 con 0x7f7d600a3040 2024-05-08T18:51:06.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.819+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.819+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d58009050 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.819+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.820+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.820+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x7f7d600a3040 2024-05-08T18:51:06.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.820+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.820+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x7f7d600a3040 2024-05-08T18:51:06.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.820+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.820+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x7f7d68014070 2024-05-08T18:51:06.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.821+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.821+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x55c9ef2fb440 2024-05-08T18:51:06.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.821+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.821+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.821+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.821+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x7f7d600a3040 2024-05-08T18:51:06.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.822+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.822+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.822+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.822+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x7f7d68014070 2024-05-08T18:51:06.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.822+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.822+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x55c9ef2fb440 2024-05-08T18:51:06.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.822+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.822+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x55c9ef2fb440 2024-05-08T18:51:06.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.823+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.823+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x7f7d600a3040 2024-05-08T18:51:06.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.823+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.823+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x55c9ef2fb440 2024-05-08T18:51:06.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.823+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.823+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x55c9ef2fb440 2024-05-08T18:51:06.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.823+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.823+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.824+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.824+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.824+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.824+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x7f7d600a3040 2024-05-08T18:51:06.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.824+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.824+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x55c9ef2fb440 2024-05-08T18:51:06.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.825+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.825+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x7f7d68014070 2024-05-08T18:51:06.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.825+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.825+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.825+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.825+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x7f7d600a3040 2024-05-08T18:51:06.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.825+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.826+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x55c9ef2fb440 2024-05-08T18:51:06.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.826+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.826+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x7f7d600a3040 2024-05-08T18:51:06.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.826+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.826+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x7f7d68014070 2024-05-08T18:51:06.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.826+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.826+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x55c9ef2fb440 2024-05-08T18:51:06.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.827+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.827+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x7f7d600a3040 2024-05-08T18:51:06.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.827+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.827+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.827+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.827+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff970 con 0x7f7d68014070 2024-05-08T18:51:06.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.828+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.828+0000 7f7d74933800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:06.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.828+0000 7f7d74933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:06.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.828+0000 7f7d74933800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:06.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.828+0000 7f7d74933800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:06.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.828+0000 7f7d74933800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:06.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.828+0000 7f7d74933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:06.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.828+0000 7f7d74933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:06.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.828+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2fea40 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.828+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.828+0000 7f7d74933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:06.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.828+0000 7f7d74933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:06.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.828+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2ff2e0 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.828+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.828+0000 7f7d74933800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:06.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.828+0000 7f7d74933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:06.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.828+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef2fe680 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.829+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.829+0000 7f7d74933800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:06.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.829+0000 7f7d74933800 20 zone default found 2024-05-08T18:51:06.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.829+0000 7f7d74933800 4 Realm: () 2024-05-08T18:51:06.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.829+0000 7f7d74933800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:06.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.829+0000 7f7d74933800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:06.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.829+0000 7f7d74933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:06.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.829+0000 7f7d74933800 20 zonegroup default 2024-05-08T18:51:06.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.829+0000 7f7d74933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:06.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.829+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3002f0 con 0x7f7d600a3040 2024-05-08T18:51:06.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.829+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.829+0000 7f7d74933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:06.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.829+0000 7f7d74933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:06.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.829+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef301d30 con 0x55c9ef2fb440 2024-05-08T18:51:06.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.829+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.829+0000 7f7d74933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:06.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.829+0000 7f7d74933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:06.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.829+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3021e0 con 0x55c9ef2fb440 2024-05-08T18:51:06.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.830+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.830+0000 7f7d74933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:06.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.830+0000 7f7d74933800 20 started sync module instance, tier type = 2024-05-08T18:51:06.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.830+0000 7f7d74933800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:06.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.830+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef301110 con 0x7f7d68014070 2024-05-08T18:51:06.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.831+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.831+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94325789690976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef302640 con 0x7f7d68014070 2024-05-08T18:51:06.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.831+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef302e90 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.832+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94325789690976] v25'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.832+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.832+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94325789698528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3032b0 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.832+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef303c70 con 0x55c9ef2fb440 2024-05-08T18:51:06.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.834+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94325789698528] v25'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.834+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.834+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94325789700064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef303c70 con 0x55c9ef2fb440 2024-05-08T18:51:06.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.834+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef304630 con 0x7f7d68014070 2024-05-08T18:51:06.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.835+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94325789700064] v25'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.836+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.836+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94325789702080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef303be0 con 0x7f7d68014070 2024-05-08T18:51:06.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.836+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3054f0 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.837+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94325789702080] v25'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.837+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.837+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94325789708352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef305910 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.837+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3062d0 con 0x7f7d600a3040 2024-05-08T18:51:06.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.838+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94325789708352] v25'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.839+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.839+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94325789709888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3062d0 con 0x7f7d600a3040 2024-05-08T18:51:06.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.839+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef306c90 con 0x7f7d600a3040 2024-05-08T18:51:06.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.840+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(56 notify.6 [create] v25'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.840+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94325789714400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3070b0 con 0x7f7d600a3040 2024-05-08T18:51:06.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.840+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef307bd0 con 0x7f7d600a3040 2024-05-08T18:51:06.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.840+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94325789709888] v25'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.841+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94325789714400] v25'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.841+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.841+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94325789718176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef306c00 con 0x7f7d600a3040 2024-05-08T18:51:06.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.841+0000 7f7d74933800 20 add_watcher() i=0 2024-05-08T18:51:06.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.841+0000 7f7d74933800 20 add_watcher() i=1 2024-05-08T18:51:06.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.841+0000 7f7d74933800 20 add_watcher() i=2 2024-05-08T18:51:06.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.841+0000 7f7d74933800 20 add_watcher() i=3 2024-05-08T18:51:06.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.841+0000 7f7d74933800 20 add_watcher() i=4 2024-05-08T18:51:06.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.841+0000 7f7d74933800 20 add_watcher() i=5 2024-05-08T18:51:06.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.841+0000 7f7d74933800 20 add_watcher() i=6 2024-05-08T18:51:06.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.842+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94325789718176] v25'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.842+0000 7f7d74933800 20 add_watcher() i=7 2024-05-08T18:51:06.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.842+0000 7f7d74933800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:06.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.842+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef30acd0 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.843+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.843+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94325789711904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef308150 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.844+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94325789711904] v25'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.844+0000 7f7c267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:06.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.844+0000 7f7d74933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:06.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.844+0000 7f7d74933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:06.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.844+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3130f0 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.845+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v25'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.845+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3136b0 con 0x7f7d600a3040 2024-05-08T18:51:06.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.846+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v25'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.847+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef313a90 con 0x55c9ef2fb440 2024-05-08T18:51:06.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.848+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v25'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.848+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef313a80 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.849+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v25'153 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.849+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3140b0 con 0x7f7d68014070 2024-05-08T18:51:06.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.850+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v25'44 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.850+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314900 con 0x55c9ef2fb440 2024-05-08T18:51:06.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.851+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v25'30 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.851+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314900 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.852+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v25'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.852+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314900 con 0x7f7d600a3040 2024-05-08T18:51:06.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.853+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v25'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.853+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314990 con 0x7f7d68014070 2024-05-08T18:51:06.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.854+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v25'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.854+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3149d0 con 0x55c9ef2fb440 2024-05-08T18:51:06.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.855+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v25'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.855+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314ac0 con 0x7f7d68014070 2024-05-08T18:51:06.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.856+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v25'45 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.856+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314ec0 con 0x7f7d600a3040 2024-05-08T18:51:06.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.858+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v25'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.858+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314ec0 con 0x7f7d68014070 2024-05-08T18:51:06.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.859+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v25'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.859+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314ec0 con 0x7f7d600a3040 2024-05-08T18:51:06.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.860+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v25'35 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.860+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314ec0 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.861+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v25'154 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.861+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314ec0 con 0x55c9ef2fb440 2024-05-08T18:51:06.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.863+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v25'38 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.863+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314ec0 con 0x7f7d68014070 2024-05-08T18:51:06.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.864+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v25'46 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.864+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314ec0 con 0x55c9ef2fb440 2024-05-08T18:51:06.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.865+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v25'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.865+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314ec0 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.866+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v25'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.866+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314ec0 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.867+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v25'155 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.867+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314ec0 con 0x55c9ef2fb440 2024-05-08T18:51:06.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.868+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v25'39 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.868+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314ec0 con 0x7f7d68014070 2024-05-08T18:51:06.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.869+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v25'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.869+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314ec0 con 0x55c9ef2fb440 2024-05-08T18:51:06.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.870+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v25'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.870+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314ec0 con 0x55c9ef2fb440 2024-05-08T18:51:06.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.871+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v25'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.871+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314ec0 con 0x55c9ef2fb440 2024-05-08T18:51:06.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.872+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v25'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.872+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314ec0 con 0x55c9ef2fb440 2024-05-08T18:51:06.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.873+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v25'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.873+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314ec0 con 0x7f7d600a3040 2024-05-08T18:51:06.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.874+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v25'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.874+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314ec0 con 0x55c9ef2fb440 2024-05-08T18:51:06.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.875+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v25'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.875+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314ec0 con 0x7f7d600a3040 2024-05-08T18:51:06.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.876+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v25'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.876+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314ec0 con 0x55c9ef2fb440 2024-05-08T18:51:06.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.877+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v25'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.877+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314ec0 con 0x7f7d600a3040 2024-05-08T18:51:06.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.878+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v25'36 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.878+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef314ec0 con 0x7f7d68014070 2024-05-08T18:51:06.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.880+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v25'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.880+0000 7f7c257e2640 20 reqs_thread_entry: start 2024-05-08T18:51:06.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.880+0000 7f7d74933800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:06.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.880+0000 7f7d74933800 20 Filter name: none 2024-05-08T18:51:06.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.880+0000 7f7b96ffd640 20 reqs_thread_entry: start 2024-05-08T18:51:06.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.880+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3407f0 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.881+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.881+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef33f7e0 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.881+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.881+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3407f0 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.881+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.881+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3407f0 con 0x7f7d600a3040 2024-05-08T18:51:06.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.881+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.881+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef33f7e0 con 0x7f7d600a3040 2024-05-08T18:51:06.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.882+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.882+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3407f0 con 0x7f7d600a3040 2024-05-08T18:51:06.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.882+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.882+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3407f0 con 0x55c9ef2fb440 2024-05-08T18:51:06.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.883+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.883+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef33f7e0 con 0x55c9ef2fb440 2024-05-08T18:51:06.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.883+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.883+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3407f0 con 0x55c9ef2fb440 2024-05-08T18:51:06.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.883+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.883+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3407f0 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.883+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.883+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef33f7e0 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.884+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv15 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.884+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3407f0 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.884+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.884+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3407f0 con 0x7f7d68014070 2024-05-08T18:51:06.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.884+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.884+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef33f7e0 con 0x7f7d68014070 2024-05-08T18:51:06.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.884+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv11 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.884+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3407f0 con 0x7f7d68014070 2024-05-08T18:51:06.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.885+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.885+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3407f0 con 0x55c9ef2fb440 2024-05-08T18:51:06.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.885+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.885+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef33f7e0 con 0x55c9ef2fb440 2024-05-08T18:51:06.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.885+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv10 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.885+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3407f0 con 0x55c9ef2fb440 2024-05-08T18:51:06.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.885+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv10 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.885+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3407f0 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.886+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.886+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef33f7e0 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.886+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.886+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3407f0 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.886+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.886+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3407f0 con 0x7f7d600a3040 2024-05-08T18:51:06.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.887+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.887+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef33f7e0 con 0x7f7d600a3040 2024-05-08T18:51:06.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.887+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv29 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.887+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3407f0 con 0x7f7d600a3040 2024-05-08T18:51:06.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.888+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 29 ==== osd_op_reply(117 gc.7 [call out=1702b] v0'0 uv29 ondisk = 0) ==== 148+0+1702 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.888+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x7f7d68014070 2024-05-08T18:51:06.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.888+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.888+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x7f7d68014070 2024-05-08T18:51:06.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.888+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.888+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x7f7d68014070 2024-05-08T18:51:06.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.889+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.889+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2fb440 2024-05-08T18:51:06.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.889+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.889+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x55c9ef2fb440 2024-05-08T18:51:06.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.889+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.889+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2fb440 2024-05-08T18:51:06.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.889+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.889+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x7f7d68014070 2024-05-08T18:51:06.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.890+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.890+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x7f7d68014070 2024-05-08T18:51:06.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.890+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.890+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x7f7d68014070 2024-05-08T18:51:06.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.890+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.890+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x7f7d600a3040 2024-05-08T18:51:06.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.891+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.891+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x7f7d600a3040 2024-05-08T18:51:06.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.891+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.891+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x7f7d600a3040 2024-05-08T18:51:06.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.891+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.891+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x7f7d68014070 2024-05-08T18:51:06.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.892+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.892+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x7f7d68014070 2024-05-08T18:51:06.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.892+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.892+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x7f7d68014070 2024-05-08T18:51:06.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.892+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.892+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x7f7d600a3040 2024-05-08T18:51:06.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.892+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.893+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x7f7d600a3040 2024-05-08T18:51:06.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.893+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.893+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x7f7d600a3040 2024-05-08T18:51:06.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.893+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.893+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.893+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.893+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.894+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.894+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.894+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.894+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2fb440 2024-05-08T18:51:06.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.894+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.894+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x55c9ef2fb440 2024-05-08T18:51:06.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.894+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.894+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2fb440 2024-05-08T18:51:06.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.895+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.895+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x7f7d68014070 2024-05-08T18:51:06.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.895+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.895+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x7f7d68014070 2024-05-08T18:51:06.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.895+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.895+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x7f7d68014070 2024-05-08T18:51:06.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.896+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.896+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2fb440 2024-05-08T18:51:06.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.896+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.896+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x55c9ef2fb440 2024-05-08T18:51:06.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.896+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.896+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2fb440 2024-05-08T18:51:06.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.896+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.896+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.897+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.897+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.897+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.897+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.897+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.897+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.898+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.898+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.898+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.898+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.898+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.898+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2fb440 2024-05-08T18:51:06.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.898+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.898+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x55c9ef2fb440 2024-05-08T18:51:06.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.899+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.899+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2fb440 2024-05-08T18:51:06.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.899+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.899+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x7f7d68014070 2024-05-08T18:51:06.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.899+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.899+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x7f7d68014070 2024-05-08T18:51:06.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.900+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.900+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x7f7d68014070 2024-05-08T18:51:06.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.900+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.900+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2fb440 2024-05-08T18:51:06.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.900+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.900+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x55c9ef2fb440 2024-05-08T18:51:06.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.900+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.900+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2fb440 2024-05-08T18:51:06.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.901+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.901+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2fb440 2024-05-08T18:51:06.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.901+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.901+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x55c9ef2fb440 2024-05-08T18:51:06.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.901+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.901+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2fb440 2024-05-08T18:51:06.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.901+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.901+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2fb440 2024-05-08T18:51:06.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.902+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.902+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x55c9ef2fb440 2024-05-08T18:51:06.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.902+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.902+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2fb440 2024-05-08T18:51:06.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.902+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.902+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2fb440 2024-05-08T18:51:06.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.902+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.902+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x55c9ef2fb440 2024-05-08T18:51:06.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.903+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.903+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2fb440 2024-05-08T18:51:06.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.903+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.903+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x7f7d600a3040 2024-05-08T18:51:06.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.903+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.903+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x7f7d600a3040 2024-05-08T18:51:06.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.904+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.904+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x7f7d600a3040 2024-05-08T18:51:06.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.904+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.904+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2fb440 2024-05-08T18:51:06.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.904+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.905+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x55c9ef2fb440 2024-05-08T18:51:06.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.905+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.905+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2fb440 2024-05-08T18:51:06.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.905+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.905+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x7f7d600a3040 2024-05-08T18:51:06.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.905+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.905+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x7f7d600a3040 2024-05-08T18:51:06.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.906+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.906+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x7f7d600a3040 2024-05-08T18:51:06.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.906+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.906+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2fb440 2024-05-08T18:51:06.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.906+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.906+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x55c9ef2fb440 2024-05-08T18:51:06.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.907+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.907+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x55c9ef2fb440 2024-05-08T18:51:06.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.907+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.907+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x7f7d600a3040 2024-05-08T18:51:06.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.907+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.907+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x7f7d600a3040 2024-05-08T18:51:06.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.908+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.908+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x7f7d600a3040 2024-05-08T18:51:06.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.908+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.908+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x7f7d68014070 2024-05-08T18:51:06.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.908+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.908+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef340180 con 0x7f7d68014070 2024-05-08T18:51:06.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.909+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.909+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef341190 con 0x7f7d68014070 2024-05-08T18:51:06.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.909+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.910+0000 7f7c267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:06.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.910+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94325789711904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef310f10 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.911+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94325789711904] v25'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.911+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94325789690976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef305e20 con 0x7f7d68014070 2024-05-08T18:51:06.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.912+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94325789690976] v25'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.912+0000 7f7d74933800 20 remove_watcher() i=0 2024-05-08T18:51:06.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.912+0000 7f7d74933800 2 removed watcher, disabling cache 2024-05-08T18:51:06.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.912+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94325789698528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef300c60 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.913+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94325789698528] v25'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.913+0000 7f7d74933800 20 remove_watcher() i=1 2024-05-08T18:51:06.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.913+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94325789700064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef300c60 con 0x55c9ef2fb440 2024-05-08T18:51:06.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.914+0000 7f7d70dcb640 1 -- 172.21.15.132:0/2195101204 <== osd.3 v2:172.21.15.132:6816/17827703 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94325789700064] v25'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d6803d020 con 0x55c9ef2fb440 2024-05-08T18:51:06.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.914+0000 7f7d74933800 20 remove_watcher() i=2 2024-05-08T18:51:06.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.914+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94325789702080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef302fe0 con 0x7f7d68014070 2024-05-08T18:51:06.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.915+0000 7f7d705ca640 1 -- 172.21.15.132:0/2195101204 <== osd.2 v2:172.21.15.132:6808/1108348591 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94325789702080] v25'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d60075030 con 0x7f7d68014070 2024-05-08T18:51:06.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.915+0000 7f7d74933800 20 remove_watcher() i=3 2024-05-08T18:51:06.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.915+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94325789708352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef300c60 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.916+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.1 v2:172.21.15.132:6800/3697320277 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94325789708352] v25'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x55c9ef2f6ba0 2024-05-08T18:51:06.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.916+0000 7f7d74933800 20 remove_watcher() i=4 2024-05-08T18:51:06.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.916+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94325789709888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef3037c0 con 0x7f7d600a3040 2024-05-08T18:51:06.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.917+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94325789709888] v25'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.917+0000 7f7d74933800 20 remove_watcher() i=5 2024-05-08T18:51:06.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.917+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94325789714400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef305040 con 0x7f7d600a3040 2024-05-08T18:51:06.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.918+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94325789714400] v25'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.918+0000 7f7d74933800 20 remove_watcher() i=6 2024-05-08T18:51:06.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.918+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94325789718176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55c9ef300c60 con 0x7f7d600a3040 2024-05-08T18:51:06.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 <== osd.0 v2:172.21.15.42:6800/1521799280 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94325789718176] v25'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d58029040 con 0x7f7d600a3040 2024-05-08T18:51:06.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 20 remove_watcher() i=7 2024-05-08T18:51:06.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f7d600a3040 msgr2=0x7f7d60092860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:06.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f7d600a3040 0x7f7d60092860 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:06.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c9ef2f6ba0 msgr2=0x55c9ef2f9040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:06.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c9ef2f6ba0 0x55c9ef2f9040 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:06.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f7d68014070 msgr2=0x7f7d6802f980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:06.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f7d68014070 0x7f7d6802f980 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:06.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c9ef2fb440 msgr2=0x55c9ef2fd830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:06.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c9ef2fb440 0x55c9ef2fd830 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:06.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7c4003bb50 msgr2=0x7f7c4003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:06.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7c4003bb50 0x7f7c4003e010 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7d600912a0 tx=0x7f7d6007f000 comp rx=0 tx=0).stop 2024-05-08T18:51:06.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef2e3660 msgr2=0x55c9ef2eaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:06.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef2e3660 0x55c9ef2eaeb0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7d68018430 tx=0x7f7d68052cd0 comp rx=0 tx=0).stop 2024-05-08T18:51:06.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d6fdc9640 1 -- 172.21.15.132:0/2195101204 reap_dead start 2024-05-08T18:51:06.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 shutdown_connections 2024-05-08T18:51:06.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 --2- 172.21.15.132:0/2195101204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef2e3660 0x55c9ef2eaeb0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:06.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 >> 172.21.15.132:0/2195101204 conn(0x55c9ef2b0320 msgr2=0x55c9ef2db0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:06.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 shutdown_connections 2024-05-08T18:51:06.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 -- 172.21.15.132:0/2195101204 wait complete. 2024-05-08T18:51:06.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 -- 172.21.15.132:0/2138694109 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7c4803bb50 msgr2=0x7f7c4803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:06.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 --2- 172.21.15.132:0/2138694109 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7c4803bb50 0x7f7c4803e010 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7d60007000 tx=0x7f7d60006e90 comp rx=0 tx=0).stop 2024-05-08T18:51:06.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 -- 172.21.15.132:0/2138694109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef2d44b0 msgr2=0x55c9ef2d48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:06.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 --2- 172.21.15.132:0/2138694109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef2d44b0 0x55c9ef2d48d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x55c9ef2c0b10 tx=0x7f7d68018830 comp rx=0 tx=0).stop 2024-05-08T18:51:06.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 -- 172.21.15.132:0/2138694109 shutdown_connections 2024-05-08T18:51:06.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 --2- 172.21.15.132:0/2138694109 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7c4803bb50 0x7f7c4803e010 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:06.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 --2- 172.21.15.132:0/2138694109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef2d44b0 0x55c9ef2d48d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:06.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 -- 172.21.15.132:0/2138694109 >> 172.21.15.132:0/2138694109 conn(0x55c9ef2c8550 msgr2=0x55c9ef2c8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 -- 172.21.15.132:0/2138694109 shutdown_connections 2024-05-08T18:51:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.920+0000 7f7d74933800 1 -- 172.21.15.132:0/2138694109 wait complete. 2024-05-08T18:51:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.921+0000 7f7d74933800 1 -- 172.21.15.132:0/3886953605 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c9ef1c0750 msgr2=0x55c9ef2c01d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.921+0000 7f7d74933800 1 --2- 172.21.15.132:0/3886953605 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c9ef1c0750 0x55c9ef2c01d0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.921+0000 7f7d74933800 1 -- 172.21.15.132:0/3886953605 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c9ef2c2a90 msgr2=0x55c9ef2c4e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.921+0000 7f7d74933800 1 --2- 172.21.15.132:0/3886953605 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c9ef2c2a90 0x55c9ef2c4e80 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.921+0000 7f7d74933800 1 -- 172.21.15.132:0/3886953605 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7c5803bb50 msgr2=0x7f7c5803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.921+0000 7f7d74933800 1 --2- 172.21.15.132:0/3886953605 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7c5803bb50 0x7f7c5803e010 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7d58000f60 tx=0x7f7d580010a0 comp rx=0 tx=0).stop 2024-05-08T18:51:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.921+0000 7f7d74933800 1 -- 172.21.15.132:0/3886953605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef1bf410 msgr2=0x55c9ef2b8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.921+0000 7f7d74933800 1 --2- 172.21.15.132:0/3886953605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef1bf410 0x55c9ef2b8f90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7d60005870 tx=0x7f7d60003020 comp rx=0 tx=0).stop 2024-05-08T18:51:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.921+0000 7f7d74933800 1 -- 172.21.15.132:0/3886953605 shutdown_connections 2024-05-08T18:51:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.921+0000 7f7d74933800 1 --2- 172.21.15.132:0/3886953605 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55c9ef2c2a90 0x55c9ef2c4e80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.921+0000 7f7d74933800 1 --2- 172.21.15.132:0/3886953605 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55c9ef1c0750 0x55c9ef2c01d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.921+0000 7f7d74933800 1 --2- 172.21.15.132:0/3886953605 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f7c5803bb50 0x7f7c5803e010 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.921+0000 7f7d74933800 1 --2- 172.21.15.132:0/3886953605 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55c9ef1bf410 0x55c9ef2b8f90 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:06.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.921+0000 7f7d74933800 1 -- 172.21.15.132:0/3886953605 >> 172.21.15.132:0/3886953605 conn(0x55c9ef1b9ea0 msgr2=0x55c9ef2aa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:06.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.921+0000 7f7d74933800 1 -- 172.21.15.132:0/3886953605 shutdown_connections 2024-05-08T18:51:06.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.921+0000 7f7d74933800 1 -- 172.21.15.132:0/3886953605 wait complete. 2024-05-08T18:51:06.929 INFO:teuthology.orchestra.run.smithi132.stdout:[{"tag":"bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.15435721887859102232\u0000","time":"2024-05-08T18:51:06.725812+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_7","key":"","instance":""}]}] 2024-05-08T18:51:06.929 DEBUG:tasks.util.rgw: json result: [{'tag': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.15435721887859102232\x00', 'time': '2024-05-08T18:51:06.725812+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_7', 'key': '', 'instance': ''}]}] 2024-05-08T18:51:06.929 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-05-08T18:51:06.929 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-05-08T18:51:06.929 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-05-08T18:51:06.971 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:06.972 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:06.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.973+0000 7fb7f103f800 1 Processor -- start 2024-05-08T18:51:06.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.973+0000 7fb7f103f800 1 -- start start 2024-05-08T18:51:06.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.973+0000 7fb7f103f800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x558b784752a0 0x558b784756c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:06.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.973+0000 7fb7f103f800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558b78475d40 con 0x558b78476460 2024-05-08T18:51:06.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.973+0000 7fb7f103f800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x558b78315e20 con 0x558b784752a0 2024-05-08T18:51:06.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.974+0000 7fb7eeb37640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x558b784752a0 0x558b784756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:06.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.974+0000 7fb7eeb37640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x558b784752a0 0x558b784756c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51220/0 (socket says 172.21.15.132:51220) 2024-05-08T18:51:06.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.974+0000 7fb7eeb37640 1 -- 172.21.15.132:0/1106491937 learned_addr learned my addr 172.21.15.132:0/1106491937 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:06.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.974+0000 7fb7ee336640 1 --1- 172.21.15.132:0/1106491937 >> v1:172.21.15.42:6789/0 conn(0x558b78476460 0x558b784768e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:55694/0 (socket says 172.21.15.132:55694) 2024-05-08T18:51:06.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.974+0000 7fb7eeb37640 1 -- 172.21.15.132:0/1106491937 >> v1:172.21.15.42:6789/0 conn(0x558b78476460 legacy=0x558b784768e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:06.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.974+0000 7fb7eeb37640 1 -- 172.21.15.132:0/1106491937 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b78477020 con 0x558b784752a0 2024-05-08T18:51:06.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.976+0000 7fb7eeb37640 1 --2- 172.21.15.132:0/1106491937 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b784752a0 0x558b784756c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000a520 tx=0x7fb7e001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a95eb3b46b789c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:06.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.976+0000 7fb7edb35640 1 -- 172.21.15.132:0/1106491937 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e0057070 con 0x558b784752a0 2024-05-08T18:51:06.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.976+0000 7fb7edb35640 1 -- 172.21.15.132:0/1106491937 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e0052570 con 0x558b784752a0 2024-05-08T18:51:06.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.976+0000 7fb7edb35640 1 -- 172.21.15.132:0/1106491937 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e0052870 con 0x558b784752a0 2024-05-08T18:51:06.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.977+0000 7fb7f103f800 1 -- 172.21.15.132:0/1106491937 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b784752a0 msgr2=0x558b784756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:06.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.977+0000 7fb7f103f800 1 --2- 172.21.15.132:0/1106491937 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b784752a0 0x558b784756c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000a520 tx=0x7fb7e001d010 comp rx=0 tx=0).stop 2024-05-08T18:51:06.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.977+0000 7fb7f103f800 1 -- 172.21.15.132:0/1106491937 shutdown_connections 2024-05-08T18:51:06.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.977+0000 7fb7f103f800 1 --2- 172.21.15.132:0/1106491937 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b784752a0 0x558b784756c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:06.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.977+0000 7fb7f103f800 1 -- 172.21.15.132:0/1106491937 >> 172.21.15.132:0/1106491937 conn(0x558b78470820 msgr2=0x558b78472c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:06.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.977+0000 7fb7f103f800 1 -- 172.21.15.132:0/1106491937 shutdown_connections 2024-05-08T18:51:06.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.977+0000 7fb7f103f800 1 -- 172.21.15.132:0/1106491937 wait complete. 2024-05-08T18:51:06.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.991+0000 7fb7f103f800 1 Processor -- start 2024-05-08T18:51:06.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.991+0000 7fb7f103f800 1 -- start start 2024-05-08T18:51:06.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.991+0000 7fb7f103f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b784752a0 0x558b783eac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:06.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.991+0000 7fb7f103f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558b783c05a0 con 0x558b784752a0 2024-05-08T18:51:06.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.991+0000 7fb7eeb37640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b784752a0 0x558b783eac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:06.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.991+0000 7fb7eeb37640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b784752a0 0x558b783eac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51236/0 (socket says 172.21.15.132:51236) 2024-05-08T18:51:06.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.991+0000 7fb7eeb37640 1 -- 172.21.15.132:0/3068315002 learned_addr learned my addr 172.21.15.132:0/3068315002 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:06.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.991+0000 7fb7eeb37640 1 -- 172.21.15.132:0/3068315002 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b783e9220 con 0x558b784752a0 2024-05-08T18:51:06.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.992+0000 7fb7eeb37640 1 --2- 172.21.15.132:0/3068315002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b784752a0 0x558b783eac60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb7e001d050 tx=0x7fb7e004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d201cf93a1c1e30a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:06.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.992+0000 7fb6dce09640 1 -- 172.21.15.132:0/3068315002 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e0057040 con 0x558b784752a0 2024-05-08T18:51:06.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.992+0000 7fb6dce09640 1 -- 172.21.15.132:0/3068315002 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e0052850 con 0x558b784752a0 2024-05-08T18:51:06.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.992+0000 7fb6dce09640 1 -- 172.21.15.132:0/3068315002 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e0052b70 con 0x558b784752a0 2024-05-08T18:51:06.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.992+0000 7fb7f103f800 1 -- 172.21.15.132:0/3068315002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b784752a0 msgr2=0x558b783eac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:06.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.992+0000 7fb7f103f800 1 --2- 172.21.15.132:0/3068315002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b784752a0 0x558b783eac60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb7e001d050 tx=0x7fb7e004c000 comp rx=0 tx=0).stop 2024-05-08T18:51:06.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.992+0000 7fb7f103f800 1 -- 172.21.15.132:0/3068315002 shutdown_connections 2024-05-08T18:51:06.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.992+0000 7fb7f103f800 1 --2- 172.21.15.132:0/3068315002 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b784752a0 0x558b783eac60 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:06.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.992+0000 7fb7f103f800 1 -- 172.21.15.132:0/3068315002 >> 172.21.15.132:0/3068315002 conn(0x558b78470820 msgr2=0x558b78561fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:06.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.992+0000 7fb7f103f800 1 -- 172.21.15.132:0/3068315002 shutdown_connections 2024-05-08T18:51:06.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.992+0000 7fb7f103f800 1 -- 172.21.15.132:0/3068315002 wait complete. 2024-05-08T18:51:06.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.993+0000 7fb7f103f800 1 Processor -- start 2024-05-08T18:51:06.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.993+0000 7fb7f103f800 1 -- start start 2024-05-08T18:51:06.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.993+0000 7fb7f103f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b78476460 0x558b785705a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:06.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.993+0000 7fb7f103f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558b7847e930 con 0x558b78476460 2024-05-08T18:51:06.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.993+0000 7fb7eeb37640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b78476460 0x558b785705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:06.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.993+0000 7fb7eeb37640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b78476460 0x558b785705a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51238/0 (socket says 172.21.15.132:51238) 2024-05-08T18:51:06.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.993+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2514388494 learned_addr learned my addr 172.21.15.132:0/2514388494 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:06.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.994+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2514388494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b78570ae0 con 0x558b78476460 2024-05-08T18:51:06.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.994+0000 7fb7eeb37640 1 --2- 172.21.15.132:0/2514388494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b78476460 0x558b785705a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0052820 tx=0x7fb7e0003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:06.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.994+0000 7fb6db606640 1 -- 172.21.15.132:0/2514388494 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e0073070 con 0x558b78476460 2024-05-08T18:51:06.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.994+0000 7fb6db606640 1 -- 172.21.15.132:0/2514388494 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e005d570 con 0x558b78476460 2024-05-08T18:51:06.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.994+0000 7fb6db606640 1 -- 172.21.15.132:0/2514388494 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e0057070 con 0x558b78476460 2024-05-08T18:51:06.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.994+0000 7fb7f103f800 1 -- 172.21.15.132:0/2514388494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b78570d70 con 0x558b78476460 2024-05-08T18:51:06.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.994+0000 7fb7f103f800 1 -- 172.21.15.132:0/2514388494 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b78573980 con 0x558b78476460 2024-05-08T18:51:07.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.995+0000 7fb6db606640 1 -- 172.21.15.132:0/2514388494 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb7e0076070 con 0x558b78476460 2024-05-08T18:51:07.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.995+0000 7fb6db606640 1 --2- 172.21.15.132:0/2514388494 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb6d403bb50 0x7fb6d403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.995+0000 7fb6db606640 1 -- 172.21.15.132:0/2514388494 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fb7e0093fe0 con 0x558b78476460 2024-05-08T18:51:07.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.995+0000 7fb7ee336640 1 --2- 172.21.15.132:0/2514388494 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb6d403bb50 0x7fb6d403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.995+0000 7fb7f103f800 1 --2- 172.21.15.132:0/2514388494 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558b78575730 0x558b78577b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.995+0000 7fb7f103f800 1 -- 172.21.15.132:0/2514388494 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785780f0 con 0x558b78575730 2024-05-08T18:51:07.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.995+0000 7fb7ef338640 1 --2- 172.21.15.132:0/2514388494 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558b78575730 0x558b78577b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.996+0000 7fb7ee336640 1 --2- 172.21.15.132:0/2514388494 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb6d403bb50 0x7fb6d403e010 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4001e40 tx=0x7fb7e40013a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.996+0000 7fb7ef338640 1 --2- 172.21.15.132:0/2514388494 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558b78575730 0x558b78577b20 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.996+0000 7fb7ef338640 1 -- 172.21.15.132:0/2514388494 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7e800a4a0 con 0x558b78575730 2024-05-08T18:51:07.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.996+0000 7fb7f103f800 1 -- 172.21.15.132:0/2514388494 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785789b0 con 0x558b78575730 2024-05-08T18:51:07.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.996+0000 7fb7ef338640 1 -- 172.21.15.132:0/2514388494 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb7e800a4a0 con 0x558b78575730 2024-05-08T18:51:07.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.996+0000 7fb7f103f800 1 --2- 172.21.15.132:0/2514388494 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558b7857a2c0 0x558b7857c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.996+0000 7fb7f103f800 1 -- 172.21.15.132:0/2514388494 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b7857cee0 con 0x558b7857a2c0 2024-05-08T18:51:07.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.996+0000 7fb7eeb37640 1 --2- 172.21.15.132:0/2514388494 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558b7857a2c0 0x558b7857c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.997+0000 7fb7eeb37640 1 --2- 172.21.15.132:0/2514388494 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558b7857a2c0 0x558b7857c750 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.997+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2514388494 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb7e0075030 con 0x558b7857a2c0 2024-05-08T18:51:07.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.997+0000 7fb7f103f800 1 -- 172.21.15.132:0/2514388494 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b78579200 con 0x558b78575730 2024-05-08T18:51:07.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.997+0000 7fb7ef338640 1 -- 172.21.15.132:0/2514388494 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb7e800a4a0 con 0x558b78575730 2024-05-08T18:51:07.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.997+0000 7fb7f103f800 1 -- 172.21.15.132:0/2514388494 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785795e0 con 0x558b78575730 2024-05-08T18:51:07.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.998+0000 7fb7ef338640 1 -- 172.21.15.132:0/2514388494 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb7e800a4a0 con 0x558b78575730 2024-05-08T18:51:07.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.998+0000 7fb7f103f800 1 Processor -- start 2024-05-08T18:51:07.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.998+0000 7fb7f103f800 1 -- start start 2024-05-08T18:51:07.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.998+0000 7fb7f103f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b7858be60 0x558b7858c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.998+0000 7fb7f103f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558b78366fc0 con 0x558b7858be60 2024-05-08T18:51:07.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.998+0000 7fb7ef338640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b7858be60 0x558b7858c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.998+0000 7fb7ef338640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b7858be60 0x558b7858c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51250/0 (socket says 172.21.15.132:51250) 2024-05-08T18:51:07.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.998+0000 7fb7ef338640 1 -- 172.21.15.132:0/1584447935 learned_addr learned my addr 172.21.15.132:0/1584447935 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.999+0000 7fb7ef338640 1 -- 172.21.15.132:0/1584447935 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b7858c7c0 con 0x558b7858be60 2024-05-08T18:51:07.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.999+0000 7fb7ef338640 1 --2- 172.21.15.132:0/1584447935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b7858be60 0x558b7858c280 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x558b78571420 tx=0x7fb7e80188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.999+0000 7fb6d8e01640 1 -- 172.21.15.132:0/1584447935 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e8014450 con 0x558b7858be60 2024-05-08T18:51:07.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.999+0000 7fb6d8e01640 1 -- 172.21.15.132:0/1584447935 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e80145f0 con 0x558b7858be60 2024-05-08T18:51:07.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.999+0000 7fb7f103f800 1 -- 172.21.15.132:0/1584447935 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b7858d230 con 0x558b7858be60 2024-05-08T18:51:07.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.999+0000 7fb6d8e01640 1 -- 172.21.15.132:0/1584447935 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e80148d0 con 0x558b7858be60 2024-05-08T18:51:07.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:06.999+0000 7fb7f103f800 1 -- 172.21.15.132:0/1584447935 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b7858d730 con 0x558b7858be60 2024-05-08T18:51:07.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.000+0000 7fb6d8e01640 1 -- 172.21.15.132:0/1584447935 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb7e8011040 con 0x558b7858be60 2024-05-08T18:51:07.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.000+0000 7fb6d8e01640 1 --2- 172.21.15.132:0/1584447935 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb6c803bb50 0x7fb6c803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.000+0000 7fb6d8e01640 1 -- 172.21.15.132:0/1584447935 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fb7e801e070 con 0x558b7858be60 2024-05-08T18:51:07.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.000+0000 7fb7eeb37640 1 --2- 172.21.15.132:0/1584447935 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb6c803bb50 0x7fb6c803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.000+0000 7fb7f103f800 1 Processor -- start 2024-05-08T18:51:07.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.000+0000 7fb7f103f800 1 -- start start 2024-05-08T18:51:07.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.001+0000 7fb7eeb37640 1 --2- 172.21.15.132:0/1584447935 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb6c803bb50 0x7fb6c803e010 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x558b78574e10 tx=0x7fb7e004abd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.001+0000 7fb7f103f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b78599160 0x558b78599580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.001+0000 7fb7f103f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558b783e94e0 con 0x558b78599160 2024-05-08T18:51:07.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.001+0000 7fb7ef338640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b78599160 0x558b78599580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.001+0000 7fb7ef338640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b78599160 0x558b78599580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51252/0 (socket says 172.21.15.132:51252) 2024-05-08T18:51:07.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.001+0000 7fb7ef338640 1 -- 172.21.15.132:0/1918343138 learned_addr learned my addr 172.21.15.132:0/1918343138 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.001+0000 7fb7ef338640 1 -- 172.21.15.132:0/1918343138 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b78599b50 con 0x558b78599160 2024-05-08T18:51:07.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.001+0000 7fb7ef338640 1 --2- 172.21.15.132:0/1918343138 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b78599160 0x558b78599580 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8005a80 tx=0x7fb7e80118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248b3da150c9dc52 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.001+0000 7fb6d27fc640 1 -- 172.21.15.132:0/1918343138 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e802bc50 con 0x558b78599160 2024-05-08T18:51:07.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.001+0000 7fb6d27fc640 1 -- 172.21.15.132:0/1918343138 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e8047070 con 0x558b78599160 2024-05-08T18:51:07.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.001+0000 7fb6d27fc640 1 -- 172.21.15.132:0/1918343138 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e8014a70 con 0x558b78599160 2024-05-08T18:51:07.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.002+0000 7fb7f103f800 1 -- 172.21.15.132:0/1918343138 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b78599160 msgr2=0x558b78599580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.002+0000 7fb7f103f800 1 --2- 172.21.15.132:0/1918343138 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b78599160 0x558b78599580 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8005a80 tx=0x7fb7e80118e0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.002+0000 7fb7f103f800 1 -- 172.21.15.132:0/1918343138 shutdown_connections 2024-05-08T18:51:07.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.002+0000 7fb7f103f800 1 --2- 172.21.15.132:0/1918343138 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b78599160 0x558b78599580 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.002+0000 7fb7f103f800 1 -- 172.21.15.132:0/1918343138 >> 172.21.15.132:0/1918343138 conn(0x558b785954c0 msgr2=0x558b78593520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.002+0000 7fb7f103f800 1 -- 172.21.15.132:0/1918343138 shutdown_connections 2024-05-08T18:51:07.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.002+0000 7fb7f103f800 1 -- 172.21.15.132:0/1918343138 wait complete. 2024-05-08T18:51:07.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.002+0000 7fb7f103f800 1 Processor -- start 2024-05-08T18:51:07.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.002+0000 7fb7f103f800 1 -- start start 2024-05-08T18:51:07.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.002+0000 7fb7f103f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b78599160 0x558b785a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.002+0000 7fb7f103f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558b7859a2c0 con 0x558b78599160 2024-05-08T18:51:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.003+0000 7fb7ef338640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b78599160 0x558b785a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.003+0000 7fb7ef338640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b78599160 0x558b785a06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51262/0 (socket says 172.21.15.132:51262) 2024-05-08T18:51:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.003+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 learned_addr learned my addr 172.21.15.132:0/2819791774 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.003+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b785a0c30 con 0x558b78599160 2024-05-08T18:51:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.003+0000 7fb7ef338640 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b78599160 0x558b785a06f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80014b0 tx=0x7fb7e8052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.003+0000 7fb6d0ff9640 1 -- 172.21.15.132:0/2819791774 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e8054310 con 0x558b78599160 2024-05-08T18:51:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.003+0000 7fb6d0ff9640 1 -- 172.21.15.132:0/2819791774 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e80544b0 con 0x558b78599160 2024-05-08T18:51:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.003+0000 7fb6d0ff9640 1 -- 172.21.15.132:0/2819791774 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e802b480 con 0x558b78599160 2024-05-08T18:51:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.003+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b785a0ec0 con 0x558b78599160 2024-05-08T18:51:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.003+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b785a3b70 con 0x558b78599160 2024-05-08T18:51:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.004+0000 7fb6d0ff9640 1 -- 172.21.15.132:0/2819791774 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb7e802b620 con 0x558b78599160 2024-05-08T18:51:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.004+0000 7fb6d0ff9640 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb6b803bb50 0x7fb6b803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.004+0000 7fb6d0ff9640 1 -- 172.21.15.132:0/2819791774 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fb7e8033030 con 0x558b78599160 2024-05-08T18:51:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.004+0000 7fb7eeb37640 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb6b803bb50 0x7fb6b803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.005+0000 7fb7eeb37640 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb6b803bb50 0x7fb6b803e010 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0007000 tx=0x7fb7e0084000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.005+0000 7fb7f103f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.005+0000 7fb7f103f800 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558b785ac3e0 0x558b785ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.005+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785aeff0 con 0x558b785ac3e0 2024-05-08T18:51:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.005+0000 7fb7ee336640 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558b785ac3e0 0x558b785ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.005+0000 7fb7ee336640 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558b785ac3e0 0x558b785ae8a0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.005+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7e400f670 con 0x558b785ac3e0 2024-05-08T18:51:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.005+0000 7fb7f103f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.005+0000 7fb7f103f800 20 realm 2024-05-08T18:51:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.005+0000 7fb7f103f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.005+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785ab830 con 0x558b785ac3e0 2024-05-08T18:51:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.006+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7e400f670 con 0x558b785ac3e0 2024-05-08T18:51:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.006+0000 7fb7f103f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.006+0000 7fb7f103f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:07.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.006+0000 7fb7f103f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.006+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785afae0 con 0x558b785ac3e0 2024-05-08T18:51:07.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.006+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7e400f670 con 0x558b785ac3e0 2024-05-08T18:51:07.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.006+0000 7fb7f103f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.006+0000 7fb7f103f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.006+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785b03b0 con 0x558b785ac3e0 2024-05-08T18:51:07.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.006+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb7e400f670 con 0x558b785ac3e0 2024-05-08T18:51:07.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.006+0000 7fb7f103f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:07.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.006+0000 7fb7f103f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.006+0000 7fb7f103f800 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558b785b0cb0 0x558b785b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.006+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785b3870 con 0x558b785b0cb0 2024-05-08T18:51:07.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.006+0000 7fb7ef338640 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558b785b0cb0 0x558b785b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.006+0000 7fb7ef338640 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558b785b0cb0 0x558b785b30e0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.007+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.007+0000 7fb7f103f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:07.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.007+0000 7fb7f103f800 20 searching for the correct realm 2024-05-08T18:51:07.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.007+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x558b785b0cb0 2024-05-08T18:51:07.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.007+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.007+0000 7fb7ef338640 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb7e8014070 0x7fb7e8051110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.007+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x7fb7e8014070 2024-05-08T18:51:07.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.007+0000 7fb7eeb37640 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb7e8014070 0x7fb7e8051110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.008+0000 7fb7eeb37640 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb7e8014070 0x7fb7e8051110 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.008+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.008+0000 7fb7eeb37640 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb7e0082030 0x7fb7e008b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.008+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x7fb7e0082030 2024-05-08T18:51:07.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.008+0000 7fb7ee336640 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb7e0082030 0x7fb7e008b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.009+0000 7fb7ee336640 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb7e0082030 0x7fb7e008b280 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.009+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e400f670 con 0x7fb7e0082030 2024-05-08T18:51:07.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.009+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x558b785ac3e0 2024-05-08T18:51:07.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.009+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e400f670 con 0x558b785ac3e0 2024-05-08T18:51:07.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.009+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x558b785ac3e0 2024-05-08T18:51:07.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.009+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e402b040 con 0x558b785ac3e0 2024-05-08T18:51:07.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.009+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x7fb7e0082030 2024-05-08T18:51:07.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.010+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e402b040 con 0x7fb7e0082030 2024-05-08T18:51:07.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.010+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x7fb7e0082030 2024-05-08T18:51:07.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.010+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e402b040 con 0x7fb7e0082030 2024-05-08T18:51:07.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.010+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x7fb7e8014070 2024-05-08T18:51:07.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.010+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.010+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x558b785b0cb0 2024-05-08T18:51:07.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.010+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.010+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x558b785ac3e0 2024-05-08T18:51:07.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.011+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e402b040 con 0x558b785ac3e0 2024-05-08T18:51:07.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.011+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x7fb7e0082030 2024-05-08T18:51:07.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.011+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e402b040 con 0x7fb7e0082030 2024-05-08T18:51:07.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.011+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x558b785ac3e0 2024-05-08T18:51:07.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.011+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb7e402b040 con 0x558b785ac3e0 2024-05-08T18:51:07.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.011+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x7fb7e8014070 2024-05-08T18:51:07.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.011+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.011+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x558b785b0cb0 2024-05-08T18:51:07.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.012+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.012+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x558b785b0cb0 2024-05-08T18:51:07.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.012+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.012+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x7fb7e0082030 2024-05-08T18:51:07.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.012+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e402b040 con 0x7fb7e0082030 2024-05-08T18:51:07.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.012+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x558b785b0cb0 2024-05-08T18:51:07.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.012+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.012+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x558b785b0cb0 2024-05-08T18:51:07.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.013+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.013+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x558b785ac3e0 2024-05-08T18:51:07.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.013+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e402b040 con 0x558b785ac3e0 2024-05-08T18:51:07.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.013+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x558b785ac3e0 2024-05-08T18:51:07.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.013+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb7e402b040 con 0x558b785ac3e0 2024-05-08T18:51:07.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.013+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x7fb7e0082030 2024-05-08T18:51:07.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.013+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e402b040 con 0x7fb7e0082030 2024-05-08T18:51:07.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.013+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x558b785b0cb0 2024-05-08T18:51:07.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.014+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.014+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x7fb7e8014070 2024-05-08T18:51:07.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.014+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.014+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x558b785ac3e0 2024-05-08T18:51:07.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.014+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e402b040 con 0x558b785ac3e0 2024-05-08T18:51:07.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.014+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x7fb7e0082030 2024-05-08T18:51:07.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.014+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.014+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x558b785b0cb0 2024-05-08T18:51:07.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.015+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.015+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x7fb7e0082030 2024-05-08T18:51:07.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.015+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.015+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x7fb7e8014070 2024-05-08T18:51:07.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.015+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.015+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x558b785b0cb0 2024-05-08T18:51:07.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.015+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.015+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x7fb7e0082030 2024-05-08T18:51:07.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.016+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.016+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x558b785ac3e0 2024-05-08T18:51:07.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.016+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.016+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558b785b51c0 con 0x7fb7e8014070 2024-05-08T18:51:07.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.016+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.016+0000 7fb7f103f800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:07.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.016+0000 7fb7f103f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:07.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.016+0000 7fb7f103f800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:07.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.016+0000 7fb7f103f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:07.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.016+0000 7fb7f103f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:07.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.016+0000 7fb7f103f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:07.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.016+0000 7fb7f103f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.016+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785b4230 con 0x558b785ac3e0 2024-05-08T18:51:07.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.017+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.017+0000 7fb7f103f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.017+0000 7fb7f103f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.017+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785b4ad0 con 0x558b785ac3e0 2024-05-08T18:51:07.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.017+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.017+0000 7fb7f103f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:07.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.017+0000 7fb7f103f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.017+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785b5640 con 0x558b785ac3e0 2024-05-08T18:51:07.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.017+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.017+0000 7fb7f103f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:07.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.017+0000 7fb7f103f800 20 zone default found 2024-05-08T18:51:07.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.017+0000 7fb7f103f800 4 Realm: () 2024-05-08T18:51:07.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.017+0000 7fb7f103f800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:07.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.017+0000 7fb7f103f800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:07.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.017+0000 7fb7f103f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:07.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.017+0000 7fb7f103f800 20 zonegroup default 2024-05-08T18:51:07.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.017+0000 7fb7f103f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.017+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785b5660 con 0x7fb7e0082030 2024-05-08T18:51:07.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.017+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.017+0000 7fb7f103f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.018+0000 7fb7f103f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.018+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785b7480 con 0x558b785b0cb0 2024-05-08T18:51:07.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.018+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.018+0000 7fb7f103f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.018+0000 7fb7f103f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.018+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785b7850 con 0x558b785b0cb0 2024-05-08T18:51:07.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.018+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.018+0000 7fb7f103f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.018+0000 7fb7f103f800 20 started sync module instance, tier type = 2024-05-08T18:51:07.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.018+0000 7fb7f103f800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:07.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.018+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785b6920 con 0x7fb7e8014070 2024-05-08T18:51:07.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.019+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.019+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94057508072720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785b6580 con 0x7fb7e8014070 2024-05-08T18:51:07.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.019+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785b8780 con 0x558b785ac3e0 2024-05-08T18:51:07.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.020+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94057508072720] v25'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.020+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.020+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94057508078288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785b8ba0 con 0x558b785ac3e0 2024-05-08T18:51:07.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.020+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785b9560 con 0x558b785b0cb0 2024-05-08T18:51:07.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.021+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.021+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94057508081840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785b9510 con 0x558b785b0cb0 2024-05-08T18:51:07.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.022+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785ba510 con 0x7fb7e8014070 2024-05-08T18:51:07.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.022+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94057508078288] v25'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.022+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94057508081840] v25'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.023+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.023+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94057508084048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785ba020 con 0x7fb7e8014070 2024-05-08T18:51:07.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.023+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785baf50 con 0x558b785ac3e0 2024-05-08T18:51:07.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.024+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.024+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94057508088480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785bb370 con 0x558b785ac3e0 2024-05-08T18:51:07.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.024+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785bbe40 con 0x7fb7e0082030 2024-05-08T18:51:07.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.024+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94057508084048] v25'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.025+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.025+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94057508092208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785bbe00 con 0x7fb7e0082030 2024-05-08T18:51:07.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.025+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785bc850 con 0x7fb7e0082030 2024-05-08T18:51:07.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.025+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94057508088480] v25'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.026+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94057508092208] v25'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.026+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.026+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94057508079344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785bc3a0 con 0x7fb7e0082030 2024-05-08T18:51:07.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.026+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785bcc70 con 0x7fb7e0082030 2024-05-08T18:51:07.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.027+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94057508079344] v25'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.027+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.027+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94057508089536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785bce50 con 0x7fb7e0082030 2024-05-08T18:51:07.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.027+0000 7fb7f103f800 20 add_watcher() i=0 2024-05-08T18:51:07.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.027+0000 7fb7f103f800 20 add_watcher() i=1 2024-05-08T18:51:07.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.027+0000 7fb7f103f800 20 add_watcher() i=2 2024-05-08T18:51:07.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.027+0000 7fb7f103f800 20 add_watcher() i=3 2024-05-08T18:51:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.027+0000 7fb7f103f800 20 add_watcher() i=4 2024-05-08T18:51:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.027+0000 7fb7f103f800 20 add_watcher() i=5 2024-05-08T18:51:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.027+0000 7fb7f103f800 20 add_watcher() i=6 2024-05-08T18:51:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.028+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94057508089536] v25'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.028+0000 7fb7f103f800 20 add_watcher() i=7 2024-05-08T18:51:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.028+0000 7fb7f103f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.028+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c0220 con 0x558b785ac3e0 2024-05-08T18:51:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.029+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.029+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94057508097344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785bd610 con 0x558b785ac3e0 2024-05-08T18:51:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.030+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94057508097344] v25'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.030+0000 7fb6a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.030+0000 7fb7f103f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.030+0000 7fb7f103f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.030+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c89c0 con 0x558b785ac3e0 2024-05-08T18:51:07.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.031+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v25'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.031+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c9090 con 0x7fb7e0082030 2024-05-08T18:51:07.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.032+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v25'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.032+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c94b0 con 0x558b785b0cb0 2024-05-08T18:51:07.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.033+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v25'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.033+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c9420 con 0x558b785ac3e0 2024-05-08T18:51:07.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.034+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v25'158 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.034+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c9550 con 0x7fb7e8014070 2024-05-08T18:51:07.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.035+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v25'47 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.035+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c9c60 con 0x558b785b0cb0 2024-05-08T18:51:07.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.036+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v25'32 uv10 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.036+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c9c60 con 0x558b785ac3e0 2024-05-08T18:51:07.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.037+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v25'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.037+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c9cf0 con 0x7fb7e0082030 2024-05-08T18:51:07.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.038+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v25'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.038+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c9cf0 con 0x7fb7e8014070 2024-05-08T18:51:07.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.039+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v25'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.039+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785ca2c0 con 0x558b785b0cb0 2024-05-08T18:51:07.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.040+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v25'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.040+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785ca2c0 con 0x7fb7e8014070 2024-05-08T18:51:07.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.041+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v25'48 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.041+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785ca2c0 con 0x7fb7e0082030 2024-05-08T18:51:07.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.042+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v25'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.042+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785ca2c0 con 0x7fb7e8014070 2024-05-08T18:51:07.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.043+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v25'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.043+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785ca2c0 con 0x7fb7e0082030 2024-05-08T18:51:07.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.044+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v25'37 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.044+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785ca2c0 con 0x558b785ac3e0 2024-05-08T18:51:07.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.045+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v25'159 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.045+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785ca2c0 con 0x558b785b0cb0 2024-05-08T18:51:07.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.046+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v25'41 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.046+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785ca2c0 con 0x7fb7e8014070 2024-05-08T18:51:07.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.047+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v25'49 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.047+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785ca2c0 con 0x558b785b0cb0 2024-05-08T18:51:07.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.048+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v25'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.048+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785ca2c0 con 0x558b785ac3e0 2024-05-08T18:51:07.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.049+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v25'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.049+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785ca2c0 con 0x558b785ac3e0 2024-05-08T18:51:07.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.050+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v25'160 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.050+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785ca2c0 con 0x558b785b0cb0 2024-05-08T18:51:07.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.051+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v25'42 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.051+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785ca2c0 con 0x7fb7e8014070 2024-05-08T18:51:07.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.052+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v25'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.052+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c8390 con 0x558b785b0cb0 2024-05-08T18:51:07.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.053+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v25'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.053+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c8390 con 0x558b785b0cb0 2024-05-08T18:51:07.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.054+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v25'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.054+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c8390 con 0x558b785b0cb0 2024-05-08T18:51:07.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.055+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v25'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.055+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c8390 con 0x558b785b0cb0 2024-05-08T18:51:07.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.056+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v25'33 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.056+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c8390 con 0x7fb7e0082030 2024-05-08T18:51:07.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.057+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v25'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.057+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c8390 con 0x558b785b0cb0 2024-05-08T18:51:07.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.058+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v25'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.058+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c8390 con 0x7fb7e0082030 2024-05-08T18:51:07.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.059+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v25'33 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.059+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c8390 con 0x558b785b0cb0 2024-05-08T18:51:07.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.060+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v25'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.060+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c8390 con 0x7fb7e0082030 2024-05-08T18:51:07.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.061+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v25'38 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.061+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c8390 con 0x7fb7e8014070 2024-05-08T18:51:07.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.062+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v25'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.062+0000 7fb61ffff640 20 reqs_thread_entry: start 2024-05-08T18:51:07.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.062+0000 7fb7f103f800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:07.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.063+0000 7fb7f103f800 20 Filter name: none 2024-05-08T18:51:07.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.063+0000 7fb61dffb640 20 reqs_thread_entry: start 2024-05-08T18:51:07.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.063+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-05-08T18:51:07.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.063+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:94 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.064+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== osd_op_reply(94 gc.9 [call] v25'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.064+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:95 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.064+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 28 ==== osd_op_reply(95 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.064+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.064+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:96 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.064+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 29 ==== osd_op_reply(96 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.064+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:97 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.064+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 30 ==== osd_op_reply(97 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.064+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.064+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:98 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.065+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 31 ==== osd_op_reply(98 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.065+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.065+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:99 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.065+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 32 ==== osd_op_reply(99 gc.9 [call] v25'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.065+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-05-08T18:51:07.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.065+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:100 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.066+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(100 gc.10 [call] v25'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.066+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:101 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.067+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(101 gc.10 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.067+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.067+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:102 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.067+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 20 ==== osd_op_reply(102 gc.10 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.067+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:103 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.067+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 21 ==== osd_op_reply(103 gc.10 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.067+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.067+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:104 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.067+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 22 ==== osd_op_reply(104 gc.10 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.067+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.067+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:105 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.068+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 23 ==== osd_op_reply(105 gc.10 [call] v25'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.068+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-05-08T18:51:07.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.068+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:106 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.070+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(106 gc.11 [call] v25'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.070+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:107 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.070+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(107 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.070+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.070+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:108 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.070+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(108 gc.11 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.070+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:109 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.070+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== osd_op_reply(109 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.070+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.070+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:110 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.071+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 28 ==== osd_op_reply(110 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.071+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.071+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:111 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.072+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 29 ==== osd_op_reply(111 gc.11 [call] v25'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.072+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-05-08T18:51:07.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.072+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:112 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.073+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 24 ==== osd_op_reply(112 gc.12 [call] v25'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.073+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:113 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.073+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 25 ==== osd_op_reply(113 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.073+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.073+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:114 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.073+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 26 ==== osd_op_reply(114 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.073+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:115 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.073+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 27 ==== osd_op_reply(115 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.073+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.073+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:116 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.073+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 28 ==== osd_op_reply(116 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.073+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.074+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:117 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.074+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 29 ==== osd_op_reply(117 gc.12 [call] v25'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.074+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-05-08T18:51:07.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.074+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:118 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.076+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 30 ==== osd_op_reply(118 gc.13 [call] v25'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.076+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:119 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.076+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 31 ==== osd_op_reply(119 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.076+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.076+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:120 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.076+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 32 ==== osd_op_reply(120 gc.13 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.077+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:121 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.077+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 33 ==== osd_op_reply(121 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.077+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.077+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:122 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.077+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 34 ==== osd_op_reply(122 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.077+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.077+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:123 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.078+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 35 ==== osd_op_reply(123 gc.13 [call] v25'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.078+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-05-08T18:51:07.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.078+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:124 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.079+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(124 gc.14 [call] v25'161 uv161 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.079+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:125 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.079+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(125 gc.14 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.079+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.079+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:126 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.079+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(126 gc.14 [call out=24b] v0'0 uv161 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.079+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:127 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.080+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(127 gc.14 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.080+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.080+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:128 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.080+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 32 ==== osd_op_reply(128 gc.14 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.080+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.080+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:129 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.081+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 33 ==== osd_op_reply(129 gc.14 [call] v25'162 uv162 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.081+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-05-08T18:51:07.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.081+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:130 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.082+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 33 ==== osd_op_reply(130 gc.15 [call] v25'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.082+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:131 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.082+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 34 ==== osd_op_reply(131 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.082+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.082+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:132 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.083+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 35 ==== osd_op_reply(132 gc.15 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.083+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:133 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.083+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 36 ==== osd_op_reply(133 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.083+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.083+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:134 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.083+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 37 ==== osd_op_reply(134 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.083+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.083+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:135 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.084+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 38 ==== osd_op_reply(135 gc.15 [call] v25'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.084+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-05-08T18:51:07.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.084+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:136 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.085+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 30 ==== osd_op_reply(136 gc.16 [call] v25'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.085+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:137 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.085+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 31 ==== osd_op_reply(137 gc.16 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.085+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.085+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:138 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.086+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 32 ==== osd_op_reply(138 gc.16 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.086+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:139 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.086+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 33 ==== osd_op_reply(139 gc.16 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.086+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.086+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:140 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.086+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 34 ==== osd_op_reply(140 gc.16 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.086+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.086+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:141 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.087+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 35 ==== osd_op_reply(141 gc.16 [call] v25'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.087+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-05-08T18:51:07.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.087+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:142 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.088+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 39 ==== osd_op_reply(142 gc.17 [call] v25'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.088+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:143 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.088+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 40 ==== osd_op_reply(143 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.088+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.088+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:144 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.088+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 41 ==== osd_op_reply(144 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.088+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.089+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 42 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.089+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.089+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.089+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 43 ==== osd_op_reply(146 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.089+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.089+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.090+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 44 ==== osd_op_reply(147 gc.17 [call] v25'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.090+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-05-08T18:51:07.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.090+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.091+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 34 ==== osd_op_reply(148 gc.18 [call] v25'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.091+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.092+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 35 ==== osd_op_reply(149 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.092+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.092+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.092+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 36 ==== osd_op_reply(150 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.092+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:151 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.092+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 37 ==== osd_op_reply(151 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.092+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.092+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:152 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.092+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 38 ==== osd_op_reply(152 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.092+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.092+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:153 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.093+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 39 ==== osd_op_reply(153 gc.18 [call] v25'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.093+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-05-08T18:51:07.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.093+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:154 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.094+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 40 ==== osd_op_reply(154 gc.19 [call] v25'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.094+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:155 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.095+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 41 ==== osd_op_reply(155 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.095+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.095+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:156 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.095+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 42 ==== osd_op_reply(156 gc.19 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.095+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:157 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.095+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 43 ==== osd_op_reply(157 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.095+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.095+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:158 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.095+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 44 ==== osd_op_reply(158 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.095+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.095+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:159 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.096+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 45 ==== osd_op_reply(159 gc.19 [call] v25'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.096+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-05-08T18:51:07.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.096+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:160 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.097+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 45 ==== osd_op_reply(160 gc.20 [call] v25'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.097+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:161 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.098+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 46 ==== osd_op_reply(161 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.098+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.098+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:162 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.098+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 47 ==== osd_op_reply(162 gc.20 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.098+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:163 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.098+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 48 ==== osd_op_reply(163 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.098+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.098+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:164 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.098+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 49 ==== osd_op_reply(164 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.098+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.098+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:165 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.099+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 50 ==== osd_op_reply(165 gc.20 [call] v25'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.099+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-05-08T18:51:07.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.099+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:166 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.100+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 36 ==== osd_op_reply(166 gc.21 [call] v25'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.100+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:167 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.101+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 37 ==== osd_op_reply(167 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.101+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.101+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:168 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.101+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 38 ==== osd_op_reply(168 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.101+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:169 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.101+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 39 ==== osd_op_reply(169 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.101+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.101+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:170 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.102+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 40 ==== osd_op_reply(170 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.102+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.102+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:171 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.102+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 41 ==== osd_op_reply(171 gc.21 [call] v25'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.102+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-05-08T18:51:07.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.102+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:172 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.103+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 51 ==== osd_op_reply(172 gc.22 [call] v25'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.103+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:173 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.104+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 52 ==== osd_op_reply(173 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.104+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.104+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:174 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.104+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 53 ==== osd_op_reply(174 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.104+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:175 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.104+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 54 ==== osd_op_reply(175 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.104+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.104+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:176 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.104+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 55 ==== osd_op_reply(176 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.104+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.104+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:177 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.105+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 56 ==== osd_op_reply(177 gc.22 [call] v25'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.105+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-05-08T18:51:07.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.105+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:178 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.106+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 57 ==== osd_op_reply(178 gc.23 [call] v25'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.106+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:179 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.106+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 58 ==== osd_op_reply(179 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.106+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.106+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:180 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.107+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 59 ==== osd_op_reply(180 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.107+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:181 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.107+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 60 ==== osd_op_reply(181 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.107+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.107+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:182 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.107+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 61 ==== osd_op_reply(182 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.107+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.107+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:183 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.108+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 62 ==== osd_op_reply(183 gc.23 [call] v25'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.108+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-05-08T18:51:07.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.108+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:184 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.109+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 63 ==== osd_op_reply(184 gc.24 [call] v25'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.109+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:185 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.109+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 64 ==== osd_op_reply(185 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.109+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.109+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:186 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.110+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 65 ==== osd_op_reply(186 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.110+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:187 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.110+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 66 ==== osd_op_reply(187 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.110+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.110+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:188 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.110+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 67 ==== osd_op_reply(188 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.110+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.110+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:189 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.111+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 68 ==== osd_op_reply(189 gc.24 [call] v25'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.111+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-05-08T18:51:07.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.111+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:190 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.112+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 69 ==== osd_op_reply(190 gc.25 [call] v25'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.112+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:191 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.112+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 70 ==== osd_op_reply(191 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.112+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.112+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:192 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.113+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 71 ==== osd_op_reply(192 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.113+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:193 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.113+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 72 ==== osd_op_reply(193 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.113+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.113+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:194 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.113+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 73 ==== osd_op_reply(194 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.113+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.113+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:195 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.114+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 74 ==== osd_op_reply(195 gc.25 [call] v25'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.114+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-05-08T18:51:07.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.114+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:196 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.115+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 36 ==== osd_op_reply(196 gc.26 [call] v25'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.115+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:197 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.116+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 37 ==== osd_op_reply(197 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.116+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.116+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:198 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.116+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 38 ==== osd_op_reply(198 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.116+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:199 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.116+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 39 ==== osd_op_reply(199 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.116+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.116+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:200 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.116+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 40 ==== osd_op_reply(200 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.116+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.116+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:201 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.117+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 41 ==== osd_op_reply(201 gc.26 [call] v25'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.117+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-05-08T18:51:07.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.117+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:202 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.118+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 75 ==== osd_op_reply(202 gc.27 [call] v25'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.118+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:203 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.119+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 76 ==== osd_op_reply(203 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.119+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.119+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:204 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.119+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 77 ==== osd_op_reply(204 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.119+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:205 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.119+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 78 ==== osd_op_reply(205 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.119+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.119+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:206 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.119+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 79 ==== osd_op_reply(206 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.119+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.119+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:207 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.120+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 80 ==== osd_op_reply(207 gc.27 [call] v25'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.120+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-05-08T18:51:07.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.120+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:208 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.122+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 42 ==== osd_op_reply(208 gc.28 [call] v25'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.122+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:209 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.122+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 43 ==== osd_op_reply(209 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.122+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.122+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:210 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.122+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 44 ==== osd_op_reply(210 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.122+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:211 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.122+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 45 ==== osd_op_reply(211 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.122+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.122+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:212 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.123+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 46 ==== osd_op_reply(212 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.123+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.123+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:213 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.123 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.124+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 47 ==== osd_op_reply(213 gc.28 [call] v25'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.124+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-05-08T18:51:07.124 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.124+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:214 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.125+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 81 ==== osd_op_reply(214 gc.29 [call] v25'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.125+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:215 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.125+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 82 ==== osd_op_reply(215 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.125+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.125+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:216 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.125+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 83 ==== osd_op_reply(216 gc.29 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.125+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:217 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.126+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 84 ==== osd_op_reply(217 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.126+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.126+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:218 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.126+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 85 ==== osd_op_reply(218 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.126+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.126+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:219 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.127+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 86 ==== osd_op_reply(219 gc.29 [call] v25'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.127+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-05-08T18:51:07.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.127+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:220 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.128+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 48 ==== osd_op_reply(220 gc.30 [call] v25'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.128+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:221 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.128+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 49 ==== osd_op_reply(221 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.128+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.128+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:222 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.129+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 50 ==== osd_op_reply(222 gc.30 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.129+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:223 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.129+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 51 ==== osd_op_reply(223 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.129+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.129+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:224 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.129+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 52 ==== osd_op_reply(224 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.129+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.129+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:225 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.130+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 53 ==== osd_op_reply(225 gc.30 [call] v25'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.130+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-05-08T18:51:07.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.130+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:226 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.131+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 42 ==== osd_op_reply(226 gc.31 [call] v25'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.131+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:227 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.132+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 43 ==== osd_op_reply(227 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.132+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.132+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:228 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.132+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 44 ==== osd_op_reply(228 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.132+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:229 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.132+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 45 ==== osd_op_reply(229 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.132+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.132+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:230 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.132+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 46 ==== osd_op_reply(230 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.132+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.132+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:231 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.133+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 47 ==== osd_op_reply(231 gc.31 [call] v25'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.133+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-05-08T18:51:07.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.133+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:232 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.134+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 46 ==== osd_op_reply(232 gc.0 [call] v25'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.134+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:233 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.134+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 47 ==== osd_op_reply(233 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.134+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.134+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:234 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.135+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 48 ==== osd_op_reply(234 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.135+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:235 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.135+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 49 ==== osd_op_reply(235 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.135+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.135+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:236 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.135+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 50 ==== osd_op_reply(236 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.135+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.135+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:237 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.136+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 51 ==== osd_op_reply(237 gc.0 [call] v25'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.136+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-05-08T18:51:07.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.136+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:238 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.137+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 54 ==== osd_op_reply(238 gc.1 [call] v25'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.137+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:239 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.137+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 55 ==== osd_op_reply(239 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.137+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.138+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:240 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.138+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 56 ==== osd_op_reply(240 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.138+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:241 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.138+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 57 ==== osd_op_reply(241 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.138+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.138+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:242 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.138+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 58 ==== osd_op_reply(242 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.139+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.139+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:243 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.140+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 59 ==== osd_op_reply(243 gc.1 [call] v25'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.140+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-05-08T18:51:07.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.140+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:244 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.141+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 87 ==== osd_op_reply(244 gc.2 [call] v25'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.141+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:245 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.141+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 88 ==== osd_op_reply(245 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.141+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.141+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:246 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.141+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 89 ==== osd_op_reply(246 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.141+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:247 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.141+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 90 ==== osd_op_reply(247 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.141+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.141+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:248 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.142+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 91 ==== osd_op_reply(248 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.142+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.142+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:249 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.143+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 92 ==== osd_op_reply(249 gc.2 [call] v25'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.143+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-05-08T18:51:07.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.143+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:250 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.144+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 52 ==== osd_op_reply(250 gc.3 [call] v25'165 uv165 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.144+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:251 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.144+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 53 ==== osd_op_reply(251 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.144+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.144+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:252 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.144+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 54 ==== osd_op_reply(252 gc.3 [call out=24b] v0'0 uv165 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.144+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:253 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.144+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 55 ==== osd_op_reply(253 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.144+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.144+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:254 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.145+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 56 ==== osd_op_reply(254 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.145+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.145+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:255 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.145+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 57 ==== osd_op_reply(255 gc.3 [call] v25'166 uv166 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.145+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-05-08T18:51:07.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.146+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:256 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.146+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 48 ==== osd_op_reply(256 gc.4 [call] v25'54 uv54 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.147+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:257 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.147+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 49 ==== osd_op_reply(257 gc.4 [call out=15b] v0'0 uv54 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.147+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.147+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:258 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.147+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 50 ==== osd_op_reply(258 gc.4 [call out=24b] v0'0 uv54 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.147+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:259 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.147+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 51 ==== osd_op_reply(259 gc.4 [call out=15b] v0'0 uv54 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.147+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.147+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:260 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.147+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 52 ==== osd_op_reply(260 gc.4 [call out=15b] v0'0 uv54 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.147+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.147+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:261 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e8014070 2024-05-08T18:51:07.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.148+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 53 ==== osd_op_reply(261 gc.4 [call] v25'55 uv55 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.148+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-05-08T18:51:07.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.148+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:262 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.149+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 93 ==== osd_op_reply(262 gc.5 [call] v25'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.149+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:263 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.149+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 94 ==== osd_op_reply(263 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.149+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.149+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:264 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.150+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 95 ==== osd_op_reply(264 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.150+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:265 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.150+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 96 ==== osd_op_reply(265 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.150+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.150+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:266 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.150+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 97 ==== osd_op_reply(266 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.150+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.150+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:267 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785b0cb0 2024-05-08T18:51:07.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.151+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 98 ==== osd_op_reply(267 gc.5 [call] v25'37 uv37 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.151+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-05-08T18:51:07.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.151+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:268 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.152+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 58 ==== osd_op_reply(268 gc.6 [call] v25'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.152+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:269 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.152+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 59 ==== osd_op_reply(269 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.152+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.152+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:270 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.153+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 60 ==== osd_op_reply(270 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.153+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:271 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.153+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 61 ==== osd_op_reply(271 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.153+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.153+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:272 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.153+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 62 ==== osd_op_reply(272 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.153+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.153+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:273 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x558b785ac3e0 2024-05-08T18:51:07.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.154+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 63 ==== osd_op_reply(273 gc.6 [call] v25'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.154+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-05-08T18:51:07.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.154+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:274 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.155+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 60 ==== osd_op_reply(274 gc.7 [call] v25'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.155+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:275 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.155+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 61 ==== osd_op_reply(275 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.155+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.155+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:276 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.156+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 62 ==== osd_op_reply(276 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.156+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:277 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.156+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 63 ==== osd_op_reply(277 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.156+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.156+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:278 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785c6d60 con 0x7fb7e0082030 2024-05-08T18:51:07.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.156+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 64 ==== osd_op_reply(278 gc.7 [call out=1702b] v0'0 uv36 ondisk = 0) ==== 148+0+1702 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.156+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-05-08T18:51:07.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.156+0000 7fb7f103f800 20 garbage collection: RGWGC::process iterating over entry tag='bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.15435721887859102232', time=2024-05-08T18:51:06.725812+0000, chain.objs.size()=7 2024-05-08T18:51:07.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.156+0000 7fb7f103f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_1 2024-05-08T18:51:07.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.156+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:279 3.35 3:afb885eb:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785f4990 con 0x558b785ac3e0 2024-05-08T18:51:07.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.156+0000 7fb7f103f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_2 2024-05-08T18:51:07.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.156+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:280 3.1b 3:d901f492:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785f9860 con 0x558b785b0cb0 2024-05-08T18:51:07.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.156+0000 7fb7f103f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_3 2024-05-08T18:51:07.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.156+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:281 3.5 3:a3abed50:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785fc0d0 con 0x7fb7e8014070 2024-05-08T18:51:07.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.156+0000 7fb7f103f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_4 2024-05-08T18:51:07.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.156+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:282 3.28 3:16194c0a:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785fe940 con 0x558b785b0cb0 2024-05-08T18:51:07.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.156+0000 7fb7f103f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_5 2024-05-08T18:51:07.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.156+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:283 3.25 3:a603300b:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b786011b0 con 0x558b785ac3e0 2024-05-08T18:51:07.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.156+0000 7fb7f103f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_6 2024-05-08T18:51:07.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.156+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:284 3.38 3:1ed73ee3:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b78603680 con 0x7fb7e0082030 2024-05-08T18:51:07.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.157+0000 7fb7f103f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_7 2024-05-08T18:51:07.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.157+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:285 3.0 3:0147da61:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b78605fa0 con 0x7fb7e0082030 2024-05-08T18:51:07.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.159+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 65 ==== osd_op_reply(285 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_7 [call] v25'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.159+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 99 ==== osd_op_reply(280 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_2 [call] v25'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.159+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 64 ==== osd_op_reply(279 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_1 [call] v25'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.159+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 54 ==== osd_op_reply(281 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_3 [call] v25'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.161+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 65 ==== osd_op_reply(283 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_5 [call] v25'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.161+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 100 ==== osd_op_reply(282 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_4 [call] v25'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.161+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 66 ==== osd_op_reply(284 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1__shadow_.gcreAIY5FSvsR21daEDqkGdJbbzIoQP_6 [call] v25'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.161+0000 7fb7f103f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-05-08T18:51:07.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.161+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:286 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785f43e0 con 0x7fb7e0082030 2024-05-08T18:51:07.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.163+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 67 ==== osd_op_reply(286 gc.7 [call] v25'37 uv37 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.163+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:287 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785f43e0 con 0x7fb7e0082030 2024-05-08T18:51:07.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.164+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 68 ==== osd_op_reply(287 gc.7 [call] v25'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.164+0000 7fb7f103f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-05-08T18:51:07.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.164+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:288 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785f43e0 con 0x7fb7e8014070 2024-05-08T18:51:07.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.166+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 55 ==== osd_op_reply(288 gc.8 [call] v25'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.166+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:289 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785f43e0 con 0x7fb7e8014070 2024-05-08T18:51:07.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.167+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 56 ==== osd_op_reply(289 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.167+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.167+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:290 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785faba0 con 0x7fb7e8014070 2024-05-08T18:51:07.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.167+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 57 ==== osd_op_reply(290 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.167+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:291 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785f4390 con 0x7fb7e8014070 2024-05-08T18:51:07.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.167+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 58 ==== osd_op_reply(291 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.167+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:51:07.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.167+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:292 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558b785f4390 con 0x7fb7e8014070 2024-05-08T18:51:07.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.167+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 59 ==== osd_op_reply(292 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.167+0000 7fb7f103f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:51:07.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.167+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:293 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785f4390 con 0x7fb7e8014070 2024-05-08T18:51:07.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.168+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 60 ==== osd_op_reply(293 gc.8 [call] v25'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.169+0000 7fb6a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:07.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.169+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94057508097344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785f3c10 con 0x558b785ac3e0 2024-05-08T18:51:07.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.170+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94057508097344] v25'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.170+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94057508072720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785f3c10 con 0x7fb7e8014070 2024-05-08T18:51:07.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.171+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 61 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94057508072720] v25'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.171+0000 7fb7f103f800 20 remove_watcher() i=0 2024-05-08T18:51:07.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.171+0000 7fb7f103f800 2 removed watcher, disabling cache 2024-05-08T18:51:07.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.171+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94057508078288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785b6d10 con 0x558b785ac3e0 2024-05-08T18:51:07.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.172+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94057508078288] v25'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.172+0000 7fb7f103f800 20 remove_watcher() i=1 2024-05-08T18:51:07.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.173+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94057508081840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785b6d10 con 0x558b785b0cb0 2024-05-08T18:51:07.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.174+0000 7fb7ef338640 1 -- 172.21.15.132:0/2819791774 <== osd.3 v2:172.21.15.132:6816/17827703 101 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94057508081840] v25'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e802a070 con 0x558b785b0cb0 2024-05-08T18:51:07.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.174+0000 7fb7f103f800 20 remove_watcher() i=2 2024-05-08T18:51:07.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.174+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94057508084048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785b90b0 con 0x7fb7e8014070 2024-05-08T18:51:07.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.175+0000 7fb7eeb37640 1 -- 172.21.15.132:0/2819791774 <== osd.2 v2:172.21.15.132:6808/1108348591 62 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94057508084048] v25'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e0075030 con 0x7fb7e8014070 2024-05-08T18:51:07.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.175+0000 7fb7f103f800 20 remove_watcher() i=3 2024-05-08T18:51:07.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.175+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94057508088480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785b6d10 con 0x558b785ac3e0 2024-05-08T18:51:07.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.175+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.1 v2:172.21.15.132:6800/3697320277 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94057508088480] v25'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x558b785ac3e0 2024-05-08T18:51:07.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.176+0000 7fb7f103f800 20 remove_watcher() i=4 2024-05-08T18:51:07.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.176+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94057508092208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785b9950 con 0x7fb7e0082030 2024-05-08T18:51:07.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.176+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 69 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94057508092208] v25'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.177+0000 7fb7f103f800 20 remove_watcher() i=5 2024-05-08T18:51:07.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.177+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94057508079344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785baaa0 con 0x7fb7e0082030 2024-05-08T18:51:07.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.177+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 70 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94057508079344] v25'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.177+0000 7fb7f103f800 20 remove_watcher() i=6 2024-05-08T18:51:07.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.178+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94057508089536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558b785b6d10 con 0x7fb7e0082030 2024-05-08T18:51:07.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 <== osd.0 v2:172.21.15.42:6800/1521799280 71 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94057508089536] v25'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e403b040 con 0x7fb7e0082030 2024-05-08T18:51:07.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 20 remove_watcher() i=7 2024-05-08T18:51:07.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb7e0082030 msgr2=0x7fb7e008b280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb7e0082030 0x7fb7e008b280 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558b785ac3e0 msgr2=0x558b785ae8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558b785ac3e0 0x558b785ae8a0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb7e8014070 msgr2=0x7fb7e8051110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb7e8014070 0x7fb7e8051110 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558b785b0cb0 msgr2=0x558b785b30e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558b785b0cb0 0x558b785b30e0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb6b803bb50 msgr2=0x7fb6b803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb6b803bb50 0x7fb6b803e010 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0007000 tx=0x7fb7e0084000 comp rx=0 tx=0).stop 2024-05-08T18:51:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b78599160 msgr2=0x558b785a06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7ee336640 1 -- 172.21.15.132:0/2819791774 reap_dead start 2024-05-08T18:51:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b78599160 0x558b785a06f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80014b0 tx=0x7fb7e8052be0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 shutdown_connections 2024-05-08T18:51:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 --2- 172.21.15.132:0/2819791774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b78599160 0x558b785a06f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 >> 172.21.15.132:0/2819791774 conn(0x558b785954c0 msgr2=0x558b78592b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 shutdown_connections 2024-05-08T18:51:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 -- 172.21.15.132:0/2819791774 wait complete. 2024-05-08T18:51:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 -- 172.21.15.132:0/1584447935 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb6c803bb50 msgr2=0x7fb6c803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 --2- 172.21.15.132:0/1584447935 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb6c803bb50 0x7fb6c803e010 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x558b78574e10 tx=0x7fb7e004abd0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 -- 172.21.15.132:0/1584447935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b7858be60 msgr2=0x558b7858c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 --2- 172.21.15.132:0/1584447935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b7858be60 0x558b7858c280 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x558b78571420 tx=0x7fb7e80188f0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 -- 172.21.15.132:0/1584447935 shutdown_connections 2024-05-08T18:51:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 --2- 172.21.15.132:0/1584447935 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb6c803bb50 0x7fb6c803e010 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 --2- 172.21.15.132:0/1584447935 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b7858be60 0x558b7858c280 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 -- 172.21.15.132:0/1584447935 >> 172.21.15.132:0/1584447935 conn(0x558b7857ff00 msgr2=0x558b78580300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.179+0000 7fb7f103f800 1 -- 172.21.15.132:0/1584447935 shutdown_connections 2024-05-08T18:51:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.180+0000 7fb7f103f800 1 -- 172.21.15.132:0/1584447935 wait complete. 2024-05-08T18:51:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.180+0000 7fb7f103f800 1 -- 172.21.15.132:0/2514388494 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558b78575730 msgr2=0x558b78577b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.180+0000 7fb7f103f800 1 --2- 172.21.15.132:0/2514388494 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558b78575730 0x558b78577b20 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.180+0000 7fb7f103f800 1 -- 172.21.15.132:0/2514388494 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558b7857a2c0 msgr2=0x558b7857c750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.180+0000 7fb7f103f800 1 --2- 172.21.15.132:0/2514388494 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558b7857a2c0 0x558b7857c750 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.180+0000 7fb7f103f800 1 -- 172.21.15.132:0/2514388494 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb6d403bb50 msgr2=0x7fb6d403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.180+0000 7fb7f103f800 1 --2- 172.21.15.132:0/2514388494 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb6d403bb50 0x7fb6d403e010 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4001e40 tx=0x7fb7e40013a0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.180+0000 7fb7f103f800 1 -- 172.21.15.132:0/2514388494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b78476460 msgr2=0x558b785705a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.180+0000 7fb7f103f800 1 --2- 172.21.15.132:0/2514388494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b78476460 0x558b785705a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0052820 tx=0x7fb7e0003020 comp rx=0 tx=0).stop 2024-05-08T18:51:07.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.180+0000 7fb7f103f800 1 -- 172.21.15.132:0/2514388494 shutdown_connections 2024-05-08T18:51:07.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.180+0000 7fb7f103f800 1 --2- 172.21.15.132:0/2514388494 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558b7857a2c0 0x558b7857c750 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.180+0000 7fb7f103f800 1 --2- 172.21.15.132:0/2514388494 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558b78575730 0x558b78577b20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.180+0000 7fb7f103f800 1 --2- 172.21.15.132:0/2514388494 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb6d403bb50 0x7fb6d403e010 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.180+0000 7fb7f103f800 1 --2- 172.21.15.132:0/2514388494 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558b78476460 0x558b785705a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.180+0000 7fb7f103f800 1 -- 172.21.15.132:0/2514388494 >> 172.21.15.132:0/2514388494 conn(0x558b78470820 msgr2=0x558b783e9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.180+0000 7fb7f103f800 1 -- 172.21.15.132:0/2514388494 shutdown_connections 2024-05-08T18:51:07.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.180+0000 7fb7f103f800 1 -- 172.21.15.132:0/2514388494 wait complete. 2024-05-08T18:51:07.188 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-05-08T18:51:07.188 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-05-08T18:51:07.188 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-05-08T18:51:07.271 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:07.271 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:07.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.272+0000 7f854f733800 1 Processor -- start 2024-05-08T18:51:07.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.273+0000 7f854f733800 1 -- start start 2024-05-08T18:51:07.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.273+0000 7f854f733800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55effaeb1140 0x55effaeb1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.273+0000 7f854f733800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55effaeb1be0 con 0x55effaeb23a0 2024-05-08T18:51:07.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.273+0000 7f854f733800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55effad52e20 con 0x55effaeb1140 2024-05-08T18:51:07.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.273+0000 7f854b3ca640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55effaeb1140 0x55effaeb1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.273+0000 7f854b3ca640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55effaeb1140 0x55effaeb1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51278/0 (socket says 172.21.15.132:51278) 2024-05-08T18:51:07.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.273+0000 7f8542bc9640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55effaeb23a0 0x55effaeb2820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:55708/0 (socket says 172.21.15.132:55708) 2024-05-08T18:51:07.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.273+0000 7f854b3ca640 1 -- 172.21.15.132:0/345156485 learned_addr learned my addr 172.21.15.132:0/345156485 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.273+0000 7f854b3ca640 1 -- 172.21.15.132:0/345156485 >> v1:172.21.15.42:6789/0 conn(0x55effaeb23a0 legacy=0x55effaeb2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.273+0000 7f854b3ca640 1 -- 172.21.15.132:0/345156485 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55effaeb2f60 con 0x55effaeb1140 2024-05-08T18:51:07.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.275+0000 7f854b3ca640 1 --2- 172.21.15.132:0/345156485 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effaeb1140 0x55effaeb1560 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f853c00a520 tx=0x7f853c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2583613712b9e8ad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.275+0000 7f854abc9640 1 -- 172.21.15.132:0/345156485 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f853c057070 con 0x55effaeb1140 2024-05-08T18:51:07.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.275+0000 7f854abc9640 1 -- 172.21.15.132:0/345156485 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f853c052570 con 0x55effaeb1140 2024-05-08T18:51:07.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.275+0000 7f854abc9640 1 -- 172.21.15.132:0/345156485 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f853c052870 con 0x55effaeb1140 2024-05-08T18:51:07.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.276+0000 7f854f733800 1 -- 172.21.15.132:0/345156485 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effaeb1140 msgr2=0x55effaeb1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.276+0000 7f854f733800 1 --2- 172.21.15.132:0/345156485 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effaeb1140 0x55effaeb1560 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f853c00a520 tx=0x7f853c01d010 comp rx=0 tx=0).stop 2024-05-08T18:51:07.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.276+0000 7f854f733800 1 -- 172.21.15.132:0/345156485 shutdown_connections 2024-05-08T18:51:07.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.276+0000 7f854f733800 1 --2- 172.21.15.132:0/345156485 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effaeb1140 0x55effaeb1560 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.276+0000 7f854f733800 1 -- 172.21.15.132:0/345156485 >> 172.21.15.132:0/345156485 conn(0x55effaeac720 msgr2=0x55effaeaeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.276+0000 7f854f733800 1 -- 172.21.15.132:0/345156485 shutdown_connections 2024-05-08T18:51:07.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.276+0000 7f854f733800 1 -- 172.21.15.132:0/345156485 wait complete. 2024-05-08T18:51:07.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.290+0000 7f854f733800 1 Processor -- start 2024-05-08T18:51:07.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.290+0000 7f854f733800 1 -- start start 2024-05-08T18:51:07.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.290+0000 7f854f733800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effaeb1140 0x55effae252c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.290+0000 7f854f733800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55effadfd5b0 con 0x55effaeb1140 2024-05-08T18:51:07.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.290+0000 7f854b3ca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effaeb1140 0x55effae252c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.290+0000 7f854b3ca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effaeb1140 0x55effae252c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51280/0 (socket says 172.21.15.132:51280) 2024-05-08T18:51:07.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.290+0000 7f854b3ca640 1 -- 172.21.15.132:0/597222818 learned_addr learned my addr 172.21.15.132:0/597222818 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.291+0000 7f854b3ca640 1 -- 172.21.15.132:0/597222818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55effafa64b0 con 0x55effaeb1140 2024-05-08T18:51:07.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.291+0000 7f854b3ca640 1 --2- 172.21.15.132:0/597222818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effaeb1140 0x55effae252c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f853c055040 tx=0x7f853c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef4634a81743470 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.291+0000 7f843960a640 1 -- 172.21.15.132:0/597222818 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f853c057040 con 0x55effaeb1140 2024-05-08T18:51:07.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.291+0000 7f843960a640 1 -- 172.21.15.132:0/597222818 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f853c052850 con 0x55effaeb1140 2024-05-08T18:51:07.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.291+0000 7f843960a640 1 -- 172.21.15.132:0/597222818 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f853c052b50 con 0x55effaeb1140 2024-05-08T18:51:07.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.292+0000 7f854f733800 1 -- 172.21.15.132:0/597222818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effaeb1140 msgr2=0x55effae252c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.292+0000 7f854f733800 1 --2- 172.21.15.132:0/597222818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effaeb1140 0x55effae252c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f853c055040 tx=0x7f853c04c000 comp rx=0 tx=0).stop 2024-05-08T18:51:07.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.292+0000 7f854f733800 1 -- 172.21.15.132:0/597222818 shutdown_connections 2024-05-08T18:51:07.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.292+0000 7f854f733800 1 --2- 172.21.15.132:0/597222818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effaeb1140 0x55effae252c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.292+0000 7f854f733800 1 -- 172.21.15.132:0/597222818 >> 172.21.15.132:0/597222818 conn(0x55effaeac720 msgr2=0x55effaf9dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.292+0000 7f854f733800 1 -- 172.21.15.132:0/597222818 shutdown_connections 2024-05-08T18:51:07.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.292+0000 7f854f733800 1 -- 172.21.15.132:0/597222818 wait complete. 2024-05-08T18:51:07.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.292+0000 7f854f733800 1 Processor -- start 2024-05-08T18:51:07.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.293+0000 7f854f733800 1 -- start start 2024-05-08T18:51:07.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.293+0000 7f854f733800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effaeb1140 0x55effafab230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.293+0000 7f854f733800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55effaeba870 con 0x55effaeb1140 2024-05-08T18:51:07.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.293+0000 7f854b3ca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effaeb1140 0x55effafab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.293+0000 7f854b3ca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effaeb1140 0x55effafab230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51286/0 (socket says 172.21.15.132:51286) 2024-05-08T18:51:07.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.293+0000 7f854b3ca640 1 -- 172.21.15.132:0/35793808 learned_addr learned my addr 172.21.15.132:0/35793808 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.293+0000 7f854b3ca640 1 -- 172.21.15.132:0/35793808 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55effafab770 con 0x55effaeb1140 2024-05-08T18:51:07.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.293+0000 7f854b3ca640 1 --2- 172.21.15.132:0/35793808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effaeb1140 0x55effafab230 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f853c00a520 tx=0x7f853c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.294+0000 7f8437e07640 1 -- 172.21.15.132:0/35793808 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f853c073070 con 0x55effaeb1140 2024-05-08T18:51:07.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.294+0000 7f8437e07640 1 -- 172.21.15.132:0/35793808 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f853c05d570 con 0x55effaeb1140 2024-05-08T18:51:07.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.294+0000 7f8437e07640 1 -- 172.21.15.132:0/35793808 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f853c057070 con 0x55effaeb1140 2024-05-08T18:51:07.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.294+0000 7f854f733800 1 -- 172.21.15.132:0/35793808 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55effafaba00 con 0x55effaeb1140 2024-05-08T18:51:07.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.294+0000 7f854f733800 1 -- 172.21.15.132:0/35793808 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55effafae6b0 con 0x55effaeb1140 2024-05-08T18:51:07.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.295+0000 7f8437e07640 1 -- 172.21.15.132:0/35793808 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f853c076070 con 0x55effaeb1140 2024-05-08T18:51:07.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.295+0000 7f8437e07640 1 --2- 172.21.15.132:0/35793808 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f843003bba0 0x7f843003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.295+0000 7f8437e07640 1 -- 172.21.15.132:0/35793808 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f853c093fb0 con 0x55effaeb1140 2024-05-08T18:51:07.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.295+0000 7f8542bc9640 1 --2- 172.21.15.132:0/35793808 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f843003bba0 0x7f843003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.295+0000 7f854f733800 1 --2- 172.21.15.132:0/35793808 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55effaeb23a0 0x55effafb2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.295+0000 7f854f733800 1 -- 172.21.15.132:0/35793808 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effafb29b0 con 0x55effaeb23a0 2024-05-08T18:51:07.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.295+0000 7f854bbcb640 1 --2- 172.21.15.132:0/35793808 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55effaeb23a0 0x55effafb2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.295+0000 7f8542bc9640 1 --2- 172.21.15.132:0/35793808 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f843003bba0 0x7f843003e060 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8534000f60 tx=0x7f8534001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.295+0000 7f854bbcb640 1 --2- 172.21.15.132:0/35793808 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55effaeb23a0 0x55effafb2470 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.296+0000 7f854bbcb640 1 -- 172.21.15.132:0/35793808 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f854400a4a0 con 0x55effaeb23a0 2024-05-08T18:51:07.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.296+0000 7f854f733800 1 -- 172.21.15.132:0/35793808 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effafafa20 con 0x55effaeb23a0 2024-05-08T18:51:07.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.296+0000 7f854bbcb640 1 -- 172.21.15.132:0/35793808 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f854400a4a0 con 0x55effaeb23a0 2024-05-08T18:51:07.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.296+0000 7f854f733800 1 --2- 172.21.15.132:0/35793808 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55effafb4cd0 0x55effafb70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.296+0000 7f854f733800 1 -- 172.21.15.132:0/35793808 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effafb77b0 con 0x55effafb4cd0 2024-05-08T18:51:07.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.296+0000 7f854b3ca640 1 --2- 172.21.15.132:0/35793808 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55effafb4cd0 0x55effafb70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.296+0000 7f854b3ca640 1 --2- 172.21.15.132:0/35793808 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55effafb4cd0 0x55effafb70c0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.297+0000 7f854b3ca640 1 -- 172.21.15.132:0/35793808 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f853c075030 con 0x55effafb4cd0 2024-05-08T18:51:07.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.297+0000 7f854f733800 1 -- 172.21.15.132:0/35793808 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effafb3b40 con 0x55effaeb23a0 2024-05-08T18:51:07.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.297+0000 7f854bbcb640 1 -- 172.21.15.132:0/35793808 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f854400a4a0 con 0x55effaeb23a0 2024-05-08T18:51:07.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.297+0000 7f854f733800 1 -- 172.21.15.132:0/35793808 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effafb4020 con 0x55effaeb23a0 2024-05-08T18:51:07.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.297+0000 7f854bbcb640 1 -- 172.21.15.132:0/35793808 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f854400a4a0 con 0x55effaeb23a0 2024-05-08T18:51:07.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.297+0000 7f854f733800 1 Processor -- start 2024-05-08T18:51:07.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.298+0000 7f854f733800 1 -- start start 2024-05-08T18:51:07.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.298+0000 7f854f733800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effafc66c0 0x55effafc6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.298+0000 7f854f733800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55effada3fc0 con 0x55effafc66c0 2024-05-08T18:51:07.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.298+0000 7f854bbcb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effafc66c0 0x55effafc6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.298+0000 7f854bbcb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effafc66c0 0x55effafc6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51288/0 (socket says 172.21.15.132:51288) 2024-05-08T18:51:07.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.298+0000 7f854bbcb640 1 -- 172.21.15.132:0/676922314 learned_addr learned my addr 172.21.15.132:0/676922314 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.298+0000 7f854bbcb640 1 -- 172.21.15.132:0/676922314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55effafc7020 con 0x55effafc66c0 2024-05-08T18:51:07.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.299+0000 7f854bbcb640 1 --2- 172.21.15.132:0/676922314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effafc66c0 0x55effafc6ae0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x55effafb2d50 tx=0x7f8544018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.299+0000 7f8435602640 1 -- 172.21.15.132:0/676922314 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8544014450 con 0x55effafc66c0 2024-05-08T18:51:07.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.299+0000 7f8435602640 1 -- 172.21.15.132:0/676922314 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8544014610 con 0x55effafc66c0 2024-05-08T18:51:07.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.299+0000 7f854f733800 1 -- 172.21.15.132:0/676922314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55effafc7a90 con 0x55effafc66c0 2024-05-08T18:51:07.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.299+0000 7f8435602640 1 -- 172.21.15.132:0/676922314 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8544014930 con 0x55effafc66c0 2024-05-08T18:51:07.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.299+0000 7f854f733800 1 -- 172.21.15.132:0/676922314 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55effafc7f90 con 0x55effafc66c0 2024-05-08T18:51:07.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.300+0000 7f8435602640 1 -- 172.21.15.132:0/676922314 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8544011040 con 0x55effafc66c0 2024-05-08T18:51:07.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.300+0000 7f8435602640 1 --2- 172.21.15.132:0/676922314 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f842403bb50 0x7f842403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.300+0000 7f8435602640 1 -- 172.21.15.132:0/676922314 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f854401e070 con 0x55effafc66c0 2024-05-08T18:51:07.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.300+0000 7f854b3ca640 1 --2- 172.21.15.132:0/676922314 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f842403bb50 0x7f842403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.300+0000 7f854f733800 1 Processor -- start 2024-05-08T18:51:07.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.300+0000 7f854b3ca640 1 --2- 172.21.15.132:0/676922314 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f842403bb50 0x7f842403e010 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f853c044830 tx=0x7f853c066750 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.300+0000 7f854f733800 1 -- start start 2024-05-08T18:51:07.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.300+0000 7f854f733800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effafd39a0 0x55effafd3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.300+0000 7f854f733800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55effafa6740 con 0x55effafd39a0 2024-05-08T18:51:07.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.301+0000 7f854bbcb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effafd39a0 0x55effafd3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.301+0000 7f854bbcb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effafd39a0 0x55effafd3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51298/0 (socket says 172.21.15.132:51298) 2024-05-08T18:51:07.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.301+0000 7f854bbcb640 1 -- 172.21.15.132:0/1368689088 learned_addr learned my addr 172.21.15.132:0/1368689088 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.301+0000 7f854bbcb640 1 -- 172.21.15.132:0/1368689088 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55effafd4390 con 0x55effafd39a0 2024-05-08T18:51:07.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.301+0000 7f854bbcb640 1 --2- 172.21.15.132:0/1368689088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effafd39a0 0x55effafd3dc0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8544013fd0 tx=0x7f85440118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ceec4c68bc7c11 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.301+0000 7f842effd640 1 -- 172.21.15.132:0/1368689088 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8544011c00 con 0x55effafd39a0 2024-05-08T18:51:07.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.301+0000 7f842effd640 1 -- 172.21.15.132:0/1368689088 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8544050070 con 0x55effafd39a0 2024-05-08T18:51:07.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.301+0000 7f842effd640 1 -- 172.21.15.132:0/1368689088 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8544014ad0 con 0x55effafd39a0 2024-05-08T18:51:07.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.302+0000 7f854f733800 1 -- 172.21.15.132:0/1368689088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effafd39a0 msgr2=0x55effafd3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.302+0000 7f854f733800 1 --2- 172.21.15.132:0/1368689088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effafd39a0 0x55effafd3dc0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8544013fd0 tx=0x7f85440118e0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.302+0000 7f854f733800 1 -- 172.21.15.132:0/1368689088 shutdown_connections 2024-05-08T18:51:07.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.302+0000 7f854f733800 1 --2- 172.21.15.132:0/1368689088 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effafd39a0 0x55effafd3dc0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.302+0000 7f854f733800 1 -- 172.21.15.132:0/1368689088 >> 172.21.15.132:0/1368689088 conn(0x55effafcfcb0 msgr2=0x55effafcdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.302+0000 7f854f733800 1 -- 172.21.15.132:0/1368689088 shutdown_connections 2024-05-08T18:51:07.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.302+0000 7f854f733800 1 -- 172.21.15.132:0/1368689088 wait complete. 2024-05-08T18:51:07.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.302+0000 7f854f733800 1 Processor -- start 2024-05-08T18:51:07.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.302+0000 7f854f733800 1 -- start start 2024-05-08T18:51:07.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.302+0000 7f854f733800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effafd39a0 0x55effafdaec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.302+0000 7f854f733800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55effafd4b60 con 0x55effafd39a0 2024-05-08T18:51:07.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.302+0000 7f854bbcb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effafd39a0 0x55effafdaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.302+0000 7f854bbcb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effafd39a0 0x55effafdaec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51304/0 (socket says 172.21.15.132:51304) 2024-05-08T18:51:07.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.302+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 learned_addr learned my addr 172.21.15.132:0/3794631456 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.303+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55effafdb400 con 0x55effafd39a0 2024-05-08T18:51:07.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.303+0000 7f854bbcb640 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effafd39a0 0x55effafdaec0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8544016c70 tx=0x7f8544052d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.303+0000 7f842d7fa640 1 -- 172.21.15.132:0/3794631456 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85440407c0 con 0x55effafd39a0 2024-05-08T18:51:07.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.303+0000 7f842d7fa640 1 -- 172.21.15.132:0/3794631456 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8544031030 con 0x55effafd39a0 2024-05-08T18:51:07.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.303+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55effafdb690 con 0x55effafd39a0 2024-05-08T18:51:07.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.303+0000 7f842d7fa640 1 -- 172.21.15.132:0/3794631456 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8544040a90 con 0x55effafd39a0 2024-05-08T18:51:07.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.303+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55effafde340 con 0x55effafd39a0 2024-05-08T18:51:07.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.304+0000 7f842d7fa640 1 -- 172.21.15.132:0/3794631456 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8544040c80 con 0x55effafd39a0 2024-05-08T18:51:07.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.304+0000 7f842d7fa640 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f841403bb50 0x7f841403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.304+0000 7f842d7fa640 1 -- 172.21.15.132:0/3794631456 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f854400e040 con 0x55effafd39a0 2024-05-08T18:51:07.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.304+0000 7f854b3ca640 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f841403bb50 0x7f841403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.304+0000 7f854f733800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.304+0000 7f854f733800 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55effafe6b30 0x55effafe8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.304+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effafe9720 con 0x55effafe6b30 2024-05-08T18:51:07.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.304+0000 7f8542bc9640 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55effafe6b30 0x55effafe8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.304+0000 7f854b3ca640 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f841403bb50 0x7f841403e010 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f853c0927f0 tx=0x7f853c07f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.305+0000 7f8542bc9640 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55effafe6b30 0x55effafe8fd0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.305+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f853400f610 con 0x55effafe6b30 2024-05-08T18:51:07.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.305+0000 7f854f733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.305+0000 7f854f733800 20 realm 2024-05-08T18:51:07.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.305+0000 7f854f733800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.305+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effafe6000 con 0x55effafe6b30 2024-05-08T18:51:07.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.305+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f853400f610 con 0x55effafe6b30 2024-05-08T18:51:07.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.305+0000 7f854f733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.305+0000 7f854f733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:07.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.305+0000 7f854f733800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.305+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effafea200 con 0x55effafe6b30 2024-05-08T18:51:07.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.305+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f853400f610 con 0x55effafe6b30 2024-05-08T18:51:07.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.305+0000 7f854f733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.305+0000 7f854f733800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.305+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effafeaad0 con 0x55effafe6b30 2024-05-08T18:51:07.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.305+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f853400f610 con 0x55effafe6b30 2024-05-08T18:51:07.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.305+0000 7f854f733800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:07.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.306+0000 7f854f733800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.306+0000 7f854f733800 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55effafeb3d0 0x55effafed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.306+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effafedf20 con 0x55effafeb3d0 2024-05-08T18:51:07.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.306+0000 7f854bbcb640 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55effafeb3d0 0x55effafed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.306+0000 7f854bbcb640 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55effafeb3d0 0x55effafed7c0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.306+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f854403d070 con 0x55effafeb3d0 2024-05-08T18:51:07.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.306+0000 7f854f733800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:07.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.306+0000 7f854f733800 20 searching for the correct realm 2024-05-08T18:51:07.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.306+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x55effafeb3d0 2024-05-08T18:51:07.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.307+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f854403d070 con 0x55effafeb3d0 2024-05-08T18:51:07.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.307+0000 7f854bbcb640 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f8544014070 0x7f85440549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.307+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x7f8544014070 2024-05-08T18:51:07.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.307+0000 7f854b3ca640 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f8544014070 0x7f85440549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.307+0000 7f854b3ca640 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f8544014070 0x7f85440549c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.307+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.307+0000 7f854b3ca640 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f853c078060 0x7f853c076360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.307+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x7f853c078060 2024-05-08T18:51:07.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.308+0000 7f8542bc9640 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f853c078060 0x7f853c076360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.308+0000 7f8542bc9640 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f853c078060 0x7f853c076360 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.308+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853400f610 con 0x7f853c078060 2024-05-08T18:51:07.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.308+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x55effafe6b30 2024-05-08T18:51:07.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.309+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853400f610 con 0x55effafe6b30 2024-05-08T18:51:07.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.309+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x55effafe6b30 2024-05-08T18:51:07.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.309+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853402b040 con 0x55effafe6b30 2024-05-08T18:51:07.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.309+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x7f853c078060 2024-05-08T18:51:07.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.309+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853402b040 con 0x7f853c078060 2024-05-08T18:51:07.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.309+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x7f853c078060 2024-05-08T18:51:07.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.310+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853402b040 con 0x7f853c078060 2024-05-08T18:51:07.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.310+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x7f8544014070 2024-05-08T18:51:07.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.310+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.310+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x55effafeb3d0 2024-05-08T18:51:07.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.310+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f854403d070 con 0x55effafeb3d0 2024-05-08T18:51:07.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.310+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x55effafe6b30 2024-05-08T18:51:07.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.310+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853402b040 con 0x55effafe6b30 2024-05-08T18:51:07.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.310+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x7f853c078060 2024-05-08T18:51:07.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.311+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853402b040 con 0x7f853c078060 2024-05-08T18:51:07.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.311+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x55effafe6b30 2024-05-08T18:51:07.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.311+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f853402b040 con 0x55effafe6b30 2024-05-08T18:51:07.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.311+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x7f8544014070 2024-05-08T18:51:07.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.311+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.311+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x55effafeb3d0 2024-05-08T18:51:07.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.311+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f854403d070 con 0x55effafeb3d0 2024-05-08T18:51:07.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.311+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x55effafeb3d0 2024-05-08T18:51:07.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.311+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f854403d070 con 0x55effafeb3d0 2024-05-08T18:51:07.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.311+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x7f853c078060 2024-05-08T18:51:07.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.312+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853402b040 con 0x7f853c078060 2024-05-08T18:51:07.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.312+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x55effafeb3d0 2024-05-08T18:51:07.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.312+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f854403d070 con 0x55effafeb3d0 2024-05-08T18:51:07.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.312+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x55effafeb3d0 2024-05-08T18:51:07.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.312+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f854403d070 con 0x55effafeb3d0 2024-05-08T18:51:07.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.312+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x55effafe6b30 2024-05-08T18:51:07.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.312+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853402b040 con 0x55effafe6b30 2024-05-08T18:51:07.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.313+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x55effafe6b30 2024-05-08T18:51:07.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.313+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f853402b040 con 0x55effafe6b30 2024-05-08T18:51:07.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.313+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x7f853c078060 2024-05-08T18:51:07.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.313+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853402b040 con 0x7f853c078060 2024-05-08T18:51:07.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.313+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x55effafeb3d0 2024-05-08T18:51:07.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.313+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.313+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x7f8544014070 2024-05-08T18:51:07.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.313+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.314+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x55effafe6b30 2024-05-08T18:51:07.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.314+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853402b040 con 0x55effafe6b30 2024-05-08T18:51:07.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.314+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x7f853c078060 2024-05-08T18:51:07.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.314+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.314+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x55effafeb3d0 2024-05-08T18:51:07.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.314+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.314+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x7f853c078060 2024-05-08T18:51:07.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.315+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.315+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x7f8544014070 2024-05-08T18:51:07.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.315+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.315+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x55effafeb3d0 2024-05-08T18:51:07.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.315+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.315+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x7f853c078060 2024-05-08T18:51:07.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.316+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.316+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x55effafe6b30 2024-05-08T18:51:07.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.316+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.316+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55effafef8f0 con 0x7f8544014070 2024-05-08T18:51:07.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.316+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.316+0000 7f854f733800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:07.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.316+0000 7f854f733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:07.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.316+0000 7f854f733800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:07.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.316+0000 7f854f733800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:07.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.316+0000 7f854f733800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:07.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.316+0000 7f854f733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:07.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.316+0000 7f854f733800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.316+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effafee9f0 con 0x55effafe6b30 2024-05-08T18:51:07.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.316+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.316+0000 7f854f733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.316+0000 7f854f733800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.316+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effafef290 con 0x55effafe6b30 2024-05-08T18:51:07.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.317+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.317+0000 7f854f733800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:07.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.317+0000 7f854f733800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.317+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effafefdc0 con 0x55effafe6b30 2024-05-08T18:51:07.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.317+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.317+0000 7f854f733800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:07.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.317+0000 7f854f733800 20 zone default found 2024-05-08T18:51:07.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.317+0000 7f854f733800 4 Realm: () 2024-05-08T18:51:07.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.317+0000 7f854f733800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:07.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.317+0000 7f854f733800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:07.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.317+0000 7f854f733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:07.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.317+0000 7f854f733800 20 zonegroup default 2024-05-08T18:51:07.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.317+0000 7f854f733800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.317+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effafefdc0 con 0x7f853c078060 2024-05-08T18:51:07.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.317+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.317+0000 7f854f733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.317+0000 7f854f733800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.317+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effaff1c50 con 0x55effafeb3d0 2024-05-08T18:51:07.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.317+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.317+0000 7f854f733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.317+0000 7f854f733800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.317+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effaff1ff0 con 0x55effafeb3d0 2024-05-08T18:51:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.318+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.318+0000 7f854f733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.318+0000 7f854f733800 20 started sync module instance, tier type = 2024-05-08T18:51:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.318+0000 7f854f733800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.318+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff1090 con 0x7f8544014070 2024-05-08T18:51:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.319+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.319+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94489196563424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff2390 con 0x7f8544014070 2024-05-08T18:51:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.319+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff2d50 con 0x55effafe6b30 2024-05-08T18:51:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.320+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94489196563424] v25'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.320+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.320+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94489196570784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff3170 con 0x55effafe6b30 2024-05-08T18:51:07.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.320+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff3b30 con 0x55effafeb3d0 2024-05-08T18:51:07.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.321+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94489196570784] v25'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.321+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.321+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94489196574816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff3170 con 0x55effafeb3d0 2024-05-08T18:51:07.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.321+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff4580 con 0x7f8544014070 2024-05-08T18:51:07.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.322+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94489196574816] v25'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.322+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.322+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94489196571840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff30e0 con 0x7f8544014070 2024-05-08T18:51:07.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.322+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff5380 con 0x55effafe6b30 2024-05-08T18:51:07.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.323+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94489196571840] v25'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.323+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.323+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94489196579232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff5770 con 0x55effafe6b30 2024-05-08T18:51:07.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.323+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff6170 con 0x7f853c078060 2024-05-08T18:51:07.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.324+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94489196579232] v25'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.324+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.324+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94489196580288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff6130 con 0x7f853c078060 2024-05-08T18:51:07.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.324+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff6b50 con 0x7f853c078060 2024-05-08T18:51:07.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.325+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94489196580288] v25'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.326+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.326+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94489196586560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff6d30 con 0x7f853c078060 2024-05-08T18:51:07.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.326+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff7580 con 0x7f853c078060 2024-05-08T18:51:07.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.327+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94489196586560] v25'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.327+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.327+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94489196588336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff7600 con 0x7f853c078060 2024-05-08T18:51:07.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.327+0000 7f854f733800 20 add_watcher() i=0 2024-05-08T18:51:07.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.327+0000 7f854f733800 20 add_watcher() i=1 2024-05-08T18:51:07.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.327+0000 7f854f733800 20 add_watcher() i=2 2024-05-08T18:51:07.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.327+0000 7f854f733800 20 add_watcher() i=3 2024-05-08T18:51:07.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.327+0000 7f854f733800 20 add_watcher() i=4 2024-05-08T18:51:07.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.327+0000 7f854f733800 20 add_watcher() i=5 2024-05-08T18:51:07.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.327+0000 7f854f733800 20 add_watcher() i=6 2024-05-08T18:51:07.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.328+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94489196588336] v25'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.328+0000 7f854f733800 20 add_watcher() i=7 2024-05-08T18:51:07.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.328+0000 7f854f733800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:07.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.328+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effaffa8f0 con 0x55effafe6b30 2024-05-08T18:51:07.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.328+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.328+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94489196589760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff7b90 con 0x55effafe6b30 2024-05-08T18:51:07.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.329+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94489196589760] v25'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.329+0000 7f8401fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:07.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.329+0000 7f854f733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:07.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.329+0000 7f854f733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:07.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.329+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb003020 con 0x55effafe6b30 2024-05-08T18:51:07.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.331+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v25'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.331+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb003590 con 0x7f853c078060 2024-05-08T18:51:07.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.332+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v25'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.332+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb003b00 con 0x55effafeb3d0 2024-05-08T18:51:07.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.333+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v25'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.333+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb003b00 con 0x55effafe6b30 2024-05-08T18:51:07.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.333+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v25'169 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.333+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb003f20 con 0x7f8544014070 2024-05-08T18:51:07.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.334+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v25'56 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.334+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb004770 con 0x55effafeb3d0 2024-05-08T18:51:07.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.335+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v25'38 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.335+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb004770 con 0x55effafe6b30 2024-05-08T18:51:07.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.337+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v25'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.337+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb004770 con 0x7f853c078060 2024-05-08T18:51:07.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.338+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v25'39 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.338+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb004770 con 0x7f8544014070 2024-05-08T18:51:07.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.339+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v25'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.339+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb004770 con 0x55effafeb3d0 2024-05-08T18:51:07.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.339+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v25'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.340+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb004770 con 0x7f8544014070 2024-05-08T18:51:07.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.340+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v25'57 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.340+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb001000 con 0x7f853c078060 2024-05-08T18:51:07.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.341+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v25'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.342+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb001000 con 0x7f8544014070 2024-05-08T18:51:07.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.342+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v25'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.342+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb001000 con 0x7f853c078060 2024-05-08T18:51:07.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.343+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v25'43 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.343+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb000e30 con 0x55effafe6b30 2024-05-08T18:51:07.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.344+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v25'170 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.344+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb000e30 con 0x55effafeb3d0 2024-05-08T18:51:07.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.345+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v25'50 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.345+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb000e30 con 0x7f8544014070 2024-05-08T18:51:07.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.346+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v25'58 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.347+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb000e30 con 0x55effafeb3d0 2024-05-08T18:51:07.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.347+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v25'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.347+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb000e30 con 0x55effafe6b30 2024-05-08T18:51:07.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.349+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v25'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.349+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb000e30 con 0x55effafe6b30 2024-05-08T18:51:07.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.350+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v25'171 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.350+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb000e30 con 0x55effafeb3d0 2024-05-08T18:51:07.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.351+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v25'51 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.351+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb000e30 con 0x7f8544014070 2024-05-08T18:51:07.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.352+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v25'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.352+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb000e30 con 0x55effafeb3d0 2024-05-08T18:51:07.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.352+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v25'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.352+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb000e30 con 0x55effafeb3d0 2024-05-08T18:51:07.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.353+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v25'29 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.353+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb000e30 con 0x55effafeb3d0 2024-05-08T18:51:07.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.354+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v25'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.354+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb000e30 con 0x55effafeb3d0 2024-05-08T18:51:07.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.355+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v25'39 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.355+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb000e30 con 0x7f853c078060 2024-05-08T18:51:07.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.357+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v25'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.357+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb000e30 con 0x55effafeb3d0 2024-05-08T18:51:07.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.358+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v25'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.358+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb000e30 con 0x7f853c078060 2024-05-08T18:51:07.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.359+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v25'40 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.359+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb000e30 con 0x55effafeb3d0 2024-05-08T18:51:07.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.360+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v25'52 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.360+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb000e30 con 0x7f853c078060 2024-05-08T18:51:07.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.361+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v25'44 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.361+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb000e30 con 0x7f8544014070 2024-05-08T18:51:07.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.362+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v25'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.362+0000 7f8400fe1640 20 reqs_thread_entry: start 2024-05-08T18:51:07.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.362+0000 7f854f733800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:07.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.362+0000 7f854f733800 20 Filter name: none 2024-05-08T18:51:07.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.362+0000 7f837a7fc640 20 reqs_thread_entry: start 2024-05-08T18:51:07.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.362+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafe6b30 2024-05-08T18:51:07.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.363+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.363+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x55effafe6b30 2024-05-08T18:51:07.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.363+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.363+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafe6b30 2024-05-08T18:51:07.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.363+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.363+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f853c078060 2024-05-08T18:51:07.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.364+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.364+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x7f853c078060 2024-05-08T18:51:07.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.364+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.364+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f853c078060 2024-05-08T18:51:07.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.364+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.364+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.365+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.365+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x55effafeb3d0 2024-05-08T18:51:07.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.365+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.365+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.365+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.365+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafe6b30 2024-05-08T18:51:07.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.365+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv166 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.365+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x55effafe6b30 2024-05-08T18:51:07.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.366+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv166 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.366+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafe6b30 2024-05-08T18:51:07.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.366+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv166 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.366+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f8544014070 2024-05-08T18:51:07.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.366+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv55 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.366+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x7f8544014070 2024-05-08T18:51:07.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.366+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv55 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.366+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f8544014070 2024-05-08T18:51:07.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.367+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv55 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.367+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.367+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv37 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.367+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x55effafeb3d0 2024-05-08T18:51:07.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.367+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv37 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.367+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.367+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv37 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.367+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafe6b30 2024-05-08T18:51:07.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.368+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.368+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x55effafe6b30 2024-05-08T18:51:07.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.368+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.368+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafe6b30 2024-05-08T18:51:07.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.368+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.368+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f853c078060 2024-05-08T18:51:07.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.369+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.369+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x7f853c078060 2024-05-08T18:51:07.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.369+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.369+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f853c078060 2024-05-08T18:51:07.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.369+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.369+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f8544014070 2024-05-08T18:51:07.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.370+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.370+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x7f8544014070 2024-05-08T18:51:07.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.370+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.370+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f8544014070 2024-05-08T18:51:07.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.370+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.370+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.370+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.371+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x55effafeb3d0 2024-05-08T18:51:07.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.371+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.371+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.371+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.371+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f8544014070 2024-05-08T18:51:07.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.371+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.371+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x7f8544014070 2024-05-08T18:51:07.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.371+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.371+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f8544014070 2024-05-08T18:51:07.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.372+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.372+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f853c078060 2024-05-08T18:51:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.372+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.372+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x7f853c078060 2024-05-08T18:51:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.372+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.372+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f853c078060 2024-05-08T18:51:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.373+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.373+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f8544014070 2024-05-08T18:51:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.373+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.373+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x7f8544014070 2024-05-08T18:51:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.373+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.373+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f8544014070 2024-05-08T18:51:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.373+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.373+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f853c078060 2024-05-08T18:51:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.374+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.374+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x7f853c078060 2024-05-08T18:51:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.374+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.374+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f853c078060 2024-05-08T18:51:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.374+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f853403b040 con 0x7f853c078060 2024-05-08T18:51:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.374+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafe6b30 2024-05-08T18:51:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.375+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f853403b040 con 0x55effafe6b30 2024-05-08T18:51:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.375+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x55effafe6b30 2024-05-08T18:51:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.375+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv162 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8534049040 con 0x55effafe6b30 2024-05-08T18:51:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.375+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafe6b30 2024-05-08T18:51:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.375+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8534049040 con 0x55effafe6b30 2024-05-08T18:51:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.375+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.375+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.375+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x55effafeb3d0 2024-05-08T18:51:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.376+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.376+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.376+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.376+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f8544014070 2024-05-08T18:51:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.376+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.376+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x7f8544014070 2024-05-08T18:51:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.376+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.376+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f8544014070 2024-05-08T18:51:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.377+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.377+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.377+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.377+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x55effafeb3d0 2024-05-08T18:51:07.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.377+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.377+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.377+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.377+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafe6b30 2024-05-08T18:51:07.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.378+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8534049040 con 0x55effafe6b30 2024-05-08T18:51:07.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.378+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x55effafe6b30 2024-05-08T18:51:07.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.378+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8534049040 con 0x55effafe6b30 2024-05-08T18:51:07.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.378+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafe6b30 2024-05-08T18:51:07.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.378+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8534049040 con 0x55effafe6b30 2024-05-08T18:51:07.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.378+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafe6b30 2024-05-08T18:51:07.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.378+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8534049040 con 0x55effafe6b30 2024-05-08T18:51:07.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.378+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x55effafe6b30 2024-05-08T18:51:07.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.378+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8534049040 con 0x55effafe6b30 2024-05-08T18:51:07.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.378+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafe6b30 2024-05-08T18:51:07.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.379+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8534049040 con 0x55effafe6b30 2024-05-08T18:51:07.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.379+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.379+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.379+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x55effafeb3d0 2024-05-08T18:51:07.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.379+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.379+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.379+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.379+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f8544014070 2024-05-08T18:51:07.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.380+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.380+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x7f8544014070 2024-05-08T18:51:07.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.380+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.380+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f8544014070 2024-05-08T18:51:07.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.380+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.380+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.380+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.380+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x55effafeb3d0 2024-05-08T18:51:07.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.381+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.381+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.381+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.381+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.381+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.381+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x55effafeb3d0 2024-05-08T18:51:07.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.382+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.382+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.382+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.382+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.382+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.382+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x55effafeb3d0 2024-05-08T18:51:07.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.382+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.382+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.383+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.383+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.383+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.383+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x55effafeb3d0 2024-05-08T18:51:07.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.383+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.383+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.383+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.383+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f853c078060 2024-05-08T18:51:07.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.384+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8534049040 con 0x7f853c078060 2024-05-08T18:51:07.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.384+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x7f853c078060 2024-05-08T18:51:07.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.384+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8534049040 con 0x7f853c078060 2024-05-08T18:51:07.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.384+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f853c078060 2024-05-08T18:51:07.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.385+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8534049040 con 0x7f853c078060 2024-05-08T18:51:07.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.385+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.385+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.385+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x55effafeb3d0 2024-05-08T18:51:07.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.385+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.385+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.385+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.385+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f853c078060 2024-05-08T18:51:07.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.386+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8534049040 con 0x7f853c078060 2024-05-08T18:51:07.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.386+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x7f853c078060 2024-05-08T18:51:07.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.386+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8534049040 con 0x7f853c078060 2024-05-08T18:51:07.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.386+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f853c078060 2024-05-08T18:51:07.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.386+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8534049040 con 0x7f853c078060 2024-05-08T18:51:07.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.386+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.386+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.386+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x55effafeb3d0 2024-05-08T18:51:07.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.386+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.386+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x55effafeb3d0 2024-05-08T18:51:07.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.387+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.387+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f853c078060 2024-05-08T18:51:07.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.387+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8534049040 con 0x7f853c078060 2024-05-08T18:51:07.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.387+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x7f853c078060 2024-05-08T18:51:07.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.387+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8534049040 con 0x7f853c078060 2024-05-08T18:51:07.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.387+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f853c078060 2024-05-08T18:51:07.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.388+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8534049040 con 0x7f853c078060 2024-05-08T18:51:07.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.388+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f8544014070 2024-05-08T18:51:07.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.388+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.388+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb02f7c0 con 0x7f8544014070 2024-05-08T18:51:07.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.388+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.388+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55effb0307d0 con 0x7f8544014070 2024-05-08T18:51:07.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.388+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.389+0000 7f8401fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:07.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.389+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94489196589760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effb000ff0 con 0x55effafe6b30 2024-05-08T18:51:07.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.390+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94489196589760] v25'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8534049040 con 0x55effafe6b30 2024-05-08T18:51:07.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.390+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94489196563424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff72c0 con 0x7f8544014070 2024-05-08T18:51:07.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.391+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94489196563424] v25'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.391+0000 7f854f733800 20 remove_watcher() i=0 2024-05-08T18:51:07.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.391+0000 7f854f733800 2 removed watcher, disabling cache 2024-05-08T18:51:07.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.391+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94489196570784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff72c0 con 0x55effafe6b30 2024-05-08T18:51:07.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.392+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94489196570784] v25'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8534049040 con 0x55effafe6b30 2024-05-08T18:51:07.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.392+0000 7f854f733800 20 remove_watcher() i=1 2024-05-08T18:51:07.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.392+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94489196574816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff28a0 con 0x55effafeb3d0 2024-05-08T18:51:07.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.393+0000 7f854bbcb640 1 -- 172.21.15.132:0/3794631456 <== osd.3 v2:172.21.15.132:6816/17827703 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94489196574816] v25'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f854406a040 con 0x55effafeb3d0 2024-05-08T18:51:07.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.393+0000 7f854f733800 20 remove_watcher() i=2 2024-05-08T18:51:07.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.394+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94489196571840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff72c0 con 0x7f8544014070 2024-05-08T18:51:07.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.395+0000 7f854b3ca640 1 -- 172.21.15.132:0/3794631456 <== osd.2 v2:172.21.15.132:6808/1108348591 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94489196571840] v25'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f853c075030 con 0x7f8544014070 2024-05-08T18:51:07.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.395+0000 7f854f733800 20 remove_watcher() i=3 2024-05-08T18:51:07.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.395+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94489196579232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff3860 con 0x55effafe6b30 2024-05-08T18:51:07.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.396+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.1 v2:172.21.15.132:6800/3697320277 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94489196579232] v25'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8534049040 con 0x55effafe6b30 2024-05-08T18:51:07.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.396+0000 7f854f733800 20 remove_watcher() i=4 2024-05-08T18:51:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.396+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94489196580288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff72c0 con 0x7f853c078060 2024-05-08T18:51:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.397+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94489196580288] v25'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8534049040 con 0x7f853c078060 2024-05-08T18:51:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.397+0000 7f854f733800 20 remove_watcher() i=5 2024-05-08T18:51:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.397+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94489196586560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff3860 con 0x7f853c078060 2024-05-08T18:51:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.398+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94489196586560] v25'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8534049040 con 0x7f853c078060 2024-05-08T18:51:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.398+0000 7f854f733800 20 remove_watcher() i=6 2024-05-08T18:51:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.398+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94489196588336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55effaff72c0 con 0x7f853c078060 2024-05-08T18:51:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.399+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 <== osd.0 v2:172.21.15.42:6800/1521799280 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94489196588336] v25'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8534049040 con 0x7f853c078060 2024-05-08T18:51:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.399+0000 7f854f733800 20 remove_watcher() i=7 2024-05-08T18:51:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.399+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f853c078060 msgr2=0x7f853c076360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.399+0000 7f854f733800 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f853c078060 0x7f853c076360 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.399+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55effafe6b30 msgr2=0x55effafe8fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.399+0000 7f854f733800 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55effafe6b30 0x55effafe8fd0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.399+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f8544014070 msgr2=0x7f85440549c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.399+0000 7f854f733800 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f8544014070 0x7f85440549c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.399+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55effafeb3d0 msgr2=0x55effafed7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.399+0000 7f854f733800 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55effafeb3d0 0x55effafed7c0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.399+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f841403bb50 msgr2=0x7f841403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.399+0000 7f854f733800 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f841403bb50 0x7f841403e010 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f853c0927f0 tx=0x7f853c07f000 comp rx=0 tx=0).stop 2024-05-08T18:51:07.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.399+0000 7f8542bc9640 1 -- 172.21.15.132:0/3794631456 reap_dead start 2024-05-08T18:51:07.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.399+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effafd39a0 msgr2=0x55effafdaec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.399+0000 7f854f733800 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effafd39a0 0x55effafdaec0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8544016c70 tx=0x7f8544052d50 comp rx=0 tx=0).stop 2024-05-08T18:51:07.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.399+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 shutdown_connections 2024-05-08T18:51:07.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.399+0000 7f854f733800 1 --2- 172.21.15.132:0/3794631456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effafd39a0 0x55effafdaec0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.399+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 >> 172.21.15.132:0/3794631456 conn(0x55effafcfcb0 msgr2=0x55effafcd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.399+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 shutdown_connections 2024-05-08T18:51:07.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.399+0000 7f854f733800 1 -- 172.21.15.132:0/3794631456 wait complete. 2024-05-08T18:51:07.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 -- 172.21.15.132:0/676922314 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f842403bb50 msgr2=0x7f842403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 --2- 172.21.15.132:0/676922314 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f842403bb50 0x7f842403e010 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f853c044830 tx=0x7f853c066750 comp rx=0 tx=0).stop 2024-05-08T18:51:07.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 -- 172.21.15.132:0/676922314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effafc66c0 msgr2=0x55effafc6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 --2- 172.21.15.132:0/676922314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effafc66c0 0x55effafc6ae0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x55effafb2d50 tx=0x7f8544018830 comp rx=0 tx=0).stop 2024-05-08T18:51:07.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 -- 172.21.15.132:0/676922314 shutdown_connections 2024-05-08T18:51:07.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 --2- 172.21.15.132:0/676922314 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f842403bb50 0x7f842403e010 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 --2- 172.21.15.132:0/676922314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effafc66c0 0x55effafc6ae0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 -- 172.21.15.132:0/676922314 >> 172.21.15.132:0/676922314 conn(0x55effafba760 msgr2=0x55effafbab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 -- 172.21.15.132:0/676922314 shutdown_connections 2024-05-08T18:51:07.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 -- 172.21.15.132:0/676922314 wait complete. 2024-05-08T18:51:07.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 -- 172.21.15.132:0/35793808 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55effaeb23a0 msgr2=0x55effafb2470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 --2- 172.21.15.132:0/35793808 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55effaeb23a0 0x55effafb2470 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 -- 172.21.15.132:0/35793808 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55effafb4cd0 msgr2=0x55effafb70c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 --2- 172.21.15.132:0/35793808 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55effafb4cd0 0x55effafb70c0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 -- 172.21.15.132:0/35793808 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f843003bba0 msgr2=0x7f843003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 --2- 172.21.15.132:0/35793808 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f843003bba0 0x7f843003e060 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8534000f60 tx=0x7f8534001370 comp rx=0 tx=0).stop 2024-05-08T18:51:07.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 -- 172.21.15.132:0/35793808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effaeb1140 msgr2=0x55effafab230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 --2- 172.21.15.132:0/35793808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effaeb1140 0x55effafab230 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f853c00a520 tx=0x7f853c003020 comp rx=0 tx=0).stop 2024-05-08T18:51:07.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 -- 172.21.15.132:0/35793808 shutdown_connections 2024-05-08T18:51:07.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 --2- 172.21.15.132:0/35793808 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55effafb4cd0 0x55effafb70c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 --2- 172.21.15.132:0/35793808 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55effaeb23a0 0x55effafb2470 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 --2- 172.21.15.132:0/35793808 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f843003bba0 0x7f843003e060 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 --2- 172.21.15.132:0/35793808 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55effaeb1140 0x55effafab230 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 -- 172.21.15.132:0/35793808 >> 172.21.15.132:0/35793808 conn(0x55effaeac720 msgr2=0x55effaf9c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 -- 172.21.15.132:0/35793808 shutdown_connections 2024-05-08T18:51:07.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.400+0000 7f854f733800 1 -- 172.21.15.132:0/35793808 wait complete. 2024-05-08T18:51:07.408 INFO:teuthology.orchestra.run.smithi132.stdout:[] 2024-05-08T18:51:07.408 DEBUG:tasks.util.rgw: json result: [] 2024-05-08T18:51:07.408 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-05-08T18:51:07.409 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-05-08T18:51:07.409 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-05-08T18:51:07.492 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:07.492 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:07.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.493+0000 7f163ca12800 1 Processor -- start 2024-05-08T18:51:07.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.493+0000 7f163ca12800 1 -- start start 2024-05-08T18:51:07.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.493+0000 7f163ca12800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55ef35a3fcd0 0x55ef35a420c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.493+0000 7f163ca12800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ef35a46110 con 0x55ef35a42600 2024-05-08T18:51:07.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.493+0000 7f163ca12800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55ef358dfe20 con 0x55ef35a3fcd0 2024-05-08T18:51:07.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.494+0000 7f1638076640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55ef35a3fcd0 0x55ef35a420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.494+0000 7f1638076640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55ef35a3fcd0 0x55ef35a420c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51312/0 (socket says 172.21.15.132:51312) 2024-05-08T18:51:07.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.494+0000 7f1638076640 1 -- 172.21.15.132:0/336650306 learned_addr learned my addr 172.21.15.132:0/336650306 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.494+0000 7f1637875640 1 --1- 172.21.15.132:0/336650306 >> v1:172.21.15.42:6789/0 conn(0x55ef35a42600 0x55ef35a449f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:55716/0 (socket says 172.21.15.132:55716) 2024-05-08T18:51:07.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.494+0000 7f1638076640 1 -- 172.21.15.132:0/336650306 >> v1:172.21.15.42:6789/0 conn(0x55ef35a42600 legacy=0x55ef35a449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.494+0000 7f1637074640 1 -- 172.21.15.132:0/336650306 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 12637923 0 0) 0x55ef35a46110 con 0x55ef35a42600 2024-05-08T18:51:07.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.494+0000 7f1638076640 1 -- 172.21.15.132:0/336650306 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef35a472f0 con 0x55ef35a3fcd0 2024-05-08T18:51:07.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.496+0000 7f1638076640 1 --2- 172.21.15.132:0/336650306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35a3fcd0 0x55ef35a420c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1628005fd0 tx=0x7f162801cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36cb3024d05f9533 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.496+0000 7f1637074640 1 -- 172.21.15.132:0/336650306 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1628052540 con 0x55ef35a3fcd0 2024-05-08T18:51:07.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.497+0000 7f1637074640 1 -- 172.21.15.132:0/336650306 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f162804e070 con 0x55ef35a3fcd0 2024-05-08T18:51:07.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.497+0000 7f1637074640 1 -- 172.21.15.132:0/336650306 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1628052850 con 0x55ef35a3fcd0 2024-05-08T18:51:07.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.497+0000 7f163ca12800 1 -- 172.21.15.132:0/336650306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35a3fcd0 msgr2=0x55ef35a420c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.497+0000 7f163ca12800 1 --2- 172.21.15.132:0/336650306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35a3fcd0 0x55ef35a420c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1628005fd0 tx=0x7f162801cd80 comp rx=0 tx=0).stop 2024-05-08T18:51:07.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.497+0000 7f163ca12800 1 -- 172.21.15.132:0/336650306 shutdown_connections 2024-05-08T18:51:07.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.497+0000 7f163ca12800 1 --2- 172.21.15.132:0/336650306 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35a3fcd0 0x55ef35a420c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.497+0000 7f163ca12800 1 -- 172.21.15.132:0/336650306 >> 172.21.15.132:0/336650306 conn(0x55ef35a39720 msgr2=0x55ef35a3bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.497+0000 7f163ca12800 1 -- 172.21.15.132:0/336650306 shutdown_connections 2024-05-08T18:51:07.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.497+0000 7f163ca12800 1 -- 172.21.15.132:0/336650306 wait complete. 2024-05-08T18:51:07.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.511+0000 7f163ca12800 1 Processor -- start 2024-05-08T18:51:07.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.511+0000 7f163ca12800 1 -- start start 2024-05-08T18:51:07.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.511+0000 7f163ca12800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35a3fcd0 0x55ef35b303f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.511+0000 7f163ca12800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ef3598a5b0 con 0x55ef35a3fcd0 2024-05-08T18:51:07.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.511+0000 7f1638076640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35a3fcd0 0x55ef35b303f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.511+0000 7f1638076640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35a3fcd0 0x55ef35b303f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51320/0 (socket says 172.21.15.132:51320) 2024-05-08T18:51:07.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.511+0000 7f1638076640 1 -- 172.21.15.132:0/379205258 learned_addr learned my addr 172.21.15.132:0/379205258 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.512+0000 7f1638076640 1 -- 172.21.15.132:0/379205258 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef35b309c0 con 0x55ef35a3fcd0 2024-05-08T18:51:07.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.512+0000 7f1638076640 1 --2- 172.21.15.132:0/379205258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35a3fcd0 0x55ef35b303f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f162801ba70 tx=0x7f162804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7babd70eafb529 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.512+0000 7f152660c640 1 -- 172.21.15.132:0/379205258 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1628052820 con 0x55ef35a3fcd0 2024-05-08T18:51:07.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.512+0000 7f152660c640 1 -- 172.21.15.132:0/379205258 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1628062070 con 0x55ef35a3fcd0 2024-05-08T18:51:07.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.512+0000 7f152660c640 1 -- 172.21.15.132:0/379205258 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1628052b10 con 0x55ef35a3fcd0 2024-05-08T18:51:07.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.513+0000 7f163ca12800 1 -- 172.21.15.132:0/379205258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35a3fcd0 msgr2=0x55ef35b303f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.513+0000 7f163ca12800 1 --2- 172.21.15.132:0/379205258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35a3fcd0 0x55ef35b303f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f162801ba70 tx=0x7f162804c000 comp rx=0 tx=0).stop 2024-05-08T18:51:07.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.513+0000 7f163ca12800 1 -- 172.21.15.132:0/379205258 shutdown_connections 2024-05-08T18:51:07.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.513+0000 7f163ca12800 1 --2- 172.21.15.132:0/379205258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35a3fcd0 0x55ef35b303f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.513+0000 7f163ca12800 1 -- 172.21.15.132:0/379205258 >> 172.21.15.132:0/379205258 conn(0x55ef35a39720 msgr2=0x55ef35b2bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.513+0000 7f163ca12800 1 -- 172.21.15.132:0/379205258 shutdown_connections 2024-05-08T18:51:07.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.513+0000 7f163ca12800 1 -- 172.21.15.132:0/379205258 wait complete. 2024-05-08T18:51:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.513+0000 7f163ca12800 1 Processor -- start 2024-05-08T18:51:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.513+0000 7f163ca12800 1 -- start start 2024-05-08T18:51:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.513+0000 7f163ca12800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35a3fcd0 0x55ef35b37e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.513+0000 7f163ca12800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ef35a465e0 con 0x55ef35a3fcd0 2024-05-08T18:51:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.514+0000 7f1638076640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35a3fcd0 0x55ef35b37e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.514+0000 7f1638076640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35a3fcd0 0x55ef35b37e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51324/0 (socket says 172.21.15.132:51324) 2024-05-08T18:51:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.514+0000 7f1638076640 1 -- 172.21.15.132:0/1846628589 learned_addr learned my addr 172.21.15.132:0/1846628589 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.514+0000 7f1638076640 1 -- 172.21.15.132:0/1846628589 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef35b383b0 con 0x55ef35a3fcd0 2024-05-08T18:51:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.514+0000 7f1638076640 1 --2- 172.21.15.132:0/1846628589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35a3fcd0 0x55ef35b37e70 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f162800a190 tx=0x7f1628003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.514+0000 7f1524e09640 1 -- 172.21.15.132:0/1846628589 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1628071570 con 0x55ef35a3fcd0 2024-05-08T18:51:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.514+0000 7f1524e09640 1 -- 172.21.15.132:0/1846628589 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1628058040 con 0x55ef35a3fcd0 2024-05-08T18:51:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.514+0000 7f163ca12800 1 -- 172.21.15.132:0/1846628589 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef35b38640 con 0x55ef35a3fcd0 2024-05-08T18:51:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.514+0000 7f1524e09640 1 -- 172.21.15.132:0/1846628589 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1628071880 con 0x55ef35a3fcd0 2024-05-08T18:51:07.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.514+0000 7f163ca12800 1 -- 172.21.15.132:0/1846628589 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef35b3b2f0 con 0x55ef35a3fcd0 2024-05-08T18:51:07.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.515+0000 7f1524e09640 1 -- 172.21.15.132:0/1846628589 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1628050070 con 0x55ef35a3fcd0 2024-05-08T18:51:07.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.515+0000 7f1524e09640 1 --2- 172.21.15.132:0/1846628589 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f152003bba0 0x7f152003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.516+0000 7f1524e09640 1 -- 172.21.15.132:0/1846628589 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f16280947f0 con 0x55ef35a3fcd0 2024-05-08T18:51:07.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.516+0000 7f1637875640 1 --2- 172.21.15.132:0/1846628589 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f152003bba0 0x7f152003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.516+0000 7f163ca12800 1 --2- 172.21.15.132:0/1846628589 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ef35a42600 0x55ef35b3f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.516+0000 7f163ca12800 1 -- 172.21.15.132:0/1846628589 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b3f680 con 0x55ef35a42600 2024-05-08T18:51:07.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.516+0000 7f1638877640 1 --2- 172.21.15.132:0/1846628589 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ef35a42600 0x55ef35b3f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.516+0000 7f1637875640 1 --2- 172.21.15.132:0/1846628589 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f152003bba0 0x7f152003e060 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f162c000c00 tx=0x7f162c0013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.516+0000 7f1638877640 1 --2- 172.21.15.132:0/1846628589 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ef35a42600 0x55ef35b3f0b0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.516+0000 7f1638877640 1 -- 172.21.15.132:0/1846628589 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35a42600 2024-05-08T18:51:07.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.516+0000 7f163ca12800 1 -- 172.21.15.132:0/1846628589 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b3c640 con 0x55ef35a42600 2024-05-08T18:51:07.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.517+0000 7f1638877640 1 -- 172.21.15.132:0/1846628589 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35a42600 2024-05-08T18:51:07.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.517+0000 7f163ca12800 1 --2- 172.21.15.132:0/1846628589 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ef35b419a0 0x55ef35b43d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.517+0000 7f163ca12800 1 -- 172.21.15.132:0/1846628589 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b44460 con 0x55ef35b419a0 2024-05-08T18:51:07.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.517+0000 7f1638076640 1 --2- 172.21.15.132:0/1846628589 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ef35b419a0 0x55ef35b43d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.517+0000 7f1638076640 1 --2- 172.21.15.132:0/1846628589 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ef35b419a0 0x55ef35b43d90 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.517+0000 7f1638076640 1 -- 172.21.15.132:0/1846628589 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1628077020 con 0x55ef35b419a0 2024-05-08T18:51:07.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.517+0000 7f163ca12800 1 -- 172.21.15.132:0/1846628589 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b40840 con 0x55ef35a42600 2024-05-08T18:51:07.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.518+0000 7f1638877640 1 -- 172.21.15.132:0/1846628589 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35a42600 2024-05-08T18:51:07.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.518+0000 7f163ca12800 1 -- 172.21.15.132:0/1846628589 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b40ce0 con 0x55ef35a42600 2024-05-08T18:51:07.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.518+0000 7f1638877640 1 -- 172.21.15.132:0/1846628589 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35a42600 2024-05-08T18:51:07.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.518+0000 7f163ca12800 1 Processor -- start 2024-05-08T18:51:07.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.518+0000 7f163ca12800 1 -- start start 2024-05-08T18:51:07.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.518+0000 7f163ca12800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35b533f0 0x55ef35b53810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.518+0000 7f163ca12800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ef35930fc0 con 0x55ef35b533f0 2024-05-08T18:51:07.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.519+0000 7f1638877640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35b533f0 0x55ef35b53810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.519+0000 7f1638877640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35b533f0 0x55ef35b53810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51328/0 (socket says 172.21.15.132:51328) 2024-05-08T18:51:07.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.519+0000 7f1638877640 1 -- 172.21.15.132:0/451614247 learned_addr learned my addr 172.21.15.132:0/451614247 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.519+0000 7f1638877640 1 -- 172.21.15.132:0/451614247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef35b53d50 con 0x55ef35b533f0 2024-05-08T18:51:07.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.519+0000 7f1638877640 1 --2- 172.21.15.132:0/451614247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35b533f0 0x55ef35b53810 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x55ef35b38d40 tx=0x7f163000aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.519+0000 7f151dffb640 1 -- 172.21.15.132:0/451614247 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1630007d00 con 0x55ef35b533f0 2024-05-08T18:51:07.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.519+0000 7f151dffb640 1 -- 172.21.15.132:0/451614247 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f163001e020 con 0x55ef35b533f0 2024-05-08T18:51:07.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.519+0000 7f151dffb640 1 -- 172.21.15.132:0/451614247 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1630019420 con 0x55ef35b533f0 2024-05-08T18:51:07.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.519+0000 7f163ca12800 1 -- 172.21.15.132:0/451614247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef35b547c0 con 0x55ef35b533f0 2024-05-08T18:51:07.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.519+0000 7f163ca12800 1 -- 172.21.15.132:0/451614247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef35b54cc0 con 0x55ef35b533f0 2024-05-08T18:51:07.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.520+0000 7f151dffb640 1 -- 172.21.15.132:0/451614247 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1630016040 con 0x55ef35b533f0 2024-05-08T18:51:07.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.520+0000 7f151dffb640 1 --2- 172.21.15.132:0/451614247 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f151003bb50 0x7f151003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.520+0000 7f151dffb640 1 -- 172.21.15.132:0/451614247 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f163001f030 con 0x55ef35b533f0 2024-05-08T18:51:07.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.520+0000 7f1638076640 1 --2- 172.21.15.132:0/451614247 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f151003bb50 0x7f151003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.521+0000 7f163ca12800 1 Processor -- start 2024-05-08T18:51:07.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.521+0000 7f1638076640 1 --2- 172.21.15.132:0/451614247 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f151003bb50 0x7f151003e010 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55ef35b3fad0 tx=0x7f1628065380 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.521+0000 7f163ca12800 1 -- start start 2024-05-08T18:51:07.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.521+0000 7f163ca12800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35b60750 0x55ef35b60b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.521+0000 7f163ca12800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ef35b30c80 con 0x55ef35b60750 2024-05-08T18:51:07.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.521+0000 7f1638877640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35b60750 0x55ef35b60b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.521+0000 7f1638877640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35b60750 0x55ef35b60b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51336/0 (socket says 172.21.15.132:51336) 2024-05-08T18:51:07.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.521+0000 7f1638877640 1 -- 172.21.15.132:0/2316427015 learned_addr learned my addr 172.21.15.132:0/2316427015 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.521+0000 7f1638877640 1 -- 172.21.15.132:0/2316427015 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef35b61140 con 0x55ef35b60750 2024-05-08T18:51:07.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.521+0000 7f1638877640 1 --2- 172.21.15.132:0/2316427015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35b60750 0x55ef35b60b70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1630018fd0 tx=0x7f1630052f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b661b306b6f7457 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.522+0000 7f150f7fe640 1 -- 172.21.15.132:0/2316427015 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f163001d070 con 0x55ef35b60750 2024-05-08T18:51:07.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.522+0000 7f150f7fe640 1 -- 172.21.15.132:0/2316427015 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1630017ac0 con 0x55ef35b60750 2024-05-08T18:51:07.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.522+0000 7f150f7fe640 1 -- 172.21.15.132:0/2316427015 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16300186f0 con 0x55ef35b60750 2024-05-08T18:51:07.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.522+0000 7f163ca12800 1 -- 172.21.15.132:0/2316427015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35b60750 msgr2=0x55ef35b60b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.522+0000 7f163ca12800 1 --2- 172.21.15.132:0/2316427015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35b60750 0x55ef35b60b70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1630018fd0 tx=0x7f1630052f00 comp rx=0 tx=0).stop 2024-05-08T18:51:07.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.522+0000 7f163ca12800 1 -- 172.21.15.132:0/2316427015 shutdown_connections 2024-05-08T18:51:07.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.522+0000 7f163ca12800 1 --2- 172.21.15.132:0/2316427015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35b60750 0x55ef35b60b70 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.522+0000 7f163ca12800 1 -- 172.21.15.132:0/2316427015 >> 172.21.15.132:0/2316427015 conn(0x55ef35b5cab0 msgr2=0x55ef35b5ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.522+0000 7f163ca12800 1 -- 172.21.15.132:0/2316427015 shutdown_connections 2024-05-08T18:51:07.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.522+0000 7f163ca12800 1 -- 172.21.15.132:0/2316427015 wait complete. 2024-05-08T18:51:07.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.522+0000 7f163ca12800 1 Processor -- start 2024-05-08T18:51:07.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.522+0000 7f163ca12800 1 -- start start 2024-05-08T18:51:07.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.523+0000 7f163ca12800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35b60750 0x55ef35b67ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.523+0000 7f163ca12800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ef35b61850 con 0x55ef35b60750 2024-05-08T18:51:07.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.523+0000 7f1638877640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35b60750 0x55ef35b67ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.523+0000 7f1638877640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35b60750 0x55ef35b67ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51342/0 (socket says 172.21.15.132:51342) 2024-05-08T18:51:07.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.523+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 learned_addr learned my addr 172.21.15.132:0/1596735923 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.523+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef35b68220 con 0x55ef35b60750 2024-05-08T18:51:07.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.523+0000 7f1638877640 1 --2- 172.21.15.132:0/1596735923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35b60750 0x55ef35b67ce0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1630018fd0 tx=0x7f1630014d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.523+0000 7f150dffb640 1 -- 172.21.15.132:0/1596735923 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1630030020 con 0x55ef35b60750 2024-05-08T18:51:07.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.523+0000 7f150dffb640 1 -- 172.21.15.132:0/1596735923 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1630019970 con 0x55ef35b60750 2024-05-08T18:51:07.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.523+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef35b684b0 con 0x55ef35b60750 2024-05-08T18:51:07.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.523+0000 7f150dffb640 1 -- 172.21.15.132:0/1596735923 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16300173b0 con 0x55ef35b60750 2024-05-08T18:51:07.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.523+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef35b684b0 con 0x55ef35b60750 2024-05-08T18:51:07.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.524+0000 7f150dffb640 1 -- 172.21.15.132:0/1596735923 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1630033020 con 0x55ef35b60750 2024-05-08T18:51:07.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.524+0000 7f150dffb640 1 --2- 172.21.15.132:0/1596735923 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f150003bb50 0x7f150003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.524+0000 7f150dffb640 1 -- 172.21.15.132:0/1596735923 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f163003a850 con 0x55ef35b60750 2024-05-08T18:51:07.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.524+0000 7f1638076640 1 --2- 172.21.15.132:0/1596735923 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f150003bb50 0x7f150003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.525+0000 7f1638076640 1 --2- 172.21.15.132:0/1596735923 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f150003bb50 0x7f150003e010 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1628065fd0 tx=0x7f162808c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.525+0000 7f163ca12800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.525+0000 7f163ca12800 1 --2- 172.21.15.132:0/1596735923 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ef35b73630 0x55ef35b75af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.525+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b76240 con 0x55ef35b73630 2024-05-08T18:51:07.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.525+0000 7f1637875640 1 --2- 172.21.15.132:0/1596735923 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ef35b73630 0x55ef35b75af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.525+0000 7f1637875640 1 --2- 172.21.15.132:0/1596735923 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ef35b73630 0x55ef35b75af0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.526+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f162c00f5f0 con 0x55ef35b73630 2024-05-08T18:51:07.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.526+0000 7f163ca12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.526+0000 7f163ca12800 20 realm 2024-05-08T18:51:07.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.526+0000 7f163ca12800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.526+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b72a80 con 0x55ef35b73630 2024-05-08T18:51:07.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.526+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f162c00f5f0 con 0x55ef35b73630 2024-05-08T18:51:07.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.526+0000 7f163ca12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.526+0000 7f163ca12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:07.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.526+0000 7f163ca12800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.526+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b76d30 con 0x55ef35b73630 2024-05-08T18:51:07.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.526+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f162c00f5f0 con 0x55ef35b73630 2024-05-08T18:51:07.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.526+0000 7f163ca12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.526+0000 7f163ca12800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.526+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b77600 con 0x55ef35b73630 2024-05-08T18:51:07.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.526+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f162c00f5f0 con 0x55ef35b73630 2024-05-08T18:51:07.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.526+0000 7f163ca12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:07.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.526+0000 7f163ca12800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.526+0000 7f163ca12800 1 --2- 172.21.15.132:0/1596735923 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ef35b78020 0x55ef35b7a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.526+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7ab80 con 0x55ef35b78020 2024-05-08T18:51:07.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.526+0000 7f1638877640 1 --2- 172.21.15.132:0/1596735923 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ef35b78020 0x55ef35b7a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.527+0000 7f1638877640 1 --2- 172.21.15.132:0/1596735923 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ef35b78020 0x55ef35b7a410 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.527+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.527+0000 7f163ca12800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:07.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.527+0000 7f163ca12800 20 searching for the correct realm 2024-05-08T18:51:07.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.527+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x55ef35b78020 2024-05-08T18:51:07.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.527+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.527+0000 7f1638877640 1 --2- 172.21.15.132:0/1596735923 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1630035030 0x7f1630023ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.527+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x7f1630035030 2024-05-08T18:51:07.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.527+0000 7f1638076640 1 --2- 172.21.15.132:0/1596735923 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1630035030 0x7f1630023ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.528+0000 7f1638076640 1 --2- 172.21.15.132:0/1596735923 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1630035030 0x7f1630023ab0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.528+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1628077020 con 0x7f1630035030 2024-05-08T18:51:07.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.528+0000 7f1638076640 1 --2- 172.21.15.132:0/1596735923 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f16280a1040 0x7f1628067970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.528+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x7f16280a1040 2024-05-08T18:51:07.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.528+0000 7f1637875640 1 --2- 172.21.15.132:0/1596735923 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f16280a1040 0x7f1628067970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.529+0000 7f1637875640 1 --2- 172.21.15.132:0/1596735923 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f16280a1040 0x7f1628067970 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.529+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f162c00f5f0 con 0x7f16280a1040 2024-05-08T18:51:07.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.529+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x55ef35b73630 2024-05-08T18:51:07.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.529+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f162c00f5f0 con 0x55ef35b73630 2024-05-08T18:51:07.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.529+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x55ef35b73630 2024-05-08T18:51:07.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.529+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f162c02b040 con 0x55ef35b73630 2024-05-08T18:51:07.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.529+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x7f16280a1040 2024-05-08T18:51:07.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.530+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f162c02b040 con 0x7f16280a1040 2024-05-08T18:51:07.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.530+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x7f16280a1040 2024-05-08T18:51:07.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.530+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f162c02b040 con 0x7f16280a1040 2024-05-08T18:51:07.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.530+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x7f1630035030 2024-05-08T18:51:07.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.530+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1628077020 con 0x7f1630035030 2024-05-08T18:51:07.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.530+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x55ef35b78020 2024-05-08T18:51:07.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.530+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.530+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x55ef35b73630 2024-05-08T18:51:07.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.531+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f162c02b040 con 0x55ef35b73630 2024-05-08T18:51:07.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.531+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x7f16280a1040 2024-05-08T18:51:07.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.531+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f162c02b040 con 0x7f16280a1040 2024-05-08T18:51:07.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.531+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x55ef35b73630 2024-05-08T18:51:07.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.531+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f162c02b040 con 0x55ef35b73630 2024-05-08T18:51:07.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.531+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x7f1630035030 2024-05-08T18:51:07.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.531+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1628077020 con 0x7f1630035030 2024-05-08T18:51:07.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.531+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x55ef35b78020 2024-05-08T18:51:07.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.532+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.532+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x55ef35b78020 2024-05-08T18:51:07.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.532+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.532+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x7f16280a1040 2024-05-08T18:51:07.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.532+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f162c02b040 con 0x7f16280a1040 2024-05-08T18:51:07.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.532+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x55ef35b78020 2024-05-08T18:51:07.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.532+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.532+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x55ef35b78020 2024-05-08T18:51:07.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.533+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.533+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x55ef35b73630 2024-05-08T18:51:07.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.533+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f162c02b040 con 0x55ef35b73630 2024-05-08T18:51:07.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.533+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x55ef35b73630 2024-05-08T18:51:07.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.533+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f162c02b040 con 0x55ef35b73630 2024-05-08T18:51:07.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.533+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x7f16280a1040 2024-05-08T18:51:07.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.534+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f162c02b040 con 0x7f16280a1040 2024-05-08T18:51:07.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.534+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x55ef35b78020 2024-05-08T18:51:07.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.534+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.534+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x7f1630035030 2024-05-08T18:51:07.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.534+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1628077020 con 0x7f1630035030 2024-05-08T18:51:07.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.534+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x55ef35b73630 2024-05-08T18:51:07.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.534+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f162c02b040 con 0x55ef35b73630 2024-05-08T18:51:07.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.534+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x7f16280a1040 2024-05-08T18:51:07.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.535+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f162c03b040 con 0x7f16280a1040 2024-05-08T18:51:07.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.535+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x55ef35b78020 2024-05-08T18:51:07.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.535+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.535+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x7f16280a1040 2024-05-08T18:51:07.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.535+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f162c03b040 con 0x7f16280a1040 2024-05-08T18:51:07.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.535+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x7f1630035030 2024-05-08T18:51:07.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.536+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1628077020 con 0x7f1630035030 2024-05-08T18:51:07.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.536+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x55ef35b78020 2024-05-08T18:51:07.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.536+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.536+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x7f16280a1040 2024-05-08T18:51:07.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.536+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f162c03b040 con 0x7f16280a1040 2024-05-08T18:51:07.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.536+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x55ef35b73630 2024-05-08T18:51:07.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.536+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f162c03b040 con 0x55ef35b73630 2024-05-08T18:51:07.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.536+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c4b0 con 0x7f1630035030 2024-05-08T18:51:07.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.536+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1628077020 con 0x7f1630035030 2024-05-08T18:51:07.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:07.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:07.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:07.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:07.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:07.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:07.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7b570 con 0x55ef35b73630 2024-05-08T18:51:07.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x55ef35b73630 2024-05-08T18:51:07.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7be10 con 0x55ef35b73630 2024-05-08T18:51:07.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f162c03b040 con 0x55ef35b73630 2024-05-08T18:51:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c930 con 0x55ef35b73630 2024-05-08T18:51:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f162c03b040 con 0x55ef35b73630 2024-05-08T18:51:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 20 zone default found 2024-05-08T18:51:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 4 Realm: () 2024-05-08T18:51:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 20 zonegroup default 2024-05-08T18:51:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.537+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7c950 con 0x7f16280a1040 2024-05-08T18:51:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.538+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x7f16280a1040 2024-05-08T18:51:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.538+0000 7f163ca12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.538+0000 7f163ca12800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.538+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7e770 con 0x55ef35b78020 2024-05-08T18:51:07.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.538+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.538+0000 7f163ca12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.538+0000 7f163ca12800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.538+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7eb60 con 0x55ef35b78020 2024-05-08T18:51:07.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.538+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.538+0000 7f163ca12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.538+0000 7f163ca12800 20 started sync module instance, tier type = 2024-05-08T18:51:07.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.538+0000 7f163ca12800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:07.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.538+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7dc10 con 0x7f1630035030 2024-05-08T18:51:07.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.539+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1628077020 con 0x7f1630035030 2024-05-08T18:51:07.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.539+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94485886785376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7eff0 con 0x7f1630035030 2024-05-08T18:51:07.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.539+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7f840 con 0x55ef35b73630 2024-05-08T18:51:07.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.540+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94485886785376] v25'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1628077020 con 0x7f1630035030 2024-05-08T18:51:07.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.540+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x55ef35b73630 2024-05-08T18:51:07.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.540+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94485886792592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7fc60 con 0x55ef35b73630 2024-05-08T18:51:07.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.540+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b804b0 con 0x55ef35b78020 2024-05-08T18:51:07.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.542+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.542+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94485886795328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b80910 con 0x55ef35b78020 2024-05-08T18:51:07.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.542+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b81430 con 0x7f1630035030 2024-05-08T18:51:07.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.542+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94485886792592] v25'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x55ef35b73630 2024-05-08T18:51:07.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.543+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94485886795328] v25'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.543+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1628077020 con 0x7f1630035030 2024-05-08T18:51:07.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.543+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94485886799616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b80360 con 0x7f1630035030 2024-05-08T18:51:07.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.543+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b81e40 con 0x55ef35b73630 2024-05-08T18:51:07.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.544+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94485886799616] v25'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1628077020 con 0x7f1630035030 2024-05-08T18:51:07.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.544+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x55ef35b73630 2024-05-08T18:51:07.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.544+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94485886802320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b82260 con 0x55ef35b73630 2024-05-08T18:51:07.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.544+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b82b30 con 0x7f16280a1040 2024-05-08T18:51:07.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.545+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94485886802320] v25'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x55ef35b73630 2024-05-08T18:51:07.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.545+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x7f16280a1040 2024-05-08T18:51:07.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.545+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94485886803376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b82680 con 0x7f16280a1040 2024-05-08T18:51:07.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.545+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b83580 con 0x7f16280a1040 2024-05-08T18:51:07.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.546+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(56 notify.6 [create] v25'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x7f16280a1040 2024-05-08T18:51:07.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.546+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94485886808208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b839c0 con 0x7f16280a1040 2024-05-08T18:51:07.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.546+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b844e0 con 0x7f16280a1040 2024-05-08T18:51:07.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.546+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94485886803376] v25'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x7f16280a1040 2024-05-08T18:51:07.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.547+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94485886808208] v25'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x7f16280a1040 2024-05-08T18:51:07.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.547+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x7f16280a1040 2024-05-08T18:51:07.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.547+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94485886809264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b821d0 con 0x7f16280a1040 2024-05-08T18:51:07.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.547+0000 7f163ca12800 20 add_watcher() i=0 2024-05-08T18:51:07.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.547+0000 7f163ca12800 20 add_watcher() i=1 2024-05-08T18:51:07.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.547+0000 7f163ca12800 20 add_watcher() i=2 2024-05-08T18:51:07.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.547+0000 7f163ca12800 20 add_watcher() i=3 2024-05-08T18:51:07.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.547+0000 7f163ca12800 20 add_watcher() i=4 2024-05-08T18:51:07.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.547+0000 7f163ca12800 20 add_watcher() i=5 2024-05-08T18:51:07.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.547+0000 7f163ca12800 20 add_watcher() i=6 2024-05-08T18:51:07.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.548+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94485886809264] v25'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x7f16280a1040 2024-05-08T18:51:07.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.548+0000 7f163ca12800 20 add_watcher() i=7 2024-05-08T18:51:07.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.548+0000 7f163ca12800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:07.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.548+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b874d0 con 0x55ef35b73630 2024-05-08T18:51:07.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.548+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f162c03b040 con 0x55ef35b73630 2024-05-08T18:51:07.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.548+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94485886812080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b84950 con 0x55ef35b73630 2024-05-08T18:51:07.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.549+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94485886812080] v25'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x55ef35b73630 2024-05-08T18:51:07.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.550+0000 7f14ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:07.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.550+0000 7f163ca12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:07.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.550+0000 7f163ca12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:07.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.550+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b8fd20 con 0x55ef35b73630 2024-05-08T18:51:07.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.551+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v25'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x55ef35b73630 2024-05-08T18:51:07.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.551+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b90370 con 0x7f16280a1040 2024-05-08T18:51:07.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.552+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v25'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x7f16280a1040 2024-05-08T18:51:07.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.552+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b907d0 con 0x55ef35b78020 2024-05-08T18:51:07.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.553+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v25'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.553+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b906f0 con 0x55ef35b73630 2024-05-08T18:51:07.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.554+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v25'174 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x55ef35b73630 2024-05-08T18:51:07.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.554+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b90ce0 con 0x7f1630035030 2024-05-08T18:51:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.555+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v25'59 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1628077020 con 0x7f1630035030 2024-05-08T18:51:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.555+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91530 con 0x55ef35b78020 2024-05-08T18:51:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.556+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v25'40 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.556+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91530 con 0x55ef35b73630 2024-05-08T18:51:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.557+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v25'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x55ef35b73630 2024-05-08T18:51:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.557+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91530 con 0x7f16280a1040 2024-05-08T18:51:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.558+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v25'41 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x7f16280a1040 2024-05-08T18:51:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.558+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91530 con 0x7f1630035030 2024-05-08T18:51:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.559+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v25'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1628077020 con 0x7f1630035030 2024-05-08T18:51:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.559+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91920 con 0x55ef35b78020 2024-05-08T18:51:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.560+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v25'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.560+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91920 con 0x7f1630035030 2024-05-08T18:51:07.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.561+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v25'60 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1628077020 con 0x7f1630035030 2024-05-08T18:51:07.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.561+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91920 con 0x7f16280a1040 2024-05-08T18:51:07.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.563+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v25'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x7f16280a1040 2024-05-08T18:51:07.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.563+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91920 con 0x7f1630035030 2024-05-08T18:51:07.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.564+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v25'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1628077020 con 0x7f1630035030 2024-05-08T18:51:07.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.564+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91920 con 0x7f16280a1040 2024-05-08T18:51:07.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.565+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v25'45 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x7f16280a1040 2024-05-08T18:51:07.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.565+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91920 con 0x55ef35b73630 2024-05-08T18:51:07.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.566+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v25'175 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x55ef35b73630 2024-05-08T18:51:07.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.566+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91920 con 0x55ef35b78020 2024-05-08T18:51:07.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.567+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v25'53 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.567+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b919b0 con 0x7f1630035030 2024-05-08T18:51:07.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.568+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v25'61 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1628077020 con 0x7f1630035030 2024-05-08T18:51:07.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.568+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b919b0 con 0x55ef35b78020 2024-05-08T18:51:07.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.569+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v25'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.569+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b919b0 con 0x55ef35b73630 2024-05-08T18:51:07.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.570+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v25'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x55ef35b73630 2024-05-08T18:51:07.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.570+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91b80 con 0x55ef35b73630 2024-05-08T18:51:07.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.571+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v25'176 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x55ef35b73630 2024-05-08T18:51:07.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.571+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91b80 con 0x55ef35b78020 2024-05-08T18:51:07.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.572+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v25'54 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.572+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91b80 con 0x7f1630035030 2024-05-08T18:51:07.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.573+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v25'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1628077020 con 0x7f1630035030 2024-05-08T18:51:07.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.573+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91530 con 0x55ef35b78020 2024-05-08T18:51:07.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.574+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v25'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.574+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91530 con 0x55ef35b78020 2024-05-08T18:51:07.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.575+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v25'30 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.575+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91530 con 0x55ef35b78020 2024-05-08T18:51:07.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.576+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v25'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.576+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91530 con 0x55ef35b78020 2024-05-08T18:51:07.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.577+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v25'41 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.577+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91530 con 0x7f16280a1040 2024-05-08T18:51:07.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.578+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v25'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x7f16280a1040 2024-05-08T18:51:07.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.578+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91530 con 0x55ef35b78020 2024-05-08T18:51:07.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.579+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v25'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.579+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91530 con 0x7f16280a1040 2024-05-08T18:51:07.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.580+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v25'42 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x7f16280a1040 2024-05-08T18:51:07.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.580+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91530 con 0x55ef35b78020 2024-05-08T18:51:07.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.581+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v25'55 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.581+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91530 con 0x7f16280a1040 2024-05-08T18:51:07.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.582+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v25'46 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x7f16280a1040 2024-05-08T18:51:07.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.582+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b91530 con 0x7f1630035030 2024-05-08T18:51:07.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.583+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v25'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1628077020 con 0x7f1630035030 2024-05-08T18:51:07.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.583+0000 7f14ed7e2640 20 reqs_thread_entry: start 2024-05-08T18:51:07.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.583+0000 7f163ca12800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:07.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.583+0000 7f163ca12800 20 Filter name: none 2024-05-08T18:51:07.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.584+0000 7f145effd640 20 reqs_thread_entry: start 2024-05-08T18:51:07.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.584+0000 7f163ca12800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:51:07.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.584+0000 7f163ca12800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.584+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ef35bbca10 con 0x55ef35b73630 2024-05-08T18:51:07.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.584+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f162c03b040 con 0x55ef35b73630 2024-05-08T18:51:07.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.584+0000 7f163ca12800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:51:07.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.584+0000 7f163ca12800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:51:07.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.584+0000 7f163ca12800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:51:07.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.584+0000 7f163ca12800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:51:07.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.584+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55ef35bbc990 con 0x7f1630035030 2024-05-08T18:51:07.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.585+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f1628077020 con 0x7f1630035030 2024-05-08T18:51:07.585 INFO:teuthology.orchestra.run.smithi132.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-05-08T18:51:07.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.585+0000 7f14ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:07.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.585+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94485886812080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b8eb30 con 0x55ef35b73630 2024-05-08T18:51:07.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.586+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94485886812080] v25'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x55ef35b73630 2024-05-08T18:51:07.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.586+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94485886785376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b83fb0 con 0x7f1630035030 2024-05-08T18:51:07.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.587+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94485886785376] v25'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1628077020 con 0x7f1630035030 2024-05-08T18:51:07.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.587+0000 7f163ca12800 20 remove_watcher() i=0 2024-05-08T18:51:07.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.587+0000 7f163ca12800 2 removed watcher, disabling cache 2024-05-08T18:51:07.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.587+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94485886792592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b83fb0 con 0x55ef35b73630 2024-05-08T18:51:07.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.588+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94485886792592] v25'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x55ef35b73630 2024-05-08T18:51:07.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.588+0000 7f163ca12800 20 remove_watcher() i=1 2024-05-08T18:51:07.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.588+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94485886795328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7f390 con 0x55ef35b78020 2024-05-08T18:51:07.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.589+0000 7f1638877640 1 -- 172.21.15.132:0/1596735923 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94485886795328] v25'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16300083e0 con 0x55ef35b78020 2024-05-08T18:51:07.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.589+0000 7f163ca12800 20 remove_watcher() i=2 2024-05-08T18:51:07.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.589+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94485886799616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b83fb0 con 0x7f1630035030 2024-05-08T18:51:07.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.590+0000 7f1638076640 1 -- 172.21.15.132:0/1596735923 <== osd.2 v2:172.21.15.132:6808/1108348591 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94485886799616] v25'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1628077020 con 0x7f1630035030 2024-05-08T18:51:07.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.590+0000 7f163ca12800 20 remove_watcher() i=3 2024-05-08T18:51:07.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.590+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94485886802320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7f390 con 0x55ef35b73630 2024-05-08T18:51:07.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.591+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94485886802320] v25'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x55ef35b73630 2024-05-08T18:51:07.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.591+0000 7f163ca12800 20 remove_watcher() i=4 2024-05-08T18:51:07.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.591+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94485886803376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b80f00 con 0x7f16280a1040 2024-05-08T18:51:07.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.592+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94485886803376] v25'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x7f16280a1040 2024-05-08T18:51:07.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.592+0000 7f163ca12800 20 remove_watcher() i=5 2024-05-08T18:51:07.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.592+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94485886808208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b83fb0 con 0x7f16280a1040 2024-05-08T18:51:07.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.593+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94485886808208] v25'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x7f16280a1040 2024-05-08T18:51:07.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.593+0000 7f163ca12800 20 remove_watcher() i=6 2024-05-08T18:51:07.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.593+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94485886809264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55ef35b7f390 con 0x7f16280a1040 2024-05-08T18:51:07.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.594+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94485886809264] v25'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f162c03b040 con 0x7f16280a1040 2024-05-08T18:51:07.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.594+0000 7f163ca12800 20 remove_watcher() i=7 2024-05-08T18:51:07.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f16280a1040 msgr2=0x7f1628067970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 --2- 172.21.15.132:0/1596735923 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f16280a1040 0x7f1628067970 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ef35b73630 msgr2=0x55ef35b75af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 --2- 172.21.15.132:0/1596735923 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ef35b73630 0x55ef35b75af0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1630035030 msgr2=0x7f1630023ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 --2- 172.21.15.132:0/1596735923 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1630035030 0x7f1630023ab0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ef35b78020 msgr2=0x55ef35b7a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 --2- 172.21.15.132:0/1596735923 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ef35b78020 0x55ef35b7a410 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f150003bb50 msgr2=0x7f150003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 --2- 172.21.15.132:0/1596735923 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f150003bb50 0x7f150003e010 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1628065fd0 tx=0x7f162808c000 comp rx=0 tx=0).stop 2024-05-08T18:51:07.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35b60750 msgr2=0x55ef35b67ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 --2- 172.21.15.132:0/1596735923 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35b60750 0x55ef35b67ce0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1630018fd0 tx=0x7f1630014d00 comp rx=0 tx=0).stop 2024-05-08T18:51:07.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 reap_dead start 2024-05-08T18:51:07.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f1637875640 1 -- 172.21.15.132:0/1596735923 reap_dead start 2024-05-08T18:51:07.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 shutdown_connections 2024-05-08T18:51:07.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 >> 172.21.15.132:0/1596735923 conn(0x55ef35b5cab0 msgr2=0x55ef35b5a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 shutdown_connections 2024-05-08T18:51:07.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 -- 172.21.15.132:0/1596735923 wait complete. 2024-05-08T18:51:07.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 -- 172.21.15.132:0/451614247 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f151003bb50 msgr2=0x7f151003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 --2- 172.21.15.132:0/451614247 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f151003bb50 0x7f151003e010 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55ef35b3fad0 tx=0x7f1628065380 comp rx=0 tx=0).stop 2024-05-08T18:51:07.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 -- 172.21.15.132:0/451614247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35b533f0 msgr2=0x55ef35b53810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 --2- 172.21.15.132:0/451614247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35b533f0 0x55ef35b53810 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x55ef35b38d40 tx=0x7f163000aea0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 -- 172.21.15.132:0/451614247 shutdown_connections 2024-05-08T18:51:07.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 --2- 172.21.15.132:0/451614247 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f151003bb50 0x7f151003e010 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 --2- 172.21.15.132:0/451614247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35b533f0 0x55ef35b53810 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 -- 172.21.15.132:0/451614247 >> 172.21.15.132:0/451614247 conn(0x55ef35b47490 msgr2=0x55ef35b47890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 -- 172.21.15.132:0/451614247 shutdown_connections 2024-05-08T18:51:07.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.595+0000 7f163ca12800 1 -- 172.21.15.132:0/451614247 wait complete. 2024-05-08T18:51:07.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.596+0000 7f163ca12800 1 -- 172.21.15.132:0/1846628589 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ef35a42600 msgr2=0x55ef35b3f0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.596+0000 7f163ca12800 1 --2- 172.21.15.132:0/1846628589 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ef35a42600 0x55ef35b3f0b0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.596+0000 7f163ca12800 1 -- 172.21.15.132:0/1846628589 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ef35b419a0 msgr2=0x55ef35b43d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.596+0000 7f163ca12800 1 --2- 172.21.15.132:0/1846628589 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ef35b419a0 0x55ef35b43d90 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.596+0000 7f163ca12800 1 -- 172.21.15.132:0/1846628589 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f152003bba0 msgr2=0x7f152003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.596+0000 7f163ca12800 1 --2- 172.21.15.132:0/1846628589 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f152003bba0 0x7f152003e060 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f162c000c00 tx=0x7f162c0013b0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.596+0000 7f163ca12800 1 -- 172.21.15.132:0/1846628589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35a3fcd0 msgr2=0x55ef35b37e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.596+0000 7f163ca12800 1 --2- 172.21.15.132:0/1846628589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35a3fcd0 0x55ef35b37e70 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f162800a190 tx=0x7f1628003330 comp rx=0 tx=0).stop 2024-05-08T18:51:07.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.596+0000 7f163ca12800 1 -- 172.21.15.132:0/1846628589 shutdown_connections 2024-05-08T18:51:07.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.596+0000 7f163ca12800 1 --2- 172.21.15.132:0/1846628589 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ef35b419a0 0x55ef35b43d90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.596+0000 7f163ca12800 1 --2- 172.21.15.132:0/1846628589 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ef35a42600 0x55ef35b3f0b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.596+0000 7f163ca12800 1 --2- 172.21.15.132:0/1846628589 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f152003bba0 0x7f152003e060 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.596+0000 7f163ca12800 1 --2- 172.21.15.132:0/1846628589 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ef35a3fcd0 0x55ef35b37e70 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.596+0000 7f163ca12800 1 -- 172.21.15.132:0/1846628589 >> 172.21.15.132:0/1846628589 conn(0x55ef35a39720 msgr2=0x55ef35b2a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.596+0000 7f163ca12800 1 -- 172.21.15.132:0/1846628589 shutdown_connections 2024-05-08T18:51:07.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.596+0000 7f163ca12800 1 -- 172.21.15.132:0/1846628589 wait complete. 2024-05-08T18:51:07.604 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-08T18:51:07.611 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-05-08T18:51:07.615 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:51:07.641 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:51:07.651 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:51:07.694 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-05-08T18:51:07.698 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:51:07.698 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-08T18:51:07.699 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-08T18:51:07.699 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-05-08T18:51:07.744 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:07.744 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:07.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.745+0000 7f8234546800 1 Processor -- start 2024-05-08T18:51:07.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.745+0000 7f8234546800 1 -- start start 2024-05-08T18:51:07.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.746+0000 7f8234546800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x564c3353fb50 0x564c3353ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.746+0000 7f8234546800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564c334b4f10 con 0x564c335404b0 2024-05-08T18:51:07.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.746+0000 7f8234546800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x564c333e1e20 con 0x564c3353fb50 2024-05-08T18:51:07.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.746+0000 7f8232045640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x564c3353fb50 0x564c3353ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.746+0000 7f8232045640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x564c3353fb50 0x564c3353ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51344/0 (socket says 172.21.15.132:51344) 2024-05-08T18:51:07.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.746+0000 7f8232045640 1 -- 172.21.15.132:0/129439951 learned_addr learned my addr 172.21.15.132:0/129439951 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.746+0000 7f8231844640 1 --1- 172.21.15.132:0/129439951 >> v1:172.21.15.42:6789/0 conn(0x564c335404b0 0x564c33540960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:55718/0 (socket says 172.21.15.132:55718) 2024-05-08T18:51:07.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.746+0000 7f8232045640 1 -- 172.21.15.132:0/129439951 >> v1:172.21.15.42:6789/0 conn(0x564c335404b0 legacy=0x564c33540960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.746+0000 7f8232045640 1 -- 172.21.15.132:0/129439951 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c33541070 con 0x564c3353fb50 2024-05-08T18:51:07.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.748+0000 7f8232045640 1 --2- 172.21.15.132:0/129439951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c3353fb50 0x564c3353ff70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8224005fd0 tx=0x7f822401cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d59bf85290b070 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.748+0000 7f8231043640 1 -- 172.21.15.132:0/129439951 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8224052540 con 0x564c3353fb50 2024-05-08T18:51:07.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.748+0000 7f8231043640 1 -- 172.21.15.132:0/129439951 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f822404e070 con 0x564c3353fb50 2024-05-08T18:51:07.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.748+0000 7f8231043640 1 -- 172.21.15.132:0/129439951 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8224052890 con 0x564c3353fb50 2024-05-08T18:51:07.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.749+0000 7f8234546800 1 -- 172.21.15.132:0/129439951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c3353fb50 msgr2=0x564c3353ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.749+0000 7f8234546800 1 --2- 172.21.15.132:0/129439951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c3353fb50 0x564c3353ff70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8224005fd0 tx=0x7f822401cd80 comp rx=0 tx=0).stop 2024-05-08T18:51:07.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.749+0000 7f8234546800 1 -- 172.21.15.132:0/129439951 shutdown_connections 2024-05-08T18:51:07.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.749+0000 7f8234546800 1 --2- 172.21.15.132:0/129439951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c3353fb50 0x564c3353ff70 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.749+0000 7f8234546800 1 -- 172.21.15.132:0/129439951 >> 172.21.15.132:0/129439951 conn(0x564c3353b6b0 msgr2=0x564c3353db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.749+0000 7f8234546800 1 -- 172.21.15.132:0/129439951 shutdown_connections 2024-05-08T18:51:07.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.749+0000 7f8234546800 1 -- 172.21.15.132:0/129439951 wait complete. 2024-05-08T18:51:07.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.763+0000 7f8234546800 1 Processor -- start 2024-05-08T18:51:07.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.763+0000 7f8234546800 1 -- start start 2024-05-08T18:51:07.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.763+0000 7f8234546800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c3353fb50 0x564c33634a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.763+0000 7f8234546800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564c3348c5c0 con 0x564c3353fb50 2024-05-08T18:51:07.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.763+0000 7f8232045640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c3353fb50 0x564c33634a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.763+0000 7f8232045640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c3353fb50 0x564c33634a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51348/0 (socket says 172.21.15.132:51348) 2024-05-08T18:51:07.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.763+0000 7f8232045640 1 -- 172.21.15.132:0/3816860519 learned_addr learned my addr 172.21.15.132:0/3816860519 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.764+0000 7f8232045640 1 -- 172.21.15.132:0/3816860519 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c33635040 con 0x564c3353fb50 2024-05-08T18:51:07.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.764+0000 7f8232045640 1 --2- 172.21.15.132:0/3816860519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c3353fb50 0x564c33634a70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f822401ba70 tx=0x7f822404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cfe621a4dbcad06 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.764+0000 7f8120608640 1 -- 172.21.15.132:0/3816860519 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8224052820 con 0x564c3353fb50 2024-05-08T18:51:07.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.764+0000 7f8120608640 1 -- 172.21.15.132:0/3816860519 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8224062070 con 0x564c3353fb50 2024-05-08T18:51:07.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.764+0000 7f8120608640 1 -- 172.21.15.132:0/3816860519 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8224052b10 con 0x564c3353fb50 2024-05-08T18:51:07.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.765+0000 7f8234546800 1 -- 172.21.15.132:0/3816860519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c3353fb50 msgr2=0x564c33634a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.765+0000 7f8234546800 1 --2- 172.21.15.132:0/3816860519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c3353fb50 0x564c33634a70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f822401ba70 tx=0x7f822404c000 comp rx=0 tx=0).stop 2024-05-08T18:51:07.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.765+0000 7f8234546800 1 -- 172.21.15.132:0/3816860519 shutdown_connections 2024-05-08T18:51:07.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.765+0000 7f8234546800 1 --2- 172.21.15.132:0/3816860519 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c3353fb50 0x564c33634a70 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.765+0000 7f8234546800 1 -- 172.21.15.132:0/3816860519 >> 172.21.15.132:0/3816860519 conn(0x564c3353b6b0 msgr2=0x564c33630390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.765+0000 7f8234546800 1 -- 172.21.15.132:0/3816860519 shutdown_connections 2024-05-08T18:51:07.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.765+0000 7f8234546800 1 -- 172.21.15.132:0/3816860519 wait complete. 2024-05-08T18:51:07.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.765+0000 7f8234546800 1 Processor -- start 2024-05-08T18:51:07.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.765+0000 7f8234546800 1 -- start start 2024-05-08T18:51:07.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.765+0000 7f8234546800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c3353fb50 0x564c3363c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.765+0000 7f8234546800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564c335415a0 con 0x564c3353fb50 2024-05-08T18:51:07.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.765+0000 7f8232045640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c3353fb50 0x564c3363c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.765+0000 7f8232045640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c3353fb50 0x564c3363c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51362/0 (socket says 172.21.15.132:51362) 2024-05-08T18:51:07.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.765+0000 7f8232045640 1 -- 172.21.15.132:0/1929335637 learned_addr learned my addr 172.21.15.132:0/1929335637 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.766+0000 7f8232045640 1 -- 172.21.15.132:0/1929335637 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c3363ca60 con 0x564c3353fb50 2024-05-08T18:51:07.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.766+0000 7f8232045640 1 --2- 172.21.15.132:0/1929335637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c3353fb50 0x564c3363c520 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f822400a190 tx=0x7f8224003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.766+0000 7f811ee05640 1 -- 172.21.15.132:0/1929335637 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8224071570 con 0x564c3353fb50 2024-05-08T18:51:07.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.766+0000 7f811ee05640 1 -- 172.21.15.132:0/1929335637 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8224058040 con 0x564c3353fb50 2024-05-08T18:51:07.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.766+0000 7f8234546800 1 -- 172.21.15.132:0/1929335637 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c3363ccf0 con 0x564c3353fb50 2024-05-08T18:51:07.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.766+0000 7f811ee05640 1 -- 172.21.15.132:0/1929335637 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8224071880 con 0x564c3353fb50 2024-05-08T18:51:07.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.766+0000 7f8234546800 1 -- 172.21.15.132:0/1929335637 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c3363f9a0 con 0x564c3353fb50 2024-05-08T18:51:07.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.767+0000 7f811ee05640 1 -- 172.21.15.132:0/1929335637 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8224050070 con 0x564c3353fb50 2024-05-08T18:51:07.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.767+0000 7f811ee05640 1 --2- 172.21.15.132:0/1929335637 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f811803bba0 0x7f811803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.767+0000 7f811ee05640 1 -- 172.21.15.132:0/1929335637 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f8224094780 con 0x564c3353fb50 2024-05-08T18:51:07.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.767+0000 7f8231844640 1 --2- 172.21.15.132:0/1929335637 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f811803bba0 0x7f811803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.767+0000 7f8234546800 1 --2- 172.21.15.132:0/1929335637 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564c335404b0 0x564c33643760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.767+0000 7f8234546800 1 -- 172.21.15.132:0/1929335637 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564c33643d30 con 0x564c335404b0 2024-05-08T18:51:07.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.768+0000 7f8232846640 1 --2- 172.21.15.132:0/1929335637 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564c335404b0 0x564c33643760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.768+0000 7f8231844640 1 --2- 172.21.15.132:0/1929335637 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f811803bba0 0x7f811803e060 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8228000f60 tx=0x7f8228001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.768+0000 7f8232846640 1 --2- 172.21.15.132:0/1929335637 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564c335404b0 0x564c33643760 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.768+0000 7f8232846640 1 -- 172.21.15.132:0/1929335637 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f822c0083e0 con 0x564c335404b0 2024-05-08T18:51:07.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.768+0000 7f8234546800 1 -- 172.21.15.132:0/1929335637 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564c33640cf0 con 0x564c335404b0 2024-05-08T18:51:07.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.768+0000 7f8232846640 1 -- 172.21.15.132:0/1929335637 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f822c0083e0 con 0x564c335404b0 2024-05-08T18:51:07.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.768+0000 7f8234546800 1 --2- 172.21.15.132:0/1929335637 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564c33646090 0x564c33648480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.768+0000 7f8234546800 1 -- 172.21.15.132:0/1929335637 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564c33648b50 con 0x564c33646090 2024-05-08T18:51:07.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.769+0000 7f8232045640 1 --2- 172.21.15.132:0/1929335637 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564c33646090 0x564c33648480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.769+0000 7f8232045640 1 --2- 172.21.15.132:0/1929335637 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564c33646090 0x564c33648480 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.769+0000 7f8232045640 1 -- 172.21.15.132:0/1929335637 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8224077020 con 0x564c33646090 2024-05-08T18:51:07.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.769+0000 7f8234546800 1 -- 172.21.15.132:0/1929335637 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564c33644f30 con 0x564c335404b0 2024-05-08T18:51:07.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.769+0000 7f8232846640 1 -- 172.21.15.132:0/1929335637 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f822c0083e0 con 0x564c335404b0 2024-05-08T18:51:07.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.769+0000 7f8234546800 1 -- 172.21.15.132:0/1929335637 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564c336453d0 con 0x564c335404b0 2024-05-08T18:51:07.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.770+0000 7f8232846640 1 -- 172.21.15.132:0/1929335637 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f822c0083e0 con 0x564c335404b0 2024-05-08T18:51:07.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.770+0000 7f8234546800 1 Processor -- start 2024-05-08T18:51:07.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.770+0000 7f8234546800 1 -- start start 2024-05-08T18:51:07.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.770+0000 7f8234546800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c33657a80 0x564c33657ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.770+0000 7f8234546800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564c33432fc0 con 0x564c33657a80 2024-05-08T18:51:07.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.770+0000 7f8232846640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c33657a80 0x564c33657ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.770+0000 7f8232846640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c33657a80 0x564c33657ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51374/0 (socket says 172.21.15.132:51374) 2024-05-08T18:51:07.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.770+0000 7f8232846640 1 -- 172.21.15.132:0/2756649260 learned_addr learned my addr 172.21.15.132:0/2756649260 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.771+0000 7f8232846640 1 -- 172.21.15.132:0/2756649260 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c336583e0 con 0x564c33657a80 2024-05-08T18:51:07.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.771+0000 7f8232846640 1 --2- 172.21.15.132:0/2756649260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c33657a80 0x564c33657ea0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x564c3363d920 tx=0x7f822c00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.771+0000 7f8117fff640 1 -- 172.21.15.132:0/2756649260 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f822c007d00 con 0x564c33657a80 2024-05-08T18:51:07.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.771+0000 7f8117fff640 1 -- 172.21.15.132:0/2756649260 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f822c01e020 con 0x564c33657a80 2024-05-08T18:51:07.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.771+0000 7f8234546800 1 -- 172.21.15.132:0/2756649260 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c33658e50 con 0x564c33657a80 2024-05-08T18:51:07.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.771+0000 7f8117fff640 1 -- 172.21.15.132:0/2756649260 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f822c019420 con 0x564c33657a80 2024-05-08T18:51:07.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.771+0000 7f8234546800 1 -- 172.21.15.132:0/2756649260 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c33659350 con 0x564c33657a80 2024-05-08T18:51:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.772+0000 7f8117fff640 1 -- 172.21.15.132:0/2756649260 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f822c016040 con 0x564c33657a80 2024-05-08T18:51:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.772+0000 7f8117fff640 1 --2- 172.21.15.132:0/2756649260 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f810c03bb50 0x7f810c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.772+0000 7f8117fff640 1 -- 172.21.15.132:0/2756649260 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f822c01f030 con 0x564c33657a80 2024-05-08T18:51:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.772+0000 7f8232045640 1 --2- 172.21.15.132:0/2756649260 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f810c03bb50 0x7f810c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.772+0000 7f8234546800 1 Processor -- start 2024-05-08T18:51:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.772+0000 7f8232045640 1 --2- 172.21.15.132:0/2756649260 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f810c03bb50 0x7f810c03e010 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x564c336441c0 tx=0x7f8224066f00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.772+0000 7f8234546800 1 -- start start 2024-05-08T18:51:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.773+0000 7f8234546800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c33664eb0 0x564c336652d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.773+0000 7f8234546800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564c33635300 con 0x564c33664eb0 2024-05-08T18:51:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.773+0000 7f8232846640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c33664eb0 0x564c336652d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.773+0000 7f8232846640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c33664eb0 0x564c336652d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51390/0 (socket says 172.21.15.132:51390) 2024-05-08T18:51:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.773+0000 7f8232846640 1 -- 172.21.15.132:0/2033495412 learned_addr learned my addr 172.21.15.132:0/2033495412 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.773+0000 7f8232846640 1 -- 172.21.15.132:0/2033495412 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c336658a0 con 0x564c33664eb0 2024-05-08T18:51:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.773+0000 7f8232846640 1 --2- 172.21.15.132:0/2033495412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c33664eb0 0x564c336652d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f822c052c20 tx=0x7f822c016f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=724f68bfad93173 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.773+0000 7f8115ffb640 1 -- 172.21.15.132:0/2033495412 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f822c01d070 con 0x564c33664eb0 2024-05-08T18:51:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.773+0000 7f8115ffb640 1 -- 172.21.15.132:0/2033495412 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f822c017ac0 con 0x564c33664eb0 2024-05-08T18:51:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.773+0000 7f8115ffb640 1 -- 172.21.15.132:0/2033495412 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f822c017c70 con 0x564c33664eb0 2024-05-08T18:51:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.774+0000 7f8234546800 1 -- 172.21.15.132:0/2033495412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c33664eb0 msgr2=0x564c336652d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.774+0000 7f8234546800 1 --2- 172.21.15.132:0/2033495412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c33664eb0 0x564c336652d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f822c052c20 tx=0x7f822c016f90 comp rx=0 tx=0).stop 2024-05-08T18:51:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.774+0000 7f8234546800 1 -- 172.21.15.132:0/2033495412 shutdown_connections 2024-05-08T18:51:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.774+0000 7f8234546800 1 --2- 172.21.15.132:0/2033495412 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c33664eb0 0x564c336652d0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.774+0000 7f8234546800 1 -- 172.21.15.132:0/2033495412 >> 172.21.15.132:0/2033495412 conn(0x564c33661180 msgr2=0x564c3365f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.774+0000 7f8234546800 1 -- 172.21.15.132:0/2033495412 shutdown_connections 2024-05-08T18:51:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.774+0000 7f8234546800 1 -- 172.21.15.132:0/2033495412 wait complete. 2024-05-08T18:51:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.774+0000 7f8234546800 1 Processor -- start 2024-05-08T18:51:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.774+0000 7f8234546800 1 -- start start 2024-05-08T18:51:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.774+0000 7f8234546800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c33664eb0 0x564c3366c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.774+0000 7f8234546800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x564c33666030 con 0x564c33664eb0 2024-05-08T18:51:07.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.775+0000 7f8232846640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c33664eb0 0x564c3366c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.775+0000 7f8232846640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c33664eb0 0x564c3366c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51404/0 (socket says 172.21.15.132:51404) 2024-05-08T18:51:07.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.775+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 learned_addr learned my addr 172.21.15.132:0/1454156926 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.775+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c3366c8a0 con 0x564c33664eb0 2024-05-08T18:51:07.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.775+0000 7f8232846640 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c33664eb0 0x564c3366c360 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f822c051b40 tx=0x7f822c052bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.775+0000 7f8103fff640 1 -- 172.21.15.132:0/1454156926 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f822c019880 con 0x564c33664eb0 2024-05-08T18:51:07.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.775+0000 7f8103fff640 1 -- 172.21.15.132:0/1454156926 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f822c019a20 con 0x564c33664eb0 2024-05-08T18:51:07.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.775+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c3366cb90 con 0x564c33664eb0 2024-05-08T18:51:07.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.775+0000 7f8103fff640 1 -- 172.21.15.132:0/1454156926 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f822c0173b0 con 0x564c33664eb0 2024-05-08T18:51:07.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.775+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c3366f7e0 con 0x564c33664eb0 2024-05-08T18:51:07.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.776+0000 7f8103fff640 1 -- 172.21.15.132:0/1454156926 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f822c04e070 con 0x564c33664eb0 2024-05-08T18:51:07.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.776+0000 7f8103fff640 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f80fc03bbf0 0x7f80fc03e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.776+0000 7f8103fff640 1 -- 172.21.15.132:0/1454156926 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f822c036ab0 con 0x564c33664eb0 2024-05-08T18:51:07.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.776+0000 7f8232045640 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f80fc03bbf0 0x7f80fc03e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.777+0000 7f8232045640 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f80fc03bbf0 0x7f80fc03e0b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x564c33648f50 tx=0x7f822408b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.777+0000 7f8234546800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.777+0000 7f8234546800 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564c33677f30 0x564c3367a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.777+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564c3367ab40 con 0x564c33677f30 2024-05-08T18:51:07.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.777+0000 7f8231844640 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564c33677f30 0x564c3367a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.777+0000 7f8231844640 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564c33677f30 0x564c3367a3f0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.778+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f822800f660 con 0x564c33677f30 2024-05-08T18:51:07.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.778+0000 7f8234546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.778+0000 7f8234546800 20 realm 2024-05-08T18:51:07.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.778+0000 7f8234546800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.778+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564c33677380 con 0x564c33677f30 2024-05-08T18:51:07.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.778+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f822800f660 con 0x564c33677f30 2024-05-08T18:51:07.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.778+0000 7f8234546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.778+0000 7f8234546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:07.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.778+0000 7f8234546800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.778+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564c3367b630 con 0x564c33677f30 2024-05-08T18:51:07.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.778+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f822800f660 con 0x564c33677f30 2024-05-08T18:51:07.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.778+0000 7f8234546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.778+0000 7f8234546800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.778+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564c3367bf00 con 0x564c33677f30 2024-05-08T18:51:07.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.778+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f822800f660 con 0x564c33677f30 2024-05-08T18:51:07.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.778+0000 7f8234546800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:07.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.778+0000 7f8234546800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.778+0000 7f8234546800 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564c3367c920 0x564c3367ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.778+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564c3367f400 con 0x564c3367c920 2024-05-08T18:51:07.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.778+0000 7f8232846640 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564c3367c920 0x564c3367ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.779+0000 7f8232846640 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564c3367c920 0x564c3367ed10 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.779+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f822c03c070 con 0x564c3367c920 2024-05-08T18:51:07.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.779+0000 7f8234546800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:07.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.779+0000 7f8234546800 20 searching for the correct realm 2024-05-08T18:51:07.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.779+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x564c3367c920 2024-05-08T18:51:07.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.780+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822c03c070 con 0x564c3367c920 2024-05-08T18:51:07.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.780+0000 7f8232846640 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f822c019040 0x7f822c0435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.780+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x7f822c019040 2024-05-08T18:51:07.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.780+0000 7f8232045640 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f822c019040 0x7f822c0435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.780+0000 7f8232045640 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f822c019040 0x7f822c0435b0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.780+0000 7f8232045640 1 -- 172.21.15.132:0/1454156926 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822408b070 con 0x7f822c019040 2024-05-08T18:51:07.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.780+0000 7f8232045640 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f82240a1040 0x7f8224067970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.780+0000 7f8232045640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x7f82240a1040 2024-05-08T18:51:07.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.780+0000 7f8231844640 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f82240a1040 0x7f8224067970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.781+0000 7f8231844640 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f82240a1040 0x7f8224067970 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.781+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822800f660 con 0x7f82240a1040 2024-05-08T18:51:07.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.781+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x564c33677f30 2024-05-08T18:51:07.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.781+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822800f660 con 0x564c33677f30 2024-05-08T18:51:07.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.781+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x564c33677f30 2024-05-08T18:51:07.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.781+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822802b040 con 0x564c33677f30 2024-05-08T18:51:07.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.781+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x7f82240a1040 2024-05-08T18:51:07.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.782+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822802b040 con 0x7f82240a1040 2024-05-08T18:51:07.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.782+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x7f82240a1040 2024-05-08T18:51:07.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.782+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822802b040 con 0x7f82240a1040 2024-05-08T18:51:07.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.782+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x7f822c019040 2024-05-08T18:51:07.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.782+0000 7f8232045640 1 -- 172.21.15.132:0/1454156926 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822408b070 con 0x7f822c019040 2024-05-08T18:51:07.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.782+0000 7f8232045640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x564c3367c920 2024-05-08T18:51:07.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.782+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822c03c070 con 0x564c3367c920 2024-05-08T18:51:07.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.782+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x564c33677f30 2024-05-08T18:51:07.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.783+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822802b040 con 0x564c33677f30 2024-05-08T18:51:07.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.783+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x7f82240a1040 2024-05-08T18:51:07.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.783+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822802b040 con 0x7f82240a1040 2024-05-08T18:51:07.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.783+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x564c33677f30 2024-05-08T18:51:07.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.783+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f822802b040 con 0x564c33677f30 2024-05-08T18:51:07.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.783+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x7f822c019040 2024-05-08T18:51:07.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.783+0000 7f8232045640 1 -- 172.21.15.132:0/1454156926 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f822408b070 con 0x7f822c019040 2024-05-08T18:51:07.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.783+0000 7f8232045640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x564c3367c920 2024-05-08T18:51:07.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.784+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f822c03c070 con 0x564c3367c920 2024-05-08T18:51:07.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.784+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x564c3367c920 2024-05-08T18:51:07.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.784+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822c03c070 con 0x564c3367c920 2024-05-08T18:51:07.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.784+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x7f82240a1040 2024-05-08T18:51:07.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.784+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822802b040 con 0x7f82240a1040 2024-05-08T18:51:07.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.785+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x564c3367c920 2024-05-08T18:51:07.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.785+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822c03c070 con 0x564c3367c920 2024-05-08T18:51:07.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.785+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x564c3367c920 2024-05-08T18:51:07.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.785+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822c03c070 con 0x564c3367c920 2024-05-08T18:51:07.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.785+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x564c33677f30 2024-05-08T18:51:07.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.785+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822802b040 con 0x564c33677f30 2024-05-08T18:51:07.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.785+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x564c33677f30 2024-05-08T18:51:07.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.785+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f822802b040 con 0x564c33677f30 2024-05-08T18:51:07.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.785+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x7f82240a1040 2024-05-08T18:51:07.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.786+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822802b040 con 0x7f82240a1040 2024-05-08T18:51:07.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.786+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x564c3367c920 2024-05-08T18:51:07.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.786+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822c06a040 con 0x564c3367c920 2024-05-08T18:51:07.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.786+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x7f822c019040 2024-05-08T18:51:07.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.786+0000 7f8232045640 1 -- 172.21.15.132:0/1454156926 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822408b070 con 0x7f822c019040 2024-05-08T18:51:07.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.786+0000 7f8232045640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x564c33677f30 2024-05-08T18:51:07.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.786+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822802b040 con 0x564c33677f30 2024-05-08T18:51:07.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.786+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x7f82240a1040 2024-05-08T18:51:07.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.787+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822803b040 con 0x7f82240a1040 2024-05-08T18:51:07.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.787+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x564c3367c920 2024-05-08T18:51:07.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.787+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822c06a040 con 0x564c3367c920 2024-05-08T18:51:07.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.787+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x7f82240a1040 2024-05-08T18:51:07.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.787+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822803b040 con 0x7f82240a1040 2024-05-08T18:51:07.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.787+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x7f822c019040 2024-05-08T18:51:07.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.788+0000 7f8232045640 1 -- 172.21.15.132:0/1454156926 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822408b070 con 0x7f822c019040 2024-05-08T18:51:07.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.788+0000 7f8232045640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x564c3367c920 2024-05-08T18:51:07.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.788+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822c06a040 con 0x564c3367c920 2024-05-08T18:51:07.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.788+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x7f82240a1040 2024-05-08T18:51:07.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.788+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822803b040 con 0x7f82240a1040 2024-05-08T18:51:07.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.788+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x564c33677f30 2024-05-08T18:51:07.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.789+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f822803b040 con 0x564c33677f30 2024-05-08T18:51:07.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.789+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x564c33680d50 con 0x7f822c019040 2024-05-08T18:51:07.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.789+0000 7f8232045640 1 -- 172.21.15.132:0/1454156926 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f822408b070 con 0x7f822c019040 2024-05-08T18:51:07.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.789+0000 7f8234546800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:07.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.789+0000 7f8234546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:07.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.789+0000 7f8234546800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:07.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.789+0000 7f8234546800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:07.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.789+0000 7f8234546800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:07.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.789+0000 7f8234546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:07.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.789+0000 7f8234546800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.789+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564c3367fdf0 con 0x564c33677f30 2024-05-08T18:51:07.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.789+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f822803b040 con 0x564c33677f30 2024-05-08T18:51:07.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.789+0000 7f8234546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.789+0000 7f8234546800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.789+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564c33680690 con 0x564c33677f30 2024-05-08T18:51:07.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.789+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f822803b040 con 0x564c33677f30 2024-05-08T18:51:07.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.789+0000 7f8234546800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:07.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.789+0000 7f8234546800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.789+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564c336811d0 con 0x564c33677f30 2024-05-08T18:51:07.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f822803b040 con 0x564c33677f30 2024-05-08T18:51:07.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8234546800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:07.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8234546800 20 zone default found 2024-05-08T18:51:07.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8234546800 4 Realm: () 2024-05-08T18:51:07.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8234546800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:07.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8234546800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:07.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8234546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:07.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8234546800 20 zonegroup default 2024-05-08T18:51:07.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8234546800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564c33681210 con 0x7f82240a1040 2024-05-08T18:51:07.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f822803b040 con 0x7f82240a1040 2024-05-08T18:51:07.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8234546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8234546800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564c33683030 con 0x564c3367c920 2024-05-08T18:51:07.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f822c06a040 con 0x564c3367c920 2024-05-08T18:51:07.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8234546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8234546800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564c33683450 con 0x564c3367c920 2024-05-08T18:51:07.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f822c06a040 con 0x564c3367c920 2024-05-08T18:51:07.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8234546800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8234546800 20 started sync module instance, tier type = 2024-05-08T18:51:07.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8234546800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:07.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.790+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c336824d0 con 0x7f822c019040 2024-05-08T18:51:07.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.791+0000 7f8232045640 1 -- 172.21.15.132:0/1454156926 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822408b070 con 0x7f822c019040 2024-05-08T18:51:07.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.791+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94885279965216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c33683890 con 0x7f822c019040 2024-05-08T18:51:07.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.792+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c336840e0 con 0x564c33677f30 2024-05-08T18:51:07.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.792+0000 7f8232045640 1 -- 172.21.15.132:0/1454156926 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94885279965216] v25'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822408b070 con 0x7f822c019040 2024-05-08T18:51:07.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.793+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822803b040 con 0x564c33677f30 2024-05-08T18:51:07.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.793+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94885279972400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c33684500 con 0x564c33677f30 2024-05-08T18:51:07.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.793+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c33684db0 con 0x564c3367c920 2024-05-08T18:51:07.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.794+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94885279972400] v25'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822803b040 con 0x564c33677f30 2024-05-08T18:51:07.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.794+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822c06a040 con 0x564c3367c920 2024-05-08T18:51:07.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.794+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94885279973456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c33684920 con 0x564c3367c920 2024-05-08T18:51:07.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.794+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c33685880 con 0x7f822c019040 2024-05-08T18:51:07.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.795+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94885279973456] v25'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822c06a040 con 0x564c3367c920 2024-05-08T18:51:07.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.795+0000 7f8232045640 1 -- 172.21.15.132:0/1454156926 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822408b070 con 0x7f822c019040 2024-05-08T18:51:07.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.795+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94885279974512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c33684890 con 0x7f822c019040 2024-05-08T18:51:07.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.795+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c33686770 con 0x564c33677f30 2024-05-08T18:51:07.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.796+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822803b040 con 0x564c33677f30 2024-05-08T18:51:07.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.796+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94885279982752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c33686ef0 con 0x564c33677f30 2024-05-08T18:51:07.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.796+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c33687a10 con 0x7f82240a1040 2024-05-08T18:51:07.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.796+0000 7f8232045640 1 -- 172.21.15.132:0/1454156926 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94885279974512] v25'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822408b070 con 0x7f822c019040 2024-05-08T18:51:07.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.797+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94885279982752] v25'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822803b040 con 0x564c33677f30 2024-05-08T18:51:07.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.797+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822803b040 con 0x7f82240a1040 2024-05-08T18:51:07.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.797+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94885279986912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c336879d0 con 0x7f82240a1040 2024-05-08T18:51:07.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.797+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c336882b0 con 0x7f82240a1040 2024-05-08T18:51:07.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.798+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(56 notify.6 [create] v25'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822803b040 con 0x7f82240a1040 2024-05-08T18:51:07.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.798+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94885279989168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c336879d0 con 0x7f82240a1040 2024-05-08T18:51:07.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.798+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c33688de0 con 0x7f82240a1040 2024-05-08T18:51:07.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.799+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94885279986912] v25'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822803b040 con 0x7f82240a1040 2024-05-08T18:51:07.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.800+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94885279989168] v25'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822803b040 con 0x7f82240a1040 2024-05-08T18:51:07.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.800+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822803b040 con 0x7f82240a1040 2024-05-08T18:51:07.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.800+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94885279992016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c336881d0 con 0x7f82240a1040 2024-05-08T18:51:07.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.800+0000 7f8234546800 20 add_watcher() i=0 2024-05-08T18:51:07.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.800+0000 7f8234546800 20 add_watcher() i=1 2024-05-08T18:51:07.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.800+0000 7f8234546800 20 add_watcher() i=2 2024-05-08T18:51:07.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.800+0000 7f8234546800 20 add_watcher() i=3 2024-05-08T18:51:07.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.800+0000 7f8234546800 20 add_watcher() i=4 2024-05-08T18:51:07.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.800+0000 7f8234546800 20 add_watcher() i=5 2024-05-08T18:51:07.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.800+0000 7f8234546800 20 add_watcher() i=6 2024-05-08T18:51:07.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.801+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94885279992016] v25'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822803b040 con 0x7f82240a1040 2024-05-08T18:51:07.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.801+0000 7f8234546800 20 add_watcher() i=7 2024-05-08T18:51:07.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.801+0000 7f8234546800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:07.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.801+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564c3368bdd0 con 0x564c33677f30 2024-05-08T18:51:07.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.801+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f822803b040 con 0x564c33677f30 2024-05-08T18:51:07.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.801+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94885279980704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c33689250 con 0x564c33677f30 2024-05-08T18:51:07.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.802+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94885279980704] v25'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f822803b040 con 0x564c33677f30 2024-05-08T18:51:07.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.802+0000 7f80e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:07.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.802+0000 7f8234546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:07.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.802+0000 7f8234546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:07.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.802+0000 7f8234546800 5 note: GC not initialized 2024-05-08T18:51:07.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.802+0000 7f80637fe640 20 reqs_thread_entry: start 2024-05-08T18:51:07.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.803+0000 7f8234546800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:07.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.803+0000 7f8234546800 20 Filter name: none 2024-05-08T18:51:07.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.803+0000 7f80617fa640 20 reqs_thread_entry: start 2024-05-08T18:51:07.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.803+0000 7f8234546800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:51:07.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.803+0000 7f8234546800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.803+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564c336bf7c0 con 0x7f822c019040 2024-05-08T18:51:07.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.803+0000 7f8232045640 1 -- 172.21.15.132:0/1454156926 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f822408b070 con 0x7f822c019040 2024-05-08T18:51:07.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.803+0000 7f8234546800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:51:07.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.803+0000 7f8234546800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:51:07.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.803+0000 7f8234546800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:51:07.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.803+0000 7f8234546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5 : miss 2024-05-08T18:51:07.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.803+0000 7f8234546800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.803+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 8.c 8:354450c5:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564c336c1620 con 0x564c33677f30 2024-05-08T18:51:07.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.804+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(63 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f822803b040 con 0x564c33677f30 2024-05-08T18:51:07.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.804+0000 7f8234546800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:51:07.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.804+0000 7f8234546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5 info.flags=0x17 2024-05-08T18:51:07.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.804+0000 7f8234546800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5 to cache LRU end 2024-05-08T18:51:07.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.804+0000 7f8234546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:51:07.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.804+0000 7f8234546800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:51:07.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.804+0000 7f8234546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5 2024-05-08T18:51:07.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.804+0000 7f8234546800 20 get_obj_state: octx=0x7f822800f5e0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x564c336c3ce8 s->prefetch_data=0 2024-05-08T18:51:07.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.804+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 3.37 3:ec595fd8:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x564c336c4d80 con 0x564c33677f30 2024-05-08T18:51:07.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.804+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+865 (crc 0 0 0) 0x7f822803b040 con 0x564c33677f30 2024-05-08T18:51:07.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.804+0000 7f8234546800 10 manifest: total_size = 5 2024-05-08T18:51:07.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.804+0000 7f8234546800 20 get_obj_state: setting s->obj_tag to _UdMQ2U0Ll5qp3TntepCUjMxdr050g9F 2024-05-08T18:51:07.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.805+0000 7f80e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:07.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.805+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94885279980704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c336c4d80 con 0x564c33677f30 2024-05-08T18:51:07.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.806+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94885279980704] v25'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f822803b040 con 0x564c33677f30 2024-05-08T18:51:07.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.806+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94885279965216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c336c4d80 con 0x7f822c019040 2024-05-08T18:51:07.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.807+0000 7f8232045640 1 -- 172.21.15.132:0/1454156926 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94885279965216] v25'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822408b070 con 0x7f822c019040 2024-05-08T18:51:07.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.807+0000 7f8234546800 20 remove_watcher() i=0 2024-05-08T18:51:07.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.807+0000 7f8234546800 2 removed watcher, disabling cache 2024-05-08T18:51:07.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.807+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94885279972400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c336c4d80 con 0x564c33677f30 2024-05-08T18:51:07.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.808+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94885279972400] v25'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822803b040 con 0x564c33677f30 2024-05-08T18:51:07.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.808+0000 7f8234546800 20 remove_watcher() i=1 2024-05-08T18:51:07.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.808+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94885279973456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c336c4d80 con 0x564c3367c920 2024-05-08T18:51:07.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.809+0000 7f8232846640 1 -- 172.21.15.132:0/1454156926 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94885279973456] v25'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822c06a040 con 0x564c3367c920 2024-05-08T18:51:07.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.809+0000 7f8234546800 20 remove_watcher() i=2 2024-05-08T18:51:07.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.809+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94885279974512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c336c4d80 con 0x7f822c019040 2024-05-08T18:51:07.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.810+0000 7f8232045640 1 -- 172.21.15.132:0/1454156926 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94885279974512] v25'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822408b070 con 0x7f822c019040 2024-05-08T18:51:07.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.810+0000 7f8234546800 20 remove_watcher() i=3 2024-05-08T18:51:07.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.810+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94885279982752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c336c4d80 con 0x564c33677f30 2024-05-08T18:51:07.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.811+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94885279982752] v25'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822803b040 con 0x564c33677f30 2024-05-08T18:51:07.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.811+0000 7f8234546800 20 remove_watcher() i=4 2024-05-08T18:51:07.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.811+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94885279986912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c336c4d80 con 0x7f82240a1040 2024-05-08T18:51:07.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.812+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94885279986912] v25'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822803b040 con 0x7f82240a1040 2024-05-08T18:51:07.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.812+0000 7f8234546800 20 remove_watcher() i=5 2024-05-08T18:51:07.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.812+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94885279989168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c336c4d80 con 0x7f82240a1040 2024-05-08T18:51:07.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.813+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94885279989168] v25'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822803b040 con 0x7f82240a1040 2024-05-08T18:51:07.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.813+0000 7f8234546800 20 remove_watcher() i=6 2024-05-08T18:51:07.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.813+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94885279992016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x564c336c4d80 con 0x7f82240a1040 2024-05-08T18:51:07.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.814+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94885279992016] v25'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f822803b040 con 0x7f82240a1040 2024-05-08T18:51:07.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.814+0000 7f8234546800 20 remove_watcher() i=7 2024-05-08T18:51:07.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.814+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f82240a1040 msgr2=0x7f8224067970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.814+0000 7f8234546800 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f82240a1040 0x7f8224067970 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.814+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564c33677f30 msgr2=0x564c3367a3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564c33677f30 0x564c3367a3f0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f822c019040 msgr2=0x7f822c0435b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f822c019040 0x7f822c0435b0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564c3367c920 msgr2=0x564c3367ed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564c3367c920 0x564c3367ed10 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f80fc03bbf0 msgr2=0x7f80fc03e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f80fc03bbf0 0x7f80fc03e0b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x564c33648f50 tx=0x7f822408b000 comp rx=0 tx=0).stop 2024-05-08T18:51:07.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c33664eb0 msgr2=0x564c3366c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c33664eb0 0x564c3366c360 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f822c051b40 tx=0x7f822c052bb0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8231844640 1 -- 172.21.15.132:0/1454156926 reap_dead start 2024-05-08T18:51:07.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 shutdown_connections 2024-05-08T18:51:07.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 --2- 172.21.15.132:0/1454156926 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c33664eb0 0x564c3366c360 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 >> 172.21.15.132:0/1454156926 conn(0x564c33661180 msgr2=0x564c3365e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 shutdown_connections 2024-05-08T18:51:07.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 -- 172.21.15.132:0/1454156926 wait complete. 2024-05-08T18:51:07.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 -- 172.21.15.132:0/2756649260 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f810c03bb50 msgr2=0x7f810c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 --2- 172.21.15.132:0/2756649260 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f810c03bb50 0x7f810c03e010 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x564c336441c0 tx=0x7f8224066f00 comp rx=0 tx=0).stop 2024-05-08T18:51:07.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 -- 172.21.15.132:0/2756649260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c33657a80 msgr2=0x564c33657ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 --2- 172.21.15.132:0/2756649260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c33657a80 0x564c33657ea0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x564c3363d920 tx=0x7f822c00aec0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 -- 172.21.15.132:0/2756649260 shutdown_connections 2024-05-08T18:51:07.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 --2- 172.21.15.132:0/2756649260 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f810c03bb50 0x7f810c03e010 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 --2- 172.21.15.132:0/2756649260 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c33657a80 0x564c33657ea0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 -- 172.21.15.132:0/2756649260 >> 172.21.15.132:0/2756649260 conn(0x564c3364bb20 msgr2=0x564c3364bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 -- 172.21.15.132:0/2756649260 shutdown_connections 2024-05-08T18:51:07.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.815+0000 7f8234546800 1 -- 172.21.15.132:0/2756649260 wait complete. 2024-05-08T18:51:07.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.816+0000 7f8234546800 1 -- 172.21.15.132:0/1929335637 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564c335404b0 msgr2=0x564c33643760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.816+0000 7f8234546800 1 --2- 172.21.15.132:0/1929335637 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564c335404b0 0x564c33643760 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.816+0000 7f8234546800 1 -- 172.21.15.132:0/1929335637 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564c33646090 msgr2=0x564c33648480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.816+0000 7f8234546800 1 --2- 172.21.15.132:0/1929335637 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564c33646090 0x564c33648480 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.816+0000 7f8234546800 1 -- 172.21.15.132:0/1929335637 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f811803bba0 msgr2=0x7f811803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.816+0000 7f8234546800 1 --2- 172.21.15.132:0/1929335637 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f811803bba0 0x7f811803e060 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8228000f60 tx=0x7f8228001370 comp rx=0 tx=0).stop 2024-05-08T18:51:07.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.816+0000 7f8234546800 1 -- 172.21.15.132:0/1929335637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c3353fb50 msgr2=0x564c3363c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.816+0000 7f8234546800 1 --2- 172.21.15.132:0/1929335637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c3353fb50 0x564c3363c520 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f822400a190 tx=0x7f8224003330 comp rx=0 tx=0).stop 2024-05-08T18:51:07.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.816+0000 7f8234546800 1 -- 172.21.15.132:0/1929335637 shutdown_connections 2024-05-08T18:51:07.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.816+0000 7f8234546800 1 --2- 172.21.15.132:0/1929335637 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x564c33646090 0x564c33648480 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.816+0000 7f8234546800 1 --2- 172.21.15.132:0/1929335637 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x564c335404b0 0x564c33643760 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.816+0000 7f8234546800 1 --2- 172.21.15.132:0/1929335637 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f811803bba0 0x7f811803e060 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.816+0000 7f8234546800 1 --2- 172.21.15.132:0/1929335637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x564c3353fb50 0x564c3363c520 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.816+0000 7f8234546800 1 -- 172.21.15.132:0/1929335637 >> 172.21.15.132:0/1929335637 conn(0x564c3353b6b0 msgr2=0x564c3362eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.816+0000 7f8234546800 1 -- 172.21.15.132:0/1929335637 shutdown_connections 2024-05-08T18:51:07.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.816+0000 7f8234546800 1 -- 172.21.15.132:0/1929335637 wait complete. 2024-05-08T18:51:07.825 INFO:teuthology.orchestra.run.smithi132.stdout:fooFoofooFooFULL_CONTROL 2024-05-08T18:51:07.825 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-05-08T18:51:07.827 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-05-08T18:51:07.831 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:51:07.831 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-08T18:51:07.831 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-08T18:51:07.831 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-05-08T18:51:07.876 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:07.876 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:07.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.878+0000 7fec15216800 1 Processor -- start 2024-05-08T18:51:07.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.878+0000 7fec15216800 1 -- start start 2024-05-08T18:51:07.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.878+0000 7fec15216800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x560135ddf150 0x560135ddf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.878+0000 7fec15216800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560135ddfbf0 con 0x560135de03b0 2024-05-08T18:51:07.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.878+0000 7fec15216800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x560135c80e20 con 0x560135ddf150 2024-05-08T18:51:07.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.878+0000 7fec12d0e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x560135ddf150 0x560135ddf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.878+0000 7fec1250d640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x560135de03b0 0x560135de0830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:55720/0 (socket says 172.21.15.132:55720) 2024-05-08T18:51:07.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.878+0000 7fec1250d640 1 -- 172.21.15.132:0/265382585 learned_addr learned my addr 172.21.15.132:0/265382585 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:51:07.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.878+0000 7fec12d0e640 1 -- 172.21.15.132:0/265382585 >> v1:172.21.15.42:6789/0 conn(0x560135de03b0 legacy=0x560135de0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.878+0000 7fec12d0e640 1 -- 172.21.15.132:0/265382585 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560135de0f70 con 0x560135ddf150 2024-05-08T18:51:07.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.878+0000 7fec11d0c640 1 -- 172.21.15.132:0/265382585 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3472079748 0 0) 0x560135ddfbf0 con 0x560135de03b0 2024-05-08T18:51:07.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.880+0000 7fec12d0e640 1 --2- 172.21.15.132:0/265382585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ddf150 0x560135ddf570 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fec0400a470 tx=0x7fec0401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc596d7d751e878 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.881+0000 7fec11d0c640 1 -- 172.21.15.132:0/265382585 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec04057070 con 0x560135ddf150 2024-05-08T18:51:07.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.881+0000 7fec11d0c640 1 -- 172.21.15.132:0/265382585 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec0404adc0 con 0x560135ddf150 2024-05-08T18:51:07.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.881+0000 7fec11d0c640 1 -- 172.21.15.132:0/265382585 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec04052590 con 0x560135ddf150 2024-05-08T18:51:07.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.881+0000 7fec15216800 1 -- 172.21.15.132:0/265382585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ddf150 msgr2=0x560135ddf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.881+0000 7fec15216800 1 --2- 172.21.15.132:0/265382585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ddf150 0x560135ddf570 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fec0400a470 tx=0x7fec0401ce90 comp rx=0 tx=0).stop 2024-05-08T18:51:07.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.881+0000 7fec15216800 1 -- 172.21.15.132:0/265382585 shutdown_connections 2024-05-08T18:51:07.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.881+0000 7fec15216800 1 --2- 172.21.15.132:0/265382585 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ddf150 0x560135ddf570 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.881+0000 7fec15216800 1 -- 172.21.15.132:0/265382585 >> 172.21.15.132:0/265382585 conn(0x560135dda730 msgr2=0x560135ddcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.881+0000 7fec15216800 1 -- 172.21.15.132:0/265382585 shutdown_connections 2024-05-08T18:51:07.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.881+0000 7fec15216800 1 -- 172.21.15.132:0/265382585 wait complete. 2024-05-08T18:51:07.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.895+0000 7fec15216800 1 Processor -- start 2024-05-08T18:51:07.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.895+0000 7fec15216800 1 -- start start 2024-05-08T18:51:07.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.895+0000 7fec15216800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ddf150 0x560135ed04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.895+0000 7fec15216800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560135d2b5c0 con 0x560135ddf150 2024-05-08T18:51:07.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.895+0000 7fec12d0e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ddf150 0x560135ed04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.895+0000 7fec12d0e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ddf150 0x560135ed04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51416/0 (socket says 172.21.15.132:51416) 2024-05-08T18:51:07.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.895+0000 7fec12d0e640 1 -- 172.21.15.132:0/2336081182 learned_addr learned my addr 172.21.15.132:0/2336081182 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.895+0000 7fec12d0e640 1 -- 172.21.15.132:0/2336081182 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560135ed0a70 con 0x560135ddf150 2024-05-08T18:51:07.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.896+0000 7fec12d0e640 1 --2- 172.21.15.132:0/2336081182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ddf150 0x560135ed04a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fec04055040 tx=0x7fec0404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1770b05d74b93d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.896+0000 7feb00e09640 1 -- 172.21.15.132:0/2336081182 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec04057040 con 0x560135ddf150 2024-05-08T18:51:07.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.896+0000 7feb00e09640 1 -- 172.21.15.132:0/2336081182 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec04063070 con 0x560135ddf150 2024-05-08T18:51:07.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.896+0000 7feb00e09640 1 -- 172.21.15.132:0/2336081182 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec0405d790 con 0x560135ddf150 2024-05-08T18:51:07.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.897+0000 7fec15216800 1 -- 172.21.15.132:0/2336081182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ddf150 msgr2=0x560135ed04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.897+0000 7fec15216800 1 --2- 172.21.15.132:0/2336081182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ddf150 0x560135ed04a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fec04055040 tx=0x7fec0404c000 comp rx=0 tx=0).stop 2024-05-08T18:51:07.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.897+0000 7fec15216800 1 -- 172.21.15.132:0/2336081182 shutdown_connections 2024-05-08T18:51:07.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.897+0000 7fec15216800 1 --2- 172.21.15.132:0/2336081182 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ddf150 0x560135ed04a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.897+0000 7fec15216800 1 -- 172.21.15.132:0/2336081182 >> 172.21.15.132:0/2336081182 conn(0x560135dda730 msgr2=0x560135ecbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.897+0000 7fec15216800 1 -- 172.21.15.132:0/2336081182 shutdown_connections 2024-05-08T18:51:07.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.897+0000 7fec15216800 1 -- 172.21.15.132:0/2336081182 wait complete. 2024-05-08T18:51:07.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.897+0000 7fec15216800 1 Processor -- start 2024-05-08T18:51:07.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.897+0000 7fec15216800 1 -- start start 2024-05-08T18:51:07.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.897+0000 7fec15216800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ddf150 0x560135d53310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.897+0000 7fec15216800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560135de8880 con 0x560135ddf150 2024-05-08T18:51:07.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.897+0000 7fec12d0e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ddf150 0x560135d53310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.897+0000 7fec12d0e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ddf150 0x560135d53310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51426/0 (socket says 172.21.15.132:51426) 2024-05-08T18:51:07.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.897+0000 7fec12d0e640 1 -- 172.21.15.132:0/1476724463 learned_addr learned my addr 172.21.15.132:0/1476724463 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.898+0000 7fec12d0e640 1 -- 172.21.15.132:0/1476724463 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560135edbc80 con 0x560135ddf150 2024-05-08T18:51:07.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.898+0000 7fec12d0e640 1 --2- 172.21.15.132:0/1476724463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ddf150 0x560135d53310 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fec04060040 tx=0x7fec04002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.898+0000 7feaff606640 1 -- 172.21.15.132:0/1476724463 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec04057050 con 0x560135ddf150 2024-05-08T18:51:07.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.898+0000 7feaff606640 1 -- 172.21.15.132:0/1476724463 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec0405dcd0 con 0x560135ddf150 2024-05-08T18:51:07.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.898+0000 7fec15216800 1 -- 172.21.15.132:0/1476724463 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560135edbe50 con 0x560135ddf150 2024-05-08T18:51:07.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.898+0000 7feaff606640 1 -- 172.21.15.132:0/1476724463 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec04052440 con 0x560135ddf150 2024-05-08T18:51:07.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.898+0000 7fec15216800 1 -- 172.21.15.132:0/1476724463 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560135edc3d0 con 0x560135ddf150 2024-05-08T18:51:07.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.899+0000 7feaff606640 1 -- 172.21.15.132:0/1476724463 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fec04052600 con 0x560135ddf150 2024-05-08T18:51:07.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.899+0000 7feaff606640 1 --2- 172.21.15.132:0/1476724463 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7feaf803bba0 0x7feaf803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.899+0000 7feaff606640 1 -- 172.21.15.132:0/1476724463 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fec04093e80 con 0x560135ddf150 2024-05-08T18:51:07.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.899+0000 7fec1250d640 1 --2- 172.21.15.132:0/1476724463 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7feaf803bba0 0x7feaf803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.899+0000 7fec15216800 1 --2- 172.21.15.132:0/1476724463 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x560135de03b0 0x560135ee01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.899+0000 7fec15216800 1 -- 172.21.15.132:0/1476724463 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x560135ee0770 con 0x560135de03b0 2024-05-08T18:51:07.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.900+0000 7fec1350f640 1 --2- 172.21.15.132:0/1476724463 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x560135de03b0 0x560135ee01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.900+0000 7fec1250d640 1 --2- 172.21.15.132:0/1476724463 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7feaf803bba0 0x7feaf803e060 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fec08000c00 tx=0x7fec080013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.900+0000 7fec1350f640 1 --2- 172.21.15.132:0/1476724463 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x560135de03b0 0x560135ee01f0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.900+0000 7fec1350f640 1 -- 172.21.15.132:0/1476724463 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec0c00a4a0 con 0x560135de03b0 2024-05-08T18:51:07.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.900+0000 7fec15216800 1 -- 172.21.15.132:0/1476724463 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x560135edd7a0 con 0x560135de03b0 2024-05-08T18:51:07.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.900+0000 7fec1350f640 1 -- 172.21.15.132:0/1476724463 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec0c00a4a0 con 0x560135de03b0 2024-05-08T18:51:07.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.900+0000 7fec15216800 1 --2- 172.21.15.132:0/1476724463 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x560135ee2aa0 0x560135ee4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.900+0000 7fec15216800 1 -- 172.21.15.132:0/1476724463 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x560135ee5560 con 0x560135ee2aa0 2024-05-08T18:51:07.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.900+0000 7fec12d0e640 1 --2- 172.21.15.132:0/1476724463 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x560135ee2aa0 0x560135ee4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.901+0000 7fec12d0e640 1 --2- 172.21.15.132:0/1476724463 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x560135ee2aa0 0x560135ee4e90 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.901+0000 7fec12d0e640 1 -- 172.21.15.132:0/1476724463 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fec04078070 con 0x560135ee2aa0 2024-05-08T18:51:07.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.901+0000 7fec15216800 1 -- 172.21.15.132:0/1476724463 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x560135ee1940 con 0x560135de03b0 2024-05-08T18:51:07.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.901+0000 7fec1350f640 1 -- 172.21.15.132:0/1476724463 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec0c00a4a0 con 0x560135de03b0 2024-05-08T18:51:07.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.901+0000 7fec15216800 1 -- 172.21.15.132:0/1476724463 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x560135ee1de0 con 0x560135de03b0 2024-05-08T18:51:07.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.902+0000 7fec1350f640 1 -- 172.21.15.132:0/1476724463 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fec0c00a4a0 con 0x560135de03b0 2024-05-08T18:51:07.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.902+0000 7fec15216800 1 Processor -- start 2024-05-08T18:51:07.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.902+0000 7fec15216800 1 -- start start 2024-05-08T18:51:07.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.902+0000 7fec15216800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ef44c0 0x560135ef48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.902+0000 7fec15216800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560135cd1fc0 con 0x560135ef44c0 2024-05-08T18:51:07.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.902+0000 7fec1350f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ef44c0 0x560135ef48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.902+0000 7fec1350f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ef44c0 0x560135ef48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51434/0 (socket says 172.21.15.132:51434) 2024-05-08T18:51:07.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.902+0000 7fec1350f640 1 -- 172.21.15.132:0/792776177 learned_addr learned my addr 172.21.15.132:0/792776177 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.903+0000 7fec1350f640 1 -- 172.21.15.132:0/792776177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560135ef4e20 con 0x560135ef44c0 2024-05-08T18:51:07.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.903+0000 7fec1350f640 1 --2- 172.21.15.132:0/792776177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ef44c0 0x560135ef48e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x560135ee0b70 tx=0x7fec0c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.903+0000 7feafce01640 1 -- 172.21.15.132:0/792776177 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec0c014450 con 0x560135ef44c0 2024-05-08T18:51:07.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.903+0000 7feafce01640 1 -- 172.21.15.132:0/792776177 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec0c0145f0 con 0x560135ef44c0 2024-05-08T18:51:07.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.903+0000 7feafce01640 1 -- 172.21.15.132:0/792776177 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec0c014910 con 0x560135ef44c0 2024-05-08T18:51:07.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.903+0000 7fec15216800 1 -- 172.21.15.132:0/792776177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560135ef5890 con 0x560135ef44c0 2024-05-08T18:51:07.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.903+0000 7fec15216800 1 -- 172.21.15.132:0/792776177 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560135ef5d90 con 0x560135ef44c0 2024-05-08T18:51:07.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.904+0000 7feafce01640 1 -- 172.21.15.132:0/792776177 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fec0c011040 con 0x560135ef44c0 2024-05-08T18:51:07.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.904+0000 7feafce01640 1 --2- 172.21.15.132:0/792776177 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7feaec03bb50 0x7feaec03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.904+0000 7feafce01640 1 -- 172.21.15.132:0/792776177 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fec0c01e070 con 0x560135ef44c0 2024-05-08T18:51:07.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.904+0000 7fec12d0e640 1 --2- 172.21.15.132:0/792776177 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7feaec03bb50 0x7feaec03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.904+0000 7fec15216800 1 Processor -- start 2024-05-08T18:51:07.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.904+0000 7fec12d0e640 1 --2- 172.21.15.132:0/792776177 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7feaec03bb50 0x7feaec03e010 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x560135ee0c10 tx=0x7fec04092330 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.904+0000 7fec15216800 1 -- start start 2024-05-08T18:51:07.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.905+0000 7fec15216800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135f01850 0x560135f01c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.905+0000 7fec15216800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560135ed0d30 con 0x560135f01850 2024-05-08T18:51:07.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.905+0000 7fec1350f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135f01850 0x560135f01c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.905+0000 7fec1350f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135f01850 0x560135f01c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51436/0 (socket says 172.21.15.132:51436) 2024-05-08T18:51:07.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.905+0000 7fec1350f640 1 -- 172.21.15.132:0/2827273591 learned_addr learned my addr 172.21.15.132:0/2827273591 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.905+0000 7fec1350f640 1 -- 172.21.15.132:0/2827273591 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560135f02240 con 0x560135f01850 2024-05-08T18:51:07.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.905+0000 7fec1350f640 1 --2- 172.21.15.132:0/2827273591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135f01850 0x560135f01c70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fec0c052d00 tx=0x7fec0c014f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4020abbf4155aa96 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.905+0000 7feaf67fc640 1 -- 172.21.15.132:0/2827273591 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec0c011e60 con 0x560135f01850 2024-05-08T18:51:07.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.905+0000 7feaf67fc640 1 -- 172.21.15.132:0/2827273591 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec0c011330 con 0x560135f01850 2024-05-08T18:51:07.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.905+0000 7feaf67fc640 1 -- 172.21.15.132:0/2827273591 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec0c016960 con 0x560135f01850 2024-05-08T18:51:07.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.906+0000 7fec15216800 1 -- 172.21.15.132:0/2827273591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135f01850 msgr2=0x560135f01c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.906+0000 7fec15216800 1 --2- 172.21.15.132:0/2827273591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135f01850 0x560135f01c70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fec0c052d00 tx=0x7fec0c014f10 comp rx=0 tx=0).stop 2024-05-08T18:51:07.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.906+0000 7fec15216800 1 -- 172.21.15.132:0/2827273591 shutdown_connections 2024-05-08T18:51:07.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.906+0000 7fec15216800 1 --2- 172.21.15.132:0/2827273591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135f01850 0x560135f01c70 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.906+0000 7fec15216800 1 -- 172.21.15.132:0/2827273591 >> 172.21.15.132:0/2827273591 conn(0x560135efdb20 msgr2=0x560135efbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.906+0000 7fec15216800 1 -- 172.21.15.132:0/2827273591 shutdown_connections 2024-05-08T18:51:07.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.906+0000 7fec15216800 1 -- 172.21.15.132:0/2827273591 wait complete. 2024-05-08T18:51:07.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.906+0000 7fec15216800 1 Processor -- start 2024-05-08T18:51:07.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.906+0000 7fec15216800 1 -- start start 2024-05-08T18:51:07.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.906+0000 7fec15216800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135f01850 0x560135f08cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.906+0000 7fec15216800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560135f02990 con 0x560135f01850 2024-05-08T18:51:07.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.906+0000 7fec1350f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135f01850 0x560135f08cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.907+0000 7fec1350f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135f01850 0x560135f08cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51452/0 (socket says 172.21.15.132:51452) 2024-05-08T18:51:07.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.907+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 learned_addr learned my addr 172.21.15.132:0/2945974642 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:07.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.907+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560135f091f0 con 0x560135f01850 2024-05-08T18:51:07.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.907+0000 7fec1350f640 1 --2- 172.21.15.132:0/2945974642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135f01850 0x560135f08cb0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fec0c001700 tx=0x7fec0c052c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.907+0000 7feaf4ff9640 1 -- 172.21.15.132:0/2945974642 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec0c011e60 con 0x560135f01850 2024-05-08T18:51:07.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.907+0000 7feaf4ff9640 1 -- 172.21.15.132:0/2945974642 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec0c031030 con 0x560135f01850 2024-05-08T18:51:07.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.907+0000 7feaf4ff9640 1 -- 172.21.15.132:0/2945974642 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec0c001af0 con 0x560135f01850 2024-05-08T18:51:07.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.907+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560135f094e0 con 0x560135f01850 2024-05-08T18:51:07.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.907+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560135f0c130 con 0x560135f01850 2024-05-08T18:51:07.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.908+0000 7feaf4ff9640 1 -- 172.21.15.132:0/2945974642 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fec0c001c90 con 0x560135f01850 2024-05-08T18:51:07.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.908+0000 7feaf4ff9640 1 --2- 172.21.15.132:0/2945974642 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7feadc03bb50 0x7feadc03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.908+0000 7feaf4ff9640 1 -- 172.21.15.132:0/2945974642 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7fec0c00e040 con 0x560135f01850 2024-05-08T18:51:07.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.908+0000 7fec12d0e640 1 --2- 172.21.15.132:0/2945974642 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7feadc03bb50 0x7feadc03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.909+0000 7fec12d0e640 1 --2- 172.21.15.132:0/2945974642 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7feadc03bb50 0x7feadc03e010 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fec040926c0 tx=0x7fec04083000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.909+0000 7fec15216800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.909+0000 7fec15216800 1 --2- 172.21.15.132:0/2945974642 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x560135f14890 0x560135f16d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.909+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x560135f174a0 con 0x560135f14890 2024-05-08T18:51:07.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.909+0000 7fec1250d640 1 --2- 172.21.15.132:0/2945974642 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x560135f14890 0x560135f16d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.909+0000 7fec1250d640 1 --2- 172.21.15.132:0/2945974642 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x560135f14890 0x560135f16d50 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.909+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec0800f5f0 con 0x560135f14890 2024-05-08T18:51:07.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.909+0000 7fec15216800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.909+0000 7fec15216800 20 realm 2024-05-08T18:51:07.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.909+0000 7fec15216800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.909+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x560135f13ce0 con 0x560135f14890 2024-05-08T18:51:07.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.910+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec0800f5f0 con 0x560135f14890 2024-05-08T18:51:07.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.910+0000 7fec15216800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.910+0000 7fec15216800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:07.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.910+0000 7fec15216800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.910+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x560135f17f90 con 0x560135f14890 2024-05-08T18:51:07.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.910+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec0800f5f0 con 0x560135f14890 2024-05-08T18:51:07.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.910+0000 7fec15216800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.910+0000 7fec15216800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.910+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x560135f18860 con 0x560135f14890 2024-05-08T18:51:07.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.910+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec0800f5f0 con 0x560135f14890 2024-05-08T18:51:07.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.910+0000 7fec15216800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:07.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.910+0000 7fec15216800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.910+0000 7fec15216800 1 --2- 172.21.15.132:0/2945974642 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x560135f19280 0x560135f1b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.910+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x560135f1bde0 con 0x560135f19280 2024-05-08T18:51:07.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.910+0000 7fec1350f640 1 --2- 172.21.15.132:0/2945974642 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x560135f19280 0x560135f1b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.910+0000 7fec1350f640 1 --2- 172.21.15.132:0/2945974642 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x560135f19280 0x560135f1b670 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.911+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fec0c03d070 con 0x560135f19280 2024-05-08T18:51:07.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.911+0000 7fec15216800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:07.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.911+0000 7fec15216800 20 searching for the correct realm 2024-05-08T18:51:07.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.911+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x560135f19280 2024-05-08T18:51:07.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.911+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec0c03d070 con 0x560135f19280 2024-05-08T18:51:07.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.911+0000 7fec1350f640 1 --2- 172.21.15.132:0/2945974642 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fec0c014070 0x7fec0c0259c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.911+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x7fec0c014070 2024-05-08T18:51:07.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.911+0000 7fec12d0e640 1 --2- 172.21.15.132:0/2945974642 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fec0c014070 0x7fec0c0259c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.912+0000 7fec12d0e640 1 --2- 172.21.15.132:0/2945974642 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fec0c014070 0x7fec0c0259c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.912+0000 7fec12d0e640 1 -- 172.21.15.132:0/2945974642 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec04092070 con 0x7fec0c014070 2024-05-08T18:51:07.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.912+0000 7fec12d0e640 1 --2- 172.21.15.132:0/2945974642 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fec04089040 0x7fec0405b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:07.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.912+0000 7fec12d0e640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x7fec04089040 2024-05-08T18:51:07.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.912+0000 7fec1250d640 1 --2- 172.21.15.132:0/2945974642 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fec04089040 0x7fec0405b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:07.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.912+0000 7fec1250d640 1 --2- 172.21.15.132:0/2945974642 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fec04089040 0x7fec0405b370 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:07.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.913+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec0800f5f0 con 0x7fec04089040 2024-05-08T18:51:07.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.913+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x560135f14890 2024-05-08T18:51:07.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.913+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec0800f5f0 con 0x560135f14890 2024-05-08T18:51:07.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.913+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x560135f14890 2024-05-08T18:51:07.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.913+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec0802b040 con 0x560135f14890 2024-05-08T18:51:07.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.913+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x7fec04089040 2024-05-08T18:51:07.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.913+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec0802b040 con 0x7fec04089040 2024-05-08T18:51:07.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.913+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x7fec04089040 2024-05-08T18:51:07.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.914+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec0802b040 con 0x7fec04089040 2024-05-08T18:51:07.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.914+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x7fec0c014070 2024-05-08T18:51:07.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.914+0000 7fec12d0e640 1 -- 172.21.15.132:0/2945974642 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec04092070 con 0x7fec0c014070 2024-05-08T18:51:07.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.914+0000 7fec12d0e640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x560135f19280 2024-05-08T18:51:07.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.914+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec0c03d070 con 0x560135f19280 2024-05-08T18:51:07.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.914+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x560135f14890 2024-05-08T18:51:07.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.915+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec0802b040 con 0x560135f14890 2024-05-08T18:51:07.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.915+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x7fec04089040 2024-05-08T18:51:07.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.915+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec0802b040 con 0x7fec04089040 2024-05-08T18:51:07.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.915+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x560135f14890 2024-05-08T18:51:07.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.915+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fec0802b040 con 0x560135f14890 2024-05-08T18:51:07.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.915+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x7fec0c014070 2024-05-08T18:51:07.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.915+0000 7fec12d0e640 1 -- 172.21.15.132:0/2945974642 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fec04092070 con 0x7fec0c014070 2024-05-08T18:51:07.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.915+0000 7fec12d0e640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x560135f19280 2024-05-08T18:51:07.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.916+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fec0c03d070 con 0x560135f19280 2024-05-08T18:51:07.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.916+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x560135f19280 2024-05-08T18:51:07.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.916+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec0c03d070 con 0x560135f19280 2024-05-08T18:51:07.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.916+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x7fec04089040 2024-05-08T18:51:07.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.916+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec0802b040 con 0x7fec04089040 2024-05-08T18:51:07.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.916+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x560135f19280 2024-05-08T18:51:07.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.916+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec0c03d070 con 0x560135f19280 2024-05-08T18:51:07.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.916+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x560135f19280 2024-05-08T18:51:07.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.917+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec0c03d070 con 0x560135f19280 2024-05-08T18:51:07.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.917+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x560135f14890 2024-05-08T18:51:07.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.917+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec0802b040 con 0x560135f14890 2024-05-08T18:51:07.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.917+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x560135f14890 2024-05-08T18:51:07.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.917+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fec0802b040 con 0x560135f14890 2024-05-08T18:51:07.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.917+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x7fec04089040 2024-05-08T18:51:07.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.917+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec0802b040 con 0x7fec04089040 2024-05-08T18:51:07.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.917+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x560135f19280 2024-05-08T18:51:07.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.918+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec0c03d070 con 0x560135f19280 2024-05-08T18:51:07.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.918+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x7fec0c014070 2024-05-08T18:51:07.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.918+0000 7fec12d0e640 1 -- 172.21.15.132:0/2945974642 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec04092070 con 0x7fec0c014070 2024-05-08T18:51:07.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.918+0000 7fec12d0e640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x560135f14890 2024-05-08T18:51:07.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.918+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec0802b040 con 0x560135f14890 2024-05-08T18:51:07.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.918+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x7fec04089040 2024-05-08T18:51:07.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.918+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec0803b040 con 0x7fec04089040 2024-05-08T18:51:07.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.918+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x560135f19280 2024-05-08T18:51:07.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.919+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec0c03d070 con 0x560135f19280 2024-05-08T18:51:07.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.919+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x7fec04089040 2024-05-08T18:51:07.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.919+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec0803b040 con 0x7fec04089040 2024-05-08T18:51:07.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.919+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x7fec0c014070 2024-05-08T18:51:07.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.919+0000 7fec12d0e640 1 -- 172.21.15.132:0/2945974642 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec04092070 con 0x7fec0c014070 2024-05-08T18:51:07.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.919+0000 7fec12d0e640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x560135f19280 2024-05-08T18:51:07.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.919+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec0c03d070 con 0x560135f19280 2024-05-08T18:51:07.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.919+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x7fec04089040 2024-05-08T18:51:07.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.920+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec0803b040 con 0x7fec04089040 2024-05-08T18:51:07.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.920+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x560135f14890 2024-05-08T18:51:07.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.920+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fec0803b040 con 0x560135f14890 2024-05-08T18:51:07.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.920+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d710 con 0x7fec0c014070 2024-05-08T18:51:07.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.920+0000 7fec12d0e640 1 -- 172.21.15.132:0/2945974642 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec04092070 con 0x7fec0c014070 2024-05-08T18:51:07.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.920+0000 7fec15216800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:07.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.920+0000 7fec15216800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:07.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.920+0000 7fec15216800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:07.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.920+0000 7fec15216800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:07.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.920+0000 7fec15216800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:07.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.920+0000 7fec15216800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:07.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.920+0000 7fec15216800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.920+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x560135f1c7a0 con 0x560135f14890 2024-05-08T18:51:07.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.921+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec0803b040 con 0x560135f14890 2024-05-08T18:51:07.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.921+0000 7fec15216800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.921+0000 7fec15216800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.921+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x560135f1d040 con 0x560135f14890 2024-05-08T18:51:07.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.921+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec0803b040 con 0x560135f14890 2024-05-08T18:51:07.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.921+0000 7fec15216800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:07.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.921+0000 7fec15216800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.921+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x560135f1db90 con 0x560135f14890 2024-05-08T18:51:07.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.921+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fec0803b040 con 0x560135f14890 2024-05-08T18:51:07.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.921+0000 7fec15216800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:07.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.921+0000 7fec15216800 20 zone default found 2024-05-08T18:51:07.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.921+0000 7fec15216800 4 Realm: () 2024-05-08T18:51:07.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.921+0000 7fec15216800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:07.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.921+0000 7fec15216800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:07.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.921+0000 7fec15216800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:07.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.921+0000 7fec15216800 20 zonegroup default 2024-05-08T18:51:07.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.921+0000 7fec15216800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.921+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x560135f1db90 con 0x7fec04089040 2024-05-08T18:51:07.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.921+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fec0803b040 con 0x7fec04089040 2024-05-08T18:51:07.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.921+0000 7fec15216800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.921+0000 7fec15216800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.921+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x560135f1f960 con 0x560135f19280 2024-05-08T18:51:07.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.922+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec0c03d070 con 0x560135f19280 2024-05-08T18:51:07.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.922+0000 7fec15216800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.922+0000 7fec15216800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.922+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x560135f1fd50 con 0x560135f19280 2024-05-08T18:51:07.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.922+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec0c03d070 con 0x560135f19280 2024-05-08T18:51:07.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.922+0000 7fec15216800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:07.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.922+0000 7fec15216800 20 started sync module instance, tier type = 2024-05-08T18:51:07.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.922+0000 7fec15216800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:07.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.922+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f1ee00 con 0x7fec0c014070 2024-05-08T18:51:07.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.923+0000 7fec12d0e640 1 -- 172.21.15.132:0/2945974642 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec04092070 con 0x7fec0c014070 2024-05-08T18:51:07.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.923+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94563200002384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f201b0 con 0x7fec0c014070 2024-05-08T18:51:07.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.923+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f20a00 con 0x560135f14890 2024-05-08T18:51:07.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.924+0000 7fec12d0e640 1 -- 172.21.15.132:0/2945974642 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94563200002384] v25'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec04092070 con 0x7fec0c014070 2024-05-08T18:51:07.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.924+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec0803b040 con 0x560135f14890 2024-05-08T18:51:07.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.924+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94563200009552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f20e20 con 0x560135f14890 2024-05-08T18:51:07.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.924+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f216b0 con 0x560135f19280 2024-05-08T18:51:07.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.925+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94563200009552] v25'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec0803b040 con 0x560135f14890 2024-05-08T18:51:07.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.925+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec0c03d070 con 0x560135f19280 2024-05-08T18:51:07.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.925+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94563200010608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f21240 con 0x560135f19280 2024-05-08T18:51:07.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.925+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f22130 con 0x7fec0c014070 2024-05-08T18:51:07.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.926+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94563200010608] v25'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec0c03d070 con 0x560135f19280 2024-05-08T18:51:07.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.926+0000 7fec12d0e640 1 -- 172.21.15.132:0/2945974642 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec04092070 con 0x7fec0c014070 2024-05-08T18:51:07.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.926+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94563200011664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f211b0 con 0x7fec0c014070 2024-05-08T18:51:07.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.926+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f22ff0 con 0x560135f14890 2024-05-08T18:51:07.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.927+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec0803b040 con 0x560135f14890 2024-05-08T18:51:07.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.927+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94563200019744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f237b0 con 0x560135f14890 2024-05-08T18:51:07.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.927+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f242b0 con 0x7fec04089040 2024-05-08T18:51:07.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.927+0000 7fec12d0e640 1 -- 172.21.15.132:0/2945974642 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94563200011664] v25'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec04092070 con 0x7fec0c014070 2024-05-08T18:51:07.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.929+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec0803b040 con 0x7fec04089040 2024-05-08T18:51:07.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.929+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94563200023968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f24270 con 0x7fec04089040 2024-05-08T18:51:07.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.929+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f24c90 con 0x7fec04089040 2024-05-08T18:51:07.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.929+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94563200019744] v25'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec0803b040 con 0x560135f14890 2024-05-08T18:51:07.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.929+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94563200023968] v25'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec0803b040 con 0x7fec04089040 2024-05-08T18:51:07.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.930+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec0803b040 con 0x7fec04089040 2024-05-08T18:51:07.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.930+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94563200017696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f23200 con 0x7fec04089040 2024-05-08T18:51:07.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.930+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f25270 con 0x7fec04089040 2024-05-08T18:51:07.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.931+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(58 notify.7 [create] v25'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec0803b040 con 0x7fec04089040 2024-05-08T18:51:07.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.931+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94563200028096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f25690 con 0x7fec04089040 2024-05-08T18:51:07.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.931+0000 7fec15216800 20 add_watcher() i=0 2024-05-08T18:51:07.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.931+0000 7fec15216800 20 add_watcher() i=1 2024-05-08T18:51:07.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.931+0000 7fec15216800 20 add_watcher() i=2 2024-05-08T18:51:07.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.931+0000 7fec15216800 20 add_watcher() i=3 2024-05-08T18:51:07.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.931+0000 7fec15216800 20 add_watcher() i=4 2024-05-08T18:51:07.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.931+0000 7fec15216800 20 add_watcher() i=5 2024-05-08T18:51:07.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.931+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94563200017696] v25'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec0803b040 con 0x7fec04089040 2024-05-08T18:51:07.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.931+0000 7fec15216800 20 add_watcher() i=6 2024-05-08T18:51:07.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.932+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94563200028096] v25'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec0803b040 con 0x7fec04089040 2024-05-08T18:51:07.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.932+0000 7fec15216800 20 add_watcher() i=7 2024-05-08T18:51:07.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.932+0000 7fec15216800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:07.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.932+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x560135f25690 con 0x560135f14890 2024-05-08T18:51:07.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.932+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fec0803b040 con 0x560135f14890 2024-05-08T18:51:07.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.932+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94563200029152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f25600 con 0x560135f14890 2024-05-08T18:51:07.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.933+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94563200029152] v25'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec0803b040 con 0x560135f14890 2024-05-08T18:51:07.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.933+0000 7feac97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:07.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.933+0000 7fec15216800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:07.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.933+0000 7fec15216800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:07.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.933+0000 7fec15216800 5 note: GC not initialized 2024-05-08T18:51:07.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.934+0000 7fea43fff640 20 reqs_thread_entry: start 2024-05-08T18:51:07.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.934+0000 7fec15216800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:07.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.934+0000 7fec15216800 20 Filter name: none 2024-05-08T18:51:07.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.934+0000 7fea41ffb640 20 reqs_thread_entry: start 2024-05-08T18:51:07.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.934+0000 7fec15216800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:51:07.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.934+0000 7fec15216800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.934+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x560135f5c180 con 0x7fec0c014070 2024-05-08T18:51:07.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.934+0000 7fec12d0e640 1 -- 172.21.15.132:0/2945974642 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fec04092070 con 0x7fec0c014070 2024-05-08T18:51:07.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.934+0000 7fec15216800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:51:07.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.934+0000 7fec15216800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:51:07.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.934+0000 7fec15216800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:51:07.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.934+0000 7fec15216800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5 : miss 2024-05-08T18:51:07.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.934+0000 7fec15216800 20 rados->read ofs=0 len=0 2024-05-08T18:51:07.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.934+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 8.c 8:354450c5:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x560135f5dc40 con 0x560135f14890 2024-05-08T18:51:07.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.935+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(63 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fec0803b040 con 0x560135f14890 2024-05-08T18:51:07.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.935+0000 7fec15216800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:51:07.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.935+0000 7fec15216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5 info.flags=0x17 2024-05-08T18:51:07.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.935+0000 7fec15216800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5 to cache LRU end 2024-05-08T18:51:07.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.935+0000 7fec15216800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:51:07.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.935+0000 7fec15216800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:51:07.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.935+0000 7fec15216800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5 2024-05-08T18:51:07.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.935+0000 7fec15216800 20 get_obj_state: octx=0x7fec0800f570 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x560135f60308 s->prefetch_data=0 2024-05-08T18:51:07.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.935+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 3.37 3:ec595fd8:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x560135f613e0 con 0x560135f14890 2024-05-08T18:51:07.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.935+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7fec0803b040 con 0x560135f14890 2024-05-08T18:51:07.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.935+0000 7fec15216800 10 manifest: total_size = 5 2024-05-08T18:51:07.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.935+0000 7fec15216800 20 get_obj_state: setting s->obj_tag to _AAsxvirZTaooHbB9fQG0zioRMd7sQbf 2024-05-08T18:51:07.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.936+0000 7feac97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:07.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.936+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94563200029152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f613e0 con 0x560135f14890 2024-05-08T18:51:07.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.937+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94563200029152] v25'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec0803b040 con 0x560135f14890 2024-05-08T18:51:07.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.937+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94563200002384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f613e0 con 0x7fec0c014070 2024-05-08T18:51:07.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.938+0000 7fec12d0e640 1 -- 172.21.15.132:0/2945974642 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94563200002384] v25'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec04092070 con 0x7fec0c014070 2024-05-08T18:51:07.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.938+0000 7fec15216800 20 remove_watcher() i=0 2024-05-08T18:51:07.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.938+0000 7fec15216800 2 removed watcher, disabling cache 2024-05-08T18:51:07.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.938+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94563200009552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f613e0 con 0x560135f14890 2024-05-08T18:51:07.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.939+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94563200009552] v25'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec0803b040 con 0x560135f14890 2024-05-08T18:51:07.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.939+0000 7fec15216800 20 remove_watcher() i=1 2024-05-08T18:51:07.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.939+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94563200010608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f613e0 con 0x560135f19280 2024-05-08T18:51:07.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.940+0000 7fec1350f640 1 -- 172.21.15.132:0/2945974642 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94563200010608] v25'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec0c03d070 con 0x560135f19280 2024-05-08T18:51:07.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.940+0000 7fec15216800 20 remove_watcher() i=2 2024-05-08T18:51:07.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.940+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94563200011664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f613e0 con 0x7fec0c014070 2024-05-08T18:51:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.941+0000 7fec12d0e640 1 -- 172.21.15.132:0/2945974642 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94563200011664] v25'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec04092070 con 0x7fec0c014070 2024-05-08T18:51:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.941+0000 7fec15216800 20 remove_watcher() i=3 2024-05-08T18:51:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.941+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94563200019744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f613e0 con 0x560135f14890 2024-05-08T18:51:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.942+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94563200019744] v25'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec0803b040 con 0x560135f14890 2024-05-08T18:51:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.942+0000 7fec15216800 20 remove_watcher() i=4 2024-05-08T18:51:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.942+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94563200023968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f613e0 con 0x7fec04089040 2024-05-08T18:51:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.943+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94563200023968] v25'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec0803b040 con 0x7fec04089040 2024-05-08T18:51:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.943+0000 7fec15216800 20 remove_watcher() i=5 2024-05-08T18:51:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.943+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94563200017696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f613e0 con 0x7fec04089040 2024-05-08T18:51:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.944+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94563200017696] v25'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec0803b040 con 0x7fec04089040 2024-05-08T18:51:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.944+0000 7fec15216800 20 remove_watcher() i=6 2024-05-08T18:51:07.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.944+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94563200028096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x560135f613e0 con 0x7fec04089040 2024-05-08T18:51:07.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.945+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94563200028096] v25'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec0803b040 con 0x7fec04089040 2024-05-08T18:51:07.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.945+0000 7fec15216800 20 remove_watcher() i=7 2024-05-08T18:51:07.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.945+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fec04089040 msgr2=0x7fec0405b370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.945+0000 7fec15216800 1 --2- 172.21.15.132:0/2945974642 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fec04089040 0x7fec0405b370 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.945+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x560135f14890 msgr2=0x560135f16d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.945+0000 7fec15216800 1 --2- 172.21.15.132:0/2945974642 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x560135f14890 0x560135f16d50 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.945+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fec0c014070 msgr2=0x7fec0c0259c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.945+0000 7fec15216800 1 --2- 172.21.15.132:0/2945974642 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fec0c014070 0x7fec0c0259c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.945+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x560135f19280 msgr2=0x560135f1b670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.945+0000 7fec15216800 1 --2- 172.21.15.132:0/2945974642 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x560135f19280 0x560135f1b670 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.945+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7feadc03bb50 msgr2=0x7feadc03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.945+0000 7fec15216800 1 --2- 172.21.15.132:0/2945974642 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7feadc03bb50 0x7feadc03e010 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fec040926c0 tx=0x7fec04083000 comp rx=0 tx=0).stop 2024-05-08T18:51:07.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.945+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135f01850 msgr2=0x560135f08cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.945+0000 7fec15216800 1 --2- 172.21.15.132:0/2945974642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135f01850 0x560135f08cb0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fec0c001700 tx=0x7fec0c052c60 comp rx=0 tx=0).stop 2024-05-08T18:51:07.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.945+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 reap_dead start 2024-05-08T18:51:07.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.945+0000 7fec1250d640 1 -- 172.21.15.132:0/2945974642 reap_dead start 2024-05-08T18:51:07.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.945+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 shutdown_connections 2024-05-08T18:51:07.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.945+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 >> 172.21.15.132:0/2945974642 conn(0x560135efdb20 msgr2=0x560135efb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 shutdown_connections 2024-05-08T18:51:07.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 -- 172.21.15.132:0/2945974642 wait complete. 2024-05-08T18:51:07.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 -- 172.21.15.132:0/792776177 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7feaec03bb50 msgr2=0x7feaec03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 --2- 172.21.15.132:0/792776177 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7feaec03bb50 0x7feaec03e010 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x560135ee0c10 tx=0x7fec04092330 comp rx=0 tx=0).stop 2024-05-08T18:51:07.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 -- 172.21.15.132:0/792776177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ef44c0 msgr2=0x560135ef48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 --2- 172.21.15.132:0/792776177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ef44c0 0x560135ef48e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x560135ee0b70 tx=0x7fec0c018830 comp rx=0 tx=0).stop 2024-05-08T18:51:07.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 -- 172.21.15.132:0/792776177 shutdown_connections 2024-05-08T18:51:07.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 --2- 172.21.15.132:0/792776177 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7feaec03bb50 0x7feaec03e010 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 --2- 172.21.15.132:0/792776177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ef44c0 0x560135ef48e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 -- 172.21.15.132:0/792776177 >> 172.21.15.132:0/792776177 conn(0x560135ee8560 msgr2=0x560135ee8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 -- 172.21.15.132:0/792776177 shutdown_connections 2024-05-08T18:51:07.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 -- 172.21.15.132:0/792776177 wait complete. 2024-05-08T18:51:07.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 -- 172.21.15.132:0/1476724463 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x560135de03b0 msgr2=0x560135ee01f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 --2- 172.21.15.132:0/1476724463 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x560135de03b0 0x560135ee01f0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 -- 172.21.15.132:0/1476724463 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x560135ee2aa0 msgr2=0x560135ee4e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 --2- 172.21.15.132:0/1476724463 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x560135ee2aa0 0x560135ee4e90 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 -- 172.21.15.132:0/1476724463 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7feaf803bba0 msgr2=0x7feaf803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 --2- 172.21.15.132:0/1476724463 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7feaf803bba0 0x7feaf803e060 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fec08000c00 tx=0x7fec080013b0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 -- 172.21.15.132:0/1476724463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ddf150 msgr2=0x560135d53310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 --2- 172.21.15.132:0/1476724463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ddf150 0x560135d53310 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fec04060040 tx=0x7fec04002fb0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 -- 172.21.15.132:0/1476724463 shutdown_connections 2024-05-08T18:51:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 --2- 172.21.15.132:0/1476724463 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x560135ee2aa0 0x560135ee4e90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 --2- 172.21.15.132:0/1476724463 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x560135de03b0 0x560135ee01f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 --2- 172.21.15.132:0/1476724463 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7feaf803bba0 0x7feaf803e060 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 --2- 172.21.15.132:0/1476724463 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560135ddf150 0x560135d53310 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 -- 172.21.15.132:0/1476724463 >> 172.21.15.132:0/1476724463 conn(0x560135dda730 msgr2=0x560135eca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 -- 172.21.15.132:0/1476724463 shutdown_connections 2024-05-08T18:51:07.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:07.946+0000 7fec15216800 1 -- 172.21.15.132:0/1476724463 wait complete. 2024-05-08T18:51:07.957 INFO:teuthology.orchestra.run.smithi132.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-05-08T18:51:07.957 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-05-08T18:51:07.960 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-05-08T18:51:07.975 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:51:08.030 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-05-08T18:51:08.031 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-05-08T18:51:08.031 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-08T18:51:08.031 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-05-08T18:51:08.031 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-05-08T18:51:08.031 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-05-08T18:51:08.032 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-05-08T18:51:08.077 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:08.077 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:08.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.079+0000 7f559300f800 1 Processor -- start 2024-05-08T18:51:08.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.079+0000 7f559300f800 1 -- start start 2024-05-08T18:51:08.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.079+0000 7f559300f800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55d39f88bce0 0x55d39f88e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.079+0000 7f559300f800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d39f892120 con 0x55d39f88e610 2024-05-08T18:51:08.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.079+0000 7f559300f800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55d39f72be20 con 0x55d39f88bce0 2024-05-08T18:51:08.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.079+0000 7f558e60d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55d39f88bce0 0x55d39f88e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.079+0000 7f558e60d640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55d39f88bce0 0x55d39f88e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51466/0 (socket says 172.21.15.132:51466) 2024-05-08T18:51:08.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.079+0000 7f558e60d640 1 -- 172.21.15.132:0/1977022455 learned_addr learned my addr 172.21.15.132:0/1977022455 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:08.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.079+0000 7f558de0c640 1 --1- 172.21.15.132:0/1977022455 >> v1:172.21.15.42:6789/0 conn(0x55d39f88e610 0x55d39f890a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:55722/0 (socket says 172.21.15.132:55722) 2024-05-08T18:51:08.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.080+0000 7f558e60d640 1 -- 172.21.15.132:0/1977022455 >> v1:172.21.15.42:6789/0 conn(0x55d39f88e610 legacy=0x55d39f890a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.080+0000 7f558e60d640 1 -- 172.21.15.132:0/1977022455 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d39f893300 con 0x55d39f88bce0 2024-05-08T18:51:08.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.080+0000 7f558d60b640 1 -- 172.21.15.132:0/1977022455 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 784028636 0 0) 0x55d39f892120 con 0x55d39f88e610 2024-05-08T18:51:08.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.081+0000 7f558e60d640 1 --2- 172.21.15.132:0/1977022455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f88bce0 0x55d39f88e0d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5588005fd0 tx=0x7f558801cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cb80ca77bc2c54 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.082+0000 7f558d60b640 1 -- 172.21.15.132:0/1977022455 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5588052540 con 0x55d39f88bce0 2024-05-08T18:51:08.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.082+0000 7f558d60b640 1 -- 172.21.15.132:0/1977022455 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f558804e070 con 0x55d39f88bce0 2024-05-08T18:51:08.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.082+0000 7f558d60b640 1 -- 172.21.15.132:0/1977022455 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5588052890 con 0x55d39f88bce0 2024-05-08T18:51:08.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.082+0000 7f559300f800 1 -- 172.21.15.132:0/1977022455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f88bce0 msgr2=0x55d39f88e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.082+0000 7f559300f800 1 --2- 172.21.15.132:0/1977022455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f88bce0 0x55d39f88e0d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5588005fd0 tx=0x7f558801cd80 comp rx=0 tx=0).stop 2024-05-08T18:51:08.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.082+0000 7f559300f800 1 -- 172.21.15.132:0/1977022455 shutdown_connections 2024-05-08T18:51:08.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.082+0000 7f559300f800 1 --2- 172.21.15.132:0/1977022455 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f88bce0 0x55d39f88e0d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.082+0000 7f559300f800 1 -- 172.21.15.132:0/1977022455 >> 172.21.15.132:0/1977022455 conn(0x55d39f885730 msgr2=0x55d39f887b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.082+0000 7f559300f800 1 -- 172.21.15.132:0/1977022455 shutdown_connections 2024-05-08T18:51:08.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.082+0000 7f559300f800 1 -- 172.21.15.132:0/1977022455 wait complete. 2024-05-08T18:51:08.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.095+0000 7f559300f800 1 Processor -- start 2024-05-08T18:51:08.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.096+0000 7f559300f800 1 -- start start 2024-05-08T18:51:08.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.096+0000 7f559300f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f88bce0 0x55d39f97c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.096+0000 7f559300f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d39f7d65c0 con 0x55d39f88bce0 2024-05-08T18:51:08.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.096+0000 7f558e60d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f88bce0 0x55d39f97c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.096+0000 7f558e60d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f88bce0 0x55d39f97c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51478/0 (socket says 172.21.15.132:51478) 2024-05-08T18:51:08.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.096+0000 7f558e60d640 1 -- 172.21.15.132:0/1161868893 learned_addr learned my addr 172.21.15.132:0/1161868893 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:08.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.096+0000 7f558e60d640 1 -- 172.21.15.132:0/1161868893 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d39f97ca10 con 0x55d39f88bce0 2024-05-08T18:51:08.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.097+0000 7f558e60d640 1 --2- 172.21.15.132:0/1161868893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f88bce0 0x55d39f97c440 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f558801ba70 tx=0x7f558804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659e3c99d8c1c159 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.097+0000 7f547c608640 1 -- 172.21.15.132:0/1161868893 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55880528e0 con 0x55d39f88bce0 2024-05-08T18:51:08.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.097+0000 7f547c608640 1 -- 172.21.15.132:0/1161868893 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5588062070 con 0x55d39f88bce0 2024-05-08T18:51:08.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.097+0000 7f547c608640 1 -- 172.21.15.132:0/1161868893 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5588052bd0 con 0x55d39f88bce0 2024-05-08T18:51:08.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.097+0000 7f559300f800 1 -- 172.21.15.132:0/1161868893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f88bce0 msgr2=0x55d39f97c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.097+0000 7f559300f800 1 --2- 172.21.15.132:0/1161868893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f88bce0 0x55d39f97c440 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f558801ba70 tx=0x7f558804c000 comp rx=0 tx=0).stop 2024-05-08T18:51:08.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.097+0000 7f559300f800 1 -- 172.21.15.132:0/1161868893 shutdown_connections 2024-05-08T18:51:08.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.097+0000 7f559300f800 1 --2- 172.21.15.132:0/1161868893 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f88bce0 0x55d39f97c440 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.098+0000 7f559300f800 1 -- 172.21.15.132:0/1161868893 >> 172.21.15.132:0/1161868893 conn(0x55d39f885730 msgr2=0x55d39f977d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.098+0000 7f559300f800 1 -- 172.21.15.132:0/1161868893 shutdown_connections 2024-05-08T18:51:08.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.098+0000 7f559300f800 1 -- 172.21.15.132:0/1161868893 wait complete. 2024-05-08T18:51:08.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.098+0000 7f559300f800 1 Processor -- start 2024-05-08T18:51:08.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.098+0000 7f559300f800 1 -- start start 2024-05-08T18:51:08.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.098+0000 7f559300f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f88bce0 0x55d39f983ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.098+0000 7f559300f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d39f8925f0 con 0x55d39f88bce0 2024-05-08T18:51:08.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.098+0000 7f558e60d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f88bce0 0x55d39f983ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.098+0000 7f558e60d640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f88bce0 0x55d39f983ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51486/0 (socket says 172.21.15.132:51486) 2024-05-08T18:51:08.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.098+0000 7f558e60d640 1 -- 172.21.15.132:0/788634758 learned_addr learned my addr 172.21.15.132:0/788634758 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:08.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.099+0000 7f558e60d640 1 -- 172.21.15.132:0/788634758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d39f984430 con 0x55d39f88bce0 2024-05-08T18:51:08.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.099+0000 7f558e60d640 1 --2- 172.21.15.132:0/788634758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f88bce0 0x55d39f983ef0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f558801ba70 tx=0x7f5588003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.099+0000 7f547ae05640 1 -- 172.21.15.132:0/788634758 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f558805d630 con 0x55d39f88bce0 2024-05-08T18:51:08.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.099+0000 7f547ae05640 1 -- 172.21.15.132:0/788634758 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5588058040 con 0x55d39f88bce0 2024-05-08T18:51:08.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.099+0000 7f547ae05640 1 -- 172.21.15.132:0/788634758 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f558805d980 con 0x55d39f88bce0 2024-05-08T18:51:08.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.099+0000 7f559300f800 1 -- 172.21.15.132:0/788634758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d39f9846c0 con 0x55d39f88bce0 2024-05-08T18:51:08.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.099+0000 7f559300f800 1 -- 172.21.15.132:0/788634758 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d39f987370 con 0x55d39f88bce0 2024-05-08T18:51:08.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.100+0000 7f547ae05640 1 -- 172.21.15.132:0/788634758 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5588050070 con 0x55d39f88bce0 2024-05-08T18:51:08.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.100+0000 7f547ae05640 1 --2- 172.21.15.132:0/788634758 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f547403bba0 0x7f547403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.100+0000 7f547ae05640 1 -- 172.21.15.132:0/788634758 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f5588094740 con 0x55d39f88bce0 2024-05-08T18:51:08.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.100+0000 7f558de0c640 1 --2- 172.21.15.132:0/788634758 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f547403bba0 0x7f547403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.100+0000 7f559300f800 1 --2- 172.21.15.132:0/788634758 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d39f88e610 0x55d39f98b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.100+0000 7f559300f800 1 -- 172.21.15.132:0/788634758 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39f98b670 con 0x55d39f88e610 2024-05-08T18:51:08.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.100+0000 7f558ee0e640 1 --2- 172.21.15.132:0/788634758 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d39f88e610 0x55d39f98b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.100+0000 7f558de0c640 1 --2- 172.21.15.132:0/788634758 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f547403bba0 0x7f547403e060 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5578000c00 tx=0x7f55780013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.101+0000 7f558ee0e640 1 --2- 172.21.15.132:0/788634758 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d39f88e610 0x55d39f98b130 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.101+0000 7f558ee0e640 1 -- 172.21.15.132:0/788634758 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55800083e0 con 0x55d39f88e610 2024-05-08T18:51:08.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.101+0000 7f559300f800 1 -- 172.21.15.132:0/788634758 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9886c0 con 0x55d39f88e610 2024-05-08T18:51:08.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.101+0000 7f558ee0e640 1 -- 172.21.15.132:0/788634758 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55800083e0 con 0x55d39f88e610 2024-05-08T18:51:08.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.101+0000 7f559300f800 1 --2- 172.21.15.132:0/788634758 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d39f98d940 0x55d39f98fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.101+0000 7f559300f800 1 -- 172.21.15.132:0/788634758 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9903d0 con 0x55d39f98d940 2024-05-08T18:51:08.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.101+0000 7f558e60d640 1 --2- 172.21.15.132:0/788634758 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d39f98d940 0x55d39f98fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.102+0000 7f558e60d640 1 --2- 172.21.15.132:0/788634758 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d39f98d940 0x55d39f98fd30 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.102+0000 7f558e60d640 1 -- 172.21.15.132:0/788634758 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5588077020 con 0x55d39f98d940 2024-05-08T18:51:08.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.102+0000 7f559300f800 1 -- 172.21.15.132:0/788634758 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39f98c7e0 con 0x55d39f88e610 2024-05-08T18:51:08.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.102+0000 7f558ee0e640 1 -- 172.21.15.132:0/788634758 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55800083e0 con 0x55d39f88e610 2024-05-08T18:51:08.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.102+0000 7f559300f800 1 -- 172.21.15.132:0/788634758 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39f98ccc0 con 0x55d39f88e610 2024-05-08T18:51:08.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.102+0000 7f558ee0e640 1 -- 172.21.15.132:0/788634758 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f55800083e0 con 0x55d39f88e610 2024-05-08T18:51:08.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.103+0000 7f559300f800 1 Processor -- start 2024-05-08T18:51:08.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.103+0000 7f559300f800 1 -- start start 2024-05-08T18:51:08.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.103+0000 7f559300f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f99f390 0x55d39f99f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.103+0000 7f559300f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d39f77cfc0 con 0x55d39f99f390 2024-05-08T18:51:08.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.103+0000 7f558ee0e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f99f390 0x55d39f99f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.103+0000 7f558ee0e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f99f390 0x55d39f99f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51488/0 (socket says 172.21.15.132:51488) 2024-05-08T18:51:08.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.103+0000 7f558ee0e640 1 -- 172.21.15.132:0/1936131345 learned_addr learned my addr 172.21.15.132:0/1936131345 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:08.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.103+0000 7f558ee0e640 1 -- 172.21.15.132:0/1936131345 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d39f99fcf0 con 0x55d39f99f390 2024-05-08T18:51:08.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.104+0000 7f558ee0e640 1 --2- 172.21.15.132:0/1936131345 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f99f390 0x55d39f99f7b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x55d39f988650 tx=0x7f558000aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.104+0000 7f5473fff640 1 -- 172.21.15.132:0/1936131345 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5580007d00 con 0x55d39f99f390 2024-05-08T18:51:08.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.104+0000 7f5473fff640 1 -- 172.21.15.132:0/1936131345 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f558001e020 con 0x55d39f99f390 2024-05-08T18:51:08.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.104+0000 7f559300f800 1 -- 172.21.15.132:0/1936131345 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d39f9a0760 con 0x55d39f99f390 2024-05-08T18:51:08.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.104+0000 7f5473fff640 1 -- 172.21.15.132:0/1936131345 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5580019420 con 0x55d39f99f390 2024-05-08T18:51:08.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.104+0000 7f559300f800 1 -- 172.21.15.132:0/1936131345 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d39f9a0c60 con 0x55d39f99f390 2024-05-08T18:51:08.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.105+0000 7f5473fff640 1 -- 172.21.15.132:0/1936131345 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5580016040 con 0x55d39f99f390 2024-05-08T18:51:08.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.105+0000 7f5473fff640 1 --2- 172.21.15.132:0/1936131345 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f546803bba0 0x7f546803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.105+0000 7f5473fff640 1 -- 172.21.15.132:0/1936131345 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f558001f030 con 0x55d39f99f390 2024-05-08T18:51:08.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.105+0000 7f558e60d640 1 --2- 172.21.15.132:0/1936131345 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f546803bba0 0x7f546803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.105+0000 7f559300f800 1 Processor -- start 2024-05-08T18:51:08.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.105+0000 7f559300f800 1 -- start start 2024-05-08T18:51:08.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.105+0000 7f558e60d640 1 --2- 172.21.15.132:0/1936131345 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f546803bba0 0x7f546803e060 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55d39f98ba70 tx=0x7f55880515e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.105+0000 7f559300f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f9ac6b0 0x55d39f9acad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.105+0000 7f559300f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d39f97ccd0 con 0x55d39f9ac6b0 2024-05-08T18:51:08.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.106+0000 7f558ee0e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f9ac6b0 0x55d39f9acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.106+0000 7f558ee0e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f9ac6b0 0x55d39f9acad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51498/0 (socket says 172.21.15.132:51498) 2024-05-08T18:51:08.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.106+0000 7f558ee0e640 1 -- 172.21.15.132:0/1038978506 learned_addr learned my addr 172.21.15.132:0/1038978506 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:08.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.106+0000 7f558ee0e640 1 -- 172.21.15.132:0/1038978506 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d39f9ad0a0 con 0x55d39f9ac6b0 2024-05-08T18:51:08.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.106+0000 7f558ee0e640 1 --2- 172.21.15.132:0/1038978506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f9ac6b0 0x55d39f9acad0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5580052c10 tx=0x7f5580017b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5509809c7190a090 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.106+0000 7f5471ffb640 1 -- 172.21.15.132:0/1038978506 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f558001d070 con 0x55d39f9ac6b0 2024-05-08T18:51:08.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.106+0000 7f5471ffb640 1 -- 172.21.15.132:0/1038978506 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5580014d50 con 0x55d39f9ac6b0 2024-05-08T18:51:08.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.106+0000 7f5471ffb640 1 -- 172.21.15.132:0/1038978506 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55800184e0 con 0x55d39f9ac6b0 2024-05-08T18:51:08.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.107+0000 7f559300f800 1 -- 172.21.15.132:0/1038978506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f9ac6b0 msgr2=0x55d39f9acad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.107+0000 7f559300f800 1 --2- 172.21.15.132:0/1038978506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f9ac6b0 0x55d39f9acad0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5580052c10 tx=0x7f5580017b10 comp rx=0 tx=0).stop 2024-05-08T18:51:08.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.107+0000 7f559300f800 1 -- 172.21.15.132:0/1038978506 shutdown_connections 2024-05-08T18:51:08.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.107+0000 7f559300f800 1 --2- 172.21.15.132:0/1038978506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f9ac6b0 0x55d39f9acad0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.107+0000 7f559300f800 1 -- 172.21.15.132:0/1038978506 >> 172.21.15.132:0/1038978506 conn(0x55d39f9a8a10 msgr2=0x55d39f9a6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.107+0000 7f559300f800 1 -- 172.21.15.132:0/1038978506 shutdown_connections 2024-05-08T18:51:08.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.107+0000 7f559300f800 1 -- 172.21.15.132:0/1038978506 wait complete. 2024-05-08T18:51:08.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.107+0000 7f559300f800 1 Processor -- start 2024-05-08T18:51:08.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.107+0000 7f559300f800 1 -- start start 2024-05-08T18:51:08.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.107+0000 7f559300f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f9ac6b0 0x55d39f9b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.107+0000 7f559300f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d39f9ad810 con 0x55d39f9ac6b0 2024-05-08T18:51:08.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.107+0000 7f558ee0e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f9ac6b0 0x55d39f9b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.107+0000 7f558ee0e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f9ac6b0 0x55d39f9b3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51504/0 (socket says 172.21.15.132:51504) 2024-05-08T18:51:08.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.107+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 learned_addr learned my addr 172.21.15.132:0/2724369961 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:08.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.108+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d39f9b41f0 con 0x55d39f9ac6b0 2024-05-08T18:51:08.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.108+0000 7f558ee0e640 1 --2- 172.21.15.132:0/2724369961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f9ac6b0 0x55d39f9b3cb0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5580017b50 tx=0x7f5580052b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.108+0000 7f545ffff640 1 -- 172.21.15.132:0/2724369961 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5580030070 con 0x55d39f9ac6b0 2024-05-08T18:51:08.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.108+0000 7f545ffff640 1 -- 172.21.15.132:0/2724369961 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55800541c0 con 0x55d39f9ac6b0 2024-05-08T18:51:08.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.108+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d39f9b4480 con 0x55d39f9ac6b0 2024-05-08T18:51:08.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.108+0000 7f545ffff640 1 -- 172.21.15.132:0/2724369961 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55800544a0 con 0x55d39f9ac6b0 2024-05-08T18:51:08.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.108+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d39f9b4480 con 0x55d39f9ac6b0 2024-05-08T18:51:08.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.109+0000 7f545ffff640 1 -- 172.21.15.132:0/2724369961 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5580033070 con 0x55d39f9ac6b0 2024-05-08T18:51:08.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.109+0000 7f545ffff640 1 --2- 172.21.15.132:0/2724369961 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f545803bb50 0x7f545803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.109+0000 7f545ffff640 1 -- 172.21.15.132:0/2724369961 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f5580036b00 con 0x55d39f9ac6b0 2024-05-08T18:51:08.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.109+0000 7f558e60d640 1 --2- 172.21.15.132:0/2724369961 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f545803bb50 0x7f545803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.109+0000 7f558e60d640 1 --2- 172.21.15.132:0/2724369961 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f545803bb50 0x7f545803e010 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f55880449b0 tx=0x7f5588087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.110+0000 7f559300f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.110+0000 7f559300f800 1 --2- 172.21.15.132:0/2724369961 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d39f9bf590 0x55d39f9c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.110+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c21a0 con 0x55d39f9bf590 2024-05-08T18:51:08.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.110+0000 7f558de0c640 1 --2- 172.21.15.132:0/2724369961 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d39f9bf590 0x55d39f9c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.110+0000 7f558de0c640 1 --2- 172.21.15.132:0/2724369961 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d39f9bf590 0x55d39f9c1a50 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.110+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f557800f5f0 con 0x55d39f9bf590 2024-05-08T18:51:08.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.110+0000 7f559300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.110+0000 7f559300f800 20 realm 2024-05-08T18:51:08.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.110+0000 7f559300f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.110+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9be9e0 con 0x55d39f9bf590 2024-05-08T18:51:08.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.110+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f557800f5f0 con 0x55d39f9bf590 2024-05-08T18:51:08.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.110+0000 7f559300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.110+0000 7f559300f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:08.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.110+0000 7f559300f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.110+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c2c90 con 0x55d39f9bf590 2024-05-08T18:51:08.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.111+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f557800f5f0 con 0x55d39f9bf590 2024-05-08T18:51:08.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.111+0000 7f559300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.111+0000 7f559300f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.111+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c3560 con 0x55d39f9bf590 2024-05-08T18:51:08.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.111+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f557800f5f0 con 0x55d39f9bf590 2024-05-08T18:51:08.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.111+0000 7f559300f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:08.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.111+0000 7f559300f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.111+0000 7f559300f800 1 --2- 172.21.15.132:0/2724369961 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d39f9c3f80 0x55d39f9c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.111+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c6ae0 con 0x55d39f9c3f80 2024-05-08T18:51:08.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.111+0000 7f558ee0e640 1 --2- 172.21.15.132:0/2724369961 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d39f9c3f80 0x55d39f9c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.111+0000 7f558ee0e640 1 --2- 172.21.15.132:0/2724369961 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d39f9c3f80 0x55d39f9c6370 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.111+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f558003c070 con 0x55d39f9c3f80 2024-05-08T18:51:08.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.112+0000 7f559300f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:08.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.112+0000 7f559300f800 20 searching for the correct realm 2024-05-08T18:51:08.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.112+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x55d39f9c3f80 2024-05-08T18:51:08.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.112+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f558003c070 con 0x55d39f9c3f80 2024-05-08T18:51:08.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.112+0000 7f558ee0e640 1 --2- 172.21.15.132:0/2724369961 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f5580035070 0x7f5580016330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.112+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x7f5580035070 2024-05-08T18:51:08.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.112+0000 7f558e60d640 1 --2- 172.21.15.132:0/2724369961 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f5580035070 0x7f5580016330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.113+0000 7f558e60d640 1 --2- 172.21.15.132:0/2724369961 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f5580035070 0x7f5580016330 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.113+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.113+0000 7f558e60d640 1 --2- 172.21.15.132:0/2724369961 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f5588052030 0x7f5588094050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.113+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x7f5588052030 2024-05-08T18:51:08.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.113+0000 7f558de0c640 1 --2- 172.21.15.132:0/2724369961 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f5588052030 0x7f5588094050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.114+0000 7f558de0c640 1 --2- 172.21.15.132:0/2724369961 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f5588052030 0x7f5588094050 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.114+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557800f5f0 con 0x7f5588052030 2024-05-08T18:51:08.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.114+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x55d39f9bf590 2024-05-08T18:51:08.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.114+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557800f5f0 con 0x55d39f9bf590 2024-05-08T18:51:08.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.114+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x55d39f9bf590 2024-05-08T18:51:08.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.114+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557802b040 con 0x55d39f9bf590 2024-05-08T18:51:08.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.114+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x7f5588052030 2024-05-08T18:51:08.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.114+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557802b040 con 0x7f5588052030 2024-05-08T18:51:08.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.114+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x7f5588052030 2024-05-08T18:51:08.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.115+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557802b040 con 0x7f5588052030 2024-05-08T18:51:08.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.115+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x7f5580035070 2024-05-08T18:51:08.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.115+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.115+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x55d39f9c3f80 2024-05-08T18:51:08.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.115+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f558003c070 con 0x55d39f9c3f80 2024-05-08T18:51:08.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.115+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x55d39f9bf590 2024-05-08T18:51:08.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.115+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557802b040 con 0x55d39f9bf590 2024-05-08T18:51:08.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.115+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x7f5588052030 2024-05-08T18:51:08.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.116+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557802b040 con 0x7f5588052030 2024-05-08T18:51:08.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.116+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x55d39f9bf590 2024-05-08T18:51:08.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.116+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f557802b040 con 0x55d39f9bf590 2024-05-08T18:51:08.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.116+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x7f5580035070 2024-05-08T18:51:08.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.116+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.116+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x55d39f9c3f80 2024-05-08T18:51:08.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.117+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f558003c070 con 0x55d39f9c3f80 2024-05-08T18:51:08.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.117+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x55d39f9c3f80 2024-05-08T18:51:08.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.117+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f558003c070 con 0x55d39f9c3f80 2024-05-08T18:51:08.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.117+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x7f5588052030 2024-05-08T18:51:08.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.118+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557802b040 con 0x7f5588052030 2024-05-08T18:51:08.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.118+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x55d39f9c3f80 2024-05-08T18:51:08.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.118+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f558003c070 con 0x55d39f9c3f80 2024-05-08T18:51:08.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.118+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x55d39f9c3f80 2024-05-08T18:51:08.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.118+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f558003c070 con 0x55d39f9c3f80 2024-05-08T18:51:08.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.118+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x55d39f9bf590 2024-05-08T18:51:08.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.118+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557802b040 con 0x55d39f9bf590 2024-05-08T18:51:08.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.118+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x55d39f9bf590 2024-05-08T18:51:08.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.118+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f557802b040 con 0x55d39f9bf590 2024-05-08T18:51:08.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.119+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x7f5588052030 2024-05-08T18:51:08.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.119+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557802b040 con 0x7f5588052030 2024-05-08T18:51:08.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.119+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x55d39f9c3f80 2024-05-08T18:51:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.119+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.119+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x7f5580035070 2024-05-08T18:51:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.119+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.119+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x55d39f9bf590 2024-05-08T18:51:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.120+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557802b040 con 0x55d39f9bf590 2024-05-08T18:51:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.120+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x7f5588052030 2024-05-08T18:51:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.120+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557803b040 con 0x7f5588052030 2024-05-08T18:51:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.120+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x55d39f9c3f80 2024-05-08T18:51:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.120+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.120+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x7f5588052030 2024-05-08T18:51:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.120+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557803b040 con 0x7f5588052030 2024-05-08T18:51:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.120+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x7f5580035070 2024-05-08T18:51:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.121+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.121+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x55d39f9c3f80 2024-05-08T18:51:08.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.121+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.121+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x7f5588052030 2024-05-08T18:51:08.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.121+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f557803b040 con 0x7f5588052030 2024-05-08T18:51:08.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.121+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x55d39f9bf590 2024-05-08T18:51:08.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.121+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f557803b040 con 0x55d39f9bf590 2024-05-08T18:51:08.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.121+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8410 con 0x7f5580035070 2024-05-08T18:51:08.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.122+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.122+0000 7f559300f800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:08.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.122+0000 7f559300f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:08.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.122+0000 7f559300f800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:08.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.122+0000 7f559300f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:08.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.122+0000 7f559300f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:08.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.122+0000 7f559300f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:08.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.122+0000 7f559300f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.122+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c74a0 con 0x55d39f9bf590 2024-05-08T18:51:08.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.122+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f557803b040 con 0x55d39f9bf590 2024-05-08T18:51:08.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.122+0000 7f559300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.122+0000 7f559300f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.122+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c7d40 con 0x55d39f9bf590 2024-05-08T18:51:08.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.122+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f557803b040 con 0x55d39f9bf590 2024-05-08T18:51:08.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.122+0000 7f559300f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:08.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.122+0000 7f559300f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.122+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8890 con 0x55d39f9bf590 2024-05-08T18:51:08.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.122+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f557803b040 con 0x55d39f9bf590 2024-05-08T18:51:08.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.123+0000 7f559300f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:08.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.123+0000 7f559300f800 20 zone default found 2024-05-08T18:51:08.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.123+0000 7f559300f800 4 Realm: () 2024-05-08T18:51:08.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.123+0000 7f559300f800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:08.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.123+0000 7f559300f800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:08.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.123+0000 7f559300f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:08.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.123+0000 7f559300f800 20 zonegroup default 2024-05-08T18:51:08.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.123+0000 7f559300f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.123+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c8890 con 0x7f5588052030 2024-05-08T18:51:08.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.123+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f557803b040 con 0x7f5588052030 2024-05-08T18:51:08.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.123+0000 7f559300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.123+0000 7f559300f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.123+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9ca6b0 con 0x55d39f9c3f80 2024-05-08T18:51:08.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.123+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.123+0000 7f559300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.123+0000 7f559300f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.123+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9caaf0 con 0x55d39f9c3f80 2024-05-08T18:51:08.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.124+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.124+0000 7f559300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.124+0000 7f559300f800 20 started sync module instance, tier type = 2024-05-08T18:51:08.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.124+0000 7f559300f800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:08.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.124+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9c9b50 con 0x7f5580035070 2024-05-08T18:51:08.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.125+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.125+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94367404299936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9caf50 con 0x7f5580035070 2024-05-08T18:51:08.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.125+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9cb7a0 con 0x55d39f9bf590 2024-05-08T18:51:08.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.126+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94367404299936] v25'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.126+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557803b040 con 0x55d39f9bf590 2024-05-08T18:51:08.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.126+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94367404307184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9cbbc0 con 0x55d39f9bf590 2024-05-08T18:51:08.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.126+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9cc410 con 0x55d39f9c3f80 2024-05-08T18:51:08.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.127+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94367404307184] v25'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557803b040 con 0x55d39f9bf590 2024-05-08T18:51:08.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.127+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.127+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94367404308720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9cc340 con 0x55d39f9c3f80 2024-05-08T18:51:08.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.127+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9cce60 con 0x7f5580035070 2024-05-08T18:51:08.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.128+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.128+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94367404312880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9cd700 con 0x7f5580035070 2024-05-08T18:51:08.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.128+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9ce1f0 con 0x55d39f9bf590 2024-05-08T18:51:08.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.128+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94367404308720] v25'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.129+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94367404312880] v25'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.129+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557803b040 con 0x55d39f9bf590 2024-05-08T18:51:08.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.129+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94367404315216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9cbd90 con 0x55d39f9bf590 2024-05-08T18:51:08.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.129+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9cec00 con 0x7f5588052030 2024-05-08T18:51:08.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.131+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94367404315216] v25'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557803b040 con 0x55d39f9bf590 2024-05-08T18:51:08.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.131+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557803b040 con 0x7f5588052030 2024-05-08T18:51:08.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.131+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94367404317888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9cec00 con 0x7f5588052030 2024-05-08T18:51:08.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.131+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9cf4b0 con 0x7f5588052030 2024-05-08T18:51:08.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.132+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94367404317888] v25'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557803b040 con 0x7f5588052030 2024-05-08T18:51:08.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.132+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557803b040 con 0x7f5588052030 2024-05-08T18:51:08.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.132+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94367404320592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9cf690 con 0x7f5588052030 2024-05-08T18:51:08.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.132+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9cfee0 con 0x7f5588052030 2024-05-08T18:51:08.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.133+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94367404320592] v25'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557803b040 con 0x7f5588052030 2024-05-08T18:51:08.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.133+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557803b040 con 0x7f5588052030 2024-05-08T18:51:08.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.133+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94367404324496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9cff60 con 0x7f5588052030 2024-05-08T18:51:08.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.133+0000 7f559300f800 20 add_watcher() i=0 2024-05-08T18:51:08.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.133+0000 7f559300f800 20 add_watcher() i=1 2024-05-08T18:51:08.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.133+0000 7f559300f800 20 add_watcher() i=2 2024-05-08T18:51:08.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.133+0000 7f559300f800 20 add_watcher() i=3 2024-05-08T18:51:08.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.133+0000 7f559300f800 20 add_watcher() i=4 2024-05-08T18:51:08.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.133+0000 7f559300f800 20 add_watcher() i=5 2024-05-08T18:51:08.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.133+0000 7f559300f800 20 add_watcher() i=6 2024-05-08T18:51:08.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.134+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94367404324496] v25'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557803b040 con 0x7f5588052030 2024-05-08T18:51:08.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.134+0000 7f559300f800 20 add_watcher() i=7 2024-05-08T18:51:08.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.134+0000 7f559300f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:08.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.134+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9d3220 con 0x55d39f9bf590 2024-05-08T18:51:08.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.134+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f557803b040 con 0x55d39f9bf590 2024-05-08T18:51:08.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.134+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94367404325920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9d04f0 con 0x55d39f9bf590 2024-05-08T18:51:08.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.135+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94367404325920] v25'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f557803b040 con 0x55d39f9bf590 2024-05-08T18:51:08.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.135+0000 7f5444fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:08.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.135+0000 7f559300f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:08.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.135+0000 7f559300f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:08.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.135+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9d2a30 con 0x55d39f9bf590 2024-05-08T18:51:08.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.136+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v25'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f557803b040 con 0x55d39f9bf590 2024-05-08T18:51:08.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.136+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dc330 con 0x7f5588052030 2024-05-08T18:51:08.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.138+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v25'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f557803b040 con 0x7f5588052030 2024-05-08T18:51:08.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.138+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dc330 con 0x55d39f9c3f80 2024-05-08T18:51:08.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.139+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v25'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.139+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dc330 con 0x55d39f9bf590 2024-05-08T18:51:08.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.140+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v25'183 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f557803b040 con 0x55d39f9bf590 2024-05-08T18:51:08.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.140+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dcd50 con 0x7f5580035070 2024-05-08T18:51:08.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.141+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v25'62 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.141+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dd770 con 0x55d39f9c3f80 2024-05-08T18:51:08.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.142+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v25'42 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.142+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dd770 con 0x55d39f9bf590 2024-05-08T18:51:08.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.143+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v25'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f557803b040 con 0x55d39f9bf590 2024-05-08T18:51:08.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.143+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dd770 con 0x7f5588052030 2024-05-08T18:51:08.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.144+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v25'43 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f557803b040 con 0x7f5588052030 2024-05-08T18:51:08.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.144+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dd770 con 0x7f5580035070 2024-05-08T18:51:08.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.145+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v25'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.145+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9daa40 con 0x55d39f9c3f80 2024-05-08T18:51:08.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.146+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v25'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.146+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9daa40 con 0x7f5580035070 2024-05-08T18:51:08.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.147+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v25'63 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.147+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9daa40 con 0x7f5588052030 2024-05-08T18:51:08.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.148+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v25'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f557803b040 con 0x7f5588052030 2024-05-08T18:51:08.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.148+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9daa40 con 0x7f5580035070 2024-05-08T18:51:08.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.149+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v25'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.149+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9daa40 con 0x7f5588052030 2024-05-08T18:51:08.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.150+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v25'47 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f557803b040 con 0x7f5588052030 2024-05-08T18:51:08.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.150+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9daa40 con 0x55d39f9bf590 2024-05-08T18:51:08.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.151+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v25'184 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f557803b040 con 0x55d39f9bf590 2024-05-08T18:51:08.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.151+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9daa40 con 0x55d39f9c3f80 2024-05-08T18:51:08.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.152+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v25'56 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.152+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dac10 con 0x7f5580035070 2024-05-08T18:51:08.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.153+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v25'64 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.153+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dac10 con 0x55d39f9c3f80 2024-05-08T18:51:08.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.154+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v25'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.154+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dac10 con 0x55d39f9bf590 2024-05-08T18:51:08.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.155+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v25'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f557803b040 con 0x55d39f9bf590 2024-05-08T18:51:08.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.155+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dac10 con 0x55d39f9bf590 2024-05-08T18:51:08.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.156+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v25'185 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f557803b040 con 0x55d39f9bf590 2024-05-08T18:51:08.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.156+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dac10 con 0x55d39f9c3f80 2024-05-08T18:51:08.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.157+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v25'57 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.157+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dac10 con 0x7f5580035070 2024-05-08T18:51:08.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.158+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v25'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.158+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dac10 con 0x55d39f9c3f80 2024-05-08T18:51:08.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.159+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v25'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.159+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dac10 con 0x55d39f9c3f80 2024-05-08T18:51:08.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.160+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v25'31 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.160+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dac10 con 0x55d39f9c3f80 2024-05-08T18:51:08.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.161+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v25'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.161+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dac10 con 0x55d39f9c3f80 2024-05-08T18:51:08.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.161+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v25'43 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.162+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dac10 con 0x7f5588052030 2024-05-08T18:51:08.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.163+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v25'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f557803b040 con 0x7f5588052030 2024-05-08T18:51:08.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.163+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dac10 con 0x55d39f9c3f80 2024-05-08T18:51:08.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.164+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v25'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.164+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dac10 con 0x7f5588052030 2024-05-08T18:51:08.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.165+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v25'44 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f557803b040 con 0x7f5588052030 2024-05-08T18:51:08.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.165+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dac10 con 0x55d39f9c3f80 2024-05-08T18:51:08.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.166+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v25'58 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.166+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dac10 con 0x7f5588052030 2024-05-08T18:51:08.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.167+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v25'48 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f557803b040 con 0x7f5588052030 2024-05-08T18:51:08.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.167+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9dac10 con 0x7f5580035070 2024-05-08T18:51:08.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.168+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v25'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.168+0000 7f53bf7fe640 20 reqs_thread_entry: start 2024-05-08T18:51:08.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.169+0000 7f559300f800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:08.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.169+0000 7f559300f800 20 Filter name: none 2024-05-08T18:51:08.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.169+0000 7f53bd7fa640 20 reqs_thread_entry: start 2024-05-08T18:51:08.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.169+0000 7f559300f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:51:08.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.169+0000 7f559300f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.169+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39f9da560 con 0x7f5580035070 2024-05-08T18:51:08.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.169+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.169+0000 7f559300f800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:51:08.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.169+0000 7f559300f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:51:08.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.169+0000 7f559300f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:51:08.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.169+0000 7f559300f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5 : miss 2024-05-08T18:51:08.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.169+0000 7f559300f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.169+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:95 8.c 8:354450c5:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa0a7b0 con 0x55d39f9bf590 2024-05-08T18:51:08.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.169+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(95 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f557803b040 con 0x55d39f9bf590 2024-05-08T18:51:08.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.169+0000 7f559300f800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:51:08.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.169+0000 7f559300f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5 info.flags=0x17 2024-05-08T18:51:08.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.169+0000 7f559300f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5 to cache LRU end 2024-05-08T18:51:08.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.169+0000 7f559300f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:51:08.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.169+0000 7f559300f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:51:08.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.169+0000 7f559300f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5 2024-05-08T18:51:08.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.170+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:96 4.25 4:a76d399c:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa87fe0 con 0x55d39f9c3f80 2024-05-08T18:51:08.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.170+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== osd_op_reply(96 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.170+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:97 4.24 4:266a81e2:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa87fe0 con 0x7f5588052030 2024-05-08T18:51:08.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.170+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(97 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f557803b040 con 0x7f5588052030 2024-05-08T18:51:08.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.170+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:98 4.14 4:2a93b2cf:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa87fe0 con 0x55d39f9c3f80 2024-05-08T18:51:08.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.171+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 28 ==== osd_op_reply(98 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.2 [call out=426b] v0'0 uv3 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.171+0000 7f559300f800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-05-08T18:51:08.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.171+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:99 4.32 4:4c253935:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa88010 con 0x55d39f9bf590 2024-05-08T18:51:08.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.171+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(99 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f557803b040 con 0x55d39f9bf590 2024-05-08T18:51:08.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.171+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:100 4.a 4:5088ec74:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa88010 con 0x7f5580035070 2024-05-08T18:51:08.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.171+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(100 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.171+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:101 4.3 4:c3dec9fe:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa88010 con 0x55d39f9bf590 2024-05-08T18:51:08.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.172+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(101 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f557803b040 con 0x55d39f9bf590 2024-05-08T18:51:08.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.172+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:102 4.16 4:68f01658:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa88010 con 0x55d39f9c3f80 2024-05-08T18:51:08.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.172+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 29 ==== osd_op_reply(102 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.6 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.172+0000 7f559300f800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-05-08T18:51:08.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.172+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:103 4.12 4:48854627:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa88010 con 0x55d39f9bf590 2024-05-08T18:51:08.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.172+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(103 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f557803b040 con 0x55d39f9bf590 2024-05-08T18:51:08.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.172+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:104 4.5 4:a06a55df:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa88010 con 0x55d39f9c3f80 2024-05-08T18:51:08.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.173+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 30 ==== osd_op_reply(104 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.8 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.173+0000 7f559300f800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-05-08T18:51:08.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.173+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:105 4.1d 4:ba93137a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa88010 con 0x55d39f9c3f80 2024-05-08T18:51:08.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.173+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 31 ==== osd_op_reply(105 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.173+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:106 4.0 4:0156580c:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa88010 con 0x55d39f9c3f80 2024-05-08T18:51:08.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.173+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 32 ==== osd_op_reply(106 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.10 [call out=697b] v0'0 uv13 ondisk = 0) ==== 195+0+697 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.173+0000 7f559300f800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-05-08T18:51:08.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.173+0000 7f559300f800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-05-08T18:51:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.173+0000 7f559300f800 20 get_obj_state: octx=0x7f557800f570 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55d39fa87818 s->prefetch_data=0 2024-05-08T18:51:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.173+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:107 3.1e 3:78f386cf:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa85d10 con 0x7f5588052030 2024-05-08T18:51:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.174+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(107 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f557803b040 con 0x7f5588052030 2024-05-08T18:51:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.174+0000 7f559300f800 10 manifest: total_size = 6 2024-05-08T18:51:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.174+0000 7f559300f800 20 get_obj_state: setting s->obj_tag to bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.12549494299145549650 2024-05-08T18:51:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.174+0000 7f559300f800 20 get_obj_state: octx=0x7f557800f570 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55d39fa87818 s->prefetch_data=0 2024-05-08T18:51:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.174+0000 7f559300f800 20 prepare_atomic_modification: state is not atomic. state=0x55d39fa87818 2024-05-08T18:51:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.174+0000 7f559300f800 20 bucket index object: :.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.2 2024-05-08T18:51:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.174+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:108 4.14 4:2a93b2cf:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa0fd30 con 0x55d39f9c3f80 2024-05-08T18:51:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.176+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 33 ==== osd_op_reply(108 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.2 [stat,call,call] v25'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.176+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:109 3.1e 3:78f386cf:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa0fd90 con 0x7f5588052030 2024-05-08T18:51:08.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.177+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(109 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_9c8454ddf7aa50116496bac348d7550d [call] v25'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f557803b040 con 0x7f5588052030 2024-05-08T18:51:08.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.177+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:110 4.14 4:2a93b2cf:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa10660 con 0x55d39f9c3f80 2024-05-08T18:51:08.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.177+0000 7f559300f800 20 get_obj_state: octx=0x7f557800f570 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55d39fa87818 s->prefetch_data=0 2024-05-08T18:51:08.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.177+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:111 3.22 3:46a0fee1:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa112b0 con 0x55d39f9c3f80 2024-05-08T18:51:08.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.177+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 34 ==== osd_op_reply(111 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.177+0000 7f559300f800 10 manifest: total_size = 3 2024-05-08T18:51:08.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.177+0000 7f559300f800 20 get_obj_state: setting s->obj_tag to bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5731391247144922408 2024-05-08T18:51:08.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.177+0000 7f559300f800 20 get_obj_state: octx=0x7f557800f570 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55d39fa87818 s->prefetch_data=0 2024-05-08T18:51:08.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.177+0000 7f559300f800 20 prepare_atomic_modification: state is not atomic. state=0x55d39fa87818 2024-05-08T18:51:08.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.177+0000 7f559300f800 20 bucket index object: :.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.6 2024-05-08T18:51:08.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.177+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:112 4.16 4:68f01658:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa112b0 con 0x55d39f9c3f80 2024-05-08T18:51:08.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.178+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 35 ==== osd_op_reply(110 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.2 [stat,call,call] v25'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.178+0000 7f5471ffb640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-05-08T18:51:08.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.178+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 36 ==== osd_op_reply(112 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.6 [stat,call,call] v25'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.178+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:113 3.22 3:46a0fee1:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa10e00 con 0x55d39f9c3f80 2024-05-08T18:51:08.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.179+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 37 ==== osd_op_reply(113 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_b1b9a972ccd8c962a473909b97007eb4 [call] v25'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.179+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:114 4.16 4:68f01658:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa112b0 con 0x55d39f9c3f80 2024-05-08T18:51:08.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.179+0000 7f559300f800 20 get_obj_state: octx=0x7f557800f570 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55d39fa87818 s->prefetch_data=0 2024-05-08T18:51:08.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.179+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:115 3.3a 3:5d3c7ea2:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa112b0 con 0x7f5580035070 2024-05-08T18:51:08.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.180+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 20 ==== osd_op_reply(115 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.180+0000 7f559300f800 10 manifest: total_size = 4 2024-05-08T18:51:08.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.180+0000 7f559300f800 20 get_obj_state: setting s->obj_tag to bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9674805509541764423 2024-05-08T18:51:08.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.180+0000 7f559300f800 20 get_obj_state: octx=0x7f557800f570 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55d39fa87818 s->prefetch_data=0 2024-05-08T18:51:08.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.180+0000 7f559300f800 20 prepare_atomic_modification: state is not atomic. state=0x55d39fa87818 2024-05-08T18:51:08.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.180+0000 7f559300f800 20 bucket index object: :.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.8 2024-05-08T18:51:08.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.180+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:116 4.5 4:a06a55df:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa112b0 con 0x55d39f9c3f80 2024-05-08T18:51:08.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.181+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 38 ==== osd_op_reply(114 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.6 [stat,call,call] v25'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.181+0000 7f54717fa640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-05-08T18:51:08.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.181+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 39 ==== osd_op_reply(116 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.8 [stat,call,call] v25'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.181+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:117 3.3a 3:5d3c7ea2:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa112b0 con 0x7f5580035070 2024-05-08T18:51:08.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.182+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 21 ==== osd_op_reply(117 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v25'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.182+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:118 4.5 4:a06a55df:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa11260 con 0x55d39f9c3f80 2024-05-08T18:51:08.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.182+0000 7f559300f800 20 get_obj_state: octx=0x7f557800f570 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55d39fa87818 s->prefetch_data=0 2024-05-08T18:51:08.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.182+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:119 3.31 3:8f2d7950:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa12040 con 0x7f5588052030 2024-05-08T18:51:08.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.183+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== osd_op_reply(119 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f557803b040 con 0x7f5588052030 2024-05-08T18:51:08.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.183+0000 7f559300f800 10 manifest: total_size = 5 2024-05-08T18:51:08.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.183+0000 7f559300f800 20 get_obj_state: setting s->obj_tag to bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.1774890247984236144 2024-05-08T18:51:08.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.183+0000 7f559300f800 20 get_obj_state: octx=0x7f557800f570 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55d39fa87818 s->prefetch_data=0 2024-05-08T18:51:08.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.183+0000 7f559300f800 20 prepare_atomic_modification: state is not atomic. state=0x55d39fa87818 2024-05-08T18:51:08.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.183+0000 7f559300f800 20 bucket index object: :.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.10 2024-05-08T18:51:08.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.183+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:120 4.0 4:0156580c:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa12040 con 0x55d39f9c3f80 2024-05-08T18:51:08.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.183+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 40 ==== osd_op_reply(118 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.8 [stat,call,call] v25'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.183+0000 7f5471ffb640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-05-08T18:51:08.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.184+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 41 ==== osd_op_reply(120 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.10 [stat,call,call] v25'14 uv14 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.184+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:121 3.31 3:8f2d7950:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa116e0 con 0x7f5588052030 2024-05-08T18:51:08.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.185+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 28 ==== osd_op_reply(121 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_24d27c169c2c881eb09a065116f2aa5c [call] v25'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f557803b040 con 0x7f5588052030 2024-05-08T18:51:08.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.185+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:122 4.0 4:0156580c:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa11b90 con 0x55d39f9c3f80 2024-05-08T18:51:08.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.185+0000 7f559300f800 20 get_obj_state: octx=0x7f557800f570 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55d39fa87818 s->prefetch_data=0 2024-05-08T18:51:08.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.185+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:123 3.37 3:ec595fd8:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa12430 con 0x55d39f9bf590 2024-05-08T18:51:08.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.185+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 32 ==== osd_op_reply(123 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7f557804b3b0 con 0x55d39f9bf590 2024-05-08T18:51:08.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.185+0000 7f559300f800 10 manifest: total_size = 5 2024-05-08T18:51:08.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.185+0000 7f559300f800 20 get_obj_state: setting s->obj_tag to _AAsxvirZTaooHbB9fQG0zioRMd7sQbf 2024-05-08T18:51:08.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.185+0000 7f559300f800 20 get_obj_state: octx=0x7f557800f570 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55d39fa87818 s->prefetch_data=0 2024-05-08T18:51:08.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.185+0000 7f559300f800 20 prepare_atomic_modification: state is not atomic. state=0x55d39fa87818 2024-05-08T18:51:08.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.185+0000 7f559300f800 20 bucket index object: :.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.10 2024-05-08T18:51:08.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.185+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:124 4.0 4:0156580c:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa16de0 con 0x55d39f9c3f80 2024-05-08T18:51:08.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.186+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 42 ==== osd_op_reply(122 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.10 [stat,call,call] v25'15 uv15 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.186+0000 7f54717fa640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-05-08T18:51:08.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.186+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 43 ==== osd_op_reply(124 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.10 [stat,call,call] v25'16 uv16 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.186+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:125 3.37 3:ec595fd8:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa116e0 con 0x55d39f9bf590 2024-05-08T18:51:08.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.187+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 33 ==== osd_op_reply(125 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5_bb3aec0fdcdbc2974890f805c585d432 [call] v25'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f557804b3b0 con 0x55d39f9bf590 2024-05-08T18:51:08.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.187+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:126 4.0 4:0156580c:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa11b90 con 0x55d39f9c3f80 2024-05-08T18:51:08.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.187+0000 7f559300f800 20 list_objects_ordered: starting attempt 1 2024-05-08T18:51:08.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.187+0000 7f559300f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-08T18:51:08.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.187+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:127 4.25 4:a76d399c:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa11b90 con 0x55d39f9c3f80 2024-05-08T18:51:08.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.187+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:128 4.24 4:266a81e2:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa87ae0 con 0x7f5588052030 2024-05-08T18:51:08.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.188+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:129 4.14 4:2a93b2cf:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa11b90 con 0x55d39f9c3f80 2024-05-08T18:51:08.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.188+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:130 4.32 4:4c253935:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa1bd60 con 0x55d39f9bf590 2024-05-08T18:51:08.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.188+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:131 4.a 4:5088ec74:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa87ae0 con 0x7f5580035070 2024-05-08T18:51:08.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.188+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:132 4.3 4:c3dec9fe:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa20d10 con 0x55d39f9bf590 2024-05-08T18:51:08.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.188+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:133 4.16 4:68f01658:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa23a70 con 0x55d39f9c3f80 2024-05-08T18:51:08.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.188+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:134 4.12 4:48854627:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa264a0 con 0x55d39f9bf590 2024-05-08T18:51:08.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.188+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:135 4.5 4:a06a55df:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa29320 con 0x55d39f9c3f80 2024-05-08T18:51:08.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.188+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:136 4.1d 4:ba93137a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa2bca0 con 0x55d39f9c3f80 2024-05-08T18:51:08.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.188+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:137 4.0 4:0156580c:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa2e6d0 con 0x55d39f9c3f80 2024-05-08T18:51:08.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.188+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 29 ==== osd_op_reply(128 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f557804b3b0 con 0x7f5588052030 2024-05-08T18:51:08.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.188+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 34 ==== osd_op_reply(130 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f557804b3b0 con 0x55d39f9bf590 2024-05-08T18:51:08.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.188+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 22 ==== osd_op_reply(131 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.188+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 35 ==== osd_op_reply(134 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f557804b3b0 con 0x55d39f9bf590 2024-05-08T18:51:08.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.188+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 36 ==== osd_op_reply(132 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f557804b3b0 con 0x55d39f9bf590 2024-05-08T18:51:08.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.188+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 44 ==== osd_op_reply(127 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.188+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 45 ==== osd_op_reply(129 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.2 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.188+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 46 ==== osd_op_reply(133 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.188+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 47 ==== osd_op_reply(135 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.189+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 48 ==== osd_op_reply(136 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.189+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 49 ==== osd_op_reply(126 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.10 [stat,call,call] v25'17 uv17 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.189+0000 7f54717fa640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-05-08T18:51:08.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.189+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 50 ==== osd_op_reply(137 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.10 [call out=124b] v0'0 uv17 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.189+0000 7f559300f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-08T18:51:08.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.189+0000 7f559300f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-08T18:51:08.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.189+0000 7f559300f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-08T18:51:08.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.189+0000 7f559300f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-08T18:51:08.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.189+0000 7f559300f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5])"; uploads.size()=0; is_truncated=0 2024-05-08T18:51:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.189+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:138 4.25 4:a76d399c:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa2e730 con 0x55d39f9c3f80 2024-05-08T18:51:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.189+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:139 4.24 4:266a81e2:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa85d80 con 0x7f5588052030 2024-05-08T18:51:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.189+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:140 4.14 4:2a93b2cf:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa2e730 con 0x55d39f9c3f80 2024-05-08T18:51:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.189+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:141 4.32 4:4c253935:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa87630 con 0x55d39f9bf590 2024-05-08T18:51:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.189+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:142 4.a 4:5088ec74:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa87ab0 con 0x7f5580035070 2024-05-08T18:51:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.189+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:143 4.3 4:c3dec9fe:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa2e730 con 0x55d39f9bf590 2024-05-08T18:51:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.189+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:144 4.16 4:68f01658:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa85d80 con 0x55d39f9c3f80 2024-05-08T18:51:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.190+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 51 ==== osd_op_reply(138 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.190+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 30 ==== osd_op_reply(139 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f557804b3b0 con 0x7f5588052030 2024-05-08T18:51:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.190+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 23 ==== osd_op_reply(142 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.190+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 52 ==== osd_op_reply(140 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.2 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.190+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 37 ==== osd_op_reply(141 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f557804b3b0 con 0x55d39f9bf590 2024-05-08T18:51:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.190+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 53 ==== osd_op_reply(144 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.190+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:145 4.12 4:48854627:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa85d80 con 0x55d39f9bf590 2024-05-08T18:51:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.190+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:146 4.5 4:a06a55df:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa87ab0 con 0x55d39f9c3f80 2024-05-08T18:51:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.190+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 38 ==== osd_op_reply(143 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f557804b3b0 con 0x55d39f9bf590 2024-05-08T18:51:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.190+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:147 4.1d 4:ba93137a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa87630 con 0x55d39f9c3f80 2024-05-08T18:51:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.190+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:148 4.0 4:0156580c:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa22cb0 con 0x55d39f9c3f80 2024-05-08T18:51:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.190+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 54 ==== osd_op_reply(147 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.190+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 55 ==== osd_op_reply(148 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.10 [call out=124b] v0'0 uv17 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.190+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 39 ==== osd_op_reply(145 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f557804b3b0 con 0x55d39f9bf590 2024-05-08T18:51:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.190+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 56 ==== osd_op_reply(146 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.190+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa87630 con 0x7f5580035070 2024-05-08T18:51:08.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.191+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 24 ==== osd_op_reply(149 foo.buckets [call] v25'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.191+0000 7f559300f800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-05-08T18:51:08.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.191+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa85d80 con 0x7f5580035070 2024-05-08T18:51:08.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.192+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 25 ==== osd_op_reply(150 myfoo [call,call,delete] v25'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.192+0000 7f559300f800 10 removing default.rgw.meta+root+myfoo from cache 2024-05-08T18:51:08.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.192+0000 7f559300f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:51:08.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.192+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94367404594912 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa87630 con 0x7f5588052030 2024-05-08T18:51:08.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.193+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 31 ==== watch-notify(notify (1) cookie 94367404320592 notify 107374182414 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55d39fa08c80 con 0x7f5588052030 2024-05-08T18:51:08.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.193+0000 7f5471ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182414 cookie 94367404320592 notifier 4641 bl.length()=149 2024-05-08T18:51:08.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.193+0000 7f5471ffb640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f5454003d60 con 0x7f5588052030 2024-05-08T18:51:08.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.193+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 32 ==== osd_op_reply(151 notify.6 [notify cookie 94367404594912 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f557804b3b0 con 0x7f5588052030 2024-05-08T18:51:08.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.193+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 33 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557804b3b0 con 0x7f5588052030 2024-05-08T18:51:08.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.193+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 34 ==== watch-notify(notify_complete (2) cookie 94367404594912 notify 107374182414 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d39f9b41f0 con 0x7f5588052030 2024-05-08T18:51:08.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.193+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:153 8.c 8:354450c5:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa85d80 con 0x55d39f9bf590 2024-05-08T18:51:08.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.194+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 40 ==== osd_op_reply(153 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5 [call,call,delete] v25'5 uv5 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f557804b3b0 con 0x55d39f9bf590 2024-05-08T18:51:08.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.194+0000 7f559300f800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5 from cache 2024-05-08T18:51:08.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.194+0000 7f559300f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5, ofs0, ns] 2024-05-08T18:51:08.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.194+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:154 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94367404594912 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa85d80 con 0x7f5580035070 2024-05-08T18:51:08.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.194+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 26 ==== watch-notify(notify (1) cookie 94367404299936 notify 107374182431 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55d39f9dc8a0 con 0x7f5580035070 2024-05-08T18:51:08.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.194+0000 7f54717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182431 cookie 94367404299936 notifier 4641 bl.length()=206 2024-05-08T18:51:08.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.194+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 27 ==== osd_op_reply(154 notify.0 [notify cookie 94367404594912 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.194+0000 7f54717fa640 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:155 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f53c40032c0 con 0x7f5580035070 2024-05-08T18:51:08.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.195+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 28 ==== osd_op_reply(155 notify.0 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.195+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 29 ==== watch-notify(notify_complete (2) cookie 94367404594912 notify 107374182431 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d39f9db320 con 0x7f5580035070 2024-05-08T18:51:08.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.195+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:156 4.25 4:a76d399c:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa85d80 con 0x55d39f9c3f80 2024-05-08T18:51:08.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.195+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:157 4.24 4:266a81e2:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa87630 con 0x7f5588052030 2024-05-08T18:51:08.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.195+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:158 4.14 4:2a93b2cf:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa07c70 con 0x55d39f9c3f80 2024-05-08T18:51:08.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.195+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:159 4.32 4:4c253935:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa084c0 con 0x55d39f9bf590 2024-05-08T18:51:08.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.195+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:160 4.a 4:5088ec74:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa85d80 con 0x7f5580035070 2024-05-08T18:51:08.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.195+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:161 4.3 4:c3dec9fe:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa07c70 con 0x55d39f9bf590 2024-05-08T18:51:08.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.195+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:162 4.16 4:68f01658:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa87630 con 0x55d39f9c3f80 2024-05-08T18:51:08.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.195+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:163 4.12 4:48854627:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa084c0 con 0x55d39f9bf590 2024-05-08T18:51:08.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.195+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:164 4.5 4:a06a55df:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa85d80 con 0x55d39f9c3f80 2024-05-08T18:51:08.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.195+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:165 4.1d 4:ba93137a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa07c70 con 0x55d39f9c3f80 2024-05-08T18:51:08.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.195+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:166 4.0 4:0156580c:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa15f10 con 0x55d39f9c3f80 2024-05-08T18:51:08.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.196+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 57 ==== osd_op_reply(158 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.2 [delete] v25'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.197+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 58 ==== osd_op_reply(156 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.0 [delete] v25'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.197+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 59 ==== osd_op_reply(162 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.6 [delete] v25'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.197+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 35 ==== osd_op_reply(157 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.1 [delete] v25'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f557804b3b0 con 0x7f5588052030 2024-05-08T18:51:08.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.197+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 41 ==== osd_op_reply(159 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.3 [delete] v25'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f557804b3b0 con 0x55d39f9bf590 2024-05-08T18:51:08.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.197+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 42 ==== osd_op_reply(161 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.5 [delete] v25'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f557804b3b0 con 0x55d39f9bf590 2024-05-08T18:51:08.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.197+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 30 ==== osd_op_reply(160 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.4 [delete] v25'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.200+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 60 ==== osd_op_reply(164 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.8 [delete] v25'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.200+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 43 ==== osd_op_reply(163 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.7 [delete] v25'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f557804b3b0 con 0x55d39f9bf590 2024-05-08T18:51:08.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.200+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 61 ==== osd_op_reply(165 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.9 [delete] v25'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.200+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 62 ==== osd_op_reply(166 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5.10 [delete] v25'18 uv18 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.200+0000 7f559300f800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5 : miss 2024-05-08T18:51:08.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.200+0000 7f559300f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.200+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:167 6.b 6:d4319fdb:::pubsub..bucket.myfoo%2fbda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa85d80 con 0x55d39f9c3f80 2024-05-08T18:51:08.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.200+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 63 ==== osd_op_reply(167 pubsub..bucket.myfoo/bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.200+0000 7f559300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.200+0000 7f559300f800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5 info.flags=0x0 2024-05-08T18:51:08.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.200+0000 7f559300f800 10 adding default.rgw.log++pubsub..bucket.myfoo/bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5 to cache LRU end 2024-05-08T18:51:08.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.200+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:168 6.b 6:d4319fdb:::pubsub..bucket.myfoo%2fbda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa85d80 con 0x55d39f9c3f80 2024-05-08T18:51:08.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.201+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 64 ==== osd_op_reply(168 pubsub..bucket.myfoo/bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5 [delete] v25'25 uv21 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.201+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa85d80 con 0x7f5580035070 2024-05-08T18:51:08.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.202+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 31 ==== osd_op_reply(169 foo.buckets [call] v25'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.203+0000 7f5444fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:08.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.203+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94367404325920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa85d80 con 0x55d39f9bf590 2024-05-08T18:51:08.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.204+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 44 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94367404325920] v25'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f557804b3b0 con 0x55d39f9bf590 2024-05-08T18:51:08.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.204+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94367404299936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa85d80 con 0x7f5580035070 2024-05-08T18:51:08.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.205+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 32 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94367404299936] v25'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.205+0000 7f559300f800 20 remove_watcher() i=0 2024-05-08T18:51:08.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.205+0000 7f559300f800 2 removed watcher, disabling cache 2024-05-08T18:51:08.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.205+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94367404307184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa85d80 con 0x55d39f9bf590 2024-05-08T18:51:08.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.206+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 45 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94367404307184] v25'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557804b3b0 con 0x55d39f9bf590 2024-05-08T18:51:08.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.206+0000 7f559300f800 20 remove_watcher() i=1 2024-05-08T18:51:08.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.206+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94367404308720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa85d80 con 0x55d39f9c3f80 2024-05-08T18:51:08.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.207+0000 7f558ee0e640 1 -- 172.21.15.132:0/2724369961 <== osd.3 v2:172.21.15.132:6816/17827703 65 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94367404308720] v25'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5580069040 con 0x55d39f9c3f80 2024-05-08T18:51:08.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.207+0000 7f559300f800 20 remove_watcher() i=2 2024-05-08T18:51:08.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.207+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94367404312880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa85d80 con 0x7f5580035070 2024-05-08T18:51:08.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.208+0000 7f558e60d640 1 -- 172.21.15.132:0/2724369961 <== osd.2 v2:172.21.15.132:6808/1108348591 33 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94367404312880] v25'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5588077020 con 0x7f5580035070 2024-05-08T18:51:08.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.208+0000 7f559300f800 20 remove_watcher() i=3 2024-05-08T18:51:08.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.208+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94367404315216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa85d80 con 0x55d39f9bf590 2024-05-08T18:51:08.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.209+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.1 v2:172.21.15.132:6800/3697320277 46 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94367404315216] v25'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557804b3b0 con 0x55d39f9bf590 2024-05-08T18:51:08.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.209+0000 7f559300f800 20 remove_watcher() i=4 2024-05-08T18:51:08.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.209+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94367404317888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa85d80 con 0x7f5588052030 2024-05-08T18:51:08.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.210+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 36 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94367404317888] v25'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557804b3b0 con 0x7f5588052030 2024-05-08T18:51:08.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.210+0000 7f559300f800 20 remove_watcher() i=5 2024-05-08T18:51:08.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.210+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94367404320592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa85d80 con 0x7f5588052030 2024-05-08T18:51:08.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.211+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 37 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94367404320592] v25'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557804b3b0 con 0x7f5588052030 2024-05-08T18:51:08.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.211+0000 7f559300f800 20 remove_watcher() i=6 2024-05-08T18:51:08.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.211+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94367404324496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d39fa85d80 con 0x7f5588052030 2024-05-08T18:51:08.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.212+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 <== osd.0 v2:172.21.15.42:6800/1521799280 38 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94367404324496] v25'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f557804b3b0 con 0x7f5588052030 2024-05-08T18:51:08.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.212+0000 7f559300f800 20 remove_watcher() i=7 2024-05-08T18:51:08.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.212+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f5588052030 msgr2=0x7f5588094050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.212+0000 7f559300f800 1 --2- 172.21.15.132:0/2724369961 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f5588052030 0x7f5588094050 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.212+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d39f9bf590 msgr2=0x55d39f9c1a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.212+0000 7f559300f800 1 --2- 172.21.15.132:0/2724369961 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d39f9bf590 0x55d39f9c1a50 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.212+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f5580035070 msgr2=0x7f5580016330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.212+0000 7f559300f800 1 --2- 172.21.15.132:0/2724369961 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f5580035070 0x7f5580016330 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.212+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d39f9c3f80 msgr2=0x55d39f9c6370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.212+0000 7f559300f800 1 --2- 172.21.15.132:0/2724369961 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d39f9c3f80 0x55d39f9c6370 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.212+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f545803bb50 msgr2=0x7f545803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.212+0000 7f559300f800 1 --2- 172.21.15.132:0/2724369961 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f545803bb50 0x7f545803e010 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f55880449b0 tx=0x7f5588087000 comp rx=0 tx=0).stop 2024-05-08T18:51:08.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.212+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f9ac6b0 msgr2=0x55d39f9b3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.212+0000 7f559300f800 1 --2- 172.21.15.132:0/2724369961 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f9ac6b0 0x55d39f9b3cb0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5580017b50 tx=0x7f5580052b70 comp rx=0 tx=0).stop 2024-05-08T18:51:08.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.212+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 reap_dead start 2024-05-08T18:51:08.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.212+0000 7f558de0c640 1 -- 172.21.15.132:0/2724369961 reap_dead start 2024-05-08T18:51:08.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.212+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 shutdown_connections 2024-05-08T18:51:08.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.212+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 >> 172.21.15.132:0/2724369961 conn(0x55d39f9a8a10 msgr2=0x55d39f9a6070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.212+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 shutdown_connections 2024-05-08T18:51:08.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.212+0000 7f559300f800 1 -- 172.21.15.132:0/2724369961 wait complete. 2024-05-08T18:51:08.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 -- 172.21.15.132:0/1936131345 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f546803bba0 msgr2=0x7f546803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 --2- 172.21.15.132:0/1936131345 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f546803bba0 0x7f546803e060 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55d39f98ba70 tx=0x7f55880515e0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 -- 172.21.15.132:0/1936131345 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f99f390 msgr2=0x55d39f99f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 --2- 172.21.15.132:0/1936131345 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f99f390 0x55d39f99f7b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x55d39f988650 tx=0x7f558000aec0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 -- 172.21.15.132:0/1936131345 shutdown_connections 2024-05-08T18:51:08.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 --2- 172.21.15.132:0/1936131345 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f546803bba0 0x7f546803e060 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 --2- 172.21.15.132:0/1936131345 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f99f390 0x55d39f99f7b0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 -- 172.21.15.132:0/1936131345 >> 172.21.15.132:0/1936131345 conn(0x55d39f993430 msgr2=0x55d39f993830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 -- 172.21.15.132:0/1936131345 shutdown_connections 2024-05-08T18:51:08.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 -- 172.21.15.132:0/1936131345 wait complete. 2024-05-08T18:51:08.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 -- 172.21.15.132:0/788634758 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d39f88e610 msgr2=0x55d39f98b130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 --2- 172.21.15.132:0/788634758 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d39f88e610 0x55d39f98b130 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 -- 172.21.15.132:0/788634758 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d39f98d940 msgr2=0x55d39f98fd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 --2- 172.21.15.132:0/788634758 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d39f98d940 0x55d39f98fd30 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 -- 172.21.15.132:0/788634758 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f547403bba0 msgr2=0x7f547403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 --2- 172.21.15.132:0/788634758 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f547403bba0 0x7f547403e060 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5578000c00 tx=0x7f55780013b0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 -- 172.21.15.132:0/788634758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f88bce0 msgr2=0x55d39f983ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 --2- 172.21.15.132:0/788634758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f88bce0 0x55d39f983ef0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f558801ba70 tx=0x7f5588003330 comp rx=0 tx=0).stop 2024-05-08T18:51:08.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 -- 172.21.15.132:0/788634758 shutdown_connections 2024-05-08T18:51:08.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 --2- 172.21.15.132:0/788634758 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d39f98d940 0x55d39f98fd30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 --2- 172.21.15.132:0/788634758 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d39f88e610 0x55d39f98b130 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 --2- 172.21.15.132:0/788634758 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f547403bba0 0x7f547403e060 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 --2- 172.21.15.132:0/788634758 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d39f88bce0 0x55d39f983ef0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 -- 172.21.15.132:0/788634758 >> 172.21.15.132:0/788634758 conn(0x55d39f885730 msgr2=0x55d39f976560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 -- 172.21.15.132:0/788634758 shutdown_connections 2024-05-08T18:51:08.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.213+0000 7f559300f800 1 -- 172.21.15.132:0/788634758 wait complete. 2024-05-08T18:51:08.221 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-05-08T18:51:08.221 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-05-08T18:51:08.222 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-05-08T18:51:08.267 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:08.267 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:08.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.269+0000 7f58af933800 1 Processor -- start 2024-05-08T18:51:08.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.269+0000 7f58af933800 1 -- start start 2024-05-08T18:51:08.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.269+0000 7f58af933800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55957be2a5e0 0x55957be2c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.269+0000 7f58af933800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55957be2cfa0 con 0x55957be26150 2024-05-08T18:51:08.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.269+0000 7f58af933800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55957bcc7e20 con 0x55957be2a5e0 2024-05-08T18:51:08.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.269+0000 7f58aaeea640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55957be2a5e0 0x55957be2c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.269+0000 7f58ab6eb640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55957be26150 0x55957be26570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:55724/0 (socket says 172.21.15.132:55724) 2024-05-08T18:51:08.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.269+0000 7f58aaeea640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55957be2a5e0 0x55957be2c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51510/0 (socket says 172.21.15.132:51510) 2024-05-08T18:51:08.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.269+0000 7f58ab6eb640 1 -- 172.21.15.132:0/3841287968 learned_addr learned my addr 172.21.15.132:0/3841287968 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:51:08.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.269+0000 7f58aaeea640 1 -- 172.21.15.132:0/3841287968 >> v1:172.21.15.42:6789/0 conn(0x55957be26150 legacy=0x55957be26570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.269+0000 7f58aaeea640 1 -- 172.21.15.132:0/3841287968 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55957be2e1d0 con 0x55957be2a5e0 2024-05-08T18:51:08.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.271+0000 7f58aaeea640 1 --2- 172.21.15.132:0/3841287968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957be2a5e0 0x55957be2c9d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f589400a470 tx=0x7f589401cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265e56295d5c8d81 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.271+0000 7f58aa6e9640 1 -- 172.21.15.132:0/3841287968 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5894057070 con 0x55957be2a5e0 2024-05-08T18:51:08.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.271+0000 7f58aa6e9640 1 -- 172.21.15.132:0/3841287968 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f589404ac70 con 0x55957be2a5e0 2024-05-08T18:51:08.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.271+0000 7f58aa6e9640 1 -- 172.21.15.132:0/3841287968 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5894052440 con 0x55957be2a5e0 2024-05-08T18:51:08.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.272+0000 7f58af933800 1 -- 172.21.15.132:0/3841287968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957be2a5e0 msgr2=0x55957be2c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.272+0000 7f58af933800 1 --2- 172.21.15.132:0/3841287968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957be2a5e0 0x55957be2c9d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f589400a470 tx=0x7f589401cce0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.272+0000 7f58af933800 1 -- 172.21.15.132:0/3841287968 shutdown_connections 2024-05-08T18:51:08.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.272+0000 7f58af933800 1 --2- 172.21.15.132:0/3841287968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957be2a5e0 0x55957be2c9d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.272+0000 7f58af933800 1 -- 172.21.15.132:0/3841287968 >> 172.21.15.132:0/3841287968 conn(0x55957be21730 msgr2=0x55957be23b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.272+0000 7f58af933800 1 -- 172.21.15.132:0/3841287968 shutdown_connections 2024-05-08T18:51:08.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.272+0000 7f58af933800 1 -- 172.21.15.132:0/3841287968 wait complete. 2024-05-08T18:51:08.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.286+0000 7f58af933800 1 Processor -- start 2024-05-08T18:51:08.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.286+0000 7f58af933800 1 -- start start 2024-05-08T18:51:08.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.286+0000 7f58af933800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957be26150 0x55957bf17540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.286+0000 7f58af933800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55957bd725c0 con 0x55957be26150 2024-05-08T18:51:08.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.286+0000 7f58ab6eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957be26150 0x55957bf17540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.286+0000 7f58ab6eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957be26150 0x55957bf17540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51520/0 (socket says 172.21.15.132:51520) 2024-05-08T18:51:08.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.286+0000 7f58ab6eb640 1 -- 172.21.15.132:0/3087498498 learned_addr learned my addr 172.21.15.132:0/3087498498 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:08.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.287+0000 7f58ab6eb640 1 -- 172.21.15.132:0/3087498498 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55957bf17b10 con 0x55957be26150 2024-05-08T18:51:08.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.287+0000 7f58ab6eb640 1 --2- 172.21.15.132:0/3087498498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957be26150 0x55957bf17540 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f589c00b3d0 tx=0x7f589c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec7b4a3f72d8800 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.287+0000 7f579960a640 1 -- 172.21.15.132:0/3087498498 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f589c008070 con 0x55957be26150 2024-05-08T18:51:08.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.287+0000 7f579960a640 1 -- 172.21.15.132:0/3087498498 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f589c00d5c0 con 0x55957be26150 2024-05-08T18:51:08.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.287+0000 7f579960a640 1 -- 172.21.15.132:0/3087498498 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f589c00d8e0 con 0x55957be26150 2024-05-08T18:51:08.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.288+0000 7f58af933800 1 -- 172.21.15.132:0/3087498498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957be26150 msgr2=0x55957bf17540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.288+0000 7f58af933800 1 --2- 172.21.15.132:0/3087498498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957be26150 0x55957bf17540 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f589c00b3d0 tx=0x7f589c00b890 comp rx=0 tx=0).stop 2024-05-08T18:51:08.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.288+0000 7f58af933800 1 -- 172.21.15.132:0/3087498498 shutdown_connections 2024-05-08T18:51:08.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.288+0000 7f58af933800 1 --2- 172.21.15.132:0/3087498498 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957be26150 0x55957bf17540 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.288+0000 7f58af933800 1 -- 172.21.15.132:0/3087498498 >> 172.21.15.132:0/3087498498 conn(0x55957be21730 msgr2=0x55957bf12e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.288+0000 7f58af933800 1 -- 172.21.15.132:0/3087498498 shutdown_connections 2024-05-08T18:51:08.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.288+0000 7f58af933800 1 -- 172.21.15.132:0/3087498498 wait complete. 2024-05-08T18:51:08.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.288+0000 7f58af933800 1 Processor -- start 2024-05-08T18:51:08.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.288+0000 7f58af933800 1 -- start start 2024-05-08T18:51:08.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.288+0000 7f58af933800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957be2a5e0 0x55957bd9a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.288+0000 7f58af933800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55957be2d470 con 0x55957be2a5e0 2024-05-08T18:51:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.289+0000 7f58ab6eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957be2a5e0 0x55957bd9a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.289+0000 7f58ab6eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957be2a5e0 0x55957bd9a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51526/0 (socket says 172.21.15.132:51526) 2024-05-08T18:51:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.289+0000 7f58ab6eb640 1 -- 172.21.15.132:0/3799770623 learned_addr learned my addr 172.21.15.132:0/3799770623 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.289+0000 7f58ab6eb640 1 -- 172.21.15.132:0/3799770623 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55957bf23070 con 0x55957be2a5e0 2024-05-08T18:51:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.289+0000 7f58ab6eb640 1 --2- 172.21.15.132:0/3799770623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957be2a5e0 0x55957bd9a310 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x55957bf182d0 tx=0x7f589c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.289+0000 7f5797e07640 1 -- 172.21.15.132:0/3799770623 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f589c00f930 con 0x55957be2a5e0 2024-05-08T18:51:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.289+0000 7f5797e07640 1 -- 172.21.15.132:0/3799770623 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f589c00fad0 con 0x55957be2a5e0 2024-05-08T18:51:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.289+0000 7f58af933800 1 -- 172.21.15.132:0/3799770623 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55957bf23240 con 0x55957be2a5e0 2024-05-08T18:51:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.289+0000 7f5797e07640 1 -- 172.21.15.132:0/3799770623 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f589c00fdb0 con 0x55957be2a5e0 2024-05-08T18:51:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.289+0000 7f58af933800 1 -- 172.21.15.132:0/3799770623 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55957bf23760 con 0x55957be2a5e0 2024-05-08T18:51:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.290+0000 7f5797e07640 1 -- 172.21.15.132:0/3799770623 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f589c017040 con 0x55957be2a5e0 2024-05-08T18:51:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.290+0000 7f5797e07640 1 --2- 172.21.15.132:0/3799770623 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f579003bba0 0x7f579003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.290+0000 7f5797e07640 1 -- 172.21.15.132:0/3799770623 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f589c015020 con 0x55957be2a5e0 2024-05-08T18:51:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.291+0000 7f58aaeea640 1 --2- 172.21.15.132:0/3799770623 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f579003bba0 0x7f579003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.291+0000 7f58af933800 1 --2- 172.21.15.132:0/3799770623 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55957bf25570 0x55957bf279a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.291+0000 7f58af933800 1 -- 172.21.15.132:0/3799770623 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55957bf27f90 con 0x55957bf25570 2024-05-08T18:51:08.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.291+0000 7f58abeec640 1 --2- 172.21.15.132:0/3799770623 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55957bf25570 0x55957bf279a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.291+0000 7f58aaeea640 1 --2- 172.21.15.132:0/3799770623 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f579003bba0 0x7f579003e060 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5894054000 tx=0x7f589404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.291+0000 7f58abeec640 1 --2- 172.21.15.132:0/3799770623 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55957bf25570 0x55957bf279a0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.291+0000 7f58abeec640 1 -- 172.21.15.132:0/3799770623 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58a400a4a0 con 0x55957bf25570 2024-05-08T18:51:08.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.291+0000 7f58af933800 1 -- 172.21.15.132:0/3799770623 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55957bf24b50 con 0x55957bf25570 2024-05-08T18:51:08.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.292+0000 7f58abeec640 1 -- 172.21.15.132:0/3799770623 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f58a400a4a0 con 0x55957bf25570 2024-05-08T18:51:08.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.292+0000 7f58af933800 1 --2- 172.21.15.132:0/3799770623 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55957bf2a2e0 0x55957bf2c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.292+0000 7f58af933800 1 -- 172.21.15.132:0/3799770623 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55957bf2cd70 con 0x55957bf2a2e0 2024-05-08T18:51:08.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.292+0000 7f58ab6eb640 1 --2- 172.21.15.132:0/3799770623 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55957bf2a2e0 0x55957bf2c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.292+0000 7f58ab6eb640 1 --2- 172.21.15.132:0/3799770623 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55957bf2a2e0 0x55957bf2c6d0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.292+0000 7f58ab6eb640 1 -- 172.21.15.132:0/3799770623 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f589c04ad70 con 0x55957bf2a2e0 2024-05-08T18:51:08.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.292+0000 7f58af933800 1 -- 172.21.15.132:0/3799770623 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55957bf29180 con 0x55957bf25570 2024-05-08T18:51:08.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.292+0000 7f58abeec640 1 -- 172.21.15.132:0/3799770623 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f58a400a4a0 con 0x55957bf25570 2024-05-08T18:51:08.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.292+0000 7f58af933800 1 -- 172.21.15.132:0/3799770623 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55957bf29660 con 0x55957bf25570 2024-05-08T18:51:08.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.293+0000 7f58abeec640 1 -- 172.21.15.132:0/3799770623 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f58a400a4a0 con 0x55957bf25570 2024-05-08T18:51:08.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.293+0000 7f58af933800 1 Processor -- start 2024-05-08T18:51:08.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.293+0000 7f58af933800 1 -- start start 2024-05-08T18:51:08.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.293+0000 7f58af933800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957bf20c00 0x55957bf1f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.293+0000 7f58af933800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55957bd18fc0 con 0x55957bf20c00 2024-05-08T18:51:08.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.294+0000 7f58abeec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957bf20c00 0x55957bf1f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.294+0000 7f58abeec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957bf20c00 0x55957bf1f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51536/0 (socket says 172.21.15.132:51536) 2024-05-08T18:51:08.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.294+0000 7f58abeec640 1 -- 172.21.15.132:0/2761141972 learned_addr learned my addr 172.21.15.132:0/2761141972 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:08.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.294+0000 7f58abeec640 1 -- 172.21.15.132:0/2761141972 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55957bf1f5b0 con 0x55957bf20c00 2024-05-08T18:51:08.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.294+0000 7f58abeec640 1 --2- 172.21.15.132:0/2761141972 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957bf20c00 0x55957bf1f070 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x55957bd99d00 tx=0x7f58a40188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.294+0000 7f5795602640 1 -- 172.21.15.132:0/2761141972 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58a4014450 con 0x55957bf20c00 2024-05-08T18:51:08.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.294+0000 7f5795602640 1 -- 172.21.15.132:0/2761141972 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a40145f0 con 0x55957bf20c00 2024-05-08T18:51:08.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.294+0000 7f58af933800 1 -- 172.21.15.132:0/2761141972 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55957bf1f840 con 0x55957bf20c00 2024-05-08T18:51:08.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.294+0000 7f5795602640 1 -- 172.21.15.132:0/2761141972 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58a40148d0 con 0x55957bf20c00 2024-05-08T18:51:08.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.294+0000 7f58af933800 1 -- 172.21.15.132:0/2761141972 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55957bf1fd40 con 0x55957bf20c00 2024-05-08T18:51:08.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.295+0000 7f5795602640 1 -- 172.21.15.132:0/2761141972 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f58a4011040 con 0x55957bf20c00 2024-05-08T18:51:08.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.295+0000 7f5795602640 1 --2- 172.21.15.132:0/2761141972 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f578403bb50 0x7f578403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.295+0000 7f5795602640 1 -- 172.21.15.132:0/2761141972 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f58a401e070 con 0x55957bf20c00 2024-05-08T18:51:08.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.295+0000 7f58ab6eb640 1 --2- 172.21.15.132:0/2761141972 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f578403bb50 0x7f578403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.296+0000 7f58af933800 1 Processor -- start 2024-05-08T18:51:08.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.296+0000 7f58af933800 1 -- start start 2024-05-08T18:51:08.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.296+0000 7f58ab6eb640 1 --2- 172.21.15.132:0/2761141972 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f578403bb50 0x7f578403e010 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55957bf28400 tx=0x7f589c0516d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.296+0000 7f58af933800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957bf4b200 0x55957bf4b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.296+0000 7f58af933800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55957bf17e90 con 0x55957bf4b200 2024-05-08T18:51:08.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.296+0000 7f58abeec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957bf4b200 0x55957bf4b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.296+0000 7f58abeec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957bf4b200 0x55957bf4b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51552/0 (socket says 172.21.15.132:51552) 2024-05-08T18:51:08.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.296+0000 7f58abeec640 1 -- 172.21.15.132:0/97086840 learned_addr learned my addr 172.21.15.132:0/97086840 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:08.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.296+0000 7f58abeec640 1 -- 172.21.15.132:0/97086840 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55957bf4bbf0 con 0x55957bf4b200 2024-05-08T18:51:08.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.297+0000 7f58abeec640 1 --2- 172.21.15.132:0/97086840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957bf4b200 0x55957bf4b620 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f58a4005a80 tx=0x7f58a40118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24169d3600fcbbed server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.297+0000 7f578effd640 1 -- 172.21.15.132:0/97086840 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58a4044020 con 0x55957bf4b200 2024-05-08T18:51:08.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.297+0000 7f578effd640 1 -- 172.21.15.132:0/97086840 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a4047070 con 0x55957bf4b200 2024-05-08T18:51:08.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.297+0000 7f578effd640 1 -- 172.21.15.132:0/97086840 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58a4011d50 con 0x55957bf4b200 2024-05-08T18:51:08.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.297+0000 7f58af933800 1 -- 172.21.15.132:0/97086840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957bf4b200 msgr2=0x55957bf4b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.297+0000 7f58af933800 1 --2- 172.21.15.132:0/97086840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957bf4b200 0x55957bf4b620 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f58a4005a80 tx=0x7f58a40118e0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.297+0000 7f58af933800 1 -- 172.21.15.132:0/97086840 shutdown_connections 2024-05-08T18:51:08.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.297+0000 7f58af933800 1 --2- 172.21.15.132:0/97086840 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957bf4b200 0x55957bf4b620 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.297+0000 7f58af933800 1 -- 172.21.15.132:0/97086840 >> 172.21.15.132:0/97086840 conn(0x55957bf47560 msgr2=0x55957bf455c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.297+0000 7f58af933800 1 -- 172.21.15.132:0/97086840 shutdown_connections 2024-05-08T18:51:08.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.297+0000 7f58af933800 1 -- 172.21.15.132:0/97086840 wait complete. 2024-05-08T18:51:08.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.297+0000 7f58af933800 1 Processor -- start 2024-05-08T18:51:08.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.298+0000 7f58af933800 1 -- start start 2024-05-08T18:51:08.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.298+0000 7f58af933800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957bf4b200 0x55957bf527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.298+0000 7f58af933800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55957bf4c360 con 0x55957bf4b200 2024-05-08T18:51:08.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.298+0000 7f58abeec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957bf4b200 0x55957bf527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.298+0000 7f58abeec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957bf4b200 0x55957bf527f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51566/0 (socket says 172.21.15.132:51566) 2024-05-08T18:51:08.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.298+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 learned_addr learned my addr 172.21.15.132:0/517696107 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:08.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.298+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55957bf52d30 con 0x55957bf4b200 2024-05-08T18:51:08.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.298+0000 7f58abeec640 1 --2- 172.21.15.132:0/517696107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957bf4b200 0x55957bf527f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f58a4051b20 tx=0x7f58a4052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.298+0000 7f578d7fa640 1 -- 172.21.15.132:0/517696107 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58a40407d0 con 0x55957bf4b200 2024-05-08T18:51:08.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.298+0000 7f578d7fa640 1 -- 172.21.15.132:0/517696107 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a4040970 con 0x55957bf4b200 2024-05-08T18:51:08.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.298+0000 7f578d7fa640 1 -- 172.21.15.132:0/517696107 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f58a4040c90 con 0x55957bf4b200 2024-05-08T18:51:08.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.298+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55957bf52fc0 con 0x55957bf4b200 2024-05-08T18:51:08.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.298+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55957bf55c70 con 0x55957bf4b200 2024-05-08T18:51:08.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.299+0000 7f578d7fa640 1 -- 172.21.15.132:0/517696107 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f58a4054890 con 0x55957bf4b200 2024-05-08T18:51:08.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.300+0000 7f578d7fa640 1 --2- 172.21.15.132:0/517696107 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f577403bb50 0x7f577403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.300+0000 7f578d7fa640 1 -- 172.21.15.132:0/517696107 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f58a400e040 con 0x55957bf4b200 2024-05-08T18:51:08.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.300+0000 7f58ab6eb640 1 --2- 172.21.15.132:0/517696107 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f577403bb50 0x7f577403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.300+0000 7f58ab6eb640 1 --2- 172.21.15.132:0/517696107 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f577403bb50 0x7f577403e010 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f589c01ae10 tx=0x7f589c053050 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.300+0000 7f58af933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.300+0000 7f58af933800 1 --2- 172.21.15.132:0/517696107 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55957bf5e4b0 0x55957bf60970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.300+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55957bf610c0 con 0x55957bf5e4b0 2024-05-08T18:51:08.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.300+0000 7f58aaeea640 1 --2- 172.21.15.132:0/517696107 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55957bf5e4b0 0x55957bf60970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.301+0000 7f58aaeea640 1 --2- 172.21.15.132:0/517696107 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55957bf5e4b0 0x55957bf60970 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.301+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.301+0000 7f58af933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.301+0000 7f58af933800 20 realm 2024-05-08T18:51:08.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.301+0000 7f58af933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.301+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55957bf614f0 con 0x55957bf5e4b0 2024-05-08T18:51:08.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.301+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.301+0000 7f58af933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.301+0000 7f58af933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:08.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.301+0000 7f58af933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.301+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55957bf61dc0 con 0x55957bf5e4b0 2024-05-08T18:51:08.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.301+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.301+0000 7f58af933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.301+0000 7f58af933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.301+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55957bf62160 con 0x55957bf5e4b0 2024-05-08T18:51:08.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.302+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.302+0000 7f58af933800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:08.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.302+0000 7f58af933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.302+0000 7f58af933800 1 --2- 172.21.15.132:0/517696107 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55957bf62ec0 0x55957bf652b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.302+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55957bf658c0 con 0x55957bf62ec0 2024-05-08T18:51:08.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.302+0000 7f58abeec640 1 --2- 172.21.15.132:0/517696107 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55957bf62ec0 0x55957bf652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.302+0000 7f58abeec640 1 --2- 172.21.15.132:0/517696107 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55957bf62ec0 0x55957bf652b0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.302+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f58a403b020 con 0x55957bf62ec0 2024-05-08T18:51:08.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.302+0000 7f58af933800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:08.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.302+0000 7f58af933800 20 searching for the correct realm 2024-05-08T18:51:08.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.302+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957bf62ec0 2024-05-08T18:51:08.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.303+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a403b020 con 0x55957bf62ec0 2024-05-08T18:51:08.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.303+0000 7f58abeec640 1 --2- 172.21.15.132:0/517696107 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f58a4014070 0x7f58a40363f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.303+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x7f58a4014070 2024-05-08T18:51:08.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.303+0000 7f58ab6eb640 1 --2- 172.21.15.132:0/517696107 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f58a4014070 0x7f58a40363f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.303+0000 7f58ab6eb640 1 --2- 172.21.15.132:0/517696107 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f58a4014070 0x7f58a40363f0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.303+0000 7f58ab6eb640 1 -- 172.21.15.132:0/517696107 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589c04ad70 con 0x7f58a4014070 2024-05-08T18:51:08.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.303+0000 7f58ab6eb640 1 --2- 172.21.15.132:0/517696107 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x55957be26150 0x7f589c01c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.303+0000 7f58ab6eb640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957be26150 2024-05-08T18:51:08.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.304+0000 7f58aaeea640 1 --2- 172.21.15.132:0/517696107 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x55957be26150 0x7f589c01c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.304+0000 7f58aaeea640 1 --2- 172.21.15.132:0/517696107 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x55957be26150 0x7f589c01c830 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.304+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589405a040 con 0x55957be26150 2024-05-08T18:51:08.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.304+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957bf5e4b0 2024-05-08T18:51:08.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.304+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.304+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957bf5e4b0 2024-05-08T18:51:08.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.305+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.305+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957be26150 2024-05-08T18:51:08.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.305+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589405a040 con 0x55957be26150 2024-05-08T18:51:08.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.305+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957be26150 2024-05-08T18:51:08.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.305+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589405a040 con 0x55957be26150 2024-05-08T18:51:08.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.305+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x7f58a4014070 2024-05-08T18:51:08.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.305+0000 7f58ab6eb640 1 -- 172.21.15.132:0/517696107 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589c04ad70 con 0x7f58a4014070 2024-05-08T18:51:08.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.305+0000 7f58ab6eb640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957bf62ec0 2024-05-08T18:51:08.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.306+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a403b020 con 0x55957bf62ec0 2024-05-08T18:51:08.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.306+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957bf5e4b0 2024-05-08T18:51:08.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.306+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.306+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957be26150 2024-05-08T18:51:08.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.306+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589405a040 con 0x55957be26150 2024-05-08T18:51:08.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.306+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957bf5e4b0 2024-05-08T18:51:08.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.306+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.306+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x7f58a4014070 2024-05-08T18:51:08.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.307+0000 7f58ab6eb640 1 -- 172.21.15.132:0/517696107 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f589c04ad70 con 0x7f58a4014070 2024-05-08T18:51:08.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.307+0000 7f58ab6eb640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957bf62ec0 2024-05-08T18:51:08.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.307+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f58a403b020 con 0x55957bf62ec0 2024-05-08T18:51:08.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.307+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957bf62ec0 2024-05-08T18:51:08.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.307+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a403b020 con 0x55957bf62ec0 2024-05-08T18:51:08.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.307+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957be26150 2024-05-08T18:51:08.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.307+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589405a040 con 0x55957be26150 2024-05-08T18:51:08.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.307+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957bf62ec0 2024-05-08T18:51:08.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.308+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a403b020 con 0x55957bf62ec0 2024-05-08T18:51:08.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.308+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957bf62ec0 2024-05-08T18:51:08.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.308+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a403b020 con 0x55957bf62ec0 2024-05-08T18:51:08.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.308+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957bf5e4b0 2024-05-08T18:51:08.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.308+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.308+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957bf5e4b0 2024-05-08T18:51:08.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.308+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.308+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957be26150 2024-05-08T18:51:08.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.309+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589405a040 con 0x55957be26150 2024-05-08T18:51:08.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.309+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957bf62ec0 2024-05-08T18:51:08.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.309+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a403b020 con 0x55957bf62ec0 2024-05-08T18:51:08.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.309+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x7f58a4014070 2024-05-08T18:51:08.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.309+0000 7f58ab6eb640 1 -- 172.21.15.132:0/517696107 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589c04ad70 con 0x7f58a4014070 2024-05-08T18:51:08.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.309+0000 7f58ab6eb640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957bf5e4b0 2024-05-08T18:51:08.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.309+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.309+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957be26150 2024-05-08T18:51:08.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.310+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589405a040 con 0x55957be26150 2024-05-08T18:51:08.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.310+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957bf62ec0 2024-05-08T18:51:08.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.310+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a403b020 con 0x55957bf62ec0 2024-05-08T18:51:08.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.310+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957be26150 2024-05-08T18:51:08.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.310+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589405a040 con 0x55957be26150 2024-05-08T18:51:08.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.310+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x7f58a4014070 2024-05-08T18:51:08.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.311+0000 7f58ab6eb640 1 -- 172.21.15.132:0/517696107 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589c04ad70 con 0x7f58a4014070 2024-05-08T18:51:08.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.311+0000 7f58ab6eb640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957bf62ec0 2024-05-08T18:51:08.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.311+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58a403b020 con 0x55957bf62ec0 2024-05-08T18:51:08.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.311+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957be26150 2024-05-08T18:51:08.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.311+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589405a040 con 0x55957be26150 2024-05-08T18:51:08.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.311+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x55957bf5e4b0 2024-05-08T18:51:08.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.311+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.311+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55957bf671d0 con 0x7f58a4014070 2024-05-08T18:51:08.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58ab6eb640 1 -- 172.21.15.132:0/517696107 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f589c04ad70 con 0x7f58a4014070 2024-05-08T18:51:08.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:08.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:08.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:08.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:08.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:08.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:08.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55957bf66da0 con 0x55957bf5e4b0 2024-05-08T18:51:08.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55957bf66230 con 0x55957bf5e4b0 2024-05-08T18:51:08.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:08.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55957bf666d0 con 0x55957bf5e4b0 2024-05-08T18:51:08.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:08.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 20 zone default found 2024-05-08T18:51:08.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 4 Realm: () 2024-05-08T18:51:08.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:08.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:08.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:08.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 20 zonegroup default 2024-05-08T18:51:08.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.312+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55957bf67670 con 0x55957be26150 2024-05-08T18:51:08.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.313+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957be26150 2024-05-08T18:51:08.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.313+0000 7f58af933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.313+0000 7f58af933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.313+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55957bf69490 con 0x55957bf62ec0 2024-05-08T18:51:08.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.313+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f58a403b020 con 0x55957bf62ec0 2024-05-08T18:51:08.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.313+0000 7f58af933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.313+0000 7f58af933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.313+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55957bf69830 con 0x55957bf62ec0 2024-05-08T18:51:08.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.313+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f58a403b020 con 0x55957bf62ec0 2024-05-08T18:51:08.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.314+0000 7f58af933800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.314+0000 7f58af933800 20 started sync module instance, tier type = 2024-05-08T18:51:08.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.314+0000 7f58af933800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:08.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.314+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf68930 con 0x7f58a4014070 2024-05-08T18:51:08.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.315+0000 7f58ab6eb640 1 -- 172.21.15.132:0/517696107 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589c04ad70 con 0x7f58a4014070 2024-05-08T18:51:08.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.315+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94100518243616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf68590 con 0x7f58a4014070 2024-05-08T18:51:08.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.315+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6a650 con 0x55957bf5e4b0 2024-05-08T18:51:08.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.316+0000 7f58ab6eb640 1 -- 172.21.15.132:0/517696107 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94100518243616] v25'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589c04ad70 con 0x7f58a4014070 2024-05-08T18:51:08.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.316+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.316+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94100518247568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6aa40 con 0x55957bf5e4b0 2024-05-08T18:51:08.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.316+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6b480 con 0x55957bf62ec0 2024-05-08T18:51:08.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.317+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94100518247568] v25'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.318+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58a403b020 con 0x55957bf62ec0 2024-05-08T18:51:08.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.318+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94100518252368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6b440 con 0x55957bf62ec0 2024-05-08T18:51:08.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.318+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6bf00 con 0x7f58a4014070 2024-05-08T18:51:08.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.319+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94100518252368] v25'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58a403b020 con 0x55957bf62ec0 2024-05-08T18:51:08.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.319+0000 7f58ab6eb640 1 -- 172.21.15.132:0/517696107 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589c04ad70 con 0x7f58a4014070 2024-05-08T18:51:08.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.319+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94100518248624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6c2f0 con 0x7f58a4014070 2024-05-08T18:51:08.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.319+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6cd70 con 0x55957bf5e4b0 2024-05-08T18:51:08.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.320+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.320+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94100518258784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6cd70 con 0x55957bf5e4b0 2024-05-08T18:51:08.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.320+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6dd60 con 0x55957be26150 2024-05-08T18:51:08.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.320+0000 7f58ab6eb640 1 -- 172.21.15.132:0/517696107 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94100518248624] v25'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589c04ad70 con 0x7f58a4014070 2024-05-08T18:51:08.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.321+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94100518258784] v25'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.321+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957be26150 2024-05-08T18:51:08.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.321+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94100518262832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6cf50 con 0x55957be26150 2024-05-08T18:51:08.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.321+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6e600 con 0x55957be26150 2024-05-08T18:51:08.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.322+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94100518262832] v25'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957be26150 2024-05-08T18:51:08.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.322+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957be26150 2024-05-08T18:51:08.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.323+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94100518255120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6cf50 con 0x55957be26150 2024-05-08T18:51:08.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.323+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6ec20 con 0x55957be26150 2024-05-08T18:51:08.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.323+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94100518255120] v25'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957be26150 2024-05-08T18:51:08.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.324+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957be26150 2024-05-08T18:51:08.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.324+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94100518264912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6ec20 con 0x55957be26150 2024-05-08T18:51:08.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.324+0000 7f58af933800 20 add_watcher() i=0 2024-05-08T18:51:08.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.324+0000 7f58af933800 20 add_watcher() i=1 2024-05-08T18:51:08.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.324+0000 7f58af933800 20 add_watcher() i=2 2024-05-08T18:51:08.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.324+0000 7f58af933800 20 add_watcher() i=3 2024-05-08T18:51:08.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.324+0000 7f58af933800 20 add_watcher() i=4 2024-05-08T18:51:08.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.324+0000 7f58af933800 20 add_watcher() i=5 2024-05-08T18:51:08.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.324+0000 7f58af933800 20 add_watcher() i=6 2024-05-08T18:51:08.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.325+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94100518264912] v25'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957be26150 2024-05-08T18:51:08.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.325+0000 7f58af933800 20 add_watcher() i=7 2024-05-08T18:51:08.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.325+0000 7f58af933800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:08.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.325+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55957bf71f50 con 0x55957bf5e4b0 2024-05-08T18:51:08.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.325+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.325+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94100518267104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6f1b0 con 0x55957bf5e4b0 2024-05-08T18:51:08.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.326+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94100518267104] v25'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.326+0000 7f5761fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:08.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.326+0000 7f58af933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:08.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.326+0000 7f58af933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:08.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.326+0000 7f58af933800 5 note: GC not initialized 2024-05-08T18:51:08.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.326+0000 7f5760fe1640 20 reqs_thread_entry: start 2024-05-08T18:51:08.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.327+0000 7f58af933800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:08.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.327+0000 7f58af933800 20 Filter name: none 2024-05-08T18:51:08.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.327+0000 7f56da7fc640 20 reqs_thread_entry: start 2024-05-08T18:51:08.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.327+0000 7f58af933800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:51:08.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.327+0000 7f58af933800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.327+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55957bfa5470 con 0x55957bf5e4b0 2024-05-08T18:51:08.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.327+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.327+0000 7f58af933800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:51:08.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.327+0000 7f58af933800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:51:08.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.327+0000 7f58af933800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:51:08.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.327+0000 7f58af933800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:51:08.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.327+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bfab560 con 0x55957bf5e4b0 2024-05-08T18:51:08.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.328+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v25'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.328+0000 7f58af933800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:51:08.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.328+0000 7f58af933800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:51:08.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.328+0000 7f58af933800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:51:08.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.328+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94100518514496 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55957bfa6d90 con 0x55957bf5e4b0 2024-05-08T18:51:08.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.329+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== watch-notify(notify (1) cookie 94100518258784 notify 107374182416 ret 0) ==== 621+0+0 (crc 0 0 0) 0x7f5894080040 con 0x55957bf5e4b0 2024-05-08T18:51:08.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.329+0000 7f578effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182416 cookie 94100518258784 notifier 4648 bl.length()=579 2024-05-08T18:51:08.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.329+0000 7f578effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:51:08.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.329+0000 7f578effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:51:08.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.329+0000 7f578effd640 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f5770003ea0 con 0x55957bf5e4b0 2024-05-08T18:51:08.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.329+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(64 notify.4 [notify cookie 94100518514496 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.329+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.329+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== watch-notify(notify_complete (2) cookie 94100518514496 notify 107374182416 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55957be2e1d0 con 0x55957bf5e4b0 2024-05-08T18:51:08.341 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:50:44.835566Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:44.835553Z","tags":[],"group_ids":[]} 2024-05-08T18:51:08.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.330+0000 7f5761fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:08.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.330+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94100518267104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf715b0 con 0x55957bf5e4b0 2024-05-08T18:51:08.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.331+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94100518267104] v25'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.331+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94100518243616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6e8e0 con 0x7f58a4014070 2024-05-08T18:51:08.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.332+0000 7f58ab6eb640 1 -- 172.21.15.132:0/517696107 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94100518243616] v25'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589c04ad70 con 0x7f58a4014070 2024-05-08T18:51:08.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.332+0000 7f58af933800 20 remove_watcher() i=0 2024-05-08T18:51:08.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.332+0000 7f58af933800 2 removed watcher, disabling cache 2024-05-08T18:51:08.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.332+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94100518247568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6e8e0 con 0x55957bf5e4b0 2024-05-08T18:51:08.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.333+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94100518247568] v25'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.333+0000 7f58af933800 20 remove_watcher() i=1 2024-05-08T18:51:08.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.333+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94100518252368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6e8e0 con 0x55957bf62ec0 2024-05-08T18:51:08.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.334+0000 7f58abeec640 1 -- 172.21.15.132:0/517696107 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94100518252368] v25'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58a403b020 con 0x55957bf62ec0 2024-05-08T18:51:08.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.334+0000 7f58af933800 20 remove_watcher() i=2 2024-05-08T18:51:08.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.334+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94100518248624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6af50 con 0x7f58a4014070 2024-05-08T18:51:08.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.335+0000 7f58ab6eb640 1 -- 172.21.15.132:0/517696107 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94100518248624] v25'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589c04ad70 con 0x7f58a4014070 2024-05-08T18:51:08.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.335+0000 7f58af933800 20 remove_watcher() i=3 2024-05-08T18:51:08.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.335+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94100518258784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6af50 con 0x55957bf5e4b0 2024-05-08T18:51:08.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.336+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94100518258784] v25'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957bf5e4b0 2024-05-08T18:51:08.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.336+0000 7f58af933800 20 remove_watcher() i=4 2024-05-08T18:51:08.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.336+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94100518262832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6af50 con 0x55957be26150 2024-05-08T18:51:08.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.337+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94100518262832] v25'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957be26150 2024-05-08T18:51:08.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.337+0000 7f58af933800 20 remove_watcher() i=5 2024-05-08T18:51:08.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.337+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94100518255120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6d830 con 0x55957be26150 2024-05-08T18:51:08.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.338+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94100518255120] v25'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957be26150 2024-05-08T18:51:08.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.338+0000 7f58af933800 20 remove_watcher() i=6 2024-05-08T18:51:08.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.338+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94100518264912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55957bf6af50 con 0x55957be26150 2024-05-08T18:51:08.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.339+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94100518264912] v25'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f589405a040 con 0x55957be26150 2024-05-08T18:51:08.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.339+0000 7f58af933800 20 remove_watcher() i=7 2024-05-08T18:51:08.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.339+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x55957be26150 msgr2=0x7f589c01c830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.339+0000 7f58af933800 1 --2- 172.21.15.132:0/517696107 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x55957be26150 0x7f589c01c830 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.339+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55957bf5e4b0 msgr2=0x55957bf60970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.339+0000 7f58af933800 1 --2- 172.21.15.132:0/517696107 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55957bf5e4b0 0x55957bf60970 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.339+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f58a4014070 msgr2=0x7f58a40363f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.339+0000 7f58af933800 1 --2- 172.21.15.132:0/517696107 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f58a4014070 0x7f58a40363f0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.339+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55957bf62ec0 msgr2=0x55957bf652b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.339+0000 7f58af933800 1 --2- 172.21.15.132:0/517696107 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55957bf62ec0 0x55957bf652b0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.339+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f577403bb50 msgr2=0x7f577403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.339+0000 7f58af933800 1 --2- 172.21.15.132:0/517696107 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f577403bb50 0x7f577403e010 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f589c01ae10 tx=0x7f589c053050 comp rx=0 tx=0).stop 2024-05-08T18:51:08.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.339+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957bf4b200 msgr2=0x55957bf527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.339+0000 7f58af933800 1 --2- 172.21.15.132:0/517696107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957bf4b200 0x55957bf527f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f58a4051b20 tx=0x7f58a4052be0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.339+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 reap_dead start 2024-05-08T18:51:08.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.339+0000 7f58aaeea640 1 -- 172.21.15.132:0/517696107 reap_dead start 2024-05-08T18:51:08.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.339+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 shutdown_connections 2024-05-08T18:51:08.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.339+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 >> 172.21.15.132:0/517696107 conn(0x55957bf47560 msgr2=0x55957bf44bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 shutdown_connections 2024-05-08T18:51:08.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 -- 172.21.15.132:0/517696107 wait complete. 2024-05-08T18:51:08.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 -- 172.21.15.132:0/2761141972 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f578403bb50 msgr2=0x7f578403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 --2- 172.21.15.132:0/2761141972 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f578403bb50 0x7f578403e010 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55957bf28400 tx=0x7f589c0516d0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 -- 172.21.15.132:0/2761141972 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957bf20c00 msgr2=0x55957bf1f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 --2- 172.21.15.132:0/2761141972 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957bf20c00 0x55957bf1f070 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x55957bd99d00 tx=0x7f58a40188f0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 -- 172.21.15.132:0/2761141972 shutdown_connections 2024-05-08T18:51:08.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 --2- 172.21.15.132:0/2761141972 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f578403bb50 0x7f578403e010 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 --2- 172.21.15.132:0/2761141972 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957bf20c00 0x55957bf1f070 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 -- 172.21.15.132:0/2761141972 >> 172.21.15.132:0/2761141972 conn(0x55957bf2fd90 msgr2=0x55957bf30190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 -- 172.21.15.132:0/2761141972 shutdown_connections 2024-05-08T18:51:08.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 -- 172.21.15.132:0/2761141972 wait complete. 2024-05-08T18:51:08.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 -- 172.21.15.132:0/3799770623 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55957bf25570 msgr2=0x55957bf279a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 --2- 172.21.15.132:0/3799770623 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55957bf25570 0x55957bf279a0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 -- 172.21.15.132:0/3799770623 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55957bf2a2e0 msgr2=0x55957bf2c6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 --2- 172.21.15.132:0/3799770623 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55957bf2a2e0 0x55957bf2c6d0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 -- 172.21.15.132:0/3799770623 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f579003bba0 msgr2=0x7f579003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 --2- 172.21.15.132:0/3799770623 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f579003bba0 0x7f579003e060 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5894054000 tx=0x7f589404e000 comp rx=0 tx=0).stop 2024-05-08T18:51:08.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 -- 172.21.15.132:0/3799770623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957be2a5e0 msgr2=0x55957bd9a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 --2- 172.21.15.132:0/3799770623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957be2a5e0 0x55957bd9a310 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x55957bf182d0 tx=0x7f589c000bc0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 -- 172.21.15.132:0/3799770623 shutdown_connections 2024-05-08T18:51:08.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 --2- 172.21.15.132:0/3799770623 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55957bf2a2e0 0x55957bf2c6d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 --2- 172.21.15.132:0/3799770623 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55957bf25570 0x55957bf279a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 --2- 172.21.15.132:0/3799770623 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f579003bba0 0x7f579003e060 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 --2- 172.21.15.132:0/3799770623 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55957be2a5e0 0x55957bd9a310 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.340+0000 7f58af933800 1 -- 172.21.15.132:0/3799770623 >> 172.21.15.132:0/3799770623 conn(0x55957be21730 msgr2=0x55957bf11660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.341+0000 7f58af933800 1 -- 172.21.15.132:0/3799770623 shutdown_connections 2024-05-08T18:51:08.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.341+0000 7f58af933800 1 -- 172.21.15.132:0/3799770623 wait complete. 2024-05-08T18:51:08.353 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:50:44.835566Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:44.835553Z', 'tags': [], 'group_ids': []} 2024-05-08T18:51:08.353 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-05-08T18:51:08.354 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-05-08T18:51:08.354 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-05-08T18:51:08.399 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:08.400 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:08.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.401+0000 7f2062735800 1 Processor -- start 2024-05-08T18:51:08.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.401+0000 7f2062735800 1 -- start start 2024-05-08T18:51:08.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.401+0000 7f2062735800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55d5fe4587f0 0x55d5fe45abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.401+0000 7f2062735800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d5fe45b120 con 0x55d5fe454ce0 2024-05-08T18:51:08.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.401+0000 7f2062735800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55d5fe2f4e20 con 0x55d5fe4587f0 2024-05-08T18:51:08.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.402+0000 7f205dbad640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55d5fe4587f0 0x55d5fe45abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.402+0000 7f205e3ae640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55d5fe454ce0 0x55d5fe4570d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:55738/0 (socket says 172.21.15.132:55738) 2024-05-08T18:51:08.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.402+0000 7f205e3ae640 1 -- 172.21.15.132:0/3640535974 learned_addr learned my addr 172.21.15.132:0/3640535974 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:51:08.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.402+0000 7f205dbad640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55d5fe4587f0 0x55d5fe45abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51578/0 (socket says 172.21.15.132:51578) 2024-05-08T18:51:08.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.402+0000 7f205dbad640 1 -- 172.21.15.132:0/3640535974 >> v1:172.21.15.42:6789/0 conn(0x55d5fe454ce0 legacy=0x55d5fe4570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.402+0000 7f205d3ac640 1 -- 172.21.15.132:0/3640535974 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 744134930 0 0) 0x55d5fe45b120 con 0x55d5fe454ce0 2024-05-08T18:51:08.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.402+0000 7f205dbad640 1 -- 172.21.15.132:0/3640535974 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5fe45c300 con 0x55d5fe4587f0 2024-05-08T18:51:08.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.404+0000 7f205dbad640 1 --2- 172.21.15.132:0/3640535974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe4587f0 0x55d5fe45abe0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f205400a470 tx=0x7f205401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a347105c8ffcecd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.404+0000 7f205d3ac640 1 -- 172.21.15.132:0/3640535974 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2054057070 con 0x55d5fe4587f0 2024-05-08T18:51:08.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.404+0000 7f205d3ac640 1 -- 172.21.15.132:0/3640535974 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2054052570 con 0x55d5fe4587f0 2024-05-08T18:51:08.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.404+0000 7f205d3ac640 1 -- 172.21.15.132:0/3640535974 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2054052870 con 0x55d5fe4587f0 2024-05-08T18:51:08.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.405+0000 7f2062735800 1 -- 172.21.15.132:0/3640535974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe4587f0 msgr2=0x55d5fe45abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.405+0000 7f2062735800 1 --2- 172.21.15.132:0/3640535974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe4587f0 0x55d5fe45abe0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f205400a470 tx=0x7f205401ce90 comp rx=0 tx=0).stop 2024-05-08T18:51:08.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.405+0000 7f2062735800 1 -- 172.21.15.132:0/3640535974 shutdown_connections 2024-05-08T18:51:08.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.405+0000 7f2062735800 1 --2- 172.21.15.132:0/3640535974 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe4587f0 0x55d5fe45abe0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.405+0000 7f2062735800 1 -- 172.21.15.132:0/3640535974 >> 172.21.15.132:0/3640535974 conn(0x55d5fe44e730 msgr2=0x55d5fe450b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.405+0000 7f2062735800 1 -- 172.21.15.132:0/3640535974 shutdown_connections 2024-05-08T18:51:08.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.405+0000 7f2062735800 1 -- 172.21.15.132:0/3640535974 wait complete. 2024-05-08T18:51:08.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.419+0000 7f2062735800 1 Processor -- start 2024-05-08T18:51:08.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.419+0000 7f2062735800 1 -- start start 2024-05-08T18:51:08.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.419+0000 7f2062735800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe454ce0 0x55d5fe454620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.419+0000 7f2062735800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d5fe39f5c0 con 0x55d5fe454ce0 2024-05-08T18:51:08.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.419+0000 7f205e3ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe454ce0 0x55d5fe454620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.419+0000 7f205e3ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe454ce0 0x55d5fe454620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51580/0 (socket says 172.21.15.132:51580) 2024-05-08T18:51:08.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.419+0000 7f205e3ae640 1 -- 172.21.15.132:0/2059751610 learned_addr learned my addr 172.21.15.132:0/2059751610 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:08.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.420+0000 7f205e3ae640 1 -- 172.21.15.132:0/2059751610 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5fe452be0 con 0x55d5fe454ce0 2024-05-08T18:51:08.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.420+0000 7f205e3ae640 1 --2- 172.21.15.132:0/2059751610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe454ce0 0x55d5fe454620 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2050001630 tx=0x7f2050001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba8428278af629d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.420+0000 7f1f4c608640 1 -- 172.21.15.132:0/2059751610 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2050003450 con 0x55d5fe454ce0 2024-05-08T18:51:08.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.420+0000 7f1f4c608640 1 -- 172.21.15.132:0/2059751610 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20500035f0 con 0x55d5fe454ce0 2024-05-08T18:51:08.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.420+0000 7f1f4c608640 1 -- 172.21.15.132:0/2059751610 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2050003990 con 0x55d5fe454ce0 2024-05-08T18:51:08.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.421+0000 7f2062735800 1 -- 172.21.15.132:0/2059751610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe454ce0 msgr2=0x55d5fe454620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.421+0000 7f2062735800 1 --2- 172.21.15.132:0/2059751610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe454ce0 0x55d5fe454620 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2050001630 tx=0x7f2050001af0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.421+0000 7f2062735800 1 -- 172.21.15.132:0/2059751610 shutdown_connections 2024-05-08T18:51:08.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.421+0000 7f2062735800 1 --2- 172.21.15.132:0/2059751610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe454ce0 0x55d5fe454620 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.421+0000 7f2062735800 1 -- 172.21.15.132:0/2059751610 >> 172.21.15.132:0/2059751610 conn(0x55d5fe44e730 msgr2=0x55d5fe540de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.421+0000 7f2062735800 1 -- 172.21.15.132:0/2059751610 shutdown_connections 2024-05-08T18:51:08.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.421+0000 7f2062735800 1 -- 172.21.15.132:0/2059751610 wait complete. 2024-05-08T18:51:08.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.421+0000 7f2062735800 1 Processor -- start 2024-05-08T18:51:08.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.421+0000 7f2062735800 1 -- start start 2024-05-08T18:51:08.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.421+0000 7f2062735800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe454ce0 0x55d5fe54f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.421+0000 7f2062735800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d5fe45b5f0 con 0x55d5fe454ce0 2024-05-08T18:51:08.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.421+0000 7f205e3ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe454ce0 0x55d5fe54f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.421+0000 7f205e3ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe454ce0 0x55d5fe54f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51596/0 (socket says 172.21.15.132:51596) 2024-05-08T18:51:08.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.421+0000 7f205e3ae640 1 -- 172.21.15.132:0/2920009126 learned_addr learned my addr 172.21.15.132:0/2920009126 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:08.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.422+0000 7f205e3ae640 1 -- 172.21.15.132:0/2920009126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5fe54f7b0 con 0x55d5fe454ce0 2024-05-08T18:51:08.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.422+0000 7f205e3ae640 1 --2- 172.21.15.132:0/2920009126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe454ce0 0x55d5fe54f270 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2050006fa0 tx=0x7f2050001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.422+0000 7f1f4ae05640 1 -- 172.21.15.132:0/2920009126 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2050013820 con 0x55d5fe454ce0 2024-05-08T18:51:08.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.422+0000 7f1f4ae05640 1 -- 172.21.15.132:0/2920009126 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2050023070 con 0x55d5fe454ce0 2024-05-08T18:51:08.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.422+0000 7f1f4ae05640 1 -- 172.21.15.132:0/2920009126 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2050013af0 con 0x55d5fe454ce0 2024-05-08T18:51:08.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.422+0000 7f2062735800 1 -- 172.21.15.132:0/2920009126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5fe54fa40 con 0x55d5fe454ce0 2024-05-08T18:51:08.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.422+0000 7f2062735800 1 -- 172.21.15.132:0/2920009126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5fe5526f0 con 0x55d5fe454ce0 2024-05-08T18:51:08.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.423+0000 7f1f4ae05640 1 -- 172.21.15.132:0/2920009126 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2050010070 con 0x55d5fe454ce0 2024-05-08T18:51:08.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.423+0000 7f1f4ae05640 1 --2- 172.21.15.132:0/2920009126 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f4403bba0 0x7f1f4403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.423+0000 7f1f4ae05640 1 -- 172.21.15.132:0/2920009126 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f2050018070 con 0x55d5fe454ce0 2024-05-08T18:51:08.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.423+0000 7f205dbad640 1 --2- 172.21.15.132:0/2920009126 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f4403bba0 0x7f1f4403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.423+0000 7f2062735800 1 --2- 172.21.15.132:0/2920009126 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d5fe4587f0 0x55d5fe556380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.423+0000 7f2062735800 1 -- 172.21.15.132:0/2920009126 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe5569f0 con 0x55d5fe4587f0 2024-05-08T18:51:08.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.423+0000 7f205ebaf640 1 --2- 172.21.15.132:0/2920009126 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d5fe4587f0 0x55d5fe556380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.424+0000 7f205dbad640 1 --2- 172.21.15.132:0/2920009126 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f4403bba0 0x7f1f4403e060 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2054054000 tx=0x7f205404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.424+0000 7f205ebaf640 1 --2- 172.21.15.132:0/2920009126 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d5fe4587f0 0x55d5fe556380 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.424+0000 7f205ebaf640 1 -- 172.21.15.132:0/2920009126 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20580083e0 con 0x55d5fe4587f0 2024-05-08T18:51:08.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.424+0000 7f2062735800 1 -- 172.21.15.132:0/2920009126 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe553a40 con 0x55d5fe4587f0 2024-05-08T18:51:08.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.424+0000 7f205ebaf640 1 -- 172.21.15.132:0/2920009126 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20580083e0 con 0x55d5fe4587f0 2024-05-08T18:51:08.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.424+0000 7f2062735800 1 --2- 172.21.15.132:0/2920009126 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d5fe558d20 0x55d5fe55b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.424+0000 7f2062735800 1 -- 172.21.15.132:0/2920009126 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe55b7e0 con 0x55d5fe558d20 2024-05-08T18:51:08.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.424+0000 7f205e3ae640 1 --2- 172.21.15.132:0/2920009126 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d5fe558d20 0x55d5fe55b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.425+0000 7f205e3ae640 1 --2- 172.21.15.132:0/2920009126 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d5fe558d20 0x55d5fe55b110 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.425+0000 7f205e3ae640 1 -- 172.21.15.132:0/2920009126 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f205000f030 con 0x55d5fe558d20 2024-05-08T18:51:08.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.425+0000 7f2062735800 1 -- 172.21.15.132:0/2920009126 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe557bc0 con 0x55d5fe4587f0 2024-05-08T18:51:08.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.425+0000 7f205ebaf640 1 -- 172.21.15.132:0/2920009126 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f20580083e0 con 0x55d5fe4587f0 2024-05-08T18:51:08.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.425+0000 7f2062735800 1 -- 172.21.15.132:0/2920009126 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe558060 con 0x55d5fe4587f0 2024-05-08T18:51:08.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.425+0000 7f205ebaf640 1 -- 172.21.15.132:0/2920009126 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f20580083e0 con 0x55d5fe4587f0 2024-05-08T18:51:08.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.426+0000 7f2062735800 1 Processor -- start 2024-05-08T18:51:08.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.426+0000 7f2062735800 1 -- start start 2024-05-08T18:51:08.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.426+0000 7f2062735800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe56a770 0x55d5fe56ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.426+0000 7f2062735800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d5fe345fc0 con 0x55d5fe56a770 2024-05-08T18:51:08.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.426+0000 7f205ebaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe56a770 0x55d5fe56ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.426+0000 7f205ebaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe56a770 0x55d5fe56ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51600/0 (socket says 172.21.15.132:51600) 2024-05-08T18:51:08.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.426+0000 7f205ebaf640 1 -- 172.21.15.132:0/803120712 learned_addr learned my addr 172.21.15.132:0/803120712 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:08.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.427+0000 7f205ebaf640 1 -- 172.21.15.132:0/803120712 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5fe56b0d0 con 0x55d5fe56a770 2024-05-08T18:51:08.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.427+0000 7f205ebaf640 1 --2- 172.21.15.132:0/803120712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe56a770 0x55d5fe56ab90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x55d5fe550140 tx=0x7f205800aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.427+0000 7f1f43fff640 1 -- 172.21.15.132:0/803120712 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2058007d00 con 0x55d5fe56a770 2024-05-08T18:51:08.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.427+0000 7f1f43fff640 1 -- 172.21.15.132:0/803120712 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205801e020 con 0x55d5fe56a770 2024-05-08T18:51:08.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.427+0000 7f1f43fff640 1 -- 172.21.15.132:0/803120712 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2058019420 con 0x55d5fe56a770 2024-05-08T18:51:08.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.427+0000 7f2062735800 1 -- 172.21.15.132:0/803120712 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5fe56bb40 con 0x55d5fe56a770 2024-05-08T18:51:08.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.427+0000 7f2062735800 1 -- 172.21.15.132:0/803120712 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5fe56c040 con 0x55d5fe56a770 2024-05-08T18:51:08.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.428+0000 7f1f43fff640 1 -- 172.21.15.132:0/803120712 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2058016040 con 0x55d5fe56a770 2024-05-08T18:51:08.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.428+0000 7f1f43fff640 1 --2- 172.21.15.132:0/803120712 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f3803bb50 0x7f1f3803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.428+0000 7f1f43fff640 1 -- 172.21.15.132:0/803120712 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f205801f030 con 0x55d5fe56a770 2024-05-08T18:51:08.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.428+0000 7f205e3ae640 1 --2- 172.21.15.132:0/803120712 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f3803bb50 0x7f1f3803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.428+0000 7f2062735800 1 Processor -- start 2024-05-08T18:51:08.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.428+0000 7f205e3ae640 1 --2- 172.21.15.132:0/803120712 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f3803bb50 0x7f1f3803e010 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55d5fe556e50 tx=0x7f2050011f60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.428+0000 7f2062735800 1 -- start start 2024-05-08T18:51:08.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.429+0000 7f2062735800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe577b40 0x55d5fe577f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.429+0000 7f2062735800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d5fe452f60 con 0x55d5fe577b40 2024-05-08T18:51:08.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.429+0000 7f205ebaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe577b40 0x55d5fe577f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.429+0000 7f205ebaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe577b40 0x55d5fe577f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51612/0 (socket says 172.21.15.132:51612) 2024-05-08T18:51:08.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.429+0000 7f205ebaf640 1 -- 172.21.15.132:0/3857334328 learned_addr learned my addr 172.21.15.132:0/3857334328 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:08.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.429+0000 7f205ebaf640 1 -- 172.21.15.132:0/3857334328 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5fe578530 con 0x55d5fe577b40 2024-05-08T18:51:08.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.429+0000 7f205ebaf640 1 --2- 172.21.15.132:0/3857334328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe577b40 0x55d5fe577f60 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2058052fd0 tx=0x7f2058019aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9768e0726f55e0a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.429+0000 7f1f41ffb640 1 -- 172.21.15.132:0/3857334328 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205801d040 con 0x55d5fe577b40 2024-05-08T18:51:08.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.429+0000 7f1f41ffb640 1 -- 172.21.15.132:0/3857334328 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20580451f0 con 0x55d5fe577b40 2024-05-08T18:51:08.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.429+0000 7f1f41ffb640 1 -- 172.21.15.132:0/3857334328 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20580174e0 con 0x55d5fe577b40 2024-05-08T18:51:08.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.430+0000 7f2062735800 1 -- 172.21.15.132:0/3857334328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe577b40 msgr2=0x55d5fe577f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.430+0000 7f2062735800 1 --2- 172.21.15.132:0/3857334328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe577b40 0x55d5fe577f60 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2058052fd0 tx=0x7f2058019aa0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.430+0000 7f2062735800 1 -- 172.21.15.132:0/3857334328 shutdown_connections 2024-05-08T18:51:08.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.430+0000 7f2062735800 1 --2- 172.21.15.132:0/3857334328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe577b40 0x55d5fe577f60 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.430+0000 7f2062735800 1 -- 172.21.15.132:0/3857334328 >> 172.21.15.132:0/3857334328 conn(0x55d5fe573e10 msgr2=0x55d5fe571e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.430+0000 7f2062735800 1 -- 172.21.15.132:0/3857334328 shutdown_connections 2024-05-08T18:51:08.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.430+0000 7f2062735800 1 -- 172.21.15.132:0/3857334328 wait complete. 2024-05-08T18:51:08.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.430+0000 7f2062735800 1 Processor -- start 2024-05-08T18:51:08.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.430+0000 7f2062735800 1 -- start start 2024-05-08T18:51:08.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.430+0000 7f2062735800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe577b40 0x55d5fe57f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.430+0000 7f2062735800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d5fe578c80 con 0x55d5fe577b40 2024-05-08T18:51:08.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.431+0000 7f205ebaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe577b40 0x55d5fe57f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.431+0000 7f205ebaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe577b40 0x55d5fe57f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51624/0 (socket says 172.21.15.132:51624) 2024-05-08T18:51:08.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.431+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 learned_addr learned my addr 172.21.15.132:0/930214165 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:08.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.431+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5fe57f540 con 0x55d5fe577b40 2024-05-08T18:51:08.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.431+0000 7f205ebaf640 1 --2- 172.21.15.132:0/930214165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe577b40 0x55d5fe57f000 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f20580186f0 tx=0x7f2058052f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.431+0000 7f1f2ffff640 1 -- 172.21.15.132:0/930214165 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2058031070 con 0x55d5fe577b40 2024-05-08T18:51:08.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.431+0000 7f1f2ffff640 1 -- 172.21.15.132:0/930214165 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2058050040 con 0x55d5fe577b40 2024-05-08T18:51:08.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.431+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5fe57f7d0 con 0x55d5fe577b40 2024-05-08T18:51:08.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.431+0000 7f1f2ffff640 1 -- 172.21.15.132:0/930214165 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205801d070 con 0x55d5fe577b40 2024-05-08T18:51:08.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.431+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5fe582480 con 0x55d5fe577b40 2024-05-08T18:51:08.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.432+0000 7f1f2ffff640 1 -- 172.21.15.132:0/930214165 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2058034070 con 0x55d5fe577b40 2024-05-08T18:51:08.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.432+0000 7f1f2ffff640 1 --2- 172.21.15.132:0/930214165 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f2803bb50 0x7f1f2803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.432+0000 7f1f2ffff640 1 -- 172.21.15.132:0/930214165 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f205804b040 con 0x55d5fe577b40 2024-05-08T18:51:08.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.432+0000 7f205e3ae640 1 --2- 172.21.15.132:0/930214165 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f2803bb50 0x7f1f2803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.433+0000 7f205e3ae640 1 --2- 172.21.15.132:0/930214165 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f2803bb50 0x7f1f2803e010 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f20500035c0 tx=0x7f2050052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.433+0000 7f2062735800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.433+0000 7f2062735800 1 --2- 172.21.15.132:0/930214165 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d5fe58ab40 0x55d5fe58d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.433+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe58d750 con 0x55d5fe58ab40 2024-05-08T18:51:08.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.433+0000 7f205dbad640 1 --2- 172.21.15.132:0/930214165 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d5fe58ab40 0x55d5fe58d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.433+0000 7f205dbad640 1 --2- 172.21.15.132:0/930214165 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d5fe58ab40 0x55d5fe58d000 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.434+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f205405a040 con 0x55d5fe58ab40 2024-05-08T18:51:08.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.434+0000 7f2062735800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.434+0000 7f2062735800 20 realm 2024-05-08T18:51:08.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.434+0000 7f2062735800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.434+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe58db20 con 0x55d5fe58ab40 2024-05-08T18:51:08.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.434+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f205405a040 con 0x55d5fe58ab40 2024-05-08T18:51:08.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.434+0000 7f2062735800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.434+0000 7f2062735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:08.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.434+0000 7f2062735800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.434+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe58e3f0 con 0x55d5fe58ab40 2024-05-08T18:51:08.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.434+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f205405a040 con 0x55d5fe58ab40 2024-05-08T18:51:08.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.434+0000 7f2062735800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.434+0000 7f2062735800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.434+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe58e790 con 0x55d5fe58ab40 2024-05-08T18:51:08.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.434+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f205405a040 con 0x55d5fe58ab40 2024-05-08T18:51:08.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.434+0000 7f2062735800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:08.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.434+0000 7f2062735800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.434+0000 7f2062735800 1 --2- 172.21.15.132:0/930214165 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d5fe58f4f0 0x55d5fe5918e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.434+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe591ef0 con 0x55d5fe58f4f0 2024-05-08T18:51:08.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.434+0000 7f205ebaf640 1 --2- 172.21.15.132:0/930214165 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d5fe58f4f0 0x55d5fe5918e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.435+0000 7f205ebaf640 1 --2- 172.21.15.132:0/930214165 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d5fe58f4f0 0x55d5fe5918e0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.435+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f205803d070 con 0x55d5fe58f4f0 2024-05-08T18:51:08.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.435+0000 7f2062735800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:08.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.435+0000 7f2062735800 20 searching for the correct realm 2024-05-08T18:51:08.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.435+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x55d5fe58f4f0 2024-05-08T18:51:08.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.435+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205803d070 con 0x55d5fe58f4f0 2024-05-08T18:51:08.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.435+0000 7f205ebaf640 1 --2- 172.21.15.132:0/930214165 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2058036070 0x7f20580440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.435+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x7f2058036070 2024-05-08T18:51:08.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.436+0000 7f205e3ae640 1 --2- 172.21.15.132:0/930214165 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2058036070 0x7f20580440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.436+0000 7f205e3ae640 1 --2- 172.21.15.132:0/930214165 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2058036070 0x7f20580440d0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.436+0000 7f205e3ae640 1 -- 172.21.15.132:0/930214165 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205001b030 con 0x7f2058036070 2024-05-08T18:51:08.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.436+0000 7f205e3ae640 1 --2- 172.21.15.132:0/930214165 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2050052070 0x7f2050028460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.436+0000 7f205e3ae640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x7f2050052070 2024-05-08T18:51:08.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.436+0000 7f205dbad640 1 --2- 172.21.15.132:0/930214165 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2050052070 0x7f2050028460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.437+0000 7f205dbad640 1 --2- 172.21.15.132:0/930214165 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2050052070 0x7f2050028460 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.437+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205405a040 con 0x7f2050052070 2024-05-08T18:51:08.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.437+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x55d5fe58ab40 2024-05-08T18:51:08.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.437+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205405a040 con 0x55d5fe58ab40 2024-05-08T18:51:08.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.437+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x55d5fe58ab40 2024-05-08T18:51:08.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.437+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205405a040 con 0x55d5fe58ab40 2024-05-08T18:51:08.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.437+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x7f2050052070 2024-05-08T18:51:08.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.437+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205405a040 con 0x7f2050052070 2024-05-08T18:51:08.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.438+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x7f2050052070 2024-05-08T18:51:08.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.438+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205405a040 con 0x7f2050052070 2024-05-08T18:51:08.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.438+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x7f2058036070 2024-05-08T18:51:08.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.438+0000 7f205e3ae640 1 -- 172.21.15.132:0/930214165 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205001b030 con 0x7f2058036070 2024-05-08T18:51:08.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.438+0000 7f205e3ae640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x55d5fe58f4f0 2024-05-08T18:51:08.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.438+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205803d070 con 0x55d5fe58f4f0 2024-05-08T18:51:08.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.438+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x55d5fe58ab40 2024-05-08T18:51:08.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.438+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205405a040 con 0x55d5fe58ab40 2024-05-08T18:51:08.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.438+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x7f2050052070 2024-05-08T18:51:08.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.439+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205405a040 con 0x7f2050052070 2024-05-08T18:51:08.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.439+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x55d5fe58ab40 2024-05-08T18:51:08.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.439+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f205405a040 con 0x55d5fe58ab40 2024-05-08T18:51:08.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.439+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x7f2058036070 2024-05-08T18:51:08.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.439+0000 7f205e3ae640 1 -- 172.21.15.132:0/930214165 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f205001b030 con 0x7f2058036070 2024-05-08T18:51:08.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.439+0000 7f205e3ae640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x55d5fe58f4f0 2024-05-08T18:51:08.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.439+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f205803d070 con 0x55d5fe58f4f0 2024-05-08T18:51:08.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.439+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x55d5fe58f4f0 2024-05-08T18:51:08.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.440+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205803d070 con 0x55d5fe58f4f0 2024-05-08T18:51:08.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.440+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x7f2050052070 2024-05-08T18:51:08.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.440+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205405a040 con 0x7f2050052070 2024-05-08T18:51:08.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.440+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x55d5fe58f4f0 2024-05-08T18:51:08.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.440+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205803d070 con 0x55d5fe58f4f0 2024-05-08T18:51:08.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.440+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x55d5fe58f4f0 2024-05-08T18:51:08.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.441+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205803d070 con 0x55d5fe58f4f0 2024-05-08T18:51:08.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.441+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x55d5fe58ab40 2024-05-08T18:51:08.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.441+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205405a040 con 0x55d5fe58ab40 2024-05-08T18:51:08.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.441+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x55d5fe58ab40 2024-05-08T18:51:08.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.441+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f205405a040 con 0x55d5fe58ab40 2024-05-08T18:51:08.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.441+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x7f2050052070 2024-05-08T18:51:08.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.441+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205407d040 con 0x7f2050052070 2024-05-08T18:51:08.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.441+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x55d5fe58f4f0 2024-05-08T18:51:08.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.442+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205803d070 con 0x55d5fe58f4f0 2024-05-08T18:51:08.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.442+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x7f2058036070 2024-05-08T18:51:08.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.442+0000 7f205e3ae640 1 -- 172.21.15.132:0/930214165 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205001b030 con 0x7f2058036070 2024-05-08T18:51:08.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.442+0000 7f205e3ae640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x55d5fe58ab40 2024-05-08T18:51:08.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.442+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205407d040 con 0x55d5fe58ab40 2024-05-08T18:51:08.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.442+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x7f2050052070 2024-05-08T18:51:08.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.442+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205407d040 con 0x7f2050052070 2024-05-08T18:51:08.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.442+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x55d5fe58f4f0 2024-05-08T18:51:08.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.443+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205803d070 con 0x55d5fe58f4f0 2024-05-08T18:51:08.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.443+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x7f2050052070 2024-05-08T18:51:08.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.443+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205407d040 con 0x7f2050052070 2024-05-08T18:51:08.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.443+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x7f2058036070 2024-05-08T18:51:08.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.443+0000 7f205e3ae640 1 -- 172.21.15.132:0/930214165 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205001b030 con 0x7f2058036070 2024-05-08T18:51:08.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.443+0000 7f205e3ae640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x55d5fe58f4f0 2024-05-08T18:51:08.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.443+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205803d070 con 0x55d5fe58f4f0 2024-05-08T18:51:08.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.443+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x7f2050052070 2024-05-08T18:51:08.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.444+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205407d040 con 0x7f2050052070 2024-05-08T18:51:08.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.444+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x55d5fe58ab40 2024-05-08T18:51:08.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.444+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f205407d040 con 0x55d5fe58ab40 2024-05-08T18:51:08.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.444+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593800 con 0x7f2058036070 2024-05-08T18:51:08.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.444+0000 7f205e3ae640 1 -- 172.21.15.132:0/930214165 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205005f040 con 0x7f2058036070 2024-05-08T18:51:08.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.444+0000 7f2062735800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:08.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.444+0000 7f2062735800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:08.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.444+0000 7f2062735800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:08.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.444+0000 7f2062735800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:08.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.444+0000 7f2062735800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:08.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.444+0000 7f2062735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:08.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.444+0000 7f2062735800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.444+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe5933d0 con 0x55d5fe58ab40 2024-05-08T18:51:08.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.444+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f205407d040 con 0x55d5fe58ab40 2024-05-08T18:51:08.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.445+0000 7f2062735800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.445+0000 7f2062735800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.445+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe592c40 con 0x55d5fe58ab40 2024-05-08T18:51:08.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.445+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f205407d040 con 0x55d5fe58ab40 2024-05-08T18:51:08.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.445+0000 7f2062735800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:08.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.445+0000 7f2062735800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.445+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe593c80 con 0x55d5fe58ab40 2024-05-08T18:51:08.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.445+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f205407d040 con 0x55d5fe58ab40 2024-05-08T18:51:08.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.445+0000 7f2062735800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:08.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.445+0000 7f2062735800 20 zone default found 2024-05-08T18:51:08.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.445+0000 7f2062735800 4 Realm: () 2024-05-08T18:51:08.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.445+0000 7f2062735800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:08.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.445+0000 7f2062735800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:08.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.445+0000 7f2062735800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:08.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.445+0000 7f2062735800 20 zonegroup default 2024-05-08T18:51:08.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.445+0000 7f2062735800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.445+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe594060 con 0x7f2050052070 2024-05-08T18:51:08.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.445+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f205407d040 con 0x7f2050052070 2024-05-08T18:51:08.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.445+0000 7f2062735800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.445+0000 7f2062735800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.445+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe596330 con 0x55d5fe58f4f0 2024-05-08T18:51:08.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.446+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f205803d070 con 0x55d5fe58f4f0 2024-05-08T18:51:08.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.446+0000 7f2062735800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.446+0000 7f2062735800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.446+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe5966d0 con 0x55d5fe58f4f0 2024-05-08T18:51:08.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.446+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f205803d070 con 0x55d5fe58f4f0 2024-05-08T18:51:08.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.446+0000 7f2062735800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.446+0000 7f2062735800 20 started sync module instance, tier type = 2024-05-08T18:51:08.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.446+0000 7f2062735800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:08.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.446+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe595770 con 0x7f2058036070 2024-05-08T18:51:08.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.447+0000 7f205e3ae640 1 -- 172.21.15.132:0/930214165 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205005f040 con 0x7f2058036070 2024-05-08T18:51:08.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.447+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94377583664016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe5953d0 con 0x7f2058036070 2024-05-08T18:51:08.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.447+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe5970b0 con 0x55d5fe58ab40 2024-05-08T18:51:08.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.448+0000 7f205e3ae640 1 -- 172.21.15.132:0/930214165 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94377583664016] v25'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205005f040 con 0x7f2058036070 2024-05-08T18:51:08.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.448+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205407d040 con 0x55d5fe58ab40 2024-05-08T18:51:08.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.448+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94377583666896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe5974a0 con 0x55d5fe58ab40 2024-05-08T18:51:08.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.448+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe597f00 con 0x55d5fe58f4f0 2024-05-08T18:51:08.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.449+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94377583666896] v25'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205407d040 con 0x55d5fe58ab40 2024-05-08T18:51:08.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.450+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205803d070 con 0x55d5fe58f4f0 2024-05-08T18:51:08.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.450+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94377583671728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe597ec0 con 0x55d5fe58f4f0 2024-05-08T18:51:08.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.450+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe598990 con 0x7f2058036070 2024-05-08T18:51:08.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.450+0000 7f205e3ae640 1 -- 172.21.15.132:0/930214165 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205005f040 con 0x7f2058036070 2024-05-08T18:51:08.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.451+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94377583674464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe599230 con 0x7f2058036070 2024-05-08T18:51:08.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.451+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe599d30 con 0x55d5fe58ab40 2024-05-08T18:51:08.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.451+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94377583671728] v25'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205803d070 con 0x55d5fe58f4f0 2024-05-08T18:51:08.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.452+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205407d040 con 0x55d5fe58ab40 2024-05-08T18:51:08.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.452+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94377583679520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe599cf0 con 0x55d5fe58ab40 2024-05-08T18:51:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.452+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe59a7b0 con 0x7f2050052070 2024-05-08T18:51:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.452+0000 7f205e3ae640 1 -- 172.21.15.132:0/930214165 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94377583674464] v25'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205005f040 con 0x7f2058036070 2024-05-08T18:51:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.453+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94377583679520] v25'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205407d040 con 0x55d5fe58ab40 2024-05-08T18:51:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.453+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205407d040 con 0x7f2050052070 2024-05-08T18:51:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.453+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94377583667952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe598d80 con 0x7f2050052070 2024-05-08T18:51:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.453+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe59ac60 con 0x7f2050052070 2024-05-08T18:51:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.454+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94377583667952] v25'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205407d040 con 0x7f2050052070 2024-05-08T18:51:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.454+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(56 notify.6 [create] v25'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205407d040 con 0x7f2050052070 2024-05-08T18:51:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.454+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94377583682240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe59ac60 con 0x7f2050052070 2024-05-08T18:51:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.454+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe59b620 con 0x7f2050052070 2024-05-08T18:51:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.456+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94377583682240] v25'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205407d040 con 0x7f2050052070 2024-05-08T18:51:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.456+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205407d040 con 0x7f2050052070 2024-05-08T18:51:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.456+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94377583683504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe59b800 con 0x7f2050052070 2024-05-08T18:51:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.456+0000 7f2062735800 20 add_watcher() i=0 2024-05-08T18:51:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.456+0000 7f2062735800 20 add_watcher() i=1 2024-05-08T18:51:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.456+0000 7f2062735800 20 add_watcher() i=2 2024-05-08T18:51:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.456+0000 7f2062735800 20 add_watcher() i=3 2024-05-08T18:51:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.456+0000 7f2062735800 20 add_watcher() i=4 2024-05-08T18:51:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.456+0000 7f2062735800 20 add_watcher() i=5 2024-05-08T18:51:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.456+0000 7f2062735800 20 add_watcher() i=6 2024-05-08T18:51:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.457+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94377583683504] v25'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205407d040 con 0x7f2050052070 2024-05-08T18:51:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.457+0000 7f2062735800 20 add_watcher() i=7 2024-05-08T18:51:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.457+0000 7f2062735800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.457+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe59e9c0 con 0x55d5fe58ab40 2024-05-08T18:51:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.457+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f205407d040 con 0x55d5fe58ab40 2024-05-08T18:51:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.457+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94377583698832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe59b770 con 0x55d5fe58ab40 2024-05-08T18:51:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.458+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94377583698832] v25'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f205407d040 con 0x55d5fe58ab40 2024-05-08T18:51:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.458+0000 7f1f14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.458+0000 7f2062735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.458+0000 7f2062735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.458+0000 7f2062735800 5 note: GC not initialized 2024-05-08T18:51:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.459+0000 7f1e8f7fe640 20 reqs_thread_entry: start 2024-05-08T18:51:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.459+0000 7f2062735800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.459+0000 7f2062735800 20 Filter name: none 2024-05-08T18:51:08.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.459+0000 7f1e8d7fa640 20 reqs_thread_entry: start 2024-05-08T18:51:08.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.459+0000 7f2062735800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:51:08.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.459+0000 7f2062735800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.459+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe5d1f70 con 0x55d5fe58ab40 2024-05-08T18:51:08.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.459+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f205407d040 con 0x55d5fe58ab40 2024-05-08T18:51:08.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.459+0000 7f2062735800 20 rados_obj.operate() r=0 bl.length=403 2024-05-08T18:51:08.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.459+0000 7f2062735800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:51:08.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.459+0000 7f2062735800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:51:08.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.459+0000 7f2062735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:51:08.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.460+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe5d8060 con 0x55d5fe58ab40 2024-05-08T18:51:08.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.461+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v25'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f205407d040 con 0x55d5fe58ab40 2024-05-08T18:51:08.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.461+0000 7f2062735800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:51:08.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.461+0000 7f2062735800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:51:08.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.461+0000 7f2062735800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:51:08.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.461+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94377583934016 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe5d3890 con 0x55d5fe58ab40 2024-05-08T18:51:08.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.461+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== watch-notify(notify (1) cookie 94377583679520 notify 107374182417 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55d5fe45c300 con 0x55d5fe58ab40 2024-05-08T18:51:08.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.461+0000 7f1f41ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 107374182417 cookie 94377583679520 notifier 4655 bl.length()=567 2024-05-08T18:51:08.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.461+0000 7f1f41ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:51:08.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.461+0000 7f1f41ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:51:08.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.461+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(64 notify.4 [notify cookie 94377583934016 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f205407d040 con 0x55d5fe58ab40 2024-05-08T18:51:08.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.461+0000 7f1f41ffb640 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x7f1f24003ea0 con 0x55d5fe58ab40 2024-05-08T18:51:08.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.461+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205407d040 con 0x55d5fe58ab40 2024-05-08T18:51:08.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.461+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== watch-notify(notify_complete (2) cookie 94377583934016 notify 107374182417 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f205405dc70 con 0x55d5fe58ab40 2024-05-08T18:51:08.477 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:50:44.835566Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:50:44.835553Z","tags":[],"group_ids":[]} 2024-05-08T18:51:08.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.462+0000 7f1f14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:08.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.462+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94377583698832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe5d7230 con 0x55d5fe58ab40 2024-05-08T18:51:08.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.463+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94377583698832] v25'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f205407d040 con 0x55d5fe58ab40 2024-05-08T18:51:08.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.463+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94377583664016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe5d7230 con 0x7f2058036070 2024-05-08T18:51:08.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.464+0000 7f205e3ae640 1 -- 172.21.15.132:0/930214165 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94377583664016] v25'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205005f040 con 0x7f2058036070 2024-05-08T18:51:08.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.464+0000 7f2062735800 20 remove_watcher() i=0 2024-05-08T18:51:08.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.464+0000 7f2062735800 2 removed watcher, disabling cache 2024-05-08T18:51:08.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.464+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94377583666896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe595b90 con 0x55d5fe58ab40 2024-05-08T18:51:08.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.465+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94377583666896] v25'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205407d040 con 0x55d5fe58ab40 2024-05-08T18:51:08.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.465+0000 7f2062735800 20 remove_watcher() i=1 2024-05-08T18:51:08.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.465+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94377583671728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe5966d0 con 0x55d5fe58f4f0 2024-05-08T18:51:08.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.466+0000 7f205ebaf640 1 -- 172.21.15.132:0/930214165 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94377583671728] v25'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205803d070 con 0x55d5fe58f4f0 2024-05-08T18:51:08.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.466+0000 7f2062735800 20 remove_watcher() i=2 2024-05-08T18:51:08.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.466+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94377583674464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe5966d0 con 0x7f2058036070 2024-05-08T18:51:08.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.467+0000 7f205e3ae640 1 -- 172.21.15.132:0/930214165 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94377583674464] v25'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205005f040 con 0x7f2058036070 2024-05-08T18:51:08.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.467+0000 7f2062735800 20 remove_watcher() i=3 2024-05-08T18:51:08.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.467+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94377583679520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe5966d0 con 0x55d5fe58ab40 2024-05-08T18:51:08.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.468+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94377583679520] v25'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205407d040 con 0x55d5fe58ab40 2024-05-08T18:51:08.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.468+0000 7f2062735800 20 remove_watcher() i=4 2024-05-08T18:51:08.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.468+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94377583667952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe599820 con 0x7f2050052070 2024-05-08T18:51:08.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.469+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94377583667952] v25'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205407d040 con 0x7f2050052070 2024-05-08T18:51:08.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.469+0000 7f2062735800 20 remove_watcher() i=5 2024-05-08T18:51:08.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.469+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94377583682240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe596b80 con 0x7f2050052070 2024-05-08T18:51:08.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.470+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94377583682240] v25'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205407d040 con 0x7f2050052070 2024-05-08T18:51:08.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.470+0000 7f2062735800 20 remove_watcher() i=6 2024-05-08T18:51:08.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.470+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94377583683504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55d5fe599820 con 0x7f2050052070 2024-05-08T18:51:08.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.471+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94377583683504] v25'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205407d040 con 0x7f2050052070 2024-05-08T18:51:08.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.471+0000 7f2062735800 20 remove_watcher() i=7 2024-05-08T18:51:08.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.471+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2050052070 msgr2=0x7f2050028460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.471+0000 7f2062735800 1 --2- 172.21.15.132:0/930214165 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2050052070 0x7f2050028460 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.471+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d5fe58ab40 msgr2=0x55d5fe58d000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.471+0000 7f2062735800 1 --2- 172.21.15.132:0/930214165 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d5fe58ab40 0x55d5fe58d000 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.471+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2058036070 msgr2=0x7f20580440d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 --2- 172.21.15.132:0/930214165 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2058036070 0x7f20580440d0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d5fe58f4f0 msgr2=0x55d5fe5918e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 --2- 172.21.15.132:0/930214165 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d5fe58f4f0 0x55d5fe5918e0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f2803bb50 msgr2=0x7f1f2803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 --2- 172.21.15.132:0/930214165 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f2803bb50 0x7f1f2803e010 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f20500035c0 tx=0x7f2050052000 comp rx=0 tx=0).stop 2024-05-08T18:51:08.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe577b40 msgr2=0x55d5fe57f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 --2- 172.21.15.132:0/930214165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe577b40 0x55d5fe57f000 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f20580186f0 tx=0x7f2058052f30 comp rx=0 tx=0).stop 2024-05-08T18:51:08.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 reap_dead start 2024-05-08T18:51:08.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f205dbad640 1 -- 172.21.15.132:0/930214165 reap_dead start 2024-05-08T18:51:08.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 shutdown_connections 2024-05-08T18:51:08.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 >> 172.21.15.132:0/930214165 conn(0x55d5fe573e10 msgr2=0x55d5fe571470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 shutdown_connections 2024-05-08T18:51:08.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 -- 172.21.15.132:0/930214165 wait complete. 2024-05-08T18:51:08.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 -- 172.21.15.132:0/803120712 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f3803bb50 msgr2=0x7f1f3803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 --2- 172.21.15.132:0/803120712 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f3803bb50 0x7f1f3803e010 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55d5fe556e50 tx=0x7f2050011f60 comp rx=0 tx=0).stop 2024-05-08T18:51:08.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 -- 172.21.15.132:0/803120712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe56a770 msgr2=0x55d5fe56ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 --2- 172.21.15.132:0/803120712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe56a770 0x55d5fe56ab90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x55d5fe550140 tx=0x7f205800aec0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 -- 172.21.15.132:0/803120712 shutdown_connections 2024-05-08T18:51:08.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 --2- 172.21.15.132:0/803120712 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f3803bb50 0x7f1f3803e010 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 --2- 172.21.15.132:0/803120712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe56a770 0x55d5fe56ab90 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 -- 172.21.15.132:0/803120712 >> 172.21.15.132:0/803120712 conn(0x55d5fe55e810 msgr2=0x55d5fe55ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 -- 172.21.15.132:0/803120712 shutdown_connections 2024-05-08T18:51:08.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 -- 172.21.15.132:0/803120712 wait complete. 2024-05-08T18:51:08.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 -- 172.21.15.132:0/2920009126 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d5fe4587f0 msgr2=0x55d5fe556380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 --2- 172.21.15.132:0/2920009126 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d5fe4587f0 0x55d5fe556380 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 -- 172.21.15.132:0/2920009126 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d5fe558d20 msgr2=0x55d5fe55b110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 --2- 172.21.15.132:0/2920009126 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d5fe558d20 0x55d5fe55b110 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.472+0000 7f2062735800 1 -- 172.21.15.132:0/2920009126 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f4403bba0 msgr2=0x7f1f4403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.473+0000 7f2062735800 1 --2- 172.21.15.132:0/2920009126 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f4403bba0 0x7f1f4403e060 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2054054000 tx=0x7f205404e000 comp rx=0 tx=0).stop 2024-05-08T18:51:08.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.473+0000 7f2062735800 1 -- 172.21.15.132:0/2920009126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe454ce0 msgr2=0x55d5fe54f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.473+0000 7f2062735800 1 --2- 172.21.15.132:0/2920009126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe454ce0 0x55d5fe54f270 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2050006fa0 tx=0x7f2050001250 comp rx=0 tx=0).stop 2024-05-08T18:51:08.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.473+0000 7f2062735800 1 -- 172.21.15.132:0/2920009126 shutdown_connections 2024-05-08T18:51:08.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.473+0000 7f2062735800 1 --2- 172.21.15.132:0/2920009126 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d5fe558d20 0x55d5fe55b110 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.473+0000 7f2062735800 1 --2- 172.21.15.132:0/2920009126 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d5fe4587f0 0x55d5fe556380 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.473+0000 7f2062735800 1 --2- 172.21.15.132:0/2920009126 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f4403bba0 0x7f1f4403e060 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.473+0000 7f2062735800 1 --2- 172.21.15.132:0/2920009126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d5fe454ce0 0x55d5fe54f270 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.473+0000 7f2062735800 1 -- 172.21.15.132:0/2920009126 >> 172.21.15.132:0/2920009126 conn(0x55d5fe44e730 msgr2=0x55d5fe4534c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.473+0000 7f2062735800 1 -- 172.21.15.132:0/2920009126 shutdown_connections 2024-05-08T18:51:08.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.473+0000 7f2062735800 1 -- 172.21.15.132:0/2920009126 wait complete. 2024-05-08T18:51:08.489 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:50:44.835566Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:50:44.835553Z', 'tags': [], 'group_ids': []} 2024-05-08T18:51:08.501 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:51:08.501 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-05-08T18:51:08.501 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-05-08T18:51:08.502 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-05-08T18:51:08.547 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:08.547 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:08.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.548+0000 7f25def1f800 1 Processor -- start 2024-05-08T18:51:08.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.548+0000 7f25def1f800 1 -- start start 2024-05-08T18:51:08.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.549+0000 7f25def1f800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5589362487e0 0x55893624abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.549+0000 7f25def1f800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55893624b110 con 0x558936244cd0 2024-05-08T18:51:08.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.549+0000 7f25def1f800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x5589360e4e20 con 0x5589362487e0 2024-05-08T18:51:08.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.549+0000 7f25d3fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5589362487e0 0x55893624abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.549+0000 7f25dabe0640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x558936244cd0 0x5589362470c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:55742/0 (socket says 172.21.15.132:55742) 2024-05-08T18:51:08.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.549+0000 7f25d3fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5589362487e0 0x55893624abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51628/0 (socket says 172.21.15.132:51628) 2024-05-08T18:51:08.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.549+0000 7f25dabe0640 1 -- 172.21.15.132:0/2647310375 learned_addr learned my addr 172.21.15.132:0/2647310375 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:51:08.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.549+0000 7f25d3fff640 1 -- 172.21.15.132:0/2647310375 >> v1:172.21.15.42:6789/0 conn(0x558936244cd0 legacy=0x5589362470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.549+0000 7f25da3df640 1 -- 172.21.15.132:0/2647310375 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1634250862 0 0) 0x55893624b110 con 0x558936244cd0 2024-05-08T18:51:08.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.549+0000 7f25d3fff640 1 -- 172.21.15.132:0/2647310375 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55893624c2f0 con 0x5589362487e0 2024-05-08T18:51:08.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.551+0000 7f25d3fff640 1 --2- 172.21.15.132:0/2647310375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589362487e0 0x55893624abd0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f25c400a470 tx=0x7f25c401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4a326def445146 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.551+0000 7f25da3df640 1 -- 172.21.15.132:0/2647310375 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25c4057070 con 0x5589362487e0 2024-05-08T18:51:08.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.551+0000 7f25da3df640 1 -- 172.21.15.132:0/2647310375 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25c4052570 con 0x5589362487e0 2024-05-08T18:51:08.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.551+0000 7f25da3df640 1 -- 172.21.15.132:0/2647310375 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25c4052870 con 0x5589362487e0 2024-05-08T18:51:08.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.552+0000 7f25def1f800 1 -- 172.21.15.132:0/2647310375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589362487e0 msgr2=0x55893624abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.552+0000 7f25def1f800 1 --2- 172.21.15.132:0/2647310375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589362487e0 0x55893624abd0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f25c400a470 tx=0x7f25c401ce90 comp rx=0 tx=0).stop 2024-05-08T18:51:08.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.552+0000 7f25def1f800 1 -- 172.21.15.132:0/2647310375 shutdown_connections 2024-05-08T18:51:08.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.552+0000 7f25def1f800 1 --2- 172.21.15.132:0/2647310375 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589362487e0 0x55893624abd0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.552+0000 7f25def1f800 1 -- 172.21.15.132:0/2647310375 >> 172.21.15.132:0/2647310375 conn(0x55893623e720 msgr2=0x558936240b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.552+0000 7f25def1f800 1 -- 172.21.15.132:0/2647310375 shutdown_connections 2024-05-08T18:51:08.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.552+0000 7f25def1f800 1 -- 172.21.15.132:0/2647310375 wait complete. 2024-05-08T18:51:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.565+0000 7f25def1f800 1 Processor -- start 2024-05-08T18:51:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.565+0000 7f25def1f800 1 -- start start 2024-05-08T18:51:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.565+0000 7f25def1f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558936244cd0 0x5589363354b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.565+0000 7f25def1f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55893618f5b0 con 0x558936244cd0 2024-05-08T18:51:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.566+0000 7f25dabe0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558936244cd0 0x5589363354b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.566+0000 7f25dabe0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558936244cd0 0x5589363354b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51630/0 (socket says 172.21.15.132:51630) 2024-05-08T18:51:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.566+0000 7f25dabe0640 1 -- 172.21.15.132:0/431395367 learned_addr learned my addr 172.21.15.132:0/431395367 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.566+0000 7f25dabe0640 1 -- 172.21.15.132:0/431395367 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558936335a80 con 0x558936244cd0 2024-05-08T18:51:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.566+0000 7f25dabe0640 1 --2- 172.21.15.132:0/431395367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558936244cd0 0x5589363354b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00b210 tx=0x7f25cc00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634fa4b0764d9aa2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.566+0000 7f24c8e09640 1 -- 172.21.15.132:0/431395367 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25cc008070 con 0x558936244cd0 2024-05-08T18:51:08.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.566+0000 7f24c8e09640 1 -- 172.21.15.132:0/431395367 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25cc00d500 con 0x558936244cd0 2024-05-08T18:51:08.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.566+0000 7f24c8e09640 1 -- 172.21.15.132:0/431395367 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25cc00d840 con 0x558936244cd0 2024-05-08T18:51:08.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.567+0000 7f25def1f800 1 -- 172.21.15.132:0/431395367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558936244cd0 msgr2=0x5589363354b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.567+0000 7f25def1f800 1 --2- 172.21.15.132:0/431395367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558936244cd0 0x5589363354b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00b210 tx=0x7f25cc00b6d0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.567+0000 7f25def1f800 1 -- 172.21.15.132:0/431395367 shutdown_connections 2024-05-08T18:51:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.567+0000 7f25def1f800 1 --2- 172.21.15.132:0/431395367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558936244cd0 0x5589363354b0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.567+0000 7f25def1f800 1 -- 172.21.15.132:0/431395367 >> 172.21.15.132:0/431395367 conn(0x55893623e720 msgr2=0x558936330dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.567+0000 7f25def1f800 1 -- 172.21.15.132:0/431395367 shutdown_connections 2024-05-08T18:51:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.567+0000 7f25def1f800 1 -- 172.21.15.132:0/431395367 wait complete. 2024-05-08T18:51:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.567+0000 7f25def1f800 1 Processor -- start 2024-05-08T18:51:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.568+0000 7f25def1f800 1 -- start start 2024-05-08T18:51:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.568+0000 7f25def1f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558936244cd0 0x55893633d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.568+0000 7f25def1f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55893624b5e0 con 0x558936244cd0 2024-05-08T18:51:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.568+0000 7f25dabe0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558936244cd0 0x55893633d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.568+0000 7f25dabe0640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558936244cd0 0x55893633d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51642/0 (socket says 172.21.15.132:51642) 2024-05-08T18:51:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.568+0000 7f25dabe0640 1 -- 172.21.15.132:0/1544956407 learned_addr learned my addr 172.21.15.132:0/1544956407 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.568+0000 7f25dabe0640 1 -- 172.21.15.132:0/1544956407 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55893633d570 con 0x558936244cd0 2024-05-08T18:51:08.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.568+0000 7f25dabe0640 1 --2- 172.21.15.132:0/1544956407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558936244cd0 0x55893633d030 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00b210 tx=0x7f25cc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.568+0000 7f24c7606640 1 -- 172.21.15.132:0/1544956407 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25cc00f950 con 0x558936244cd0 2024-05-08T18:51:08.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.569+0000 7f24c7606640 1 -- 172.21.15.132:0/1544956407 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25cc00faf0 con 0x558936244cd0 2024-05-08T18:51:08.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.569+0000 7f25def1f800 1 -- 172.21.15.132:0/1544956407 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55893633d800 con 0x558936244cd0 2024-05-08T18:51:08.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.569+0000 7f24c7606640 1 -- 172.21.15.132:0/1544956407 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25cc00fdd0 con 0x558936244cd0 2024-05-08T18:51:08.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.569+0000 7f25def1f800 1 -- 172.21.15.132:0/1544956407 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589363404b0 con 0x558936244cd0 2024-05-08T18:51:08.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.569+0000 7f24c7606640 1 -- 172.21.15.132:0/1544956407 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f25cc017040 con 0x558936244cd0 2024-05-08T18:51:08.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.570+0000 7f24c7606640 1 --2- 172.21.15.132:0/1544956407 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f24c003bb50 0x7f24c003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.570+0000 7f24c7606640 1 -- 172.21.15.132:0/1544956407 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f25cc015020 con 0x558936244cd0 2024-05-08T18:51:08.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.570+0000 7f25d3fff640 1 --2- 172.21.15.132:0/1544956407 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f24c003bb50 0x7f24c003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.570+0000 7f25def1f800 1 --2- 172.21.15.132:0/1544956407 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5589362487e0 0x558936344270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.570+0000 7f25def1f800 1 -- 172.21.15.132:0/1544956407 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5589363447f0 con 0x5589362487e0 2024-05-08T18:51:08.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.570+0000 7f25db3e1640 1 --2- 172.21.15.132:0/1544956407 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5589362487e0 0x558936344270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.570+0000 7f25d3fff640 1 --2- 172.21.15.132:0/1544956407 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f24c003bb50 0x7f24c003e010 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f25c4054000 tx=0x7f25c404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.570+0000 7f25db3e1640 1 --2- 172.21.15.132:0/1544956407 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5589362487e0 0x558936344270 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.571+0000 7f25db3e1640 1 -- 172.21.15.132:0/1544956407 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25d400a4a0 con 0x5589362487e0 2024-05-08T18:51:08.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.571+0000 7f25def1f800 1 -- 172.21.15.132:0/1544956407 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558936341840 con 0x5589362487e0 2024-05-08T18:51:08.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.571+0000 7f25db3e1640 1 -- 172.21.15.132:0/1544956407 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f25d400a4a0 con 0x5589362487e0 2024-05-08T18:51:08.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.571+0000 7f25def1f800 1 --2- 172.21.15.132:0/1544956407 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558936346b20 0x558936348f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.571+0000 7f25def1f800 1 -- 172.21.15.132:0/1544956407 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558936349600 con 0x558936346b20 2024-05-08T18:51:08.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.571+0000 7f25dabe0640 1 --2- 172.21.15.132:0/1544956407 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558936346b20 0x558936348f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.571+0000 7f25dabe0640 1 --2- 172.21.15.132:0/1544956407 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558936346b20 0x558936348f10 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.572+0000 7f25dabe0640 1 -- 172.21.15.132:0/1544956407 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f25cc02d070 con 0x558936346b20 2024-05-08T18:51:08.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.572+0000 7f25def1f800 1 -- 172.21.15.132:0/1544956407 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558936345990 con 0x5589362487e0 2024-05-08T18:51:08.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.572+0000 7f25db3e1640 1 -- 172.21.15.132:0/1544956407 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f25d400a4a0 con 0x5589362487e0 2024-05-08T18:51:08.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.572+0000 7f25def1f800 1 -- 172.21.15.132:0/1544956407 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558936345e70 con 0x5589362487e0 2024-05-08T18:51:08.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.572+0000 7f25db3e1640 1 -- 172.21.15.132:0/1544956407 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f25d400a4a0 con 0x5589362487e0 2024-05-08T18:51:08.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.572+0000 7f25def1f800 1 Processor -- start 2024-05-08T18:51:08.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.573+0000 7f25def1f800 1 -- start start 2024-05-08T18:51:08.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.573+0000 7f25def1f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558936244870 0x558936242ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.573+0000 7f25def1f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558936135fc0 con 0x558936244870 2024-05-08T18:51:08.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.573+0000 7f25db3e1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558936244870 0x558936242ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.573+0000 7f25db3e1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558936244870 0x558936242ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51644/0 (socket says 172.21.15.132:51644) 2024-05-08T18:51:08.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.573+0000 7f25db3e1640 1 -- 172.21.15.132:0/2908629290 learned_addr learned my addr 172.21.15.132:0/2908629290 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:08.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.573+0000 7f25db3e1640 1 -- 172.21.15.132:0/2908629290 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558936243220 con 0x558936244870 2024-05-08T18:51:08.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.573+0000 7f25db3e1640 1 --2- 172.21.15.132:0/2908629290 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558936244870 0x558936242ce0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x558936344bd0 tx=0x7f25d4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.574+0000 7f24c4e01640 1 -- 172.21.15.132:0/2908629290 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25d4014450 con 0x558936244870 2024-05-08T18:51:08.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.574+0000 7f24c4e01640 1 -- 172.21.15.132:0/2908629290 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25d4014610 con 0x558936244870 2024-05-08T18:51:08.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.574+0000 7f24c4e01640 1 -- 172.21.15.132:0/2908629290 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25d4014930 con 0x558936244870 2024-05-08T18:51:08.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.574+0000 7f25def1f800 1 -- 172.21.15.132:0/2908629290 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589362434b0 con 0x558936244870 2024-05-08T18:51:08.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.574+0000 7f25def1f800 1 -- 172.21.15.132:0/2908629290 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589362439b0 con 0x558936244870 2024-05-08T18:51:08.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.574+0000 7f24c4e01640 1 -- 172.21.15.132:0/2908629290 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f25d4011040 con 0x558936244870 2024-05-08T18:51:08.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.575+0000 7f24c4e01640 1 --2- 172.21.15.132:0/2908629290 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f24b403bba0 0x7f24b403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.575+0000 7f24c4e01640 1 -- 172.21.15.132:0/2908629290 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f25d401e070 con 0x558936244870 2024-05-08T18:51:08.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.575+0000 7f25dabe0640 1 --2- 172.21.15.132:0/2908629290 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f24b403bba0 0x7f24b403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.575+0000 7f25def1f800 1 Processor -- start 2024-05-08T18:51:08.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.575+0000 7f25dabe0640 1 --2- 172.21.15.132:0/2908629290 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f24b403bba0 0x7f24b403e060 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00ed00 tx=0x7f25cc051710 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.575+0000 7f25def1f800 1 -- start start 2024-05-08T18:51:08.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.575+0000 7f25def1f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589363679a0 0x558936367dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.575+0000 7f25def1f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558936335e00 con 0x5589363679a0 2024-05-08T18:51:08.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.575+0000 7f25db3e1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589363679a0 0x558936367dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.575+0000 7f25db3e1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589363679a0 0x558936367dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51656/0 (socket says 172.21.15.132:51656) 2024-05-08T18:51:08.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.575+0000 7f25db3e1640 1 -- 172.21.15.132:0/3231323360 learned_addr learned my addr 172.21.15.132:0/3231323360 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:08.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.576+0000 7f25db3e1640 1 -- 172.21.15.132:0/3231323360 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558936368390 con 0x5589363679a0 2024-05-08T18:51:08.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.576+0000 7f25db3e1640 1 --2- 172.21.15.132:0/3231323360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589363679a0 0x558936367dc0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f25d40165b0 tx=0x7f25d4001310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7e8934a8cc119 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.576+0000 7f24be7fc640 1 -- 172.21.15.132:0/3231323360 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25d402bc50 con 0x5589363679a0 2024-05-08T18:51:08.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.576+0000 7f24be7fc640 1 -- 172.21.15.132:0/3231323360 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25d4047070 con 0x5589363679a0 2024-05-08T18:51:08.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.576+0000 7f24be7fc640 1 -- 172.21.15.132:0/3231323360 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25d40167c0 con 0x5589363679a0 2024-05-08T18:51:08.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.576+0000 7f25def1f800 1 -- 172.21.15.132:0/3231323360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589363679a0 msgr2=0x558936367dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.576+0000 7f25def1f800 1 --2- 172.21.15.132:0/3231323360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589363679a0 0x558936367dc0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f25d40165b0 tx=0x7f25d4001310 comp rx=0 tx=0).stop 2024-05-08T18:51:08.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.576+0000 7f25def1f800 1 -- 172.21.15.132:0/3231323360 shutdown_connections 2024-05-08T18:51:08.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.576+0000 7f25def1f800 1 --2- 172.21.15.132:0/3231323360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589363679a0 0x558936367dc0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.576+0000 7f25def1f800 1 -- 172.21.15.132:0/3231323360 >> 172.21.15.132:0/3231323360 conn(0x558936363cb0 msgr2=0x558936361d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.576+0000 7f25def1f800 1 -- 172.21.15.132:0/3231323360 shutdown_connections 2024-05-08T18:51:08.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.576+0000 7f25def1f800 1 -- 172.21.15.132:0/3231323360 wait complete. 2024-05-08T18:51:08.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.577+0000 7f25def1f800 1 Processor -- start 2024-05-08T18:51:08.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.577+0000 7f25def1f800 1 -- start start 2024-05-08T18:51:08.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.577+0000 7f25def1f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589363679a0 0x55893636efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.577+0000 7f25def1f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558936368b60 con 0x5589363679a0 2024-05-08T18:51:08.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.577+0000 7f25db3e1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589363679a0 0x55893636efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.577+0000 7f25db3e1640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589363679a0 0x55893636efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:51670/0 (socket says 172.21.15.132:51670) 2024-05-08T18:51:08.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.577+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 learned_addr learned my addr 172.21.15.132:0/558131201 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:08.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.577+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55893636f4e0 con 0x5589363679a0 2024-05-08T18:51:08.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.577+0000 7f25db3e1640 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589363679a0 0x55893636efa0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f25d4001350 tx=0x7f25d4052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.578+0000 7f24bcff9640 1 -- 172.21.15.132:0/558131201 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25d4054530 con 0x5589363679a0 2024-05-08T18:51:08.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.578+0000 7f24bcff9640 1 -- 172.21.15.132:0/558131201 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25d4016ac0 con 0x5589363679a0 2024-05-08T18:51:08.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.578+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55893636f770 con 0x5589363679a0 2024-05-08T18:51:08.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.578+0000 7f24bcff9640 1 -- 172.21.15.132:0/558131201 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25d402b480 con 0x5589363679a0 2024-05-08T18:51:08.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.578+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558936372420 con 0x5589363679a0 2024-05-08T18:51:08.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.578+0000 7f24bcff9640 1 -- 172.21.15.132:0/558131201 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f25d402b620 con 0x5589363679a0 2024-05-08T18:51:08.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.579+0000 7f24bcff9640 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f24a403bb50 0x7f24a403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.579+0000 7f24bcff9640 1 -- 172.21.15.132:0/558131201 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5706+0+0 (secure 0 0 0) 0x7f25d400e040 con 0x5589363679a0 2024-05-08T18:51:08.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.579+0000 7f25dabe0640 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f24a403bb50 0x7f24a403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.579+0000 7f25dabe0640 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f24a403bb50 0x7f24a403e010 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f25cc019fd0 tx=0x7f25cc053050 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.579+0000 7f25def1f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.579+0000 7f25def1f800 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55893637abc0 0x55893637d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.579+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55893637d7d0 con 0x55893637abc0 2024-05-08T18:51:08.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.579+0000 7f25d3fff640 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55893637abc0 0x55893637d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.580+0000 7f25d3fff640 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55893637abc0 0x55893637d080 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.580+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25c405a040 con 0x55893637abc0 2024-05-08T18:51:08.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.580+0000 7f25def1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.580+0000 7f25def1f800 20 realm 2024-05-08T18:51:08.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.580+0000 7f25def1f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.580+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55893637dba0 con 0x55893637abc0 2024-05-08T18:51:08.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.580+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25c405a040 con 0x55893637abc0 2024-05-08T18:51:08.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.580+0000 7f25def1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.580+0000 7f25def1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:08.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.580+0000 7f25def1f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.580+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55893637e470 con 0x55893637abc0 2024-05-08T18:51:08.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.580+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25c405a040 con 0x55893637abc0 2024-05-08T18:51:08.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.580+0000 7f25def1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.580+0000 7f25def1f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.580+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55893637e810 con 0x55893637abc0 2024-05-08T18:51:08.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.580+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f25c405a040 con 0x55893637abc0 2024-05-08T18:51:08.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.580+0000 7f25def1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:08.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.581+0000 7f25def1f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.581+0000 7f25def1f800 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55893637f570 0x558936381960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.581+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558936381f70 con 0x55893637f570 2024-05-08T18:51:08.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.581+0000 7f25db3e1640 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55893637f570 0x558936381960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.581+0000 7f25db3e1640 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55893637f570 0x558936381960 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.581+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.581+0000 7f25def1f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:08.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.581+0000 7f25def1f800 20 searching for the correct realm 2024-05-08T18:51:08.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.581+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x55893637f570 2024-05-08T18:51:08.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.582+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.582+0000 7f25db3e1640 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f25d4014070 0x7f25d405e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.582+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x7f25d4014070 2024-05-08T18:51:08.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.582+0000 7f25dabe0640 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f25d4014070 0x7f25d405e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.582+0000 7f25dabe0640 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f25d4014070 0x7f25d405e6c0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.582+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25cc02d070 con 0x7f25d4014070 2024-05-08T18:51:08.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.582+0000 7f25dabe0640 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f25cc042040 0x7f25cc043430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:08.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.582+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x7f25cc042040 2024-05-08T18:51:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.582+0000 7f25d3fff640 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f25cc042040 0x7f25cc043430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.583+0000 7f25d3fff640 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f25cc042040 0x7f25cc043430 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.583+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c405a040 con 0x7f25cc042040 2024-05-08T18:51:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.583+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x55893637abc0 2024-05-08T18:51:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.584+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c405a040 con 0x55893637abc0 2024-05-08T18:51:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.584+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x55893637abc0 2024-05-08T18:51:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.584+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c405a040 con 0x55893637abc0 2024-05-08T18:51:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.584+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x7f25cc042040 2024-05-08T18:51:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.584+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c405a040 con 0x7f25cc042040 2024-05-08T18:51:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.584+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x7f25cc042040 2024-05-08T18:51:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.584+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c405a040 con 0x7f25cc042040 2024-05-08T18:51:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.584+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x7f25d4014070 2024-05-08T18:51:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.585+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25cc02d070 con 0x7f25d4014070 2024-05-08T18:51:08.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.585+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x55893637f570 2024-05-08T18:51:08.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.585+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.585+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x55893637abc0 2024-05-08T18:51:08.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.585+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c405a040 con 0x55893637abc0 2024-05-08T18:51:08.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.585+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x7f25cc042040 2024-05-08T18:51:08.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.585+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c405a040 con 0x7f25cc042040 2024-05-08T18:51:08.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.585+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x55893637abc0 2024-05-08T18:51:08.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.586+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 25 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f25c405a040 con 0x55893637abc0 2024-05-08T18:51:08.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.586+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x7f25d4014070 2024-05-08T18:51:08.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.586+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 25 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f25cc02d070 con 0x7f25d4014070 2024-05-08T18:51:08.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.586+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x55893637f570 2024-05-08T18:51:08.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.586+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 25 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.586+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x55893637f570 2024-05-08T18:51:08.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.586+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.586+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x7f25cc042040 2024-05-08T18:51:08.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.587+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c405a040 con 0x7f25cc042040 2024-05-08T18:51:08.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.587+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x55893637f570 2024-05-08T18:51:08.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.587+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.587+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x55893637f570 2024-05-08T18:51:08.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.587+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.587+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x55893637abc0 2024-05-08T18:51:08.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.587+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c405a040 con 0x55893637abc0 2024-05-08T18:51:08.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.587+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x55893637abc0 2024-05-08T18:51:08.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.587+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 25 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f25c405a040 con 0x55893637abc0 2024-05-08T18:51:08.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.587+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x7f25cc042040 2024-05-08T18:51:08.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.588+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c407d040 con 0x7f25cc042040 2024-05-08T18:51:08.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.588+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x55893637f570 2024-05-08T18:51:08.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.588+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.588+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x7f25d4014070 2024-05-08T18:51:08.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.588+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25cc02d070 con 0x7f25d4014070 2024-05-08T18:51:08.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.588+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x55893637abc0 2024-05-08T18:51:08.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.588+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c407d040 con 0x55893637abc0 2024-05-08T18:51:08.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.588+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x7f25cc042040 2024-05-08T18:51:08.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.589+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(30 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c407d040 con 0x7f25cc042040 2024-05-08T18:51:08.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.589+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x55893637f570 2024-05-08T18:51:08.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.589+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.589+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x7f25cc042040 2024-05-08T18:51:08.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.589+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(32 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c407d040 con 0x7f25cc042040 2024-05-08T18:51:08.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.589+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x7f25d4014070 2024-05-08T18:51:08.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.590+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(33 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25cc02d070 con 0x7f25d4014070 2024-05-08T18:51:08.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.590+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x55893637f570 2024-05-08T18:51:08.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.590+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.590+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x7f25cc042040 2024-05-08T18:51:08.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.590+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(35 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c407d040 con 0x7f25cc042040 2024-05-08T18:51:08.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.590+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x55893637abc0 2024-05-08T18:51:08.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.590+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 25 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f25c407d040 con 0x55893637abc0 2024-05-08T18:51:08.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.590+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 25 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e25) -- 0x558936383880 con 0x7f25d4014070 2024-05-08T18:51:08.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(37 [pgnls start_epoch 25 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25cc02d070 con 0x7f25d4014070 2024-05-08T18:51:08.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:08.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:08.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:08.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:08.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:08.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:08.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558936383450 con 0x55893637abc0 2024-05-08T18:51:08.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x55893637abc0 2024-05-08T18:51:08.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558936382cc0 con 0x55893637abc0 2024-05-08T18:51:08.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f25c407d040 con 0x55893637abc0 2024-05-08T18:51:08.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:08.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558936383d00 con 0x55893637abc0 2024-05-08T18:51:08.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f25c407d040 con 0x55893637abc0 2024-05-08T18:51:08.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:08.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 20 zone default found 2024-05-08T18:51:08.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 4 Realm: () 2024-05-08T18:51:08.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:08.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:08.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:08.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 20 zonegroup default 2024-05-08T18:51:08.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.591+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5589363840e0 con 0x7f25cc042040 2024-05-08T18:51:08.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.592+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x7f25cc042040 2024-05-08T18:51:08.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.592+0000 7f25def1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.592+0000 7f25def1f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.592+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5589363863b0 con 0x55893637f570 2024-05-08T18:51:08.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.592+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.592+0000 7f25def1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.592+0000 7f25def1f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.592+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x558936386750 con 0x55893637f570 2024-05-08T18:51:08.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.592+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.592+0000 7f25def1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:08.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.592+0000 7f25def1f800 20 started sync module instance, tier type = 2024-05-08T18:51:08.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.592+0000 7f25def1f800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:08.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.592+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5589363857f0 con 0x7f25d4014070 2024-05-08T18:51:08.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.593+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(44 notify.0 [create] v25'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25cc02d070 con 0x7f25d4014070 2024-05-08T18:51:08.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.593+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94047808543712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936386000 con 0x7f25d4014070 2024-05-08T18:51:08.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.593+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936387130 con 0x55893637abc0 2024-05-08T18:51:08.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.594+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94047808543712] v25'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25cc02d070 con 0x7f25d4014070 2024-05-08T18:51:08.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.595+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v25'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x55893637abc0 2024-05-08T18:51:08.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.595+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94047808546640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936387520 con 0x55893637abc0 2024-05-08T18:51:08.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.595+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936387f80 con 0x55893637f570 2024-05-08T18:51:08.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.596+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94047808546640] v25'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x55893637abc0 2024-05-08T18:51:08.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.596+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v25'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.596+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94047808551472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936387f40 con 0x55893637f570 2024-05-08T18:51:08.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.596+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936388a30 con 0x7f25d4014070 2024-05-08T18:51:08.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.597+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94047808551472] v25'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.597+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(50 notify.3 [create] v25'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25cc02d070 con 0x7f25d4014070 2024-05-08T18:51:08.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.597+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94047808554304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936388e20 con 0x7f25d4014070 2024-05-08T18:51:08.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.597+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936389860 con 0x55893637abc0 2024-05-08T18:51:08.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.598+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94047808554304] v25'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25cc02d070 con 0x7f25d4014070 2024-05-08T18:51:08.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.598+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v25'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x55893637abc0 2024-05-08T18:51:08.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.598+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94047808557872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936389c50 con 0x55893637abc0 2024-05-08T18:51:08.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.598+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55893638a670 con 0x7f25cc042040 2024-05-08T18:51:08.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.599+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94047808557872] v25'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x55893637abc0 2024-05-08T18:51:08.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.599+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(54 notify.5 [create] v25'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x7f25cc042040 2024-05-08T18:51:08.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.599+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94047808561504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55893638a630 con 0x7f25cc042040 2024-05-08T18:51:08.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.599+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55893638b0b0 con 0x7f25cc042040 2024-05-08T18:51:08.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.600+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(56 notify.6 [create] v25'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x7f25cc042040 2024-05-08T18:51:08.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.600+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94047808564224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55893638b020 con 0x7f25cc042040 2024-05-08T18:51:08.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.600+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55893638c020 con 0x7f25cc042040 2024-05-08T18:51:08.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.601+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94047808561504] v25'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x7f25cc042040 2024-05-08T18:51:08.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.601+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94047808564224] v25'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x7f25cc042040 2024-05-08T18:51:08.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.601+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(58 notify.7 [create] v25'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x7f25cc042040 2024-05-08T18:51:08.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.601+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94047808566432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936386b70 con 0x7f25cc042040 2024-05-08T18:51:08.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.601+0000 7f25def1f800 20 add_watcher() i=0 2024-05-08T18:51:08.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.601+0000 7f25def1f800 20 add_watcher() i=1 2024-05-08T18:51:08.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.601+0000 7f25def1f800 20 add_watcher() i=2 2024-05-08T18:51:08.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.601+0000 7f25def1f800 20 add_watcher() i=3 2024-05-08T18:51:08.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.601+0000 7f25def1f800 20 add_watcher() i=4 2024-05-08T18:51:08.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.601+0000 7f25def1f800 20 add_watcher() i=5 2024-05-08T18:51:08.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.601+0000 7f25def1f800 20 add_watcher() i=6 2024-05-08T18:51:08.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.602+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94047808566432] v25'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x7f25cc042040 2024-05-08T18:51:08.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.603+0000 7f25def1f800 20 add_watcher() i=7 2024-05-08T18:51:08.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.603+0000 7f25def1f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:08.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.603+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x55893638f010 con 0x55893637abc0 2024-05-08T18:51:08.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.603+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f25c407d040 con 0x55893637abc0 2024-05-08T18:51:08.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.603+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94047808568048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55893638c490 con 0x55893637abc0 2024-05-08T18:51:08.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.604+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94047808568048] v25'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x55893637abc0 2024-05-08T18:51:08.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.604+0000 7f24917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:08.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.604+0000 7f25def1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:08.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.604+0000 7f25def1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:08.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.604+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5589363977e0 con 0x55893637abc0 2024-05-08T18:51:08.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.606+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v25'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x55893637abc0 2024-05-08T18:51:08.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.606+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936397eb0 con 0x7f25cc042040 2024-05-08T18:51:08.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.607+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v25'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x7f25cc042040 2024-05-08T18:51:08.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.607+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5589363982d0 con 0x55893637f570 2024-05-08T18:51:08.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.608+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v25'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.608+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5589363981f0 con 0x55893637abc0 2024-05-08T18:51:08.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.609+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v25'192 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x55893637abc0 2024-05-08T18:51:08.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.609+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936398900 con 0x7f25d4014070 2024-05-08T18:51:08.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.610+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v25'65 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25cc02d070 con 0x7f25d4014070 2024-05-08T18:51:08.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.610+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399150 con 0x55893637f570 2024-05-08T18:51:08.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.610+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v25'44 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.611+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399150 con 0x55893637abc0 2024-05-08T18:51:08.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.612+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v25'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x55893637abc0 2024-05-08T18:51:08.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.612+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399550 con 0x7f25cc042040 2024-05-08T18:51:08.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.613+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v25'45 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x7f25cc042040 2024-05-08T18:51:08.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.613+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399550 con 0x7f25d4014070 2024-05-08T18:51:08.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.614+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v25'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25cc02d070 con 0x7f25d4014070 2024-05-08T18:51:08.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.614+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a00 con 0x55893637f570 2024-05-08T18:51:08.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.615+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v25'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.615+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a00 con 0x7f25d4014070 2024-05-08T18:51:08.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.616+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v25'66 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25cc02d070 con 0x7f25d4014070 2024-05-08T18:51:08.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.616+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a00 con 0x7f25cc042040 2024-05-08T18:51:08.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.617+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v25'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x7f25cc042040 2024-05-08T18:51:08.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.617+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a00 con 0x7f25d4014070 2024-05-08T18:51:08.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.618+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v25'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25cc02d070 con 0x7f25d4014070 2024-05-08T18:51:08.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.618+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a00 con 0x7f25cc042040 2024-05-08T18:51:08.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.619+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v25'49 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x7f25cc042040 2024-05-08T18:51:08.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.619+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a00 con 0x55893637abc0 2024-05-08T18:51:08.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.620+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v25'193 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x55893637abc0 2024-05-08T18:51:08.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.620+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a00 con 0x55893637f570 2024-05-08T18:51:08.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.621+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v25'59 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.621+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a90 con 0x7f25d4014070 2024-05-08T18:51:08.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.622+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v25'67 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25cc02d070 con 0x7f25d4014070 2024-05-08T18:51:08.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.622+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a90 con 0x55893637f570 2024-05-08T18:51:08.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.623+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v25'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.623+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a90 con 0x55893637abc0 2024-05-08T18:51:08.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.624+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v25'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x55893637abc0 2024-05-08T18:51:08.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.624+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a90 con 0x55893637abc0 2024-05-08T18:51:08.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.625+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v25'194 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x55893637abc0 2024-05-08T18:51:08.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.625+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a90 con 0x55893637f570 2024-05-08T18:51:08.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.626+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v25'60 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.626+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a90 con 0x7f25d4014070 2024-05-08T18:51:08.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.627+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v25'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25cc02d070 con 0x7f25d4014070 2024-05-08T18:51:08.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.627+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a90 con 0x55893637f570 2024-05-08T18:51:08.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.628+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v25'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.628+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a90 con 0x55893637f570 2024-05-08T18:51:08.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.629+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v25'32 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.629+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a90 con 0x55893637f570 2024-05-08T18:51:08.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.630+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v25'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.630+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a90 con 0x55893637f570 2024-05-08T18:51:08.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.631+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v25'45 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.631+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a90 con 0x7f25cc042040 2024-05-08T18:51:08.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.632+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v25'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x7f25cc042040 2024-05-08T18:51:08.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.632+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a90 con 0x55893637f570 2024-05-08T18:51:08.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.633+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v25'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.633+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a90 con 0x7f25cc042040 2024-05-08T18:51:08.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.634+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v25'46 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x7f25cc042040 2024-05-08T18:51:08.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.634+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a90 con 0x55893637f570 2024-05-08T18:51:08.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.635+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v25'61 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.635+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a90 con 0x7f25cc042040 2024-05-08T18:51:08.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.636+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v25'50 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x7f25cc042040 2024-05-08T18:51:08.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.636+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936399a90 con 0x7f25d4014070 2024-05-08T18:51:08.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.637+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v25'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25cc02d070 con 0x7f25d4014070 2024-05-08T18:51:08.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.638+0000 7f240bfff640 20 reqs_thread_entry: start 2024-05-08T18:51:08.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.638+0000 7f25def1f800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:08.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.638+0000 7f25def1f800 20 Filter name: none 2024-05-08T18:51:08.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.638+0000 7f2409ffb640 20 reqs_thread_entry: start 2024-05-08T18:51:08.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.638+0000 7f25def1f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:51:08.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.638+0000 7f25def1f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:08.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.638+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5589363c4c90 con 0x55893637abc0 2024-05-08T18:51:08.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.638+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f25c407d040 con 0x55893637abc0 2024-05-08T18:51:08.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.638+0000 7f25def1f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:51:08.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.638+0000 7f25def1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:51:08.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.638+0000 7f25def1f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:51:08.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.638+0000 7f25def1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:51:08.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.638+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25) -- 0x5589363c47c0 con 0x7f25d4014070 2024-05-08T18:51:08.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.639+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f25cc02d070 con 0x7f25d4014070 2024-05-08T18:51:08.639 INFO:teuthology.orchestra.run.smithi132.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-05-08T18:51:08.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.640+0000 7f24917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:08.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.640+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94047808568048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x5589363961e0 con 0x55893637abc0 2024-05-08T18:51:08.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.641+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94047808568048] v25'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x55893637abc0 2024-05-08T18:51:08.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.641+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94047808543712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55893638baf0 con 0x7f25d4014070 2024-05-08T18:51:08.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.642+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94047808543712] v25'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25cc02d070 con 0x7f25d4014070 2024-05-08T18:51:08.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.642+0000 7f25def1f800 20 remove_watcher() i=0 2024-05-08T18:51:08.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.642+0000 7f25def1f800 2 removed watcher, disabling cache 2024-05-08T18:51:08.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.642+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94047808546640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55893638baf0 con 0x55893637abc0 2024-05-08T18:51:08.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.643+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94047808546640] v25'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x55893637abc0 2024-05-08T18:51:08.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.643+0000 7f25def1f800 20 remove_watcher() i=1 2024-05-08T18:51:08.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.643+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94047808551472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936386750 con 0x55893637f570 2024-05-08T18:51:08.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.644+0000 7f25db3e1640 1 -- 172.21.15.132:0/558131201 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94047808551472] v25'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25d402a070 con 0x55893637f570 2024-05-08T18:51:08.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.644+0000 7f25def1f800 20 remove_watcher() i=2 2024-05-08T18:51:08.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.644+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94047808554304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55893638baf0 con 0x7f25d4014070 2024-05-08T18:51:08.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.645+0000 7f25dabe0640 1 -- 172.21.15.132:0/558131201 <== osd.2 v2:172.21.15.132:6808/1108348591 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94047808554304] v25'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25cc02d070 con 0x7f25d4014070 2024-05-08T18:51:08.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.645+0000 7f25def1f800 20 remove_watcher() i=3 2024-05-08T18:51:08.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.645+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94047808557872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936387a30 con 0x55893637abc0 2024-05-08T18:51:08.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.646+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94047808557872] v25'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x55893637abc0 2024-05-08T18:51:08.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.646+0000 7f25def1f800 20 remove_watcher() i=4 2024-05-08T18:51:08.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.646+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94047808561504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936386750 con 0x7f25cc042040 2024-05-08T18:51:08.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.647+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94047808561504] v25'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x7f25cc042040 2024-05-08T18:51:08.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.647+0000 7f25def1f800 20 remove_watcher() i=5 2024-05-08T18:51:08.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.647+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94047808564224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x558936388540 con 0x7f25cc042040 2024-05-08T18:51:08.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.648+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94047808564224] v25'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x7f25cc042040 2024-05-08T18:51:08.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.648+0000 7f25def1f800 20 remove_watcher() i=6 2024-05-08T18:51:08.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.648+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94047808566432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25) -- 0x55893638baf0 con 0x7f25cc042040 2024-05-08T18:51:08.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.648+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94047808566432] v25'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c407d040 con 0x7f25cc042040 2024-05-08T18:51:08.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.648+0000 7f25def1f800 20 remove_watcher() i=7 2024-05-08T18:51:08.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f25cc042040 msgr2=0x7f25cc043430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f25cc042040 0x7f25cc043430 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55893637abc0 msgr2=0x55893637d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55893637abc0 0x55893637d080 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f25d4014070 msgr2=0x7f25d405e6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f25d4014070 0x7f25d405e6c0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55893637f570 msgr2=0x558936381960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55893637f570 0x558936381960 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f24a403bb50 msgr2=0x7f24a403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f24a403bb50 0x7f24a403e010 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f25cc019fd0 tx=0x7f25cc053050 comp rx=0 tx=0).stop 2024-05-08T18:51:08.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589363679a0 msgr2=0x55893636efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25d3fff640 1 -- 172.21.15.132:0/558131201 reap_dead start 2024-05-08T18:51:08.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589363679a0 0x55893636efa0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f25d4001350 tx=0x7f25d4052be0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 shutdown_connections 2024-05-08T18:51:08.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 --2- 172.21.15.132:0/558131201 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5589363679a0 0x55893636efa0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 >> 172.21.15.132:0/558131201 conn(0x558936363cb0 msgr2=0x558936361360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 shutdown_connections 2024-05-08T18:51:08.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 -- 172.21.15.132:0/558131201 wait complete. 2024-05-08T18:51:08.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 -- 172.21.15.132:0/2908629290 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f24b403bba0 msgr2=0x7f24b403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 --2- 172.21.15.132:0/2908629290 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f24b403bba0 0x7f24b403e060 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00ed00 tx=0x7f25cc051710 comp rx=0 tx=0).stop 2024-05-08T18:51:08.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 -- 172.21.15.132:0/2908629290 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558936244870 msgr2=0x558936242ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 --2- 172.21.15.132:0/2908629290 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558936244870 0x558936242ce0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x558936344bd0 tx=0x7f25d4018830 comp rx=0 tx=0).stop 2024-05-08T18:51:08.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 -- 172.21.15.132:0/2908629290 shutdown_connections 2024-05-08T18:51:08.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 --2- 172.21.15.132:0/2908629290 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f24b403bba0 0x7f24b403e060 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 --2- 172.21.15.132:0/2908629290 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558936244870 0x558936242ce0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 -- 172.21.15.132:0/2908629290 >> 172.21.15.132:0/2908629290 conn(0x55893634c5b0 msgr2=0x55893634c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 -- 172.21.15.132:0/2908629290 shutdown_connections 2024-05-08T18:51:08.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.649+0000 7f25def1f800 1 -- 172.21.15.132:0/2908629290 wait complete. 2024-05-08T18:51:08.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.650+0000 7f25def1f800 1 -- 172.21.15.132:0/1544956407 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5589362487e0 msgr2=0x558936344270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.650+0000 7f25def1f800 1 --2- 172.21.15.132:0/1544956407 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5589362487e0 0x558936344270 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.650+0000 7f25def1f800 1 -- 172.21.15.132:0/1544956407 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558936346b20 msgr2=0x558936348f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.650+0000 7f25def1f800 1 --2- 172.21.15.132:0/1544956407 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558936346b20 0x558936348f10 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.650+0000 7f25def1f800 1 -- 172.21.15.132:0/1544956407 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f24c003bb50 msgr2=0x7f24c003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.650+0000 7f25def1f800 1 --2- 172.21.15.132:0/1544956407 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f24c003bb50 0x7f24c003e010 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f25c4054000 tx=0x7f25c404e000 comp rx=0 tx=0).stop 2024-05-08T18:51:08.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.650+0000 7f25def1f800 1 -- 172.21.15.132:0/1544956407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558936244cd0 msgr2=0x55893633d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:08.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.650+0000 7f25def1f800 1 --2- 172.21.15.132:0/1544956407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558936244cd0 0x55893633d030 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00b210 tx=0x7f25cc000ed0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.650+0000 7f25def1f800 1 -- 172.21.15.132:0/1544956407 shutdown_connections 2024-05-08T18:51:08.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.650+0000 7f25def1f800 1 --2- 172.21.15.132:0/1544956407 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558936346b20 0x558936348f10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.650+0000 7f25def1f800 1 --2- 172.21.15.132:0/1544956407 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5589362487e0 0x558936344270 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.650+0000 7f25def1f800 1 --2- 172.21.15.132:0/1544956407 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f24c003bb50 0x7f24c003e010 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.650+0000 7f25def1f800 1 --2- 172.21.15.132:0/1544956407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558936244cd0 0x55893633d030 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:08.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.650+0000 7f25def1f800 1 -- 172.21.15.132:0/1544956407 >> 172.21.15.132:0/1544956407 conn(0x55893623e720 msgr2=0x55893632f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:08.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.650+0000 7f25def1f800 1 -- 172.21.15.132:0/1544956407 shutdown_connections 2024-05-08T18:51:08.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:08.650+0000 7f25def1f800 1 -- 172.21.15.132:0/1544956407 wait complete. 2024-05-08T18:51:08.658 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-08T18:51:08.674 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:51:08.718 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-05-08T18:51:43.719 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-05-08T18:51:43.720 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-05-08T18:51:43.720 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-05-08T18:51:43.772 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:43.772 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:43.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.774+0000 7ffa07f2e800 1 Processor -- start 2024-05-08T18:51:43.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.774+0000 7ffa07f2e800 1 -- start start 2024-05-08T18:51:43.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.774+0000 7ffa07f2e800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55e006189610 0x55e00618ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.774+0000 7ffa07f2e800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e00618bfd0 con 0x55e006185660 2024-05-08T18:51:43.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.774+0000 7ffa07f2e800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55e006026e20 con 0x55e006189610 2024-05-08T18:51:43.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.774+0000 7ff9fbfff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55e006189610 0x55e00618ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.774+0000 7ffa03c84640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55e006185660 0x55e006185a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:49008/0 (socket says 172.21.15.132:49008) 2024-05-08T18:51:43.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.774+0000 7ffa03c84640 1 -- 172.21.15.132:0/2660954073 learned_addr learned my addr 172.21.15.132:0/2660954073 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:51:43.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.775+0000 7ff9fbfff640 1 -- 172.21.15.132:0/2660954073 >> v1:172.21.15.42:6789/0 conn(0x55e006185660 legacy=0x55e006185a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:43.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.775+0000 7ff9fbfff640 1 -- 172.21.15.132:0/2660954073 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e00618d1b0 con 0x55e006189610 2024-05-08T18:51:43.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.777+0000 7ff9fbfff640 1 --2- 172.21.15.132:0/2660954073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e006189610 0x55e00618ba00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec00a470 tx=0x7ff9ec01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8796d1f2df0a1e38 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.777+0000 7ffa03483640 1 -- 172.21.15.132:0/2660954073 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9ec057070 con 0x55e006189610 2024-05-08T18:51:43.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.777+0000 7ffa03483640 1 -- 172.21.15.132:0/2660954073 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9ec052570 con 0x55e006189610 2024-05-08T18:51:43.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.777+0000 7ffa03483640 1 -- 172.21.15.132:0/2660954073 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9ec052870 con 0x55e006189610 2024-05-08T18:51:43.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.777+0000 7ffa07f2e800 1 -- 172.21.15.132:0/2660954073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e006189610 msgr2=0x55e00618ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:43.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.777+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/2660954073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e006189610 0x55e00618ba00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec00a470 tx=0x7ff9ec01ce90 comp rx=0 tx=0).stop 2024-05-08T18:51:43.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.777+0000 7ffa07f2e800 1 -- 172.21.15.132:0/2660954073 shutdown_connections 2024-05-08T18:51:43.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.777+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/2660954073 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e006189610 0x55e00618ba00 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.777+0000 7ffa07f2e800 1 -- 172.21.15.132:0/2660954073 >> 172.21.15.132:0/2660954073 conn(0x55e00617fea0 msgr2=0x55e0061822c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:43.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.777+0000 7ffa07f2e800 1 -- 172.21.15.132:0/2660954073 shutdown_connections 2024-05-08T18:51:43.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.777+0000 7ffa07f2e800 1 -- 172.21.15.132:0/2660954073 wait complete. 2024-05-08T18:51:43.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.793+0000 7ffa07f2e800 1 Processor -- start 2024-05-08T18:51:43.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.793+0000 7ffa07f2e800 1 -- start start 2024-05-08T18:51:43.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.793+0000 7ffa07f2e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e006185660 0x55e006184d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.793+0000 7ffa07f2e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e0060d15b0 con 0x55e006185660 2024-05-08T18:51:43.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.793+0000 7ffa03c84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e006185660 0x55e006184d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.794+0000 7ffa03c84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e006185660 0x55e006184d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56076/0 (socket says 172.21.15.132:56076) 2024-05-08T18:51:43.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.794+0000 7ffa03c84640 1 -- 172.21.15.132:0/352488663 learned_addr learned my addr 172.21.15.132:0/352488663 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:43.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.794+0000 7ffa03c84640 1 -- 172.21.15.132:0/352488663 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e00627a3c0 con 0x55e006185660 2024-05-08T18:51:43.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.794+0000 7ffa03c84640 1 --2- 172.21.15.132:0/352488663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e006185660 0x55e006184d60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4001de0 tx=0x7ff9f400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed20b1064610589 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.794+0000 7ff8f1e0b640 1 -- 172.21.15.132:0/352488663 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9f4012020 con 0x55e006185660 2024-05-08T18:51:43.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.794+0000 7ff8f1e0b640 1 -- 172.21.15.132:0/352488663 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9f400e5a0 con 0x55e006185660 2024-05-08T18:51:43.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.794+0000 7ff8f1e0b640 1 -- 172.21.15.132:0/352488663 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9f400e8c0 con 0x55e006185660 2024-05-08T18:51:43.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.795+0000 7ffa07f2e800 1 -- 172.21.15.132:0/352488663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e006185660 msgr2=0x55e006184d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:43.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.795+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/352488663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e006185660 0x55e006184d60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff9f4001de0 tx=0x7ff9f400b6c0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.795+0000 7ffa07f2e800 1 -- 172.21.15.132:0/352488663 shutdown_connections 2024-05-08T18:51:43.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.795+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/352488663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e006185660 0x55e006184d60 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.795+0000 7ffa07f2e800 1 -- 172.21.15.132:0/352488663 >> 172.21.15.132:0/352488663 conn(0x55e00617fea0 msgr2=0x55e006271eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:43.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.795+0000 7ffa07f2e800 1 -- 172.21.15.132:0/352488663 shutdown_connections 2024-05-08T18:51:43.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.795+0000 7ffa07f2e800 1 -- 172.21.15.132:0/352488663 wait complete. 2024-05-08T18:51:43.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.795+0000 7ffa07f2e800 1 Processor -- start 2024-05-08T18:51:43.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.795+0000 7ffa07f2e800 1 -- start start 2024-05-08T18:51:43.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.796+0000 7ffa07f2e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e006185660 0x55e00627f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.796+0000 7ffa07f2e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e00618c4a0 con 0x55e006185660 2024-05-08T18:51:43.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.796+0000 7ffa03c84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e006185660 0x55e00627f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.796+0000 7ffa03c84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e006185660 0x55e00627f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56092/0 (socket says 172.21.15.132:56092) 2024-05-08T18:51:43.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.796+0000 7ffa03c84640 1 -- 172.21.15.132:0/520935633 learned_addr learned my addr 172.21.15.132:0/520935633 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:43.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.796+0000 7ffa03c84640 1 -- 172.21.15.132:0/520935633 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e00627f6f0 con 0x55e006185660 2024-05-08T18:51:43.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.796+0000 7ffa03c84640 1 --2- 172.21.15.132:0/520935633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e006185660 0x55e00627f1b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff9f400c010 tx=0x7ff9f4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.797+0000 7ff8ebfff640 1 -- 172.21.15.132:0/520935633 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9f4012070 con 0x55e006185660 2024-05-08T18:51:43.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.797+0000 7ff8ebfff640 1 -- 172.21.15.132:0/520935633 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9f401a7a0 con 0x55e006185660 2024-05-08T18:51:43.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.797+0000 7ffa07f2e800 1 -- 172.21.15.132:0/520935633 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e00627f980 con 0x55e006185660 2024-05-08T18:51:43.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.797+0000 7ff8ebfff640 1 -- 172.21.15.132:0/520935633 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9f401aa80 con 0x55e006185660 2024-05-08T18:51:43.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.797+0000 7ffa07f2e800 1 -- 172.21.15.132:0/520935633 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e006282630 con 0x55e006185660 2024-05-08T18:51:43.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.798+0000 7ff8ebfff640 1 -- 172.21.15.132:0/520935633 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff9f4015020 con 0x55e006185660 2024-05-08T18:51:43.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.798+0000 7ff8ebfff640 1 --2- 172.21.15.132:0/520935633 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8ec03bb50 0x7ff8ec03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.798+0000 7ff8ebfff640 1 -- 172.21.15.132:0/520935633 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7ff9f4020070 con 0x55e006185660 2024-05-08T18:51:43.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.798+0000 7ff9fbfff640 1 --2- 172.21.15.132:0/520935633 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8ec03bb50 0x7ff8ec03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.798+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/520935633 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e006189610 0x55e0062863f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.798+0000 7ffa07f2e800 1 -- 172.21.15.132:0/520935633 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e006286930 con 0x55e006189610 2024-05-08T18:51:43.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.798+0000 7ffa04485640 1 --2- 172.21.15.132:0/520935633 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e006189610 0x55e0062863f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.798+0000 7ff9fbfff640 1 --2- 172.21.15.132:0/520935633 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8ec03bb50 0x7ff8ec03e010 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec054000 tx=0x7ff9ec04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.799+0000 7ffa04485640 1 --2- 172.21.15.132:0/520935633 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e006189610 0x55e0062863f0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.799+0000 7ffa04485640 1 -- 172.21.15.132:0/520935633 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9fc00a4a0 con 0x55e006189610 2024-05-08T18:51:43.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.799+0000 7ffa07f2e800 1 -- 172.21.15.132:0/520935633 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0062839c0 con 0x55e006189610 2024-05-08T18:51:43.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.799+0000 7ffa04485640 1 -- 172.21.15.132:0/520935633 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff9fc00a4a0 con 0x55e006189610 2024-05-08T18:51:43.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.799+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/520935633 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e006288c80 0x55e00628b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.799+0000 7ffa07f2e800 1 -- 172.21.15.132:0/520935633 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e00628b760 con 0x55e006288c80 2024-05-08T18:51:43.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.799+0000 7ffa03c84640 1 --2- 172.21.15.132:0/520935633 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e006288c80 0x55e00628b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.800+0000 7ffa03c84640 1 --2- 172.21.15.132:0/520935633 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e006288c80 0x55e00628b070 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.800+0000 7ffa03c84640 1 -- 172.21.15.132:0/520935633 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff9f402b070 con 0x55e006288c80 2024-05-08T18:51:43.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.800+0000 7ffa07f2e800 1 -- 172.21.15.132:0/520935633 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e006287b20 con 0x55e006189610 2024-05-08T18:51:43.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.800+0000 7ffa04485640 1 -- 172.21.15.132:0/520935633 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff9fc00a4a0 con 0x55e006189610 2024-05-08T18:51:43.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.800+0000 7ffa07f2e800 1 -- 172.21.15.132:0/520935633 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e006288000 con 0x55e006189610 2024-05-08T18:51:43.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.801+0000 7ffa04485640 1 -- 172.21.15.132:0/520935633 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff9fc00a4a0 con 0x55e006189610 2024-05-08T18:51:43.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.801+0000 7ffa07f2e800 1 Processor -- start 2024-05-08T18:51:43.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.801+0000 7ffa07f2e800 1 -- start start 2024-05-08T18:51:43.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.801+0000 7ffa07f2e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e00629a6e0 0x55e00629ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.801+0000 7ffa07f2e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e006077fc0 con 0x55e00629a6e0 2024-05-08T18:51:43.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.801+0000 7ffa04485640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e00629a6e0 0x55e00629ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.802+0000 7ffa04485640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e00629a6e0 0x55e00629ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56100/0 (socket says 172.21.15.132:56100) 2024-05-08T18:51:43.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.802+0000 7ffa04485640 1 -- 172.21.15.132:0/3278351390 learned_addr learned my addr 172.21.15.132:0/3278351390 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:43.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.802+0000 7ffa04485640 1 -- 172.21.15.132:0/3278351390 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e00629b040 con 0x55e00629a6e0 2024-05-08T18:51:43.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.802+0000 7ffa04485640 1 --2- 172.21.15.132:0/3278351390 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e00629a6e0 0x55e00629ab00 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x55e006286d30 tx=0x7ff9fc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.802+0000 7ff8e97fa640 1 -- 172.21.15.132:0/3278351390 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9fc014450 con 0x55e00629a6e0 2024-05-08T18:51:43.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.802+0000 7ff8e97fa640 1 -- 172.21.15.132:0/3278351390 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9fc014610 con 0x55e00629a6e0 2024-05-08T18:51:43.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.802+0000 7ff8e97fa640 1 -- 172.21.15.132:0/3278351390 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9fc014930 con 0x55e00629a6e0 2024-05-08T18:51:43.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.802+0000 7ffa07f2e800 1 -- 172.21.15.132:0/3278351390 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e00629bab0 con 0x55e00629a6e0 2024-05-08T18:51:43.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.802+0000 7ffa07f2e800 1 -- 172.21.15.132:0/3278351390 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e00629bfb0 con 0x55e00629a6e0 2024-05-08T18:51:43.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.803+0000 7ff8e97fa640 1 -- 172.21.15.132:0/3278351390 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff9fc011040 con 0x55e00629a6e0 2024-05-08T18:51:43.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.804+0000 7ff8e97fa640 1 --2- 172.21.15.132:0/3278351390 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8dc03bba0 0x7ff8dc03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.804+0000 7ff8e97fa640 1 -- 172.21.15.132:0/3278351390 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7ff9fc01e070 con 0x55e00629a6e0 2024-05-08T18:51:43.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.804+0000 7ffa03c84640 1 --2- 172.21.15.132:0/3278351390 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8dc03bba0 0x7ff8dc03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.804+0000 7ffa07f2e800 1 Processor -- start 2024-05-08T18:51:43.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.804+0000 7ffa03c84640 1 --2- 172.21.15.132:0/3278351390 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8dc03bba0 0x7ff8dc03e060 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55e006286dd0 tx=0x7ff9f4050ce0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.804+0000 7ffa07f2e800 1 -- start start 2024-05-08T18:51:43.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.804+0000 7ffa07f2e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e0062779a0 0x55e006277dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.804+0000 7ffa07f2e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e00627a710 con 0x55e0062779a0 2024-05-08T18:51:43.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.805+0000 7ffa04485640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e0062779a0 0x55e006277dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.805+0000 7ffa04485640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e0062779a0 0x55e006277dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56116/0 (socket says 172.21.15.132:56116) 2024-05-08T18:51:43.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.805+0000 7ffa04485640 1 -- 172.21.15.132:0/1714281194 learned_addr learned my addr 172.21.15.132:0/1714281194 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:43.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.805+0000 7ffa04485640 1 -- 172.21.15.132:0/1714281194 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0062761a0 con 0x55e0062779a0 2024-05-08T18:51:43.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.805+0000 7ffa04485640 1 --2- 172.21.15.132:0/1714281194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e0062779a0 0x55e006277dc0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc052c50 tx=0x7ff9fc011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4303025fe9d7f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.805+0000 7ff8e2ffd640 1 -- 172.21.15.132:0/1714281194 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9fc028070 con 0x55e0062779a0 2024-05-08T18:51:43.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.805+0000 7ff8e2ffd640 1 -- 172.21.15.132:0/1714281194 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9fc02b350 con 0x55e0062779a0 2024-05-08T18:51:43.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.805+0000 7ff8e2ffd640 1 -- 172.21.15.132:0/1714281194 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9fc016910 con 0x55e0062779a0 2024-05-08T18:51:43.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.806+0000 7ffa07f2e800 1 -- 172.21.15.132:0/1714281194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e0062779a0 msgr2=0x55e006277dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:43.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.806+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/1714281194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e0062779a0 0x55e006277dc0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc052c50 tx=0x7ff9fc011a80 comp rx=0 tx=0).stop 2024-05-08T18:51:43.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.806+0000 7ffa07f2e800 1 -- 172.21.15.132:0/1714281194 shutdown_connections 2024-05-08T18:51:43.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.806+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/1714281194 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e0062779a0 0x55e006277dc0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.806+0000 7ffa07f2e800 1 -- 172.21.15.132:0/1714281194 >> 172.21.15.132:0/1714281194 conn(0x55e0062a3c70 msgr2=0x55e0062a1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:43.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.806+0000 7ffa07f2e800 1 -- 172.21.15.132:0/1714281194 shutdown_connections 2024-05-08T18:51:43.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.806+0000 7ffa07f2e800 1 -- 172.21.15.132:0/1714281194 wait complete. 2024-05-08T18:51:43.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.806+0000 7ffa07f2e800 1 Processor -- start 2024-05-08T18:51:43.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.806+0000 7ffa07f2e800 1 -- start start 2024-05-08T18:51:43.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.806+0000 7ffa07f2e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e0062779a0 0x55e0062b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.806+0000 7ffa07f2e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e006276670 con 0x55e0062779a0 2024-05-08T18:51:43.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.807+0000 7ffa04485640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e0062779a0 0x55e0062b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.807+0000 7ffa04485640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e0062779a0 0x55e0062b10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56132/0 (socket says 172.21.15.132:56132) 2024-05-08T18:51:43.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.807+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 learned_addr learned my addr 172.21.15.132:0/889156197 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:43.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.807+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0062b1610 con 0x55e0062779a0 2024-05-08T18:51:43.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.807+0000 7ffa04485640 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e0062779a0 0x55e0062b10d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc052c50 tx=0x7ff9fc052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.807+0000 7ff8e17fa640 1 -- 172.21.15.132:0/889156197 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9fc011bc0 con 0x55e0062779a0 2024-05-08T18:51:43.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.807+0000 7ff8e17fa640 1 -- 172.21.15.132:0/889156197 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9fc032070 con 0x55e0062779a0 2024-05-08T18:51:43.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.807+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0062b18a0 con 0x55e0062779a0 2024-05-08T18:51:43.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.807+0000 7ff8e17fa640 1 -- 172.21.15.132:0/889156197 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9fc0541d0 con 0x55e0062779a0 2024-05-08T18:51:43.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.807+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0062b4550 con 0x55e0062779a0 2024-05-08T18:51:43.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.808+0000 7ff8e17fa640 1 -- 172.21.15.132:0/889156197 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff9fc04b040 con 0x55e0062779a0 2024-05-08T18:51:43.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.809+0000 7ff8e17fa640 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8cc03bb50 0x7ff8cc03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.809+0000 7ff8e17fa640 1 -- 172.21.15.132:0/889156197 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7ff9fc048040 con 0x55e0062779a0 2024-05-08T18:51:43.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.809+0000 7ffa07f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:43.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.809+0000 7ffa03c84640 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8cc03bb50 0x7ff8cc03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.809+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e0062bcb70 0x55e0062bf010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.809+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0062bf760 con 0x55e0062bcb70 2024-05-08T18:51:43.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.809+0000 7ff9fbfff640 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e0062bcb70 0x55e0062bf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.809+0000 7ffa03c84640 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8cc03bb50 0x7ff8cc03e010 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff9f400b6e0 tx=0x7ff9f404d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.809+0000 7ff9fbfff640 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e0062bcb70 0x55e0062bf010 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.810+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9ec05a040 con 0x55e0062bcb70 2024-05-08T18:51:43.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.810+0000 7ffa07f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:43.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.810+0000 7ffa07f2e800 20 realm 2024-05-08T18:51:43.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.810+0000 7ffa07f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:43.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.810+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0062bfb30 con 0x55e0062bcb70 2024-05-08T18:51:43.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.810+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9ec05a040 con 0x55e0062bcb70 2024-05-08T18:51:43.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.810+0000 7ffa07f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:43.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.810+0000 7ffa07f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:43.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.810+0000 7ffa07f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:43.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.810+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c0400 con 0x55e0062bcb70 2024-05-08T18:51:43.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.810+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9ec05a040 con 0x55e0062bcb70 2024-05-08T18:51:43.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.810+0000 7ffa07f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:43.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.810+0000 7ffa07f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:43.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.810+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c07a0 con 0x55e0062bcb70 2024-05-08T18:51:43.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.810+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff9ec05a040 con 0x55e0062bcb70 2024-05-08T18:51:43.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.810+0000 7ffa07f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:43.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.810+0000 7ffa07f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:43.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.810+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e0062c1250 0x55e0062c3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.810+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c3da0 con 0x55e0062c1250 2024-05-08T18:51:43.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.811+0000 7ffa04485640 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e0062c1250 0x55e0062c3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.811+0000 7ffa04485640 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e0062c1250 0x55e0062c3640 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.811+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff9fc02a070 con 0x55e0062c1250 2024-05-08T18:51:43.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.811+0000 7ffa07f2e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:43.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.811+0000 7ffa07f2e800 20 searching for the correct realm 2024-05-08T18:51:43.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.811+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x55e0062c1250 2024-05-08T18:51:43.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.812+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9fc02a070 con 0x55e0062c1250 2024-05-08T18:51:43.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.812+0000 7ffa04485640 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7ff9fc014070 0x7ff9fc0399f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.812+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x7ff9fc014070 2024-05-08T18:51:43.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.812+0000 7ffa03c84640 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7ff9fc014070 0x7ff9fc0399f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.812+0000 7ffa03c84640 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7ff9fc014070 0x7ff9fc0399f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.812+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9f402b070 con 0x7ff9fc014070 2024-05-08T18:51:43.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.812+0000 7ffa03c84640 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7ff9f4017050 0x7ff9f4052190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.812+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x7ff9f4017050 2024-05-08T18:51:43.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.813+0000 7ff9fbfff640 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7ff9f4017050 0x7ff9f4052190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.813+0000 7ff9fbfff640 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7ff9f4017050 0x7ff9f4052190 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.813+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9ec05a040 con 0x7ff9f4017050 2024-05-08T18:51:43.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.813+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x55e0062bcb70 2024-05-08T18:51:43.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.814+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9ec05a040 con 0x55e0062bcb70 2024-05-08T18:51:43.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.814+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x55e0062bcb70 2024-05-08T18:51:43.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.814+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9ec05a040 con 0x55e0062bcb70 2024-05-08T18:51:43.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.814+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x7ff9f4017050 2024-05-08T18:51:43.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.814+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9ec05a040 con 0x7ff9f4017050 2024-05-08T18:51:43.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.814+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x7ff9f4017050 2024-05-08T18:51:43.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.815+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9ec05a040 con 0x7ff9f4017050 2024-05-08T18:51:43.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.815+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x7ff9fc014070 2024-05-08T18:51:43.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.815+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9f402b070 con 0x7ff9fc014070 2024-05-08T18:51:43.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.815+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x55e0062c1250 2024-05-08T18:51:43.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.815+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9fc02a070 con 0x55e0062c1250 2024-05-08T18:51:43.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.815+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x55e0062bcb70 2024-05-08T18:51:43.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.815+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9ec05a040 con 0x55e0062bcb70 2024-05-08T18:51:43.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.815+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x7ff9f4017050 2024-05-08T18:51:43.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.816+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9ec05a040 con 0x7ff9f4017050 2024-05-08T18:51:43.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.816+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x55e0062bcb70 2024-05-08T18:51:43.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.816+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff9ec05a040 con 0x55e0062bcb70 2024-05-08T18:51:43.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.816+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x7ff9fc014070 2024-05-08T18:51:43.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.816+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff9f402b070 con 0x7ff9fc014070 2024-05-08T18:51:43.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.816+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x55e0062c1250 2024-05-08T18:51:43.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.816+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff9fc02a070 con 0x55e0062c1250 2024-05-08T18:51:43.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.817+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x55e0062c1250 2024-05-08T18:51:43.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.817+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9fc02a070 con 0x55e0062c1250 2024-05-08T18:51:43.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.817+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x7ff9f4017050 2024-05-08T18:51:43.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.817+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9ec05a040 con 0x7ff9f4017050 2024-05-08T18:51:43.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.817+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x55e0062c1250 2024-05-08T18:51:43.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.817+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9fc02a070 con 0x55e0062c1250 2024-05-08T18:51:43.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.817+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x55e0062c1250 2024-05-08T18:51:43.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.818+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9fc02a070 con 0x55e0062c1250 2024-05-08T18:51:43.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.818+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x55e0062bcb70 2024-05-08T18:51:43.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.818+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9ec05a040 con 0x55e0062bcb70 2024-05-08T18:51:43.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.818+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x55e0062bcb70 2024-05-08T18:51:43.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.818+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff9ec05a040 con 0x55e0062bcb70 2024-05-08T18:51:43.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.818+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x7ff9f4017050 2024-05-08T18:51:43.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.819+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9ec07d040 con 0x7ff9f4017050 2024-05-08T18:51:43.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.819+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x55e0062c1250 2024-05-08T18:51:43.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.819+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9fc06b040 con 0x55e0062c1250 2024-05-08T18:51:43.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.819+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x7ff9fc014070 2024-05-08T18:51:43.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.819+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9f402b070 con 0x7ff9fc014070 2024-05-08T18:51:43.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.819+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x55e0062bcb70 2024-05-08T18:51:43.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.819+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.819+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x7ff9fc014070 2024-05-08T18:51:43.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.820+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9f402b070 con 0x7ff9fc014070 2024-05-08T18:51:43.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.820+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x55e0062c1250 2024-05-08T18:51:43.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.820+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9fc06b040 con 0x55e0062c1250 2024-05-08T18:51:43.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.820+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x7ff9f4017050 2024-05-08T18:51:43.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.820+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9ec07d040 con 0x7ff9f4017050 2024-05-08T18:51:43.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.820+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x7ff9fc014070 2024-05-08T18:51:43.837 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.820+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9f402b070 con 0x7ff9fc014070 2024-05-08T18:51:43.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.820+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x55e0062c1250 2024-05-08T18:51:43.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.821+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9fc06b040 con 0x55e0062c1250 2024-05-08T18:51:43.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.821+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x7ff9f4017050 2024-05-08T18:51:43.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.821+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9ec07d040 con 0x7ff9f4017050 2024-05-08T18:51:43.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.821+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x55e0062bcb70 2024-05-08T18:51:43.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.821+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.821+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5780 con 0x7ff9fc014070 2024-05-08T18:51:43.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.822+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9f402b070 con 0x7ff9fc014070 2024-05-08T18:51:43.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.822+0000 7ffa07f2e800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:43.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.822+0000 7ffa07f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:43.838 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.822+0000 7ffa07f2e800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:43.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.822+0000 7ffa07f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:43.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.822+0000 7ffa07f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:43.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.822+0000 7ffa07f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:43.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.822+0000 7ffa07f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:43.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.822+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c4850 con 0x55e0062bcb70 2024-05-08T18:51:43.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.822+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.822+0000 7ffa07f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:43.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.822+0000 7ffa07f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:43.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.822+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c4490 con 0x55e0062bcb70 2024-05-08T18:51:43.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.822+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.822+0000 7ffa07f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:43.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.822+0000 7ffa07f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:43.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.822+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c5170 con 0x55e0062bcb70 2024-05-08T18:51:43.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ffa07f2e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:43.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ffa07f2e800 20 zone default found 2024-05-08T18:51:43.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ffa07f2e800 4 Realm: () 2024-05-08T18:51:43.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ffa07f2e800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:43.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ffa07f2e800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:43.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ffa07f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:43.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ffa07f2e800 20 zonegroup default 2024-05-08T18:51:43.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ffa07f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:43.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c6100 con 0x7ff9fc014070 2024-05-08T18:51:43.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff9f402b070 con 0x7ff9fc014070 2024-05-08T18:51:43.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ffa07f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:43.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ffa07f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:43.840 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c7ee0 con 0x55e0062c1250 2024-05-08T18:51:43.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff9fc06b040 con 0x55e0062c1250 2024-05-08T18:51:43.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ffa07f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:43.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ffa07f2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:43.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c83f0 con 0x55e0062c1250 2024-05-08T18:51:43.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff9fc06b040 con 0x55e0062c1250 2024-05-08T18:51:43.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ffa07f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:43.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ffa07f2e800 20 started sync module instance, tier type = 2024-05-08T18:51:43.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ffa07f2e800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:43.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.823+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c7320 con 0x7ff9fc014070 2024-05-08T18:51:43.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.824+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9f402b070 con 0x7ff9fc014070 2024-05-08T18:51:43.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.825+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94420664612624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c6f80 con 0x7ff9fc014070 2024-05-08T18:51:43.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.825+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c9320 con 0x55e0062bcb70 2024-05-08T18:51:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.826+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94420664612624] v27'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9f402b070 con 0x7ff9fc014070 2024-05-08T18:51:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.826+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.826+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94420664618608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c9290 con 0x55e0062bcb70 2024-05-08T18:51:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.826+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062ca1e0 con 0x55e0062c1250 2024-05-08T18:51:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.828+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94420664618608] v27'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.828+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9fc06b040 con 0x55e0062c1250 2024-05-08T18:51:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.828+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94420664620816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062ca1e0 con 0x55e0062c1250 2024-05-08T18:51:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.828+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062cac40 con 0x7ff9fc014070 2024-05-08T18:51:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.829+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9f402b070 con 0x7ff9fc014070 2024-05-08T18:51:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.829+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94420664620816] v27'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9fc06b040 con 0x55e0062c1250 2024-05-08T18:51:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.829+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94420664624928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062cb4e0 con 0x7ff9fc014070 2024-05-08T18:51:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.829+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c9d70 con 0x55e0062bcb70 2024-05-08T18:51:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.831+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94420664624928] v27'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9f402b070 con 0x7ff9fc014070 2024-05-08T18:51:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.831+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.831+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94420664627248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062cb450 con 0x55e0062bcb70 2024-05-08T18:51:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.831+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062cc5a0 con 0x7ff9f4017050 2024-05-08T18:51:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.832+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94420664627248] v27'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.832+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x7ff9f4017050 2024-05-08T18:51:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.832+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94420664629968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062cc5a0 con 0x7ff9f4017050 2024-05-08T18:51:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.832+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062ccf60 con 0x7ff9f4017050 2024-05-08T18:51:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.833+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(56 notify.6 [create] v27'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x7ff9f4017050 2024-05-08T18:51:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.833+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94420664634032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062cd380 con 0x7ff9f4017050 2024-05-08T18:51:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.833+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062cde80 con 0x7ff9f4017050 2024-05-08T18:51:43.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.833+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94420664629968] v27'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x7ff9f4017050 2024-05-08T18:51:43.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.834+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94420664634032] v27'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x7ff9f4017050 2024-05-08T18:51:43.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.834+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x7ff9f4017050 2024-05-08T18:51:43.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.834+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94420664637808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062cced0 con 0x7ff9f4017050 2024-05-08T18:51:43.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.834+0000 7ffa07f2e800 20 add_watcher() i=0 2024-05-08T18:51:43.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.834+0000 7ffa07f2e800 20 add_watcher() i=1 2024-05-08T18:51:43.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.834+0000 7ffa07f2e800 20 add_watcher() i=2 2024-05-08T18:51:43.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.834+0000 7ffa07f2e800 20 add_watcher() i=3 2024-05-08T18:51:43.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.834+0000 7ffa07f2e800 20 add_watcher() i=4 2024-05-08T18:51:43.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.834+0000 7ffa07f2e800 20 add_watcher() i=5 2024-05-08T18:51:43.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.834+0000 7ffa07f2e800 20 add_watcher() i=6 2024-05-08T18:51:43.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.835+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94420664637808] v27'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x7ff9f4017050 2024-05-08T18:51:43.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.835+0000 7ffa07f2e800 20 add_watcher() i=7 2024-05-08T18:51:43.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.835+0000 7ffa07f2e800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:43.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.835+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0062cced0 con 0x55e0062bcb70 2024-05-08T18:51:43.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.836+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.836+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94420664631536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062cced0 con 0x55e0062bcb70 2024-05-08T18:51:43.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.837+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94420664631536] v27'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.837+0000 7ff8b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:43.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.837+0000 7ffa07f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:43.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.837+0000 7ffa07f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:43.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.837+0000 7ffa07f2e800 5 note: GC not initialized 2024-05-08T18:51:43.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.837+0000 7ff8b8fe1640 20 reqs_thread_entry: start 2024-05-08T18:51:43.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.837+0000 7ffa07f2e800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:43.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.837+0000 7ffa07f2e800 20 Filter name: none 2024-05-08T18:51:43.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.838+0000 7ff8327fc640 20 reqs_thread_entry: start 2024-05-08T18:51:43.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.838+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063047b0 con 0x55e0062bcb70 2024-05-08T18:51:43.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.838+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.838+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063047b0 con 0x7ff9fc014070 2024-05-08T18:51:43.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.838+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff9f402b070 con 0x7ff9fc014070 2024-05-08T18:51:43.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.838+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063047b0 con 0x55e0062bcb70 2024-05-08T18:51:43.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.838+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.838+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e006304770 con 0x55e0062c1250 2024-05-08T18:51:43.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.839+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff9fc06b040 con 0x55e0062c1250 2024-05-08T18:51:43.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.839+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e006304770 con 0x55e0062c1250 2024-05-08T18:51:43.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.839+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff9fc06b040 con 0x55e0062c1250 2024-05-08T18:51:43.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.839+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e006304770 con 0x55e0062c1250 2024-05-08T18:51:43.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.839+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff9fc06b040 con 0x55e0062c1250 2024-05-08T18:51:43.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.839+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e006304770 con 0x55e0062bcb70 2024-05-08T18:51:43.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.839+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.839+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e006304770 con 0x55e0062bcb70 2024-05-08T18:51:43.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.839+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.840+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e006304770 con 0x55e0062c1250 2024-05-08T18:51:43.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.840+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff9fc06b040 con 0x55e0062c1250 2024-05-08T18:51:43.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.840+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e006304770 con 0x55e0062c1250 2024-05-08T18:51:43.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.840+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff9fc06b040 con 0x55e0062c1250 2024-05-08T18:51:43.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.840+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e006304770 con 0x7ff9f4017050 2024-05-08T18:51:43.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.841+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7ff9ec07d040 con 0x7ff9f4017050 2024-05-08T18:51:43.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.841+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063062f0 con 0x55e0062bcb70 2024-05-08T18:51:43.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.841+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.841+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063062f0 con 0x7ff9fc014070 2024-05-08T18:51:43.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.841+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9f402b070 con 0x7ff9fc014070 2024-05-08T18:51:43.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.841+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063062f0 con 0x55e0062c1250 2024-05-08T18:51:43.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.841+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9fc06b040 con 0x55e0062c1250 2024-05-08T18:51:43.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.841+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063062f0 con 0x7ff9f4017050 2024-05-08T18:51:43.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.842+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x7ff9f4017050 2024-05-08T18:51:43.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.842+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063062f0 con 0x7ff9f4017050 2024-05-08T18:51:43.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.842+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x7ff9f4017050 2024-05-08T18:51:43.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.842+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063062f0 con 0x55e0062c1250 2024-05-08T18:51:43.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.842+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9fc06b040 con 0x55e0062c1250 2024-05-08T18:51:43.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.842+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063062a0 con 0x7ff9f4017050 2024-05-08T18:51:43.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.843+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7ff9ec07d040 con 0x7ff9f4017050 2024-05-08T18:51:43.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.843+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063062a0 con 0x55e0062bcb70 2024-05-08T18:51:43.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.843+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.843+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063062a0 con 0x55e0062c1250 2024-05-08T18:51:43.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.843+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9fc06b040 con 0x55e0062c1250 2024-05-08T18:51:43.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.843+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063062a0 con 0x7ff9f4017050 2024-05-08T18:51:43.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.843+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x7ff9f4017050 2024-05-08T18:51:43.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.843+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063062a0 con 0x7ff9fc014070 2024-05-08T18:51:43.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.844+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9f402b070 con 0x7ff9fc014070 2024-05-08T18:51:43.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.844+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063062a0 con 0x7ff9f4017050 2024-05-08T18:51:43.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.844+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x7ff9f4017050 2024-05-08T18:51:43.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.844+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063062a0 con 0x55e0062bcb70 2024-05-08T18:51:43.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.844+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.844+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063062a0 con 0x55e0062bcb70 2024-05-08T18:51:43.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.844+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.845+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063062a0 con 0x55e0062c1250 2024-05-08T18:51:43.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.845+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9fc06b040 con 0x55e0062c1250 2024-05-08T18:51:43.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.845+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063062a0 con 0x55e0062bcb70 2024-05-08T18:51:43.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.845+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.845+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063062a0 con 0x55e0062bcb70 2024-05-08T18:51:43.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.845+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.845+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063062a0 con 0x55e0062c1250 2024-05-08T18:51:43.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.845+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9fc06b040 con 0x55e0062c1250 2024-05-08T18:51:43.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.845+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063062a0 con 0x55e0062c1250 2024-05-08T18:51:43.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.846+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9fc06b040 con 0x55e0062c1250 2024-05-08T18:51:43.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.846+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063062a0 con 0x55e0062c1250 2024-05-08T18:51:43.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.846+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9fc06b040 con 0x55e0062c1250 2024-05-08T18:51:43.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.846+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e0063062a0 con 0x7ff9f4017050 2024-05-08T18:51:43.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.846+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x7ff9f4017050 2024-05-08T18:51:43.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.847+0000 7ff8b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:43.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.847+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94420664631536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e006302470 con 0x55e0062bcb70 2024-05-08T18:51:43.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.848+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94420664631536] v27'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.848+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94420664612624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062cc0f0 con 0x7ff9fc014070 2024-05-08T18:51:43.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.849+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94420664612624] v27'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9f402b070 con 0x7ff9fc014070 2024-05-08T18:51:43.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.849+0000 7ffa07f2e800 20 remove_watcher() i=0 2024-05-08T18:51:43.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.849+0000 7ffa07f2e800 2 removed watcher, disabling cache 2024-05-08T18:51:43.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.849+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94420664618608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c7710 con 0x55e0062bcb70 2024-05-08T18:51:43.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.850+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94420664618608] v27'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.851+0000 7ffa07f2e800 20 remove_watcher() i=1 2024-05-08T18:51:43.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.851+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94420664620816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c7710 con 0x55e0062c1250 2024-05-08T18:51:43.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.852+0000 7ffa04485640 1 -- 172.21.15.132:0/889156197 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94420664620816] v27'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9fc06b040 con 0x55e0062c1250 2024-05-08T18:51:43.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.852+0000 7ffa07f2e800 20 remove_watcher() i=2 2024-05-08T18:51:43.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.852+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94420664624928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c9710 con 0x7ff9fc014070 2024-05-08T18:51:43.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.853+0000 7ffa03c84640 1 -- 172.21.15.132:0/889156197 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94420664624928] v27'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9f402b070 con 0x7ff9fc014070 2024-05-08T18:51:43.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.853+0000 7ffa07f2e800 20 remove_watcher() i=3 2024-05-08T18:51:43.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.853+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94420664627248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062c7710 con 0x55e0062bcb70 2024-05-08T18:51:43.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.854+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.1 v2:172.21.15.132:6800/3697320277 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94420664627248] v27'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x55e0062bcb70 2024-05-08T18:51:43.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.854+0000 7ffa07f2e800 20 remove_watcher() i=4 2024-05-08T18:51:43.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.854+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94420664629968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062ca720 con 0x7ff9f4017050 2024-05-08T18:51:43.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.855+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94420664629968] v27'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x7ff9f4017050 2024-05-08T18:51:43.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.855+0000 7ffa07f2e800 20 remove_watcher() i=5 2024-05-08T18:51:43.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.855+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94420664634032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062ca720 con 0x7ff9f4017050 2024-05-08T18:51:43.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.856+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94420664634032] v27'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x7ff9f4017050 2024-05-08T18:51:43.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.856+0000 7ffa07f2e800 20 remove_watcher() i=6 2024-05-08T18:51:43.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.856+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94420664637808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e0062ca720 con 0x7ff9f4017050 2024-05-08T18:51:43.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.857+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94420664637808] v27'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9ec07d040 con 0x7ff9f4017050 2024-05-08T18:51:43.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.857+0000 7ffa07f2e800 20 remove_watcher() i=7 2024-05-08T18:51:43.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.857+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7ff9f4017050 msgr2=0x7ff9f4052190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:43.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.857+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7ff9f4017050 0x7ff9f4052190 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.857+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e0062bcb70 msgr2=0x55e0062bf010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:43.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.857+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e0062bcb70 0x55e0062bf010 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.857+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7ff9fc014070 msgr2=0x7ff9fc0399f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:43.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.857+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7ff9fc014070 0x7ff9fc0399f0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.857+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e0062c1250 msgr2=0x55e0062c3640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:43.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.857+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e0062c1250 0x55e0062c3640 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.858+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8cc03bb50 msgr2=0x7ff8cc03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:43.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.858+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8cc03bb50 0x7ff8cc03e010 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff9f400b6e0 tx=0x7ff9f404d000 comp rx=0 tx=0).stop 2024-05-08T18:51:43.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.858+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e0062779a0 msgr2=0x55e0062b10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:43.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.858+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e0062779a0 0x55e0062b10d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff9fc052c50 tx=0x7ff9fc052be0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.858+0000 7ff9fbfff640 1 -- 172.21.15.132:0/889156197 reap_dead start 2024-05-08T18:51:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.858+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 shutdown_connections 2024-05-08T18:51:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.858+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/889156197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e0062779a0 0x55e0062b10d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.858+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 >> 172.21.15.132:0/889156197 conn(0x55e0062a3c70 msgr2=0x55e0062a12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.858+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 shutdown_connections 2024-05-08T18:51:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.858+0000 7ffa07f2e800 1 -- 172.21.15.132:0/889156197 wait complete. 2024-05-08T18:51:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.858+0000 7ffa07f2e800 1 -- 172.21.15.132:0/3278351390 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8dc03bba0 msgr2=0x7ff8dc03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.858+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/3278351390 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8dc03bba0 0x7ff8dc03e060 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55e006286dd0 tx=0x7ff9f4050ce0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.858+0000 7ffa07f2e800 1 -- 172.21.15.132:0/3278351390 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e00629a6e0 msgr2=0x55e00629ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.858+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/3278351390 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e00629a6e0 0x55e00629ab00 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x55e006286d30 tx=0x7ff9fc018830 comp rx=0 tx=0).stop 2024-05-08T18:51:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.858+0000 7ffa07f2e800 1 -- 172.21.15.132:0/3278351390 shutdown_connections 2024-05-08T18:51:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.858+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/3278351390 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8dc03bba0 0x7ff8dc03e060 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.858+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/3278351390 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e00629a6e0 0x55e00629ab00 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.858+0000 7ffa07f2e800 1 -- 172.21.15.132:0/3278351390 >> 172.21.15.132:0/3278351390 conn(0x55e00628e780 msgr2=0x55e00628eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:43.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.858+0000 7ffa07f2e800 1 -- 172.21.15.132:0/3278351390 shutdown_connections 2024-05-08T18:51:43.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.858+0000 7ffa07f2e800 1 -- 172.21.15.132:0/3278351390 wait complete. 2024-05-08T18:51:43.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.859+0000 7ffa07f2e800 1 -- 172.21.15.132:0/520935633 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e006189610 msgr2=0x55e0062863f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:43.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.859+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/520935633 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e006189610 0x55e0062863f0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.859+0000 7ffa07f2e800 1 -- 172.21.15.132:0/520935633 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e006288c80 msgr2=0x55e00628b070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:43.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.859+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/520935633 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e006288c80 0x55e00628b070 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.859+0000 7ffa07f2e800 1 -- 172.21.15.132:0/520935633 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8ec03bb50 msgr2=0x7ff8ec03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:43.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.859+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/520935633 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8ec03bb50 0x7ff8ec03e010 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec054000 tx=0x7ff9ec04e000 comp rx=0 tx=0).stop 2024-05-08T18:51:43.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.859+0000 7ffa07f2e800 1 -- 172.21.15.132:0/520935633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e006185660 msgr2=0x55e00627f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:43.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.859+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/520935633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e006185660 0x55e00627f1b0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff9f400c010 tx=0x7ff9f4000ed0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.859+0000 7ffa07f2e800 1 -- 172.21.15.132:0/520935633 shutdown_connections 2024-05-08T18:51:43.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.859+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/520935633 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e006288c80 0x55e00628b070 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.859+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/520935633 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e006189610 0x55e0062863f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.859+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/520935633 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8ec03bb50 0x7ff8ec03e010 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.859+0000 7ffa07f2e800 1 --2- 172.21.15.132:0/520935633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e006185660 0x55e00627f1b0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.859+0000 7ffa07f2e800 1 -- 172.21.15.132:0/520935633 >> 172.21.15.132:0/520935633 conn(0x55e00617fea0 msgr2=0x55e0062706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:43.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.859+0000 7ffa07f2e800 1 -- 172.21.15.132:0/520935633 shutdown_connections 2024-05-08T18:51:43.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.859+0000 7ffa07f2e800 1 -- 172.21.15.132:0/520935633 wait complete. 2024-05-08T18:51:43.871 INFO:teuthology.orchestra.run.smithi132.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"anonymous","categories":[],"s3select":{}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-08T18:51:43.871 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:51:43.871 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-05-08T18:51:43.871 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-05-08T18:51:43.871 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-05-08T18:51:43.913 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:43.913 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:43.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.915+0000 7fca11733800 1 Processor -- start 2024-05-08T18:51:43.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.915+0000 7fca11733800 1 -- start start 2024-05-08T18:51:43.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.915+0000 7fca11733800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x562f42089690 0x562f4208ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.915+0000 7fca11733800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562f4208c050 con 0x562f420852a0 2024-05-08T18:51:43.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.915+0000 7fca11733800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x562f41f25e20 con 0x562f42089690 2024-05-08T18:51:43.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.915+0000 7fca07fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x562f42089690 0x562f4208ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.915+0000 7fca0d3ee640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x562f420852a0 0x562f420856c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:49020/0 (socket says 172.21.15.132:49020) 2024-05-08T18:51:43.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.915+0000 7fca07fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x562f42089690 0x562f4208ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56148/0 (socket says 172.21.15.132:56148) 2024-05-08T18:51:43.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.915+0000 7fca0d3ee640 1 -- 172.21.15.132:0/2278702908 learned_addr learned my addr 172.21.15.132:0/2278702908 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:51:43.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.916+0000 7fca07fff640 1 -- 172.21.15.132:0/2278702908 >> v1:172.21.15.42:6789/0 conn(0x562f420852a0 legacy=0x562f420856c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:43.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.916+0000 7fca07fff640 1 -- 172.21.15.132:0/2278702908 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f4208d280 con 0x562f42089690 2024-05-08T18:51:43.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.917+0000 7fca07fff640 1 --2- 172.21.15.132:0/2278702908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f42089690 0x562f4208ba80 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800a470 tx=0x7fc9f801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c2a5b2911102ad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.918+0000 7fca0cbed640 1 -- 172.21.15.132:0/2278702908 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9f8057070 con 0x562f42089690 2024-05-08T18:51:43.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.918+0000 7fca0cbed640 1 -- 172.21.15.132:0/2278702908 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f8052570 con 0x562f42089690 2024-05-08T18:51:43.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.918+0000 7fca0cbed640 1 -- 172.21.15.132:0/2278702908 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9f8052870 con 0x562f42089690 2024-05-08T18:51:43.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.918+0000 7fca11733800 1 -- 172.21.15.132:0/2278702908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f42089690 msgr2=0x562f4208ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:43.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.918+0000 7fca11733800 1 --2- 172.21.15.132:0/2278702908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f42089690 0x562f4208ba80 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800a470 tx=0x7fc9f801ce90 comp rx=0 tx=0).stop 2024-05-08T18:51:43.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.918+0000 7fca11733800 1 -- 172.21.15.132:0/2278702908 shutdown_connections 2024-05-08T18:51:43.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.918+0000 7fca11733800 1 --2- 172.21.15.132:0/2278702908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f42089690 0x562f4208ba80 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.918+0000 7fca11733800 1 -- 172.21.15.132:0/2278702908 >> 172.21.15.132:0/2278702908 conn(0x562f42080820 msgr2=0x562f42082c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:43.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.918+0000 7fca11733800 1 -- 172.21.15.132:0/2278702908 shutdown_connections 2024-05-08T18:51:43.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.918+0000 7fca11733800 1 -- 172.21.15.132:0/2278702908 wait complete. 2024-05-08T18:51:43.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.932+0000 7fca11733800 1 Processor -- start 2024-05-08T18:51:43.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.932+0000 7fca11733800 1 -- start start 2024-05-08T18:51:43.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.932+0000 7fca11733800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f420852a0 0x562f42176610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.932+0000 7fca11733800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562f41fd05a0 con 0x562f420852a0 2024-05-08T18:51:43.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.932+0000 7fca0d3ee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f420852a0 0x562f42176610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.932+0000 7fca0d3ee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f420852a0 0x562f42176610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56152/0 (socket says 172.21.15.132:56152) 2024-05-08T18:51:43.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.932+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1019815319 learned_addr learned my addr 172.21.15.132:0/1019815319 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:43.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.933+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1019815319 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f42176be0 con 0x562f420852a0 2024-05-08T18:51:43.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.933+0000 7fca0d3ee640 1 --2- 172.21.15.132:0/1019815319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f420852a0 0x562f42176610 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fca00001e10 tx=0x7fca0000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9523ad6a5e1004cf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.933+0000 7fc8fb606640 1 -- 172.21.15.132:0/1019815319 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca00012020 con 0x562f420852a0 2024-05-08T18:51:43.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.933+0000 7fc8fb606640 1 -- 172.21.15.132:0/1019815319 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca0000e5a0 con 0x562f420852a0 2024-05-08T18:51:43.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.933+0000 7fc8fb606640 1 -- 172.21.15.132:0/1019815319 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca0000e8e0 con 0x562f420852a0 2024-05-08T18:51:43.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.934+0000 7fca11733800 1 -- 172.21.15.132:0/1019815319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f420852a0 msgr2=0x562f42176610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:43.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.934+0000 7fca11733800 1 --2- 172.21.15.132:0/1019815319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f420852a0 0x562f42176610 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fca00001e10 tx=0x7fca0000b780 comp rx=0 tx=0).stop 2024-05-08T18:51:43.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.934+0000 7fca11733800 1 -- 172.21.15.132:0/1019815319 shutdown_connections 2024-05-08T18:51:43.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.934+0000 7fca11733800 1 --2- 172.21.15.132:0/1019815319 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f420852a0 0x562f42176610 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.934+0000 7fca11733800 1 -- 172.21.15.132:0/1019815319 >> 172.21.15.132:0/1019815319 conn(0x562f42080820 msgr2=0x562f42171f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:43.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.934+0000 7fca11733800 1 -- 172.21.15.132:0/1019815319 shutdown_connections 2024-05-08T18:51:43.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.934+0000 7fca11733800 1 -- 172.21.15.132:0/1019815319 wait complete. 2024-05-08T18:51:43.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.934+0000 7fca11733800 1 Processor -- start 2024-05-08T18:51:43.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.934+0000 7fca11733800 1 -- start start 2024-05-08T18:51:43.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.934+0000 7fca11733800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f420852a0 0x562f4217e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.934+0000 7fca11733800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562f4208c520 con 0x562f420852a0 2024-05-08T18:51:43.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.935+0000 7fca0d3ee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f420852a0 0x562f4217e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.935+0000 7fca0d3ee640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f420852a0 0x562f4217e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56164/0 (socket says 172.21.15.132:56164) 2024-05-08T18:51:43.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.935+0000 7fca0d3ee640 1 -- 172.21.15.132:0/389156143 learned_addr learned my addr 172.21.15.132:0/389156143 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:43.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.935+0000 7fca0d3ee640 1 -- 172.21.15.132:0/389156143 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f4217e6c0 con 0x562f420852a0 2024-05-08T18:51:43.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.935+0000 7fca0d3ee640 1 --2- 172.21.15.132:0/389156143 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f420852a0 0x562f4217e180 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fca0000b7c0 tx=0x7fca00000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.935+0000 7fc8f9e03640 1 -- 172.21.15.132:0/389156143 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca00012030 con 0x562f420852a0 2024-05-08T18:51:43.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.935+0000 7fc8f9e03640 1 -- 172.21.15.132:0/389156143 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca00001470 con 0x562f420852a0 2024-05-08T18:51:43.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.935+0000 7fca11733800 1 -- 172.21.15.132:0/389156143 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f4217e950 con 0x562f420852a0 2024-05-08T18:51:43.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.935+0000 7fc8f9e03640 1 -- 172.21.15.132:0/389156143 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca0001a8d0 con 0x562f420852a0 2024-05-08T18:51:43.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.935+0000 7fca11733800 1 -- 172.21.15.132:0/389156143 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f42181600 con 0x562f420852a0 2024-05-08T18:51:43.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.936+0000 7fc8f9e03640 1 -- 172.21.15.132:0/389156143 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fca00015020 con 0x562f420852a0 2024-05-08T18:51:43.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.936+0000 7fc8f9e03640 1 --2- 172.21.15.132:0/389156143 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc8f403bb50 0x7fc8f403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.936+0000 7fc8f9e03640 1 -- 172.21.15.132:0/389156143 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fca00020030 con 0x562f420852a0 2024-05-08T18:51:43.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.937+0000 7fca07fff640 1 --2- 172.21.15.132:0/389156143 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc8f403bb50 0x7fc8f403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.937+0000 7fca11733800 1 --2- 172.21.15.132:0/389156143 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562f42089690 0x562f421853c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.937+0000 7fca11733800 1 -- 172.21.15.132:0/389156143 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42185950 con 0x562f42089690 2024-05-08T18:51:43.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.937+0000 7fca0dbef640 1 --2- 172.21.15.132:0/389156143 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562f42089690 0x562f421853c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.937+0000 7fca07fff640 1 --2- 172.21.15.132:0/389156143 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc8f403bb50 0x7fc8f403e010 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8054000 tx=0x7fc9f804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.937+0000 7fca0dbef640 1 --2- 172.21.15.132:0/389156143 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562f42089690 0x562f421853c0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.937+0000 7fca0dbef640 1 -- 172.21.15.132:0/389156143 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca0800a4a0 con 0x562f42089690 2024-05-08T18:51:43.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.937+0000 7fca11733800 1 -- 172.21.15.132:0/389156143 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42182990 con 0x562f42089690 2024-05-08T18:51:43.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.938+0000 7fca0dbef640 1 -- 172.21.15.132:0/389156143 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca0800a4a0 con 0x562f42089690 2024-05-08T18:51:43.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.938+0000 7fca11733800 1 --2- 172.21.15.132:0/389156143 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562f42187ca0 0x562f4218a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.938+0000 7fca11733800 1 -- 172.21.15.132:0/389156143 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f4218a730 con 0x562f42187ca0 2024-05-08T18:51:43.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.938+0000 7fca0d3ee640 1 --2- 172.21.15.132:0/389156143 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562f42187ca0 0x562f4218a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.938+0000 7fca0d3ee640 1 --2- 172.21.15.132:0/389156143 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562f42187ca0 0x562f4218a090 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.938+0000 7fca0d3ee640 1 -- 172.21.15.132:0/389156143 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fca00043130 con 0x562f42187ca0 2024-05-08T18:51:43.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.938+0000 7fca11733800 1 -- 172.21.15.132:0/389156143 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42186b40 con 0x562f42089690 2024-05-08T18:51:43.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.939+0000 7fca0dbef640 1 -- 172.21.15.132:0/389156143 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca0800a4a0 con 0x562f42089690 2024-05-08T18:51:43.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.939+0000 7fca11733800 1 -- 172.21.15.132:0/389156143 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42187020 con 0x562f42089690 2024-05-08T18:51:43.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.939+0000 7fca0dbef640 1 -- 172.21.15.132:0/389156143 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fca0800a4a0 con 0x562f42089690 2024-05-08T18:51:43.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.939+0000 7fca11733800 1 Processor -- start 2024-05-08T18:51:43.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.939+0000 7fca11733800 1 -- start start 2024-05-08T18:51:43.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.939+0000 7fca11733800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f421996b0 0x562f42199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.939+0000 7fca11733800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562f41f76fc0 con 0x562f421996b0 2024-05-08T18:51:43.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.940+0000 7fca0dbef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f421996b0 0x562f42199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.940+0000 7fca0dbef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f421996b0 0x562f42199ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56172/0 (socket says 172.21.15.132:56172) 2024-05-08T18:51:43.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.940+0000 7fca0dbef640 1 -- 172.21.15.132:0/2180218878 learned_addr learned my addr 172.21.15.132:0/2180218878 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:43.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.940+0000 7fca0dbef640 1 -- 172.21.15.132:0/2180218878 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f4219a010 con 0x562f421996b0 2024-05-08T18:51:43.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.940+0000 7fca0dbef640 1 --2- 172.21.15.132:0/2180218878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f421996b0 0x562f42199ad0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x562f4217f050 tx=0x7fca080188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.940+0000 7fc8f2ffd640 1 -- 172.21.15.132:0/2180218878 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca08014450 con 0x562f421996b0 2024-05-08T18:51:43.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.940+0000 7fc8f2ffd640 1 -- 172.21.15.132:0/2180218878 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca080145f0 con 0x562f421996b0 2024-05-08T18:51:43.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.940+0000 7fc8f2ffd640 1 -- 172.21.15.132:0/2180218878 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca080148d0 con 0x562f421996b0 2024-05-08T18:51:43.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.940+0000 7fca11733800 1 -- 172.21.15.132:0/2180218878 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f4219aa80 con 0x562f421996b0 2024-05-08T18:51:43.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.940+0000 7fca11733800 1 -- 172.21.15.132:0/2180218878 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f4219af80 con 0x562f421996b0 2024-05-08T18:51:43.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.941+0000 7fc8f2ffd640 1 -- 172.21.15.132:0/2180218878 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fca08011040 con 0x562f421996b0 2024-05-08T18:51:43.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.941+0000 7fc8f2ffd640 1 --2- 172.21.15.132:0/2180218878 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc8e403bb50 0x7fc8e403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.942+0000 7fc8f2ffd640 1 -- 172.21.15.132:0/2180218878 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fca0801e070 con 0x562f421996b0 2024-05-08T18:51:43.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.942+0000 7fca0d3ee640 1 --2- 172.21.15.132:0/2180218878 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc8e403bb50 0x7fc8e403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.942+0000 7fca11733800 1 Processor -- start 2024-05-08T18:51:43.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.942+0000 7fca0d3ee640 1 --2- 172.21.15.132:0/2180218878 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc8e403bb50 0x7fc8e403e010 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x562f42185dc0 tx=0x7fca000433e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.942+0000 7fca11733800 1 -- start start 2024-05-08T18:51:43.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.942+0000 7fca11733800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f421a6a40 0x562f421a6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.942+0000 7fca11733800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562f42176f60 con 0x562f421a6a40 2024-05-08T18:51:43.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.942+0000 7fca0dbef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f421a6a40 0x562f421a6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.942+0000 7fca0dbef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f421a6a40 0x562f421a6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56184/0 (socket says 172.21.15.132:56184) 2024-05-08T18:51:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.942+0000 7fca0dbef640 1 -- 172.21.15.132:0/3997748625 learned_addr learned my addr 172.21.15.132:0/3997748625 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.943+0000 7fca0dbef640 1 -- 172.21.15.132:0/3997748625 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f421a7430 con 0x562f421a6a40 2024-05-08T18:51:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.943+0000 7fca0dbef640 1 --2- 172.21.15.132:0/3997748625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f421a6a40 0x562f421a6e60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fca08005a80 tx=0x7fca080118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13144ddae7ea798 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.943+0000 7fc8f0ff9640 1 -- 172.21.15.132:0/3997748625 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca08044020 con 0x562f421a6a40 2024-05-08T18:51:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.943+0000 7fc8f0ff9640 1 -- 172.21.15.132:0/3997748625 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca08047070 con 0x562f421a6a40 2024-05-08T18:51:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.943+0000 7fc8f0ff9640 1 -- 172.21.15.132:0/3997748625 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca08011d50 con 0x562f421a6a40 2024-05-08T18:51:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.943+0000 7fca11733800 1 -- 172.21.15.132:0/3997748625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f421a6a40 msgr2=0x562f421a6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.943+0000 7fca11733800 1 --2- 172.21.15.132:0/3997748625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f421a6a40 0x562f421a6e60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fca08005a80 tx=0x7fca080118e0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.943+0000 7fca11733800 1 -- 172.21.15.132:0/3997748625 shutdown_connections 2024-05-08T18:51:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.943+0000 7fca11733800 1 --2- 172.21.15.132:0/3997748625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f421a6a40 0x562f421a6e60 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.943+0000 7fca11733800 1 -- 172.21.15.132:0/3997748625 >> 172.21.15.132:0/3997748625 conn(0x562f421a2d10 msgr2=0x562f421a0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.943+0000 7fca11733800 1 -- 172.21.15.132:0/3997748625 shutdown_connections 2024-05-08T18:51:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.943+0000 7fca11733800 1 -- 172.21.15.132:0/3997748625 wait complete. 2024-05-08T18:51:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.944+0000 7fca11733800 1 Processor -- start 2024-05-08T18:51:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.944+0000 7fca11733800 1 -- start start 2024-05-08T18:51:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.944+0000 7fca11733800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f421a6a40 0x562f41ffaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.944+0000 7fca11733800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562f421a7b80 con 0x562f421a6a40 2024-05-08T18:51:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.944+0000 7fca0dbef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f421a6a40 0x562f41ffaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.944+0000 7fca0dbef640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f421a6a40 0x562f41ffaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56198/0 (socket says 172.21.15.132:56198) 2024-05-08T18:51:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.944+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 learned_addr learned my addr 172.21.15.132:0/1247817071 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.944+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f41ffb0e0 con 0x562f421a6a40 2024-05-08T18:51:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.945+0000 7fca0dbef640 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f421a6a40 0x562f41ffaba0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fca08045030 tx=0x7fca08052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.945+0000 7fc8e2ffd640 1 -- 172.21.15.132:0/1247817071 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca08054590 con 0x562f421a6a40 2024-05-08T18:51:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.945+0000 7fc8e2ffd640 1 -- 172.21.15.132:0/1247817071 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca080407d0 con 0x562f421a6a40 2024-05-08T18:51:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.945+0000 7fc8e2ffd640 1 -- 172.21.15.132:0/1247817071 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca08040af0 con 0x562f421a6a40 2024-05-08T18:51:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.945+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f41ff9290 con 0x562f421a6a40 2024-05-08T18:51:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.945+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f41ff9790 con 0x562f421a6a40 2024-05-08T18:51:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.946+0000 7fc8e2ffd640 1 -- 172.21.15.132:0/1247817071 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fca08040c90 con 0x562f421a6a40 2024-05-08T18:51:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.946+0000 7fca11733800 20 rados->read ofs=0 len=0 2024-05-08T18:51:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.946+0000 7fc8e2ffd640 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc8d803bba0 0x7fc8d803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.946+0000 7fc8e2ffd640 1 -- 172.21.15.132:0/1247817071 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fca0800e040 con 0x562f421a6a40 2024-05-08T18:51:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.946+0000 7fca0d3ee640 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc8d803bba0 0x7fc8d803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.947+0000 7fca11733800 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562f421bbdd0 0x562f421be290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.947+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f421be9e0 con 0x562f421bbdd0 2024-05-08T18:51:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.947+0000 7fca07fff640 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562f421bbdd0 0x562f421be290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.947+0000 7fca0d3ee640 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc8d803bba0 0x7fc8d803e060 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fca00018e00 tx=0x7fca00047000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.947+0000 7fca07fff640 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562f421bbdd0 0x562f421be290 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.947+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9f805a040 con 0x562f421bbdd0 2024-05-08T18:51:43.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.947+0000 7fca11733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:43.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.947+0000 7fca11733800 20 realm 2024-05-08T18:51:43.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.947+0000 7fca11733800 20 rados->read ofs=0 len=0 2024-05-08T18:51:43.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.947+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f421bedb0 con 0x562f421bbdd0 2024-05-08T18:51:43.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.947+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9f805a040 con 0x562f421bbdd0 2024-05-08T18:51:43.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.947+0000 7fca11733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:43.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.947+0000 7fca11733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:43.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.947+0000 7fca11733800 20 rados->read ofs=0 len=0 2024-05-08T18:51:43.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.947+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f421bf650 con 0x562f421bbdd0 2024-05-08T18:51:43.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.948+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9f805a040 con 0x562f421bbdd0 2024-05-08T18:51:43.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.948+0000 7fca11733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:43.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.948+0000 7fca11733800 20 rados->read ofs=0 len=0 2024-05-08T18:51:43.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.948+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f421bf9f0 con 0x562f421bbdd0 2024-05-08T18:51:43.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.948+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9f805a040 con 0x562f421bbdd0 2024-05-08T18:51:43.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.948+0000 7fca11733800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:43.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.948+0000 7fca11733800 20 rados->read ofs=0 len=0 2024-05-08T18:51:43.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.948+0000 7fca11733800 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562f421c0750 0x562f421c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.948+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f421c3080 con 0x562f421c0750 2024-05-08T18:51:43.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.948+0000 7fca0dbef640 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562f421c0750 0x562f421c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.948+0000 7fca0dbef640 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562f421c0750 0x562f421c2b40 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.949+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fca0803c020 con 0x562f421c0750 2024-05-08T18:51:43.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.949+0000 7fca11733800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:43.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.949+0000 7fca11733800 20 searching for the correct realm 2024-05-08T18:51:43.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.949+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x562f421c0750 2024-05-08T18:51:43.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.949+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0803c020 con 0x562f421c0750 2024-05-08T18:51:43.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.949+0000 7fca0dbef640 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fca08014070 0x7fca080137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.949+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x7fca08014070 2024-05-08T18:51:43.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.949+0000 7fca0d3ee640 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fca08014070 0x7fca080137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.950+0000 7fca0d3ee640 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fca08014070 0x7fca080137a0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.950+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca00043130 con 0x7fca08014070 2024-05-08T18:51:43.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.950+0000 7fca0d3ee640 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fca00017050 0x7fca000167a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:43.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.950+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x7fca00017050 2024-05-08T18:51:43.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.950+0000 7fca07fff640 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fca00017050 0x7fca000167a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:43.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.950+0000 7fca07fff640 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fca00017050 0x7fca000167a0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:43.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.951+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f805a040 con 0x7fca00017050 2024-05-08T18:51:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.951+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x562f421bbdd0 2024-05-08T18:51:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.951+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f805a040 con 0x562f421bbdd0 2024-05-08T18:51:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.951+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x562f421bbdd0 2024-05-08T18:51:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.951+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f805a040 con 0x562f421bbdd0 2024-05-08T18:51:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.951+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x7fca00017050 2024-05-08T18:51:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.951+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f805a040 con 0x7fca00017050 2024-05-08T18:51:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.951+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x7fca00017050 2024-05-08T18:51:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.952+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f805a040 con 0x7fca00017050 2024-05-08T18:51:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.952+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x7fca08014070 2024-05-08T18:51:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.952+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca00043130 con 0x7fca08014070 2024-05-08T18:51:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.952+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x562f421c0750 2024-05-08T18:51:43.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.952+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0803c020 con 0x562f421c0750 2024-05-08T18:51:43.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.952+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x562f421bbdd0 2024-05-08T18:51:43.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.953+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f805a040 con 0x562f421bbdd0 2024-05-08T18:51:43.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.953+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x7fca00017050 2024-05-08T18:51:43.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.953+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f805a040 con 0x7fca00017050 2024-05-08T18:51:43.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.953+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x562f421bbdd0 2024-05-08T18:51:43.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.953+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc9f805a040 con 0x562f421bbdd0 2024-05-08T18:51:43.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.953+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x7fca08014070 2024-05-08T18:51:43.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.953+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fca00043130 con 0x7fca08014070 2024-05-08T18:51:43.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.953+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x562f421c0750 2024-05-08T18:51:43.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.954+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fca0803c020 con 0x562f421c0750 2024-05-08T18:51:43.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.954+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x562f421c0750 2024-05-08T18:51:43.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.954+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0803c020 con 0x562f421c0750 2024-05-08T18:51:43.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.954+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x7fca00017050 2024-05-08T18:51:43.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.954+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f805a040 con 0x7fca00017050 2024-05-08T18:51:43.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.954+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x562f421c0750 2024-05-08T18:51:43.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.954+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0803c020 con 0x562f421c0750 2024-05-08T18:51:43.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.954+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x562f421c0750 2024-05-08T18:51:43.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.955+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0803c020 con 0x562f421c0750 2024-05-08T18:51:43.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.955+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x562f421bbdd0 2024-05-08T18:51:43.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.955+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f805a040 con 0x562f421bbdd0 2024-05-08T18:51:43.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.955+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x562f421bbdd0 2024-05-08T18:51:43.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.955+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc9f805a040 con 0x562f421bbdd0 2024-05-08T18:51:43.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.955+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x7fca00017050 2024-05-08T18:51:43.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.955+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f807d040 con 0x7fca00017050 2024-05-08T18:51:43.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.955+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x562f421c0750 2024-05-08T18:51:43.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.956+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0806a040 con 0x562f421c0750 2024-05-08T18:51:43.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.956+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x7fca08014070 2024-05-08T18:51:43.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.956+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca00043130 con 0x7fca08014070 2024-05-08T18:51:43.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.956+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x562f421bbdd0 2024-05-08T18:51:43.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.956+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:43.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.956+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x7fca08014070 2024-05-08T18:51:43.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.956+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca00043130 con 0x7fca08014070 2024-05-08T18:51:43.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.956+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x562f421c0750 2024-05-08T18:51:43.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.957+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0806a040 con 0x562f421c0750 2024-05-08T18:51:43.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.957+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x7fca00017050 2024-05-08T18:51:43.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.957+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f807d040 con 0x7fca00017050 2024-05-08T18:51:43.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.957+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x7fca08014070 2024-05-08T18:51:43.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.957+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca00043130 con 0x7fca08014070 2024-05-08T18:51:43.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.957+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x562f421c0750 2024-05-08T18:51:43.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.957+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca0806a040 con 0x562f421c0750 2024-05-08T18:51:43.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.957+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x7fca00017050 2024-05-08T18:51:43.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.958+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f807d040 con 0x7fca00017050 2024-05-08T18:51:43.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.958+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x562f421bbdd0 2024-05-08T18:51:43.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.958+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:43.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.958+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x562f421c4a30 con 0x7fca08014070 2024-05-08T18:51:43.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.958+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca00043130 con 0x7fca08014070 2024-05-08T18:51:43.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.958+0000 7fca11733800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:43.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.958+0000 7fca11733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:43.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.958+0000 7fca11733800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:43.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.958+0000 7fca11733800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:43.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.958+0000 7fca11733800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:43.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.958+0000 7fca11733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:43.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.958+0000 7fca11733800 20 rados->read ofs=0 len=0 2024-05-08T18:51:43.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.959+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f421c3b30 con 0x562f421bbdd0 2024-05-08T18:51:43.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.959+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:43.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.959+0000 7fca11733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:43.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.959+0000 7fca11733800 20 rados->read ofs=0 len=0 2024-05-08T18:51:43.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.959+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f421c43d0 con 0x562f421bbdd0 2024-05-08T18:51:43.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.959+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:43.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.959+0000 7fca11733800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:43.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.959+0000 7fca11733800 20 rados->read ofs=0 len=0 2024-05-08T18:51:43.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.959+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f421c3770 con 0x562f421bbdd0 2024-05-08T18:51:43.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.959+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:43.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.959+0000 7fca11733800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:43.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.959+0000 7fca11733800 20 zone default found 2024-05-08T18:51:43.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.959+0000 7fca11733800 4 Realm: () 2024-05-08T18:51:43.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.959+0000 7fca11733800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:43.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.959+0000 7fca11733800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:43.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.959+0000 7fca11733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:43.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.959+0000 7fca11733800 20 zonegroup default 2024-05-08T18:51:43.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.959+0000 7fca11733800 20 rados->read ofs=0 len=0 2024-05-08T18:51:43.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.959+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f421c53b0 con 0x7fca08014070 2024-05-08T18:51:43.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.960+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fca00043130 con 0x7fca08014070 2024-05-08T18:51:43.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.960+0000 7fca11733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:43.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.960+0000 7fca11733800 20 rados->read ofs=0 len=0 2024-05-08T18:51:43.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.960+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f421c71c0 con 0x562f421c0750 2024-05-08T18:51:43.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.960+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca0806a040 con 0x562f421c0750 2024-05-08T18:51:43.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.960+0000 7fca11733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:43.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.960+0000 7fca11733800 20 rados->read ofs=0 len=0 2024-05-08T18:51:43.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.960+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f421c7690 con 0x562f421c0750 2024-05-08T18:51:43.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.960+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca0806a040 con 0x562f421c0750 2024-05-08T18:51:43.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.960+0000 7fca11733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:43.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.960+0000 7fca11733800 20 started sync module instance, tier type = 2024-05-08T18:51:43.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.960+0000 7fca11733800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:43.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.960+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421c65d0 con 0x7fca08014070 2024-05-08T18:51:43.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.961+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca00043130 con 0x7fca08014070 2024-05-08T18:51:43.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.961+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94760972609984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421c7fa0 con 0x7fca08014070 2024-05-08T18:51:43.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.961+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421c87f0 con 0x562f421bbdd0 2024-05-08T18:51:43.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.962+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94760972609984] v27'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca00043130 con 0x7fca08014070 2024-05-08T18:51:43.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.962+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:43.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.962+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94760972614384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421c88b0 con 0x562f421bbdd0 2024-05-08T18:51:43.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.963+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421c93d0 con 0x562f421c0750 2024-05-08T18:51:43.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.964+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94760972614384] v27'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:43.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.964+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0806a040 con 0x562f421c0750 2024-05-08T18:51:43.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.964+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94760972619424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421c9390 con 0x562f421c0750 2024-05-08T18:51:43.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.964+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421c9e40 con 0x7fca08014070 2024-05-08T18:51:43.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.965+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca00043130 con 0x7fca08014070 2024-05-08T18:51:43.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.965+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94760972622224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421ca710 con 0x7fca08014070 2024-05-08T18:51:43.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.965+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421cb210 con 0x562f421bbdd0 2024-05-08T18:51:43.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.965+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94760972619424] v27'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0806a040 con 0x562f421c0750 2024-05-08T18:51:43.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.966+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94760972622224] v27'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca00043130 con 0x7fca08014070 2024-05-08T18:51:43.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.966+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:43.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.966+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94760972624480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421c8340 con 0x562f421bbdd0 2024-05-08T18:51:43.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.966+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421cbc20 con 0x7fca00017050 2024-05-08T18:51:43.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.967+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94760972624480] v27'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:43.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.967+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x7fca00017050 2024-05-08T18:51:43.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.967+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94760972627200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421cbc20 con 0x7fca00017050 2024-05-08T18:51:43.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.967+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421cc4b0 con 0x7fca00017050 2024-05-08T18:51:43.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.968+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94760972627200] v27'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x7fca00017050 2024-05-08T18:51:43.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.968+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x7fca00017050 2024-05-08T18:51:43.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.968+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94760972629872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421cc690 con 0x7fca00017050 2024-05-08T18:51:43.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.968+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421ccee0 con 0x7fca00017050 2024-05-08T18:51:43.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.969+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(58 notify.7 [create] v27'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x7fca00017050 2024-05-08T18:51:43.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.969+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94760972634224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421cd280 con 0x7fca00017050 2024-05-08T18:51:43.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.969+0000 7fca11733800 20 add_watcher() i=0 2024-05-08T18:51:43.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.969+0000 7fca11733800 20 add_watcher() i=1 2024-05-08T18:51:43.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.969+0000 7fca11733800 20 add_watcher() i=2 2024-05-08T18:51:43.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.969+0000 7fca11733800 20 add_watcher() i=3 2024-05-08T18:51:43.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.969+0000 7fca11733800 20 add_watcher() i=4 2024-05-08T18:51:43.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.969+0000 7fca11733800 20 add_watcher() i=5 2024-05-08T18:51:43.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.969+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94760972629872] v27'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x7fca00017050 2024-05-08T18:51:43.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.969+0000 7fca11733800 20 add_watcher() i=6 2024-05-08T18:51:43.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.970+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94760972634224] v27'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x7fca00017050 2024-05-08T18:51:43.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.970+0000 7fca11733800 20 add_watcher() i=7 2024-05-08T18:51:43.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.970+0000 7fca11733800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:43.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.970+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f421cbc50 con 0x562f421bbdd0 2024-05-08T18:51:43.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.971+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:43.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.971+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94760972635408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421cbc10 con 0x562f421bbdd0 2024-05-08T18:51:43.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.972+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94760972635408] v27'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:43.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.972+0000 7fc8c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:43.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.972+0000 7fca11733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:43.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.972+0000 7fca11733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:43.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.972+0000 7fca11733800 5 note: GC not initialized 2024-05-08T18:51:43.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.972+0000 7fc8c27e4640 20 reqs_thread_entry: start 2024-05-08T18:51:43.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.972+0000 7fca11733800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:43.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.972+0000 7fca11733800 20 Filter name: none 2024-05-08T18:51:43.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.972+0000 7fc833fff640 20 reqs_thread_entry: start 2024-05-08T18:51:43.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.973+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42203d50 con 0x562f421bbdd0 2024-05-08T18:51:43.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.973+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:43.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.973+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42203d50 con 0x7fca08014070 2024-05-08T18:51:43.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.973+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fca00043130 con 0x7fca08014070 2024-05-08T18:51:43.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.973+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42203d70 con 0x562f421bbdd0 2024-05-08T18:51:43.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.973+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:43.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.973+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42203d30 con 0x562f421c0750 2024-05-08T18:51:43.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.973+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fca0806a040 con 0x562f421c0750 2024-05-08T18:51:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.973+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42203d30 con 0x562f421c0750 2024-05-08T18:51:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.974+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fca0806a040 con 0x562f421c0750 2024-05-08T18:51:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.974+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42203d30 con 0x562f421c0750 2024-05-08T18:51:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.974+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fca0806a040 con 0x562f421c0750 2024-05-08T18:51:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.974+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42203d30 con 0x562f421bbdd0 2024-05-08T18:51:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.974+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.974+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42203d30 con 0x562f421bbdd0 2024-05-08T18:51:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.974+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.974+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42203d30 con 0x562f421c0750 2024-05-08T18:51:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.974+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fca0806a040 con 0x562f421c0750 2024-05-08T18:51:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.974+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42203d30 con 0x562f421c0750 2024-05-08T18:51:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.975+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fca0806a040 con 0x562f421c0750 2024-05-08T18:51:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.975+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42203d30 con 0x7fca00017050 2024-05-08T18:51:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.975+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fc9f807d040 con 0x7fca00017050 2024-05-08T18:51:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.976+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42205890 con 0x562f421bbdd0 2024-05-08T18:51:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.976+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.976+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42205890 con 0x7fca08014070 2024-05-08T18:51:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.976+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fca00043130 con 0x7fca08014070 2024-05-08T18:51:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.976+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42205890 con 0x562f421c0750 2024-05-08T18:51:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.976+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fca0806a040 con 0x562f421c0750 2024-05-08T18:51:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.976+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42205890 con 0x7fca00017050 2024-05-08T18:51:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.976+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x7fca00017050 2024-05-08T18:51:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.976+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42205890 con 0x7fca00017050 2024-05-08T18:51:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.977+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x7fca00017050 2024-05-08T18:51:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.977+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42205890 con 0x562f421c0750 2024-05-08T18:51:43.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.977+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fca0806a040 con 0x562f421c0750 2024-05-08T18:51:43.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.977+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42205840 con 0x7fca00017050 2024-05-08T18:51:43.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.977+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7fc9f807d040 con 0x7fca00017050 2024-05-08T18:51:43.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.977+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42205840 con 0x562f421bbdd0 2024-05-08T18:51:43.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.978+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:43.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.978+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42205840 con 0x562f421c0750 2024-05-08T18:51:43.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.978+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fca0806a040 con 0x562f421c0750 2024-05-08T18:51:43.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.978+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42205840 con 0x7fca00017050 2024-05-08T18:51:43.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.978+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x7fca00017050 2024-05-08T18:51:43.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.978+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42205840 con 0x7fca08014070 2024-05-08T18:51:43.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.979+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fca00043130 con 0x7fca08014070 2024-05-08T18:51:43.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.979+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42205840 con 0x7fca00017050 2024-05-08T18:51:43.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.979+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x7fca00017050 2024-05-08T18:51:43.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.979+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42205840 con 0x562f421bbdd0 2024-05-08T18:51:43.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.979+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:43.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.979+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42205840 con 0x562f421bbdd0 2024-05-08T18:51:43.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.979+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:43.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.979+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42205840 con 0x562f421c0750 2024-05-08T18:51:43.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.979+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fca0806a040 con 0x562f421c0750 2024-05-08T18:51:43.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.980+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42205840 con 0x562f421bbdd0 2024-05-08T18:51:43.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.980+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:43.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.980+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42205840 con 0x562f421bbdd0 2024-05-08T18:51:43.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.980+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:43.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.980+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42205840 con 0x562f421c0750 2024-05-08T18:51:43.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.980+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fca0806a040 con 0x562f421c0750 2024-05-08T18:51:43.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.980+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42205840 con 0x562f421c0750 2024-05-08T18:51:43.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.980+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fca0806a040 con 0x562f421c0750 2024-05-08T18:51:43.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.980+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42205840 con 0x562f421c0750 2024-05-08T18:51:43.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.980+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fca0806a040 con 0x562f421c0750 2024-05-08T18:51:43.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.980+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562f42205840 con 0x7fca00017050 2024-05-08T18:51:43.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.981+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x7fca00017050 2024-05-08T18:51:43.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.982+0000 7fc8c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:43.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.982+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94760972635408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421cd760 con 0x562f421bbdd0 2024-05-08T18:51:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.983+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94760972635408] v27'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.983+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94760972609984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421cccd0 con 0x7fca08014070 2024-05-08T18:51:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.984+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94760972609984] v27'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca00043130 con 0x7fca08014070 2024-05-08T18:51:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.984+0000 7fca11733800 20 remove_watcher() i=0 2024-05-08T18:51:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.984+0000 7fca11733800 2 removed watcher, disabling cache 2024-05-08T18:51:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.984+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94760972614384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421c69c0 con 0x562f421bbdd0 2024-05-08T18:51:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.985+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94760972614384] v27'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.985+0000 7fca11733800 20 remove_watcher() i=1 2024-05-08T18:51:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.985+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94760972619424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421c69c0 con 0x562f421c0750 2024-05-08T18:51:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.986+0000 7fca0dbef640 1 -- 172.21.15.132:0/1247817071 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94760972619424] v27'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca0806a040 con 0x562f421c0750 2024-05-08T18:51:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.986+0000 7fca11733800 20 remove_watcher() i=2 2024-05-08T18:51:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.986+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94760972622224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421c69c0 con 0x7fca08014070 2024-05-08T18:51:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.987+0000 7fca0d3ee640 1 -- 172.21.15.132:0/1247817071 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94760972622224] v27'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca00043130 con 0x7fca08014070 2024-05-08T18:51:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.987+0000 7fca11733800 20 remove_watcher() i=3 2024-05-08T18:51:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.987+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94760972624480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421c69c0 con 0x562f421bbdd0 2024-05-08T18:51:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.988+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.1 v2:172.21.15.132:6800/3697320277 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94760972624480] v27'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x562f421bbdd0 2024-05-08T18:51:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.988+0000 7fca11733800 20 remove_watcher() i=4 2024-05-08T18:51:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.988+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94760972627200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421c69c0 con 0x7fca00017050 2024-05-08T18:51:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.989+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94760972627200] v27'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x7fca00017050 2024-05-08T18:51:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.989+0000 7fca11733800 20 remove_watcher() i=5 2024-05-08T18:51:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.989+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94760972629872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421c69c0 con 0x7fca00017050 2024-05-08T18:51:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.990+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94760972629872] v27'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x7fca00017050 2024-05-08T18:51:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.990+0000 7fca11733800 20 remove_watcher() i=6 2024-05-08T18:51:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.990+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94760972634224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562f421c69c0 con 0x7fca00017050 2024-05-08T18:51:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.991+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94760972634224] v27'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f807d040 con 0x7fca00017050 2024-05-08T18:51:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.991+0000 7fca11733800 20 remove_watcher() i=7 2024-05-08T18:51:44.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.991+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fca00017050 msgr2=0x7fca000167a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.991+0000 7fca11733800 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fca00017050 0x7fca000167a0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.991+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562f421bbdd0 msgr2=0x562f421be290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.991+0000 7fca11733800 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562f421bbdd0 0x562f421be290 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.991+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fca08014070 msgr2=0x7fca080137a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.991+0000 7fca11733800 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fca08014070 0x7fca080137a0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.991+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562f421c0750 msgr2=0x562f421c2b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.991+0000 7fca11733800 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562f421c0750 0x562f421c2b40 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.991+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc8d803bba0 msgr2=0x7fc8d803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.991+0000 7fca11733800 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc8d803bba0 0x7fc8d803e060 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fca00018e00 tx=0x7fca00047000 comp rx=0 tx=0).stop 2024-05-08T18:51:44.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.991+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f421a6a40 msgr2=0x562f41ffaba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.991+0000 7fca07fff640 1 -- 172.21.15.132:0/1247817071 reap_dead start 2024-05-08T18:51:44.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.991+0000 7fca11733800 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f421a6a40 0x562f41ffaba0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fca08045030 tx=0x7fca08052be0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.991+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 shutdown_connections 2024-05-08T18:51:44.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.991+0000 7fca11733800 1 --2- 172.21.15.132:0/1247817071 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f421a6a40 0x562f41ffaba0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.991+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 >> 172.21.15.132:0/1247817071 conn(0x562f421a2d10 msgr2=0x562f421a0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.991+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 shutdown_connections 2024-05-08T18:51:44.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 -- 172.21.15.132:0/1247817071 wait complete. 2024-05-08T18:51:44.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 -- 172.21.15.132:0/2180218878 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc8e403bb50 msgr2=0x7fc8e403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 --2- 172.21.15.132:0/2180218878 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc8e403bb50 0x7fc8e403e010 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x562f42185dc0 tx=0x7fca000433e0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 -- 172.21.15.132:0/2180218878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f421996b0 msgr2=0x562f42199ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 --2- 172.21.15.132:0/2180218878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f421996b0 0x562f42199ad0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x562f4217f050 tx=0x7fca080188f0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 -- 172.21.15.132:0/2180218878 shutdown_connections 2024-05-08T18:51:44.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 --2- 172.21.15.132:0/2180218878 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc8e403bb50 0x7fc8e403e010 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 --2- 172.21.15.132:0/2180218878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f421996b0 0x562f42199ad0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 -- 172.21.15.132:0/2180218878 >> 172.21.15.132:0/2180218878 conn(0x562f4218d750 msgr2=0x562f4218db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 -- 172.21.15.132:0/2180218878 shutdown_connections 2024-05-08T18:51:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 -- 172.21.15.132:0/2180218878 wait complete. 2024-05-08T18:51:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 -- 172.21.15.132:0/389156143 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562f42089690 msgr2=0x562f421853c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 --2- 172.21.15.132:0/389156143 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562f42089690 0x562f421853c0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 -- 172.21.15.132:0/389156143 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562f42187ca0 msgr2=0x562f4218a090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 --2- 172.21.15.132:0/389156143 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562f42187ca0 0x562f4218a090 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 -- 172.21.15.132:0/389156143 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc8f403bb50 msgr2=0x7fc8f403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 --2- 172.21.15.132:0/389156143 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc8f403bb50 0x7fc8f403e010 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8054000 tx=0x7fc9f804e000 comp rx=0 tx=0).stop 2024-05-08T18:51:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 -- 172.21.15.132:0/389156143 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f420852a0 msgr2=0x562f4217e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 --2- 172.21.15.132:0/389156143 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f420852a0 0x562f4217e180 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fca0000b7c0 tx=0x7fca00000ed0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 -- 172.21.15.132:0/389156143 shutdown_connections 2024-05-08T18:51:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 --2- 172.21.15.132:0/389156143 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562f42187ca0 0x562f4218a090 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 --2- 172.21.15.132:0/389156143 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562f42089690 0x562f421853c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 --2- 172.21.15.132:0/389156143 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc8f403bb50 0x7fc8f403e010 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 --2- 172.21.15.132:0/389156143 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562f420852a0 0x562f4217e180 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 -- 172.21.15.132:0/389156143 >> 172.21.15.132:0/389156143 conn(0x562f42080820 msgr2=0x562f42170730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 -- 172.21.15.132:0/389156143 shutdown_connections 2024-05-08T18:51:44.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:43.992+0000 7fca11733800 1 -- 172.21.15.132:0/389156143 wait complete. 2024-05-08T18:51:44.009 INFO:teuthology.orchestra.run.smithi132.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-08T18:51:44.010 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:51:44.010 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-05-08T18:51:44.010 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-05-08T18:51:44.011 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-05-08T18:51:44.094 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:44.094 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:44.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.095+0000 7fa47ef19800 1 Processor -- start 2024-05-08T18:51:44.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.096+0000 7fa47ef19800 1 -- start start 2024-05-08T18:51:44.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.096+0000 7fa47ef19800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5590eb6e2490 0x5590eb771e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.096+0000 7fa47ef19800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5590eb7760c0 con 0x5590eb772370 2024-05-08T18:51:44.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.096+0000 7fa47ef19800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x5590eb60fe20 con 0x5590eb6e2490 2024-05-08T18:51:44.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.096+0000 7fa47ca11640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5590eb6e2490 0x5590eb771e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.096+0000 7fa47ca11640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5590eb6e2490 0x5590eb771e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56208/0 (socket says 172.21.15.132:56208) 2024-05-08T18:51:44.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.096+0000 7fa477fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x5590eb772370 0x5590eb774830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:49026/0 (socket says 172.21.15.132:49026) 2024-05-08T18:51:44.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.096+0000 7fa47ca11640 1 -- 172.21.15.132:0/2894449226 learned_addr learned my addr 172.21.15.132:0/2894449226 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.096+0000 7fa47ca11640 1 -- 172.21.15.132:0/2894449226 >> v1:172.21.15.42:6789/0 conn(0x5590eb772370 legacy=0x5590eb774830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.096+0000 7fa47ca11640 1 -- 172.21.15.132:0/2894449226 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590eb7772f0 con 0x5590eb6e2490 2024-05-08T18:51:44.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.098+0000 7fa47ca11640 1 --2- 172.21.15.132:0/2894449226 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb6e2490 0x5590eb771e00 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa47000a520 tx=0x7fa47001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1383d6261ae9d7b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.099+0000 7fa4777fe640 1 -- 172.21.15.132:0/2894449226 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa470057070 con 0x5590eb6e2490 2024-05-08T18:51:44.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.099+0000 7fa4777fe640 1 -- 172.21.15.132:0/2894449226 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa470052570 con 0x5590eb6e2490 2024-05-08T18:51:44.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.099+0000 7fa4777fe640 1 -- 172.21.15.132:0/2894449226 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa47004ae60 con 0x5590eb6e2490 2024-05-08T18:51:44.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.099+0000 7fa47ef19800 1 -- 172.21.15.132:0/2894449226 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb6e2490 msgr2=0x5590eb771e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.099+0000 7fa47ef19800 1 --2- 172.21.15.132:0/2894449226 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb6e2490 0x5590eb771e00 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa47000a520 tx=0x7fa47001d010 comp rx=0 tx=0).stop 2024-05-08T18:51:44.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.099+0000 7fa47ef19800 1 -- 172.21.15.132:0/2894449226 shutdown_connections 2024-05-08T18:51:44.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.099+0000 7fa47ef19800 1 --2- 172.21.15.132:0/2894449226 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb6e2490 0x5590eb771e00 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.099+0000 7fa47ef19800 1 -- 172.21.15.132:0/2894449226 >> 172.21.15.132:0/2894449226 conn(0x5590eb769720 msgr2=0x5590eb76bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.099+0000 7fa47ef19800 1 -- 172.21.15.132:0/2894449226 shutdown_connections 2024-05-08T18:51:44.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.099+0000 7fa47ef19800 1 -- 172.21.15.132:0/2894449226 wait complete. 2024-05-08T18:51:44.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.113+0000 7fa47ef19800 1 Processor -- start 2024-05-08T18:51:44.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.113+0000 7fa47ef19800 1 -- start start 2024-05-08T18:51:44.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.113+0000 7fa47ef19800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb6e2490 0x5590eb860630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.113+0000 7fa47ef19800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5590eb6ba5b0 con 0x5590eb6e2490 2024-05-08T18:51:44.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.113+0000 7fa47ca11640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb6e2490 0x5590eb860630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.113+0000 7fa47ca11640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb6e2490 0x5590eb860630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56224/0 (socket says 172.21.15.132:56224) 2024-05-08T18:51:44.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.113+0000 7fa47ca11640 1 -- 172.21.15.132:0/2858003946 learned_addr learned my addr 172.21.15.132:0/2858003946 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.114+0000 7fa47ca11640 1 -- 172.21.15.132:0/2858003946 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590eb860c00 con 0x5590eb6e2490 2024-05-08T18:51:44.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.114+0000 7fa47ca11640 1 --2- 172.21.15.132:0/2858003946 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb6e2490 0x5590eb860630 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa470055040 tx=0x7fa47004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf778e1186461f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.114+0000 7fa36ae05640 1 -- 172.21.15.132:0/2858003946 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa470057040 con 0x5590eb6e2490 2024-05-08T18:51:44.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.114+0000 7fa36ae05640 1 -- 172.21.15.132:0/2858003946 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa470052720 con 0x5590eb6e2490 2024-05-08T18:51:44.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.114+0000 7fa36ae05640 1 -- 172.21.15.132:0/2858003946 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa470052a20 con 0x5590eb6e2490 2024-05-08T18:51:44.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.115+0000 7fa47ef19800 1 -- 172.21.15.132:0/2858003946 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb6e2490 msgr2=0x5590eb860630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.115+0000 7fa47ef19800 1 --2- 172.21.15.132:0/2858003946 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb6e2490 0x5590eb860630 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa470055040 tx=0x7fa47004c000 comp rx=0 tx=0).stop 2024-05-08T18:51:44.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.115+0000 7fa47ef19800 1 -- 172.21.15.132:0/2858003946 shutdown_connections 2024-05-08T18:51:44.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.115+0000 7fa47ef19800 1 --2- 172.21.15.132:0/2858003946 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb6e2490 0x5590eb860630 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.115+0000 7fa47ef19800 1 -- 172.21.15.132:0/2858003946 >> 172.21.15.132:0/2858003946 conn(0x5590eb769720 msgr2=0x5590eb85bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.115+0000 7fa47ef19800 1 -- 172.21.15.132:0/2858003946 shutdown_connections 2024-05-08T18:51:44.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.115+0000 7fa47ef19800 1 -- 172.21.15.132:0/2858003946 wait complete. 2024-05-08T18:51:44.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.115+0000 7fa47ef19800 1 Processor -- start 2024-05-08T18:51:44.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.115+0000 7fa47ef19800 1 -- start start 2024-05-08T18:51:44.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.115+0000 7fa47ef19800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb6e2490 0x5590eb76f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.115+0000 7fa47ef19800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5590eb776530 con 0x5590eb6e2490 2024-05-08T18:51:44.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.116+0000 7fa47ca11640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb6e2490 0x5590eb76f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.116+0000 7fa47ca11640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb6e2490 0x5590eb76f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56240/0 (socket says 172.21.15.132:56240) 2024-05-08T18:51:44.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.116+0000 7fa47ca11640 1 -- 172.21.15.132:0/2400728914 learned_addr learned my addr 172.21.15.132:0/2400728914 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.116+0000 7fa47ca11640 1 -- 172.21.15.132:0/2400728914 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590eb76de20 con 0x5590eb6e2490 2024-05-08T18:51:44.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.116+0000 7fa47ca11640 1 --2- 172.21.15.132:0/2400728914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb6e2490 0x5590eb76f730 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa470052540 tx=0x7fa470003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.116+0000 7fa369602640 1 -- 172.21.15.132:0/2400728914 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa470073070 con 0x5590eb6e2490 2024-05-08T18:51:44.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.116+0000 7fa369602640 1 -- 172.21.15.132:0/2400728914 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa47005d440 con 0x5590eb6e2490 2024-05-08T18:51:44.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.116+0000 7fa47ef19800 1 -- 172.21.15.132:0/2400728914 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590eb76e0b0 con 0x5590eb6e2490 2024-05-08T18:51:44.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.116+0000 7fa369602640 1 -- 172.21.15.132:0/2400728914 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa470057070 con 0x5590eb6e2490 2024-05-08T18:51:44.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.116+0000 7fa47ef19800 1 -- 172.21.15.132:0/2400728914 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590eb76e5d0 con 0x5590eb6e2490 2024-05-08T18:51:44.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.117+0000 7fa369602640 1 -- 172.21.15.132:0/2400728914 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa470076070 con 0x5590eb6e2490 2024-05-08T18:51:44.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.117+0000 7fa369602640 1 --2- 172.21.15.132:0/2400728914 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa36403bb50 0x7fa36403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.117+0000 7fa369602640 1 -- 172.21.15.132:0/2400728914 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fa470093f40 con 0x5590eb6e2490 2024-05-08T18:51:44.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.117+0000 7fa477fff640 1 --2- 172.21.15.132:0/2400728914 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa36403bb50 0x7fa36403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.118+0000 7fa47ef19800 1 --2- 172.21.15.132:0/2400728914 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5590eb772370 0x5590eb8714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.118+0000 7fa47ef19800 1 -- 172.21.15.132:0/2400728914 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5590eb871a50 con 0x5590eb772370 2024-05-08T18:51:44.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.118+0000 7fa47d212640 1 --2- 172.21.15.132:0/2400728914 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5590eb772370 0x5590eb8714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.118+0000 7fa477fff640 1 --2- 172.21.15.132:0/2400728914 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa36403bb50 0x7fa36403e010 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa468000f60 tx=0x7fa468001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.118+0000 7fa47d212640 1 --2- 172.21.15.132:0/2400728914 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5590eb772370 0x5590eb8714d0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.118+0000 7fa47d212640 1 -- 172.21.15.132:0/2400728914 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa47800a4a0 con 0x5590eb772370 2024-05-08T18:51:44.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.118+0000 7fa47ef19800 1 -- 172.21.15.132:0/2400728914 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5590eb872310 con 0x5590eb772370 2024-05-08T18:51:44.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.119+0000 7fa47d212640 1 -- 172.21.15.132:0/2400728914 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa47800a4a0 con 0x5590eb772370 2024-05-08T18:51:44.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.119+0000 7fa47ef19800 1 --2- 172.21.15.132:0/2400728914 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5590eb873d90 0x5590eb876250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.119+0000 7fa47ef19800 1 -- 172.21.15.132:0/2400728914 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8769e0 con 0x5590eb873d90 2024-05-08T18:51:44.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.119+0000 7fa47ca11640 1 --2- 172.21.15.132:0/2400728914 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5590eb873d90 0x5590eb876250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.119+0000 7fa47ca11640 1 --2- 172.21.15.132:0/2400728914 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5590eb873d90 0x5590eb876250 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.119+0000 7fa47ca11640 1 -- 172.21.15.132:0/2400728914 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa470075030 con 0x5590eb873d90 2024-05-08T18:51:44.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.119+0000 7fa47ef19800 1 -- 172.21.15.132:0/2400728914 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5590eb872b60 con 0x5590eb772370 2024-05-08T18:51:44.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.119+0000 7fa47d212640 1 -- 172.21.15.132:0/2400728914 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa47800a4a0 con 0x5590eb772370 2024-05-08T18:51:44.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.119+0000 7fa47ef19800 1 -- 172.21.15.132:0/2400728914 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5590eb872f40 con 0x5590eb772370 2024-05-08T18:51:44.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.120+0000 7fa47d212640 1 -- 172.21.15.132:0/2400728914 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa47800a4a0 con 0x5590eb772370 2024-05-08T18:51:44.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.120+0000 7fa47ef19800 1 Processor -- start 2024-05-08T18:51:44.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.120+0000 7fa47ef19800 1 -- start start 2024-05-08T18:51:44.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.120+0000 7fa47ef19800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb885920 0x5590eb885d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.120+0000 7fa47ef19800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5590eb76fc70 con 0x5590eb885920 2024-05-08T18:51:44.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.121+0000 7fa47d212640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb885920 0x5590eb885d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.121+0000 7fa47d212640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb885920 0x5590eb885d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56242/0 (socket says 172.21.15.132:56242) 2024-05-08T18:51:44.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.121+0000 7fa47d212640 1 -- 172.21.15.132:0/545984128 learned_addr learned my addr 172.21.15.132:0/545984128 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.121+0000 7fa47d212640 1 -- 172.21.15.132:0/545984128 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590eb886280 con 0x5590eb885920 2024-05-08T18:51:44.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.121+0000 7fa47d212640 1 --2- 172.21.15.132:0/545984128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb885920 0x5590eb885d40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x5590eb871e30 tx=0x7fa478018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.121+0000 7fa3627fc640 1 -- 172.21.15.132:0/545984128 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa478014450 con 0x5590eb885920 2024-05-08T18:51:44.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.121+0000 7fa3627fc640 1 -- 172.21.15.132:0/545984128 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa478014610 con 0x5590eb885920 2024-05-08T18:51:44.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.122+0000 7fa47ef19800 1 -- 172.21.15.132:0/545984128 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590eb886cf0 con 0x5590eb885920 2024-05-08T18:51:44.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.122+0000 7fa3627fc640 1 -- 172.21.15.132:0/545984128 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa478014930 con 0x5590eb885920 2024-05-08T18:51:44.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.122+0000 7fa47ef19800 1 -- 172.21.15.132:0/545984128 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590eb8871f0 con 0x5590eb885920 2024-05-08T18:51:44.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.122+0000 7fa3627fc640 1 -- 172.21.15.132:0/545984128 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa478011040 con 0x5590eb885920 2024-05-08T18:51:44.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.123+0000 7fa3627fc640 1 --2- 172.21.15.132:0/545984128 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa35403bba0 0x7fa35403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.123+0000 7fa3627fc640 1 -- 172.21.15.132:0/545984128 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fa47801e070 con 0x5590eb885920 2024-05-08T18:51:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.123+0000 7fa47ca11640 1 --2- 172.21.15.132:0/545984128 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa35403bba0 0x7fa35403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.123+0000 7fa47ef19800 1 Processor -- start 2024-05-08T18:51:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.123+0000 7fa47ca11640 1 --2- 172.21.15.132:0/545984128 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa35403bba0 0x7fa35403e060 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x5590eb76ebe0 tx=0x7fa470052f40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.123+0000 7fa47ef19800 1 -- start start 2024-05-08T18:51:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.123+0000 7fa47ef19800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb892c10 0x5590eb893030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.123+0000 7fa47ef19800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5590eb660fc0 con 0x5590eb892c10 2024-05-08T18:51:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.124+0000 7fa47d212640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb892c10 0x5590eb893030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.124+0000 7fa47d212640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb892c10 0x5590eb893030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56258/0 (socket says 172.21.15.132:56258) 2024-05-08T18:51:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.124+0000 7fa47d212640 1 -- 172.21.15.132:0/419208014 learned_addr learned my addr 172.21.15.132:0/419208014 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.124+0000 7fa47d212640 1 -- 172.21.15.132:0/419208014 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590eb893600 con 0x5590eb892c10 2024-05-08T18:51:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.124+0000 7fa47d212640 1 --2- 172.21.15.132:0/419208014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb892c10 0x5590eb893030 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa478052c50 tx=0x7fa4780118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26351fe43aad8e65 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.124+0000 7fa353fff640 1 -- 172.21.15.132:0/419208014 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa478001310 con 0x5590eb892c10 2024-05-08T18:51:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.124+0000 7fa353fff640 1 -- 172.21.15.132:0/419208014 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa478047070 con 0x5590eb892c10 2024-05-08T18:51:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.124+0000 7fa353fff640 1 -- 172.21.15.132:0/419208014 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4780168f0 con 0x5590eb892c10 2024-05-08T18:51:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.125+0000 7fa47ef19800 1 -- 172.21.15.132:0/419208014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb892c10 msgr2=0x5590eb893030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.125+0000 7fa47ef19800 1 --2- 172.21.15.132:0/419208014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb892c10 0x5590eb893030 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa478052c50 tx=0x7fa4780118e0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.125+0000 7fa47ef19800 1 -- 172.21.15.132:0/419208014 shutdown_connections 2024-05-08T18:51:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.125+0000 7fa47ef19800 1 --2- 172.21.15.132:0/419208014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb892c10 0x5590eb893030 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.125+0000 7fa47ef19800 1 -- 172.21.15.132:0/419208014 >> 172.21.15.132:0/419208014 conn(0x5590eb88ef20 msgr2=0x5590eb88cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.125+0000 7fa47ef19800 1 -- 172.21.15.132:0/419208014 shutdown_connections 2024-05-08T18:51:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.125+0000 7fa47ef19800 1 -- 172.21.15.132:0/419208014 wait complete. 2024-05-08T18:51:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.125+0000 7fa47ef19800 1 Processor -- start 2024-05-08T18:51:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.125+0000 7fa47ef19800 1 -- start start 2024-05-08T18:51:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.125+0000 7fa47ef19800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb892c10 0x5590eb899fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.125+0000 7fa47ef19800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5590eb893bd0 con 0x5590eb892c10 2024-05-08T18:51:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.125+0000 7fa47d212640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb892c10 0x5590eb899fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.125+0000 7fa47d212640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb892c10 0x5590eb899fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56274/0 (socket says 172.21.15.132:56274) 2024-05-08T18:51:44.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.125+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 learned_addr learned my addr 172.21.15.132:0/420848265 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.126+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590eb89a4e0 con 0x5590eb892c10 2024-05-08T18:51:44.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.126+0000 7fa47d212640 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb892c10 0x5590eb899fa0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa478011920 tx=0x7fa478052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.126+0000 7fa3527fc640 1 -- 172.21.15.132:0/420848265 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa478001310 con 0x5590eb892c10 2024-05-08T18:51:44.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.126+0000 7fa3527fc640 1 -- 172.21.15.132:0/420848265 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa478054310 con 0x5590eb892c10 2024-05-08T18:51:44.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.126+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590eb89a770 con 0x5590eb892c10 2024-05-08T18:51:44.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.126+0000 7fa3527fc640 1 -- 172.21.15.132:0/420848265 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4780545f0 con 0x5590eb892c10 2024-05-08T18:51:44.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.126+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590eb89d420 con 0x5590eb892c10 2024-05-08T18:51:44.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.127+0000 7fa3527fc640 1 -- 172.21.15.132:0/420848265 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa47804b400 con 0x5590eb892c10 2024-05-08T18:51:44.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.127+0000 7fa3527fc640 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa34803bba0 0x7fa34803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.127+0000 7fa3527fc640 1 -- 172.21.15.132:0/420848265 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fa478033030 con 0x5590eb892c10 2024-05-08T18:51:44.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.127+0000 7fa47ca11640 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa34803bba0 0x7fa34803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.127+0000 7fa47ef19800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.127+0000 7fa47ef19800 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5590eb8a5c20 0x5590eb8a80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.127+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8a8830 con 0x5590eb8a5c20 2024-05-08T18:51:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.128+0000 7fa477fff640 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5590eb8a5c20 0x5590eb8a80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.128+0000 7fa47ca11640 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa34803bba0 0x7fa34803e060 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa470044940 tx=0x7fa470086000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.128+0000 7fa477fff640 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5590eb8a5c20 0x5590eb8a80e0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.128+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa46800f610 con 0x5590eb8a5c20 2024-05-08T18:51:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.128+0000 7fa47ef19800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.128+0000 7fa47ef19800 20 realm 2024-05-08T18:51:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.128+0000 7fa47ef19800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.128+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8a5070 con 0x5590eb8a5c20 2024-05-08T18:51:44.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.128+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa46800f610 con 0x5590eb8a5c20 2024-05-08T18:51:44.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.128+0000 7fa47ef19800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.128+0000 7fa47ef19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:44.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.128+0000 7fa47ef19800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.128+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8a9310 con 0x5590eb8a5c20 2024-05-08T18:51:44.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.129+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa46800f610 con 0x5590eb8a5c20 2024-05-08T18:51:44.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.129+0000 7fa47ef19800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.129+0000 7fa47ef19800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.129+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8a9be0 con 0x5590eb8a5c20 2024-05-08T18:51:44.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.129+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa46800f610 con 0x5590eb8a5c20 2024-05-08T18:51:44.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.129+0000 7fa47ef19800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:44.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.129+0000 7fa47ef19800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.129+0000 7fa47ef19800 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5590eb8aa490 0x5590eb8ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.129+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8ad000 con 0x5590eb8aa490 2024-05-08T18:51:44.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.129+0000 7fa47d212640 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5590eb8aa490 0x5590eb8ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.129+0000 7fa47d212640 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5590eb8aa490 0x5590eb8ac8a0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.129+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa47802a070 con 0x5590eb8aa490 2024-05-08T18:51:44.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.129+0000 7fa47ef19800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:44.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.129+0000 7fa47ef19800 20 searching for the correct realm 2024-05-08T18:51:44.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.129+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x5590eb8aa490 2024-05-08T18:51:44.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.130+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47802a070 con 0x5590eb8aa490 2024-05-08T18:51:44.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.130+0000 7fa47d212640 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa478014070 0x7fa47803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.130+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x7fa478014070 2024-05-08T18:51:44.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.130+0000 7fa47ca11640 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa478014070 0x7fa47803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.130+0000 7fa47ca11640 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa478014070 0x7fa47803f4c0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.131+0000 7fa47ca11640 1 -- 172.21.15.132:0/420848265 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa470083030 con 0x7fa478014070 2024-05-08T18:51:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.131+0000 7fa47ca11640 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa470078060 0x7fa470092700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.131+0000 7fa47ca11640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x7fa470078060 2024-05-08T18:51:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.131+0000 7fa477fff640 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa470078060 0x7fa470092700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.131+0000 7fa477fff640 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa470078060 0x7fa470092700 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.132+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa46800f610 con 0x7fa470078060 2024-05-08T18:51:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.132+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x5590eb8a5c20 2024-05-08T18:51:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.132+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa46800f610 con 0x5590eb8a5c20 2024-05-08T18:51:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.132+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x5590eb8a5c20 2024-05-08T18:51:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.132+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa46802b040 con 0x5590eb8a5c20 2024-05-08T18:51:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.132+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x7fa470078060 2024-05-08T18:51:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.132+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa46802b040 con 0x7fa470078060 2024-05-08T18:51:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.132+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x7fa470078060 2024-05-08T18:51:44.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.133+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa46802b040 con 0x7fa470078060 2024-05-08T18:51:44.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.133+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x7fa478014070 2024-05-08T18:51:44.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.133+0000 7fa47ca11640 1 -- 172.21.15.132:0/420848265 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa470083030 con 0x7fa478014070 2024-05-08T18:51:44.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.133+0000 7fa47ca11640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x5590eb8aa490 2024-05-08T18:51:44.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.133+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47802a070 con 0x5590eb8aa490 2024-05-08T18:51:44.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.133+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x5590eb8a5c20 2024-05-08T18:51:44.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.133+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa46802b040 con 0x5590eb8a5c20 2024-05-08T18:51:44.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.133+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x7fa470078060 2024-05-08T18:51:44.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.134+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa46802b040 con 0x7fa470078060 2024-05-08T18:51:44.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.134+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x5590eb8a5c20 2024-05-08T18:51:44.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.134+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa46802b040 con 0x5590eb8a5c20 2024-05-08T18:51:44.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.134+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x7fa478014070 2024-05-08T18:51:44.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.134+0000 7fa47ca11640 1 -- 172.21.15.132:0/420848265 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa470083030 con 0x7fa478014070 2024-05-08T18:51:44.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.134+0000 7fa47ca11640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x5590eb8aa490 2024-05-08T18:51:44.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.134+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa47802a070 con 0x5590eb8aa490 2024-05-08T18:51:44.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.134+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x5590eb8aa490 2024-05-08T18:51:44.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.135+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47802a070 con 0x5590eb8aa490 2024-05-08T18:51:44.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.135+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x7fa470078060 2024-05-08T18:51:44.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.135+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa46802b040 con 0x7fa470078060 2024-05-08T18:51:44.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.135+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x5590eb8aa490 2024-05-08T18:51:44.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.135+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47802a070 con 0x5590eb8aa490 2024-05-08T18:51:44.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.135+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x5590eb8aa490 2024-05-08T18:51:44.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.135+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47802a070 con 0x5590eb8aa490 2024-05-08T18:51:44.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.136+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x5590eb8a5c20 2024-05-08T18:51:44.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.136+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa46802b040 con 0x5590eb8a5c20 2024-05-08T18:51:44.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.136+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x5590eb8a5c20 2024-05-08T18:51:44.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.136+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa46802b040 con 0x5590eb8a5c20 2024-05-08T18:51:44.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.136+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x7fa470078060 2024-05-08T18:51:44.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.136+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa46802b040 con 0x7fa470078060 2024-05-08T18:51:44.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.136+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x5590eb8aa490 2024-05-08T18:51:44.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.137+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47802a070 con 0x5590eb8aa490 2024-05-08T18:51:44.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.137+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x7fa478014070 2024-05-08T18:51:44.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.137+0000 7fa47ca11640 1 -- 172.21.15.132:0/420848265 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa470083030 con 0x7fa478014070 2024-05-08T18:51:44.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.137+0000 7fa47ca11640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x5590eb8a5c20 2024-05-08T18:51:44.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.137+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa46802b040 con 0x5590eb8a5c20 2024-05-08T18:51:44.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.137+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x7fa478014070 2024-05-08T18:51:44.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.137+0000 7fa47ca11640 1 -- 172.21.15.132:0/420848265 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa470083030 con 0x7fa478014070 2024-05-08T18:51:44.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.137+0000 7fa47ca11640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x5590eb8aa490 2024-05-08T18:51:44.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.138+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47802a070 con 0x5590eb8aa490 2024-05-08T18:51:44.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.138+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x7fa470078060 2024-05-08T18:51:44.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.138+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa46802b040 con 0x7fa470078060 2024-05-08T18:51:44.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.138+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x7fa478014070 2024-05-08T18:51:44.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.138+0000 7fa47ca11640 1 -- 172.21.15.132:0/420848265 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa470083030 con 0x7fa478014070 2024-05-08T18:51:44.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.138+0000 7fa47ca11640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x5590eb8aa490 2024-05-08T18:51:44.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.138+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa47802a070 con 0x5590eb8aa490 2024-05-08T18:51:44.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.138+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x7fa470078060 2024-05-08T18:51:44.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.139+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa46802b040 con 0x7fa470078060 2024-05-08T18:51:44.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.139+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x5590eb8a5c20 2024-05-08T18:51:44.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.139+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa46802b040 con 0x5590eb8a5c20 2024-05-08T18:51:44.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.139+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8aea30 con 0x7fa478014070 2024-05-08T18:51:44.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.139+0000 7fa47ca11640 1 -- 172.21.15.132:0/420848265 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa470083030 con 0x7fa478014070 2024-05-08T18:51:44.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.139+0000 7fa47ef19800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:44.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.139+0000 7fa47ef19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:44.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.139+0000 7fa47ef19800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:44.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.139+0000 7fa47ef19800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:44.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.139+0000 7fa47ef19800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:44.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.139+0000 7fa47ef19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:44.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.139+0000 7fa47ef19800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.139+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8adb00 con 0x5590eb8a5c20 2024-05-08T18:51:44.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.139+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa46802b040 con 0x5590eb8a5c20 2024-05-08T18:51:44.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.139+0000 7fa47ef19800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.139+0000 7fa47ef19800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.139+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8ae3a0 con 0x5590eb8a5c20 2024-05-08T18:51:44.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.140+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa46802b040 con 0x5590eb8a5c20 2024-05-08T18:51:44.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.140+0000 7fa47ef19800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:44.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.140+0000 7fa47ef19800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.140+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8ad740 con 0x5590eb8a5c20 2024-05-08T18:51:44.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.140+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa46802b040 con 0x5590eb8a5c20 2024-05-08T18:51:44.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.140+0000 7fa47ef19800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:44.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.140+0000 7fa47ef19800 20 zone default found 2024-05-08T18:51:44.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.140+0000 7fa47ef19800 4 Realm: () 2024-05-08T18:51:44.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.140+0000 7fa47ef19800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:44.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.140+0000 7fa47ef19800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:44.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.140+0000 7fa47ef19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:44.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.140+0000 7fa47ef19800 20 zonegroup default 2024-05-08T18:51:44.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.140+0000 7fa47ef19800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.140+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8af3b0 con 0x7fa478014070 2024-05-08T18:51:44.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.140+0000 7fa47ca11640 1 -- 172.21.15.132:0/420848265 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa470083030 con 0x7fa478014070 2024-05-08T18:51:44.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.140+0000 7fa47ef19800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.140+0000 7fa47ef19800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.140+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b1190 con 0x5590eb8aa490 2024-05-08T18:51:44.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.140+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa47802a070 con 0x5590eb8aa490 2024-05-08T18:51:44.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.140+0000 7fa47ef19800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.140+0000 7fa47ef19800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.141+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b1680 con 0x5590eb8aa490 2024-05-08T18:51:44.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.141+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa47802a070 con 0x5590eb8aa490 2024-05-08T18:51:44.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.141+0000 7fa47ef19800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.141+0000 7fa47ef19800 20 started sync module instance, tier type = 2024-05-08T18:51:44.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.141+0000 7fa47ef19800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:44.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.141+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b05d0 con 0x7fa478014070 2024-05-08T18:51:44.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.142+0000 7fa47ca11640 1 -- 172.21.15.132:0/420848265 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa470083030 con 0x7fa478014070 2024-05-08T18:51:44.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.142+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94080915409344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b0230 con 0x7fa478014070 2024-05-08T18:51:44.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.142+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b25b0 con 0x5590eb8a5c20 2024-05-08T18:51:44.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.143+0000 7fa47ca11640 1 -- 172.21.15.132:0/420848265 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94080915409344] v27'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa470083030 con 0x7fa478014070 2024-05-08T18:51:44.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.143+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46802b040 con 0x5590eb8a5c20 2024-05-08T18:51:44.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.143+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94080915415296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b29d0 con 0x5590eb8a5c20 2024-05-08T18:51:44.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.143+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b33d0 con 0x5590eb8aa490 2024-05-08T18:51:44.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.144+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94080915415296] v27'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46802b040 con 0x5590eb8a5c20 2024-05-08T18:51:44.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.145+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47802a070 con 0x5590eb8aa490 2024-05-08T18:51:44.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.145+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94080915418848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b29d0 con 0x5590eb8aa490 2024-05-08T18:51:44.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.145+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b3e60 con 0x7fa478014070 2024-05-08T18:51:44.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.146+0000 7fa47ca11640 1 -- 172.21.15.132:0/420848265 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa470083030 con 0x7fa478014070 2024-05-08T18:51:44.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.146+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94080915421488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b3e20 con 0x7fa478014070 2024-05-08T18:51:44.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.146+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b4e40 con 0x5590eb8a5c20 2024-05-08T18:51:44.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.146+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94080915418848] v27'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47802a070 con 0x5590eb8aa490 2024-05-08T18:51:44.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.147+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46802b040 con 0x5590eb8a5c20 2024-05-08T18:51:44.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.147+0000 7fa47ca11640 1 -- 172.21.15.132:0/420848265 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94080915421488] v27'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa470083030 con 0x7fa478014070 2024-05-08T18:51:44.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.147+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94080915425616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b4e40 con 0x5590eb8a5c20 2024-05-08T18:51:44.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.147+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b56e0 con 0x7fa470078060 2024-05-08T18:51:44.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.148+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46802b040 con 0x7fa470078060 2024-05-08T18:51:44.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.148+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94080915426880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b5790 con 0x7fa470078060 2024-05-08T18:51:44.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.148+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b62b0 con 0x7fa470078060 2024-05-08T18:51:44.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.148+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94080915425616] v27'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46802b040 con 0x5590eb8a5c20 2024-05-08T18:51:44.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.149+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94080915426880] v27'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46802b040 con 0x7fa470078060 2024-05-08T18:51:44.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.149+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46802b040 con 0x7fa470078060 2024-05-08T18:51:44.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.149+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94080915427936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b4250 con 0x7fa470078060 2024-05-08T18:51:44.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.149+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b6720 con 0x7fa470078060 2024-05-08T18:51:44.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.150+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94080915427936] v27'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46802b040 con 0x7fa470078060 2024-05-08T18:51:44.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.150+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46802b040 con 0x7fa470078060 2024-05-08T18:51:44.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.150+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94080915430784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b6720 con 0x7fa470078060 2024-05-08T18:51:44.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.150+0000 7fa47ef19800 20 add_watcher() i=0 2024-05-08T18:51:44.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.150+0000 7fa47ef19800 20 add_watcher() i=1 2024-05-08T18:51:44.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.150+0000 7fa47ef19800 20 add_watcher() i=2 2024-05-08T18:51:44.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.150+0000 7fa47ef19800 20 add_watcher() i=3 2024-05-08T18:51:44.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.150+0000 7fa47ef19800 20 add_watcher() i=4 2024-05-08T18:51:44.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.150+0000 7fa47ef19800 20 add_watcher() i=5 2024-05-08T18:51:44.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.150+0000 7fa47ef19800 20 add_watcher() i=6 2024-05-08T18:51:44.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.151+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94080915430784] v27'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46802b040 con 0x7fa470078060 2024-05-08T18:51:44.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.151+0000 7fa47ef19800 20 add_watcher() i=7 2024-05-08T18:51:44.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.151+0000 7fa47ef19800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:44.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.151+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b9b20 con 0x5590eb8a5c20 2024-05-08T18:51:44.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.152+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa46802b040 con 0x5590eb8a5c20 2024-05-08T18:51:44.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.152+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94080915432512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b7040 con 0x5590eb8a5c20 2024-05-08T18:51:44.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.153+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94080915432512] v27'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa46802b040 con 0x5590eb8a5c20 2024-05-08T18:51:44.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.153+0000 7fa3337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:44.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.153+0000 7fa47ef19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:44.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.153+0000 7fa47ef19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:44.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.153+0000 7fa47ef19800 5 note: GC not initialized 2024-05-08T18:51:44.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.153+0000 7fa3327e4640 20 reqs_thread_entry: start 2024-05-08T18:51:44.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.153+0000 7fa47ef19800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:44.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.153+0000 7fa47ef19800 20 Filter name: none 2024-05-08T18:51:44.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.153+0000 7fa32b7fe640 20 reqs_thread_entry: start 2024-05-08T18:51:44.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.154+0000 7fa47ef19800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.154+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8ecb40 con 0x5590eb8a5c20 2024-05-08T18:51:44.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.154+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa46802b040 con 0x5590eb8a5c20 2024-05-08T18:51:44.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.154+0000 7fa47ef19800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:51:44.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.154+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8edf30 con 0x7fa470078060 2024-05-08T18:51:44.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.155+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fa46802b040 con 0x7fa470078060 2024-05-08T18:51:44.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.155+0000 7fa3337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:44.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.156+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94080915432512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b92d0 con 0x5590eb8a5c20 2024-05-08T18:51:44.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.157+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94080915432512] v27'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa46802b040 con 0x5590eb8a5c20 2024-05-08T18:51:44.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.157+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94080915409344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b8e20 con 0x7fa478014070 2024-05-08T18:51:44.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.157+0000 7fa47ca11640 1 -- 172.21.15.132:0/420848265 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94080915409344] v27'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa470083030 con 0x7fa478014070 2024-05-08T18:51:44.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.158+0000 7fa47ef19800 20 remove_watcher() i=0 2024-05-08T18:51:44.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.158+0000 7fa47ef19800 2 removed watcher, disabling cache 2024-05-08T18:51:44.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.158+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94080915415296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b09c0 con 0x5590eb8a5c20 2024-05-08T18:51:44.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.159+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94080915415296] v27'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46802b040 con 0x5590eb8a5c20 2024-05-08T18:51:44.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.159+0000 7fa47ef19800 20 remove_watcher() i=1 2024-05-08T18:51:44.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.159+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94080915418848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b09c0 con 0x5590eb8aa490 2024-05-08T18:51:44.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.160+0000 7fa47d212640 1 -- 172.21.15.132:0/420848265 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94080915418848] v27'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa47802a070 con 0x5590eb8aa490 2024-05-08T18:51:44.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.160+0000 7fa47ef19800 20 remove_watcher() i=2 2024-05-08T18:51:44.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.160+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94080915421488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b2ee0 con 0x7fa478014070 2024-05-08T18:51:44.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.161+0000 7fa47ca11640 1 -- 172.21.15.132:0/420848265 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94080915421488] v27'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa470083030 con 0x7fa478014070 2024-05-08T18:51:44.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.161+0000 7fa47ef19800 20 remove_watcher() i=3 2024-05-08T18:51:44.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.161+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94080915425616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b09c0 con 0x5590eb8a5c20 2024-05-08T18:51:44.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.162+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94080915425616] v27'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46802b040 con 0x5590eb8a5c20 2024-05-08T18:51:44.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.162+0000 7fa47ef19800 20 remove_watcher() i=4 2024-05-08T18:51:44.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.162+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94080915426880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b2ee0 con 0x7fa470078060 2024-05-08T18:51:44.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.164+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94080915426880] v27'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46802b040 con 0x7fa470078060 2024-05-08T18:51:44.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.164+0000 7fa47ef19800 20 remove_watcher() i=5 2024-05-08T18:51:44.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.164+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94080915427936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b2ee0 con 0x7fa470078060 2024-05-08T18:51:44.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.165+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94080915427936] v27'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46802b040 con 0x7fa470078060 2024-05-08T18:51:44.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.165+0000 7fa47ef19800 20 remove_watcher() i=6 2024-05-08T18:51:44.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.165+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94080915430784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5590eb8b2ee0 con 0x7fa470078060 2024-05-08T18:51:44.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.166+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94080915430784] v27'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa46802b040 con 0x7fa470078060 2024-05-08T18:51:44.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.166+0000 7fa47ef19800 20 remove_watcher() i=7 2024-05-08T18:51:44.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.166+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa470078060 msgr2=0x7fa470092700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.166+0000 7fa47ef19800 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa470078060 0x7fa470092700 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.166+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5590eb8a5c20 msgr2=0x5590eb8a80e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.166+0000 7fa47ef19800 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5590eb8a5c20 0x5590eb8a80e0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.166+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa478014070 msgr2=0x7fa47803f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.166+0000 7fa47ef19800 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa478014070 0x7fa47803f4c0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.166+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5590eb8aa490 msgr2=0x5590eb8ac8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.166+0000 7fa47ef19800 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5590eb8aa490 0x5590eb8ac8a0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.166+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa34803bba0 msgr2=0x7fa34803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.166+0000 7fa47ef19800 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa34803bba0 0x7fa34803e060 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa470044940 tx=0x7fa470086000 comp rx=0 tx=0).stop 2024-05-08T18:51:44.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.166+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb892c10 msgr2=0x5590eb899fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.166+0000 7fa477fff640 1 -- 172.21.15.132:0/420848265 reap_dead start 2024-05-08T18:51:44.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.166+0000 7fa47ef19800 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb892c10 0x5590eb899fa0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa478011920 tx=0x7fa478052be0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.166+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 shutdown_connections 2024-05-08T18:51:44.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.166+0000 7fa47ef19800 1 --2- 172.21.15.132:0/420848265 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb892c10 0x5590eb899fa0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.166+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 >> 172.21.15.132:0/420848265 conn(0x5590eb88ef20 msgr2=0x5590eb88c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.166+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 shutdown_connections 2024-05-08T18:51:44.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.166+0000 7fa47ef19800 1 -- 172.21.15.132:0/420848265 wait complete. 2024-05-08T18:51:44.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 -- 172.21.15.132:0/545984128 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa35403bba0 msgr2=0x7fa35403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 --2- 172.21.15.132:0/545984128 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa35403bba0 0x7fa35403e060 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x5590eb76ebe0 tx=0x7fa470052f40 comp rx=0 tx=0).stop 2024-05-08T18:51:44.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 -- 172.21.15.132:0/545984128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb885920 msgr2=0x5590eb885d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 --2- 172.21.15.132:0/545984128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb885920 0x5590eb885d40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x5590eb871e30 tx=0x7fa478018830 comp rx=0 tx=0).stop 2024-05-08T18:51:44.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 -- 172.21.15.132:0/545984128 shutdown_connections 2024-05-08T18:51:44.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 --2- 172.21.15.132:0/545984128 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa35403bba0 0x7fa35403e060 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 --2- 172.21.15.132:0/545984128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb885920 0x5590eb885d40 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 -- 172.21.15.132:0/545984128 >> 172.21.15.132:0/545984128 conn(0x5590eb8799c0 msgr2=0x5590eb879dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 -- 172.21.15.132:0/545984128 shutdown_connections 2024-05-08T18:51:44.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 -- 172.21.15.132:0/545984128 wait complete. 2024-05-08T18:51:44.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 -- 172.21.15.132:0/2400728914 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5590eb772370 msgr2=0x5590eb8714d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 --2- 172.21.15.132:0/2400728914 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5590eb772370 0x5590eb8714d0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 -- 172.21.15.132:0/2400728914 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5590eb873d90 msgr2=0x5590eb876250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 --2- 172.21.15.132:0/2400728914 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5590eb873d90 0x5590eb876250 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 -- 172.21.15.132:0/2400728914 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa36403bb50 msgr2=0x7fa36403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 --2- 172.21.15.132:0/2400728914 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa36403bb50 0x7fa36403e010 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa468000f60 tx=0x7fa468001370 comp rx=0 tx=0).stop 2024-05-08T18:51:44.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 -- 172.21.15.132:0/2400728914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb6e2490 msgr2=0x5590eb76f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 --2- 172.21.15.132:0/2400728914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb6e2490 0x5590eb76f730 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa470052540 tx=0x7fa470003020 comp rx=0 tx=0).stop 2024-05-08T18:51:44.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 -- 172.21.15.132:0/2400728914 shutdown_connections 2024-05-08T18:51:44.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 --2- 172.21.15.132:0/2400728914 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5590eb873d90 0x5590eb876250 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 --2- 172.21.15.132:0/2400728914 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5590eb772370 0x5590eb8714d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 --2- 172.21.15.132:0/2400728914 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa36403bb50 0x7fa36403e010 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 --2- 172.21.15.132:0/2400728914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5590eb6e2490 0x5590eb76f730 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 -- 172.21.15.132:0/2400728914 >> 172.21.15.132:0/2400728914 conn(0x5590eb769720 msgr2=0x5590eb85a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 -- 172.21.15.132:0/2400728914 shutdown_connections 2024-05-08T18:51:44.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.167+0000 7fa47ef19800 1 -- 172.21.15.132:0/2400728914 wait complete. 2024-05-08T18:51:44.178 INFO:teuthology.orchestra.run.smithi132.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-08T18:51:44.178 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:51:44.178 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-05-08T18:51:44.178 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-05-08T18:51:44.178 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-05-08T18:51:44.224 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:44.224 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:44.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.226+0000 7fa62f32d800 1 Processor -- start 2024-05-08T18:51:44.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.226+0000 7fa62f32d800 1 -- start start 2024-05-08T18:51:44.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.226+0000 7fa62f32d800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55cf0a79a6b0 0x55cf0a7a31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.226+0000 7fa62f32d800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cf0a70ddb0 con 0x55cf0a798b70 2024-05-08T18:51:44.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.226+0000 7fa62f32d800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55cf0a63ae20 con 0x55cf0a79a6b0 2024-05-08T18:51:44.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.226+0000 7fa623fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55cf0a79a6b0 0x55cf0a7a31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.226+0000 7fa62af78640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55cf0a798b70 0x55cf0a798f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:49028/0 (socket says 172.21.15.132:49028) 2024-05-08T18:51:44.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.226+0000 7fa62af78640 1 -- 172.21.15.132:0/3303791694 learned_addr learned my addr 172.21.15.132:0/3303791694 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:51:44.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.226+0000 7fa623fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55cf0a79a6b0 0x55cf0a7a31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56290/0 (socket says 172.21.15.132:56290) 2024-05-08T18:51:44.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.227+0000 7fa623fff640 1 -- 172.21.15.132:0/3303791694 >> v1:172.21.15.42:6789/0 conn(0x55cf0a798b70 legacy=0x55cf0a798f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.227+0000 7fa623fff640 1 -- 172.21.15.132:0/3303791694 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf0a7a4700 con 0x55cf0a79a6b0 2024-05-08T18:51:44.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.229+0000 7fa623fff640 1 --2- 172.21.15.132:0/3303791694 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a79a6b0 0x55cf0a7a31b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa61400a470 tx=0x7fa61401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2be58b0728e4dd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.229+0000 7fa62a777640 1 -- 172.21.15.132:0/3303791694 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa614057070 con 0x55cf0a79a6b0 2024-05-08T18:51:44.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.229+0000 7fa62a777640 1 -- 172.21.15.132:0/3303791694 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61404adc0 con 0x55cf0a79a6b0 2024-05-08T18:51:44.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.229+0000 7fa62a777640 1 -- 172.21.15.132:0/3303791694 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa614052590 con 0x55cf0a79a6b0 2024-05-08T18:51:44.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.229+0000 7fa62f32d800 1 -- 172.21.15.132:0/3303791694 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a79a6b0 msgr2=0x55cf0a7a31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.229+0000 7fa62f32d800 1 --2- 172.21.15.132:0/3303791694 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a79a6b0 0x55cf0a7a31b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa61400a470 tx=0x7fa61401ce90 comp rx=0 tx=0).stop 2024-05-08T18:51:44.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.229+0000 7fa62f32d800 1 -- 172.21.15.132:0/3303791694 shutdown_connections 2024-05-08T18:51:44.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.229+0000 7fa62f32d800 1 --2- 172.21.15.132:0/3303791694 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a79a6b0 0x55cf0a7a31b0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.229+0000 7fa62f32d800 1 -- 172.21.15.132:0/3303791694 >> 172.21.15.132:0/3303791694 conn(0x55cf0a7946b0 msgr2=0x55cf0a796b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.229+0000 7fa62f32d800 1 -- 172.21.15.132:0/3303791694 shutdown_connections 2024-05-08T18:51:44.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.229+0000 7fa62f32d800 1 -- 172.21.15.132:0/3303791694 wait complete. 2024-05-08T18:51:44.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.243+0000 7fa62f32d800 1 Processor -- start 2024-05-08T18:51:44.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.243+0000 7fa62f32d800 1 -- start start 2024-05-08T18:51:44.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.243+0000 7fa62f32d800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a798b70 0x55cf0a88d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.243+0000 7fa62f32d800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cf0a6e55c0 con 0x55cf0a798b70 2024-05-08T18:51:44.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.244+0000 7fa62af78640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a798b70 0x55cf0a88d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.244+0000 7fa62af78640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a798b70 0x55cf0a88d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56306/0 (socket says 172.21.15.132:56306) 2024-05-08T18:51:44.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.244+0000 7fa62af78640 1 -- 172.21.15.132:0/2310831556 learned_addr learned my addr 172.21.15.132:0/2310831556 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.244+0000 7fa62af78640 1 -- 172.21.15.132:0/2310831556 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf0a88df70 con 0x55cf0a798b70 2024-05-08T18:51:44.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.244+0000 7fa62af78640 1 --2- 172.21.15.132:0/2310831556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a798b70 0x55cf0a88d9a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa61c001de0 tx=0x7fa61c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7938034433dec3e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.244+0000 7fa518e09640 1 -- 172.21.15.132:0/2310831556 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa61c012020 con 0x55cf0a798b70 2024-05-08T18:51:44.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.244+0000 7fa518e09640 1 -- 172.21.15.132:0/2310831556 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61c00e5a0 con 0x55cf0a798b70 2024-05-08T18:51:44.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.244+0000 7fa518e09640 1 -- 172.21.15.132:0/2310831556 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa61c00e8c0 con 0x55cf0a798b70 2024-05-08T18:51:44.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.245+0000 7fa62f32d800 1 -- 172.21.15.132:0/2310831556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a798b70 msgr2=0x55cf0a88d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.245+0000 7fa62f32d800 1 --2- 172.21.15.132:0/2310831556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a798b70 0x55cf0a88d9a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa61c001de0 tx=0x7fa61c00b6c0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.245+0000 7fa62f32d800 1 -- 172.21.15.132:0/2310831556 shutdown_connections 2024-05-08T18:51:44.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.245+0000 7fa62f32d800 1 --2- 172.21.15.132:0/2310831556 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a798b70 0x55cf0a88d9a0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.245+0000 7fa62f32d800 1 -- 172.21.15.132:0/2310831556 >> 172.21.15.132:0/2310831556 conn(0x55cf0a7946b0 msgr2=0x55cf0a8892c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.245+0000 7fa62f32d800 1 -- 172.21.15.132:0/2310831556 shutdown_connections 2024-05-08T18:51:44.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.245+0000 7fa62f32d800 1 -- 172.21.15.132:0/2310831556 wait complete. 2024-05-08T18:51:44.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.245+0000 7fa62f32d800 1 Processor -- start 2024-05-08T18:51:44.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.245+0000 7fa62f32d800 1 -- start start 2024-05-08T18:51:44.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.246+0000 7fa62f32d800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a798b70 0x55cf0a8954f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.246+0000 7fa62f32d800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cf0a7a39c0 con 0x55cf0a798b70 2024-05-08T18:51:44.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.246+0000 7fa62af78640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a798b70 0x55cf0a8954f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.246+0000 7fa62af78640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a798b70 0x55cf0a8954f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56322/0 (socket says 172.21.15.132:56322) 2024-05-08T18:51:44.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.246+0000 7fa62af78640 1 -- 172.21.15.132:0/1785322252 learned_addr learned my addr 172.21.15.132:0/1785322252 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.246+0000 7fa62af78640 1 -- 172.21.15.132:0/1785322252 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf0a895a30 con 0x55cf0a798b70 2024-05-08T18:51:44.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.246+0000 7fa62af78640 1 --2- 172.21.15.132:0/1785322252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a798b70 0x55cf0a8954f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00c010 tx=0x7fa61c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.247+0000 7fa517606640 1 -- 172.21.15.132:0/1785322252 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa61c012070 con 0x55cf0a798b70 2024-05-08T18:51:44.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.247+0000 7fa517606640 1 -- 172.21.15.132:0/1785322252 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61c01a7a0 con 0x55cf0a798b70 2024-05-08T18:51:44.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.247+0000 7fa62f32d800 1 -- 172.21.15.132:0/1785322252 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf0a895cc0 con 0x55cf0a798b70 2024-05-08T18:51:44.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.247+0000 7fa517606640 1 -- 172.21.15.132:0/1785322252 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa61c01aa80 con 0x55cf0a798b70 2024-05-08T18:51:44.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.247+0000 7fa62f32d800 1 -- 172.21.15.132:0/1785322252 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf0a898970 con 0x55cf0a798b70 2024-05-08T18:51:44.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.248+0000 7fa517606640 1 -- 172.21.15.132:0/1785322252 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa61c015020 con 0x55cf0a798b70 2024-05-08T18:51:44.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.248+0000 7fa517606640 1 --2- 172.21.15.132:0/1785322252 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa51003bb50 0x7fa51003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.248+0000 7fa517606640 1 -- 172.21.15.132:0/1785322252 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fa61c020070 con 0x55cf0a798b70 2024-05-08T18:51:44.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.248+0000 7fa623fff640 1 --2- 172.21.15.132:0/1785322252 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa51003bb50 0x7fa51003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.248+0000 7fa62f32d800 1 --2- 172.21.15.132:0/1785322252 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cf0a79a6b0 0x55cf0a89c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.248+0000 7fa62f32d800 1 -- 172.21.15.132:0/1785322252 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a89cc70 con 0x55cf0a79a6b0 2024-05-08T18:51:44.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.248+0000 7fa62b779640 1 --2- 172.21.15.132:0/1785322252 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cf0a79a6b0 0x55cf0a89c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.248+0000 7fa623fff640 1 --2- 172.21.15.132:0/1785322252 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa51003bb50 0x7fa51003e010 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa614054000 tx=0x7fa61404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.248+0000 7fa62b779640 1 --2- 172.21.15.132:0/1785322252 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cf0a79a6b0 0x55cf0a89c730 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.249+0000 7fa62b779640 1 -- 172.21.15.132:0/1785322252 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa62400a4a0 con 0x55cf0a79a6b0 2024-05-08T18:51:44.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.249+0000 7fa62f32d800 1 -- 172.21.15.132:0/1785322252 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a899d00 con 0x55cf0a79a6b0 2024-05-08T18:51:44.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.249+0000 7fa62b779640 1 -- 172.21.15.132:0/1785322252 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa62400a4a0 con 0x55cf0a79a6b0 2024-05-08T18:51:44.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.249+0000 7fa62f32d800 1 --2- 172.21.15.132:0/1785322252 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cf0a89efc0 0x55cf0a8a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.249+0000 7fa62f32d800 1 -- 172.21.15.132:0/1785322252 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8a1aa0 con 0x55cf0a89efc0 2024-05-08T18:51:44.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.249+0000 7fa62af78640 1 --2- 172.21.15.132:0/1785322252 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cf0a89efc0 0x55cf0a8a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.249+0000 7fa62af78640 1 --2- 172.21.15.132:0/1785322252 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cf0a89efc0 0x55cf0a8a13b0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.250+0000 7fa62af78640 1 -- 172.21.15.132:0/1785322252 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa61c02b070 con 0x55cf0a89efc0 2024-05-08T18:51:44.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.250+0000 7fa62f32d800 1 -- 172.21.15.132:0/1785322252 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a89de60 con 0x55cf0a79a6b0 2024-05-08T18:51:44.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.250+0000 7fa62b779640 1 -- 172.21.15.132:0/1785322252 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa62400a4a0 con 0x55cf0a79a6b0 2024-05-08T18:51:44.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.250+0000 7fa62f32d800 1 -- 172.21.15.132:0/1785322252 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a89e340 con 0x55cf0a79a6b0 2024-05-08T18:51:44.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.250+0000 7fa62b779640 1 -- 172.21.15.132:0/1785322252 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa62400a4a0 con 0x55cf0a79a6b0 2024-05-08T18:51:44.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.250+0000 7fa62f32d800 1 Processor -- start 2024-05-08T18:51:44.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.251+0000 7fa62f32d800 1 -- start start 2024-05-08T18:51:44.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.251+0000 7fa62f32d800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a8b0a20 0x55cf0a8b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.251+0000 7fa62f32d800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cf0a68bfc0 con 0x55cf0a8b0a20 2024-05-08T18:51:44.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.251+0000 7fa62b779640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a8b0a20 0x55cf0a8b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.251+0000 7fa62b779640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a8b0a20 0x55cf0a8b0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56336/0 (socket says 172.21.15.132:56336) 2024-05-08T18:51:44.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.251+0000 7fa62b779640 1 -- 172.21.15.132:0/2528890357 learned_addr learned my addr 172.21.15.132:0/2528890357 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.251+0000 7fa62b779640 1 -- 172.21.15.132:0/2528890357 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf0a8b1380 con 0x55cf0a8b0a20 2024-05-08T18:51:44.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.252+0000 7fa62b779640 1 --2- 172.21.15.132:0/2528890357 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a8b0a20 0x55cf0a8b0e40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x55cf0a89d070 tx=0x7fa624018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.252+0000 7fa514e01640 1 -- 172.21.15.132:0/2528890357 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa624014450 con 0x55cf0a8b0a20 2024-05-08T18:51:44.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.252+0000 7fa514e01640 1 -- 172.21.15.132:0/2528890357 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa624014610 con 0x55cf0a8b0a20 2024-05-08T18:51:44.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.252+0000 7fa514e01640 1 -- 172.21.15.132:0/2528890357 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa624014930 con 0x55cf0a8b0a20 2024-05-08T18:51:44.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.252+0000 7fa62f32d800 1 -- 172.21.15.132:0/2528890357 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf0a8b1df0 con 0x55cf0a8b0a20 2024-05-08T18:51:44.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.252+0000 7fa62f32d800 1 -- 172.21.15.132:0/2528890357 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf0a8b22f0 con 0x55cf0a8b0a20 2024-05-08T18:51:44.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.253+0000 7fa514e01640 1 -- 172.21.15.132:0/2528890357 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa624011040 con 0x55cf0a8b0a20 2024-05-08T18:51:44.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.253+0000 7fa514e01640 1 --2- 172.21.15.132:0/2528890357 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa50403bba0 0x7fa50403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.253+0000 7fa514e01640 1 -- 172.21.15.132:0/2528890357 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fa62401e070 con 0x55cf0a8b0a20 2024-05-08T18:51:44.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.253+0000 7fa62af78640 1 --2- 172.21.15.132:0/2528890357 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa50403bba0 0x7fa50403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.253+0000 7fa62f32d800 1 Processor -- start 2024-05-08T18:51:44.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.253+0000 7fa62af78640 1 --2- 172.21.15.132:0/2528890357 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa50403bba0 0x7fa50403e060 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55cf0a89d110 tx=0x7fa61c001520 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.253+0000 7fa62f32d800 1 -- start start 2024-05-08T18:51:44.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.253+0000 7fa62f32d800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a8bdcc0 0x55cf0a8be0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.254+0000 7fa62f32d800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cf0a88e2f0 con 0x55cf0a8bdcc0 2024-05-08T18:51:44.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.254+0000 7fa62b779640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a8bdcc0 0x55cf0a8be0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.254+0000 7fa62b779640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a8bdcc0 0x55cf0a8be0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56348/0 (socket says 172.21.15.132:56348) 2024-05-08T18:51:44.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.254+0000 7fa62b779640 1 -- 172.21.15.132:0/4240155600 learned_addr learned my addr 172.21.15.132:0/4240155600 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.254+0000 7fa62b779640 1 -- 172.21.15.132:0/4240155600 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf0a8be6b0 con 0x55cf0a8bdcc0 2024-05-08T18:51:44.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.254+0000 7fa62b779640 1 --2- 172.21.15.132:0/4240155600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a8bdcc0 0x55cf0a8be0e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa624052c50 tx=0x7fa624011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f6bc4231ab8b9a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.254+0000 7fa50e7fc640 1 -- 172.21.15.132:0/4240155600 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa624028030 con 0x55cf0a8bdcc0 2024-05-08T18:51:44.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.254+0000 7fa50e7fc640 1 -- 172.21.15.132:0/4240155600 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa62402b350 con 0x55cf0a8bdcc0 2024-05-08T18:51:44.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.255+0000 7fa50e7fc640 1 -- 172.21.15.132:0/4240155600 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa624016910 con 0x55cf0a8bdcc0 2024-05-08T18:51:44.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.255+0000 7fa62f32d800 1 -- 172.21.15.132:0/4240155600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a8bdcc0 msgr2=0x55cf0a8be0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.255+0000 7fa62f32d800 1 --2- 172.21.15.132:0/4240155600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a8bdcc0 0x55cf0a8be0e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa624052c50 tx=0x7fa624011a80 comp rx=0 tx=0).stop 2024-05-08T18:51:44.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.255+0000 7fa62f32d800 1 -- 172.21.15.132:0/4240155600 shutdown_connections 2024-05-08T18:51:44.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.255+0000 7fa62f32d800 1 --2- 172.21.15.132:0/4240155600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a8bdcc0 0x55cf0a8be0e0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.255+0000 7fa62f32d800 1 -- 172.21.15.132:0/4240155600 >> 172.21.15.132:0/4240155600 conn(0x55cf0a8b9fd0 msgr2=0x55cf0a8b8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.255+0000 7fa62f32d800 1 -- 172.21.15.132:0/4240155600 shutdown_connections 2024-05-08T18:51:44.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.255+0000 7fa62f32d800 1 -- 172.21.15.132:0/4240155600 wait complete. 2024-05-08T18:51:44.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.255+0000 7fa62f32d800 1 Processor -- start 2024-05-08T18:51:44.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.255+0000 7fa62f32d800 1 -- start start 2024-05-08T18:51:44.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.255+0000 7fa62f32d800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a8bdcc0 0x55cf0a8c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.255+0000 7fa62f32d800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55cf0a8bee00 con 0x55cf0a8bdcc0 2024-05-08T18:51:44.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.256+0000 7fa62b779640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a8bdcc0 0x55cf0a8c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.256+0000 7fa62b779640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a8bdcc0 0x55cf0a8c52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56364/0 (socket says 172.21.15.132:56364) 2024-05-08T18:51:44.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.256+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 learned_addr learned my addr 172.21.15.132:0/12535239 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.256+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf0a8c57f0 con 0x55cf0a8bdcc0 2024-05-08T18:51:44.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.256+0000 7fa62b779640 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a8bdcc0 0x55cf0a8c52b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa624014fd0 tx=0x7fa624052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.256+0000 7fa50cff9640 1 -- 172.21.15.132:0/12535239 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6240542e0 con 0x55cf0a8bdcc0 2024-05-08T18:51:44.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.256+0000 7fa50cff9640 1 -- 172.21.15.132:0/12535239 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa624032020 con 0x55cf0a8bdcc0 2024-05-08T18:51:44.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.256+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf0a8c5a80 con 0x55cf0a8bdcc0 2024-05-08T18:51:44.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.256+0000 7fa50cff9640 1 -- 172.21.15.132:0/12535239 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6240545b0 con 0x55cf0a8bdcc0 2024-05-08T18:51:44.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.256+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf0a8c8730 con 0x55cf0a8bdcc0 2024-05-08T18:51:44.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.257+0000 7fa50cff9640 1 -- 172.21.15.132:0/12535239 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa62404b050 con 0x55cf0a8bdcc0 2024-05-08T18:51:44.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.257+0000 7fa50cff9640 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa4f403bb50 0x7fa4f403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.258+0000 7fa50cff9640 1 -- 172.21.15.132:0/12535239 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fa624033030 con 0x55cf0a8bdcc0 2024-05-08T18:51:44.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.258+0000 7fa62af78640 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa4f403bb50 0x7fa4f403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.258+0000 7fa62f32d800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.258+0000 7fa62f32d800 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cf0a8d0db0 0x55cf0a8d3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.258+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d39c0 con 0x55cf0a8d0db0 2024-05-08T18:51:44.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.258+0000 7fa62af78640 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa4f403bb50 0x7fa4f403e010 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa61c02cb20 tx=0x7fa61c025000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.258+0000 7fa623fff640 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cf0a8d0db0 0x55cf0a8d3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.258+0000 7fa623fff640 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cf0a8d0db0 0x55cf0a8d3270 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.258+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.259+0000 7fa62f32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.259+0000 7fa62f32d800 20 realm 2024-05-08T18:51:44.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.259+0000 7fa62f32d800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.259+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d3df0 con 0x55cf0a8d0db0 2024-05-08T18:51:44.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.259+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.259+0000 7fa62f32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.259+0000 7fa62f32d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:44.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.259+0000 7fa62f32d800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.259+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d46c0 con 0x55cf0a8d0db0 2024-05-08T18:51:44.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.259+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.259+0000 7fa62f32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.259+0000 7fa62f32d800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.259+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d4a60 con 0x55cf0a8d0db0 2024-05-08T18:51:44.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.259+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.259+0000 7fa62f32d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:44.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.259+0000 7fa62f32d800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.259+0000 7fa62f32d800 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cf0a8d57c0 0x55cf0a8d7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.259+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d80f0 con 0x55cf0a8d57c0 2024-05-08T18:51:44.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.259+0000 7fa62b779640 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cf0a8d57c0 0x55cf0a8d7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.260+0000 7fa62b779640 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cf0a8d57c0 0x55cf0a8d7bb0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.260+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa62402a070 con 0x55cf0a8d57c0 2024-05-08T18:51:44.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.260+0000 7fa62f32d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:44.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.260+0000 7fa62f32d800 20 searching for the correct realm 2024-05-08T18:51:44.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.260+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x55cf0a8d57c0 2024-05-08T18:51:44.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.260+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62402a070 con 0x55cf0a8d57c0 2024-05-08T18:51:44.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.261+0000 7fa62b779640 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa624014070 0x7fa624015210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.261+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x7fa624014070 2024-05-08T18:51:44.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.261+0000 7fa62af78640 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa624014070 0x7fa624015210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.261+0000 7fa62af78640 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa624014070 0x7fa624015210 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.261+0000 7fa62af78640 1 -- 172.21.15.132:0/12535239 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61c02b070 con 0x7fa624014070 2024-05-08T18:51:44.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.261+0000 7fa62af78640 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa61c017050 0x7fa61c0227d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.261+0000 7fa62af78640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x7fa61c017050 2024-05-08T18:51:44.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.261+0000 7fa623fff640 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa61c017050 0x7fa61c0227d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.262+0000 7fa623fff640 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa61c017050 0x7fa61c0227d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.262+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61405a040 con 0x7fa61c017050 2024-05-08T18:51:44.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.262+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x55cf0a8d0db0 2024-05-08T18:51:44.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.262+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.262+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x55cf0a8d0db0 2024-05-08T18:51:44.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.263+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.263+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x7fa61c017050 2024-05-08T18:51:44.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.263+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61405a040 con 0x7fa61c017050 2024-05-08T18:51:44.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.263+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x7fa61c017050 2024-05-08T18:51:44.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.263+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61405a040 con 0x7fa61c017050 2024-05-08T18:51:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.263+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x7fa624014070 2024-05-08T18:51:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.263+0000 7fa62af78640 1 -- 172.21.15.132:0/12535239 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61c02b070 con 0x7fa624014070 2024-05-08T18:51:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.263+0000 7fa62af78640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x55cf0a8d57c0 2024-05-08T18:51:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.264+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa624061040 con 0x55cf0a8d57c0 2024-05-08T18:51:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.264+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x55cf0a8d0db0 2024-05-08T18:51:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.264+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.264+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x7fa61c017050 2024-05-08T18:51:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.264+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61405a040 con 0x7fa61c017050 2024-05-08T18:51:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.264+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x55cf0a8d0db0 2024-05-08T18:51:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.265+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.265+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x7fa624014070 2024-05-08T18:51:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.265+0000 7fa62af78640 1 -- 172.21.15.132:0/12535239 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa61c02b070 con 0x7fa624014070 2024-05-08T18:51:44.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.265+0000 7fa62af78640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x55cf0a8d57c0 2024-05-08T18:51:44.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.265+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa624061040 con 0x55cf0a8d57c0 2024-05-08T18:51:44.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.265+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x55cf0a8d57c0 2024-05-08T18:51:44.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.265+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa624061040 con 0x55cf0a8d57c0 2024-05-08T18:51:44.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.265+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x7fa61c017050 2024-05-08T18:51:44.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.266+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61405a040 con 0x7fa61c017050 2024-05-08T18:51:44.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.266+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x55cf0a8d57c0 2024-05-08T18:51:44.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.266+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa624061040 con 0x55cf0a8d57c0 2024-05-08T18:51:44.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.266+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x55cf0a8d57c0 2024-05-08T18:51:44.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.266+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa624061040 con 0x55cf0a8d57c0 2024-05-08T18:51:44.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.266+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x55cf0a8d0db0 2024-05-08T18:51:44.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.266+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.266+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x55cf0a8d0db0 2024-05-08T18:51:44.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.267+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.267+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x7fa61c017050 2024-05-08T18:51:44.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.267+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61405a040 con 0x7fa61c017050 2024-05-08T18:51:44.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.267+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x55cf0a8d57c0 2024-05-08T18:51:44.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.267+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa624061040 con 0x55cf0a8d57c0 2024-05-08T18:51:44.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.267+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x7fa624014070 2024-05-08T18:51:44.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.267+0000 7fa62af78640 1 -- 172.21.15.132:0/12535239 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61c02b070 con 0x7fa624014070 2024-05-08T18:51:44.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.267+0000 7fa62af78640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x55cf0a8d0db0 2024-05-08T18:51:44.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.268+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.268+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x7fa624014070 2024-05-08T18:51:44.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.268+0000 7fa62af78640 1 -- 172.21.15.132:0/12535239 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61c02b070 con 0x7fa624014070 2024-05-08T18:51:44.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.268+0000 7fa62af78640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x55cf0a8d57c0 2024-05-08T18:51:44.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.268+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa624061040 con 0x55cf0a8d57c0 2024-05-08T18:51:44.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.268+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x7fa61c017050 2024-05-08T18:51:44.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.269+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61405a040 con 0x7fa61c017050 2024-05-08T18:51:44.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.269+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x7fa624014070 2024-05-08T18:51:44.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.269+0000 7fa62af78640 1 -- 172.21.15.132:0/12535239 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61c02b070 con 0x7fa624014070 2024-05-08T18:51:44.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.269+0000 7fa62af78640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x55cf0a8d57c0 2024-05-08T18:51:44.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.269+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa624061040 con 0x55cf0a8d57c0 2024-05-08T18:51:44.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.269+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x7fa61c017050 2024-05-08T18:51:44.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.269+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61405a040 con 0x7fa61c017050 2024-05-08T18:51:44.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.269+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x55cf0a8d0db0 2024-05-08T18:51:44.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.270+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.270+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9a60 con 0x7fa624014070 2024-05-08T18:51:44.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.270+0000 7fa62af78640 1 -- 172.21.15.132:0/12535239 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa61c02b070 con 0x7fa624014070 2024-05-08T18:51:44.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.270+0000 7fa62f32d800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:44.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.270+0000 7fa62f32d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:44.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.270+0000 7fa62f32d800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:44.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.270+0000 7fa62f32d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:44.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.270+0000 7fa62f32d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:44.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.270+0000 7fa62f32d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:44.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.270+0000 7fa62f32d800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.270+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d8b30 con 0x55cf0a8d0db0 2024-05-08T18:51:44.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.270+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.270+0000 7fa62f32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.270+0000 7fa62f32d800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.270+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d8740 con 0x55cf0a8d0db0 2024-05-08T18:51:44.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.270+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.270+0000 7fa62f32d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:44.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.270+0000 7fa62f32d800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.270+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d8710 con 0x55cf0a8d0db0 2024-05-08T18:51:44.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.271+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.271+0000 7fa62f32d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:44.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.271+0000 7fa62f32d800 20 zone default found 2024-05-08T18:51:44.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.271+0000 7fa62f32d800 4 Realm: () 2024-05-08T18:51:44.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.271+0000 7fa62f32d800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:44.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.271+0000 7fa62f32d800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:44.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.271+0000 7fa62f32d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:44.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.271+0000 7fa62f32d800 20 zonegroup default 2024-05-08T18:51:44.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.271+0000 7fa62f32d800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.271+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d9470 con 0x7fa624014070 2024-05-08T18:51:44.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.271+0000 7fa62af78640 1 -- 172.21.15.132:0/12535239 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa61c02b070 con 0x7fa624014070 2024-05-08T18:51:44.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.271+0000 7fa62f32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.271+0000 7fa62f32d800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.271+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8d8fe0 con 0x55cf0a8d57c0 2024-05-08T18:51:44.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.271+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa624061040 con 0x55cf0a8d57c0 2024-05-08T18:51:44.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.271+0000 7fa62f32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.271+0000 7fa62f32d800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.271+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8dbee0 con 0x55cf0a8d57c0 2024-05-08T18:51:44.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.272+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa624061040 con 0x55cf0a8d57c0 2024-05-08T18:51:44.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.272+0000 7fa62f32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.272+0000 7fa62f32d800 20 started sync module instance, tier type = 2024-05-08T18:51:44.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.272+0000 7fa62f32d800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:44.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.272+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8db200 con 0x7fa624014070 2024-05-08T18:51:44.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.273+0000 7fa62af78640 1 -- 172.21.15.132:0/12535239 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61c02b070 con 0x7fa624014070 2024-05-08T18:51:44.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.273+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94347723648336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8dc340 con 0x7fa624014070 2024-05-08T18:51:44.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.273+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8dcb90 con 0x55cf0a8d0db0 2024-05-08T18:51:44.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.274+0000 7fa62af78640 1 -- 172.21.15.132:0/12535239 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94347723648336] v27'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61c02b070 con 0x7fa624014070 2024-05-08T18:51:44.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.274+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.274+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94347723654880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8dcfb0 con 0x55cf0a8d0db0 2024-05-08T18:51:44.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.274+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8dd800 con 0x55cf0a8d57c0 2024-05-08T18:51:44.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.275+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa624061040 con 0x55cf0a8d57c0 2024-05-08T18:51:44.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.275+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94347723657616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8ddcb0 con 0x55cf0a8d57c0 2024-05-08T18:51:44.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.275+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8de7d0 con 0x7fa624014070 2024-05-08T18:51:44.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.275+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94347723654880] v27'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.276+0000 7fa62af78640 1 -- 172.21.15.132:0/12535239 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61c02b070 con 0x7fa624014070 2024-05-08T18:51:44.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.276+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94347723661984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8de790 con 0x7fa624014070 2024-05-08T18:51:44.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.276+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94347723657616] v27'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa624061040 con 0x55cf0a8d57c0 2024-05-08T18:51:44.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.276+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8df250 con 0x55cf0a8d0db0 2024-05-08T18:51:44.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.277+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.277+0000 7fa62af78640 1 -- 172.21.15.132:0/12535239 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94347723661984] v27'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61c02b070 con 0x7fa624014070 2024-05-08T18:51:44.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.277+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94347723659072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8df250 con 0x55cf0a8d0db0 2024-05-08T18:51:44.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.277+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8dcb20 con 0x7fa61c017050 2024-05-08T18:51:44.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.278+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94347723659072] v27'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.279+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61405a040 con 0x7fa61c017050 2024-05-08T18:51:44.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.279+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94347723664736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8dcb20 con 0x7fa61c017050 2024-05-08T18:51:44.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.279+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8e0260 con 0x7fa61c017050 2024-05-08T18:51:44.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.280+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94347723664736] v27'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61405a040 con 0x7fa61c017050 2024-05-08T18:51:44.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.280+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61405a040 con 0x7fa61c017050 2024-05-08T18:51:44.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.280+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94347723667344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8e0260 con 0x7fa61c017050 2024-05-08T18:51:44.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.280+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8e0c20 con 0x7fa61c017050 2024-05-08T18:51:44.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.281+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(58 notify.7 [create] v27'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61405a040 con 0x7fa61c017050 2024-05-08T18:51:44.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.281+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94347723671408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8e1040 con 0x7fa61c017050 2024-05-08T18:51:44.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.281+0000 7fa62f32d800 20 add_watcher() i=0 2024-05-08T18:51:44.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.281+0000 7fa62f32d800 20 add_watcher() i=1 2024-05-08T18:51:44.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.281+0000 7fa62f32d800 20 add_watcher() i=2 2024-05-08T18:51:44.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.281+0000 7fa62f32d800 20 add_watcher() i=3 2024-05-08T18:51:44.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.281+0000 7fa62f32d800 20 add_watcher() i=4 2024-05-08T18:51:44.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.281+0000 7fa62f32d800 20 add_watcher() i=5 2024-05-08T18:51:44.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.281+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94347723667344] v27'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61405a040 con 0x7fa61c017050 2024-05-08T18:51:44.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.281+0000 7fa62f32d800 20 add_watcher() i=6 2024-05-08T18:51:44.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.282+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94347723671408] v27'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61405a040 con 0x7fa61c017050 2024-05-08T18:51:44.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.282+0000 7fa62f32d800 20 add_watcher() i=7 2024-05-08T18:51:44.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.282+0000 7fa62f32d800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:44.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.282+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8dfe00 con 0x55cf0a8d0db0 2024-05-08T18:51:44.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.282+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.282+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94347723672464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8dfe00 con 0x55cf0a8d0db0 2024-05-08T18:51:44.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.283+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94347723672464] v27'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.283+0000 7fa4e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:44.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.283+0000 7fa62f32d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:44.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.283+0000 7fa62f32d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:44.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.283+0000 7fa62f32d800 5 note: GC not initialized 2024-05-08T18:51:44.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.283+0000 7fa45bfff640 20 reqs_thread_entry: start 2024-05-08T18:51:44.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.283+0000 7fa62f32d800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:44.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.284+0000 7fa62f32d800 20 Filter name: none 2024-05-08T18:51:44.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.284+0000 7fa459ffb640 20 reqs_thread_entry: start 2024-05-08T18:51:44.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.284+0000 7fa62f32d800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.284+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a917120 con 0x55cf0a8d0db0 2024-05-08T18:51:44.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.284+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.284+0000 7fa62f32d800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:51:44.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.284+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a918510 con 0x7fa61c017050 2024-05-08T18:51:44.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.285+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fa61405a040 con 0x7fa61c017050 2024-05-08T18:51:44.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.286+0000 7fa4e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:44.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.286+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94347723672464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a915880 con 0x55cf0a8d0db0 2024-05-08T18:51:44.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.287+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94347723672464] v27'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.287+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94347723648336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8e0b90 con 0x7fa624014070 2024-05-08T18:51:44.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.287+0000 7fa62af78640 1 -- 172.21.15.132:0/12535239 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94347723648336] v27'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61c02b070 con 0x7fa624014070 2024-05-08T18:51:44.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.288+0000 7fa62f32d800 20 remove_watcher() i=0 2024-05-08T18:51:44.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.288+0000 7fa62f32d800 2 removed watcher, disabling cache 2024-05-08T18:51:44.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.288+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94347723654880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8e0b90 con 0x55cf0a8d0db0 2024-05-08T18:51:44.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.289+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94347723654880] v27'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.289+0000 7fa62f32d800 20 remove_watcher() i=1 2024-05-08T18:51:44.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.289+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94347723657616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8dc6e0 con 0x55cf0a8d57c0 2024-05-08T18:51:44.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.290+0000 7fa62b779640 1 -- 172.21.15.132:0/12535239 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94347723657616] v27'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa624061040 con 0x55cf0a8d57c0 2024-05-08T18:51:44.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.290+0000 7fa62f32d800 20 remove_watcher() i=2 2024-05-08T18:51:44.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.290+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94347723661984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8e0b90 con 0x7fa624014070 2024-05-08T18:51:44.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.291+0000 7fa62af78640 1 -- 172.21.15.132:0/12535239 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94347723661984] v27'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61c02b070 con 0x7fa624014070 2024-05-08T18:51:44.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.291+0000 7fa62f32d800 20 remove_watcher() i=3 2024-05-08T18:51:44.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.291+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94347723659072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8dc6e0 con 0x55cf0a8d0db0 2024-05-08T18:51:44.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.292+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94347723659072] v27'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61405a040 con 0x55cf0a8d0db0 2024-05-08T18:51:44.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.292+0000 7fa62f32d800 20 remove_watcher() i=4 2024-05-08T18:51:44.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.292+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94347723664736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8de2a0 con 0x7fa61c017050 2024-05-08T18:51:44.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.293+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94347723664736] v27'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61405a040 con 0x7fa61c017050 2024-05-08T18:51:44.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.293+0000 7fa62f32d800 20 remove_watcher() i=5 2024-05-08T18:51:44.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.293+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94347723667344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8e0b90 con 0x7fa61c017050 2024-05-08T18:51:44.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.294+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94347723667344] v27'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61405a040 con 0x7fa61c017050 2024-05-08T18:51:44.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.294+0000 7fa62f32d800 20 remove_watcher() i=6 2024-05-08T18:51:44.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.294+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94347723671408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cf0a8dd740 con 0x7fa61c017050 2024-05-08T18:51:44.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.295+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94347723671408] v27'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa61405a040 con 0x7fa61c017050 2024-05-08T18:51:44.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.295+0000 7fa62f32d800 20 remove_watcher() i=7 2024-05-08T18:51:44.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.295+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa61c017050 msgr2=0x7fa61c0227d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.295+0000 7fa62f32d800 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa61c017050 0x7fa61c0227d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.295+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cf0a8d0db0 msgr2=0x55cf0a8d3270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.295+0000 7fa62f32d800 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cf0a8d0db0 0x55cf0a8d3270 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa624014070 msgr2=0x7fa624015210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa624014070 0x7fa624015210 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cf0a8d57c0 msgr2=0x55cf0a8d7bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cf0a8d57c0 0x55cf0a8d7bb0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa4f403bb50 msgr2=0x7fa4f403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa4f403bb50 0x7fa4f403e010 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa61c02cb20 tx=0x7fa61c025000 comp rx=0 tx=0).stop 2024-05-08T18:51:44.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a8bdcc0 msgr2=0x55cf0a8c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa623fff640 1 -- 172.21.15.132:0/12535239 reap_dead start 2024-05-08T18:51:44.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a8bdcc0 0x55cf0a8c52b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa624014fd0 tx=0x7fa624052be0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 shutdown_connections 2024-05-08T18:51:44.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 --2- 172.21.15.132:0/12535239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a8bdcc0 0x55cf0a8c52b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 >> 172.21.15.132:0/12535239 conn(0x55cf0a8b9fd0 msgr2=0x55cf0a8b7630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 shutdown_connections 2024-05-08T18:51:44.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 -- 172.21.15.132:0/12535239 wait complete. 2024-05-08T18:51:44.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 -- 172.21.15.132:0/2528890357 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa50403bba0 msgr2=0x7fa50403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 --2- 172.21.15.132:0/2528890357 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa50403bba0 0x7fa50403e060 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55cf0a89d110 tx=0x7fa61c001520 comp rx=0 tx=0).stop 2024-05-08T18:51:44.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 -- 172.21.15.132:0/2528890357 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a8b0a20 msgr2=0x55cf0a8b0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 --2- 172.21.15.132:0/2528890357 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a8b0a20 0x55cf0a8b0e40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x55cf0a89d070 tx=0x7fa624018830 comp rx=0 tx=0).stop 2024-05-08T18:51:44.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 -- 172.21.15.132:0/2528890357 shutdown_connections 2024-05-08T18:51:44.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 --2- 172.21.15.132:0/2528890357 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa50403bba0 0x7fa50403e060 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 --2- 172.21.15.132:0/2528890357 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a8b0a20 0x55cf0a8b0e40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 -- 172.21.15.132:0/2528890357 >> 172.21.15.132:0/2528890357 conn(0x55cf0a8a4ac0 msgr2=0x55cf0a8a4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 -- 172.21.15.132:0/2528890357 shutdown_connections 2024-05-08T18:51:44.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 -- 172.21.15.132:0/2528890357 wait complete. 2024-05-08T18:51:44.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 -- 172.21.15.132:0/1785322252 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cf0a79a6b0 msgr2=0x55cf0a89c730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 --2- 172.21.15.132:0/1785322252 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cf0a79a6b0 0x55cf0a89c730 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 -- 172.21.15.132:0/1785322252 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cf0a89efc0 msgr2=0x55cf0a8a13b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.296+0000 7fa62f32d800 1 --2- 172.21.15.132:0/1785322252 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cf0a89efc0 0x55cf0a8a13b0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.297+0000 7fa62f32d800 1 -- 172.21.15.132:0/1785322252 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa51003bb50 msgr2=0x7fa51003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.297+0000 7fa62f32d800 1 --2- 172.21.15.132:0/1785322252 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa51003bb50 0x7fa51003e010 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa614054000 tx=0x7fa61404e000 comp rx=0 tx=0).stop 2024-05-08T18:51:44.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.297+0000 7fa62f32d800 1 -- 172.21.15.132:0/1785322252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a798b70 msgr2=0x55cf0a8954f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.297+0000 7fa62f32d800 1 --2- 172.21.15.132:0/1785322252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a798b70 0x55cf0a8954f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00c010 tx=0x7fa61c000ed0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.297+0000 7fa62f32d800 1 -- 172.21.15.132:0/1785322252 shutdown_connections 2024-05-08T18:51:44.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.297+0000 7fa62f32d800 1 --2- 172.21.15.132:0/1785322252 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55cf0a89efc0 0x55cf0a8a13b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.297+0000 7fa62f32d800 1 --2- 172.21.15.132:0/1785322252 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55cf0a79a6b0 0x55cf0a89c730 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.297+0000 7fa62f32d800 1 --2- 172.21.15.132:0/1785322252 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa51003bb50 0x7fa51003e010 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.297+0000 7fa62f32d800 1 --2- 172.21.15.132:0/1785322252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55cf0a798b70 0x55cf0a8954f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.297+0000 7fa62f32d800 1 -- 172.21.15.132:0/1785322252 >> 172.21.15.132:0/1785322252 conn(0x55cf0a7946b0 msgr2=0x55cf0a887ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.297+0000 7fa62f32d800 1 -- 172.21.15.132:0/1785322252 shutdown_connections 2024-05-08T18:51:44.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.297+0000 7fa62f32d800 1 -- 172.21.15.132:0/1785322252 wait complete. 2024-05-08T18:51:44.311 INFO:teuthology.orchestra.run.smithi132.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}],"s3select":{}},{"bucket":"myfoo2","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-08T18:51:44.311 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:51:44.312 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-05-08T18:51:44.312 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-05-08T18:51:44.312 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-05-08T18:51:44.358 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:44.358 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:44.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.360+0000 7fa239719800 1 Processor -- start 2024-05-08T18:51:44.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.360+0000 7fa239719800 1 -- start start 2024-05-08T18:51:44.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.360+0000 7fa239719800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55a693d53650 0x55a693d53a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.360+0000 7fa239719800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a693d540f0 con 0x55a693d543d0 2024-05-08T18:51:44.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.360+0000 7fa239719800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55a693bf4e20 con 0x55a693d53650 2024-05-08T18:51:44.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.360+0000 7fa237211640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55a693d53650 0x55a693d53a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.360+0000 7fa237211640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55a693d53650 0x55a693d53a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56374/0 (socket says 172.21.15.132:56374) 2024-05-08T18:51:44.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.360+0000 7fa22ffff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55a693d543d0 0x55a693d54880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:49038/0 (socket says 172.21.15.132:49038) 2024-05-08T18:51:44.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.360+0000 7fa237211640 1 -- 172.21.15.132:0/120645610 learned_addr learned my addr 172.21.15.132:0/120645610 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.361+0000 7fa237211640 1 -- 172.21.15.132:0/120645610 >> v1:172.21.15.42:6789/0 conn(0x55a693d543d0 legacy=0x55a693d54880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.361+0000 7fa237211640 1 -- 172.21.15.132:0/120645610 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a693d54f90 con 0x55a693d53650 2024-05-08T18:51:44.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.362+0000 7fa237211640 1 --2- 172.21.15.132:0/120645610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693d53650 0x55a693d53a70 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa22800a520 tx=0x7fa22801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4e9b637240ab3a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.363+0000 7fa236a10640 1 -- 172.21.15.132:0/120645610 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa228057070 con 0x55a693d53650 2024-05-08T18:51:44.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.363+0000 7fa236a10640 1 -- 172.21.15.132:0/120645610 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa228052570 con 0x55a693d53650 2024-05-08T18:51:44.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.363+0000 7fa236a10640 1 -- 172.21.15.132:0/120645610 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa228052870 con 0x55a693d53650 2024-05-08T18:51:44.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.363+0000 7fa239719800 1 -- 172.21.15.132:0/120645610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693d53650 msgr2=0x55a693d53a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.363+0000 7fa239719800 1 --2- 172.21.15.132:0/120645610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693d53650 0x55a693d53a70 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa22800a520 tx=0x7fa22801d010 comp rx=0 tx=0).stop 2024-05-08T18:51:44.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.363+0000 7fa239719800 1 -- 172.21.15.132:0/120645610 shutdown_connections 2024-05-08T18:51:44.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.363+0000 7fa239719800 1 --2- 172.21.15.132:0/120645610 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693d53650 0x55a693d53a70 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.363+0000 7fa239719800 1 -- 172.21.15.132:0/120645610 >> 172.21.15.132:0/120645610 conn(0x55a693d4deb0 msgr2=0x55a693d502d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.363+0000 7fa239719800 1 -- 172.21.15.132:0/120645610 shutdown_connections 2024-05-08T18:51:44.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.363+0000 7fa239719800 1 -- 172.21.15.132:0/120645610 wait complete. 2024-05-08T18:51:44.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.377+0000 7fa239719800 1 Processor -- start 2024-05-08T18:51:44.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.377+0000 7fa239719800 1 -- start start 2024-05-08T18:51:44.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.378+0000 7fa239719800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693d53650 0x55a693d52d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.378+0000 7fa239719800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a693c9f5c0 con 0x55a693d53650 2024-05-08T18:51:44.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.378+0000 7fa237211640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693d53650 0x55a693d52d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.378+0000 7fa237211640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693d53650 0x55a693d52d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56388/0 (socket says 172.21.15.132:56388) 2024-05-08T18:51:44.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.378+0000 7fa237211640 1 -- 172.21.15.132:0/2705530902 learned_addr learned my addr 172.21.15.132:0/2705530902 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.378+0000 7fa237211640 1 -- 172.21.15.132:0/2705530902 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a693e484c0 con 0x55a693d53650 2024-05-08T18:51:44.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.378+0000 7fa237211640 1 --2- 172.21.15.132:0/2705530902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693d53650 0x55a693d52d50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa228055040 tx=0x7fa22804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e57f5fda8503154 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.379+0000 7fa12560a640 1 -- 172.21.15.132:0/2705530902 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa228057040 con 0x55a693d53650 2024-05-08T18:51:44.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.379+0000 7fa12560a640 1 -- 172.21.15.132:0/2705530902 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa228052850 con 0x55a693d53650 2024-05-08T18:51:44.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.379+0000 7fa12560a640 1 -- 172.21.15.132:0/2705530902 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa228052b50 con 0x55a693d53650 2024-05-08T18:51:44.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.379+0000 7fa239719800 1 -- 172.21.15.132:0/2705530902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693d53650 msgr2=0x55a693d52d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.379+0000 7fa239719800 1 --2- 172.21.15.132:0/2705530902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693d53650 0x55a693d52d50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa228055040 tx=0x7fa22804c000 comp rx=0 tx=0).stop 2024-05-08T18:51:44.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.379+0000 7fa239719800 1 -- 172.21.15.132:0/2705530902 shutdown_connections 2024-05-08T18:51:44.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.379+0000 7fa239719800 1 --2- 172.21.15.132:0/2705530902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693d53650 0x55a693d52d50 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.379+0000 7fa239719800 1 -- 172.21.15.132:0/2705530902 >> 172.21.15.132:0/2705530902 conn(0x55a693d4deb0 msgr2=0x55a693e3ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.380+0000 7fa239719800 1 -- 172.21.15.132:0/2705530902 shutdown_connections 2024-05-08T18:51:44.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.380+0000 7fa239719800 1 -- 172.21.15.132:0/2705530902 wait complete. 2024-05-08T18:51:44.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.380+0000 7fa239719800 1 Processor -- start 2024-05-08T18:51:44.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.380+0000 7fa239719800 1 -- start start 2024-05-08T18:51:44.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.380+0000 7fa239719800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693d53650 0x55a693e4d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.380+0000 7fa239719800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a693d5c8a0 con 0x55a693d53650 2024-05-08T18:51:44.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.380+0000 7fa237211640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693d53650 0x55a693e4d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.380+0000 7fa237211640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693d53650 0x55a693e4d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56396/0 (socket says 172.21.15.132:56396) 2024-05-08T18:51:44.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.380+0000 7fa237211640 1 -- 172.21.15.132:0/817540446 learned_addr learned my addr 172.21.15.132:0/817540446 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.381+0000 7fa237211640 1 -- 172.21.15.132:0/817540446 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a693e4d760 con 0x55a693d53650 2024-05-08T18:51:44.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.381+0000 7fa237211640 1 --2- 172.21.15.132:0/817540446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693d53650 0x55a693e4d220 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa22800a520 tx=0x7fa228003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.381+0000 7fa123e07640 1 -- 172.21.15.132:0/817540446 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa228073070 con 0x55a693d53650 2024-05-08T18:51:44.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.381+0000 7fa123e07640 1 -- 172.21.15.132:0/817540446 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa22805d570 con 0x55a693d53650 2024-05-08T18:51:44.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.381+0000 7fa123e07640 1 -- 172.21.15.132:0/817540446 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa228057070 con 0x55a693d53650 2024-05-08T18:51:44.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.381+0000 7fa239719800 1 -- 172.21.15.132:0/817540446 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a693e4d9f0 con 0x55a693d53650 2024-05-08T18:51:44.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.381+0000 7fa239719800 1 -- 172.21.15.132:0/817540446 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a693e506a0 con 0x55a693d53650 2024-05-08T18:51:44.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.382+0000 7fa123e07640 1 -- 172.21.15.132:0/817540446 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa228076070 con 0x55a693d53650 2024-05-08T18:51:44.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.382+0000 7fa123e07640 1 --2- 172.21.15.132:0/817540446 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa11c03bb50 0x7fa11c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.382+0000 7fa123e07640 1 -- 172.21.15.132:0/817540446 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fa228094020 con 0x55a693d53650 2024-05-08T18:51:44.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.382+0000 7fa22ffff640 1 --2- 172.21.15.132:0/817540446 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa11c03bb50 0x7fa11c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.383+0000 7fa239719800 1 --2- 172.21.15.132:0/817540446 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a693d543d0 0x55a693e54460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.383+0000 7fa239719800 1 -- 172.21.15.132:0/817540446 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a693e549a0 con 0x55a693d543d0 2024-05-08T18:51:44.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.383+0000 7fa237a12640 1 --2- 172.21.15.132:0/817540446 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a693d543d0 0x55a693e54460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.386 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.383+0000 7fa22ffff640 1 --2- 172.21.15.132:0/817540446 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa11c03bb50 0x7fa11c03e010 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa220000f60 tx=0x7fa220001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.383+0000 7fa237a12640 1 --2- 172.21.15.132:0/817540446 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a693d543d0 0x55a693e54460 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.383+0000 7fa237a12640 1 -- 172.21.15.132:0/817540446 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa23000a4a0 con 0x55a693d543d0 2024-05-08T18:51:44.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.383+0000 7fa239719800 1 -- 172.21.15.132:0/817540446 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a693e51a30 con 0x55a693d543d0 2024-05-08T18:51:44.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.383+0000 7fa237a12640 1 -- 172.21.15.132:0/817540446 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa23000a4a0 con 0x55a693d543d0 2024-05-08T18:51:44.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.384+0000 7fa239719800 1 --2- 172.21.15.132:0/817540446 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a693e56cb0 0x55a693e590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.384+0000 7fa239719800 1 -- 172.21.15.132:0/817540446 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a693e59790 con 0x55a693e56cb0 2024-05-08T18:51:44.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.384+0000 7fa237211640 1 --2- 172.21.15.132:0/817540446 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a693e56cb0 0x55a693e590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.384+0000 7fa237211640 1 --2- 172.21.15.132:0/817540446 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a693e56cb0 0x55a693e590a0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.384+0000 7fa237211640 1 -- 172.21.15.132:0/817540446 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa228075030 con 0x55a693e56cb0 2024-05-08T18:51:44.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.384+0000 7fa239719800 1 -- 172.21.15.132:0/817540446 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a693e55b50 con 0x55a693d543d0 2024-05-08T18:51:44.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.384+0000 7fa237a12640 1 -- 172.21.15.132:0/817540446 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa23000a4a0 con 0x55a693d543d0 2024-05-08T18:51:44.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.384+0000 7fa239719800 1 -- 172.21.15.132:0/817540446 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a693e56030 con 0x55a693d543d0 2024-05-08T18:51:44.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.385+0000 7fa237a12640 1 -- 172.21.15.132:0/817540446 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa23000a4a0 con 0x55a693d543d0 2024-05-08T18:51:44.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.385+0000 7fa239719800 1 Processor -- start 2024-05-08T18:51:44.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.385+0000 7fa239719800 1 -- start start 2024-05-08T18:51:44.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.385+0000 7fa239719800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693e46070 0x55a693e444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.385+0000 7fa239719800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a693c45fc0 con 0x55a693e46070 2024-05-08T18:51:44.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.386+0000 7fa237a12640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693e46070 0x55a693e444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.386+0000 7fa237a12640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693e46070 0x55a693e444e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56398/0 (socket says 172.21.15.132:56398) 2024-05-08T18:51:44.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.386+0000 7fa237a12640 1 -- 172.21.15.132:0/3379428954 learned_addr learned my addr 172.21.15.132:0/3379428954 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.386+0000 7fa237a12640 1 -- 172.21.15.132:0/3379428954 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a693e44a20 con 0x55a693e46070 2024-05-08T18:51:44.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.386+0000 7fa237a12640 1 --2- 172.21.15.132:0/3379428954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693e46070 0x55a693e444e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x55a693e54d60 tx=0x7fa230018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.386+0000 7fa121602640 1 -- 172.21.15.132:0/3379428954 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa230014450 con 0x55a693e46070 2024-05-08T18:51:44.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.386+0000 7fa121602640 1 -- 172.21.15.132:0/3379428954 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa230014610 con 0x55a693e46070 2024-05-08T18:51:44.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.386+0000 7fa121602640 1 -- 172.21.15.132:0/3379428954 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa230014930 con 0x55a693e46070 2024-05-08T18:51:44.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.386+0000 7fa239719800 1 -- 172.21.15.132:0/3379428954 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a693e44cb0 con 0x55a693e46070 2024-05-08T18:51:44.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.386+0000 7fa239719800 1 -- 172.21.15.132:0/3379428954 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a693e451b0 con 0x55a693e46070 2024-05-08T18:51:44.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.387+0000 7fa121602640 1 -- 172.21.15.132:0/3379428954 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa230011040 con 0x55a693e46070 2024-05-08T18:51:44.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.388+0000 7fa121602640 1 --2- 172.21.15.132:0/3379428954 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa11003bba0 0x7fa11003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.388+0000 7fa121602640 1 -- 172.21.15.132:0/3379428954 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fa23001e070 con 0x55a693e46070 2024-05-08T18:51:44.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.388+0000 7fa237211640 1 --2- 172.21.15.132:0/3379428954 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa11003bba0 0x7fa11003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.388+0000 7fa239719800 1 Processor -- start 2024-05-08T18:51:44.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.388+0000 7fa237211640 1 --2- 172.21.15.132:0/3379428954 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa11003bba0 0x7fa11003e060 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55a693e54e00 tx=0x7fa228066750 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.388+0000 7fa239719800 1 -- start start 2024-05-08T18:51:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.388+0000 7fa239719800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693e77b70 0x55a693e77f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.388+0000 7fa239719800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a693e48750 con 0x55a693e77b70 2024-05-08T18:51:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.388+0000 7fa237a12640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693e77b70 0x55a693e77f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.388+0000 7fa237a12640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693e77b70 0x55a693e77f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56400/0 (socket says 172.21.15.132:56400) 2024-05-08T18:51:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.388+0000 7fa237a12640 1 -- 172.21.15.132:0/706524053 learned_addr learned my addr 172.21.15.132:0/706524053 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.389+0000 7fa237a12640 1 -- 172.21.15.132:0/706524053 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a693e78560 con 0x55a693e77b70 2024-05-08T18:51:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.389+0000 7fa237a12640 1 --2- 172.21.15.132:0/706524053 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693e77b70 0x55a693e77f90 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa230052c50 tx=0x7fa2300118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca443cfd6317658 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.389+0000 7fa11affd640 1 -- 172.21.15.132:0/706524053 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa230001310 con 0x55a693e77b70 2024-05-08T18:51:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.389+0000 7fa11affd640 1 -- 172.21.15.132:0/706524053 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa230047070 con 0x55a693e77b70 2024-05-08T18:51:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.389+0000 7fa11affd640 1 -- 172.21.15.132:0/706524053 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2300168f0 con 0x55a693e77b70 2024-05-08T18:51:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.389+0000 7fa239719800 1 -- 172.21.15.132:0/706524053 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693e77b70 msgr2=0x55a693e77f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.389+0000 7fa239719800 1 --2- 172.21.15.132:0/706524053 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693e77b70 0x55a693e77f90 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa230052c50 tx=0x7fa2300118e0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.389+0000 7fa239719800 1 -- 172.21.15.132:0/706524053 shutdown_connections 2024-05-08T18:51:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.389+0000 7fa239719800 1 --2- 172.21.15.132:0/706524053 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693e77b70 0x55a693e77f90 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.389+0000 7fa239719800 1 -- 172.21.15.132:0/706524053 >> 172.21.15.132:0/706524053 conn(0x55a693e73e80 msgr2=0x55a693e71f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.389+0000 7fa239719800 1 -- 172.21.15.132:0/706524053 shutdown_connections 2024-05-08T18:51:44.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.389+0000 7fa239719800 1 -- 172.21.15.132:0/706524053 wait complete. 2024-05-08T18:51:44.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.390+0000 7fa239719800 1 Processor -- start 2024-05-08T18:51:44.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.390+0000 7fa239719800 1 -- start start 2024-05-08T18:51:44.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.390+0000 7fa239719800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693e77b70 0x55a693e7f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.390+0000 7fa239719800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a693e78cd0 con 0x55a693e77b70 2024-05-08T18:51:44.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.390+0000 7fa237a12640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693e77b70 0x55a693e7f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.390+0000 7fa237a12640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693e77b70 0x55a693e7f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56416/0 (socket says 172.21.15.132:56416) 2024-05-08T18:51:44.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.390+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 learned_addr learned my addr 172.21.15.132:0/1472004709 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.390+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a693e7f690 con 0x55a693e77b70 2024-05-08T18:51:44.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.391+0000 7fa237a12640 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693e77b70 0x55a693e7f150 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa230011920 tx=0x7fa230052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.391+0000 7fa1197fa640 1 -- 172.21.15.132:0/1472004709 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa23004b620 con 0x55a693e77b70 2024-05-08T18:51:44.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.391+0000 7fa1197fa640 1 -- 172.21.15.132:0/1472004709 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa23004b7c0 con 0x55a693e77b70 2024-05-08T18:51:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.391+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a693e7f920 con 0x55a693e77b70 2024-05-08T18:51:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.391+0000 7fa1197fa640 1 -- 172.21.15.132:0/1472004709 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa230054070 con 0x55a693e77b70 2024-05-08T18:51:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.391+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a693e825d0 con 0x55a693e77b70 2024-05-08T18:51:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.392+0000 7fa1197fa640 1 -- 172.21.15.132:0/1472004709 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fa230054210 con 0x55a693e77b70 2024-05-08T18:51:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.392+0000 7fa1197fa640 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa10003bba0 0x7fa10003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.392+0000 7fa1197fa640 1 -- 172.21.15.132:0/1472004709 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fa23000e040 con 0x55a693e77b70 2024-05-08T18:51:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.392+0000 7fa237211640 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa10003bba0 0x7fa10003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.392+0000 7fa239719800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.392+0000 7fa239719800 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a693e8ad30 0x55a693e8d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.392+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a693e8d920 con 0x55a693e8ad30 2024-05-08T18:51:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.392+0000 7fa22ffff640 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a693e8ad30 0x55a693e8d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.393+0000 7fa237211640 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa10003bba0 0x7fa10003e060 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa228066f90 tx=0x7fa22807f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.393+0000 7fa22ffff640 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a693e8ad30 0x55a693e8d1d0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.393+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa22000f610 con 0x55a693e8ad30 2024-05-08T18:51:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.393+0000 7fa239719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.393+0000 7fa239719800 20 realm 2024-05-08T18:51:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.393+0000 7fa239719800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.393+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a693e8a290 con 0x55a693e8ad30 2024-05-08T18:51:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.393+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa22000f610 con 0x55a693e8ad30 2024-05-08T18:51:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.393+0000 7fa239719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.393+0000 7fa239719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.393+0000 7fa239719800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.393+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a693e8e470 con 0x55a693e8ad30 2024-05-08T18:51:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.393+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa22000f610 con 0x55a693e8ad30 2024-05-08T18:51:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.393+0000 7fa239719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.393+0000 7fa239719800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.393+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a693e8ed40 con 0x55a693e8ad30 2024-05-08T18:51:44.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.394+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa22000f610 con 0x55a693e8ad30 2024-05-08T18:51:44.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.394+0000 7fa239719800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:44.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.394+0000 7fa239719800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.394+0000 7fa239719800 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a693e8f640 0x55a693e91a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.394+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a693e92170 con 0x55a693e8f640 2024-05-08T18:51:44.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.394+0000 7fa237a12640 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a693e8f640 0x55a693e91a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.394+0000 7fa237a12640 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a693e8f640 0x55a693e91a30 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.394+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa23005d040 con 0x55a693e8f640 2024-05-08T18:51:44.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.394+0000 7fa239719800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:44.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.394+0000 7fa239719800 20 searching for the correct realm 2024-05-08T18:51:44.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.394+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x55a693e8f640 2024-05-08T18:51:44.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.395+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa23005d040 con 0x55a693e8f640 2024-05-08T18:51:44.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.395+0000 7fa237a12640 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa230014070 0x7fa2300548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.395+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x7fa230014070 2024-05-08T18:51:44.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.395+0000 7fa237211640 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa230014070 0x7fa2300548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.395+0000 7fa237211640 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa230014070 0x7fa2300548d0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.396+0000 7fa237211640 1 -- 172.21.15.132:0/1472004709 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa228075030 con 0x7fa230014070 2024-05-08T18:51:44.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.396+0000 7fa237211640 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa2280a1040 0x7fa22805c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.396+0000 7fa237211640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x7fa2280a1040 2024-05-08T18:51:44.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.396+0000 7fa22ffff640 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa2280a1040 0x7fa22805c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.396+0000 7fa22ffff640 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa2280a1040 0x7fa22805c910 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.397+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa22000f610 con 0x7fa2280a1040 2024-05-08T18:51:44.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.397+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x55a693e8ad30 2024-05-08T18:51:44.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.397+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa22000f610 con 0x55a693e8ad30 2024-05-08T18:51:44.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.397+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x55a693e8ad30 2024-05-08T18:51:44.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.397+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa22002b040 con 0x55a693e8ad30 2024-05-08T18:51:44.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.397+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x7fa2280a1040 2024-05-08T18:51:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.397+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa22002b040 con 0x7fa2280a1040 2024-05-08T18:51:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.397+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x7fa2280a1040 2024-05-08T18:51:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.398+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa22002b040 con 0x7fa2280a1040 2024-05-08T18:51:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.398+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x7fa230014070 2024-05-08T18:51:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.398+0000 7fa237211640 1 -- 172.21.15.132:0/1472004709 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa228075030 con 0x7fa230014070 2024-05-08T18:51:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.398+0000 7fa237211640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x55a693e8f640 2024-05-08T18:51:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.398+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa23005d040 con 0x55a693e8f640 2024-05-08T18:51:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.398+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x55a693e8ad30 2024-05-08T18:51:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.398+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa22002b040 con 0x55a693e8ad30 2024-05-08T18:51:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.398+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x7fa2280a1040 2024-05-08T18:51:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.399+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa22002b040 con 0x7fa2280a1040 2024-05-08T18:51:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.399+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x55a693e8ad30 2024-05-08T18:51:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.399+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa22002b040 con 0x55a693e8ad30 2024-05-08T18:51:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.399+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x7fa230014070 2024-05-08T18:51:44.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.399+0000 7fa237211640 1 -- 172.21.15.132:0/1472004709 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa228075030 con 0x7fa230014070 2024-05-08T18:51:44.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.399+0000 7fa237211640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x55a693e8f640 2024-05-08T18:51:44.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.399+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa23005d040 con 0x55a693e8f640 2024-05-08T18:51:44.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.399+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x55a693e8f640 2024-05-08T18:51:44.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.400+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa23005d040 con 0x55a693e8f640 2024-05-08T18:51:44.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.400+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x7fa2280a1040 2024-05-08T18:51:44.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.400+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa22002b040 con 0x7fa2280a1040 2024-05-08T18:51:44.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.400+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x55a693e8f640 2024-05-08T18:51:44.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.400+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa23005d040 con 0x55a693e8f640 2024-05-08T18:51:44.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.400+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x55a693e8f640 2024-05-08T18:51:44.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.400+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa23005d040 con 0x55a693e8f640 2024-05-08T18:51:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.400+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x55a693e8ad30 2024-05-08T18:51:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.401+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa22002b040 con 0x55a693e8ad30 2024-05-08T18:51:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.401+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x55a693e8ad30 2024-05-08T18:51:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.401+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa22002b040 con 0x55a693e8ad30 2024-05-08T18:51:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.401+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x7fa2280a1040 2024-05-08T18:51:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.401+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa22002b040 con 0x7fa2280a1040 2024-05-08T18:51:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.401+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x55a693e8f640 2024-05-08T18:51:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.402+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa23005d040 con 0x55a693e8f640 2024-05-08T18:51:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.402+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x7fa230014070 2024-05-08T18:51:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.402+0000 7fa237211640 1 -- 172.21.15.132:0/1472004709 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa228075030 con 0x7fa230014070 2024-05-08T18:51:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.402+0000 7fa237211640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x55a693e8ad30 2024-05-08T18:51:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.402+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa22002b040 con 0x55a693e8ad30 2024-05-08T18:51:44.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.402+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x7fa230014070 2024-05-08T18:51:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.402+0000 7fa237211640 1 -- 172.21.15.132:0/1472004709 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa228075030 con 0x7fa230014070 2024-05-08T18:51:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.402+0000 7fa237211640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x55a693e8f640 2024-05-08T18:51:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.402+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa23005d040 con 0x55a693e8f640 2024-05-08T18:51:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.402+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x7fa2280a1040 2024-05-08T18:51:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.403+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa22002b040 con 0x7fa2280a1040 2024-05-08T18:51:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.403+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x7fa230014070 2024-05-08T18:51:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.403+0000 7fa237211640 1 -- 172.21.15.132:0/1472004709 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa228075030 con 0x7fa230014070 2024-05-08T18:51:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.403+0000 7fa237211640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x55a693e8f640 2024-05-08T18:51:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.403+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa23005d040 con 0x55a693e8f640 2024-05-08T18:51:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.403+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x7fa2280a1040 2024-05-08T18:51:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.404+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa22002b040 con 0x7fa2280a1040 2024-05-08T18:51:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.404+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x55a693e8ad30 2024-05-08T18:51:44.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.404+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa22002b040 con 0x55a693e8ad30 2024-05-08T18:51:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.404+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93b40 con 0x7fa230014070 2024-05-08T18:51:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.404+0000 7fa237211640 1 -- 172.21.15.132:0/1472004709 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa228075030 con 0x7fa230014070 2024-05-08T18:51:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.404+0000 7fa239719800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.404+0000 7fa239719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.404+0000 7fa239719800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.404+0000 7fa239719800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.404+0000 7fa239719800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.404+0000 7fa239719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.404+0000 7fa239719800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.404+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a693e92c10 con 0x55a693e8ad30 2024-05-08T18:51:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.404+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa22002b040 con 0x55a693e8ad30 2024-05-08T18:51:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.404+0000 7fa239719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.404+0000 7fa239719800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.404+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a693e92850 con 0x55a693e8ad30 2024-05-08T18:51:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.405+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa22002b040 con 0x55a693e8ad30 2024-05-08T18:51:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.405+0000 7fa239719800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.405+0000 7fa239719800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.405+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93530 con 0x55a693e8ad30 2024-05-08T18:51:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.405+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa22002b040 con 0x55a693e8ad30 2024-05-08T18:51:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.405+0000 7fa239719800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.405+0000 7fa239719800 20 zone default found 2024-05-08T18:51:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.405+0000 7fa239719800 4 Realm: () 2024-05-08T18:51:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.405+0000 7fa239719800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.405+0000 7fa239719800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.405+0000 7fa239719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.405+0000 7fa239719800 20 zonegroup default 2024-05-08T18:51:44.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.405+0000 7fa239719800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.405+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a693e93130 con 0x7fa230014070 2024-05-08T18:51:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.405+0000 7fa237211640 1 -- 172.21.15.132:0/1472004709 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa228075030 con 0x7fa230014070 2024-05-08T18:51:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.405+0000 7fa239719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.405+0000 7fa239719800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.405+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a693e963d0 con 0x55a693e8f640 2024-05-08T18:51:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.405+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa23005d040 con 0x55a693e8f640 2024-05-08T18:51:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.405+0000 7fa239719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.406+0000 7fa239719800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.406+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a693e96770 con 0x55a693e8f640 2024-05-08T18:51:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.406+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa23005d040 con 0x55a693e8f640 2024-05-08T18:51:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.406+0000 7fa239719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.406+0000 7fa239719800 20 started sync module instance, tier type = 2024-05-08T18:51:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.406+0000 7fa239719800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:44.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.406+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e95810 con 0x7fa230014070 2024-05-08T18:51:44.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.407+0000 7fa237211640 1 -- 172.21.15.132:0/1472004709 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa228075030 con 0x7fa230014070 2024-05-08T18:51:44.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.407+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94173934476288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e96020 con 0x7fa230014070 2024-05-08T18:51:44.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.407+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e97240 con 0x55a693e8ad30 2024-05-08T18:51:44.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.408+0000 7fa237211640 1 -- 172.21.15.132:0/1472004709 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94173934476288] v27'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa228075030 con 0x7fa230014070 2024-05-08T18:51:44.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.408+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa22002b040 con 0x55a693e8ad30 2024-05-08T18:51:44.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.408+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94173934480784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e971b0 con 0x55a693e8ad30 2024-05-08T18:51:44.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.408+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e98100 con 0x55a693e8f640 2024-05-08T18:51:44.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.409+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa23005d040 con 0x55a693e8f640 2024-05-08T18:51:44.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.409+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94173934484560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e980b0 con 0x55a693e8f640 2024-05-08T18:51:44.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.409+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e990c0 con 0x7fa230014070 2024-05-08T18:51:44.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.409+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94173934480784] v27'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa22002b040 con 0x55a693e8ad30 2024-05-08T18:51:44.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.410+0000 7fa237211640 1 -- 172.21.15.132:0/1472004709 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa228075030 con 0x7fa230014070 2024-05-08T18:51:44.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.410+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94173934488432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e994e0 con 0x7fa230014070 2024-05-08T18:51:44.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.410+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e99ee0 con 0x55a693e8ad30 2024-05-08T18:51:44.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.410+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94173934484560] v27'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa23005d040 con 0x55a693e8f640 2024-05-08T18:51:44.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.411+0000 7fa237211640 1 -- 172.21.15.132:0/1472004709 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94173934488432] v27'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa228075030 con 0x7fa230014070 2024-05-08T18:51:44.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.411+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa22002b040 con 0x55a693e8ad30 2024-05-08T18:51:44.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.411+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94173934482992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e999f0 con 0x55a693e8ad30 2024-05-08T18:51:44.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.411+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e9a8f0 con 0x7fa2280a1040 2024-05-08T18:51:44.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.412+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa22002b040 con 0x7fa2280a1040 2024-05-08T18:51:44.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.412+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94173934482992] v27'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa22002b040 con 0x55a693e8ad30 2024-05-08T18:51:44.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.412+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94173934494784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e9ad10 con 0x7fa2280a1040 2024-05-08T18:51:44.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.412+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e98510 con 0x7fa2280a1040 2024-05-08T18:51:44.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.413+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(56 notify.6 [create] v27'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa22002b040 con 0x7fa2280a1040 2024-05-08T18:51:44.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.413+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94173934486800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e9b6d0 con 0x7fa2280a1040 2024-05-08T18:51:44.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.413+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e9c120 con 0x7fa2280a1040 2024-05-08T18:51:44.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.414+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94173934494784] v27'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa22002b040 con 0x7fa2280a1040 2024-05-08T18:51:44.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.415+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94173934486800] v27'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa22002b040 con 0x7fa2280a1040 2024-05-08T18:51:44.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.415+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa22002b040 con 0x7fa2280a1040 2024-05-08T18:51:44.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.415+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94173934500880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e9b220 con 0x7fa2280a1040 2024-05-08T18:51:44.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.415+0000 7fa239719800 20 add_watcher() i=0 2024-05-08T18:51:44.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.415+0000 7fa239719800 20 add_watcher() i=1 2024-05-08T18:51:44.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.415+0000 7fa239719800 20 add_watcher() i=2 2024-05-08T18:51:44.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.415+0000 7fa239719800 20 add_watcher() i=3 2024-05-08T18:51:44.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.415+0000 7fa239719800 20 add_watcher() i=4 2024-05-08T18:51:44.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.415+0000 7fa239719800 20 add_watcher() i=5 2024-05-08T18:51:44.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.415+0000 7fa239719800 20 add_watcher() i=6 2024-05-08T18:51:44.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.416+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94173934500880] v27'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa22002b040 con 0x7fa2280a1040 2024-05-08T18:51:44.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.416+0000 7fa239719800 20 add_watcher() i=7 2024-05-08T18:51:44.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.416+0000 7fa239719800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:44.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.416+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a693e9f220 con 0x55a693e8ad30 2024-05-08T18:51:44.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.416+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa22002b040 con 0x55a693e8ad30 2024-05-08T18:51:44.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.416+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94173934495840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e9c6a0 con 0x55a693e8ad30 2024-05-08T18:51:44.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.417+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94173934495840] v27'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa22002b040 con 0x55a693e8ad30 2024-05-08T18:51:44.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.417+0000 7fa0edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:44.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.417+0000 7fa239719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:44.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.417+0000 7fa239719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:44.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.417+0000 7fa239719800 5 note: GC not initialized 2024-05-08T18:51:44.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.418+0000 7fa0ecfe1640 20 reqs_thread_entry: start 2024-05-08T18:51:44.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.418+0000 7fa239719800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:44.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.418+0000 7fa239719800 20 Filter name: none 2024-05-08T18:51:44.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.418+0000 7fa0667fc640 20 reqs_thread_entry: start 2024-05-08T18:51:44.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.418+0000 7fa239719800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.418+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a693ed1fc0 con 0x55a693e8ad30 2024-05-08T18:51:44.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.418+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa22002b040 con 0x55a693e8ad30 2024-05-08T18:51:44.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.418+0000 7fa239719800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:51:44.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.418+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a693ed33b0 con 0x7fa2280a1040 2024-05-08T18:51:44.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.419+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fa22002b040 con 0x7fa2280a1040 2024-05-08T18:51:44.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.420+0000 7fa0edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:44.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.420+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94173934495840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693ed0bf0 con 0x55a693e8ad30 2024-05-08T18:51:44.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.421+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94173934495840] v27'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa22002b040 con 0x55a693e8ad30 2024-05-08T18:51:44.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.421+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94173934476288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e9a860 con 0x7fa230014070 2024-05-08T18:51:44.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.422+0000 7fa237211640 1 -- 172.21.15.132:0/1472004709 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94173934476288] v27'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa228075030 con 0x7fa230014070 2024-05-08T18:51:44.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.422+0000 7fa239719800 20 remove_watcher() i=0 2024-05-08T18:51:44.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.422+0000 7fa239719800 2 removed watcher, disabling cache 2024-05-08T18:51:44.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.422+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94173934480784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e95c00 con 0x55a693e8ad30 2024-05-08T18:51:44.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.423+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94173934480784] v27'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa22002b040 con 0x55a693e8ad30 2024-05-08T18:51:44.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.423+0000 7fa239719800 20 remove_watcher() i=1 2024-05-08T18:51:44.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.423+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94173934484560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e95c00 con 0x55a693e8f640 2024-05-08T18:51:44.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.424+0000 7fa237a12640 1 -- 172.21.15.132:0/1472004709 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94173934484560] v27'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa23005d040 con 0x55a693e8f640 2024-05-08T18:51:44.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.424+0000 7fa239719800 20 remove_watcher() i=2 2024-05-08T18:51:44.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.424+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94173934488432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e97c50 con 0x7fa230014070 2024-05-08T18:51:44.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.425+0000 7fa237211640 1 -- 172.21.15.132:0/1472004709 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94173934488432] v27'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa228075030 con 0x7fa230014070 2024-05-08T18:51:44.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.425+0000 7fa239719800 20 remove_watcher() i=3 2024-05-08T18:51:44.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.425+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94173934482992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e95c00 con 0x55a693e8ad30 2024-05-08T18:51:44.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.426+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94173934482992] v27'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa22002b040 con 0x55a693e8ad30 2024-05-08T18:51:44.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.426+0000 7fa239719800 20 remove_watcher() i=4 2024-05-08T18:51:44.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.426+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94173934494784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e97630 con 0x7fa2280a1040 2024-05-08T18:51:44.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.427+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94173934494784] v27'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa22002b040 con 0x7fa2280a1040 2024-05-08T18:51:44.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.427+0000 7fa239719800 20 remove_watcher() i=5 2024-05-08T18:51:44.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.427+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94173934486800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e95c00 con 0x7fa2280a1040 2024-05-08T18:51:44.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.428+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94173934486800] v27'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa22002b040 con 0x7fa2280a1040 2024-05-08T18:51:44.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.428+0000 7fa239719800 20 remove_watcher() i=6 2024-05-08T18:51:44.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.428+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94173934500880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a693e9a440 con 0x7fa2280a1040 2024-05-08T18:51:44.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.429+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94173934500880] v27'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa22002b040 con 0x7fa2280a1040 2024-05-08T18:51:44.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.429+0000 7fa239719800 20 remove_watcher() i=7 2024-05-08T18:51:44.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.429+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa2280a1040 msgr2=0x7fa22805c910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.429+0000 7fa239719800 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fa2280a1040 0x7fa22805c910 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.429+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a693e8ad30 msgr2=0x55a693e8d1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.429+0000 7fa239719800 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a693e8ad30 0x55a693e8d1d0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.429+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa230014070 msgr2=0x7fa2300548d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.429+0000 7fa239719800 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fa230014070 0x7fa2300548d0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.429+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a693e8f640 msgr2=0x55a693e91a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.429+0000 7fa239719800 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a693e8f640 0x55a693e91a30 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.429+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa10003bba0 msgr2=0x7fa10003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.429+0000 7fa239719800 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa10003bba0 0x7fa10003e060 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa228066f90 tx=0x7fa22807f000 comp rx=0 tx=0).stop 2024-05-08T18:51:44.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.429+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693e77b70 msgr2=0x55a693e7f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.429+0000 7fa22ffff640 1 -- 172.21.15.132:0/1472004709 reap_dead start 2024-05-08T18:51:44.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.429+0000 7fa239719800 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693e77b70 0x55a693e7f150 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa230011920 tx=0x7fa230052be0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.429+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 shutdown_connections 2024-05-08T18:51:44.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.429+0000 7fa239719800 1 --2- 172.21.15.132:0/1472004709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693e77b70 0x55a693e7f150 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.429+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 >> 172.21.15.132:0/1472004709 conn(0x55a693e73e80 msgr2=0x55a693e71530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 shutdown_connections 2024-05-08T18:51:44.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 -- 172.21.15.132:0/1472004709 wait complete. 2024-05-08T18:51:44.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 -- 172.21.15.132:0/3379428954 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa11003bba0 msgr2=0x7fa11003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 --2- 172.21.15.132:0/3379428954 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa11003bba0 0x7fa11003e060 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55a693e54e00 tx=0x7fa228066750 comp rx=0 tx=0).stop 2024-05-08T18:51:44.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 -- 172.21.15.132:0/3379428954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693e46070 msgr2=0x55a693e444e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 --2- 172.21.15.132:0/3379428954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693e46070 0x55a693e444e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x55a693e54d60 tx=0x7fa230018830 comp rx=0 tx=0).stop 2024-05-08T18:51:44.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 -- 172.21.15.132:0/3379428954 shutdown_connections 2024-05-08T18:51:44.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 --2- 172.21.15.132:0/3379428954 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa11003bba0 0x7fa11003e060 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 --2- 172.21.15.132:0/3379428954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693e46070 0x55a693e444e0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 -- 172.21.15.132:0/3379428954 >> 172.21.15.132:0/3379428954 conn(0x55a693e5c770 msgr2=0x55a693e5cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 -- 172.21.15.132:0/3379428954 shutdown_connections 2024-05-08T18:51:44.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 -- 172.21.15.132:0/3379428954 wait complete. 2024-05-08T18:51:44.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 -- 172.21.15.132:0/817540446 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a693d543d0 msgr2=0x55a693e54460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 --2- 172.21.15.132:0/817540446 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a693d543d0 0x55a693e54460 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 -- 172.21.15.132:0/817540446 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a693e56cb0 msgr2=0x55a693e590a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 --2- 172.21.15.132:0/817540446 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a693e56cb0 0x55a693e590a0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 -- 172.21.15.132:0/817540446 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa11c03bb50 msgr2=0x7fa11c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 --2- 172.21.15.132:0/817540446 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa11c03bb50 0x7fa11c03e010 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa220000f60 tx=0x7fa220001370 comp rx=0 tx=0).stop 2024-05-08T18:51:44.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 -- 172.21.15.132:0/817540446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693d53650 msgr2=0x55a693e4d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 --2- 172.21.15.132:0/817540446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693d53650 0x55a693e4d220 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa22800a520 tx=0x7fa228003020 comp rx=0 tx=0).stop 2024-05-08T18:51:44.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 -- 172.21.15.132:0/817540446 shutdown_connections 2024-05-08T18:51:44.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 --2- 172.21.15.132:0/817540446 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a693e56cb0 0x55a693e590a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 --2- 172.21.15.132:0/817540446 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a693d543d0 0x55a693e54460 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 --2- 172.21.15.132:0/817540446 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fa11c03bb50 0x7fa11c03e010 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 --2- 172.21.15.132:0/817540446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a693d53650 0x55a693e4d220 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 -- 172.21.15.132:0/817540446 >> 172.21.15.132:0/817540446 conn(0x55a693d4deb0 msgr2=0x55a693e3e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 -- 172.21.15.132:0/817540446 shutdown_connections 2024-05-08T18:51:44.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.430+0000 7fa239719800 1 -- 172.21.15.132:0/817540446 wait complete. 2024-05-08T18:51:44.439 INFO:teuthology.orchestra.run.smithi132.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{}},{"bucket":"myfoo2","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-08T18:51:44.439 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:51:44.439 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-05-08T18:51:44.439 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-05-08T18:51:44.440 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-05-08T18:51:44.485 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:44.486 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:44.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.487+0000 7f5fee319800 1 Processor -- start 2024-05-08T18:51:44.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.487+0000 7f5fee319800 1 -- start start 2024-05-08T18:51:44.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.487+0000 7f5fee319800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55ee46be4570 0x55ee46be6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.487+0000 7f5fee319800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ee46be7090 con 0x55ee46b534c0 2024-05-08T18:51:44.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.487+0000 7f5fee319800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55ee46a80e20 con 0x55ee46be4570 2024-05-08T18:51:44.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.488+0000 7f5feb610640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55ee46be4570 0x55ee46be6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.488+0000 7f5febe11640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55ee46b534c0 0x55ee46be2df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:49042/0 (socket says 172.21.15.132:49042) 2024-05-08T18:51:44.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.488+0000 7f5feb610640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55ee46be4570 0x55ee46be6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56420/0 (socket says 172.21.15.132:56420) 2024-05-08T18:51:44.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.488+0000 7f5febe11640 1 -- 172.21.15.132:0/1973956514 learned_addr learned my addr 172.21.15.132:0/1973956514 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:51:44.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.488+0000 7f5feb610640 1 -- 172.21.15.132:0/1973956514 >> v1:172.21.15.42:6789/0 conn(0x55ee46b534c0 legacy=0x55ee46be2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.488+0000 7f5feb610640 1 -- 172.21.15.132:0/1973956514 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee46be82c0 con 0x55ee46be4570 2024-05-08T18:51:44.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.490+0000 7f5feb610640 1 --2- 172.21.15.132:0/1973956514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46be4570 0x55ee46be6a10 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000a470 tx=0x7f5fe001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b73cdfc31e21e4d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.490+0000 7f5feae0f640 1 -- 172.21.15.132:0/1973956514 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe0057070 con 0x55ee46be4570 2024-05-08T18:51:44.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.490+0000 7f5feae0f640 1 -- 172.21.15.132:0/1973956514 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe0052570 con 0x55ee46be4570 2024-05-08T18:51:44.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.490+0000 7f5feae0f640 1 -- 172.21.15.132:0/1973956514 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe0052870 con 0x55ee46be4570 2024-05-08T18:51:44.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.490+0000 7f5fee319800 1 -- 172.21.15.132:0/1973956514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46be4570 msgr2=0x55ee46be6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.490+0000 7f5fee319800 1 --2- 172.21.15.132:0/1973956514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46be4570 0x55ee46be6a10 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000a470 tx=0x7f5fe001ce90 comp rx=0 tx=0).stop 2024-05-08T18:51:44.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.490+0000 7f5fee319800 1 -- 172.21.15.132:0/1973956514 shutdown_connections 2024-05-08T18:51:44.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.490+0000 7f5fee319800 1 --2- 172.21.15.132:0/1973956514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46be4570 0x55ee46be6a10 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.490+0000 7f5fee319800 1 -- 172.21.15.132:0/1973956514 >> 172.21.15.132:0/1973956514 conn(0x55ee46bda730 msgr2=0x55ee46bdcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.490+0000 7f5fee319800 1 -- 172.21.15.132:0/1973956514 shutdown_connections 2024-05-08T18:51:44.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.490+0000 7f5fee319800 1 -- 172.21.15.132:0/1973956514 wait complete. 2024-05-08T18:51:44.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.504+0000 7f5fee319800 1 Processor -- start 2024-05-08T18:51:44.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.504+0000 7f5fee319800 1 -- start start 2024-05-08T18:51:44.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.504+0000 7f5fee319800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46b534c0 0x55ee46be0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.504+0000 7f5fee319800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ee46b2b5c0 con 0x55ee46b534c0 2024-05-08T18:51:44.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.504+0000 7f5febe11640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46b534c0 0x55ee46be0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.504+0000 7f5febe11640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46b534c0 0x55ee46be0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56434/0 (socket says 172.21.15.132:56434) 2024-05-08T18:51:44.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.504+0000 7f5febe11640 1 -- 172.21.15.132:0/534173624 learned_addr learned my addr 172.21.15.132:0/534173624 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.505+0000 7f5febe11640 1 -- 172.21.15.132:0/534173624 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee46bdece0 con 0x55ee46b534c0 2024-05-08T18:51:44.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.505+0000 7f5febe11640 1 --2- 172.21.15.132:0/534173624 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46b534c0 0x55ee46be0720 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc001de0 tx=0x7f5fdc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f243e412c8003d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.505+0000 7f5ed9e0b640 1 -- 172.21.15.132:0/534173624 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fdc012020 con 0x55ee46b534c0 2024-05-08T18:51:44.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.505+0000 7f5ed9e0b640 1 -- 172.21.15.132:0/534173624 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fdc00e5a0 con 0x55ee46b534c0 2024-05-08T18:51:44.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.505+0000 7f5ed9e0b640 1 -- 172.21.15.132:0/534173624 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fdc00e8c0 con 0x55ee46b534c0 2024-05-08T18:51:44.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.506+0000 7f5fee319800 1 -- 172.21.15.132:0/534173624 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46b534c0 msgr2=0x55ee46be0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.506+0000 7f5fee319800 1 --2- 172.21.15.132:0/534173624 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46b534c0 0x55ee46be0720 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc001de0 tx=0x7f5fdc00b6c0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.506+0000 7f5fee319800 1 -- 172.21.15.132:0/534173624 shutdown_connections 2024-05-08T18:51:44.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.506+0000 7f5fee319800 1 --2- 172.21.15.132:0/534173624 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46b534c0 0x55ee46be0720 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.506+0000 7f5fee319800 1 -- 172.21.15.132:0/534173624 >> 172.21.15.132:0/534173624 conn(0x55ee46bda730 msgr2=0x55ee46cccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.506+0000 7f5fee319800 1 -- 172.21.15.132:0/534173624 shutdown_connections 2024-05-08T18:51:44.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.506+0000 7f5fee319800 1 -- 172.21.15.132:0/534173624 wait complete. 2024-05-08T18:51:44.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.506+0000 7f5fee319800 1 Processor -- start 2024-05-08T18:51:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.506+0000 7f5fee319800 1 -- start start 2024-05-08T18:51:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.506+0000 7f5fee319800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46b534c0 0x55ee46cdb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.506+0000 7f5fee319800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ee46be7560 con 0x55ee46b534c0 2024-05-08T18:51:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.507+0000 7f5febe11640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46b534c0 0x55ee46cdb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.507+0000 7f5febe11640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46b534c0 0x55ee46cdb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56442/0 (socket says 172.21.15.132:56442) 2024-05-08T18:51:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.507+0000 7f5febe11640 1 -- 172.21.15.132:0/1534495857 learned_addr learned my addr 172.21.15.132:0/1534495857 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.507+0000 7f5febe11640 1 -- 172.21.15.132:0/1534495857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee46cdb960 con 0x55ee46b534c0 2024-05-08T18:51:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.507+0000 7f5febe11640 1 --2- 172.21.15.132:0/1534495857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46b534c0 0x55ee46cdb420 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc001de0 tx=0x7f5fdc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.507+0000 7f5ed3fff640 1 -- 172.21.15.132:0/1534495857 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fdc012030 con 0x55ee46b534c0 2024-05-08T18:51:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.507+0000 7f5ed3fff640 1 -- 172.21.15.132:0/1534495857 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fdc01a7a0 con 0x55ee46b534c0 2024-05-08T18:51:44.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.507+0000 7f5fee319800 1 -- 172.21.15.132:0/1534495857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee46cdbbf0 con 0x55ee46b534c0 2024-05-08T18:51:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.507+0000 7f5ed3fff640 1 -- 172.21.15.132:0/1534495857 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fdc01aac0 con 0x55ee46b534c0 2024-05-08T18:51:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.507+0000 7f5fee319800 1 -- 172.21.15.132:0/1534495857 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee46cde8a0 con 0x55ee46b534c0 2024-05-08T18:51:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.508+0000 7f5ed3fff640 1 -- 172.21.15.132:0/1534495857 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5fdc015020 con 0x55ee46b534c0 2024-05-08T18:51:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.508+0000 7f5ed3fff640 1 --2- 172.21.15.132:0/1534495857 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ed403bb50 0x7f5ed403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.508+0000 7f5ed3fff640 1 -- 172.21.15.132:0/1534495857 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f5fdc020070 con 0x55ee46b534c0 2024-05-08T18:51:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.509+0000 7f5feb610640 1 --2- 172.21.15.132:0/1534495857 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ed403bb50 0x7f5ed403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.509+0000 7f5fee319800 1 --2- 172.21.15.132:0/1534495857 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ee46be4570 0x55ee46ce2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.509+0000 7f5fee319800 1 -- 172.21.15.132:0/1534495857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ee46ce2be0 con 0x55ee46be4570 2024-05-08T18:51:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.509+0000 7f5fec612640 1 --2- 172.21.15.132:0/1534495857 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ee46be4570 0x55ee46ce2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.509+0000 7f5feb610640 1 --2- 172.21.15.132:0/1534495857 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ed403bb50 0x7f5ed403e010 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0054000 tx=0x7f5fe004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.509+0000 7f5fec612640 1 --2- 172.21.15.132:0/1534495857 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ee46be4570 0x55ee46ce2660 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.509+0000 7f5fec612640 1 -- 172.21.15.132:0/1534495857 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fe400a4a0 con 0x55ee46be4570 2024-05-08T18:51:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.509+0000 7f5fee319800 1 -- 172.21.15.132:0/1534495857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ee46cdfc10 con 0x55ee46be4570 2024-05-08T18:51:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.510+0000 7f5fec612640 1 -- 172.21.15.132:0/1534495857 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5fe400a4a0 con 0x55ee46be4570 2024-05-08T18:51:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.510+0000 7f5fee319800 1 --2- 172.21.15.132:0/1534495857 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ee46ce4f40 0x55ee46ce7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.510+0000 7f5fee319800 1 -- 172.21.15.132:0/1534495857 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ee46ce79d0 con 0x55ee46ce4f40 2024-05-08T18:51:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.510+0000 7f5febe11640 1 --2- 172.21.15.132:0/1534495857 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ee46ce4f40 0x55ee46ce7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.510+0000 7f5febe11640 1 --2- 172.21.15.132:0/1534495857 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ee46ce4f40 0x55ee46ce7330 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.510+0000 7f5febe11640 1 -- 172.21.15.132:0/1534495857 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5fdc01ac60 con 0x55ee46ce4f40 2024-05-08T18:51:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.510+0000 7f5fee319800 1 -- 172.21.15.132:0/1534495857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ee46ce3de0 con 0x55ee46be4570 2024-05-08T18:51:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.511+0000 7f5fec612640 1 -- 172.21.15.132:0/1534495857 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5fe400a4a0 con 0x55ee46be4570 2024-05-08T18:51:44.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.511+0000 7f5fee319800 1 -- 172.21.15.132:0/1534495857 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ee46ce42c0 con 0x55ee46be4570 2024-05-08T18:51:44.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.511+0000 7f5fec612640 1 -- 172.21.15.132:0/1534495857 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5fe400a4a0 con 0x55ee46be4570 2024-05-08T18:51:44.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.511+0000 7f5fee319800 1 Processor -- start 2024-05-08T18:51:44.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.511+0000 7f5fee319800 1 -- start start 2024-05-08T18:51:44.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.511+0000 7f5fee319800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46cf6950 0x55ee46cf6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.511+0000 7f5fee319800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ee46ad1fc0 con 0x55ee46cf6950 2024-05-08T18:51:44.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.512+0000 7f5fec612640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46cf6950 0x55ee46cf6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.512+0000 7f5fec612640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46cf6950 0x55ee46cf6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56456/0 (socket says 172.21.15.132:56456) 2024-05-08T18:51:44.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.512+0000 7f5fec612640 1 -- 172.21.15.132:0/1370755884 learned_addr learned my addr 172.21.15.132:0/1370755884 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.512+0000 7f5fec612640 1 -- 172.21.15.132:0/1370755884 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee46cf72b0 con 0x55ee46cf6950 2024-05-08T18:51:44.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.512+0000 7f5fec612640 1 --2- 172.21.15.132:0/1370755884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46cf6950 0x55ee46cf6d70 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x55ee46ce2fc0 tx=0x7f5fe4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.512+0000 7f5ed17fa640 1 -- 172.21.15.132:0/1370755884 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe4014450 con 0x55ee46cf6950 2024-05-08T18:51:44.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.512+0000 7f5ed17fa640 1 -- 172.21.15.132:0/1370755884 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe40145f0 con 0x55ee46cf6950 2024-05-08T18:51:44.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.512+0000 7f5ed17fa640 1 -- 172.21.15.132:0/1370755884 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe40148d0 con 0x55ee46cf6950 2024-05-08T18:51:44.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.512+0000 7f5fee319800 1 -- 172.21.15.132:0/1370755884 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee46cf7d20 con 0x55ee46cf6950 2024-05-08T18:51:44.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.513+0000 7f5fee319800 1 -- 172.21.15.132:0/1370755884 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee46cf8220 con 0x55ee46cf6950 2024-05-08T18:51:44.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.513+0000 7f5ed17fa640 1 -- 172.21.15.132:0/1370755884 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5fe4011040 con 0x55ee46cf6950 2024-05-08T18:51:44.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.513+0000 7f5ed17fa640 1 --2- 172.21.15.132:0/1370755884 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ec403bb50 0x7f5ec403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.514+0000 7f5ed17fa640 1 -- 172.21.15.132:0/1370755884 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f5fe401e070 con 0x55ee46cf6950 2024-05-08T18:51:44.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.514+0000 7f5febe11640 1 --2- 172.21.15.132:0/1370755884 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ec403bb50 0x7f5ec403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.514+0000 7f5fee319800 1 Processor -- start 2024-05-08T18:51:44.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.514+0000 7f5febe11640 1 --2- 172.21.15.132:0/1370755884 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ec403bb50 0x7f5ec403e010 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x55ee46ce3080 tx=0x7f5fdc018e70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.514+0000 7f5fee319800 1 -- start start 2024-05-08T18:51:44.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.514+0000 7f5fee319800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46d03c50 0x55ee46d04070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.514+0000 7f5fee319800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ee46bdf060 con 0x55ee46d03c50 2024-05-08T18:51:44.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.514+0000 7f5fec612640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46d03c50 0x55ee46d04070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.514+0000 7f5fec612640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46d03c50 0x55ee46d04070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56466/0 (socket says 172.21.15.132:56466) 2024-05-08T18:51:44.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.514+0000 7f5fec612640 1 -- 172.21.15.132:0/1722460307 learned_addr learned my addr 172.21.15.132:0/1722460307 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.515+0000 7f5fec612640 1 -- 172.21.15.132:0/1722460307 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee46d04640 con 0x55ee46d03c50 2024-05-08T18:51:44.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.515+0000 7f5fec612640 1 --2- 172.21.15.132:0/1722460307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46d03c50 0x55ee46d04070 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4013fd0 tx=0x7f5fe40451a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5f95c87b49547a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.515+0000 7f5ecaffd640 1 -- 172.21.15.132:0/1722460307 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe4022db0 con 0x55ee46d03c50 2024-05-08T18:51:44.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.515+0000 7f5ecaffd640 1 -- 172.21.15.132:0/1722460307 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe40167c0 con 0x55ee46d03c50 2024-05-08T18:51:44.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.515+0000 7f5ecaffd640 1 -- 172.21.15.132:0/1722460307 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe4016aa0 con 0x55ee46d03c50 2024-05-08T18:51:44.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.515+0000 7f5fee319800 1 -- 172.21.15.132:0/1722460307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46d03c50 msgr2=0x55ee46d04070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.515+0000 7f5fee319800 1 --2- 172.21.15.132:0/1722460307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46d03c50 0x55ee46d04070 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4013fd0 tx=0x7f5fe40451a0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.515+0000 7f5fee319800 1 -- 172.21.15.132:0/1722460307 shutdown_connections 2024-05-08T18:51:44.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.515+0000 7f5fee319800 1 --2- 172.21.15.132:0/1722460307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46d03c50 0x55ee46d04070 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.515+0000 7f5fee319800 1 -- 172.21.15.132:0/1722460307 >> 172.21.15.132:0/1722460307 conn(0x55ee46cfff60 msgr2=0x55ee46cfe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.515+0000 7f5fee319800 1 -- 172.21.15.132:0/1722460307 shutdown_connections 2024-05-08T18:51:44.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.515+0000 7f5fee319800 1 -- 172.21.15.132:0/1722460307 wait complete. 2024-05-08T18:51:44.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.516+0000 7f5fee319800 1 Processor -- start 2024-05-08T18:51:44.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.516+0000 7f5fee319800 1 -- start start 2024-05-08T18:51:44.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.516+0000 7f5fee319800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46d03c50 0x55ee46d0b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.516+0000 7f5fee319800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ee46d04db0 con 0x55ee46d03c50 2024-05-08T18:51:44.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.516+0000 7f5fec612640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46d03c50 0x55ee46d0b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.516+0000 7f5fec612640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46d03c50 0x55ee46d0b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56478/0 (socket says 172.21.15.132:56478) 2024-05-08T18:51:44.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.516+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 learned_addr learned my addr 172.21.15.132:0/3399759157 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.516+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee46d0b710 con 0x55ee46d03c50 2024-05-08T18:51:44.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.517+0000 7f5fec612640 1 --2- 172.21.15.132:0/3399759157 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46d03c50 0x55ee46d0b1d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4052cf0 tx=0x7f5fe4052d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.517+0000 7f5ec97fa640 1 -- 172.21.15.132:0/3399759157 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe40408e0 con 0x55ee46d03c50 2024-05-08T18:51:44.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.517+0000 7f5ec97fa640 1 -- 172.21.15.132:0/3399759157 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe4040a80 con 0x55ee46d03c50 2024-05-08T18:51:44.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.517+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee46d0b9a0 con 0x55ee46d03c50 2024-05-08T18:51:44.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.517+0000 7f5ec97fa640 1 -- 172.21.15.132:0/3399759157 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe4040da0 con 0x55ee46d03c50 2024-05-08T18:51:44.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.517+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee46d0e650 con 0x55ee46d03c50 2024-05-08T18:51:44.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.518+0000 7f5ec97fa640 1 -- 172.21.15.132:0/3399759157 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5fe4054ad0 con 0x55ee46d03c50 2024-05-08T18:51:44.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.518+0000 7f5ec97fa640 1 --2- 172.21.15.132:0/3399759157 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5eb403bba0 0x7f5eb403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.518+0000 7f5fee319800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.518+0000 7f5ec97fa640 1 -- 172.21.15.132:0/3399759157 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f5fe400e040 con 0x55ee46d03c50 2024-05-08T18:51:44.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.518+0000 7f5febe11640 1 --2- 172.21.15.132:0/3399759157 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5eb403bba0 0x7f5eb403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.518+0000 7f5fee319800 1 --2- 172.21.15.132:0/3399759157 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ee46d16c80 0x55ee46d190f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.518+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d19840 con 0x55ee46d16c80 2024-05-08T18:51:44.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.518+0000 7f5feb610640 1 --2- 172.21.15.132:0/3399759157 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ee46d16c80 0x55ee46d190f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.518+0000 7f5febe11640 1 --2- 172.21.15.132:0/3399759157 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5eb403bba0 0x7f5eb403e060 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc000c00 tx=0x7f5fdc047000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.519+0000 7f5feb610640 1 --2- 172.21.15.132:0/3399759157 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ee46d16c80 0x55ee46d190f0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.519+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fe005a040 con 0x55ee46d16c80 2024-05-08T18:51:44.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.519+0000 7f5fee319800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.519+0000 7f5fee319800 20 realm 2024-05-08T18:51:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.519+0000 7f5fee319800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.519+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d19c10 con 0x55ee46d16c80 2024-05-08T18:51:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.519+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fe005a040 con 0x55ee46d16c80 2024-05-08T18:51:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.519+0000 7f5fee319800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.519+0000 7f5fee319800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.519+0000 7f5fee319800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.519+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1a4e0 con 0x55ee46d16c80 2024-05-08T18:51:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.519+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fe005a040 con 0x55ee46d16c80 2024-05-08T18:51:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.519+0000 7f5fee319800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.519+0000 7f5fee319800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.519+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1a880 con 0x55ee46d16c80 2024-05-08T18:51:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.520+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5fe005a040 con 0x55ee46d16c80 2024-05-08T18:51:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.520+0000 7f5fee319800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.520+0000 7f5fee319800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.520+0000 7f5fee319800 1 --2- 172.21.15.132:0/3399759157 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ee46d1b330 0x55ee46d1d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.520+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1dea0 con 0x55ee46d1b330 2024-05-08T18:51:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.520+0000 7f5fec612640 1 --2- 172.21.15.132:0/3399759157 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ee46d1b330 0x55ee46d1d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.520+0000 7f5fec612640 1 --2- 172.21.15.132:0/3399759157 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ee46d1b330 0x55ee46d1d740 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.520+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5fe403c020 con 0x55ee46d1b330 2024-05-08T18:51:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.520+0000 7f5fee319800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.520+0000 7f5fee319800 20 searching for the correct realm 2024-05-08T18:51:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.520+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x55ee46d1b330 2024-05-08T18:51:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.521+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe403c020 con 0x55ee46d1b330 2024-05-08T18:51:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.521+0000 7f5fec612640 1 --2- 172.21.15.132:0/3399759157 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f5fe4014070 0x7f5fe4055020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.521+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x7f5fe4014070 2024-05-08T18:51:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.521+0000 7f5febe11640 1 --2- 172.21.15.132:0/3399759157 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f5fe4014070 0x7f5fe4055020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.521+0000 7f5febe11640 1 --2- 172.21.15.132:0/3399759157 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f5fe4014070 0x7f5fe4055020 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.522+0000 7f5febe11640 1 -- 172.21.15.132:0/3399759157 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc01ac60 con 0x7f5fe4014070 2024-05-08T18:51:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.522+0000 7f5febe11640 1 --2- 172.21.15.132:0/3399759157 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f5fdc017050 0x7f5fdc02d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.522+0000 7f5febe11640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x7f5fdc017050 2024-05-08T18:51:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.522+0000 7f5feb610640 1 --2- 172.21.15.132:0/3399759157 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f5fdc017050 0x7f5fdc02d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.522+0000 7f5feb610640 1 --2- 172.21.15.132:0/3399759157 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f5fdc017050 0x7f5fdc02d870 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.523+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe005a040 con 0x7f5fdc017050 2024-05-08T18:51:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.523+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x55ee46d16c80 2024-05-08T18:51:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.523+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe005a040 con 0x55ee46d16c80 2024-05-08T18:51:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.523+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x55ee46d16c80 2024-05-08T18:51:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.523+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe005a040 con 0x55ee46d16c80 2024-05-08T18:51:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.523+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x7f5fdc017050 2024-05-08T18:51:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.523+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe005a040 con 0x7f5fdc017050 2024-05-08T18:51:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.523+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x7f5fdc017050 2024-05-08T18:51:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.524+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe005a040 con 0x7f5fdc017050 2024-05-08T18:51:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.524+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x7f5fe4014070 2024-05-08T18:51:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.524+0000 7f5febe11640 1 -- 172.21.15.132:0/3399759157 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc01ac60 con 0x7f5fe4014070 2024-05-08T18:51:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.524+0000 7f5febe11640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x55ee46d1b330 2024-05-08T18:51:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.524+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe403c020 con 0x55ee46d1b330 2024-05-08T18:51:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.524+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x55ee46d16c80 2024-05-08T18:51:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.524+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe005a040 con 0x55ee46d16c80 2024-05-08T18:51:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.525+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x7f5fdc017050 2024-05-08T18:51:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.525+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe005a040 con 0x7f5fdc017050 2024-05-08T18:51:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.525+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x55ee46d16c80 2024-05-08T18:51:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.525+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5fe005a040 con 0x55ee46d16c80 2024-05-08T18:51:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.525+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x7f5fe4014070 2024-05-08T18:51:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.525+0000 7f5febe11640 1 -- 172.21.15.132:0/3399759157 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5fdc01ac60 con 0x7f5fe4014070 2024-05-08T18:51:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.525+0000 7f5febe11640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x55ee46d1b330 2024-05-08T18:51:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.526+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5fe403c020 con 0x55ee46d1b330 2024-05-08T18:51:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.526+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x55ee46d1b330 2024-05-08T18:51:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.526+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe403c020 con 0x55ee46d1b330 2024-05-08T18:51:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.526+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x7f5fdc017050 2024-05-08T18:51:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.526+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe005a040 con 0x7f5fdc017050 2024-05-08T18:51:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.526+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x55ee46d1b330 2024-05-08T18:51:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.526+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe403c020 con 0x55ee46d1b330 2024-05-08T18:51:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.526+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x55ee46d1b330 2024-05-08T18:51:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.527+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe403c020 con 0x55ee46d1b330 2024-05-08T18:51:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.527+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x55ee46d16c80 2024-05-08T18:51:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.527+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe005a040 con 0x55ee46d16c80 2024-05-08T18:51:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.527+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x55ee46d16c80 2024-05-08T18:51:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.527+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5fe005a040 con 0x55ee46d16c80 2024-05-08T18:51:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.527+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x7f5fdc017050 2024-05-08T18:51:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.527+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe007d040 con 0x7f5fdc017050 2024-05-08T18:51:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.527+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x55ee46d1b330 2024-05-08T18:51:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.528+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe403c020 con 0x55ee46d1b330 2024-05-08T18:51:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.528+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x7f5fe4014070 2024-05-08T18:51:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.528+0000 7f5febe11640 1 -- 172.21.15.132:0/3399759157 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc01ac60 con 0x7f5fe4014070 2024-05-08T18:51:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.528+0000 7f5febe11640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x55ee46d16c80 2024-05-08T18:51:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.528+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe007d040 con 0x55ee46d16c80 2024-05-08T18:51:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.528+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x7f5fe4014070 2024-05-08T18:51:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.528+0000 7f5febe11640 1 -- 172.21.15.132:0/3399759157 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc01ac60 con 0x7f5fe4014070 2024-05-08T18:51:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.528+0000 7f5febe11640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x55ee46d1b330 2024-05-08T18:51:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.529+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe403c020 con 0x55ee46d1b330 2024-05-08T18:51:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.529+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x7f5fdc017050 2024-05-08T18:51:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.529+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe007d040 con 0x7f5fdc017050 2024-05-08T18:51:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.529+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x7f5fe4014070 2024-05-08T18:51:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.529+0000 7f5febe11640 1 -- 172.21.15.132:0/3399759157 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc01ac60 con 0x7f5fe4014070 2024-05-08T18:51:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.529+0000 7f5febe11640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x55ee46d1b330 2024-05-08T18:51:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.529+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe403c020 con 0x55ee46d1b330 2024-05-08T18:51:44.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.529+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x7f5fdc017050 2024-05-08T18:51:44.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.530+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe007d040 con 0x7f5fdc017050 2024-05-08T18:51:44.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.530+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x55ee46d16c80 2024-05-08T18:51:44.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.530+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5fe007d040 con 0x55ee46d16c80 2024-05-08T18:51:44.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.530+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f880 con 0x7f5fe4014070 2024-05-08T18:51:44.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.530+0000 7f5febe11640 1 -- 172.21.15.132:0/3399759157 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fdc01ac60 con 0x7f5fe4014070 2024-05-08T18:51:44.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.530+0000 7f5fee319800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:44.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.530+0000 7f5fee319800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:44.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.530+0000 7f5fee319800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:44.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.530+0000 7f5fee319800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:44.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.530+0000 7f5fee319800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:44.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.530+0000 7f5fee319800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:44.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.530+0000 7f5fee319800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.530+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1e980 con 0x55ee46d16c80 2024-05-08T18:51:44.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.530+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fe007d040 con 0x55ee46d16c80 2024-05-08T18:51:44.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.531+0000 7f5fee319800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.531+0000 7f5fee319800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.531+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1f220 con 0x55ee46d16c80 2024-05-08T18:51:44.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.531+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5fe007d040 con 0x55ee46d16c80 2024-05-08T18:51:44.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.531+0000 7f5fee319800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:44.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.531+0000 7f5fee319800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.531+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d1e5c0 con 0x55ee46d16c80 2024-05-08T18:51:44.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.531+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5fe007d040 con 0x55ee46d16c80 2024-05-08T18:51:44.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.531+0000 7f5fee319800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:44.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.531+0000 7f5fee319800 20 zone default found 2024-05-08T18:51:44.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.531+0000 7f5fee319800 4 Realm: () 2024-05-08T18:51:44.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.531+0000 7f5fee319800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:44.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.531+0000 7f5fee319800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:44.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.531+0000 7f5fee319800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:44.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.531+0000 7f5fee319800 20 zonegroup default 2024-05-08T18:51:44.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.531+0000 7f5fee319800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.531+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d20200 con 0x7f5fe4014070 2024-05-08T18:51:44.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.531+0000 7f5febe11640 1 -- 172.21.15.132:0/3399759157 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5fdc01ac60 con 0x7f5fe4014070 2024-05-08T18:51:44.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.531+0000 7f5fee319800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.531+0000 7f5fee319800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.531+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d21fe0 con 0x55ee46d1b330 2024-05-08T18:51:44.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.532+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5fe403c020 con 0x55ee46d1b330 2024-05-08T18:51:44.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.532+0000 7f5fee319800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.532+0000 7f5fee319800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.532+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d224e0 con 0x55ee46d1b330 2024-05-08T18:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.532+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5fe403c020 con 0x55ee46d1b330 2024-05-08T18:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.532+0000 7f5fee319800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.532+0000 7f5fee319800 20 started sync module instance, tier type = 2024-05-08T18:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.532+0000 7f5fee319800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.532+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d21420 con 0x7f5fe4014070 2024-05-08T18:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.533+0000 7f5febe11640 1 -- 172.21.15.132:0/3399759157 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc01ac60 con 0x7f5fe4014070 2024-05-08T18:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.533+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94481878751248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d22df0 con 0x7f5fe4014070 2024-05-08T18:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.533+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d23640 con 0x55ee46d16c80 2024-05-08T18:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.534+0000 7f5febe11640 1 -- 172.21.15.132:0/3399759157 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94481878751248] v27'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc01ac60 con 0x7f5fe4014070 2024-05-08T18:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.535+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe007d040 con 0x55ee46d16c80 2024-05-08T18:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.535+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94481878757776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d23a60 con 0x55ee46d16c80 2024-05-08T18:51:44.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.535+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d242b0 con 0x55ee46d1b330 2024-05-08T18:51:44.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.536+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94481878757776] v27'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe007d040 con 0x55ee46d16c80 2024-05-08T18:51:44.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.536+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe403c020 con 0x55ee46d1b330 2024-05-08T18:51:44.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.536+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94481878759312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d241e0 con 0x55ee46d1b330 2024-05-08T18:51:44.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.536+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d24d00 con 0x7f5fe4014070 2024-05-08T18:51:44.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.537+0000 7f5febe11640 1 -- 172.21.15.132:0/3399759157 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc01ac60 con 0x7f5fe4014070 2024-05-08T18:51:44.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.537+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94481878759312] v27'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe403c020 con 0x55ee46d1b330 2024-05-08T18:51:44.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.537+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94481878763472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d255a0 con 0x7f5fe4014070 2024-05-08T18:51:44.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.537+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d23c70 con 0x55ee46d16c80 2024-05-08T18:51:44.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.538+0000 7f5febe11640 1 -- 172.21.15.132:0/3399759157 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94481878763472] v27'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc01ac60 con 0x7f5fe4014070 2024-05-08T18:51:44.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.538+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe007d040 con 0x55ee46d16c80 2024-05-08T18:51:44.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.538+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94481878765808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d25510 con 0x55ee46d16c80 2024-05-08T18:51:44.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.539+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d26630 con 0x7f5fdc017050 2024-05-08T18:51:44.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.540+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94481878765808] v27'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe007d040 con 0x55ee46d16c80 2024-05-08T18:51:44.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.540+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe007d040 con 0x7f5fdc017050 2024-05-08T18:51:44.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.540+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94481878768480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d26630 con 0x7f5fdc017050 2024-05-08T18:51:44.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.540+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d27040 con 0x7f5fdc017050 2024-05-08T18:51:44.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.541+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94481878768480] v27'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe007d040 con 0x7f5fdc017050 2024-05-08T18:51:44.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.541+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe007d040 con 0x7f5fdc017050 2024-05-08T18:51:44.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.541+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94481878770528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d27040 con 0x7f5fdc017050 2024-05-08T18:51:44.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.541+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d27a00 con 0x7f5fdc017050 2024-05-08T18:51:44.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.542+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(58 notify.7 [create] v27'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe007d040 con 0x7f5fdc017050 2024-05-08T18:51:44.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.542+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94481878770528] v27'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe007d040 con 0x7f5fdc017050 2024-05-08T18:51:44.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.542+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94481878775120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d27970 con 0x7f5fdc017050 2024-05-08T18:51:44.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.542+0000 7f5fee319800 20 add_watcher() i=0 2024-05-08T18:51:44.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.542+0000 7f5fee319800 20 add_watcher() i=1 2024-05-08T18:51:44.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.542+0000 7f5fee319800 20 add_watcher() i=2 2024-05-08T18:51:44.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.542+0000 7f5fee319800 20 add_watcher() i=3 2024-05-08T18:51:44.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.542+0000 7f5fee319800 20 add_watcher() i=4 2024-05-08T18:51:44.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.542+0000 7f5fee319800 20 add_watcher() i=5 2024-05-08T18:51:44.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.542+0000 7f5fee319800 20 add_watcher() i=6 2024-05-08T18:51:44.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.543+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94481878775120] v27'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe007d040 con 0x7f5fdc017050 2024-05-08T18:51:44.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.543+0000 7f5fee319800 20 add_watcher() i=7 2024-05-08T18:51:44.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.543+0000 7f5fee319800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:44.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.543+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d2ae50 con 0x55ee46d16c80 2024-05-08T18:51:44.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.544+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5fe007d040 con 0x55ee46d16c80 2024-05-08T18:51:44.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.544+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94481878772624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d28350 con 0x55ee46d16c80 2024-05-08T18:51:44.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.544+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94481878772624] v27'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5fe007d040 con 0x55ee46d16c80 2024-05-08T18:51:44.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.545+0000 7f5ea1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:44.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.545+0000 7f5fee319800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:44.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.545+0000 7f5fee319800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:44.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.545+0000 7f5fee319800 5 note: GC not initialized 2024-05-08T18:51:44.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.545+0000 7f5ea0fe1640 20 reqs_thread_entry: start 2024-05-08T18:51:44.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.545+0000 7f5fee319800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:44.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.545+0000 7f5fee319800 20 Filter name: none 2024-05-08T18:51:44.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.545+0000 7f5e1a7fc640 20 reqs_thread_entry: start 2024-05-08T18:51:44.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.545+0000 7f5fee319800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.545+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d5de40 con 0x55ee46d16c80 2024-05-08T18:51:44.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.546+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5fe007d040 con 0x55ee46d16c80 2024-05-08T18:51:44.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.546+0000 7f5fee319800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:51:44.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.546+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d5f230 con 0x7f5fdc017050 2024-05-08T18:51:44.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.546+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f5fe007d040 con 0x7f5fdc017050 2024-05-08T18:51:44.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.547+0000 7f5ea1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:44.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.547+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94481878772624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d2a130 con 0x55ee46d16c80 2024-05-08T18:51:44.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.548+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94481878772624] v27'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5fe007d040 con 0x55ee46d16c80 2024-05-08T18:51:44.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.548+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94481878751248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d26b90 con 0x7f5fe4014070 2024-05-08T18:51:44.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.549+0000 7f5febe11640 1 -- 172.21.15.132:0/3399759157 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94481878751248] v27'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc01ac60 con 0x7f5fe4014070 2024-05-08T18:51:44.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.549+0000 7f5fee319800 20 remove_watcher() i=0 2024-05-08T18:51:44.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.549+0000 7f5fee319800 2 removed watcher, disabling cache 2024-05-08T18:51:44.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.549+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94481878757776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d21810 con 0x55ee46d16c80 2024-05-08T18:51:44.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.550+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94481878757776] v27'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe007d040 con 0x55ee46d16c80 2024-05-08T18:51:44.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.550+0000 7f5fee319800 20 remove_watcher() i=1 2024-05-08T18:51:44.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.550+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94481878759312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d21810 con 0x55ee46d1b330 2024-05-08T18:51:44.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.551+0000 7f5fec612640 1 -- 172.21.15.132:0/3399759157 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94481878759312] v27'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe403c020 con 0x55ee46d1b330 2024-05-08T18:51:44.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.551+0000 7f5fee319800 20 remove_watcher() i=2 2024-05-08T18:51:44.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.551+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94481878763472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d21810 con 0x7f5fe4014070 2024-05-08T18:51:44.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.552+0000 7f5febe11640 1 -- 172.21.15.132:0/3399759157 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94481878763472] v27'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fdc01ac60 con 0x7f5fe4014070 2024-05-08T18:51:44.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.552+0000 7f5fee319800 20 remove_watcher() i=3 2024-05-08T18:51:44.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.552+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94481878765808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d247d0 con 0x55ee46d16c80 2024-05-08T18:51:44.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.553+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94481878765808] v27'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe007d040 con 0x55ee46d16c80 2024-05-08T18:51:44.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.553+0000 7f5fee319800 20 remove_watcher() i=4 2024-05-08T18:51:44.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.553+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94481878768480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d21810 con 0x7f5fdc017050 2024-05-08T18:51:44.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.554+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94481878768480] v27'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe007d040 con 0x7f5fdc017050 2024-05-08T18:51:44.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.554+0000 7f5fee319800 20 remove_watcher() i=5 2024-05-08T18:51:44.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.554+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94481878770528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d21810 con 0x7f5fdc017050 2024-05-08T18:51:44.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.555+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94481878770528] v27'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe007d040 con 0x7f5fdc017050 2024-05-08T18:51:44.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.555+0000 7f5fee319800 20 remove_watcher() i=6 2024-05-08T18:51:44.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.555+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94481878775120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ee46d21810 con 0x7f5fdc017050 2024-05-08T18:51:44.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.556+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94481878775120] v27'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe007d040 con 0x7f5fdc017050 2024-05-08T18:51:44.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.556+0000 7f5fee319800 20 remove_watcher() i=7 2024-05-08T18:51:44.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.556+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f5fdc017050 msgr2=0x7f5fdc02d870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.556+0000 7f5fee319800 1 --2- 172.21.15.132:0/3399759157 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f5fdc017050 0x7f5fdc02d870 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.556+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ee46d16c80 msgr2=0x55ee46d190f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.556+0000 7f5fee319800 1 --2- 172.21.15.132:0/3399759157 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ee46d16c80 0x55ee46d190f0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.556+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f5fe4014070 msgr2=0x7f5fe4055020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 --2- 172.21.15.132:0/3399759157 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f5fe4014070 0x7f5fe4055020 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ee46d1b330 msgr2=0x55ee46d1d740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 --2- 172.21.15.132:0/3399759157 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ee46d1b330 0x55ee46d1d740 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5eb403bba0 msgr2=0x7f5eb403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 --2- 172.21.15.132:0/3399759157 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5eb403bba0 0x7f5eb403e060 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc000c00 tx=0x7f5fdc047000 comp rx=0 tx=0).stop 2024-05-08T18:51:44.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46d03c50 msgr2=0x55ee46d0b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 --2- 172.21.15.132:0/3399759157 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46d03c50 0x55ee46d0b1d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4052cf0 tx=0x7f5fe4052d20 comp rx=0 tx=0).stop 2024-05-08T18:51:44.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 reap_dead start 2024-05-08T18:51:44.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5feb610640 1 -- 172.21.15.132:0/3399759157 reap_dead start 2024-05-08T18:51:44.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 shutdown_connections 2024-05-08T18:51:44.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 >> 172.21.15.132:0/3399759157 conn(0x55ee46cfff60 msgr2=0x55ee46cfd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 shutdown_connections 2024-05-08T18:51:44.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 -- 172.21.15.132:0/3399759157 wait complete. 2024-05-08T18:51:44.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 -- 172.21.15.132:0/1370755884 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ec403bb50 msgr2=0x7f5ec403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 --2- 172.21.15.132:0/1370755884 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ec403bb50 0x7f5ec403e010 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x55ee46ce3080 tx=0x7f5fdc018e70 comp rx=0 tx=0).stop 2024-05-08T18:51:44.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 -- 172.21.15.132:0/1370755884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46cf6950 msgr2=0x55ee46cf6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 --2- 172.21.15.132:0/1370755884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46cf6950 0x55ee46cf6d70 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x55ee46ce2fc0 tx=0x7f5fe4018830 comp rx=0 tx=0).stop 2024-05-08T18:51:44.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 -- 172.21.15.132:0/1370755884 shutdown_connections 2024-05-08T18:51:44.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 --2- 172.21.15.132:0/1370755884 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ec403bb50 0x7f5ec403e010 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 --2- 172.21.15.132:0/1370755884 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46cf6950 0x55ee46cf6d70 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 -- 172.21.15.132:0/1370755884 >> 172.21.15.132:0/1370755884 conn(0x55ee46cea9f0 msgr2=0x55ee46ceadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 -- 172.21.15.132:0/1370755884 shutdown_connections 2024-05-08T18:51:44.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 -- 172.21.15.132:0/1370755884 wait complete. 2024-05-08T18:51:44.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 -- 172.21.15.132:0/1534495857 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ee46be4570 msgr2=0x55ee46ce2660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 --2- 172.21.15.132:0/1534495857 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ee46be4570 0x55ee46ce2660 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.557+0000 7f5fee319800 1 -- 172.21.15.132:0/1534495857 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ee46ce4f40 msgr2=0x55ee46ce7330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.558+0000 7f5fee319800 1 --2- 172.21.15.132:0/1534495857 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ee46ce4f40 0x55ee46ce7330 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.558+0000 7f5fee319800 1 -- 172.21.15.132:0/1534495857 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ed403bb50 msgr2=0x7f5ed403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.558+0000 7f5fee319800 1 --2- 172.21.15.132:0/1534495857 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ed403bb50 0x7f5ed403e010 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0054000 tx=0x7f5fe004e000 comp rx=0 tx=0).stop 2024-05-08T18:51:44.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.558+0000 7f5fee319800 1 -- 172.21.15.132:0/1534495857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46b534c0 msgr2=0x55ee46cdb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.558+0000 7f5fee319800 1 --2- 172.21.15.132:0/1534495857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46b534c0 0x55ee46cdb420 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc001de0 tx=0x7f5fdc000ed0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.558+0000 7f5fee319800 1 -- 172.21.15.132:0/1534495857 shutdown_connections 2024-05-08T18:51:44.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.558+0000 7f5fee319800 1 --2- 172.21.15.132:0/1534495857 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ee46ce4f40 0x55ee46ce7330 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.558+0000 7f5fee319800 1 --2- 172.21.15.132:0/1534495857 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ee46be4570 0x55ee46ce2660 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.558+0000 7f5fee319800 1 --2- 172.21.15.132:0/1534495857 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ed403bb50 0x7f5ed403e010 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.558+0000 7f5fee319800 1 --2- 172.21.15.132:0/1534495857 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ee46b534c0 0x55ee46cdb420 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.558+0000 7f5fee319800 1 -- 172.21.15.132:0/1534495857 >> 172.21.15.132:0/1534495857 conn(0x55ee46bda730 msgr2=0x55ee46bdf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.558+0000 7f5fee319800 1 -- 172.21.15.132:0/1534495857 shutdown_connections 2024-05-08T18:51:44.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.558+0000 7f5fee319800 1 -- 172.21.15.132:0/1534495857 wait complete. 2024-05-08T18:51:44.571 INFO:teuthology.orchestra.run.smithi132.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-08T18:51:44.571 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:51:44.571 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-05-08T18:51:44.572 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-05-08T18:51:44.572 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-05-08T18:51:44.617 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:44.618 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:44.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.619+0000 7f98bfd2b800 1 Processor -- start 2024-05-08T18:51:44.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.619+0000 7f98bfd2b800 1 -- start start 2024-05-08T18:51:44.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.619+0000 7f98bfd2b800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x558a37e8e540 0x558a37e8e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.619+0000 7f98bfd2b800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558a37e8ef90 con 0x558a37e91530 2024-05-08T18:51:44.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.619+0000 7f98bfd2b800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x558a37d30e20 con 0x558a37e8e540 2024-05-08T18:51:44.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.620+0000 7f98bb952640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x558a37e8e540 0x558a37e8e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.620+0000 7f98b3fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x558a37e91530 0x558a37e919e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:49052/0 (socket says 172.21.15.132:49052) 2024-05-08T18:51:44.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.620+0000 7f98b3fff640 1 -- 172.21.15.132:0/111912130 learned_addr learned my addr 172.21.15.132:0/111912130 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:51:44.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.620+0000 7f98bb952640 1 -- 172.21.15.132:0/111912130 >> v1:172.21.15.42:6789/0 conn(0x558a37e91530 legacy=0x558a37e919e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.620+0000 7f98bb952640 1 -- 172.21.15.132:0/111912130 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a37e920f0 con 0x558a37e8e540 2024-05-08T18:51:44.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.622+0000 7f98bb952640 1 --2- 172.21.15.132:0/111912130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e8e540 0x558a37e8e960 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00a470 tx=0x7f98ac01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f13e73f8b18b529 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.622+0000 7f98bb151640 1 -- 172.21.15.132:0/111912130 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98ac057070 con 0x558a37e8e540 2024-05-08T18:51:44.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.622+0000 7f98bb151640 1 -- 172.21.15.132:0/111912130 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98ac04adc0 con 0x558a37e8e540 2024-05-08T18:51:44.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.622+0000 7f98bb151640 1 -- 172.21.15.132:0/111912130 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98ac052590 con 0x558a37e8e540 2024-05-08T18:51:44.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.622+0000 7f98bfd2b800 1 -- 172.21.15.132:0/111912130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e8e540 msgr2=0x558a37e8e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.622+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/111912130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e8e540 0x558a37e8e960 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00a470 tx=0x7f98ac01ce90 comp rx=0 tx=0).stop 2024-05-08T18:51:44.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.622+0000 7f98bfd2b800 1 -- 172.21.15.132:0/111912130 shutdown_connections 2024-05-08T18:51:44.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.622+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/111912130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e8e540 0x558a37e8e960 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.622+0000 7f98bfd2b800 1 -- 172.21.15.132:0/111912130 >> 172.21.15.132:0/111912130 conn(0x558a37e89eb0 msgr2=0x558a37e8c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.622+0000 7f98bfd2b800 1 -- 172.21.15.132:0/111912130 shutdown_connections 2024-05-08T18:51:44.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.622+0000 7f98bfd2b800 1 -- 172.21.15.132:0/111912130 wait complete. 2024-05-08T18:51:44.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.636+0000 7f98bfd2b800 1 Processor -- start 2024-05-08T18:51:44.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.636+0000 7f98bfd2b800 1 -- start start 2024-05-08T18:51:44.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.636+0000 7f98bfd2b800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e8e540 0x558a37f817a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.636+0000 7f98bfd2b800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558a37ddb5c0 con 0x558a37e8e540 2024-05-08T18:51:44.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.637+0000 7f98bb952640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e8e540 0x558a37f817a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.637+0000 7f98bb952640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e8e540 0x558a37f817a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56502/0 (socket says 172.21.15.132:56502) 2024-05-08T18:51:44.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.637+0000 7f98bb952640 1 -- 172.21.15.132:0/1100693847 learned_addr learned my addr 172.21.15.132:0/1100693847 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.637+0000 7f98bb952640 1 -- 172.21.15.132:0/1100693847 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a37f81d70 con 0x558a37e8e540 2024-05-08T18:51:44.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.637+0000 7f98bb952640 1 --2- 172.21.15.132:0/1100693847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e8e540 0x558a37f817a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f98ac055040 tx=0x7f98ac04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf1339d57254090 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.637+0000 7f97a9e0b640 1 -- 172.21.15.132:0/1100693847 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98ac057040 con 0x558a37e8e540 2024-05-08T18:51:44.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.638+0000 7f97a9e0b640 1 -- 172.21.15.132:0/1100693847 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98ac063070 con 0x558a37e8e540 2024-05-08T18:51:44.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.638+0000 7f97a9e0b640 1 -- 172.21.15.132:0/1100693847 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98ac05d790 con 0x558a37e8e540 2024-05-08T18:51:44.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.638+0000 7f98bfd2b800 1 -- 172.21.15.132:0/1100693847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e8e540 msgr2=0x558a37f817a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.638+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/1100693847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e8e540 0x558a37f817a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f98ac055040 tx=0x7f98ac04c000 comp rx=0 tx=0).stop 2024-05-08T18:51:44.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.638+0000 7f98bfd2b800 1 -- 172.21.15.132:0/1100693847 shutdown_connections 2024-05-08T18:51:44.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.638+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/1100693847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e8e540 0x558a37f817a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.638+0000 7f98bfd2b800 1 -- 172.21.15.132:0/1100693847 >> 172.21.15.132:0/1100693847 conn(0x558a37e89eb0 msgr2=0x558a37f7d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.638+0000 7f98bfd2b800 1 -- 172.21.15.132:0/1100693847 shutdown_connections 2024-05-08T18:51:44.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.638+0000 7f98bfd2b800 1 -- 172.21.15.132:0/1100693847 wait complete. 2024-05-08T18:51:44.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.639+0000 7f98bfd2b800 1 Processor -- start 2024-05-08T18:51:44.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.639+0000 7f98bfd2b800 1 -- start start 2024-05-08T18:51:44.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.639+0000 7f98bfd2b800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e8e540 0x558a37f89230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.639+0000 7f98bfd2b800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558a37e99a00 con 0x558a37e8e540 2024-05-08T18:51:44.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.639+0000 7f98bb952640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e8e540 0x558a37f89230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.639+0000 7f98bb952640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e8e540 0x558a37f89230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56512/0 (socket says 172.21.15.132:56512) 2024-05-08T18:51:44.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.639+0000 7f98bb952640 1 -- 172.21.15.132:0/3460215393 learned_addr learned my addr 172.21.15.132:0/3460215393 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.639+0000 7f98bb952640 1 -- 172.21.15.132:0/3460215393 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a37f89770 con 0x558a37e8e540 2024-05-08T18:51:44.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.639+0000 7f98bb952640 1 --2- 172.21.15.132:0/3460215393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e8e540 0x558a37f89230 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00a470 tx=0x7f98ac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.640+0000 7f97a3fff640 1 -- 172.21.15.132:0/3460215393 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98ac057050 con 0x558a37e8e540 2024-05-08T18:51:44.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.640+0000 7f97a3fff640 1 -- 172.21.15.132:0/3460215393 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98ac05dc90 con 0x558a37e8e540 2024-05-08T18:51:44.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.640+0000 7f98bfd2b800 1 -- 172.21.15.132:0/3460215393 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a37f89a00 con 0x558a37e8e540 2024-05-08T18:51:44.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.640+0000 7f97a3fff640 1 -- 172.21.15.132:0/3460215393 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98ac052440 con 0x558a37e8e540 2024-05-08T18:51:44.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.640+0000 7f98bfd2b800 1 -- 172.21.15.132:0/3460215393 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a37f8c6b0 con 0x558a37e8e540 2024-05-08T18:51:44.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.641+0000 7f97a3fff640 1 -- 172.21.15.132:0/3460215393 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f98ac0525e0 con 0x558a37e8e540 2024-05-08T18:51:44.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.641+0000 7f97a3fff640 1 --2- 172.21.15.132:0/3460215393 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f97a403bba0 0x7f97a403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.641+0000 7f97a3fff640 1 -- 172.21.15.132:0/3460215393 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f98ac093f30 con 0x558a37e8e540 2024-05-08T18:51:44.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.641+0000 7f98b3fff640 1 --2- 172.21.15.132:0/3460215393 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f97a403bba0 0x7f97a403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.641+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/3460215393 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558a37e91530 0x558a37f90470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.641+0000 7f98bfd2b800 1 -- 172.21.15.132:0/3460215393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558a37f909f0 con 0x558a37e91530 2024-05-08T18:51:44.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.641+0000 7f98bc153640 1 --2- 172.21.15.132:0/3460215393 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558a37e91530 0x558a37f90470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.641+0000 7f98b3fff640 1 --2- 172.21.15.132:0/3460215393 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f97a403bba0 0x7f97a403e060 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f98a4000f60 tx=0x7f98a40012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.641+0000 7f98bc153640 1 --2- 172.21.15.132:0/3460215393 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558a37e91530 0x558a37f90470 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.642+0000 7f98bc153640 1 -- 172.21.15.132:0/3460215393 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98b400a4a0 con 0x558a37e91530 2024-05-08T18:51:44.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.642+0000 7f98bfd2b800 1 -- 172.21.15.132:0/3460215393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558a37f8da40 con 0x558a37e91530 2024-05-08T18:51:44.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.642+0000 7f98bc153640 1 -- 172.21.15.132:0/3460215393 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98b400a4a0 con 0x558a37e91530 2024-05-08T18:51:44.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.642+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/3460215393 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558a37f92d00 0x558a37f950f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.642+0000 7f98bfd2b800 1 -- 172.21.15.132:0/3460215393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558a37f957e0 con 0x558a37f92d00 2024-05-08T18:51:44.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.642+0000 7f98bb952640 1 --2- 172.21.15.132:0/3460215393 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558a37f92d00 0x558a37f950f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.642+0000 7f98bb952640 1 --2- 172.21.15.132:0/3460215393 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558a37f92d00 0x558a37f950f0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.643+0000 7f98bb952640 1 -- 172.21.15.132:0/3460215393 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f98ac078070 con 0x558a37f92d00 2024-05-08T18:51:44.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.643+0000 7f98bfd2b800 1 -- 172.21.15.132:0/3460215393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558a37f91ba0 con 0x558a37e91530 2024-05-08T18:51:44.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.643+0000 7f98bc153640 1 -- 172.21.15.132:0/3460215393 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98b400a4a0 con 0x558a37e91530 2024-05-08T18:51:44.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.643+0000 7f98bfd2b800 1 -- 172.21.15.132:0/3460215393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558a37f92080 con 0x558a37e91530 2024-05-08T18:51:44.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.643+0000 7f98bc153640 1 -- 172.21.15.132:0/3460215393 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f98b400a4a0 con 0x558a37e91530 2024-05-08T18:51:44.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.643+0000 7f98bfd2b800 1 Processor -- start 2024-05-08T18:51:44.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.644+0000 7f98bfd2b800 1 -- start start 2024-05-08T18:51:44.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.644+0000 7f98bfd2b800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e910d0 0x558a37e8f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.644+0000 7f98bfd2b800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558a37d81fc0 con 0x558a37e910d0 2024-05-08T18:51:44.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.644+0000 7f98bc153640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e910d0 0x558a37e8f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.644+0000 7f98bc153640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e910d0 0x558a37e8f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56520/0 (socket says 172.21.15.132:56520) 2024-05-08T18:51:44.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.644+0000 7f98bc153640 1 -- 172.21.15.132:0/108024370 learned_addr learned my addr 172.21.15.132:0/108024370 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.644+0000 7f98bc153640 1 -- 172.21.15.132:0/108024370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a37e8fa80 con 0x558a37e910d0 2024-05-08T18:51:44.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.644+0000 7f98bc153640 1 --2- 172.21.15.132:0/108024370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e910d0 0x558a37e8f540 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x558a37f90db0 tx=0x7f98b4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.645+0000 7f97a17fa640 1 -- 172.21.15.132:0/108024370 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b4014450 con 0x558a37e910d0 2024-05-08T18:51:44.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.645+0000 7f97a17fa640 1 -- 172.21.15.132:0/108024370 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b4014610 con 0x558a37e910d0 2024-05-08T18:51:44.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.645+0000 7f97a17fa640 1 -- 172.21.15.132:0/108024370 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b4014930 con 0x558a37e910d0 2024-05-08T18:51:44.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.645+0000 7f98bfd2b800 1 -- 172.21.15.132:0/108024370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a37e8fd10 con 0x558a37e910d0 2024-05-08T18:51:44.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.645+0000 7f98bfd2b800 1 -- 172.21.15.132:0/108024370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a37e90210 con 0x558a37e910d0 2024-05-08T18:51:44.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.645+0000 7f97a17fa640 1 -- 172.21.15.132:0/108024370 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f98b4011040 con 0x558a37e910d0 2024-05-08T18:51:44.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.646+0000 7f97a17fa640 1 --2- 172.21.15.132:0/108024370 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f979403bb50 0x7f979403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.646+0000 7f97a17fa640 1 -- 172.21.15.132:0/108024370 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f98b401e070 con 0x558a37e910d0 2024-05-08T18:51:44.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.646+0000 7f98bb952640 1 --2- 172.21.15.132:0/108024370 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f979403bb50 0x7f979403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.646+0000 7f98bfd2b800 1 Processor -- start 2024-05-08T18:51:44.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.646+0000 7f98bfd2b800 1 -- start start 2024-05-08T18:51:44.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.646+0000 7f98bb952640 1 --2- 172.21.15.132:0/108024370 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f979403bb50 0x7f979403e010 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x558a37f90e50 tx=0x7f98ac05cf30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.646+0000 7f98bfd2b800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37fb3c00 0x558a37fb4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.646+0000 7f98bfd2b800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558a37f82030 con 0x558a37fb3c00 2024-05-08T18:51:44.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.646+0000 7f98bc153640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37fb3c00 0x558a37fb4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.646+0000 7f98bc153640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37fb3c00 0x558a37fb4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56536/0 (socket says 172.21.15.132:56536) 2024-05-08T18:51:44.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.646+0000 7f98bc153640 1 -- 172.21.15.132:0/2835303276 learned_addr learned my addr 172.21.15.132:0/2835303276 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.647+0000 7f98bc153640 1 -- 172.21.15.132:0/2835303276 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a37fb45f0 con 0x558a37fb3c00 2024-05-08T18:51:44.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.647+0000 7f98bc153640 1 --2- 172.21.15.132:0/2835303276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37fb3c00 0x558a37fb4020 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f98b4052cd0 tx=0x7f98b402b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaca419f5e0f5994 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.664 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.647+0000 7f979affd640 1 -- 172.21.15.132:0/2835303276 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b4028070 con 0x558a37fb3c00 2024-05-08T18:51:44.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.647+0000 7f979affd640 1 -- 172.21.15.132:0/2835303276 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b4016e00 con 0x558a37fb3c00 2024-05-08T18:51:44.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.647+0000 7f979affd640 1 -- 172.21.15.132:0/2835303276 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b40165b0 con 0x558a37fb3c00 2024-05-08T18:51:44.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.647+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2835303276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37fb3c00 msgr2=0x558a37fb4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.647+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/2835303276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37fb3c00 0x558a37fb4020 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f98b4052cd0 tx=0x7f98b402b720 comp rx=0 tx=0).stop 2024-05-08T18:51:44.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.647+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2835303276 shutdown_connections 2024-05-08T18:51:44.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.647+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/2835303276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37fb3c00 0x558a37fb4020 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.647+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2835303276 >> 172.21.15.132:0/2835303276 conn(0x558a37faff60 msgr2=0x558a37fadfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.647+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2835303276 shutdown_connections 2024-05-08T18:51:44.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.647+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2835303276 wait complete. 2024-05-08T18:51:44.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.648+0000 7f98bfd2b800 1 Processor -- start 2024-05-08T18:51:44.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.648+0000 7f98bfd2b800 1 -- start start 2024-05-08T18:51:44.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.648+0000 7f98bfd2b800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37fb3c00 0x558a37fbb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.648+0000 7f98bfd2b800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558a37fb4d60 con 0x558a37fb3c00 2024-05-08T18:51:44.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.648+0000 7f98bc153640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37fb3c00 0x558a37fbb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.648+0000 7f98bc153640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37fb3c00 0x558a37fbb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56538/0 (socket says 172.21.15.132:56538) 2024-05-08T18:51:44.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.648+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 learned_addr learned my addr 172.21.15.132:0/2348007010 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.648+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a37fbb730 con 0x558a37fb3c00 2024-05-08T18:51:44.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.649+0000 7f98bc153640 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37fb3c00 0x558a37fbb1f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f98b4051040 tx=0x7f98b4052c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.649+0000 7f97997fa640 1 -- 172.21.15.132:0/2348007010 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b4031070 con 0x558a37fb3c00 2024-05-08T18:51:44.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.649+0000 7f97997fa640 1 -- 172.21.15.132:0/2348007010 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b4011700 con 0x558a37fb3c00 2024-05-08T18:51:44.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.649+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a37fbb9c0 con 0x558a37fb3c00 2024-05-08T18:51:44.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.649+0000 7f97997fa640 1 -- 172.21.15.132:0/2348007010 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b4001910 con 0x558a37fb3c00 2024-05-08T18:51:44.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.649+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a37fbe670 con 0x558a37fb3c00 2024-05-08T18:51:44.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.650+0000 7f97997fa640 1 -- 172.21.15.132:0/2348007010 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f98b4034070 con 0x558a37fb3c00 2024-05-08T18:51:44.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.650+0000 7f97997fa640 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f978403bb50 0x7f978403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.650+0000 7f97997fa640 1 -- 172.21.15.132:0/2348007010 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f98b400e040 con 0x558a37fb3c00 2024-05-08T18:51:44.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.650+0000 7f98bb952640 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f978403bb50 0x7f978403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.650+0000 7f98bfd2b800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.650+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558a37fc6c90 0x558a37fc9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.650+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558a37fc98a0 con 0x558a37fc6c90 2024-05-08T18:51:44.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.650+0000 7f98bb952640 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f978403bb50 0x7f978403e010 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f98ac092490 tx=0x7f98ac07f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.650+0000 7f98b3fff640 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558a37fc6c90 0x558a37fc9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.651+0000 7f98b3fff640 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558a37fc6c90 0x558a37fc9150 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.651+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98a4009050 con 0x558a37fc6c90 2024-05-08T18:51:44.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.651+0000 7f98bfd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.651+0000 7f98bfd2b800 20 realm 2024-05-08T18:51:44.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.651+0000 7f98bfd2b800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.651+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558a37fc60e0 con 0x558a37fc6c90 2024-05-08T18:51:44.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.651+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98a4009050 con 0x558a37fc6c90 2024-05-08T18:51:44.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.651+0000 7f98bfd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.651+0000 7f98bfd2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.651+0000 7f98bfd2b800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.651+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558a37fca380 con 0x558a37fc6c90 2024-05-08T18:51:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.651+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98a4009050 con 0x558a37fc6c90 2024-05-08T18:51:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.651+0000 7f98bfd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.651+0000 7f98bfd2b800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.651+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcac50 con 0x558a37fc6c90 2024-05-08T18:51:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.651+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98a4009050 con 0x558a37fc6c90 2024-05-08T18:51:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.651+0000 7f98bfd2b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.651+0000 7f98bfd2b800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.651+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558a37fcb500 0x558a37fcd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.651+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558a37fce030 con 0x558a37fcb500 2024-05-08T18:51:44.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.652+0000 7f98bc153640 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558a37fcb500 0x558a37fcd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.652+0000 7f98bc153640 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558a37fcb500 0x558a37fcd8f0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.652+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f98b403d070 con 0x558a37fcb500 2024-05-08T18:51:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.652+0000 7f98bfd2b800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.652+0000 7f98bfd2b800 20 searching for the correct realm 2024-05-08T18:51:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.652+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x558a37fcb500 2024-05-08T18:51:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.653+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b403d070 con 0x558a37fcb500 2024-05-08T18:51:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.653+0000 7f98bc153640 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f98b4036070 0x7f98b4055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.653+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x7f98b4036070 2024-05-08T18:51:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.653+0000 7f98bb952640 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f98b4036070 0x7f98b4055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.653+0000 7f98bb952640 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f98b4036070 0x7f98b4055a20 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.653+0000 7f98bb952640 1 -- 172.21.15.132:0/2348007010 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac078070 con 0x7f98b4036070 2024-05-08T18:51:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.653+0000 7f98bb952640 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f98ac092510 0x7f98ac092910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.653+0000 7f98bb952640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x7f98ac092510 2024-05-08T18:51:44.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.654+0000 7f98b3fff640 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f98ac092510 0x7f98ac092910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.654+0000 7f98b3fff640 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f98ac092510 0x7f98ac092910 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.654+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a4009050 con 0x7f98ac092510 2024-05-08T18:51:44.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.654+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x558a37fc6c90 2024-05-08T18:51:44.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.654+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a4009050 con 0x558a37fc6c90 2024-05-08T18:51:44.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.654+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x558a37fc6c90 2024-05-08T18:51:44.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.655+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a4029040 con 0x558a37fc6c90 2024-05-08T18:51:44.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.655+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x7f98ac092510 2024-05-08T18:51:44.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.655+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a4029040 con 0x7f98ac092510 2024-05-08T18:51:44.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.655+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x7f98ac092510 2024-05-08T18:51:44.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.655+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a4029040 con 0x7f98ac092510 2024-05-08T18:51:44.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.655+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x7f98b4036070 2024-05-08T18:51:44.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.655+0000 7f98bb952640 1 -- 172.21.15.132:0/2348007010 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac078070 con 0x7f98b4036070 2024-05-08T18:51:44.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.656+0000 7f98bb952640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x558a37fcb500 2024-05-08T18:51:44.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.656+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b403d070 con 0x558a37fcb500 2024-05-08T18:51:44.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.656+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x558a37fc6c90 2024-05-08T18:51:44.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.656+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a4029040 con 0x558a37fc6c90 2024-05-08T18:51:44.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.656+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x7f98ac092510 2024-05-08T18:51:44.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.656+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a4029040 con 0x7f98ac092510 2024-05-08T18:51:44.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.656+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x558a37fc6c90 2024-05-08T18:51:44.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.657+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f98a4029040 con 0x558a37fc6c90 2024-05-08T18:51:44.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.657+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x7f98b4036070 2024-05-08T18:51:44.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.657+0000 7f98bb952640 1 -- 172.21.15.132:0/2348007010 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f98ac078070 con 0x7f98b4036070 2024-05-08T18:51:44.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.657+0000 7f98bb952640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x558a37fcb500 2024-05-08T18:51:44.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.657+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f98b403d070 con 0x558a37fcb500 2024-05-08T18:51:44.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.657+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x558a37fcb500 2024-05-08T18:51:44.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.657+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b403d070 con 0x558a37fcb500 2024-05-08T18:51:44.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.657+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x7f98ac092510 2024-05-08T18:51:44.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.657+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a4029040 con 0x7f98ac092510 2024-05-08T18:51:44.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.657+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x558a37fcb500 2024-05-08T18:51:44.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.658+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b403d070 con 0x558a37fcb500 2024-05-08T18:51:44.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.658+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x558a37fcb500 2024-05-08T18:51:44.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.658+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b403d070 con 0x558a37fcb500 2024-05-08T18:51:44.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.658+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x558a37fc6c90 2024-05-08T18:51:44.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.658+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a4029040 con 0x558a37fc6c90 2024-05-08T18:51:44.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.658+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x558a37fc6c90 2024-05-08T18:51:44.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.658+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f98a4029040 con 0x558a37fc6c90 2024-05-08T18:51:44.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.658+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x7f98ac092510 2024-05-08T18:51:44.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.659+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a4029040 con 0x7f98ac092510 2024-05-08T18:51:44.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.659+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x558a37fcb500 2024-05-08T18:51:44.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.659+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b403d070 con 0x558a37fcb500 2024-05-08T18:51:44.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.659+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x7f98b4036070 2024-05-08T18:51:44.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.659+0000 7f98bb952640 1 -- 172.21.15.132:0/2348007010 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac078070 con 0x7f98b4036070 2024-05-08T18:51:44.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.659+0000 7f98bb952640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x558a37fc6c90 2024-05-08T18:51:44.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.659+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a4029040 con 0x558a37fc6c90 2024-05-08T18:51:44.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.659+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x7f98b4036070 2024-05-08T18:51:44.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.660+0000 7f98bb952640 1 -- 172.21.15.132:0/2348007010 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac078070 con 0x7f98b4036070 2024-05-08T18:51:44.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.660+0000 7f98bb952640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x558a37fcb500 2024-05-08T18:51:44.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.660+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b403d070 con 0x558a37fcb500 2024-05-08T18:51:44.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.660+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x7f98ac092510 2024-05-08T18:51:44.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.661+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a4029040 con 0x7f98ac092510 2024-05-08T18:51:44.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.661+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x7f98b4036070 2024-05-08T18:51:44.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.661+0000 7f98bb952640 1 -- 172.21.15.132:0/2348007010 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac078070 con 0x7f98b4036070 2024-05-08T18:51:44.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.661+0000 7f98bb952640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x558a37fcb500 2024-05-08T18:51:44.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.661+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b403d070 con 0x558a37fcb500 2024-05-08T18:51:44.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.661+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x7f98ac092510 2024-05-08T18:51:44.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.662+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98a4029040 con 0x7f98ac092510 2024-05-08T18:51:44.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.662+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x558a37fc6c90 2024-05-08T18:51:44.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.662+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f98a4029040 con 0x558a37fc6c90 2024-05-08T18:51:44.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.662+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcfa10 con 0x7f98b4036070 2024-05-08T18:51:44.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.662+0000 7f98bb952640 1 -- 172.21.15.132:0/2348007010 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98ac078070 con 0x7f98b4036070 2024-05-08T18:51:44.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.662+0000 7f98bfd2b800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:44.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.662+0000 7f98bfd2b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:44.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.662+0000 7f98bfd2b800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:44.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.662+0000 7f98bfd2b800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:44.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.662+0000 7f98bfd2b800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:44.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.662+0000 7f98bfd2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:44.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.662+0000 7f98bfd2b800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.662+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558a37fceae0 con 0x558a37fc6c90 2024-05-08T18:51:44.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.662+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98a4029040 con 0x558a37fc6c90 2024-05-08T18:51:44.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.662+0000 7f98bfd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.662+0000 7f98bfd2b800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.662+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558a37fcf380 con 0x558a37fc6c90 2024-05-08T18:51:44.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.663+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98a4029040 con 0x558a37fc6c90 2024-05-08T18:51:44.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.663+0000 7f98bfd2b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:44.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.663+0000 7f98bfd2b800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.663+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558a37fce720 con 0x558a37fc6c90 2024-05-08T18:51:44.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.663+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f98a4029040 con 0x558a37fc6c90 2024-05-08T18:51:44.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.663+0000 7f98bfd2b800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:44.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.663+0000 7f98bfd2b800 20 zone default found 2024-05-08T18:51:44.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.663+0000 7f98bfd2b800 4 Realm: () 2024-05-08T18:51:44.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.663+0000 7f98bfd2b800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:44.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.663+0000 7f98bfd2b800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:44.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.663+0000 7f98bfd2b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:44.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.663+0000 7f98bfd2b800 20 zonegroup default 2024-05-08T18:51:44.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.663+0000 7f98bfd2b800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.663+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd0390 con 0x7f98b4036070 2024-05-08T18:51:44.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.663+0000 7f98bb952640 1 -- 172.21.15.132:0/2348007010 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f98ac078070 con 0x7f98b4036070 2024-05-08T18:51:44.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.663+0000 7f98bfd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.663+0000 7f98bfd2b800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.663+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd21a0 con 0x558a37fcb500 2024-05-08T18:51:44.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.663+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98b403d070 con 0x558a37fcb500 2024-05-08T18:51:44.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.663+0000 7f98bfd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.663+0000 7f98bfd2b800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.676 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.663+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd2670 con 0x558a37fcb500 2024-05-08T18:51:44.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.664+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98b403d070 con 0x558a37fcb500 2024-05-08T18:51:44.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.664+0000 7f98bfd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.664+0000 7f98bfd2b800 20 started sync module instance, tier type = 2024-05-08T18:51:44.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.664+0000 7f98bfd2b800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:44.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.664+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd15b0 con 0x7f98b4036070 2024-05-08T18:51:44.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.665+0000 7f98bb952640 1 -- 172.21.15.132:0/2348007010 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac078070 con 0x7f98b4036070 2024-05-08T18:51:44.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.665+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94052133181856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd2f80 con 0x7f98b4036070 2024-05-08T18:51:44.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.665+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd37d0 con 0x558a37fc6c90 2024-05-08T18:51:44.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.666+0000 7f98bb952640 1 -- 172.21.15.132:0/2348007010 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94052133181856] v27'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac078070 con 0x7f98b4036070 2024-05-08T18:51:44.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.666+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a4029040 con 0x558a37fc6c90 2024-05-08T18:51:44.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.666+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94052133186256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd3830 con 0x558a37fc6c90 2024-05-08T18:51:44.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.666+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd4340 con 0x558a37fcb500 2024-05-08T18:51:44.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.667+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94052133186256] v27'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a4029040 con 0x558a37fc6c90 2024-05-08T18:51:44.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.667+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b403d070 con 0x558a37fcb500 2024-05-08T18:51:44.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.667+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94052133191152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd4300 con 0x558a37fcb500 2024-05-08T18:51:44.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.667+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd4e70 con 0x7f98b4036070 2024-05-08T18:51:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.668+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94052133191152] v27'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b403d070 con 0x558a37fcb500 2024-05-08T18:51:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.668+0000 7f98bb952640 1 -- 172.21.15.132:0/2348007010 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac078070 con 0x7f98b4036070 2024-05-08T18:51:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.668+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94052133194112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd5260 con 0x7f98b4036070 2024-05-08T18:51:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.668+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd5cc0 con 0x558a37fc6c90 2024-05-08T18:51:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.670+0000 7f98bb952640 1 -- 172.21.15.132:0/2348007010 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94052133194112] v27'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac078070 con 0x7f98b4036070 2024-05-08T18:51:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.670+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a4029040 con 0x558a37fc6c90 2024-05-08T18:51:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.670+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94052133188384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd5cc0 con 0x558a37fc6c90 2024-05-08T18:51:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.670+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd6730 con 0x7f98ac092510 2024-05-08T18:51:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.671+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a4029040 con 0x7f98ac092510 2024-05-08T18:51:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.671+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94052133200416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd66f0 con 0x7f98ac092510 2024-05-08T18:51:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.671+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd76e0 con 0x7f98ac092510 2024-05-08T18:51:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.671+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94052133188384] v27'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a4029040 con 0x558a37fc6c90 2024-05-08T18:51:44.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.672+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94052133200416] v27'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a4029040 con 0x7f98ac092510 2024-05-08T18:51:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.672+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a4029040 con 0x7f98ac092510 2024-05-08T18:51:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.672+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94052133202720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd71c0 con 0x7f98ac092510 2024-05-08T18:51:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.672+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd7b90 con 0x7f98ac092510 2024-05-08T18:51:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.673+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94052133202720] v27'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a4029040 con 0x7f98ac092510 2024-05-08T18:51:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.673+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a4029040 con 0x7f98ac092510 2024-05-08T18:51:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.673+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94052133197728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd7b90 con 0x7f98ac092510 2024-05-08T18:51:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.673+0000 7f98bfd2b800 20 add_watcher() i=0 2024-05-08T18:51:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.673+0000 7f98bfd2b800 20 add_watcher() i=1 2024-05-08T18:51:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.673+0000 7f98bfd2b800 20 add_watcher() i=2 2024-05-08T18:51:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.673+0000 7f98bfd2b800 20 add_watcher() i=3 2024-05-08T18:51:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.673+0000 7f98bfd2b800 20 add_watcher() i=4 2024-05-08T18:51:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.673+0000 7f98bfd2b800 20 add_watcher() i=5 2024-05-08T18:51:44.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.673+0000 7f98bfd2b800 20 add_watcher() i=6 2024-05-08T18:51:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.674+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94052133197728] v27'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a4029040 con 0x7f98ac092510 2024-05-08T18:51:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.674+0000 7f98bfd2b800 20 add_watcher() i=7 2024-05-08T18:51:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.674+0000 7f98bfd2b800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.674+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558a37fdaef0 con 0x558a37fc6c90 2024-05-08T18:51:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.675+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f98a4029040 con 0x558a37fc6c90 2024-05-08T18:51:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.675+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94052133206096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd8120 con 0x558a37fc6c90 2024-05-08T18:51:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.675+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94052133206096] v27'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f98a4029040 con 0x558a37fc6c90 2024-05-08T18:51:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.676+0000 7f9771fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.676+0000 7f98bfd2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.676+0000 7f98bfd2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.676+0000 7f98bfd2b800 5 note: GC not initialized 2024-05-08T18:51:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.676+0000 7f9770fe1640 20 reqs_thread_entry: start 2024-05-08T18:51:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.676+0000 7f98bfd2b800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:44.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.676+0000 7f98bfd2b800 20 Filter name: none 2024-05-08T18:51:44.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.676+0000 7f96ea7fc640 20 reqs_thread_entry: start 2024-05-08T18:51:44.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.676+0000 7f98bfd2b800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.676+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558a3800dfa0 con 0x558a37fc6c90 2024-05-08T18:51:44.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.677+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f98a4029040 con 0x558a37fc6c90 2024-05-08T18:51:44.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.677+0000 7f98bfd2b800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:51:44.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.677+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558a3800f390 con 0x7f98ac092510 2024-05-08T18:51:44.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.677+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f98a4029040 con 0x7f98ac092510 2024-05-08T18:51:44.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.678+0000 7f9771fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:44.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.678+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94052133206096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fc4340 con 0x558a37fc6c90 2024-05-08T18:51:44.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.679+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94052133206096] v27'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f98a4029040 con 0x558a37fc6c90 2024-05-08T18:51:44.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.679+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94052133181856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd7850 con 0x7f98b4036070 2024-05-08T18:51:44.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.680+0000 7f98bb952640 1 -- 172.21.15.132:0/2348007010 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94052133181856] v27'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac078070 con 0x7f98b4036070 2024-05-08T18:51:44.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.680+0000 7f98bfd2b800 20 remove_watcher() i=0 2024-05-08T18:51:44.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.680+0000 7f98bfd2b800 2 removed watcher, disabling cache 2024-05-08T18:51:44.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.680+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94052133186256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd7850 con 0x558a37fc6c90 2024-05-08T18:51:44.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.681+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94052133186256] v27'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a4029040 con 0x558a37fc6c90 2024-05-08T18:51:44.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.681+0000 7f98bfd2b800 20 remove_watcher() i=1 2024-05-08T18:51:44.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.681+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94052133191152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd2ad0 con 0x558a37fcb500 2024-05-08T18:51:44.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.682+0000 7f98bc153640 1 -- 172.21.15.132:0/2348007010 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94052133191152] v27'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b403d070 con 0x558a37fcb500 2024-05-08T18:51:44.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.682+0000 7f98bfd2b800 20 remove_watcher() i=2 2024-05-08T18:51:44.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.682+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94052133194112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd7850 con 0x7f98b4036070 2024-05-08T18:51:44.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.683+0000 7f98bb952640 1 -- 172.21.15.132:0/2348007010 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94052133194112] v27'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98ac078070 con 0x7f98b4036070 2024-05-08T18:51:44.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.683+0000 7f98bfd2b800 20 remove_watcher() i=3 2024-05-08T18:51:44.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.683+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94052133188384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd3df0 con 0x558a37fc6c90 2024-05-08T18:51:44.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.684+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94052133188384] v27'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a4029040 con 0x558a37fc6c90 2024-05-08T18:51:44.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.684+0000 7f98bfd2b800 20 remove_watcher() i=4 2024-05-08T18:51:44.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.684+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94052133200416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd7850 con 0x7f98ac092510 2024-05-08T18:51:44.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.685+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94052133200416] v27'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a4029040 con 0x7f98ac092510 2024-05-08T18:51:44.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.685+0000 7f98bfd2b800 20 remove_watcher() i=5 2024-05-08T18:51:44.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.685+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94052133202720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd3320 con 0x7f98ac092510 2024-05-08T18:51:44.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.687+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94052133202720] v27'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a4029040 con 0x7f98ac092510 2024-05-08T18:51:44.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.687+0000 7f98bfd2b800 20 remove_watcher() i=6 2024-05-08T18:51:44.693 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.687+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94052133197728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558a37fd3320 con 0x7f98ac092510 2024-05-08T18:51:44.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94052133197728] v27'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98a4029040 con 0x7f98ac092510 2024-05-08T18:51:44.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 20 remove_watcher() i=7 2024-05-08T18:51:44.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f98ac092510 msgr2=0x7f98ac092910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f98ac092510 0x7f98ac092910 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558a37fc6c90 msgr2=0x558a37fc9150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558a37fc6c90 0x558a37fc9150 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f98b4036070 msgr2=0x7f98b4055a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f98b4036070 0x7f98b4055a20 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558a37fcb500 msgr2=0x558a37fcd8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558a37fcb500 0x558a37fcd8f0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f978403bb50 msgr2=0x7f978403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f978403bb50 0x7f978403e010 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f98ac092490 tx=0x7f98ac07f000 comp rx=0 tx=0).stop 2024-05-08T18:51:44.694 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37fb3c00 msgr2=0x558a37fbb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98b3fff640 1 -- 172.21.15.132:0/2348007010 reap_dead start 2024-05-08T18:51:44.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37fb3c00 0x558a37fbb1f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f98b4051040 tx=0x7f98b4052c60 comp rx=0 tx=0).stop 2024-05-08T18:51:44.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 shutdown_connections 2024-05-08T18:51:44.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/2348007010 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37fb3c00 0x558a37fbb1f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 >> 172.21.15.132:0/2348007010 conn(0x558a37faff60 msgr2=0x558a37fad5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 shutdown_connections 2024-05-08T18:51:44.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 -- 172.21.15.132:0/2348007010 wait complete. 2024-05-08T18:51:44.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 -- 172.21.15.132:0/108024370 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f979403bb50 msgr2=0x7f979403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/108024370 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f979403bb50 0x7f979403e010 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x558a37f90e50 tx=0x7f98ac05cf30 comp rx=0 tx=0).stop 2024-05-08T18:51:44.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 -- 172.21.15.132:0/108024370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e910d0 msgr2=0x558a37e8f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/108024370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e910d0 0x558a37e8f540 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x558a37f90db0 tx=0x7f98b4018830 comp rx=0 tx=0).stop 2024-05-08T18:51:44.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 -- 172.21.15.132:0/108024370 shutdown_connections 2024-05-08T18:51:44.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/108024370 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f979403bb50 0x7f979403e010 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/108024370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e910d0 0x558a37e8f540 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.688+0000 7f98bfd2b800 1 -- 172.21.15.132:0/108024370 >> 172.21.15.132:0/108024370 conn(0x558a37f987c0 msgr2=0x558a37f98bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.689+0000 7f98bfd2b800 1 -- 172.21.15.132:0/108024370 shutdown_connections 2024-05-08T18:51:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.689+0000 7f98bfd2b800 1 -- 172.21.15.132:0/108024370 wait complete. 2024-05-08T18:51:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.689+0000 7f98bfd2b800 1 -- 172.21.15.132:0/3460215393 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558a37e91530 msgr2=0x558a37f90470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.689+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/3460215393 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558a37e91530 0x558a37f90470 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.689+0000 7f98bfd2b800 1 -- 172.21.15.132:0/3460215393 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558a37f92d00 msgr2=0x558a37f950f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.689+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/3460215393 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558a37f92d00 0x558a37f950f0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.689+0000 7f98bfd2b800 1 -- 172.21.15.132:0/3460215393 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f97a403bba0 msgr2=0x7f97a403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.689+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/3460215393 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f97a403bba0 0x7f97a403e060 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f98a4000f60 tx=0x7f98a40012b0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.689+0000 7f98bfd2b800 1 -- 172.21.15.132:0/3460215393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e8e540 msgr2=0x558a37f89230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.689+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/3460215393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e8e540 0x558a37f89230 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00a470 tx=0x7f98ac002fb0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.689+0000 7f98bfd2b800 1 -- 172.21.15.132:0/3460215393 shutdown_connections 2024-05-08T18:51:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.689+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/3460215393 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558a37f92d00 0x558a37f950f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.689+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/3460215393 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558a37e91530 0x558a37f90470 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.689+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/3460215393 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f97a403bba0 0x7f97a403e060 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.689+0000 7f98bfd2b800 1 --2- 172.21.15.132:0/3460215393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558a37e8e540 0x558a37f89230 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.689+0000 7f98bfd2b800 1 -- 172.21.15.132:0/3460215393 >> 172.21.15.132:0/3460215393 conn(0x558a37e89eb0 msgr2=0x558a37f7b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.689+0000 7f98bfd2b800 1 -- 172.21.15.132:0/3460215393 shutdown_connections 2024-05-08T18:51:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.689+0000 7f98bfd2b800 1 -- 172.21.15.132:0/3460215393 wait complete. 2024-05-08T18:51:44.698 INFO:teuthology.orchestra.run.smithi132.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo2","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-08T18:51:44.698 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:51:44.698 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-05-08T18:51:44.698 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-05-08T18:51:44.699 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-05-08T18:51:44.751 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:44.751 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.752+0000 7f6a00287800 1 Processor -- start 2024-05-08T18:51:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.752+0000 7f6a00287800 1 -- start start 2024-05-08T18:51:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.752+0000 7f6a00287800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55d685b51610 0x55d685b53a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.752+0000 7f6a00287800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d685b53fd0 con 0x55d685b4d180 2024-05-08T18:51:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.752+0000 7f6a00287800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55d6859eee20 con 0x55d685b51610 2024-05-08T18:51:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.753+0000 7f69f7fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55d685b51610 0x55d685b53a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.753+0000 7f69fdd7f640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55d685b4d180 0x55d685b4d5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:49066/0 (socket says 172.21.15.132:49066) 2024-05-08T18:51:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.753+0000 7f69fdd7f640 1 -- 172.21.15.132:0/4175285228 learned_addr learned my addr 172.21.15.132:0/4175285228 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:51:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.753+0000 7f69f7fff640 1 -- 172.21.15.132:0/4175285228 >> v1:172.21.15.42:6789/0 conn(0x55d685b4d180 legacy=0x55d685b4d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.753+0000 7f69f7fff640 1 -- 172.21.15.132:0/4175285228 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d685b55200 con 0x55d685b51610 2024-05-08T18:51:44.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.755+0000 7f69f7fff640 1 --2- 172.21.15.132:0/4175285228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685b51610 0x55d685b53a00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f69e800a470 tx=0x7f69e801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddbf0b665c123313 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.755+0000 7f69fd57e640 1 -- 172.21.15.132:0/4175285228 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69e8057070 con 0x55d685b51610 2024-05-08T18:51:44.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.755+0000 7f69fd57e640 1 -- 172.21.15.132:0/4175285228 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69e8052570 con 0x55d685b51610 2024-05-08T18:51:44.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.755+0000 7f69fd57e640 1 -- 172.21.15.132:0/4175285228 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69e8052870 con 0x55d685b51610 2024-05-08T18:51:44.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.756+0000 7f6a00287800 1 -- 172.21.15.132:0/4175285228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685b51610 msgr2=0x55d685b53a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.756+0000 7f6a00287800 1 --2- 172.21.15.132:0/4175285228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685b51610 0x55d685b53a00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f69e800a470 tx=0x7f69e801ce90 comp rx=0 tx=0).stop 2024-05-08T18:51:44.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.756+0000 7f6a00287800 1 -- 172.21.15.132:0/4175285228 shutdown_connections 2024-05-08T18:51:44.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.756+0000 7f6a00287800 1 --2- 172.21.15.132:0/4175285228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685b51610 0x55d685b53a00 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.756+0000 7f6a00287800 1 -- 172.21.15.132:0/4175285228 >> 172.21.15.132:0/4175285228 conn(0x55d685b48760 msgr2=0x55d685b4ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.756+0000 7f6a00287800 1 -- 172.21.15.132:0/4175285228 shutdown_connections 2024-05-08T18:51:44.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.756+0000 7f6a00287800 1 -- 172.21.15.132:0/4175285228 wait complete. 2024-05-08T18:51:44.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.770+0000 7f6a00287800 1 Processor -- start 2024-05-08T18:51:44.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.770+0000 7f6a00287800 1 -- start start 2024-05-08T18:51:44.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.770+0000 7f6a00287800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685b4d180 0x55d685ac1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.770+0000 7f6a00287800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d685a995f0 con 0x55d685b4d180 2024-05-08T18:51:44.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.770+0000 7f69fdd7f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685b4d180 0x55d685ac1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.770+0000 7f69fdd7f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685b4d180 0x55d685ac1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56556/0 (socket says 172.21.15.132:56556) 2024-05-08T18:51:44.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.770+0000 7f69fdd7f640 1 -- 172.21.15.132:0/1728989114 learned_addr learned my addr 172.21.15.132:0/1728989114 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.770+0000 7f69fdd7f640 1 -- 172.21.15.132:0/1728989114 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d685c42470 con 0x55d685b4d180 2024-05-08T18:51:44.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.771+0000 7f69fdd7f640 1 --2- 172.21.15.132:0/1728989114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685b4d180 0x55d685ac1300 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f69f0001e10 tx=0x7f69f000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6266fb4a245d2e92 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.771+0000 7f68ebe07640 1 -- 172.21.15.132:0/1728989114 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f0012020 con 0x55d685b4d180 2024-05-08T18:51:44.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.771+0000 7f68ebe07640 1 -- 172.21.15.132:0/1728989114 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f000e5a0 con 0x55d685b4d180 2024-05-08T18:51:44.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.771+0000 7f68ebe07640 1 -- 172.21.15.132:0/1728989114 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f000e8e0 con 0x55d685b4d180 2024-05-08T18:51:44.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.772+0000 7f6a00287800 1 -- 172.21.15.132:0/1728989114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685b4d180 msgr2=0x55d685ac1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.772+0000 7f6a00287800 1 --2- 172.21.15.132:0/1728989114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685b4d180 0x55d685ac1300 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f69f0001e10 tx=0x7f69f000b780 comp rx=0 tx=0).stop 2024-05-08T18:51:44.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.772+0000 7f6a00287800 1 -- 172.21.15.132:0/1728989114 shutdown_connections 2024-05-08T18:51:44.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.772+0000 7f6a00287800 1 --2- 172.21.15.132:0/1728989114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685b4d180 0x55d685ac1300 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.772+0000 7f6a00287800 1 -- 172.21.15.132:0/1728989114 >> 172.21.15.132:0/1728989114 conn(0x55d685b48760 msgr2=0x55d685c39f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.772+0000 7f6a00287800 1 -- 172.21.15.132:0/1728989114 shutdown_connections 2024-05-08T18:51:44.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.772+0000 7f6a00287800 1 -- 172.21.15.132:0/1728989114 wait complete. 2024-05-08T18:51:44.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.772+0000 7f6a00287800 1 Processor -- start 2024-05-08T18:51:44.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.772+0000 7f6a00287800 1 -- start start 2024-05-08T18:51:44.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.772+0000 7f6a00287800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685b4d180 0x55d685c47240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.772+0000 7f6a00287800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d685b544a0 con 0x55d685b4d180 2024-05-08T18:51:44.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.772+0000 7f69fdd7f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685b4d180 0x55d685c47240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.772+0000 7f69fdd7f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685b4d180 0x55d685c47240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56566/0 (socket says 172.21.15.132:56566) 2024-05-08T18:51:44.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.772+0000 7f69fdd7f640 1 -- 172.21.15.132:0/620320140 learned_addr learned my addr 172.21.15.132:0/620320140 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.773+0000 7f69fdd7f640 1 -- 172.21.15.132:0/620320140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d685c47780 con 0x55d685b4d180 2024-05-08T18:51:44.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.773+0000 7f69fdd7f640 1 --2- 172.21.15.132:0/620320140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685b4d180 0x55d685c47240 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f69f0004170 tx=0x7f69f0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.773+0000 7f68ea604640 1 -- 172.21.15.132:0/620320140 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f0012030 con 0x55d685b4d180 2024-05-08T18:51:44.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.773+0000 7f68ea604640 1 -- 172.21.15.132:0/620320140 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f0001470 con 0x55d685b4d180 2024-05-08T18:51:44.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.773+0000 7f68ea604640 1 -- 172.21.15.132:0/620320140 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f001a8d0 con 0x55d685b4d180 2024-05-08T18:51:44.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.773+0000 7f6a00287800 1 -- 172.21.15.132:0/620320140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d685c47a10 con 0x55d685b4d180 2024-05-08T18:51:44.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.773+0000 7f6a00287800 1 -- 172.21.15.132:0/620320140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d685c4a6c0 con 0x55d685b4d180 2024-05-08T18:51:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.774+0000 7f68ea604640 1 -- 172.21.15.132:0/620320140 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f69f0015020 con 0x55d685b4d180 2024-05-08T18:51:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.775+0000 7f68ea604640 1 --2- 172.21.15.132:0/620320140 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f68e403bb50 0x7f68e403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.775+0000 7f68ea604640 1 -- 172.21.15.132:0/620320140 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f69f0020030 con 0x55d685b4d180 2024-05-08T18:51:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.775+0000 7f69f7fff640 1 --2- 172.21.15.132:0/620320140 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f68e403bb50 0x7f68e403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.775+0000 7f6a00287800 1 --2- 172.21.15.132:0/620320140 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d685b51610 0x55d685c4e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.775+0000 7f6a00287800 1 -- 172.21.15.132:0/620320140 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d685c4e9c0 con 0x55d685b51610 2024-05-08T18:51:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.775+0000 7f69fe580640 1 --2- 172.21.15.132:0/620320140 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d685b51610 0x55d685c4e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.775+0000 7f69f7fff640 1 --2- 172.21.15.132:0/620320140 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f68e403bb50 0x7f68e403e010 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f69e8054000 tx=0x7f69e804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.775+0000 7f69fe580640 1 --2- 172.21.15.132:0/620320140 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d685b51610 0x55d685c4e480 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.775+0000 7f69fe580640 1 -- 172.21.15.132:0/620320140 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69f800a4a0 con 0x55d685b51610 2024-05-08T18:51:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.776+0000 7f6a00287800 1 -- 172.21.15.132:0/620320140 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d685c4ba30 con 0x55d685b51610 2024-05-08T18:51:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.776+0000 7f69fe580640 1 -- 172.21.15.132:0/620320140 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69f800a4a0 con 0x55d685b51610 2024-05-08T18:51:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.776+0000 7f6a00287800 1 --2- 172.21.15.132:0/620320140 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d685c50c60 0x55d685c53050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.776+0000 7f6a00287800 1 -- 172.21.15.132:0/620320140 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d685c53740 con 0x55d685c50c60 2024-05-08T18:51:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.776+0000 7f69fdd7f640 1 --2- 172.21.15.132:0/620320140 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d685c50c60 0x55d685c53050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.776+0000 7f69fdd7f640 1 --2- 172.21.15.132:0/620320140 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d685c50c60 0x55d685c53050 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.777+0000 7f69fdd7f640 1 -- 172.21.15.132:0/620320140 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f69f0018430 con 0x55d685c50c60 2024-05-08T18:51:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.777+0000 7f6a00287800 1 -- 172.21.15.132:0/620320140 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d685c4fb00 con 0x55d685b51610 2024-05-08T18:51:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.777+0000 7f69fe580640 1 -- 172.21.15.132:0/620320140 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69f800a4a0 con 0x55d685b51610 2024-05-08T18:51:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.777+0000 7f6a00287800 1 -- 172.21.15.132:0/620320140 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d685c4ffe0 con 0x55d685b51610 2024-05-08T18:51:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.777+0000 7f69fe580640 1 -- 172.21.15.132:0/620320140 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f69f800a4a0 con 0x55d685b51610 2024-05-08T18:51:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.778+0000 7f6a00287800 1 Processor -- start 2024-05-08T18:51:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.778+0000 7f6a00287800 1 -- start start 2024-05-08T18:51:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.778+0000 7f6a00287800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685c62680 0x55d685c62aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.778+0000 7f6a00287800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d685a3ffc0 con 0x55d685c62680 2024-05-08T18:51:44.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.778+0000 7f69fe580640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685c62680 0x55d685c62aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.778+0000 7f69fe580640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685c62680 0x55d685c62aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56570/0 (socket says 172.21.15.132:56570) 2024-05-08T18:51:44.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.778+0000 7f69fe580640 1 -- 172.21.15.132:0/817370924 learned_addr learned my addr 172.21.15.132:0/817370924 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.778+0000 7f69fe580640 1 -- 172.21.15.132:0/817370924 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d685c62fe0 con 0x55d685c62680 2024-05-08T18:51:44.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.779+0000 7f69fe580640 1 --2- 172.21.15.132:0/817370924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685c62680 0x55d685c62aa0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x55d685c482d0 tx=0x7f69f8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.779+0000 7f68e37fe640 1 -- 172.21.15.132:0/817370924 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f8014450 con 0x55d685c62680 2024-05-08T18:51:44.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.779+0000 7f68e37fe640 1 -- 172.21.15.132:0/817370924 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f8014610 con 0x55d685c62680 2024-05-08T18:51:44.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.779+0000 7f6a00287800 1 -- 172.21.15.132:0/817370924 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d685c63a50 con 0x55d685c62680 2024-05-08T18:51:44.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.779+0000 7f68e37fe640 1 -- 172.21.15.132:0/817370924 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f8014930 con 0x55d685c62680 2024-05-08T18:51:44.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.779+0000 7f6a00287800 1 -- 172.21.15.132:0/817370924 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d685c63f50 con 0x55d685c62680 2024-05-08T18:51:44.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.780+0000 7f68e37fe640 1 -- 172.21.15.132:0/817370924 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f69f8011040 con 0x55d685c62680 2024-05-08T18:51:44.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.780+0000 7f68e37fe640 1 --2- 172.21.15.132:0/817370924 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f68d803bb50 0x7f68d803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.780+0000 7f68e37fe640 1 -- 172.21.15.132:0/817370924 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f69f801e070 con 0x55d685c62680 2024-05-08T18:51:44.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.780+0000 7f69fdd7f640 1 --2- 172.21.15.132:0/817370924 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f68d803bb50 0x7f68d803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.780+0000 7f6a00287800 1 Processor -- start 2024-05-08T18:51:44.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.780+0000 7f69fdd7f640 1 --2- 172.21.15.132:0/817370924 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f68d803bb50 0x7f68d803e010 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55d685c4edd0 tx=0x7f69f003f040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.780+0000 7f6a00287800 1 -- start start 2024-05-08T18:51:44.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.781+0000 7f6a00287800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685c6f9d0 0x55d685c6fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.781+0000 7f6a00287800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d685c427c0 con 0x55d685c6f9d0 2024-05-08T18:51:44.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.781+0000 7f69fe580640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685c6f9d0 0x55d685c6fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.781+0000 7f69fe580640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685c6f9d0 0x55d685c6fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56580/0 (socket says 172.21.15.132:56580) 2024-05-08T18:51:44.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.781+0000 7f69fe580640 1 -- 172.21.15.132:0/1821581720 learned_addr learned my addr 172.21.15.132:0/1821581720 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.781+0000 7f69fe580640 1 -- 172.21.15.132:0/1821581720 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d685c703c0 con 0x55d685c6f9d0 2024-05-08T18:51:44.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.781+0000 7f69fe580640 1 --2- 172.21.15.132:0/1821581720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685c6f9d0 0x55d685c6fdf0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f69f8052cd0 tx=0x7f69f8016df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed1aabb92fbaabd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.781+0000 7f68e17fa640 1 -- 172.21.15.132:0/1821581720 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f8028030 con 0x55d685c6f9d0 2024-05-08T18:51:44.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.781+0000 7f68e17fa640 1 -- 172.21.15.132:0/1821581720 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f8016a90 con 0x55d685c6f9d0 2024-05-08T18:51:44.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.781+0000 7f68e17fa640 1 -- 172.21.15.132:0/1821581720 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f80165b0 con 0x55d685c6f9d0 2024-05-08T18:51:44.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.782+0000 7f6a00287800 1 -- 172.21.15.132:0/1821581720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685c6f9d0 msgr2=0x55d685c6fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.782+0000 7f6a00287800 1 --2- 172.21.15.132:0/1821581720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685c6f9d0 0x55d685c6fdf0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f69f8052cd0 tx=0x7f69f8016df0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.782+0000 7f6a00287800 1 -- 172.21.15.132:0/1821581720 shutdown_connections 2024-05-08T18:51:44.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.782+0000 7f6a00287800 1 --2- 172.21.15.132:0/1821581720 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685c6f9d0 0x55d685c6fdf0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.782+0000 7f6a00287800 1 -- 172.21.15.132:0/1821581720 >> 172.21.15.132:0/1821581720 conn(0x55d685c6bce0 msgr2=0x55d685c69d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.782+0000 7f6a00287800 1 -- 172.21.15.132:0/1821581720 shutdown_connections 2024-05-08T18:51:44.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.782+0000 7f6a00287800 1 -- 172.21.15.132:0/1821581720 wait complete. 2024-05-08T18:51:44.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.782+0000 7f6a00287800 1 Processor -- start 2024-05-08T18:51:44.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.782+0000 7f6a00287800 1 -- start start 2024-05-08T18:51:44.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.782+0000 7f6a00287800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685c6f9d0 0x55d685c76e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.782+0000 7f6a00287800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d685c70ab0 con 0x55d685c6f9d0 2024-05-08T18:51:44.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.782+0000 7f69fe580640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685c6f9d0 0x55d685c76e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.782+0000 7f69fe580640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685c6f9d0 0x55d685c76e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56596/0 (socket says 172.21.15.132:56596) 2024-05-08T18:51:44.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.783+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 learned_addr learned my addr 172.21.15.132:0/286741172 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.783+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d685c773c0 con 0x55d685c6f9d0 2024-05-08T18:51:44.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.783+0000 7f69fe580640 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685c6f9d0 0x55d685c76e80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f69f80014d0 tx=0x7f69f8052c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.783+0000 7f68cf7fe640 1 -- 172.21.15.132:0/286741172 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f8054620 con 0x55d685c6f9d0 2024-05-08T18:51:44.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.783+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d685c77650 con 0x55d685c6f9d0 2024-05-08T18:51:44.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.783+0000 7f68cf7fe640 1 -- 172.21.15.132:0/286741172 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f8032070 con 0x55d685c6f9d0 2024-05-08T18:51:44.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.783+0000 7f68cf7fe640 1 -- 172.21.15.132:0/286741172 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69f8001ab0 con 0x55d685c6f9d0 2024-05-08T18:51:44.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.783+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d685c7a300 con 0x55d685c6f9d0 2024-05-08T18:51:44.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.784+0000 7f68cf7fe640 1 -- 172.21.15.132:0/286741172 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f69f8001c50 con 0x55d685c6f9d0 2024-05-08T18:51:44.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.784+0000 7f68cf7fe640 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f68c803bcf0 0x7f68c803e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.784+0000 7f68cf7fe640 1 -- 172.21.15.132:0/286741172 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f69f800e040 con 0x55d685c6f9d0 2024-05-08T18:51:44.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.784+0000 7f69fdd7f640 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f68c803bcf0 0x7f68c803e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.784+0000 7f69fdd7f640 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f68c803bcf0 0x7f68c803e1b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f69f000e550 tx=0x7f69f0045070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.785+0000 7f6a00287800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.785+0000 7f6a00287800 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d685c829a0 0x55d685c84e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.785+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d685c855b0 con 0x55d685c829a0 2024-05-08T18:51:44.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.785+0000 7f69f7fff640 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d685c829a0 0x55d685c84e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.785+0000 7f69f7fff640 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d685c829a0 0x55d685c84e60 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.785+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69e805a040 con 0x55d685c829a0 2024-05-08T18:51:44.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.785+0000 7f6a00287800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.785+0000 7f6a00287800 20 realm 2024-05-08T18:51:44.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.785+0000 7f6a00287800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.785+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d685c85980 con 0x55d685c829a0 2024-05-08T18:51:44.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.786+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69e805a040 con 0x55d685c829a0 2024-05-08T18:51:44.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.786+0000 7f6a00287800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.786+0000 7f6a00287800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:44.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.786+0000 7f6a00287800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.786+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d685c86250 con 0x55d685c829a0 2024-05-08T18:51:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.786+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69e805a040 con 0x55d685c829a0 2024-05-08T18:51:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.786+0000 7f6a00287800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.786+0000 7f6a00287800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.786+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d685c865f0 con 0x55d685c829a0 2024-05-08T18:51:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.786+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69e805a040 con 0x55d685c829a0 2024-05-08T18:51:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.786+0000 7f6a00287800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.786+0000 7f6a00287800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.786+0000 7f6a00287800 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d685c87350 0x55d685c89740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.786+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d685c89d00 con 0x55d685c87350 2024-05-08T18:51:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.786+0000 7f69fe580640 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d685c87350 0x55d685c89740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.786+0000 7f69fe580640 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d685c87350 0x55d685c89740 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.787+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f69f8049040 con 0x55d685c87350 2024-05-08T18:51:44.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.787+0000 7f6a00287800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:44.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.787+0000 7f6a00287800 20 searching for the correct realm 2024-05-08T18:51:44.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.787+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x55d685c87350 2024-05-08T18:51:44.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.787+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f8049040 con 0x55d685c87350 2024-05-08T18:51:44.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.787+0000 7f69fe580640 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f69f8014070 0x7f69f8053210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.787+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x7f69f8014070 2024-05-08T18:51:44.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.787+0000 7f69fdd7f640 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f69f8014070 0x7f69f8053210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.788+0000 7f69fdd7f640 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f69f8014070 0x7f69f8053210 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.788+0000 7f69fdd7f640 1 -- 172.21.15.132:0/286741172 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f0018430 con 0x7f69f8014070 2024-05-08T18:51:44.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.788+0000 7f69fdd7f640 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f69f0017050 0x7f69f00167d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.788+0000 7f69fdd7f640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x7f69f0017050 2024-05-08T18:51:44.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.788+0000 7f69f7fff640 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f69f0017050 0x7f69f00167d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.789+0000 7f69f7fff640 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f69f0017050 0x7f69f00167d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.789+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69e805a040 con 0x7f69f0017050 2024-05-08T18:51:44.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.789+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x55d685c829a0 2024-05-08T18:51:44.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.789+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69e805a040 con 0x55d685c829a0 2024-05-08T18:51:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.789+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x55d685c829a0 2024-05-08T18:51:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.789+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69e805a040 con 0x55d685c829a0 2024-05-08T18:51:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.789+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x7f69f0017050 2024-05-08T18:51:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.790+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69e805a040 con 0x7f69f0017050 2024-05-08T18:51:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.790+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x7f69f0017050 2024-05-08T18:51:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.790+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69e805a040 con 0x7f69f0017050 2024-05-08T18:51:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.790+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x7f69f8014070 2024-05-08T18:51:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.790+0000 7f69fdd7f640 1 -- 172.21.15.132:0/286741172 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f0018430 con 0x7f69f8014070 2024-05-08T18:51:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.790+0000 7f69fdd7f640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x55d685c87350 2024-05-08T18:51:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.790+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f8049040 con 0x55d685c87350 2024-05-08T18:51:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.790+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x55d685c829a0 2024-05-08T18:51:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.790+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69e805a040 con 0x55d685c829a0 2024-05-08T18:51:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.790+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x7f69f0017050 2024-05-08T18:51:44.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.791+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69e805a040 con 0x7f69f0017050 2024-05-08T18:51:44.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.791+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x55d685c829a0 2024-05-08T18:51:44.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.791+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f69e805a040 con 0x55d685c829a0 2024-05-08T18:51:44.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.791+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x7f69f8014070 2024-05-08T18:51:44.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.791+0000 7f69fdd7f640 1 -- 172.21.15.132:0/286741172 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f69f0018430 con 0x7f69f8014070 2024-05-08T18:51:44.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.791+0000 7f69fdd7f640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x55d685c87350 2024-05-08T18:51:44.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.791+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f69f8049040 con 0x55d685c87350 2024-05-08T18:51:44.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.791+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x55d685c87350 2024-05-08T18:51:44.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.792+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f8049040 con 0x55d685c87350 2024-05-08T18:51:44.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.792+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x7f69f0017050 2024-05-08T18:51:44.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.792+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69e805a040 con 0x7f69f0017050 2024-05-08T18:51:44.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.792+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x55d685c87350 2024-05-08T18:51:44.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.792+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f8049040 con 0x55d685c87350 2024-05-08T18:51:44.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.792+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x55d685c87350 2024-05-08T18:51:44.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.792+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f8049040 con 0x55d685c87350 2024-05-08T18:51:44.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.792+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x55d685c829a0 2024-05-08T18:51:44.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.793+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69e805a040 con 0x55d685c829a0 2024-05-08T18:51:44.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.793+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x55d685c829a0 2024-05-08T18:51:44.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.793+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f69e805a040 con 0x55d685c829a0 2024-05-08T18:51:44.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.793+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x7f69f0017050 2024-05-08T18:51:44.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.793+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69e807d040 con 0x7f69f0017050 2024-05-08T18:51:44.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.793+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x55d685c87350 2024-05-08T18:51:44.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.793+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f8069040 con 0x55d685c87350 2024-05-08T18:51:44.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.793+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x7f69f8014070 2024-05-08T18:51:44.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.794+0000 7f69fdd7f640 1 -- 172.21.15.132:0/286741172 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f0018430 con 0x7f69f8014070 2024-05-08T18:51:44.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.794+0000 7f69fdd7f640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x55d685c829a0 2024-05-08T18:51:44.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.794+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69e807d040 con 0x55d685c829a0 2024-05-08T18:51:44.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.794+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x7f69f8014070 2024-05-08T18:51:44.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.794+0000 7f69fdd7f640 1 -- 172.21.15.132:0/286741172 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f0018430 con 0x7f69f8014070 2024-05-08T18:51:44.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.794+0000 7f69fdd7f640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x55d685c87350 2024-05-08T18:51:44.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.794+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f8069040 con 0x55d685c87350 2024-05-08T18:51:44.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.794+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x7f69f0017050 2024-05-08T18:51:44.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.795+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69e807d040 con 0x7f69f0017050 2024-05-08T18:51:44.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.795+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x7f69f8014070 2024-05-08T18:51:44.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.795+0000 7f69fdd7f640 1 -- 172.21.15.132:0/286741172 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f0018430 con 0x7f69f8014070 2024-05-08T18:51:44.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.795+0000 7f69fdd7f640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x55d685c87350 2024-05-08T18:51:44.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.795+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f8069040 con 0x55d685c87350 2024-05-08T18:51:44.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.795+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x7f69f0017050 2024-05-08T18:51:44.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.795+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69e807d040 con 0x7f69f0017050 2024-05-08T18:51:44.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.795+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x55d685c829a0 2024-05-08T18:51:44.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.796+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f69e807d040 con 0x55d685c829a0 2024-05-08T18:51:44.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.796+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8b650 con 0x7f69f8014070 2024-05-08T18:51:44.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.796+0000 7f69fdd7f640 1 -- 172.21.15.132:0/286741172 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69f0018430 con 0x7f69f8014070 2024-05-08T18:51:44.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.796+0000 7f6a00287800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:44.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.796+0000 7f6a00287800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:44.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.796+0000 7f6a00287800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:44.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.796+0000 7f6a00287800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:44.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.796+0000 7f6a00287800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:44.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.796+0000 7f6a00287800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:44.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.796+0000 7f6a00287800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.796+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8a6c0 con 0x55d685c829a0 2024-05-08T18:51:44.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.796+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x55d685c829a0 2024-05-08T18:51:44.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.796+0000 7f6a00287800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.796+0000 7f6a00287800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.796+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8a300 con 0x55d685c829a0 2024-05-08T18:51:44.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.796+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69e807d040 con 0x55d685c829a0 2024-05-08T18:51:44.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.796+0000 7f6a00287800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:44.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.796+0000 7f6a00287800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.796+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8ab00 con 0x55d685c829a0 2024-05-08T18:51:44.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.797+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f69e807d040 con 0x55d685c829a0 2024-05-08T18:51:44.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.797+0000 7f6a00287800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:44.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.797+0000 7f6a00287800 20 zone default found 2024-05-08T18:51:44.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.797+0000 7f6a00287800 4 Realm: () 2024-05-08T18:51:44.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.797+0000 7f6a00287800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.797+0000 7f6a00287800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.797+0000 7f6a00287800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.797+0000 7f6a00287800 20 zonegroup default 2024-05-08T18:51:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.797+0000 7f6a00287800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.797+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8bf80 con 0x7f69f8014070 2024-05-08T18:51:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.797+0000 7f69fdd7f640 1 -- 172.21.15.132:0/286741172 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f69f0018430 con 0x7f69f8014070 2024-05-08T18:51:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.797+0000 7f6a00287800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.797+0000 7f6a00287800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.797+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8e1b0 con 0x55d685c87350 2024-05-08T18:51:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.797+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f69f8069040 con 0x55d685c87350 2024-05-08T18:51:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.797+0000 7f6a00287800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.797+0000 7f6a00287800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.797+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8e550 con 0x55d685c87350 2024-05-08T18:51:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.798+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f69f8069040 con 0x55d685c87350 2024-05-08T18:51:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.798+0000 7f6a00287800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.798+0000 7f6a00287800 20 started sync module instance, tier type = 2024-05-08T18:51:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.798+0000 7f6a00287800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.798+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8d640 con 0x7f69f8014070 2024-05-08T18:51:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.799+0000 7f69fdd7f640 1 -- 172.21.15.132:0/286741172 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69f0018430 con 0x7f69f8014070 2024-05-08T18:51:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.799+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94379855895088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8d2a0 con 0x7f69f8014070 2024-05-08T18:51:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.799+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8f2e0 con 0x55d685c829a0 2024-05-08T18:51:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.800+0000 7f69fdd7f640 1 -- 172.21.15.132:0/286741172 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94379855895088] v27'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69f0018430 con 0x7f69f8014070 2024-05-08T18:51:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.800+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x55d685c829a0 2024-05-08T18:51:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.800+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94379855898944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8f6d0 con 0x55d685c829a0 2024-05-08T18:51:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.800+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c90120 con 0x55d685c87350 2024-05-08T18:51:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.801+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69f8069040 con 0x55d685c87350 2024-05-08T18:51:44.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.801+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94379855903760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c90120 con 0x55d685c87350 2024-05-08T18:51:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.801+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c91120 con 0x7f69f8014070 2024-05-08T18:51:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.801+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94379855898944] v27'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x55d685c829a0 2024-05-08T18:51:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.802+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94379855903760] v27'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69f8069040 con 0x55d685c87350 2024-05-08T18:51:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.804+0000 7f69fdd7f640 1 -- 172.21.15.132:0/286741172 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69f0018430 con 0x7f69f8014070 2024-05-08T18:51:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.804+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94379855907856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8ed60 con 0x7f69f8014070 2024-05-08T18:51:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.804+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c91b30 con 0x55d685c829a0 2024-05-08T18:51:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.805+0000 7f69fdd7f640 1 -- 172.21.15.132:0/286741172 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94379855907856] v27'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69f0018430 con 0x7f69f8014070 2024-05-08T18:51:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.805+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x55d685c829a0 2024-05-08T18:51:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.805+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94379855910528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c91f50 con 0x55d685c829a0 2024-05-08T18:51:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.805+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c927a0 con 0x7f69f0017050 2024-05-08T18:51:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.806+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x7f69f0017050 2024-05-08T18:51:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.806+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94379855910528] v27'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x55d685c829a0 2024-05-08T18:51:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.806+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94379855913296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c92c30 con 0x7f69f0017050 2024-05-08T18:51:44.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.806+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c91ae0 con 0x7f69f0017050 2024-05-08T18:51:44.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.807+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(56 notify.6 [create] v27'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x7f69f0017050 2024-05-08T18:51:44.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.807+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94379855911648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c936d0 con 0x7f69f0017050 2024-05-08T18:51:44.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.807+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c94120 con 0x7f69f0017050 2024-05-08T18:51:44.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.807+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94379855913296] v27'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x7f69f0017050 2024-05-08T18:51:44.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.808+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94379855911648] v27'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x7f69f0017050 2024-05-08T18:51:44.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.808+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x7f69f0017050 2024-05-08T18:51:44.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.808+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94379855920144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c93220 con 0x7f69f0017050 2024-05-08T18:51:44.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.808+0000 7f6a00287800 20 add_watcher() i=0 2024-05-08T18:51:44.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.808+0000 7f6a00287800 20 add_watcher() i=1 2024-05-08T18:51:44.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.808+0000 7f6a00287800 20 add_watcher() i=2 2024-05-08T18:51:44.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.808+0000 7f6a00287800 20 add_watcher() i=3 2024-05-08T18:51:44.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.808+0000 7f6a00287800 20 add_watcher() i=4 2024-05-08T18:51:44.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.808+0000 7f6a00287800 20 add_watcher() i=5 2024-05-08T18:51:44.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.808+0000 7f6a00287800 20 add_watcher() i=6 2024-05-08T18:51:44.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.809+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94379855920144] v27'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x7f69f0017050 2024-05-08T18:51:44.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.809+0000 7f6a00287800 20 add_watcher() i=7 2024-05-08T18:51:44.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.809+0000 7f6a00287800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:44.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.809+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d685c93220 con 0x55d685c829a0 2024-05-08T18:51:44.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.809+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f69e807d040 con 0x55d685c829a0 2024-05-08T18:51:44.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.810+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94379855914544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c93220 con 0x55d685c829a0 2024-05-08T18:51:44.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.810+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94379855914544] v27'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x55d685c829a0 2024-05-08T18:51:44.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.811+0000 7f68af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:44.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.811+0000 7f6a00287800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:44.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.811+0000 7f6a00287800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:44.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.811+0000 7f6a00287800 5 note: GC not initialized 2024-05-08T18:51:44.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.811+0000 7f68ae7fc640 20 reqs_thread_entry: start 2024-05-08T18:51:44.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.811+0000 7f6a00287800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:44.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.811+0000 7f6a00287800 20 Filter name: none 2024-05-08T18:51:44.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.811+0000 7f6823fff640 20 reqs_thread_entry: start 2024-05-08T18:51:44.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.811+0000 7f6a00287800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-05-08T18:51:44.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.811+0000 7f6a00287800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.811+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d685cca570 con 0x7f69f0017050 2024-05-08T18:51:44.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.812+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x7f69f0017050 2024-05-08T18:51:44.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.812+0000 7f6a00287800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.812+0000 7f6a00287800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-05-08T18:51:44.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.812+0000 7f6a00287800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-05-08T18:51:44.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.812+0000 7f6a00287800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-05-08T18:51:44.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.812+0000 7f6a00287800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.812+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d685cc8d10 con 0x55d685c829a0 2024-05-08T18:51:44.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.812+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x55d685c829a0 2024-05-08T18:51:44.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.812+0000 7f6a00287800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.812+0000 7f6a00287800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-05-08T18:51:44.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.812+0000 7f6a00287800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-08T18:51:44.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.812+0000 7f6a00287800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-05-08T18:51:44.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.812+0000 7f6a00287800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-05-08T18:51:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.812+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685cc95d0 con 0x7f69f0017050 2024-05-08T18:51:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.813+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v27'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x7f69f0017050 2024-05-08T18:51:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.813+0000 7f6a00287800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-05-08T18:51:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.813+0000 7f6a00287800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-05-08T18:51:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.813+0000 7f6a00287800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-05-08T18:51:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.813+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94379856138528 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d685ccdeb0 con 0x7f69f0017050 2024-05-08T18:51:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.813+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== watch-notify(notify (1) cookie 94379855920144 notify 115964117008 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55d685cc9970 con 0x7f69f0017050 2024-05-08T18:51:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.813+0000 7f68e17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117008 cookie 94379855920144 notifier 4718 bl.length()=556 2024-05-08T18:51:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.813+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(65 notify.7 [notify cookie 94379856138528 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f69e807d040 con 0x7f69f0017050 2024-05-08T18:51:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.813+0000 7f68e17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-05-08T18:51:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.813+0000 7f68e17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-05-08T18:51:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.813+0000 7f68e17fa640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f68c0003ea0 con 0x7f69f0017050 2024-05-08T18:51:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.814+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x7f69f0017050 2024-05-08T18:51:44.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.814+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== watch-notify(notify_complete (2) cookie 94379856138528 notify 115964117008 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d685cc9fc0 con 0x7f69f0017050 2024-05-08T18:51:44.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.814+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685cc90d0 con 0x55d685c829a0 2024-05-08T18:51:44.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.815+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x55d685c829a0 2024-05-08T18:51:44.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.815+0000 7f6a00287800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-08T18:51:44.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.815+0000 7f6a00287800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-08T18:51:44.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.815+0000 7f6a00287800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-05-08T18:51:44.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.815+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94379856153072 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d685cce2d0 con 0x7f69f0017050 2024-05-08T18:51:44.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.815+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== watch-notify(notify (1) cookie 94379855913296 notify 115964117009 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55d685cc9fc0 con 0x7f69f0017050 2024-05-08T18:51:44.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.815+0000 7f68e17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117009 cookie 94379855913296 notifier 4718 bl.length()=177 2024-05-08T18:51:44.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.815+0000 7f68e17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-08T18:51:44.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.815+0000 7f68e17fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-08T18:51:44.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.815+0000 7f68e17fa640 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f68c0003ea0 con 0x7f69f0017050 2024-05-08T18:51:44.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.815+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(68 notify.5 [notify cookie 94379856153072 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f69e807d040 con 0x7f69f0017050 2024-05-08T18:51:44.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.815+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x7f69f0017050 2024-05-08T18:51:44.826 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.816+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== watch-notify(notify_complete (2) cookie 94379856153072 notify 115964117009 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d685b55200 con 0x7f69f0017050 2024-05-08T18:51:44.826 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-05-08T18:51:44.813467Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:51:44.813453Z","tags":[],"group_ids":[]} 2024-05-08T18:51:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.816+0000 7f68af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.816+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94379855914544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c7ee30 con 0x55d685c829a0 2024-05-08T18:51:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.817+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94379855914544] v27'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x55d685c829a0 2024-05-08T18:51:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.817+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94379855895088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c92630 con 0x7f69f8014070 2024-05-08T18:51:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.818+0000 7f69fdd7f640 1 -- 172.21.15.132:0/286741172 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94379855895088] v27'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69f0018430 con 0x7f69f8014070 2024-05-08T18:51:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.818+0000 7f6a00287800 20 remove_watcher() i=0 2024-05-08T18:51:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.818+0000 7f6a00287800 2 removed watcher, disabling cache 2024-05-08T18:51:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.818+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94379855898944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8da30 con 0x55d685c829a0 2024-05-08T18:51:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.820+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94379855898944] v27'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x55d685c829a0 2024-05-08T18:51:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.820+0000 7f6a00287800 20 remove_watcher() i=1 2024-05-08T18:51:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.820+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94379855903760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8da30 con 0x55d685c87350 2024-05-08T18:51:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.821+0000 7f69fe580640 1 -- 172.21.15.132:0/286741172 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94379855903760] v27'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69f8069040 con 0x55d685c87350 2024-05-08T18:51:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.821+0000 7f6a00287800 20 remove_watcher() i=2 2024-05-08T18:51:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.821+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94379855907856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8da30 con 0x7f69f8014070 2024-05-08T18:51:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.822+0000 7f69fdd7f640 1 -- 172.21.15.132:0/286741172 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94379855907856] v27'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69f0018430 con 0x7f69f8014070 2024-05-08T18:51:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.822+0000 7f6a00287800 20 remove_watcher() i=3 2024-05-08T18:51:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.822+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94379855910528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8da30 con 0x55d685c829a0 2024-05-08T18:51:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.823+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94379855910528] v27'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x55d685c829a0 2024-05-08T18:51:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.823+0000 7f6a00287800 20 remove_watcher() i=4 2024-05-08T18:51:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.823+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94379855913296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c91680 con 0x7f69f0017050 2024-05-08T18:51:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.824+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94379855913296] v27'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x7f69f0017050 2024-05-08T18:51:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.824+0000 7f6a00287800 20 remove_watcher() i=5 2024-05-08T18:51:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.824+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94379855911648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c8da30 con 0x7f69f0017050 2024-05-08T18:51:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.825+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94379855911648] v27'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x7f69f0017050 2024-05-08T18:51:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.825+0000 7f6a00287800 20 remove_watcher() i=6 2024-05-08T18:51:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.825+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94379855920144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d685c91680 con 0x7f69f0017050 2024-05-08T18:51:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94379855920144] v27'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69e807d040 con 0x7f69f0017050 2024-05-08T18:51:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 20 remove_watcher() i=7 2024-05-08T18:51:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f69f0017050 msgr2=0x7f69f00167d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f69f0017050 0x7f69f00167d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d685c829a0 msgr2=0x55d685c84e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d685c829a0 0x55d685c84e60 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f69f8014070 msgr2=0x7f69f8053210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f69f8014070 0x7f69f8053210 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d685c87350 msgr2=0x55d685c89740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d685c87350 0x55d685c89740 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f68c803bcf0 msgr2=0x7f68c803e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f68c803bcf0 0x7f68c803e1b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f69f000e550 tx=0x7f69f0045070 comp rx=0 tx=0).stop 2024-05-08T18:51:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685c6f9d0 msgr2=0x55d685c76e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f69f7fff640 1 -- 172.21.15.132:0/286741172 reap_dead start 2024-05-08T18:51:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685c6f9d0 0x55d685c76e80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f69f80014d0 tx=0x7f69f8052c60 comp rx=0 tx=0).stop 2024-05-08T18:51:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 shutdown_connections 2024-05-08T18:51:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 --2- 172.21.15.132:0/286741172 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685c6f9d0 0x55d685c76e80 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 >> 172.21.15.132:0/286741172 conn(0x55d685c6bce0 msgr2=0x55d685c711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 shutdown_connections 2024-05-08T18:51:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 -- 172.21.15.132:0/286741172 wait complete. 2024-05-08T18:51:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 -- 172.21.15.132:0/817370924 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f68d803bb50 msgr2=0x7f68d803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 --2- 172.21.15.132:0/817370924 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f68d803bb50 0x7f68d803e010 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x55d685c4edd0 tx=0x7f69f003f040 comp rx=0 tx=0).stop 2024-05-08T18:51:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 -- 172.21.15.132:0/817370924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685c62680 msgr2=0x55d685c62aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 --2- 172.21.15.132:0/817370924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685c62680 0x55d685c62aa0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x55d685c482d0 tx=0x7f69f8018830 comp rx=0 tx=0).stop 2024-05-08T18:51:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 -- 172.21.15.132:0/817370924 shutdown_connections 2024-05-08T18:51:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 --2- 172.21.15.132:0/817370924 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f68d803bb50 0x7f68d803e010 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 --2- 172.21.15.132:0/817370924 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685c62680 0x55d685c62aa0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.826+0000 7f6a00287800 1 -- 172.21.15.132:0/817370924 >> 172.21.15.132:0/817370924 conn(0x55d685c56720 msgr2=0x55d685c56b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.827+0000 7f6a00287800 1 -- 172.21.15.132:0/817370924 shutdown_connections 2024-05-08T18:51:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.827+0000 7f6a00287800 1 -- 172.21.15.132:0/817370924 wait complete. 2024-05-08T18:51:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.827+0000 7f6a00287800 1 -- 172.21.15.132:0/620320140 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d685b51610 msgr2=0x55d685c4e480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.827+0000 7f6a00287800 1 --2- 172.21.15.132:0/620320140 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d685b51610 0x55d685c4e480 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.827+0000 7f6a00287800 1 -- 172.21.15.132:0/620320140 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d685c50c60 msgr2=0x55d685c53050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.827+0000 7f6a00287800 1 --2- 172.21.15.132:0/620320140 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d685c50c60 0x55d685c53050 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.827+0000 7f6a00287800 1 -- 172.21.15.132:0/620320140 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f68e403bb50 msgr2=0x7f68e403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.827+0000 7f6a00287800 1 --2- 172.21.15.132:0/620320140 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f68e403bb50 0x7f68e403e010 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f69e8054000 tx=0x7f69e804e000 comp rx=0 tx=0).stop 2024-05-08T18:51:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.827+0000 7f6a00287800 1 -- 172.21.15.132:0/620320140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685b4d180 msgr2=0x55d685c47240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.827+0000 7f6a00287800 1 --2- 172.21.15.132:0/620320140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685b4d180 0x55d685c47240 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f69f0004170 tx=0x7f69f0000ed0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.827+0000 7f6a00287800 1 -- 172.21.15.132:0/620320140 shutdown_connections 2024-05-08T18:51:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.827+0000 7f6a00287800 1 --2- 172.21.15.132:0/620320140 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d685c50c60 0x55d685c53050 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.827+0000 7f6a00287800 1 --2- 172.21.15.132:0/620320140 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d685b51610 0x55d685c4e480 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.827+0000 7f6a00287800 1 --2- 172.21.15.132:0/620320140 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f68e403bb50 0x7f68e403e010 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.827+0000 7f6a00287800 1 --2- 172.21.15.132:0/620320140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d685b4d180 0x55d685c47240 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.827+0000 7f6a00287800 1 -- 172.21.15.132:0/620320140 >> 172.21.15.132:0/620320140 conn(0x55d685b48760 msgr2=0x55d685c38760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.827+0000 7f6a00287800 1 -- 172.21.15.132:0/620320140 shutdown_connections 2024-05-08T18:51:44.836 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.827+0000 7f6a00287800 1 -- 172.21.15.132:0/620320140 wait complete. 2024-05-08T18:51:44.837 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-05-08T18:51:44.813467Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:51:44.813453Z', 'tags': [], 'group_ids': []} 2024-05-08T18:51:44.852 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:51:44.856 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-05-08T18:51:44.856 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-05-08T18:51:44.857 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-05-08T18:51:44.857 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-05-08T18:51:44.902 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:44.902 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:44.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.904+0000 7f4ff67af800 1 Processor -- start 2024-05-08T18:51:44.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.904+0000 7f4ff67af800 1 -- start start 2024-05-08T18:51:44.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.904+0000 7f4ff67af800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55f1fcd3c800 0x55f1fcd3cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.904+0000 7f4ff67af800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f1fcd452b0 con 0x55f1fcd3d160 2024-05-08T18:51:44.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.904+0000 7f4ff67af800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55f1fcbdce20 con 0x55f1fcd3c800 2024-05-08T18:51:44.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.904+0000 7f4ff42ae640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55f1fcd3c800 0x55f1fcd3cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.904+0000 7f4ff3aad640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55f1fcd3d160 0x55f1fcd43a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:49072/0 (socket says 172.21.15.132:49072) 2024-05-08T18:51:44.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.904+0000 7f4ff3aad640 1 -- 172.21.15.132:0/3977427835 learned_addr learned my addr 172.21.15.132:0/3977427835 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:51:44.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.905+0000 7f4ff42ae640 1 -- 172.21.15.132:0/3977427835 >> v1:172.21.15.42:6789/0 conn(0x55f1fcd3d160 legacy=0x55f1fcd43a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.905+0000 7f4ff42ae640 1 -- 172.21.15.132:0/3977427835 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1fcd464e0 con 0x55f1fcd3c800 2024-05-08T18:51:44.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.906+0000 7f4ff42ae640 1 --2- 172.21.15.132:0/3977427835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fcd3c800 0x55f1fcd3cc20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4fec005fd0 tx=0x7f4fec01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472a9dec6122b9d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.907+0000 7f4ff32ac640 1 -- 172.21.15.132:0/3977427835 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec052560 con 0x55f1fcd3c800 2024-05-08T18:51:44.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.907+0000 7f4ff32ac640 1 -- 172.21.15.132:0/3977427835 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fec052700 con 0x55f1fcd3c800 2024-05-08T18:51:44.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.907+0000 7f4ff32ac640 1 -- 172.21.15.132:0/3977427835 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec052a60 con 0x55f1fcd3c800 2024-05-08T18:51:44.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.907+0000 7f4ff67af800 1 -- 172.21.15.132:0/3977427835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fcd3c800 msgr2=0x55f1fcd3cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.907+0000 7f4ff67af800 1 --2- 172.21.15.132:0/3977427835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fcd3c800 0x55f1fcd3cc20 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4fec005fd0 tx=0x7f4fec01ccc0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.907+0000 7f4ff67af800 1 -- 172.21.15.132:0/3977427835 shutdown_connections 2024-05-08T18:51:44.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.907+0000 7f4ff67af800 1 --2- 172.21.15.132:0/3977427835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fcd3c800 0x55f1fcd3cc20 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.907+0000 7f4ff67af800 1 -- 172.21.15.132:0/3977427835 >> 172.21.15.132:0/3977427835 conn(0x55f1fcd35eb0 msgr2=0x55f1fcd382d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.907+0000 7f4ff67af800 1 -- 172.21.15.132:0/3977427835 shutdown_connections 2024-05-08T18:51:44.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.907+0000 7f4ff67af800 1 -- 172.21.15.132:0/3977427835 wait complete. 2024-05-08T18:51:44.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.920+0000 7f4ff67af800 1 Processor -- start 2024-05-08T18:51:44.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.920+0000 7f4ff67af800 1 -- start start 2024-05-08T18:51:44.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.921+0000 7f4ff67af800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fcd3c800 0x55f1fce2f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.921+0000 7f4ff67af800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f1fcc875c0 con 0x55f1fcd3c800 2024-05-08T18:51:44.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.921+0000 7f4ff42ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fcd3c800 0x55f1fce2f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.921+0000 7f4ff42ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fcd3c800 0x55f1fce2f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56608/0 (socket says 172.21.15.132:56608) 2024-05-08T18:51:44.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.921+0000 7f4ff42ae640 1 -- 172.21.15.132:0/1038160600 learned_addr learned my addr 172.21.15.132:0/1038160600 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.921+0000 7f4ff42ae640 1 -- 172.21.15.132:0/1038160600 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1fce2fdf0 con 0x55f1fcd3c800 2024-05-08T18:51:44.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.921+0000 7f4ff42ae640 1 --2- 172.21.15.132:0/1038160600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fcd3c800 0x55f1fce2f820 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4fec007000 tx=0x7f4fec04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef13017fd57f62b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.922+0000 7f4ee260c640 1 -- 172.21.15.132:0/1038160600 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec0529e0 con 0x55f1fcd3c800 2024-05-08T18:51:44.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.922+0000 7f4ee260c640 1 -- 172.21.15.132:0/1038160600 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fec052b80 con 0x55f1fcd3c800 2024-05-08T18:51:44.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.922+0000 7f4ee260c640 1 -- 172.21.15.132:0/1038160600 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec05c430 con 0x55f1fcd3c800 2024-05-08T18:51:44.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.922+0000 7f4ff67af800 1 -- 172.21.15.132:0/1038160600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fcd3c800 msgr2=0x55f1fce2f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.922+0000 7f4ff67af800 1 --2- 172.21.15.132:0/1038160600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fcd3c800 0x55f1fce2f820 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4fec007000 tx=0x7f4fec04c000 comp rx=0 tx=0).stop 2024-05-08T18:51:44.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.922+0000 7f4ff67af800 1 -- 172.21.15.132:0/1038160600 shutdown_connections 2024-05-08T18:51:44.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.922+0000 7f4ff67af800 1 --2- 172.21.15.132:0/1038160600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fcd3c800 0x55f1fce2f820 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.922+0000 7f4ff67af800 1 -- 172.21.15.132:0/1038160600 >> 172.21.15.132:0/1038160600 conn(0x55f1fcd35eb0 msgr2=0x55f1fce2b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.922+0000 7f4ff67af800 1 -- 172.21.15.132:0/1038160600 shutdown_connections 2024-05-08T18:51:44.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.922+0000 7f4ff67af800 1 -- 172.21.15.132:0/1038160600 wait complete. 2024-05-08T18:51:44.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.923+0000 7f4ff67af800 1 Processor -- start 2024-05-08T18:51:44.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.923+0000 7f4ff67af800 1 -- start start 2024-05-08T18:51:44.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.923+0000 7f4ff67af800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fcd3c800 0x55f1fce37320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.923+0000 7f4ff67af800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f1fcd45720 con 0x55f1fcd3c800 2024-05-08T18:51:44.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.923+0000 7f4ff42ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fcd3c800 0x55f1fce37320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.923+0000 7f4ff42ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fcd3c800 0x55f1fce37320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56622/0 (socket says 172.21.15.132:56622) 2024-05-08T18:51:44.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.923+0000 7f4ff42ae640 1 -- 172.21.15.132:0/1927546298 learned_addr learned my addr 172.21.15.132:0/1927546298 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.923+0000 7f4ff42ae640 1 -- 172.21.15.132:0/1927546298 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1fce37860 con 0x55f1fcd3c800 2024-05-08T18:51:44.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.924+0000 7f4ff42ae640 1 --2- 172.21.15.132:0/1927546298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fcd3c800 0x55f1fce37320 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0526d0 tx=0x7f4fec003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.924+0000 7f4ee0e09640 1 -- 172.21.15.132:0/1927546298 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec075070 con 0x55f1fcd3c800 2024-05-08T18:51:44.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.924+0000 7f4ee0e09640 1 -- 172.21.15.132:0/1927546298 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fec070410 con 0x55f1fcd3c800 2024-05-08T18:51:44.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.924+0000 7f4ff67af800 1 -- 172.21.15.132:0/1927546298 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1fce37af0 con 0x55f1fcd3c800 2024-05-08T18:51:44.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.924+0000 7f4ee0e09640 1 -- 172.21.15.132:0/1927546298 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fec0529e0 con 0x55f1fcd3c800 2024-05-08T18:51:44.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.924+0000 7f4ff67af800 1 -- 172.21.15.132:0/1927546298 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1fce3a7a0 con 0x55f1fcd3c800 2024-05-08T18:51:44.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.925+0000 7f4ee0e09640 1 -- 172.21.15.132:0/1927546298 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4fec078070 con 0x55f1fcd3c800 2024-05-08T18:51:44.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.925+0000 7f4ee0e09640 1 --2- 172.21.15.132:0/1927546298 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f4edc03bb50 0x7f4edc03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.925+0000 7f4ee0e09640 1 -- 172.21.15.132:0/1927546298 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f4fec06d070 con 0x55f1fcd3c800 2024-05-08T18:51:44.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.925+0000 7f4ff3aad640 1 --2- 172.21.15.132:0/1927546298 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f4edc03bb50 0x7f4edc03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.925+0000 7f4ff67af800 1 --2- 172.21.15.132:0/1927546298 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f1fcd3d160 0x55f1fce3e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.925+0000 7f4ff67af800 1 -- 172.21.15.132:0/1927546298 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce3eae0 con 0x55f1fcd3d160 2024-05-08T18:51:44.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.925+0000 7f4ff4aaf640 1 --2- 172.21.15.132:0/1927546298 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f1fcd3d160 0x55f1fce3e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.925+0000 7f4ff3aad640 1 --2- 172.21.15.132:0/1927546298 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f4edc03bb50 0x7f4edc03e010 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc000f60 tx=0x7f4fdc0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.926+0000 7f4ff4aaf640 1 --2- 172.21.15.132:0/1927546298 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f1fcd3d160 0x55f1fce3e560 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.926+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/1927546298 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fe40083e0 con 0x55f1fcd3d160 2024-05-08T18:51:44.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.926+0000 7f4ff67af800 1 -- 172.21.15.132:0/1927546298 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce3bb10 con 0x55f1fcd3d160 2024-05-08T18:51:44.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.926+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/1927546298 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4fe40083e0 con 0x55f1fcd3d160 2024-05-08T18:51:44.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.926+0000 7f4ff67af800 1 --2- 172.21.15.132:0/1927546298 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f1fce40df0 0x55f1fce431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.926+0000 7f4ff67af800 1 -- 172.21.15.132:0/1927546298 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce438d0 con 0x55f1fce40df0 2024-05-08T18:51:44.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.926+0000 7f4ff42ae640 1 --2- 172.21.15.132:0/1927546298 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f1fce40df0 0x55f1fce431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.926+0000 7f4ff42ae640 1 --2- 172.21.15.132:0/1927546298 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f1fce40df0 0x55f1fce431e0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.927+0000 7f4ff42ae640 1 -- 172.21.15.132:0/1927546298 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4fec077030 con 0x55f1fce40df0 2024-05-08T18:51:44.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.927+0000 7f4ff67af800 1 -- 172.21.15.132:0/1927546298 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce3fc90 con 0x55f1fcd3d160 2024-05-08T18:51:44.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.927+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/1927546298 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4fe40083e0 con 0x55f1fcd3d160 2024-05-08T18:51:44.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.927+0000 7f4ff67af800 1 -- 172.21.15.132:0/1927546298 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce40150 con 0x55f1fcd3d160 2024-05-08T18:51:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.927+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/1927546298 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4fe40083e0 con 0x55f1fcd3d160 2024-05-08T18:51:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.928+0000 7f4ff67af800 1 Processor -- start 2024-05-08T18:51:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.928+0000 7f4ff67af800 1 -- start start 2024-05-08T18:51:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.928+0000 7f4ff67af800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fce52870 0x55f1fce52c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.928+0000 7f4ff67af800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f1fcc2dfc0 con 0x55f1fce52870 2024-05-08T18:51:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.928+0000 7f4ff4aaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fce52870 0x55f1fce52c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.928+0000 7f4ff4aaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fce52870 0x55f1fce52c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56624/0 (socket says 172.21.15.132:56624) 2024-05-08T18:51:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.928+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/223294076 learned_addr learned my addr 172.21.15.132:0/223294076 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.928+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/223294076 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1fce531d0 con 0x55f1fce52870 2024-05-08T18:51:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.929+0000 7f4ff4aaf640 1 --2- 172.21.15.132:0/223294076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fce52870 0x55f1fce52c90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x55f1fce38720 tx=0x7f4fe400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.929+0000 7f4ed9ffb640 1 -- 172.21.15.132:0/223294076 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fe4007d00 con 0x55f1fce52870 2024-05-08T18:51:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.929+0000 7f4ed9ffb640 1 -- 172.21.15.132:0/223294076 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe401e020 con 0x55f1fce52870 2024-05-08T18:51:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.929+0000 7f4ff67af800 1 -- 172.21.15.132:0/223294076 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1fce53c40 con 0x55f1fce52870 2024-05-08T18:51:44.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.929+0000 7f4ed9ffb640 1 -- 172.21.15.132:0/223294076 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fe4019420 con 0x55f1fce52870 2024-05-08T18:51:44.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.929+0000 7f4ff67af800 1 -- 172.21.15.132:0/223294076 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1fce54140 con 0x55f1fce52870 2024-05-08T18:51:44.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.930+0000 7f4ed9ffb640 1 -- 172.21.15.132:0/223294076 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4fe4016040 con 0x55f1fce52870 2024-05-08T18:51:44.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.930+0000 7f4ed9ffb640 1 --2- 172.21.15.132:0/223294076 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f4ecc03bba0 0x7f4ecc03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.930+0000 7f4ed9ffb640 1 -- 172.21.15.132:0/223294076 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f4fe401f030 con 0x55f1fce52870 2024-05-08T18:51:44.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.930+0000 7f4ff42ae640 1 --2- 172.21.15.132:0/223294076 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f4ecc03bba0 0x7f4ecc03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.930+0000 7f4ff67af800 1 Processor -- start 2024-05-08T18:51:44.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.931+0000 7f4ff42ae640 1 --2- 172.21.15.132:0/223294076 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f4ecc03bba0 0x7f4ecc03e060 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55f1fce3ef60 tx=0x7f4fec051460 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.931+0000 7f4ff67af800 1 -- start start 2024-05-08T18:51:44.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.931+0000 7f4ff67af800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fce5fb30 0x55f1fce5ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.931+0000 7f4ff67af800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f1fce30110 con 0x55f1fce5fb30 2024-05-08T18:51:44.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.931+0000 7f4ff4aaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fce5fb30 0x55f1fce5ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.931+0000 7f4ff4aaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fce5fb30 0x55f1fce5ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56628/0 (socket says 172.21.15.132:56628) 2024-05-08T18:51:44.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.931+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/1040706911 learned_addr learned my addr 172.21.15.132:0/1040706911 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.931+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/1040706911 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1fce60520 con 0x55f1fce5fb30 2024-05-08T18:51:44.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.931+0000 7f4ff4aaf640 1 --2- 172.21.15.132:0/1040706911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fce5fb30 0x55f1fce5ff50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4052c20 tx=0x7f4fe4015e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22a9dccef149a44 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.931+0000 7f4ed37fe640 1 -- 172.21.15.132:0/1040706911 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fe401d070 con 0x55f1fce5fb30 2024-05-08T18:51:44.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.931+0000 7f4ed37fe640 1 -- 172.21.15.132:0/1040706911 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe40183b0 con 0x55f1fce5fb30 2024-05-08T18:51:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.931+0000 7f4ed37fe640 1 -- 172.21.15.132:0/1040706911 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fe40173b0 con 0x55f1fce5fb30 2024-05-08T18:51:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.932+0000 7f4ff67af800 1 -- 172.21.15.132:0/1040706911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fce5fb30 msgr2=0x55f1fce5ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.932+0000 7f4ff67af800 1 --2- 172.21.15.132:0/1040706911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fce5fb30 0x55f1fce5ff50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4052c20 tx=0x7f4fe4015e60 comp rx=0 tx=0).stop 2024-05-08T18:51:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.932+0000 7f4ff67af800 1 -- 172.21.15.132:0/1040706911 shutdown_connections 2024-05-08T18:51:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.932+0000 7f4ff67af800 1 --2- 172.21.15.132:0/1040706911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fce5fb30 0x55f1fce5ff50 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.932+0000 7f4ff67af800 1 -- 172.21.15.132:0/1040706911 >> 172.21.15.132:0/1040706911 conn(0x55f1fce5be40 msgr2=0x55f1fce59ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.932+0000 7f4ff67af800 1 -- 172.21.15.132:0/1040706911 shutdown_connections 2024-05-08T18:51:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.932+0000 7f4ff67af800 1 -- 172.21.15.132:0/1040706911 wait complete. 2024-05-08T18:51:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.932+0000 7f4ff67af800 1 Processor -- start 2024-05-08T18:51:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.932+0000 7f4ff67af800 1 -- start start 2024-05-08T18:51:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.932+0000 7f4ff67af800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fce5fb30 0x55f1fce670c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.932+0000 7f4ff67af800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f1fce60cf0 con 0x55f1fce5fb30 2024-05-08T18:51:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.933+0000 7f4ff4aaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fce5fb30 0x55f1fce670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.933+0000 7f4ff4aaf640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fce5fb30 0x55f1fce670c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56640/0 (socket says 172.21.15.132:56640) 2024-05-08T18:51:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.933+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 learned_addr learned my addr 172.21.15.132:0/2091399070 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.933+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1fce67600 con 0x55f1fce5fb30 2024-05-08T18:51:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.933+0000 7f4ff4aaf640 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fce5fb30 0x55f1fce670c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4014a60 tx=0x7f4fe4052bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.933+0000 7f4ed1ffb640 1 -- 172.21.15.132:0/2091399070 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fe4044030 con 0x55f1fce5fb30 2024-05-08T18:51:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.933+0000 7f4ed1ffb640 1 -- 172.21.15.132:0/2091399070 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe40169f0 con 0x55f1fce5fb30 2024-05-08T18:51:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.933+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1fce67890 con 0x55f1fce5fb30 2024-05-08T18:51:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.933+0000 7f4ed1ffb640 1 -- 172.21.15.132:0/2091399070 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fe4016cf0 con 0x55f1fce5fb30 2024-05-08T18:51:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.933+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1fce6a540 con 0x55f1fce5fb30 2024-05-08T18:51:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.934+0000 7f4ed1ffb640 1 -- 172.21.15.132:0/2091399070 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4fe4033020 con 0x55f1fce5fb30 2024-05-08T18:51:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.934+0000 7f4ed1ffb640 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f4ec403bb00 0x7f4ec403dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.934+0000 7f4ed1ffb640 1 -- 172.21.15.132:0/2091399070 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f4fe4031020 con 0x55f1fce5fb30 2024-05-08T18:51:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.934+0000 7f4ff42ae640 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f4ec403bb00 0x7f4ec403dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.935+0000 7f4ff42ae640 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f4ec403bb00 0x7f4ec403dfc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4fec071fc0 tx=0x7f4fec08c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.935+0000 7f4ff67af800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.935+0000 7f4ff67af800 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f1fce72bb0 0x55f1fce75070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.935+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce757c0 con 0x55f1fce72bb0 2024-05-08T18:51:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.935+0000 7f4ff3aad640 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f1fce72bb0 0x55f1fce75070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.935+0000 7f4ff3aad640 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f1fce72bb0 0x55f1fce75070 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.935+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fdc009050 con 0x55f1fce72bb0 2024-05-08T18:51:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.935+0000 7f4ff67af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.935+0000 7f4ff67af800 20 realm 2024-05-08T18:51:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.935+0000 7f4ff67af800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.935+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce72000 con 0x55f1fce72bb0 2024-05-08T18:51:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.936+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fdc009050 con 0x55f1fce72bb0 2024-05-08T18:51:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.936+0000 7f4ff67af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.936+0000 7f4ff67af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.936+0000 7f4ff67af800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.936+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce762b0 con 0x55f1fce72bb0 2024-05-08T18:51:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.936+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fdc009050 con 0x55f1fce72bb0 2024-05-08T18:51:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.936+0000 7f4ff67af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.936+0000 7f4ff67af800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.936+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce76b80 con 0x55f1fce72bb0 2024-05-08T18:51:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.936+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4fdc009050 con 0x55f1fce72bb0 2024-05-08T18:51:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.936+0000 7f4ff67af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.936+0000 7f4ff67af800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.936+0000 7f4ff67af800 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f1fce775a0 0x55f1fce79990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.936+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce7a0d0 con 0x55f1fce775a0 2024-05-08T18:51:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.936+0000 7f4ff4aaf640 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f1fce775a0 0x55f1fce79990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.937+0000 7f4ff4aaf640 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f1fce775a0 0x55f1fce79990 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.937+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4fe404a040 con 0x55f1fce775a0 2024-05-08T18:51:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.937+0000 7f4ff67af800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.937+0000 7f4ff67af800 20 searching for the correct realm 2024-05-08T18:51:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.937+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce7b620 con 0x55f1fce775a0 2024-05-08T18:51:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.937+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe404a040 con 0x55f1fce775a0 2024-05-08T18:51:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.937+0000 7f4ff4aaf640 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4fe4019040 0x7f4fe4023410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.937+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x7f4fe4019040 2024-05-08T18:51:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.937+0000 7f4ff42ae640 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4fe4019040 0x7f4fe4023410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.938+0000 7f4ff42ae640 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4fe4019040 0x7f4fe4023410 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.938+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.938+0000 7f4ff42ae640 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f4fec07a060 0x7f4fec05b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.938+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x7f4fec07a060 2024-05-08T18:51:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.938+0000 7f4ff3aad640 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f4fec07a060 0x7f4fec05b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.939+0000 7f4ff3aad640 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f4fec07a060 0x7f4fec05b7c0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.939+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fdc009050 con 0x7f4fec07a060 2024-05-08T18:51:44.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.939+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x55f1fce72bb0 2024-05-08T18:51:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.939+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fdc009050 con 0x55f1fce72bb0 2024-05-08T18:51:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.939+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x55f1fce72bb0 2024-05-08T18:51:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.940+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.940+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x7f4fec07a060 2024-05-08T18:51:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.940+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.940+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x7f4fec07a060 2024-05-08T18:51:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.940+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.940+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x7f4fe4019040 2024-05-08T18:51:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.940+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.940+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x55f1fce775a0 2024-05-08T18:51:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.941+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe404a040 con 0x55f1fce775a0 2024-05-08T18:51:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.941+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x55f1fce72bb0 2024-05-08T18:51:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.941+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.941+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x7f4fec07a060 2024-05-08T18:51:44.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.941+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.941+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x55f1fce72bb0 2024-05-08T18:51:44.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.941+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.941+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x7f4fe4019040 2024-05-08T18:51:44.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.942+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.942+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x55f1fce775a0 2024-05-08T18:51:44.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.942+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4fe404a040 con 0x55f1fce775a0 2024-05-08T18:51:44.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.942+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x55f1fce775a0 2024-05-08T18:51:44.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.942+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe404a040 con 0x55f1fce775a0 2024-05-08T18:51:44.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.942+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x7f4fec07a060 2024-05-08T18:51:44.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.943+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.943+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x55f1fce775a0 2024-05-08T18:51:44.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.943+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe404a040 con 0x55f1fce775a0 2024-05-08T18:51:44.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.943+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x55f1fce775a0 2024-05-08T18:51:44.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.943+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe404a040 con 0x55f1fce775a0 2024-05-08T18:51:44.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.943+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x55f1fce72bb0 2024-05-08T18:51:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.943+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.943+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x55f1fce72bb0 2024-05-08T18:51:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.944+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.944+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x7f4fec07a060 2024-05-08T18:51:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.944+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.944+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x55f1fce775a0 2024-05-08T18:51:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.944+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe4067040 con 0x55f1fce775a0 2024-05-08T18:51:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.944+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x7f4fe4019040 2024-05-08T18:51:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.944+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.944+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x55f1fce72bb0 2024-05-08T18:51:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.945+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.945+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x7f4fe4019040 2024-05-08T18:51:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.945+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.945+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x55f1fce775a0 2024-05-08T18:51:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.945+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe4067040 con 0x55f1fce775a0 2024-05-08T18:51:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.945+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x7f4fec07a060 2024-05-08T18:51:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.945+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.945+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x7f4fe4019040 2024-05-08T18:51:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.946+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.946+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x55f1fce775a0 2024-05-08T18:51:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.946+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fe4067040 con 0x55f1fce775a0 2024-05-08T18:51:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.946+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x7f4fec07a060 2024-05-08T18:51:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.947+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.947+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x55f1fce72bb0 2024-05-08T18:51:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.947+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.947+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4fe4035070 con 0x7f4fe4019040 2024-05-08T18:51:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.947+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.947+0000 7f4ff67af800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.947+0000 7f4ff67af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.947+0000 7f4ff67af800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.947+0000 7f4ff67af800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.947+0000 7f4ff67af800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.947+0000 7f4ff67af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.947+0000 7f4ff67af800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.947+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce7a0d0 con 0x55f1fce72bb0 2024-05-08T18:51:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.947+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.947+0000 7f4ff67af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.947+0000 7f4ff67af800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.947+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce7a4c0 con 0x55f1fce72bb0 2024-05-08T18:51:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.947+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.947+0000 7f4ff67af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:44.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.947+0000 7f4ff67af800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.947+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce7a8e0 con 0x55f1fce72bb0 2024-05-08T18:51:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.948+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.948+0000 7f4ff67af800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.948+0000 7f4ff67af800 20 zone default found 2024-05-08T18:51:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.948+0000 7f4ff67af800 4 Realm: () 2024-05-08T18:51:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.948+0000 7f4ff67af800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.948+0000 7f4ff67af800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.948+0000 7f4ff67af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.948+0000 7f4ff67af800 20 zonegroup default 2024-05-08T18:51:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.948+0000 7f4ff67af800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.948+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce7bb30 con 0x7f4fe4019040 2024-05-08T18:51:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.948+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.948+0000 7f4ff67af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.948+0000 7f4ff67af800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.948+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce7de00 con 0x55f1fce775a0 2024-05-08T18:51:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.948+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4fe4067040 con 0x55f1fce775a0 2024-05-08T18:51:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.948+0000 7f4ff67af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.948+0000 7f4ff67af800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.948+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce7e1a0 con 0x55f1fce775a0 2024-05-08T18:51:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.949+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4fe4067040 con 0x55f1fce775a0 2024-05-08T18:51:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.949+0000 7f4ff67af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.949+0000 7f4ff67af800 20 started sync module instance, tier type = 2024-05-08T18:51:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.949+0000 7f4ff67af800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.949+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce7d240 con 0x7f4fe4019040 2024-05-08T18:51:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.950+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.950+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94497818531424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce7e650 con 0x7f4fe4019040 2024-05-08T18:51:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.950+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce7eea0 con 0x55f1fce72bb0 2024-05-08T18:51:44.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.951+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94497818531424] v27'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.951+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.951+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94497818534304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce7eea0 con 0x55f1fce72bb0 2024-05-08T18:51:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.951+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce7f9c0 con 0x55f1fce775a0 2024-05-08T18:51:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.952+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fe4067040 con 0x55f1fce775a0 2024-05-08T18:51:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.953+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94497818539152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce7f980 con 0x55f1fce775a0 2024-05-08T18:51:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.953+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce809a0 con 0x7f4fe4019040 2024-05-08T18:51:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.953+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94497818534304] v27'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.954+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.954+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94497818539152] v27'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fe4067040 con 0x55f1fce775a0 2024-05-08T18:51:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.954+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94497818543280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce809a0 con 0x7f4fe4019040 2024-05-08T18:51:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.954+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce81240 con 0x55f1fce72bb0 2024-05-08T18:51:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.955+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.955+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94497818545552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce81660 con 0x55f1fce72bb0 2024-05-08T18:51:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.955+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce81ef0 con 0x7f4fec07a060 2024-05-08T18:51:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.955+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94497818543280] v27'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.956+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.956+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94497818536432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce81b10 con 0x7f4fec07a060 2024-05-08T18:51:44.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.956+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce829a0 con 0x7f4fec07a060 2024-05-08T18:51:44.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.956+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94497818545552] v27'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.957+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94497818536432] v27'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.957+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.957+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94497818551424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce81660 con 0x7f4fec07a060 2024-05-08T18:51:44.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.957+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce83030 con 0x7f4fec07a060 2024-05-08T18:51:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.958+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94497818551424] v27'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.958+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.958+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94497818546608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce81630 con 0x7f4fec07a060 2024-05-08T18:51:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.958+0000 7f4ff67af800 20 add_watcher() i=0 2024-05-08T18:51:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.958+0000 7f4ff67af800 20 add_watcher() i=1 2024-05-08T18:51:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.958+0000 7f4ff67af800 20 add_watcher() i=2 2024-05-08T18:51:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.958+0000 7f4ff67af800 20 add_watcher() i=3 2024-05-08T18:51:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.958+0000 7f4ff67af800 20 add_watcher() i=4 2024-05-08T18:51:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.958+0000 7f4ff67af800 20 add_watcher() i=5 2024-05-08T18:51:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.958+0000 7f4ff67af800 20 add_watcher() i=6 2024-05-08T18:51:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.959+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94497818546608] v27'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.959+0000 7f4ff67af800 20 add_watcher() i=7 2024-05-08T18:51:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.959+0000 7f4ff67af800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.959+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce861a0 con 0x55f1fce72bb0 2024-05-08T18:51:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.960+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.960+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94497818553216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fce83690 con 0x55f1fce72bb0 2024-05-08T18:51:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.961+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94497818553216] v27'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.961+0000 7f4eaa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.961+0000 7f4ff67af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.961+0000 7f4ff67af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.961+0000 7f4ff67af800 5 note: GC not initialized 2024-05-08T18:51:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.961+0000 7f4ea97e2640 20 reqs_thread_entry: start 2024-05-08T18:51:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.961+0000 7f4ff67af800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.961+0000 7f4ff67af800 20 Filter name: none 2024-05-08T18:51:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.961+0000 7f4e1affd640 20 reqs_thread_entry: start 2024-05-08T18:51:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.961+0000 7f4ff67af800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-05-08T18:51:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.961+0000 7f4ff67af800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.961+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fceb9700 con 0x7f4fec07a060 2024-05-08T18:51:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.962+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.962+0000 7f4ff67af800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:51:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.962+0000 7f4ff67af800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-05-08T18:51:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.962+0000 7f4ff67af800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-05-08T18:51:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.962+0000 7f4ff67af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:51:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.962+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcebd950 con 0x7f4fe4019040 2024-05-08T18:51:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.963+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v27'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.964+0000 7f4ff67af800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-08T18:51:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.964+0000 7f4ff67af800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T18:51:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.964+0000 7f4ff67af800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-05-08T18:51:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.964+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94497818792720 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcebe5e0 con 0x7f4fec07a060 2024-05-08T18:51:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.964+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== watch-notify(notify (1) cookie 94497818536432 notify 115964117010 ret 0) ==== 424+0+0 (crc 0 0 0) 0x55f1fcd452b0 con 0x7f4fec07a060 2024-05-08T18:51:44.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.964+0000 7f4ed37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117010 cookie 94497818536432 notifier 4725 bl.length()=382 2024-05-08T18:51:44.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.964+0000 7f4ed37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-08T18:51:44.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.964+0000 7f4ed37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T18:51:44.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.964+0000 7f4ed37fe640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4eb8003ea0 con 0x7f4fec07a060 2024-05-08T18:51:44.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.964+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(64 notify.5 [notify cookie 94497818792720 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.964+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.964+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== watch-notify(notify_complete (2) cookie 94497818792720 notify 115964117010 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4fdc02d720 con 0x7f4fec07a060 2024-05-08T18:51:44.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.964+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcebd310 con 0x55f1fce72bb0 2024-05-08T18:51:44.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.965+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv5 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.965+0000 7f4ff67af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 : miss 2024-05-08T18:51:44.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.965+0000 7f4ff67af800 20 rados->read ofs=0 len=0 2024-05-08T18:51:44.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.965+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:67 8.18 8:1f32a4ab:root::.bucket.meta.myfoo6%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcebb740 con 0x55f1fce72bb0 2024-05-08T18:51:44.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.965+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(67 .bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv16 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.965+0000 7f4ff67af800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:51:44.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.965+0000 7f4ff67af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 info.flags=0x17 2024-05-08T18:51:44.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.965+0000 7f4ff67af800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 to cache LRU end 2024-05-08T18:51:44.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.965+0000 7f4ff67af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:51:44.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.965+0000 7f4ff67af800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:51:44.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.965+0000 7f4ff67af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 2024-05-08T18:51:44.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.965+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 8.18 8:1f32a4ab:root::.bucket.meta.myfoo6%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec57d0 con 0x55f1fce72bb0 2024-05-08T18:51:44.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.966+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 .bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v27'18 uv18 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.966+0000 7f4ff67af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 info.flags=0x17 2024-05-08T18:51:44.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.966+0000 7f4ff67af800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 to cache LRU end 2024-05-08T18:51:44.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.966+0000 7f4ff67af800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-05-08T18:51:44.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.966+0000 7f4ff67af800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9, ofs0, ns] 2024-05-08T18:51:44.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.967+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94497818780288 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec4460 con 0x7f4fe4019040 2024-05-08T18:51:44.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.967+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== watch-notify(notify (1) cookie 94497818543280 notify 115964117029 ret 0) ==== 790+0+0 (crc 0 0 0) 0x7f4fec0a8060 con 0x7f4fe4019040 2024-05-08T18:51:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.967+0000 7f4ed2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117029 cookie 94497818543280 notifier 4725 bl.length()=748 2024-05-08T18:51:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.967+0000 7f4ed2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 info.flags=0x17 2024-05-08T18:51:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.967+0000 7f4ed2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 to cache LRU end 2024-05-08T18:51:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.967+0000 7f4ed2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-05-08T18:51:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.967+0000 7f4ed2ffd640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4e28003530 con 0x7f4fe4019040 2024-05-08T18:51:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.967+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(69 notify.3 [notify cookie 94497818780288 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.967+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== watch-notify(notify_complete (2) cookie 94497818780288 notify 115964117029 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f1fce3a7a0 con 0x7f4fe4019040 2024-05-08T18:51:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.967+0000 7f4ff67af800 20 handle_bi_update(): bucket=:myfoo6[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9]): orig_sources= new_sources= 2024-05-08T18:51:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.967+0000 7f4ff67af800 20 handle_bi_update(): bucket=:myfoo6[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9]): potential sources added=[] removed=[] 2024-05-08T18:51:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.967+0000 7f4ff67af800 20 handle_bi_update(): bucket=:myfoo6[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9]): orig_dests= new_dests= 2024-05-08T18:51:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.967+0000 7f4ff67af800 20 handle_bi_update(): bucket=:myfoo6[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9]): potential dests added=[] removed=[] 2024-05-08T18:51:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.967+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.967+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec3fb0 con 0x55f1fce72bb0 2024-05-08T18:51:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.968+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(71 bud.buckets [call] v27'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.968+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec3fb0 con 0x55f1fce72bb0 2024-05-08T18:51:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.969+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(72 bud.buckets [call] v27'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.969+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec4fc0 con 0x55f1fce72bb0 2024-05-08T18:51:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.970+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v27'19 uv19 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.970+0000 7f4ff67af800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-05-08T18:51:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.970+0000 7f4ff67af800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-05-08T18:51:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.970+0000 7f4ff67af800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-05-08T18:51:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.970+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94497818780288 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcebea10 con 0x7f4fe4019040 2024-05-08T18:51:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.971+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== watch-notify(notify (1) cookie 94497818543280 notify 115964117030 ret 0) ==== 358+0+0 (crc 0 0 0) 0x55f1fce37af0 con 0x7f4fe4019040 2024-05-08T18:51:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.971+0000 7f4ed37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117030 cookie 94497818543280 notifier 4725 bl.length()=316 2024-05-08T18:51:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.971+0000 7f4ed37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-05-08T18:51:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.971+0000 7f4ed37fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-05-08T18:51:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.971+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(74 notify.3 [notify cookie 94497818780288 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.971+0000 7f4ed37fe640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4eb8003ea0 con 0x7f4fe4019040 2024-05-08T18:51:44.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.971+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 20 ==== watch-notify(notify_complete (2) cookie 94497818780288 notify 115964117030 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f1fce37860 con 0x7f4fe4019040 2024-05-08T18:51:44.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.971+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 21 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.971+0000 7f4ff67af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 : hit (requested=0x17, cached=0x17) 2024-05-08T18:51:44.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.971+0000 7f4ff67af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 2024-05-08T18:51:44.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.971+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 8.18 8:1f32a4ab:root::.bucket.meta.myfoo6%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec2120 con 0x55f1fce72bb0 2024-05-08T18:51:44.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.972+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(76 .bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v27'20 uv20 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.972+0000 7f4ff67af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 info.flags=0x17 2024-05-08T18:51:44.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.972+0000 7f4ff67af800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 to cache LRU end 2024-05-08T18:51:44.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.972+0000 7f4ff67af800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-05-08T18:51:44.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.972+0000 7f4ff67af800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9, ofs0, ns] 2024-05-08T18:51:44.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.972+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [notify cookie 94497818812560 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcebea10 con 0x7f4fe4019040 2024-05-08T18:51:44.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.972+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 22 ==== watch-notify(notify (1) cookie 94497818543280 notify 115964117031 ret 0) ==== 790+0+0 (crc 0 0 0) 0x55f1fce37860 con 0x7f4fe4019040 2024-05-08T18:51:44.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.972+0000 7f4ed2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117031 cookie 94497818543280 notifier 4725 bl.length()=748 2024-05-08T18:51:44.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.972+0000 7f4ed2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 info.flags=0x17 2024-05-08T18:51:44.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.972+0000 7f4ed2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 to cache LRU end 2024-05-08T18:51:44.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.972+0000 7f4ed2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-05-08T18:51:44.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.972+0000 7f4ed2ffd640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4e28003560 con 0x7f4fe4019040 2024-05-08T18:51:44.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.973+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 23 ==== osd_op_reply(77 notify.3 [notify cookie 94497818812560 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.973+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 24 ==== watch-notify(notify_complete (2) cookie 94497818812560 notify 115964117031 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f1fce2fdf0 con 0x7f4fe4019040 2024-05-08T18:51:44.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.973+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 25 ==== osd_op_reply(78 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.973+0000 7f4ff67af800 20 handle_bi_update(): bucket=:myfoo6[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9]): orig_sources= new_sources= 2024-05-08T18:51:44.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.973+0000 7f4ff67af800 20 handle_bi_update(): bucket=:myfoo6[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9]): potential sources added=[] removed=[] 2024-05-08T18:51:44.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.973+0000 7f4ff67af800 20 handle_bi_update(): bucket=:myfoo6[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9]): orig_dests= new_dests= 2024-05-08T18:51:44.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.973+0000 7f4ff67af800 20 handle_bi_update(): bucket=:myfoo6[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9]): potential dests added=[] removed=[] 2024-05-08T18:51:44.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.973+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 4.10 4:089cb5ef:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec2090 con 0x55f1fce775a0 2024-05-08T18:51:44.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.973+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(79 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4fe4067040 con 0x55f1fce775a0 2024-05-08T18:51:44.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.973+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:80 4.14 4:290a0c8f:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec2090 con 0x55f1fce775a0 2024-05-08T18:51:44.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.974+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(80 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4fe4067040 con 0x55f1fce775a0 2024-05-08T18:51:44.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.974+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:81 4.6 4:63ee3cce:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec2090 con 0x55f1fce775a0 2024-05-08T18:51:44.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.974+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(81 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4fe4067040 con 0x55f1fce775a0 2024-05-08T18:51:44.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.974+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:82 4.35 4:acfcfe55:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec2090 con 0x55f1fce72bb0 2024-05-08T18:51:44.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.974+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(82 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.974+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 4.b 4:d11f7132:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec2090 con 0x7f4fe4019040 2024-05-08T18:51:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.975+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 26 ==== osd_op_reply(83 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.975+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:84 4.8 4:1283cf10:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec2090 con 0x55f1fce775a0 2024-05-08T18:51:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.975+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(84 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4fe4067040 con 0x55f1fce775a0 2024-05-08T18:51:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.975+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:85 4.33 4:ccad2c2f:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec2090 con 0x7f4fec07a060 2024-05-08T18:51:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.976+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(85 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.976+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:86 4.39 4:9d016cb3:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec2040 con 0x55f1fce775a0 2024-05-08T18:51:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.976+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(86 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4fe4067040 con 0x55f1fce775a0 2024-05-08T18:51:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.976+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 4.1d 4:bb67ae50:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec2040 con 0x55f1fce775a0 2024-05-08T18:51:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.977+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(87 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4fe4078040 con 0x55f1fce775a0 2024-05-08T18:51:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.977+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:88 4.31 4:8d378f2a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec2040 con 0x55f1fce72bb0 2024-05-08T18:51:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.977+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(88 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.9 [call out=378b] v0'0 uv9 ondisk = 0) ==== 194+0+378 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.977+0000 7f4ff67af800 10 cls_bucket_list_unordered: got thirteen 2024-05-08T18:51:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.977+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:89 4.2a 4:54f62651:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec2040 con 0x55f1fce72bb0 2024-05-08T18:51:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.977+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(89 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.10 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.977+0000 7f4ff67af800 20 get_obj_state: octx=0x7f4fdc00e4c0 obj=myfoo6:thirteen state=0x55f1fcec2e08 s->prefetch_data=0 2024-05-08T18:51:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.977+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:90 3.20 3:06d5260b:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec1fc0 con 0x7f4fe4019040 2024-05-08T18:51:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.978+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 27 ==== osd_op_reply(90 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9_thirteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+872 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.978+0000 7f4ff67af800 10 manifest: total_size = 8 2024-05-08T18:51:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.978+0000 7f4ff67af800 20 get_obj_state: setting s->obj_tag to bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.12895747632078945305 2024-05-08T18:51:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.978+0000 7f4ff67af800 20 Read xattr rgw_rados: user.rgw.acl 2024-05-08T18:51:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.978+0000 7f4ff67af800 20 Read xattr rgw_rados: user.rgw.content_type 2024-05-08T18:51:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.978+0000 7f4ff67af800 20 Read xattr rgw_rados: user.rgw.etag 2024-05-08T18:51:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.978+0000 7f4ff67af800 20 Read xattr rgw_rados: user.rgw.idtag 2024-05-08T18:51:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.978+0000 7f4ff67af800 20 Read xattr rgw_rados: user.rgw.manifest 2024-05-08T18:51:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.978+0000 7f4ff67af800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-05-08T18:51:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.978+0000 7f4ff67af800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-05-08T18:51:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.978+0000 7f4ff67af800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-05-08T18:51:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.978+0000 7f4ff67af800 20 get_obj_state: octx=0x7f4fdc00e4c0 obj=myfoo6:thirteen state=0x55f1fcec2e08 s->prefetch_data=0 2024-05-08T18:51:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.978+0000 7f4ff67af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 : hit (requested=0x17, cached=0x17) 2024-05-08T18:51:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.978+0000 7f4ff67af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 2024-05-08T18:51:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.978+0000 7f4ff67af800 20 bucket index object: :.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.9 2024-05-08T18:51:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.978+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:91 4.31 4:8d378f2a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcebb350 con 0x55f1fce72bb0 2024-05-08T18:51:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.979+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 32 ==== osd_op_reply(91 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.9 [stat,call,call] v27'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.979+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:92 3.20 3:06d5260b:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec6ec0 con 0x7f4fe4019040 2024-05-08T18:51:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.980+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 28 ==== osd_op_reply(92 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v27'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.980+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:93 4.31 4:8d378f2a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=267b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec6ec0 con 0x55f1fce72bb0 2024-05-08T18:51:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:1 objects processed in :myfoo6[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9]). Next marker thirteen 2024-05-08T18:51:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.980+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec6ec0 con 0x7f4fe4019040 2024-05-08T18:51:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.981+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 33 ==== osd_op_reply(93 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.9 [stat,call,call] v27'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.981+0000 7f4ed37fe640 20 handle_completion(): completion ok for obj=thirteen 2024-05-08T18:51:44.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.981+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 29 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v27'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.981+0000 7f4ff67af800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-08T18:51:44.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.981+0000 7f4ff67af800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T18:51:44.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.981+0000 7f4ff67af800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-05-08T18:51:44.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.981+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94497818781776 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcebdf40 con 0x7f4fec07a060 2024-05-08T18:51:44.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.982+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== watch-notify(notify (1) cookie 94497818536432 notify 115964117011 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55f1fcec59b0 con 0x7f4fec07a060 2024-05-08T18:51:44.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.982+0000 7f4ed2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117011 cookie 94497818536432 notifier 4725 bl.length()=556 2024-05-08T18:51:44.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.982+0000 7f4ed2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-08T18:51:44.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.982+0000 7f4ed2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T18:51:44.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.982+0000 7f4ed2ffd640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4e280030c0 con 0x7f4fec07a060 2024-05-08T18:51:44.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.982+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(95 notify.5 [notify cookie 94497818781776 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.982+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.982+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== watch-notify(notify_complete (2) cookie 94497818781776 notify 115964117011 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f1fcec2a50 con 0x7f4fec07a060 2024-05-08T18:51:44.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.982+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcebdf00 con 0x55f1fce72bb0 2024-05-08T18:51:44.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.984+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 34 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v27'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.984+0000 7f4ff67af800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-08T18:51:44.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.984+0000 7f4ff67af800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-08T18:51:44.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.984+0000 7f4ff67af800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-05-08T18:51:44.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.984+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94497818781776 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec6ec0 con 0x7f4fec07a060 2024-05-08T18:51:44.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.984+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== watch-notify(notify (1) cookie 94497818536432 notify 115964117012 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55f1fcec2a50 con 0x7f4fec07a060 2024-05-08T18:51:44.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.984+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(98 notify.5 [notify cookie 94497818781776 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.984+0000 7f4ed37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117012 cookie 94497818536432 notifier 4725 bl.length()=177 2024-05-08T18:51:44.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.984+0000 7f4ed37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-08T18:51:44.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.984+0000 7f4ed37fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-08T18:51:44.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.984+0000 7f4ed37fe640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4eb8003ea0 con 0x7f4fec07a060 2024-05-08T18:51:44.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.984+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.984+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 28 ==== watch-notify(notify_complete (2) cookie 94497818781776 notify 115964117012 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f1fcebbb30 con 0x7f4fec07a060 2024-05-08T18:51:44.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.985+0000 7f4ff67af800 10 removing user index: bar 2024-05-08T18:51:44.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.985+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcebdf00 con 0x7f4fec07a060 2024-05-08T18:51:44.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.986+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 29 ==== osd_op_reply(100 bar [delete] v27'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.986+0000 7f4ff67af800 10 removing default.rgw.meta+users.uid+bar from cache 2024-05-08T18:51:44.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.986+0000 7f4ff67af800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-05-08T18:51:44.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.986+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94497818781776 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcec2c20 con 0x7f4fec07a060 2024-05-08T18:51:44.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.986+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 30 ==== watch-notify(notify (1) cookie 94497818546608 notify 115964117013 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55f1fcebbb30 con 0x7f4fec07a060 2024-05-08T18:51:44.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.986+0000 7f4ed37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117013 cookie 94497818546608 notifier 4725 bl.length()=152 2024-05-08T18:51:44.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.986+0000 7f4ed37fe640 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4eb8003ea0 con 0x7f4fec07a060 2024-05-08T18:51:44.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.986+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 31 ==== osd_op_reply(101 notify.7 [notify cookie 94497818781776 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.986+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 32 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:44.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.986+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 33 ==== watch-notify(notify_complete (2) cookie 94497818781776 notify 115964117013 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f1fcebd470 con 0x7f4fec07a060 2024-05-08T18:51:44.994 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-05-08T18:51:44.813467Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:51:44.813453Z","tags":[],"group_ids":[]} 2024-05-08T18:51:44.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.987+0000 7f4eaa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:44.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.988+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94497818553216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcea2010 con 0x55f1fce72bb0 2024-05-08T18:51:44.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.989+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 35 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94497818553216] v27'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.989+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94497818531424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcea2010 con 0x7f4fe4019040 2024-05-08T18:51:44.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.989+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 30 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94497818531424] v27'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:44.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.989+0000 7f4ff67af800 20 remove_watcher() i=0 2024-05-08T18:51:44.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.989+0000 7f4ff67af800 2 removed watcher, disabling cache 2024-05-08T18:51:44.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.990+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94497818534304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcea2010 con 0x55f1fce72bb0 2024-05-08T18:51:44.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.991+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 36 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94497818534304] v27'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:44.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.991+0000 7f4ff67af800 20 remove_watcher() i=1 2024-05-08T18:51:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.991+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94497818539152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcea2010 con 0x55f1fce775a0 2024-05-08T18:51:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.992+0000 7f4ff4aaf640 1 -- 172.21.15.132:0/2091399070 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94497818539152] v27'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fe4078040 con 0x55f1fce775a0 2024-05-08T18:51:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.992+0000 7f4ff67af800 20 remove_watcher() i=2 2024-05-08T18:51:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.992+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94497818543280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcea2010 con 0x7f4fe4019040 2024-05-08T18:51:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.993+0000 7f4ff42ae640 1 -- 172.21.15.132:0/2091399070 <== osd.2 v2:172.21.15.132:6808/1108348591 31 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94497818543280] v27'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fec088040 con 0x7f4fe4019040 2024-05-08T18:51:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.993+0000 7f4ff67af800 20 remove_watcher() i=3 2024-05-08T18:51:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.993+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94497818545552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcea2010 con 0x55f1fce72bb0 2024-05-08T18:51:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.994+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.1 v2:172.21.15.132:6800/3697320277 37 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94497818545552] v27'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x55f1fce72bb0 2024-05-08T18:51:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.994+0000 7f4ff67af800 20 remove_watcher() i=4 2024-05-08T18:51:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.994+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94497818536432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcea2010 con 0x7f4fec07a060 2024-05-08T18:51:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.995+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 34 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94497818536432] v27'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.995+0000 7f4ff67af800 20 remove_watcher() i=5 2024-05-08T18:51:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.995+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94497818551424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcea2010 con 0x7f4fec07a060 2024-05-08T18:51:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.996+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 35 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94497818551424] v27'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.996+0000 7f4ff67af800 20 remove_watcher() i=6 2024-05-08T18:51:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.996+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94497818546608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f1fcea2010 con 0x7f4fec07a060 2024-05-08T18:51:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.997+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 <== osd.0 v2:172.21.15.42:6800/1521799280 36 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94497818546608] v27'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fdc029040 con 0x7f4fec07a060 2024-05-08T18:51:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.997+0000 7f4ff67af800 20 remove_watcher() i=7 2024-05-08T18:51:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.997+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f4fec07a060 msgr2=0x7f4fec05b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.997+0000 7f4ff67af800 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f4fec07a060 0x7f4fec05b7c0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.997+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f1fce72bb0 msgr2=0x55f1fce75070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.997+0000 7f4ff67af800 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f1fce72bb0 0x55f1fce75070 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.997+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4fe4019040 msgr2=0x7f4fe4023410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.997+0000 7f4ff67af800 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4fe4019040 0x7f4fe4023410 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.997+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f1fce775a0 msgr2=0x55f1fce79990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.997+0000 7f4ff67af800 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f1fce775a0 0x55f1fce79990 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.997+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f4ec403bb00 msgr2=0x7f4ec403dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.997+0000 7f4ff67af800 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f4ec403bb00 0x7f4ec403dfc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4fec071fc0 tx=0x7f4fec08c000 comp rx=0 tx=0).stop 2024-05-08T18:51:45.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.997+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fce5fb30 msgr2=0x55f1fce670c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:45.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.997+0000 7f4ff3aad640 1 -- 172.21.15.132:0/2091399070 reap_dead start 2024-05-08T18:51:45.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.997+0000 7f4ff67af800 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fce5fb30 0x55f1fce670c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4014a60 tx=0x7f4fe4052bb0 comp rx=0 tx=0).stop 2024-05-08T18:51:45.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.997+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 shutdown_connections 2024-05-08T18:51:45.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.997+0000 7f4ff67af800 1 --2- 172.21.15.132:0/2091399070 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fce5fb30 0x55f1fce670c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:45.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.997+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 >> 172.21.15.132:0/2091399070 conn(0x55f1fce5be40 msgr2=0x55f1fce594f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:45.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.997+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 shutdown_connections 2024-05-08T18:51:45.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.997+0000 7f4ff67af800 1 -- 172.21.15.132:0/2091399070 wait complete. 2024-05-08T18:51:45.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 -- 172.21.15.132:0/223294076 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f4ecc03bba0 msgr2=0x7f4ecc03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:45.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 --2- 172.21.15.132:0/223294076 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f4ecc03bba0 0x7f4ecc03e060 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55f1fce3ef60 tx=0x7f4fec051460 comp rx=0 tx=0).stop 2024-05-08T18:51:45.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 -- 172.21.15.132:0/223294076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fce52870 msgr2=0x55f1fce52c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:45.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 --2- 172.21.15.132:0/223294076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fce52870 0x55f1fce52c90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x55f1fce38720 tx=0x7f4fe400aec0 comp rx=0 tx=0).stop 2024-05-08T18:51:45.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 -- 172.21.15.132:0/223294076 shutdown_connections 2024-05-08T18:51:45.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 --2- 172.21.15.132:0/223294076 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f4ecc03bba0 0x7f4ecc03e060 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 --2- 172.21.15.132:0/223294076 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fce52870 0x55f1fce52c90 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 -- 172.21.15.132:0/223294076 >> 172.21.15.132:0/223294076 conn(0x55f1fce46910 msgr2=0x55f1fce46d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 -- 172.21.15.132:0/223294076 shutdown_connections 2024-05-08T18:51:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 -- 172.21.15.132:0/223294076 wait complete. 2024-05-08T18:51:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 -- 172.21.15.132:0/1927546298 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f1fcd3d160 msgr2=0x55f1fce3e560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 --2- 172.21.15.132:0/1927546298 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f1fcd3d160 0x55f1fce3e560 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 -- 172.21.15.132:0/1927546298 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f1fce40df0 msgr2=0x55f1fce431e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 --2- 172.21.15.132:0/1927546298 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f1fce40df0 0x55f1fce431e0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 -- 172.21.15.132:0/1927546298 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f4edc03bb50 msgr2=0x7f4edc03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 --2- 172.21.15.132:0/1927546298 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f4edc03bb50 0x7f4edc03e010 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc000f60 tx=0x7f4fdc0012b0 comp rx=0 tx=0).stop 2024-05-08T18:51:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 -- 172.21.15.132:0/1927546298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fcd3c800 msgr2=0x55f1fce37320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 --2- 172.21.15.132:0/1927546298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fcd3c800 0x55f1fce37320 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0526d0 tx=0x7f4fec003330 comp rx=0 tx=0).stop 2024-05-08T18:51:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 -- 172.21.15.132:0/1927546298 shutdown_connections 2024-05-08T18:51:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 --2- 172.21.15.132:0/1927546298 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f1fce40df0 0x55f1fce431e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 --2- 172.21.15.132:0/1927546298 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f1fcd3d160 0x55f1fce3e560 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:45.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 --2- 172.21.15.132:0/1927546298 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f4edc03bb50 0x7f4edc03e010 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:45.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 --2- 172.21.15.132:0/1927546298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f1fcd3c800 0x55f1fce37320 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:45.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 -- 172.21.15.132:0/1927546298 >> 172.21.15.132:0/1927546298 conn(0x55f1fcd35eb0 msgr2=0x55f1fce29940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:45.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 -- 172.21.15.132:0/1927546298 shutdown_connections 2024-05-08T18:51:45.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:44.998+0000 7f4ff67af800 1 -- 172.21.15.132:0/1927546298 wait complete. 2024-05-08T18:51:45.007 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-05-08T18:51:44.813467Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:51:44.813453Z', 'tags': [], 'group_ids': []} 2024-05-08T18:51:50.013 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:51:50.014 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-05-08T18:51:50.014 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-05-08T18:51:50.014 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-05-08T18:51:50.014 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-05-08T18:51:50.074 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:50.074 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:50.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.075+0000 7f2077d2e800 1 Processor -- start 2024-05-08T18:51:50.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.075+0000 7f2077d2e800 1 -- start start 2024-05-08T18:51:50.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.076+0000 7f2077d2e800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x555c474cd820 0x555c474cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.076+0000 7f2077d2e800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555c474d0150 con 0x555c474c9d10 2024-05-08T18:51:50.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.076+0000 7f2077d2e800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x555c47369e20 con 0x555c474cd820 2024-05-08T18:51:50.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.076+0000 7f206bfff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x555c474cd820 0x555c474cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.076+0000 7f2073a84640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x555c474c9d10 0x555c474cc100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:49086/0 (socket says 172.21.15.132:49086) 2024-05-08T18:51:50.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.076+0000 7f2073a84640 1 -- 172.21.15.132:0/549149926 learned_addr learned my addr 172.21.15.132:0/549149926 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:51:50.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.076+0000 7f206bfff640 1 --2- 172.21.15.132:0/549149926 >> v2:172.21.15.42:3300/0 conn(0x555c474cd820 0x555c474cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56652/0 (socket says 172.21.15.132:56652) 2024-05-08T18:51:50.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.076+0000 7f206bfff640 1 -- 172.21.15.132:0/549149926 >> v1:172.21.15.42:6789/0 conn(0x555c474c9d10 legacy=0x555c474cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.076+0000 7f206bfff640 1 -- 172.21.15.132:0/549149926 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c474d1330 con 0x555c474cd820 2024-05-08T18:51:50.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.078+0000 7f206bfff640 1 --2- 172.21.15.132:0/549149926 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c474cd820 0x555c474cfc10 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f205c00a470 tx=0x7f205c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33347698a606600 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.079+0000 7f2073283640 1 -- 172.21.15.132:0/549149926 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205c057070 con 0x555c474cd820 2024-05-08T18:51:50.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.079+0000 7f2073283640 1 -- 172.21.15.132:0/549149926 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205c052570 con 0x555c474cd820 2024-05-08T18:51:50.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.079+0000 7f2073283640 1 -- 172.21.15.132:0/549149926 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205c052870 con 0x555c474cd820 2024-05-08T18:51:50.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.079+0000 7f2077d2e800 1 -- 172.21.15.132:0/549149926 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c474cd820 msgr2=0x555c474cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.079+0000 7f2077d2e800 1 --2- 172.21.15.132:0/549149926 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c474cd820 0x555c474cfc10 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f205c00a470 tx=0x7f205c01ce90 comp rx=0 tx=0).stop 2024-05-08T18:51:50.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.079+0000 7f2077d2e800 1 -- 172.21.15.132:0/549149926 shutdown_connections 2024-05-08T18:51:50.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.079+0000 7f2077d2e800 1 --2- 172.21.15.132:0/549149926 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c474cd820 0x555c474cfc10 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.079+0000 7f2077d2e800 1 -- 172.21.15.132:0/549149926 >> 172.21.15.132:0/549149926 conn(0x555c474c36e0 msgr2=0x555c474c5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.079+0000 7f2077d2e800 1 -- 172.21.15.132:0/549149926 shutdown_connections 2024-05-08T18:51:50.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.079+0000 7f2077d2e800 1 -- 172.21.15.132:0/549149926 wait complete. 2024-05-08T18:51:50.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.094+0000 7f2077d2e800 1 Processor -- start 2024-05-08T18:51:50.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.095+0000 7f2077d2e800 1 -- start start 2024-05-08T18:51:50.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.095+0000 7f2077d2e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c474c9d10 0x555c474c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.095+0000 7f2077d2e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555c474145f0 con 0x555c474c9d10 2024-05-08T18:51:50.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.095+0000 7f2073a84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c474c9d10 0x555c474c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.095+0000 7f2073a84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c474c9d10 0x555c474c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56664/0 (socket says 172.21.15.132:56664) 2024-05-08T18:51:50.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.095+0000 7f2073a84640 1 -- 172.21.15.132:0/2555793625 learned_addr learned my addr 172.21.15.132:0/2555793625 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:50.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.095+0000 7f2073a84640 1 -- 172.21.15.132:0/2555793625 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c474c7c10 con 0x555c474c9d10 2024-05-08T18:51:50.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.095+0000 7f2073a84640 1 --2- 172.21.15.132:0/2555793625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c474c9d10 0x555c474c9650 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2064001de0 tx=0x7f206400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb129649f64b12a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.096+0000 7f1f61e0b640 1 -- 172.21.15.132:0/2555793625 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2064012020 con 0x555c474c9d10 2024-05-08T18:51:50.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.096+0000 7f1f61e0b640 1 -- 172.21.15.132:0/2555793625 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206400e5a0 con 0x555c474c9d10 2024-05-08T18:51:50.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.096+0000 7f1f61e0b640 1 -- 172.21.15.132:0/2555793625 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f206400e8c0 con 0x555c474c9d10 2024-05-08T18:51:50.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.096+0000 7f2077d2e800 1 -- 172.21.15.132:0/2555793625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c474c9d10 msgr2=0x555c474c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.096+0000 7f2077d2e800 1 --2- 172.21.15.132:0/2555793625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c474c9d10 0x555c474c9650 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2064001de0 tx=0x7f206400b6c0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.096+0000 7f2077d2e800 1 -- 172.21.15.132:0/2555793625 shutdown_connections 2024-05-08T18:51:50.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.096+0000 7f2077d2e800 1 --2- 172.21.15.132:0/2555793625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c474c9d10 0x555c474c9650 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.096+0000 7f2077d2e800 1 -- 172.21.15.132:0/2555793625 >> 172.21.15.132:0/2555793625 conn(0x555c474c36e0 msgr2=0x555c475b6080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.097+0000 7f2077d2e800 1 -- 172.21.15.132:0/2555793625 shutdown_connections 2024-05-08T18:51:50.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.097+0000 7f2077d2e800 1 -- 172.21.15.132:0/2555793625 wait complete. 2024-05-08T18:51:50.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.097+0000 7f2077d2e800 1 Processor -- start 2024-05-08T18:51:50.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.097+0000 7f2077d2e800 1 -- start start 2024-05-08T18:51:50.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.097+0000 7f2077d2e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c474c9d10 0x555c475c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.097+0000 7f2077d2e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555c474d0620 con 0x555c474c9d10 2024-05-08T18:51:50.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.097+0000 7f2073a84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c474c9d10 0x555c475c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.097+0000 7f2073a84640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c474c9d10 0x555c475c44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56672/0 (socket says 172.21.15.132:56672) 2024-05-08T18:51:50.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.097+0000 7f2073a84640 1 -- 172.21.15.132:0/4088083928 learned_addr learned my addr 172.21.15.132:0/4088083928 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:50.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.098+0000 7f2073a84640 1 -- 172.21.15.132:0/4088083928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c475c4a00 con 0x555c474c9d10 2024-05-08T18:51:50.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.098+0000 7f2073a84640 1 --2- 172.21.15.132:0/4088083928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c474c9d10 0x555c475c44c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2064001de0 tx=0x7f2064000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.098+0000 7f1f5bfff640 1 -- 172.21.15.132:0/4088083928 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2064012030 con 0x555c474c9d10 2024-05-08T18:51:50.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.098+0000 7f1f5bfff640 1 -- 172.21.15.132:0/4088083928 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206401a7a0 con 0x555c474c9d10 2024-05-08T18:51:50.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.098+0000 7f2077d2e800 1 -- 172.21.15.132:0/4088083928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c475c4c90 con 0x555c474c9d10 2024-05-08T18:51:50.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.098+0000 7f1f5bfff640 1 -- 172.21.15.132:0/4088083928 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f206401aac0 con 0x555c474c9d10 2024-05-08T18:51:50.100 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.099+0000 7f2077d2e800 1 -- 172.21.15.132:0/4088083928 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c475c78f0 con 0x555c474c9d10 2024-05-08T18:51:50.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.099+0000 7f1f5bfff640 1 -- 172.21.15.132:0/4088083928 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2064015020 con 0x555c474c9d10 2024-05-08T18:51:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.100+0000 7f1f5bfff640 1 --2- 172.21.15.132:0/4088083928 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f5c03bba0 0x7f1f5c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.100+0000 7f1f5bfff640 1 -- 172.21.15.132:0/4088083928 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f2064020070 con 0x555c474c9d10 2024-05-08T18:51:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.100+0000 7f206bfff640 1 --2- 172.21.15.132:0/4088083928 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f5c03bba0 0x7f1f5c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.100+0000 7f2077d2e800 1 --2- 172.21.15.132:0/4088083928 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555c474cd820 0x555c475cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.100+0000 7f2077d2e800 1 -- 172.21.15.132:0/4088083928 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555c475cbbf0 con 0x555c474cd820 2024-05-08T18:51:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.100+0000 7f2074285640 1 --2- 172.21.15.132:0/4088083928 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555c474cd820 0x555c475cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.100+0000 7f206bfff640 1 --2- 172.21.15.132:0/4088083928 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f5c03bba0 0x7f1f5c03e060 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f205c054000 tx=0x7f205c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.100+0000 7f2074285640 1 --2- 172.21.15.132:0/4088083928 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555c474cd820 0x555c475cb6b0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.101+0000 7f2074285640 1 -- 172.21.15.132:0/4088083928 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f206c00a4a0 con 0x555c474cd820 2024-05-08T18:51:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.101+0000 7f2077d2e800 1 -- 172.21.15.132:0/4088083928 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555c475c8c80 con 0x555c474cd820 2024-05-08T18:51:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.101+0000 7f2074285640 1 -- 172.21.15.132:0/4088083928 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f206c00a4a0 con 0x555c474cd820 2024-05-08T18:51:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.101+0000 7f2077d2e800 1 --2- 172.21.15.132:0/4088083928 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555c475cdf30 0x555c475d0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.101+0000 7f2077d2e800 1 -- 172.21.15.132:0/4088083928 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555c475d0a10 con 0x555c475cdf30 2024-05-08T18:51:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.101+0000 7f2073a84640 1 --2- 172.21.15.132:0/4088083928 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555c475cdf30 0x555c475d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.101+0000 7f2073a84640 1 --2- 172.21.15.132:0/4088083928 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555c475cdf30 0x555c475d0320 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.102+0000 7f2073a84640 1 -- 172.21.15.132:0/4088083928 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2064024460 con 0x555c475cdf30 2024-05-08T18:51:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.102+0000 7f2077d2e800 1 -- 172.21.15.132:0/4088083928 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555c475ccdd0 con 0x555c474cd820 2024-05-08T18:51:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.102+0000 7f2074285640 1 -- 172.21.15.132:0/4088083928 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f206c00a4a0 con 0x555c474cd820 2024-05-08T18:51:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.102+0000 7f2077d2e800 1 -- 172.21.15.132:0/4088083928 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555c475cd2b0 con 0x555c474cd820 2024-05-08T18:51:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.102+0000 7f2074285640 1 -- 172.21.15.132:0/4088083928 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f206c00a4a0 con 0x555c474cd820 2024-05-08T18:51:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.103+0000 7f2077d2e800 1 Processor -- start 2024-05-08T18:51:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.103+0000 7f2077d2e800 1 -- start start 2024-05-08T18:51:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.103+0000 7f2077d2e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c475df950 0x555c475dfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.103+0000 7f2077d2e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555c473bafc0 con 0x555c475df950 2024-05-08T18:51:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.103+0000 7f2074285640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c475df950 0x555c475dfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.103+0000 7f2074285640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c475df950 0x555c475dfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56684/0 (socket says 172.21.15.132:56684) 2024-05-08T18:51:50.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.103+0000 7f2074285640 1 -- 172.21.15.132:0/3193505472 learned_addr learned my addr 172.21.15.132:0/3193505472 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:50.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.104+0000 7f2074285640 1 -- 172.21.15.132:0/3193505472 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c475e02b0 con 0x555c475df950 2024-05-08T18:51:50.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.104+0000 7f2074285640 1 --2- 172.21.15.132:0/3193505472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c475df950 0x555c475dfd70 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x555c475cbf90 tx=0x7f206c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.104+0000 7f1f597fa640 1 -- 172.21.15.132:0/3193505472 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f206c014450 con 0x555c475df950 2024-05-08T18:51:50.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.104+0000 7f1f597fa640 1 -- 172.21.15.132:0/3193505472 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206c014610 con 0x555c475df950 2024-05-08T18:51:50.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.104+0000 7f2077d2e800 1 -- 172.21.15.132:0/3193505472 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c475e0d20 con 0x555c475df950 2024-05-08T18:51:50.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.104+0000 7f1f597fa640 1 -- 172.21.15.132:0/3193505472 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f206c014930 con 0x555c475df950 2024-05-08T18:51:50.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.104+0000 7f2077d2e800 1 -- 172.21.15.132:0/3193505472 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c475e1220 con 0x555c475df950 2024-05-08T18:51:50.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.105+0000 7f1f597fa640 1 -- 172.21.15.132:0/3193505472 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f206c011040 con 0x555c475df950 2024-05-08T18:51:50.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.105+0000 7f1f597fa640 1 --2- 172.21.15.132:0/3193505472 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f4c03bba0 0x7f1f4c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.106+0000 7f1f597fa640 1 -- 172.21.15.132:0/3193505472 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f206c01e070 con 0x555c475df950 2024-05-08T18:51:50.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.106+0000 7f2073a84640 1 --2- 172.21.15.132:0/3193505472 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f4c03bba0 0x7f1f4c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.106+0000 7f2077d2e800 1 Processor -- start 2024-05-08T18:51:50.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.106+0000 7f2077d2e800 1 -- start start 2024-05-08T18:51:50.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.106+0000 7f2073a84640 1 --2- 172.21.15.132:0/3193505472 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f4c03bba0 0x7f1f4c03e060 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x555c475cc080 tx=0x7f206401ae40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.106+0000 7f2077d2e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c475ecbd0 0x555c475ecff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.106+0000 7f2077d2e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555c474c7f90 con 0x555c475ecbd0 2024-05-08T18:51:50.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.106+0000 7f2074285640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c475ecbd0 0x555c475ecff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.106+0000 7f2074285640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c475ecbd0 0x555c475ecff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56690/0 (socket says 172.21.15.132:56690) 2024-05-08T18:51:50.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.106+0000 7f2074285640 1 -- 172.21.15.132:0/3122032625 learned_addr learned my addr 172.21.15.132:0/3122032625 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:50.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.107+0000 7f2074285640 1 -- 172.21.15.132:0/3122032625 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c475ed5c0 con 0x555c475ecbd0 2024-05-08T18:51:50.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.107+0000 7f2074285640 1 --2- 172.21.15.132:0/3122032625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c475ecbd0 0x555c475ecff0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f206c013fd0 tx=0x7f206c0451b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6025071c3d590cf5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.107+0000 7f1f52ffd640 1 -- 172.21.15.132:0/3122032625 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f206c051070 con 0x555c475ecbd0 2024-05-08T18:51:50.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.107+0000 7f1f52ffd640 1 -- 172.21.15.132:0/3122032625 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206c02bc50 con 0x555c475ecbd0 2024-05-08T18:51:50.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.107+0000 7f1f52ffd640 1 -- 172.21.15.132:0/3122032625 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f206c0167c0 con 0x555c475ecbd0 2024-05-08T18:51:50.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.107+0000 7f2077d2e800 1 -- 172.21.15.132:0/3122032625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c475ecbd0 msgr2=0x555c475ecff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.107+0000 7f2077d2e800 1 --2- 172.21.15.132:0/3122032625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c475ecbd0 0x555c475ecff0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f206c013fd0 tx=0x7f206c0451b0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.107+0000 7f2077d2e800 1 -- 172.21.15.132:0/3122032625 shutdown_connections 2024-05-08T18:51:50.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.107+0000 7f2077d2e800 1 --2- 172.21.15.132:0/3122032625 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c475ecbd0 0x555c475ecff0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.107+0000 7f2077d2e800 1 -- 172.21.15.132:0/3122032625 >> 172.21.15.132:0/3122032625 conn(0x555c475e8f30 msgr2=0x555c475e6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.108+0000 7f2077d2e800 1 -- 172.21.15.132:0/3122032625 shutdown_connections 2024-05-08T18:51:50.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.108+0000 7f2077d2e800 1 -- 172.21.15.132:0/3122032625 wait complete. 2024-05-08T18:51:50.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.108+0000 7f2077d2e800 1 Processor -- start 2024-05-08T18:51:50.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.108+0000 7f2077d2e800 1 -- start start 2024-05-08T18:51:50.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.108+0000 7f2077d2e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c475ecbd0 0x555c475f4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.108+0000 7f2077d2e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x555c475edd30 con 0x555c475ecbd0 2024-05-08T18:51:50.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.108+0000 7f2074285640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c475ecbd0 0x555c475f4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.108+0000 7f2074285640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c475ecbd0 0x555c475f4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56698/0 (socket says 172.21.15.132:56698) 2024-05-08T18:51:50.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.108+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 learned_addr learned my addr 172.21.15.132:0/439958854 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:50.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.109+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c475f4750 con 0x555c475ecbd0 2024-05-08T18:51:50.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.109+0000 7f2074285640 1 --2- 172.21.15.132:0/439958854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c475ecbd0 0x555c475f4210 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f206c0114a0 tx=0x7f206c052d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.109+0000 7f1f517fa640 1 -- 172.21.15.132:0/439958854 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f206c02be00 con 0x555c475ecbd0 2024-05-08T18:51:50.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.109+0000 7f1f517fa640 1 -- 172.21.15.132:0/439958854 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206c02b560 con 0x555c475ecbd0 2024-05-08T18:51:50.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.109+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c475f49e0 con 0x555c475ecbd0 2024-05-08T18:51:50.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.109+0000 7f1f517fa640 1 -- 172.21.15.132:0/439958854 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f206c02b860 con 0x555c475ecbd0 2024-05-08T18:51:50.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.109+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c475f7690 con 0x555c475ecbd0 2024-05-08T18:51:50.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.110+0000 7f1f517fa640 1 -- 172.21.15.132:0/439958854 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f206c054a10 con 0x555c475ecbd0 2024-05-08T18:51:50.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.110+0000 7f1f517fa640 1 --2- 172.21.15.132:0/439958854 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f3c03bb50 0x7f1f3c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.110+0000 7f1f517fa640 1 -- 172.21.15.132:0/439958854 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f206c00e040 con 0x555c475ecbd0 2024-05-08T18:51:50.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.110+0000 7f2073a84640 1 --2- 172.21.15.132:0/439958854 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f3c03bb50 0x7f1f3c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.111+0000 7f2077d2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.111+0000 7f2073a84640 1 --2- 172.21.15.132:0/439958854 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f3c03bb50 0x7f1f3c03e010 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f206402dfb0 tx=0x7f2064049000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.111+0000 7f2077d2e800 1 --2- 172.21.15.132:0/439958854 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555c475ffe40 0x555c47602300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.111+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555c47602a50 con 0x555c475ffe40 2024-05-08T18:51:50.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.111+0000 7f206bfff640 1 --2- 172.21.15.132:0/439958854 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555c475ffe40 0x555c47602300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.111+0000 7f206bfff640 1 --2- 172.21.15.132:0/439958854 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555c475ffe40 0x555c47602300 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.111+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f205c05a040 con 0x555c475ffe40 2024-05-08T18:51:50.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.111+0000 7f2077d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.111+0000 7f2077d2e800 20 realm 2024-05-08T18:51:50.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.111+0000 7f2077d2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.111+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555c47602e20 con 0x555c475ffe40 2024-05-08T18:51:50.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.112+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f205c05a040 con 0x555c475ffe40 2024-05-08T18:51:50.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.112+0000 7f2077d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.112+0000 7f2077d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:50.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.112+0000 7f2077d2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.112+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555c476036f0 con 0x555c475ffe40 2024-05-08T18:51:50.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.112+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f205c05a040 con 0x555c475ffe40 2024-05-08T18:51:50.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.112+0000 7f2077d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.112+0000 7f2077d2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.112+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555c47603a90 con 0x555c475ffe40 2024-05-08T18:51:50.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.112+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f205c05a040 con 0x555c475ffe40 2024-05-08T18:51:50.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.112+0000 7f2077d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:50.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.112+0000 7f2077d2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.112+0000 7f2077d2e800 1 --2- 172.21.15.132:0/439958854 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555c476047f0 0x555c47606be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.112+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555c476071a0 con 0x555c476047f0 2024-05-08T18:51:50.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.112+0000 7f2074285640 1 --2- 172.21.15.132:0/439958854 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555c476047f0 0x555c47606be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.112+0000 7f2074285640 1 --2- 172.21.15.132:0/439958854 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555c476047f0 0x555c47606be0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.113+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f206c03e070 con 0x555c476047f0 2024-05-08T18:51:50.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.113+0000 7f2077d2e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:50.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.113+0000 7f2077d2e800 20 searching for the correct realm 2024-05-08T18:51:50.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.113+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x555c476047f0 2024-05-08T18:51:50.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.113+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206c05e040 con 0x555c476047f0 2024-05-08T18:51:50.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.113+0000 7f2074285640 1 --2- 172.21.15.132:0/439958854 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f206c037020 0x7f206c0514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.113+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x7f206c037020 2024-05-08T18:51:50.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.114+0000 7f2073a84640 1 --2- 172.21.15.132:0/439958854 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f206c037020 0x7f206c0514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.114+0000 7f2073a84640 1 --2- 172.21.15.132:0/439958854 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f206c037020 0x7f206c0514d0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.114+0000 7f2073a84640 1 -- 172.21.15.132:0/439958854 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2064024460 con 0x7f206c037020 2024-05-08T18:51:50.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.114+0000 7f2073a84640 1 --2- 172.21.15.132:0/439958854 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2064017050 0x7f20640167f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.114+0000 7f2073a84640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x7f2064017050 2024-05-08T18:51:50.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.114+0000 7f206bfff640 1 --2- 172.21.15.132:0/439958854 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2064017050 0x7f20640167f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.115+0000 7f206bfff640 1 --2- 172.21.15.132:0/439958854 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2064017050 0x7f20640167f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.115+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c05a040 con 0x7f2064017050 2024-05-08T18:51:50.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.115+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x555c475ffe40 2024-05-08T18:51:50.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.115+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c05a040 con 0x555c475ffe40 2024-05-08T18:51:50.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.115+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x555c475ffe40 2024-05-08T18:51:50.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.116+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c05a040 con 0x555c475ffe40 2024-05-08T18:51:50.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.116+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x7f2064017050 2024-05-08T18:51:50.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.116+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c05a040 con 0x7f2064017050 2024-05-08T18:51:50.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.116+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x7f2064017050 2024-05-08T18:51:50.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.116+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c05a040 con 0x7f2064017050 2024-05-08T18:51:50.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.116+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x7f206c037020 2024-05-08T18:51:50.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.117+0000 7f2073a84640 1 -- 172.21.15.132:0/439958854 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2064024460 con 0x7f206c037020 2024-05-08T18:51:50.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.117+0000 7f2073a84640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x555c476047f0 2024-05-08T18:51:50.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.117+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206c05e040 con 0x555c476047f0 2024-05-08T18:51:50.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.117+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x555c475ffe40 2024-05-08T18:51:50.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.117+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c05a040 con 0x555c475ffe40 2024-05-08T18:51:50.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.117+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x7f2064017050 2024-05-08T18:51:50.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.118+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c05a040 con 0x7f2064017050 2024-05-08T18:51:50.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.118+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x555c475ffe40 2024-05-08T18:51:50.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.118+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f205c05a040 con 0x555c475ffe40 2024-05-08T18:51:50.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.118+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x7f206c037020 2024-05-08T18:51:50.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.118+0000 7f2073a84640 1 -- 172.21.15.132:0/439958854 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2064024460 con 0x7f206c037020 2024-05-08T18:51:50.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.118+0000 7f2073a84640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x555c476047f0 2024-05-08T18:51:50.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.118+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f206c05e040 con 0x555c476047f0 2024-05-08T18:51:50.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.118+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x555c476047f0 2024-05-08T18:51:50.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.119+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206c05e040 con 0x555c476047f0 2024-05-08T18:51:50.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.119+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x7f2064017050 2024-05-08T18:51:50.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.119+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c05a040 con 0x7f2064017050 2024-05-08T18:51:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.119+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x555c476047f0 2024-05-08T18:51:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.119+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206c05e040 con 0x555c476047f0 2024-05-08T18:51:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.119+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x555c476047f0 2024-05-08T18:51:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.119+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206c05e040 con 0x555c476047f0 2024-05-08T18:51:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.119+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x555c475ffe40 2024-05-08T18:51:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.120+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c05a040 con 0x555c475ffe40 2024-05-08T18:51:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.120+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x555c475ffe40 2024-05-08T18:51:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.120+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f205c05a040 con 0x555c475ffe40 2024-05-08T18:51:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.120+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x7f2064017050 2024-05-08T18:51:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.120+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c07d040 con 0x7f2064017050 2024-05-08T18:51:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.120+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x555c476047f0 2024-05-08T18:51:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.120+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206c05e040 con 0x555c476047f0 2024-05-08T18:51:50.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.120+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x7f206c037020 2024-05-08T18:51:50.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.121+0000 7f2073a84640 1 -- 172.21.15.132:0/439958854 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2064024460 con 0x7f206c037020 2024-05-08T18:51:50.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.121+0000 7f2073a84640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x555c475ffe40 2024-05-08T18:51:50.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.121+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c07d040 con 0x555c475ffe40 2024-05-08T18:51:50.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.121+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x7f206c037020 2024-05-08T18:51:50.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.121+0000 7f2073a84640 1 -- 172.21.15.132:0/439958854 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2064024460 con 0x7f206c037020 2024-05-08T18:51:50.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.121+0000 7f2073a84640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x555c476047f0 2024-05-08T18:51:50.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.121+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206c05e040 con 0x555c476047f0 2024-05-08T18:51:50.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.122+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x7f2064017050 2024-05-08T18:51:50.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.122+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c07d040 con 0x7f2064017050 2024-05-08T18:51:50.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.122+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x7f206c037020 2024-05-08T18:51:50.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.122+0000 7f2073a84640 1 -- 172.21.15.132:0/439958854 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2064024460 con 0x7f206c037020 2024-05-08T18:51:50.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.122+0000 7f2073a84640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x555c476047f0 2024-05-08T18:51:50.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.122+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f206c05e040 con 0x555c476047f0 2024-05-08T18:51:50.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.122+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x7f2064017050 2024-05-08T18:51:50.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.123+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f205c07d040 con 0x7f2064017050 2024-05-08T18:51:50.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.123+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x555c475ffe40 2024-05-08T18:51:50.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.123+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f205c07d040 con 0x555c475ffe40 2024-05-08T18:51:50.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.123+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555c47608af0 con 0x7f206c037020 2024-05-08T18:51:50.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.123+0000 7f2073a84640 1 -- 172.21.15.132:0/439958854 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2064024460 con 0x7f206c037020 2024-05-08T18:51:50.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.123+0000 7f2077d2e800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:50.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.123+0000 7f2077d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:50.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.123+0000 7f2077d2e800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:50.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.123+0000 7f2077d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:50.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.123+0000 7f2077d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:50.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.123+0000 7f2077d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:50.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.123+0000 7f2077d2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.123+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555c47607b60 con 0x555c475ffe40 2024-05-08T18:51:50.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.124+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x555c475ffe40 2024-05-08T18:51:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.124+0000 7f2077d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.124+0000 7f2077d2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.124+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555c476077a0 con 0x555c475ffe40 2024-05-08T18:51:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.124+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f205c07d040 con 0x555c475ffe40 2024-05-08T18:51:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.124+0000 7f2077d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.124+0000 7f2077d2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.124+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555c47608500 con 0x555c475ffe40 2024-05-08T18:51:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.124+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f205c07d040 con 0x555c475ffe40 2024-05-08T18:51:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.124+0000 7f2077d2e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.124+0000 7f2077d2e800 20 zone default found 2024-05-08T18:51:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.124+0000 7f2077d2e800 4 Realm: () 2024-05-08T18:51:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.124+0000 7f2077d2e800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.124+0000 7f2077d2e800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:50.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.124+0000 7f2077d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.124+0000 7f2077d2e800 20 zonegroup default 2024-05-08T18:51:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.124+0000 7f2077d2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.124+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555c47609420 con 0x7f206c037020 2024-05-08T18:51:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.124+0000 7f2073a84640 1 -- 172.21.15.132:0/439958854 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2064024460 con 0x7f206c037020 2024-05-08T18:51:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.124+0000 7f2077d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.125+0000 7f2077d2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.125+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555c4760b650 con 0x555c476047f0 2024-05-08T18:51:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.125+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f206c05e040 con 0x555c476047f0 2024-05-08T18:51:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.125+0000 7f2077d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.125+0000 7f2077d2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.125+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555c4760b9f0 con 0x555c476047f0 2024-05-08T18:51:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.125+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f206c05e040 con 0x555c476047f0 2024-05-08T18:51:50.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.125+0000 7f2077d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.125+0000 7f2077d2e800 20 started sync module instance, tier type = 2024-05-08T18:51:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.125+0000 7f2077d2e800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.125+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c4760aa90 con 0x7f206c037020 2024-05-08T18:51:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.126+0000 7f2073a84640 1 -- 172.21.15.132:0/439958854 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2064024460 con 0x7f206c037020 2024-05-08T18:51:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.126+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93854822870704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c4760a6f0 con 0x7f206c037020 2024-05-08T18:51:50.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.126+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c4760c3b0 con 0x555c475ffe40 2024-05-08T18:51:50.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.127+0000 7f2073a84640 1 -- 172.21.15.132:0/439958854 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93854822870704] v27'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2064024460 con 0x7f206c037020 2024-05-08T18:51:50.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.128+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x555c475ffe40 2024-05-08T18:51:50.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.128+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93854822873584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c4760c7a0 con 0x555c475ffe40 2024-05-08T18:51:50.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.128+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c4760d1e0 con 0x555c476047f0 2024-05-08T18:51:50.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.129+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93854822873584] v27'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x555c475ffe40 2024-05-08T18:51:50.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.129+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f206c05e040 con 0x555c476047f0 2024-05-08T18:51:50.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.129+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93854822878384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c4760d1a0 con 0x555c476047f0 2024-05-08T18:51:50.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.129+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c4760da80 con 0x7f206c037020 2024-05-08T18:51:50.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.130+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93854822878384] v27'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f206c05e040 con 0x555c476047f0 2024-05-08T18:51:50.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.130+0000 7f2073a84640 1 -- 172.21.15.132:0/439958854 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2064024460 con 0x7f206c037020 2024-05-08T18:51:50.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.130+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93854822874640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c4760e2d0 con 0x7f206c037020 2024-05-08T18:51:50.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.130+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c4760eb20 con 0x555c475ffe40 2024-05-08T18:51:50.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.132+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x555c475ffe40 2024-05-08T18:51:50.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.132+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93854822885456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c4760f340 con 0x555c475ffe40 2024-05-08T18:51:50.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.132+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c4760fe60 con 0x7f2064017050 2024-05-08T18:51:50.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.132+0000 7f2073a84640 1 -- 172.21.15.132:0/439958854 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93854822874640] v27'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2064024460 con 0x7f206c037020 2024-05-08T18:51:50.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.133+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x7f2064017050 2024-05-08T18:51:50.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.133+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93854822885456] v27'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x555c475ffe40 2024-05-08T18:51:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.133+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93854822889776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c4760fe20 con 0x7f2064017050 2024-05-08T18:51:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.133+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c4760edd0 con 0x7f2064017050 2024-05-08T18:51:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.134+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93854822889776] v27'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x7f2064017050 2024-05-08T18:51:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.134+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x7f2064017050 2024-05-08T18:51:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.134+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93854822882848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c476103c0 con 0x7f2064017050 2024-05-08T18:51:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.134+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c47610d80 con 0x7f2064017050 2024-05-08T18:51:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.135+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93854822882848] v27'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x7f2064017050 2024-05-08T18:51:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.135+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x7f2064017050 2024-05-08T18:51:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.135+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93854822886800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c47610d80 con 0x7f2064017050 2024-05-08T18:51:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.135+0000 7f2077d2e800 20 add_watcher() i=0 2024-05-08T18:51:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.135+0000 7f2077d2e800 20 add_watcher() i=1 2024-05-08T18:51:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.135+0000 7f2077d2e800 20 add_watcher() i=2 2024-05-08T18:51:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.135+0000 7f2077d2e800 20 add_watcher() i=3 2024-05-08T18:51:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.135+0000 7f2077d2e800 20 add_watcher() i=4 2024-05-08T18:51:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.135+0000 7f2077d2e800 20 add_watcher() i=5 2024-05-08T18:51:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.135+0000 7f2077d2e800 20 add_watcher() i=6 2024-05-08T18:51:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.136+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93854822886800] v27'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x7f2064017050 2024-05-08T18:51:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.136+0000 7f2077d2e800 20 add_watcher() i=7 2024-05-08T18:51:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.136+0000 7f2077d2e800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.136+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555c476140b0 con 0x555c475ffe40 2024-05-08T18:51:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.137+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f205c07d040 con 0x555c475ffe40 2024-05-08T18:51:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.137+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93854822894144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c47611310 con 0x555c475ffe40 2024-05-08T18:51:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.138+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93854822894144] v27'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x555c475ffe40 2024-05-08T18:51:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.138+0000 7f1f29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.138+0000 7f2077d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.138+0000 7f2077d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.138+0000 7f2077d2e800 5 note: GC not initialized 2024-05-08T18:51:50.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.138+0000 7f1f28fe1640 20 reqs_thread_entry: start 2024-05-08T18:51:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.138+0000 7f2077d2e800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.138+0000 7f2077d2e800 20 Filter name: none 2024-05-08T18:51:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.138+0000 7f1ea27fc640 20 reqs_thread_entry: start 2024-05-08T18:51:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.139+0000 7f2077d2e800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:51:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.139+0000 7f2077d2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.139+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555c47647680 con 0x7f2064017050 2024-05-08T18:51:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.139+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x7f2064017050 2024-05-08T18:51:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.139+0000 7f2077d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.139+0000 7f2077d2e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-08T18:51:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.139+0000 7f2077d2e800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:51:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.139+0000 7f2077d2e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-08T18:51:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.139+0000 7f2077d2e800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.139+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555c47645e20 con 0x7f2064017050 2024-05-08T18:51:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.139+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x7f2064017050 2024-05-08T18:51:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.139+0000 7f2077d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.139+0000 7f2077d2e800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-08T18:51:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.139+0000 7f2077d2e800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:51:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.139+0000 7f2077d2e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T18:51:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.139+0000 7f2077d2e800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T18:51:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.140+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c476466e0 con 0x7f2064017050 2024-05-08T18:51:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.141+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v27'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x7f2064017050 2024-05-08T18:51:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.141+0000 7f2077d2e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-08T18:51:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.141+0000 7f2077d2e800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:51:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.141+0000 7f2077d2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-08T18:51:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.141+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 93854823113264 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555c4764afc0 con 0x7f2064017050 2024-05-08T18:51:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.141+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== watch-notify(notify (1) cookie 93854822889776 notify 115964117014 ret 0) ==== 598+0+0 (crc 0 0 0) 0x555c47646a80 con 0x7f2064017050 2024-05-08T18:51:50.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.141+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(65 notify.5 [notify cookie 93854823113264 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f205c07d040 con 0x7f2064017050 2024-05-08T18:51:50.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.141+0000 7f1f527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117014 cookie 93854822889776 notifier 4732 bl.length()=556 2024-05-08T18:51:50.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.141+0000 7f1f527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-08T18:51:50.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.141+0000 7f1f527fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:51:50.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.141+0000 7f1f527fc640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f1ea8003430 con 0x7f2064017050 2024-05-08T18:51:50.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.141+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x7f2064017050 2024-05-08T18:51:50.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.141+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== watch-notify(notify_complete (2) cookie 93854823113264 notify 115964117014 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555c476470d0 con 0x7f2064017050 2024-05-08T18:51:50.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.141+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c476461e0 con 0x7f2064017050 2024-05-08T18:51:50.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.143+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v27'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x7f2064017050 2024-05-08T18:51:50.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.143+0000 7f2077d2e800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:51:50.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.143+0000 7f2077d2e800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:51:50.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.143+0000 7f2077d2e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:51:50.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.143+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93854823113184 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555c4764afc0 con 0x555c476047f0 2024-05-08T18:51:50.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.143+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== watch-notify(notify (1) cookie 93854822878384 notify 115964116998 ret 0) ==== 219+0+0 (crc 0 0 0) 0x555c475f7690 con 0x555c476047f0 2024-05-08T18:51:50.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.143+0000 7f1f527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116998 cookie 93854822878384 notifier 4732 bl.length()=177 2024-05-08T18:51:50.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.143+0000 7f1f527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:51:50.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.143+0000 7f1f527fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:51:50.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.143+0000 7f1f527fc640 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f1ea80033f0 con 0x555c476047f0 2024-05-08T18:51:50.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.143+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(68 notify.2 [notify cookie 93854823113184 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f206c05e040 con 0x555c476047f0 2024-05-08T18:51:50.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.143+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== watch-notify(notify_complete (2) cookie 93854823113184 notify 115964116998 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555c475f49e0 con 0x555c476047f0 2024-05-08T18:51:50.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.143+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f206c05e040 con 0x555c476047f0 2024-05-08T18:51:50.154 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-08T18:51:50.141067Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:51:50.141054Z","tags":[],"group_ids":[]} 2024-05-08T18:51:50.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.144+0000 7f1f29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:50.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.144+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93854822894144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c476136c0 con 0x555c475ffe40 2024-05-08T18:51:50.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.145+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93854822894144] v27'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x555c475ffe40 2024-05-08T18:51:50.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.145+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93854822870704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c47610a40 con 0x7f206c037020 2024-05-08T18:51:50.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.146+0000 7f2073a84640 1 -- 172.21.15.132:0/439958854 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93854822870704] v27'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2064024460 con 0x7f206c037020 2024-05-08T18:51:50.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.146+0000 7f2077d2e800 20 remove_watcher() i=0 2024-05-08T18:51:50.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.146+0000 7f2077d2e800 2 removed watcher, disabling cache 2024-05-08T18:51:50.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.146+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93854822873584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c47610a40 con 0x555c475ffe40 2024-05-08T18:51:50.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.147+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93854822873584] v27'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x555c475ffe40 2024-05-08T18:51:50.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.147+0000 7f2077d2e800 20 remove_watcher() i=1 2024-05-08T18:51:50.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.147+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93854822878384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c47610a40 con 0x555c476047f0 2024-05-08T18:51:50.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.149+0000 7f2074285640 1 -- 172.21.15.132:0/439958854 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93854822878384] v27'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f206c05e040 con 0x555c476047f0 2024-05-08T18:51:50.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.149+0000 7f2077d2e800 20 remove_watcher() i=2 2024-05-08T18:51:50.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.149+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93854822874640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c4760ccb0 con 0x7f206c037020 2024-05-08T18:51:50.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.150+0000 7f2073a84640 1 -- 172.21.15.132:0/439958854 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93854822874640] v27'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2064024460 con 0x7f206c037020 2024-05-08T18:51:50.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.150+0000 7f2077d2e800 20 remove_watcher() i=3 2024-05-08T18:51:50.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.150+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93854822885456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c4760ccb0 con 0x555c475ffe40 2024-05-08T18:51:50.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.151+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93854822885456] v27'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x555c475ffe40 2024-05-08T18:51:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.151+0000 7f2077d2e800 20 remove_watcher() i=4 2024-05-08T18:51:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.151+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93854822889776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c4760e850 con 0x7f2064017050 2024-05-08T18:51:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.152+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93854822889776] v27'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x7f2064017050 2024-05-08T18:51:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.152+0000 7f2077d2e800 20 remove_watcher() i=5 2024-05-08T18:51:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.152+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93854822882848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c4760ccb0 con 0x7f2064017050 2024-05-08T18:51:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.153+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93854822882848] v27'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x7f2064017050 2024-05-08T18:51:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.153+0000 7f2077d2e800 20 remove_watcher() i=6 2024-05-08T18:51:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.153+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93854822886800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555c4760f930 con 0x7f2064017050 2024-05-08T18:51:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.154+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93854822886800] v27'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f205c07d040 con 0x7f2064017050 2024-05-08T18:51:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.154+0000 7f2077d2e800 20 remove_watcher() i=7 2024-05-08T18:51:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.154+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2064017050 msgr2=0x7f20640167f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.154+0000 7f2077d2e800 1 --2- 172.21.15.132:0/439958854 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2064017050 0x7f20640167f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.154+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555c475ffe40 msgr2=0x555c47602300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.154+0000 7f2077d2e800 1 --2- 172.21.15.132:0/439958854 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555c475ffe40 0x555c47602300 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.154+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f206c037020 msgr2=0x7f206c0514d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.154+0000 7f2077d2e800 1 --2- 172.21.15.132:0/439958854 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f206c037020 0x7f206c0514d0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.154+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555c476047f0 msgr2=0x555c47606be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.154+0000 7f2077d2e800 1 --2- 172.21.15.132:0/439958854 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555c476047f0 0x555c47606be0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.154+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f3c03bb50 msgr2=0x7f1f3c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.154+0000 7f2077d2e800 1 --2- 172.21.15.132:0/439958854 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f3c03bb50 0x7f1f3c03e010 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f206402dfb0 tx=0x7f2064049000 comp rx=0 tx=0).stop 2024-05-08T18:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.154+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c475ecbd0 msgr2=0x555c475f4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.154+0000 7f2077d2e800 1 --2- 172.21.15.132:0/439958854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c475ecbd0 0x555c475f4210 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f206c0114a0 tx=0x7f206c052d20 comp rx=0 tx=0).stop 2024-05-08T18:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.154+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 reap_dead start 2024-05-08T18:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.154+0000 7f206bfff640 1 -- 172.21.15.132:0/439958854 reap_dead start 2024-05-08T18:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.154+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 shutdown_connections 2024-05-08T18:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.154+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 >> 172.21.15.132:0/439958854 conn(0x555c475e8f30 msgr2=0x555c475e6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 shutdown_connections 2024-05-08T18:51:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 -- 172.21.15.132:0/439958854 wait complete. 2024-05-08T18:51:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 -- 172.21.15.132:0/3193505472 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f4c03bba0 msgr2=0x7f1f4c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 --2- 172.21.15.132:0/3193505472 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f4c03bba0 0x7f1f4c03e060 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x555c475cc080 tx=0x7f206401ae40 comp rx=0 tx=0).stop 2024-05-08T18:51:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 -- 172.21.15.132:0/3193505472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c475df950 msgr2=0x555c475dfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 --2- 172.21.15.132:0/3193505472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c475df950 0x555c475dfd70 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x555c475cbf90 tx=0x7f206c018830 comp rx=0 tx=0).stop 2024-05-08T18:51:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 -- 172.21.15.132:0/3193505472 shutdown_connections 2024-05-08T18:51:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 --2- 172.21.15.132:0/3193505472 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f4c03bba0 0x7f1f4c03e060 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 --2- 172.21.15.132:0/3193505472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c475df950 0x555c475dfd70 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 -- 172.21.15.132:0/3193505472 >> 172.21.15.132:0/3193505472 conn(0x555c475d39f0 msgr2=0x555c475d3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 -- 172.21.15.132:0/3193505472 shutdown_connections 2024-05-08T18:51:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 -- 172.21.15.132:0/3193505472 wait complete. 2024-05-08T18:51:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 -- 172.21.15.132:0/4088083928 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555c474cd820 msgr2=0x555c475cb6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 --2- 172.21.15.132:0/4088083928 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555c474cd820 0x555c475cb6b0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 -- 172.21.15.132:0/4088083928 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555c475cdf30 msgr2=0x555c475d0320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 --2- 172.21.15.132:0/4088083928 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555c475cdf30 0x555c475d0320 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 -- 172.21.15.132:0/4088083928 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f5c03bba0 msgr2=0x7f1f5c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 --2- 172.21.15.132:0/4088083928 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f5c03bba0 0x7f1f5c03e060 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f205c054000 tx=0x7f205c04e000 comp rx=0 tx=0).stop 2024-05-08T18:51:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 -- 172.21.15.132:0/4088083928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c474c9d10 msgr2=0x555c475c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 --2- 172.21.15.132:0/4088083928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c474c9d10 0x555c475c44c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2064001de0 tx=0x7f2064000ed0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 -- 172.21.15.132:0/4088083928 shutdown_connections 2024-05-08T18:51:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 --2- 172.21.15.132:0/4088083928 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x555c475cdf30 0x555c475d0320 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 --2- 172.21.15.132:0/4088083928 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x555c474cd820 0x555c475cb6b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 --2- 172.21.15.132:0/4088083928 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1f5c03bba0 0x7f1f5c03e060 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 --2- 172.21.15.132:0/4088083928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x555c474c9d10 0x555c475c44c0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 -- 172.21.15.132:0/4088083928 >> 172.21.15.132:0/4088083928 conn(0x555c474c36e0 msgr2=0x555c474c84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.155+0000 7f2077d2e800 1 -- 172.21.15.132:0/4088083928 shutdown_connections 2024-05-08T18:51:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.156+0000 7f2077d2e800 1 -- 172.21.15.132:0/4088083928 wait complete. 2024-05-08T18:51:50.166 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-08T18:51:50.141067Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:51:50.141054Z', 'tags': [], 'group_ids': []} 2024-05-08T18:51:50.178 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:51:50.182 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-05-08T18:51:50.182 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-05-08T18:51:50.183 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-05-08T18:51:50.183 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-05-08T18:51:50.229 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:50.229 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:50.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.230+0000 7fb110062800 1 Processor -- start 2024-05-08T18:51:50.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.230+0000 7fb110062800 1 -- start start 2024-05-08T18:51:50.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.230+0000 7fb110062800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55670f5fc5e0 0x55670f5fe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.230+0000 7fb110062800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55670f5fefa0 con 0x55670f5f8150 2024-05-08T18:51:50.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.230+0000 7fb110062800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55670f499e20 con 0x55670f5fc5e0 2024-05-08T18:51:50.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.231+0000 7fb10d359640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55670f5fc5e0 0x55670f5fe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.231+0000 7fb10db5a640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55670f5f8150 0x55670f5f8570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:49096/0 (socket says 172.21.15.132:49096) 2024-05-08T18:51:50.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.231+0000 7fb10db5a640 1 -- 172.21.15.132:0/2000295560 learned_addr learned my addr 172.21.15.132:0/2000295560 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:51:50.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.231+0000 7fb10d359640 1 -- 172.21.15.132:0/2000295560 >> v1:172.21.15.42:6789/0 conn(0x55670f5f8150 legacy=0x55670f5f8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.231+0000 7fb10d359640 1 -- 172.21.15.132:0/2000295560 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55670f6001d0 con 0x55670f5fc5e0 2024-05-08T18:51:50.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.233+0000 7fb10d359640 1 --2- 172.21.15.132:0/2000295560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f5fc5e0 0x55670f5fe9d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb10400a470 tx=0x7fb10401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f828e894ab178f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.233+0000 7fb10cb58640 1 -- 172.21.15.132:0/2000295560 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb104057070 con 0x55670f5fc5e0 2024-05-08T18:51:50.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.233+0000 7fb10cb58640 1 -- 172.21.15.132:0/2000295560 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb104052570 con 0x55670f5fc5e0 2024-05-08T18:51:50.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.233+0000 7fb10cb58640 1 -- 172.21.15.132:0/2000295560 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb104052870 con 0x55670f5fc5e0 2024-05-08T18:51:50.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.233+0000 7fb110062800 1 -- 172.21.15.132:0/2000295560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f5fc5e0 msgr2=0x55670f5fe9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.233+0000 7fb110062800 1 --2- 172.21.15.132:0/2000295560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f5fc5e0 0x55670f5fe9d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb10400a470 tx=0x7fb10401ce90 comp rx=0 tx=0).stop 2024-05-08T18:51:50.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.233+0000 7fb110062800 1 -- 172.21.15.132:0/2000295560 shutdown_connections 2024-05-08T18:51:50.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.233+0000 7fb110062800 1 --2- 172.21.15.132:0/2000295560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f5fc5e0 0x55670f5fe9d0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.233+0000 7fb110062800 1 -- 172.21.15.132:0/2000295560 >> 172.21.15.132:0/2000295560 conn(0x55670f5f3730 msgr2=0x55670f5f5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.233+0000 7fb110062800 1 -- 172.21.15.132:0/2000295560 shutdown_connections 2024-05-08T18:51:50.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.234+0000 7fb110062800 1 -- 172.21.15.132:0/2000295560 wait complete. 2024-05-08T18:51:50.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.247+0000 7fb110062800 1 Processor -- start 2024-05-08T18:51:50.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.247+0000 7fb110062800 1 -- start start 2024-05-08T18:51:50.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.247+0000 7fb110062800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f5f8150 0x55670f6ec860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.247+0000 7fb110062800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55670f5445c0 con 0x55670f5f8150 2024-05-08T18:51:50.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.248+0000 7fb10db5a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f5f8150 0x55670f6ec860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.248+0000 7fb10db5a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f5f8150 0x55670f6ec860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56728/0 (socket says 172.21.15.132:56728) 2024-05-08T18:51:50.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.248+0000 7fb10db5a640 1 -- 172.21.15.132:0/1118022741 learned_addr learned my addr 172.21.15.132:0/1118022741 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:50.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.248+0000 7fb10db5a640 1 -- 172.21.15.132:0/1118022741 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55670f6ece30 con 0x55670f5f8150 2024-05-08T18:51:50.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.248+0000 7fb10db5a640 1 --2- 172.21.15.132:0/1118022741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f5f8150 0x55670f6ec860 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb1000017a0 tx=0x7fb100001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518b71276d374629 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.248+0000 7faffbe07640 1 -- 172.21.15.132:0/1118022741 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb100016070 con 0x55670f5f8150 2024-05-08T18:51:50.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.248+0000 7faffbe07640 1 -- 172.21.15.132:0/1118022741 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb100004520 con 0x55670f5f8150 2024-05-08T18:51:50.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.248+0000 7faffbe07640 1 -- 172.21.15.132:0/1118022741 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb100004820 con 0x55670f5f8150 2024-05-08T18:51:50.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.249+0000 7fb110062800 1 -- 172.21.15.132:0/1118022741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f5f8150 msgr2=0x55670f6ec860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.249+0000 7fb110062800 1 --2- 172.21.15.132:0/1118022741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f5f8150 0x55670f6ec860 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb1000017a0 tx=0x7fb100001c60 comp rx=0 tx=0).stop 2024-05-08T18:51:50.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.249+0000 7fb110062800 1 -- 172.21.15.132:0/1118022741 shutdown_connections 2024-05-08T18:51:50.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.249+0000 7fb110062800 1 --2- 172.21.15.132:0/1118022741 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f5f8150 0x55670f6ec860 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.249+0000 7fb110062800 1 -- 172.21.15.132:0/1118022741 >> 172.21.15.132:0/1118022741 conn(0x55670f5f3730 msgr2=0x55670f6e3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.249+0000 7fb110062800 1 -- 172.21.15.132:0/1118022741 shutdown_connections 2024-05-08T18:51:50.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.249+0000 7fb110062800 1 -- 172.21.15.132:0/1118022741 wait complete. 2024-05-08T18:51:50.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.249+0000 7fb110062800 1 Processor -- start 2024-05-08T18:51:50.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.250+0000 7fb110062800 1 -- start start 2024-05-08T18:51:50.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.250+0000 7fb110062800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f5f8150 0x55670f6f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.250+0000 7fb110062800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55670f5ff470 con 0x55670f5f8150 2024-05-08T18:51:50.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.250+0000 7fb10db5a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f5f8150 0x55670f6f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.250+0000 7fb10db5a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f5f8150 0x55670f6f43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56734/0 (socket says 172.21.15.132:56734) 2024-05-08T18:51:50.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.250+0000 7fb10db5a640 1 -- 172.21.15.132:0/360483526 learned_addr learned my addr 172.21.15.132:0/360483526 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:50.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.250+0000 7fb10db5a640 1 -- 172.21.15.132:0/360483526 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55670f6f48e0 con 0x55670f5f8150 2024-05-08T18:51:50.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.250+0000 7fb10db5a640 1 --2- 172.21.15.132:0/360483526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f5f8150 0x55670f6f43a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb100014040 tx=0x7fb100001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.251+0000 7faffa604640 1 -- 172.21.15.132:0/360483526 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb100020070 con 0x55670f5f8150 2024-05-08T18:51:50.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.251+0000 7faffa604640 1 -- 172.21.15.132:0/360483526 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb100011550 con 0x55670f5f8150 2024-05-08T18:51:50.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.251+0000 7fb110062800 1 -- 172.21.15.132:0/360483526 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55670f6f4b70 con 0x55670f5f8150 2024-05-08T18:51:50.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.251+0000 7faffa604640 1 -- 172.21.15.132:0/360483526 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb100016040 con 0x55670f5f8150 2024-05-08T18:51:50.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.251+0000 7fb110062800 1 -- 172.21.15.132:0/360483526 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55670f6f7820 con 0x55670f5f8150 2024-05-08T18:51:50.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.252+0000 7faffa604640 1 -- 172.21.15.132:0/360483526 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb100023070 con 0x55670f5f8150 2024-05-08T18:51:50.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.252+0000 7faffa604640 1 --2- 172.21.15.132:0/360483526 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7faff403bb50 0x7faff403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.252+0000 7faffa604640 1 -- 172.21.15.132:0/360483526 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fb100051e80 con 0x55670f5f8150 2024-05-08T18:51:50.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.252+0000 7fb10d359640 1 --2- 172.21.15.132:0/360483526 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7faff403bb50 0x7faff403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.252+0000 7fb110062800 1 --2- 172.21.15.132:0/360483526 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55670f5fc5e0 0x55670f6fb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.252+0000 7fb110062800 1 -- 172.21.15.132:0/360483526 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55670f6fbbb0 con 0x55670f5fc5e0 2024-05-08T18:51:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.252+0000 7fb10e35b640 1 --2- 172.21.15.132:0/360483526 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55670f5fc5e0 0x55670f6fb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.252+0000 7fb10d359640 1 --2- 172.21.15.132:0/360483526 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7faff403bb50 0x7faff403e010 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb104054000 tx=0x7fb10404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.252+0000 7fb10e35b640 1 --2- 172.21.15.132:0/360483526 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55670f5fc5e0 0x55670f6fb5e0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.253+0000 7fb10e35b640 1 -- 172.21.15.132:0/360483526 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1080083e0 con 0x55670f5fc5e0 2024-05-08T18:51:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.253+0000 7fb110062800 1 -- 172.21.15.132:0/360483526 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55670f6f8b90 con 0x55670f5fc5e0 2024-05-08T18:51:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.253+0000 7fb10e35b640 1 -- 172.21.15.132:0/360483526 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb1080083e0 con 0x55670f5fc5e0 2024-05-08T18:51:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.253+0000 7fb110062800 1 --2- 172.21.15.132:0/360483526 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55670f6fdf10 0x55670f700300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.253+0000 7fb110062800 1 -- 172.21.15.132:0/360483526 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55670f7009f0 con 0x55670f6fdf10 2024-05-08T18:51:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.253+0000 7fb10db5a640 1 --2- 172.21.15.132:0/360483526 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55670f6fdf10 0x55670f700300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.253+0000 7fb10db5a640 1 --2- 172.21.15.132:0/360483526 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55670f6fdf10 0x55670f700300 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.254+0000 7fb10db5a640 1 -- 172.21.15.132:0/360483526 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb10002c070 con 0x55670f6fdf10 2024-05-08T18:51:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.254+0000 7fb110062800 1 -- 172.21.15.132:0/360483526 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55670f6fcdb0 con 0x55670f5fc5e0 2024-05-08T18:51:50.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.254+0000 7fb10e35b640 1 -- 172.21.15.132:0/360483526 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb1080083e0 con 0x55670f5fc5e0 2024-05-08T18:51:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.254+0000 7fb110062800 1 -- 172.21.15.132:0/360483526 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55670f6fd250 con 0x55670f5fc5e0 2024-05-08T18:51:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.254+0000 7fb10e35b640 1 -- 172.21.15.132:0/360483526 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb1080083e0 con 0x55670f5fc5e0 2024-05-08T18:51:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.254+0000 7fb110062800 1 Processor -- start 2024-05-08T18:51:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.254+0000 7fb110062800 1 -- start start 2024-05-08T18:51:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.255+0000 7fb110062800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f70f980 0x55670f70fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.255+0000 7fb110062800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55670f4eafc0 con 0x55670f70f980 2024-05-08T18:51:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.255+0000 7fb10e35b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f70f980 0x55670f70fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.255+0000 7fb10e35b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f70f980 0x55670f70fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56750/0 (socket says 172.21.15.132:56750) 2024-05-08T18:51:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.255+0000 7fb10e35b640 1 -- 172.21.15.132:0/2166346590 learned_addr learned my addr 172.21.15.132:0/2166346590 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.255+0000 7fb10e35b640 1 -- 172.21.15.132:0/2166346590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55670f7102e0 con 0x55670f70f980 2024-05-08T18:51:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.255+0000 7fb10e35b640 1 --2- 172.21.15.132:0/2166346590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f70f980 0x55670f70fda0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x55670f6f5270 tx=0x7fb10800aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.256+0000 7faff37fe640 1 -- 172.21.15.132:0/2166346590 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb108007d00 con 0x55670f70f980 2024-05-08T18:51:50.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.256+0000 7fb110062800 1 -- 172.21.15.132:0/2166346590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55670f710d50 con 0x55670f70f980 2024-05-08T18:51:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.256+0000 7faff37fe640 1 -- 172.21.15.132:0/2166346590 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb10801e020 con 0x55670f70f980 2024-05-08T18:51:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.256+0000 7fb110062800 1 -- 172.21.15.132:0/2166346590 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55670f711250 con 0x55670f70f980 2024-05-08T18:51:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.256+0000 7faff37fe640 1 -- 172.21.15.132:0/2166346590 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb108019420 con 0x55670f70f980 2024-05-08T18:51:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.257+0000 7faff37fe640 1 -- 172.21.15.132:0/2166346590 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb108016040 con 0x55670f70f980 2024-05-08T18:51:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.257+0000 7faff37fe640 1 --2- 172.21.15.132:0/2166346590 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fafe803bb50 0x7fafe803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.257+0000 7faff37fe640 1 -- 172.21.15.132:0/2166346590 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fb10801f030 con 0x55670f70f980 2024-05-08T18:51:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.257+0000 7fb10db5a640 1 --2- 172.21.15.132:0/2166346590 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fafe803bb50 0x7fafe803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.257+0000 7fb110062800 1 Processor -- start 2024-05-08T18:51:50.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.257+0000 7fb10db5a640 1 --2- 172.21.15.132:0/2166346590 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fafe803bb50 0x7fafe803e010 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55670f6fc080 tx=0x7fb100024ca0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.257+0000 7fb110062800 1 -- start start 2024-05-08T18:51:50.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.257+0000 7fb110062800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f71cc30 0x55670f71d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.257+0000 7fb110062800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55670f6ed1b0 con 0x55670f71cc30 2024-05-08T18:51:50.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.258+0000 7fb10e35b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f71cc30 0x55670f71d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.258+0000 7fb10e35b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f71cc30 0x55670f71d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56752/0 (socket says 172.21.15.132:56752) 2024-05-08T18:51:50.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.258+0000 7fb10e35b640 1 -- 172.21.15.132:0/3659099200 learned_addr learned my addr 172.21.15.132:0/3659099200 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:50.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.258+0000 7fb10e35b640 1 -- 172.21.15.132:0/3659099200 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55670f71d620 con 0x55670f71cc30 2024-05-08T18:51:50.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.258+0000 7fb10e35b640 1 --2- 172.21.15.132:0/3659099200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f71cc30 0x55670f71d050 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb108014970 tx=0x7fb108014650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25489d14ef8cf2c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.258+0000 7faff17fa640 1 -- 172.21.15.132:0/3659099200 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb10801d070 con 0x55670f71cc30 2024-05-08T18:51:50.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.258+0000 7faff17fa640 1 -- 172.21.15.132:0/3659099200 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1080223c0 con 0x55670f71cc30 2024-05-08T18:51:50.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.258+0000 7faff17fa640 1 -- 172.21.15.132:0/3659099200 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1080173b0 con 0x55670f71cc30 2024-05-08T18:51:50.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.259+0000 7fb110062800 1 -- 172.21.15.132:0/3659099200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f71cc30 msgr2=0x55670f71d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.259+0000 7fb110062800 1 --2- 172.21.15.132:0/3659099200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f71cc30 0x55670f71d050 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb108014970 tx=0x7fb108014650 comp rx=0 tx=0).stop 2024-05-08T18:51:50.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.259+0000 7fb110062800 1 -- 172.21.15.132:0/3659099200 shutdown_connections 2024-05-08T18:51:50.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.259+0000 7fb110062800 1 --2- 172.21.15.132:0/3659099200 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f71cc30 0x55670f71d050 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.259+0000 7fb110062800 1 -- 172.21.15.132:0/3659099200 >> 172.21.15.132:0/3659099200 conn(0x55670f718fe0 msgr2=0x55670f717040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.259+0000 7fb110062800 1 -- 172.21.15.132:0/3659099200 shutdown_connections 2024-05-08T18:51:50.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.259+0000 7fb110062800 1 -- 172.21.15.132:0/3659099200 wait complete. 2024-05-08T18:51:50.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.259+0000 7fb110062800 1 Processor -- start 2024-05-08T18:51:50.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.259+0000 7fb110062800 1 -- start start 2024-05-08T18:51:50.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.259+0000 7fb110062800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f71cc30 0x55670f724180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.259+0000 7fb110062800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55670f71dd30 con 0x55670f71cc30 2024-05-08T18:51:50.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.259+0000 7fb10e35b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f71cc30 0x55670f724180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.259+0000 7fb10e35b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f71cc30 0x55670f724180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56758/0 (socket says 172.21.15.132:56758) 2024-05-08T18:51:50.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.259+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 learned_addr learned my addr 172.21.15.132:0/1439567968 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:50.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.260+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55670f7246c0 con 0x55670f71cc30 2024-05-08T18:51:50.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.260+0000 7fb10e35b640 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f71cc30 0x55670f724180 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb108014690 tx=0x7fb108052b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.260+0000 7fafdf7fe640 1 -- 172.21.15.132:0/1439567968 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1080155f0 con 0x55670f71cc30 2024-05-08T18:51:50.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.260+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55670f724950 con 0x55670f71cc30 2024-05-08T18:51:50.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.260+0000 7fafdf7fe640 1 -- 172.21.15.132:0/1439567968 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb108031020 con 0x55670f71cc30 2024-05-08T18:51:50.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.260+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55670f727600 con 0x55670f71cc30 2024-05-08T18:51:50.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.260+0000 7fafdf7fe640 1 -- 172.21.15.132:0/1439567968 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb108015790 con 0x55670f71cc30 2024-05-08T18:51:50.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.261+0000 7fafdf7fe640 1 -- 172.21.15.132:0/1439567968 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb1080540d0 con 0x55670f71cc30 2024-05-08T18:51:50.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.261+0000 7fafdf7fe640 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fafd803bb50 0x7fafd803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.261+0000 7fafdf7fe640 1 -- 172.21.15.132:0/1439567968 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fb108032030 con 0x55670f71cc30 2024-05-08T18:51:50.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.261+0000 7fb10db5a640 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fafd803bb50 0x7fafd803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.262+0000 7fb110062800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.262+0000 7fb10db5a640 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fafd803bb50 0x7fafd803e010 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55670f700df0 tx=0x7fb100047000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.262+0000 7fb110062800 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55670f72fcf0 0x55670f7321b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.262+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55670f732900 con 0x55670f72fcf0 2024-05-08T18:51:50.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.262+0000 7fb10d359640 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55670f72fcf0 0x55670f7321b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.262+0000 7fb10d359640 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55670f72fcf0 0x55670f7321b0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.262+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb10405a040 con 0x55670f72fcf0 2024-05-08T18:51:50.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.262+0000 7fb110062800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.262+0000 7fb110062800 20 realm 2024-05-08T18:51:50.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.262+0000 7fb110062800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.262+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55670f732cd0 con 0x55670f72fcf0 2024-05-08T18:51:50.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.263+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb10405a040 con 0x55670f72fcf0 2024-05-08T18:51:50.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.263+0000 7fb110062800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.263+0000 7fb110062800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:50.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.263+0000 7fb110062800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.263+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55670f7335a0 con 0x55670f72fcf0 2024-05-08T18:51:50.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.263+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb10405a040 con 0x55670f72fcf0 2024-05-08T18:51:50.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.263+0000 7fb110062800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.263+0000 7fb110062800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.263+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55670f733940 con 0x55670f72fcf0 2024-05-08T18:51:50.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.263+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb10405a040 con 0x55670f72fcf0 2024-05-08T18:51:50.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.263+0000 7fb110062800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:50.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.263+0000 7fb110062800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.263+0000 7fb110062800 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55670f7346a0 0x55670f736a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.263+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55670f7370a0 con 0x55670f7346a0 2024-05-08T18:51:50.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.263+0000 7fb10e35b640 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55670f7346a0 0x55670f736a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.263+0000 7fb10e35b640 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55670f7346a0 0x55670f736a90 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.264+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb108049070 con 0x55670f7346a0 2024-05-08T18:51:50.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.264+0000 7fb110062800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:50.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.264+0000 7fb110062800 20 searching for the correct realm 2024-05-08T18:51:50.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.264+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x55670f7346a0 2024-05-08T18:51:50.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.264+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb108049070 con 0x55670f7346a0 2024-05-08T18:51:50.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.264+0000 7fb10e35b640 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb108019040 0x7fb10803f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.264+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x7fb108019040 2024-05-08T18:51:50.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.264+0000 7fb10db5a640 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb108019040 0x7fb10803f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.265+0000 7fb10db5a640 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb108019040 0x7fb10803f8d0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.265+0000 7fb10db5a640 1 -- 172.21.15.132:0/1439567968 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10002c070 con 0x7fb108019040 2024-05-08T18:51:50.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.265+0000 7fb10db5a640 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb10003c040 0x7fb100042770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.265+0000 7fb10db5a640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x7fb10003c040 2024-05-08T18:51:50.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.265+0000 7fb10d359640 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb10003c040 0x7fb100042770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.266+0000 7fb10d359640 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb10003c040 0x7fb100042770 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.266+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10405a040 con 0x7fb10003c040 2024-05-08T18:51:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.266+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x55670f72fcf0 2024-05-08T18:51:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.266+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10405a040 con 0x55670f72fcf0 2024-05-08T18:51:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.266+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x55670f72fcf0 2024-05-08T18:51:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.266+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10405a040 con 0x55670f72fcf0 2024-05-08T18:51:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.266+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x7fb10003c040 2024-05-08T18:51:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.267+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10405a040 con 0x7fb10003c040 2024-05-08T18:51:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.267+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x7fb10003c040 2024-05-08T18:51:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.267+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10405a040 con 0x7fb10003c040 2024-05-08T18:51:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.267+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x7fb108019040 2024-05-08T18:51:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.267+0000 7fb10db5a640 1 -- 172.21.15.132:0/1439567968 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10002c070 con 0x7fb108019040 2024-05-08T18:51:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.267+0000 7fb10db5a640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x55670f7346a0 2024-05-08T18:51:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.267+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb108049070 con 0x55670f7346a0 2024-05-08T18:51:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.267+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x55670f72fcf0 2024-05-08T18:51:50.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.268+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10405a040 con 0x55670f72fcf0 2024-05-08T18:51:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.268+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x7fb10003c040 2024-05-08T18:51:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.268+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10405a040 con 0x7fb10003c040 2024-05-08T18:51:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.268+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x55670f72fcf0 2024-05-08T18:51:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.268+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb10405a040 con 0x55670f72fcf0 2024-05-08T18:51:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.268+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x7fb108019040 2024-05-08T18:51:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.268+0000 7fb10db5a640 1 -- 172.21.15.132:0/1439567968 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb10002c070 con 0x7fb108019040 2024-05-08T18:51:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.268+0000 7fb10db5a640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x55670f7346a0 2024-05-08T18:51:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.269+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb108049070 con 0x55670f7346a0 2024-05-08T18:51:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.269+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x55670f7346a0 2024-05-08T18:51:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.269+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb108049070 con 0x55670f7346a0 2024-05-08T18:51:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.269+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x7fb10003c040 2024-05-08T18:51:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.269+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10405a040 con 0x7fb10003c040 2024-05-08T18:51:50.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.269+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x55670f7346a0 2024-05-08T18:51:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.269+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb108049070 con 0x55670f7346a0 2024-05-08T18:51:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.269+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x55670f7346a0 2024-05-08T18:51:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.270+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb108049070 con 0x55670f7346a0 2024-05-08T18:51:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.270+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x55670f72fcf0 2024-05-08T18:51:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.270+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10405a040 con 0x55670f72fcf0 2024-05-08T18:51:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.270+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x55670f72fcf0 2024-05-08T18:51:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.270+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb10405a040 con 0x55670f72fcf0 2024-05-08T18:51:50.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.270+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x7fb10003c040 2024-05-08T18:51:50.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.270+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10407d040 con 0x7fb10003c040 2024-05-08T18:51:50.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.270+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x55670f7346a0 2024-05-08T18:51:50.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.271+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb108069040 con 0x55670f7346a0 2024-05-08T18:51:50.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.271+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x7fb108019040 2024-05-08T18:51:50.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.271+0000 7fb10db5a640 1 -- 172.21.15.132:0/1439567968 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10002c070 con 0x7fb108019040 2024-05-08T18:51:50.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.271+0000 7fb10db5a640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x55670f72fcf0 2024-05-08T18:51:50.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.271+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10407d040 con 0x55670f72fcf0 2024-05-08T18:51:50.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.271+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x7fb108019040 2024-05-08T18:51:50.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.271+0000 7fb10db5a640 1 -- 172.21.15.132:0/1439567968 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10002c070 con 0x7fb108019040 2024-05-08T18:51:50.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.271+0000 7fb10db5a640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x55670f7346a0 2024-05-08T18:51:50.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.272+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb108069040 con 0x55670f7346a0 2024-05-08T18:51:50.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.272+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x7fb10003c040 2024-05-08T18:51:50.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.272+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10407d040 con 0x7fb10003c040 2024-05-08T18:51:50.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.272+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x7fb108019040 2024-05-08T18:51:50.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.272+0000 7fb10db5a640 1 -- 172.21.15.132:0/1439567968 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10002c070 con 0x7fb108019040 2024-05-08T18:51:50.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.272+0000 7fb10db5a640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x55670f7346a0 2024-05-08T18:51:50.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.272+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb108069040 con 0x55670f7346a0 2024-05-08T18:51:50.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.273+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x7fb10003c040 2024-05-08T18:51:50.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.273+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10407d040 con 0x7fb10003c040 2024-05-08T18:51:50.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.273+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x55670f72fcf0 2024-05-08T18:51:50.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.273+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb10407d040 con 0x55670f72fcf0 2024-05-08T18:51:50.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.273+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55670f7389b0 con 0x7fb108019040 2024-05-08T18:51:50.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.273+0000 7fb10db5a640 1 -- 172.21.15.132:0/1439567968 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10002c070 con 0x7fb108019040 2024-05-08T18:51:50.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.273+0000 7fb110062800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:50.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.273+0000 7fb110062800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:50.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.273+0000 7fb110062800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:50.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.273+0000 7fb110062800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:50.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.273+0000 7fb110062800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:50.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.273+0000 7fb110062800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:50.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.273+0000 7fb110062800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.273+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55670f738580 con 0x55670f72fcf0 2024-05-08T18:51:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.274+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb10407d040 con 0x55670f72fcf0 2024-05-08T18:51:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.274+0000 7fb110062800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.274+0000 7fb110062800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.274+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55670f737df0 con 0x55670f72fcf0 2024-05-08T18:51:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.274+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb10407d040 con 0x55670f72fcf0 2024-05-08T18:51:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.274+0000 7fb110062800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.274+0000 7fb110062800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.274+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55670f738e30 con 0x55670f72fcf0 2024-05-08T18:51:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.274+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb10407d040 con 0x55670f72fcf0 2024-05-08T18:51:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.274+0000 7fb110062800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.274+0000 7fb110062800 20 zone default found 2024-05-08T18:51:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.274+0000 7fb110062800 4 Realm: () 2024-05-08T18:51:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.274+0000 7fb110062800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.274+0000 7fb110062800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.274+0000 7fb110062800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.274+0000 7fb110062800 20 zonegroup default 2024-05-08T18:51:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.274+0000 7fb110062800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.274+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55670f739210 con 0x7fb108019040 2024-05-08T18:51:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.274+0000 7fb10db5a640 1 -- 172.21.15.132:0/1439567968 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb10002c070 con 0x7fb108019040 2024-05-08T18:51:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.274+0000 7fb110062800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.274+0000 7fb110062800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.274+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55670f73b4e0 con 0x55670f7346a0 2024-05-08T18:51:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.275+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb108069040 con 0x55670f7346a0 2024-05-08T18:51:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.275+0000 7fb110062800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.275+0000 7fb110062800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.275+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55670f73b880 con 0x55670f7346a0 2024-05-08T18:51:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.275+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb108069040 con 0x55670f7346a0 2024-05-08T18:51:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.275+0000 7fb110062800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.275+0000 7fb110062800 20 started sync module instance, tier type = 2024-05-08T18:51:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.275+0000 7fb110062800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.275+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f73a920 con 0x7fb108019040 2024-05-08T18:51:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.276+0000 7fb10db5a640 1 -- 172.21.15.132:0/1439567968 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10002c070 con 0x7fb108019040 2024-05-08T18:51:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.276+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93901129229424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f73bc70 con 0x7fb108019040 2024-05-08T18:51:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.276+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f73c4c0 con 0x55670f72fcf0 2024-05-08T18:51:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.277+0000 7fb10db5a640 1 -- 172.21.15.132:0/1439567968 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93901129229424] v27'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10002c070 con 0x7fb108019040 2024-05-08T18:51:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.277+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10407d040 con 0x55670f72fcf0 2024-05-08T18:51:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.277+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93901129231632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f73cd10 con 0x55670f72fcf0 2024-05-08T18:51:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.278+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f73d560 con 0x55670f7346a0 2024-05-08T18:51:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.279+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93901129231632] v27'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10407d040 con 0x55670f72fcf0 2024-05-08T18:51:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.279+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb108069040 con 0x55670f7346a0 2024-05-08T18:51:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.279+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93901129239104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f73d3d0 con 0x55670f7346a0 2024-05-08T18:51:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.279+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f73def0 con 0x7fb108019040 2024-05-08T18:51:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.280+0000 7fb10db5a640 1 -- 172.21.15.132:0/1439567968 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10002c070 con 0x7fb108019040 2024-05-08T18:51:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.280+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93901129243072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f73e790 con 0x7fb108019040 2024-05-08T18:51:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.280+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f73f280 con 0x55670f72fcf0 2024-05-08T18:51:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.280+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93901129239104] v27'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb108069040 con 0x55670f7346a0 2024-05-08T18:51:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.281+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10407d040 con 0x55670f72fcf0 2024-05-08T18:51:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.281+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93901129248080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f73f670 con 0x55670f72fcf0 2024-05-08T18:51:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.281+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f7400d0 con 0x7fb10003c040 2024-05-08T18:51:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.281+0000 7fb10db5a640 1 -- 172.21.15.132:0/1439567968 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93901129243072] v27'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10002c070 con 0x7fb108019040 2024-05-08T18:51:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.282+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93901129248080] v27'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10407d040 con 0x55670f72fcf0 2024-05-08T18:51:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.282+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10407d040 con 0x7fb10003c040 2024-05-08T18:51:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.282+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93901129240160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f7400d0 con 0x7fb10003c040 2024-05-08T18:51:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.282+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f740970 con 0x7fb10003c040 2024-05-08T18:51:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.283+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93901129240160] v27'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10407d040 con 0x7fb10003c040 2024-05-08T18:51:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.283+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10407d040 con 0x7fb10003c040 2024-05-08T18:51:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.283+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93901129245408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f740580 con 0x7fb10003c040 2024-05-08T18:51:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.283+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f740f40 con 0x7fb10003c040 2024-05-08T18:51:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.284+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93901129245408] v27'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10407d040 con 0x7fb10003c040 2024-05-08T18:51:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.284+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10407d040 con 0x7fb10003c040 2024-05-08T18:51:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.284+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93901129253552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f740f40 con 0x7fb10003c040 2024-05-08T18:51:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.284+0000 7fb110062800 20 add_watcher() i=0 2024-05-08T18:51:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.284+0000 7fb110062800 20 add_watcher() i=1 2024-05-08T18:51:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.285+0000 7fb110062800 20 add_watcher() i=2 2024-05-08T18:51:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.285+0000 7fb110062800 20 add_watcher() i=3 2024-05-08T18:51:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.285+0000 7fb110062800 20 add_watcher() i=4 2024-05-08T18:51:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.285+0000 7fb110062800 20 add_watcher() i=5 2024-05-08T18:51:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.285+0000 7fb110062800 20 add_watcher() i=6 2024-05-08T18:51:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.285+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93901129253552] v27'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10407d040 con 0x7fb10003c040 2024-05-08T18:51:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.285+0000 7fb110062800 20 add_watcher() i=7 2024-05-08T18:51:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.285+0000 7fb110062800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.286+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55670f744340 con 0x55670f72fcf0 2024-05-08T18:51:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.286+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb10407d040 con 0x55670f72fcf0 2024-05-08T18:51:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.286+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93901129256032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f741860 con 0x55670f72fcf0 2024-05-08T18:51:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.287+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93901129256032] v27'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb10407d040 con 0x55670f72fcf0 2024-05-08T18:51:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.287+0000 7fafbf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.287+0000 7fb110062800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.287+0000 7fb110062800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.287+0000 7fb110062800 5 note: GC not initialized 2024-05-08T18:51:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.288+0000 7fafbe7fc640 20 reqs_thread_entry: start 2024-05-08T18:51:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.288+0000 7fb110062800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.288+0000 7fb110062800 20 Filter name: none 2024-05-08T18:51:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.288+0000 7faf2ffff640 20 reqs_thread_entry: start 2024-05-08T18:51:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.288+0000 7fb110062800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-05-08T18:51:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.288+0000 7fb110062800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.288+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55670f777820 con 0x7fb108019040 2024-05-08T18:51:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.288+0000 7fb10db5a640 1 -- 172.21.15.132:0/1439567968 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fb10002c070 con 0x7fb108019040 2024-05-08T18:51:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.288+0000 7fb110062800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:51:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.288+0000 7fb110062800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-05-08T18:51:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.288+0000 7fb110062800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T18:51:50.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.288+0000 7fb110062800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:51:50.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.289+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f77bac0 con 0x7fb10003c040 2024-05-08T18:51:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.290+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v27'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7fb10407d040 con 0x7fb10003c040 2024-05-08T18:51:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-05-08T18:51:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.290+0000 7fafbf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.291+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93901129256032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f743a50 con 0x55670f72fcf0 2024-05-08T18:51:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.292+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93901129256032] v27'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb10407d040 con 0x55670f72fcf0 2024-05-08T18:51:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.292+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93901129229424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f740c30 con 0x7fb108019040 2024-05-08T18:51:50.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.293+0000 7fb10db5a640 1 -- 172.21.15.132:0/1439567968 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93901129229424] v27'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10002c070 con 0x7fb108019040 2024-05-08T18:51:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.293+0000 7fb110062800 20 remove_watcher() i=0 2024-05-08T18:51:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.293+0000 7fb110062800 2 removed watcher, disabling cache 2024-05-08T18:51:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.293+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93901129231632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f73a470 con 0x55670f72fcf0 2024-05-08T18:51:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.294+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93901129231632] v27'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10407d040 con 0x55670f72fcf0 2024-05-08T18:51:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.294+0000 7fb110062800 20 remove_watcher() i=1 2024-05-08T18:51:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.294+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93901129239104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f73a470 con 0x55670f7346a0 2024-05-08T18:51:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.295+0000 7fb10e35b640 1 -- 172.21.15.132:0/1439567968 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93901129239104] v27'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb108069040 con 0x55670f7346a0 2024-05-08T18:51:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.295+0000 7fb110062800 20 remove_watcher() i=2 2024-05-08T18:51:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.295+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93901129243072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f73ca40 con 0x7fb108019040 2024-05-08T18:51:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.296+0000 7fb10db5a640 1 -- 172.21.15.132:0/1439567968 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93901129243072] v27'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10002c070 con 0x7fb108019040 2024-05-08T18:51:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.296+0000 7fb110062800 20 remove_watcher() i=3 2024-05-08T18:51:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.296+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93901129248080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f73d9c0 con 0x55670f72fcf0 2024-05-08T18:51:50.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.297+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93901129248080] v27'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10407d040 con 0x55670f72fcf0 2024-05-08T18:51:50.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.297+0000 7fb110062800 20 remove_watcher() i=4 2024-05-08T18:51:50.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.297+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93901129240160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f73ca40 con 0x7fb10003c040 2024-05-08T18:51:50.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.298+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93901129240160] v27'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10407d040 con 0x7fb10003c040 2024-05-08T18:51:50.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.298+0000 7fb110062800 20 remove_watcher() i=5 2024-05-08T18:51:50.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.298+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93901129245408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f73ed50 con 0x7fb10003c040 2024-05-08T18:51:50.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.299+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93901129245408] v27'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10407d040 con 0x7fb10003c040 2024-05-08T18:51:50.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.299+0000 7fb110062800 20 remove_watcher() i=6 2024-05-08T18:51:50.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.299+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93901129253552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55670f73d9c0 con 0x7fb10003c040 2024-05-08T18:51:50.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.300+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93901129253552] v27'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10407d040 con 0x7fb10003c040 2024-05-08T18:51:50.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.300+0000 7fb110062800 20 remove_watcher() i=7 2024-05-08T18:51:50.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.300+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb10003c040 msgr2=0x7fb100042770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.300+0000 7fb110062800 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fb10003c040 0x7fb100042770 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.300+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55670f72fcf0 msgr2=0x55670f7321b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.300+0000 7fb110062800 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55670f72fcf0 0x55670f7321b0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.300+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb108019040 msgr2=0x7fb10803f8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.300+0000 7fb110062800 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb108019040 0x7fb10803f8d0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.300+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55670f7346a0 msgr2=0x55670f736a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.300+0000 7fb110062800 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55670f7346a0 0x55670f736a90 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fafd803bb50 msgr2=0x7fafd803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fafd803bb50 0x7fafd803e010 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55670f700df0 tx=0x7fb100047000 comp rx=0 tx=0).stop 2024-05-08T18:51:50.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f71cc30 msgr2=0x55670f724180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb10d359640 1 -- 172.21.15.132:0/1439567968 reap_dead start 2024-05-08T18:51:50.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f71cc30 0x55670f724180 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb108014690 tx=0x7fb108052b70 comp rx=0 tx=0).stop 2024-05-08T18:51:50.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 shutdown_connections 2024-05-08T18:51:50.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 --2- 172.21.15.132:0/1439567968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f71cc30 0x55670f724180 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 >> 172.21.15.132:0/1439567968 conn(0x55670f718fe0 msgr2=0x55670f71e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 shutdown_connections 2024-05-08T18:51:50.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 -- 172.21.15.132:0/1439567968 wait complete. 2024-05-08T18:51:50.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 -- 172.21.15.132:0/2166346590 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fafe803bb50 msgr2=0x7fafe803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 --2- 172.21.15.132:0/2166346590 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fafe803bb50 0x7fafe803e010 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55670f6fc080 tx=0x7fb100024ca0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 -- 172.21.15.132:0/2166346590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f70f980 msgr2=0x55670f70fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 --2- 172.21.15.132:0/2166346590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f70f980 0x55670f70fda0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x55670f6f5270 tx=0x7fb10800aea0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 -- 172.21.15.132:0/2166346590 shutdown_connections 2024-05-08T18:51:50.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 --2- 172.21.15.132:0/2166346590 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fafe803bb50 0x7fafe803e010 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 --2- 172.21.15.132:0/2166346590 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f70f980 0x55670f70fda0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 -- 172.21.15.132:0/2166346590 >> 172.21.15.132:0/2166346590 conn(0x55670f703a20 msgr2=0x55670f703e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 -- 172.21.15.132:0/2166346590 shutdown_connections 2024-05-08T18:51:50.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 -- 172.21.15.132:0/2166346590 wait complete. 2024-05-08T18:51:50.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 -- 172.21.15.132:0/360483526 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55670f5fc5e0 msgr2=0x55670f6fb5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 --2- 172.21.15.132:0/360483526 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55670f5fc5e0 0x55670f6fb5e0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 -- 172.21.15.132:0/360483526 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55670f6fdf10 msgr2=0x55670f700300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 --2- 172.21.15.132:0/360483526 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55670f6fdf10 0x55670f700300 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.301+0000 7fb110062800 1 -- 172.21.15.132:0/360483526 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7faff403bb50 msgr2=0x7faff403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.302+0000 7fb110062800 1 --2- 172.21.15.132:0/360483526 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7faff403bb50 0x7faff403e010 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb104054000 tx=0x7fb10404e000 comp rx=0 tx=0).stop 2024-05-08T18:51:50.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.302+0000 7fb110062800 1 -- 172.21.15.132:0/360483526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f5f8150 msgr2=0x55670f6f43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.302+0000 7fb110062800 1 --2- 172.21.15.132:0/360483526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f5f8150 0x55670f6f43a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb100014040 tx=0x7fb100001250 comp rx=0 tx=0).stop 2024-05-08T18:51:50.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.302+0000 7fb110062800 1 -- 172.21.15.132:0/360483526 shutdown_connections 2024-05-08T18:51:50.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.302+0000 7fb110062800 1 --2- 172.21.15.132:0/360483526 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55670f6fdf10 0x55670f700300 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.302+0000 7fb110062800 1 --2- 172.21.15.132:0/360483526 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55670f5fc5e0 0x55670f6fb5e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.302+0000 7fb110062800 1 --2- 172.21.15.132:0/360483526 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7faff403bb50 0x7faff403e010 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.302+0000 7fb110062800 1 --2- 172.21.15.132:0/360483526 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55670f5f8150 0x55670f6f43a0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.302+0000 7fb110062800 1 -- 172.21.15.132:0/360483526 >> 172.21.15.132:0/360483526 conn(0x55670f5f3730 msgr2=0x55670f6e2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.302+0000 7fb110062800 1 -- 172.21.15.132:0/360483526 shutdown_connections 2024-05-08T18:51:50.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.302+0000 7fb110062800 1 -- 172.21.15.132:0/360483526 wait complete. 2024-05-08T18:51:50.309 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-08T18:51:50.314 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:51:50.314 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-05-08T18:51:50.318 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:51:50.318 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-05-08T18:51:50.318 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-05-08T18:51:50.318 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-05-08T18:51:50.318 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-05-08T18:51:50.362 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:50.363 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:50.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.364+0000 7fdda7c0f800 1 Processor -- start 2024-05-08T18:51:50.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.364+0000 7fdda7c0f800 1 -- start start 2024-05-08T18:51:50.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.364+0000 7fdda7c0f800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55ec8ee11540 0x55ec8ee11960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.364+0000 7fdda7c0f800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ec8ee11f90 con 0x55ec8ee14530 2024-05-08T18:51:50.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.364+0000 7fdda7c0f800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55ec8ecb3e20 con 0x55ec8ee11540 2024-05-08T18:51:50.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.364+0000 7fdda31d5640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55ec8ee11540 0x55ec8ee11960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.364+0000 7fdda31d5640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55ec8ee11540 0x55ec8ee11960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56770/0 (socket says 172.21.15.132:56770) 2024-05-08T18:51:50.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.364+0000 7fdda31d5640 1 -- 172.21.15.132:0/2165880948 learned_addr learned my addr 172.21.15.132:0/2165880948 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:50.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.364+0000 7fdd9a9d4640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55ec8ee14530 0x55ec8ee149e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:49102/0 (socket says 172.21.15.132:49102) 2024-05-08T18:51:50.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.365+0000 7fdda31d5640 1 -- 172.21.15.132:0/2165880948 >> v1:172.21.15.42:6789/0 conn(0x55ec8ee14530 legacy=0x55ec8ee149e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.365+0000 7fdda31d5640 1 -- 172.21.15.132:0/2165880948 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec8ee150f0 con 0x55ec8ee11540 2024-05-08T18:51:50.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.367+0000 7fdda31d5640 1 --2- 172.21.15.132:0/2165880948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ee11540 0x55ec8ee11960 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400a520 tx=0x7fdd9401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac826ad49a87160 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.367+0000 7fdda29d4640 1 -- 172.21.15.132:0/2165880948 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd94057070 con 0x55ec8ee11540 2024-05-08T18:51:50.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.367+0000 7fdda29d4640 1 -- 172.21.15.132:0/2165880948 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd94052570 con 0x55ec8ee11540 2024-05-08T18:51:50.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.367+0000 7fdda29d4640 1 -- 172.21.15.132:0/2165880948 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd94052870 con 0x55ec8ee11540 2024-05-08T18:51:50.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.367+0000 7fdda7c0f800 1 -- 172.21.15.132:0/2165880948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ee11540 msgr2=0x55ec8ee11960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.367+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/2165880948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ee11540 0x55ec8ee11960 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400a520 tx=0x7fdd9401d010 comp rx=0 tx=0).stop 2024-05-08T18:51:50.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.367+0000 7fdda7c0f800 1 -- 172.21.15.132:0/2165880948 shutdown_connections 2024-05-08T18:51:50.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.367+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/2165880948 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ee11540 0x55ec8ee11960 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.367+0000 7fdda7c0f800 1 -- 172.21.15.132:0/2165880948 >> 172.21.15.132:0/2165880948 conn(0x55ec8ee0ceb0 msgr2=0x55ec8ee0f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.367+0000 7fdda7c0f800 1 -- 172.21.15.132:0/2165880948 shutdown_connections 2024-05-08T18:51:50.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.367+0000 7fdda7c0f800 1 -- 172.21.15.132:0/2165880948 wait complete. 2024-05-08T18:51:50.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.380+0000 7fdda7c0f800 1 Processor -- start 2024-05-08T18:51:50.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.381+0000 7fdda7c0f800 1 -- start start 2024-05-08T18:51:50.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.381+0000 7fdda7c0f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ee11540 0x55ec8ee13e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.381+0000 7fdda7c0f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ec8ed5e5c0 con 0x55ec8ee11540 2024-05-08T18:51:50.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.381+0000 7fdda31d5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ee11540 0x55ec8ee13e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.381+0000 7fdda31d5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ee11540 0x55ec8ee13e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56776/0 (socket says 172.21.15.132:56776) 2024-05-08T18:51:50.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.381+0000 7fdda31d5640 1 -- 172.21.15.132:0/2229975729 learned_addr learned my addr 172.21.15.132:0/2229975729 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:50.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.381+0000 7fdda31d5640 1 -- 172.21.15.132:0/2229975729 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec8ee12430 con 0x55ec8ee11540 2024-05-08T18:51:50.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.382+0000 7fdda31d5640 1 --2- 172.21.15.132:0/2229975729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ee11540 0x55ec8ee13e70 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fdd94055040 tx=0x7fdd9404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46dbe2060039b704 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.382+0000 7fdc9160a640 1 -- 172.21.15.132:0/2229975729 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd94057040 con 0x55ec8ee11540 2024-05-08T18:51:50.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.382+0000 7fdc9160a640 1 -- 172.21.15.132:0/2229975729 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd94052850 con 0x55ec8ee11540 2024-05-08T18:51:50.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.382+0000 7fdc9160a640 1 -- 172.21.15.132:0/2229975729 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd94052b50 con 0x55ec8ee11540 2024-05-08T18:51:50.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.382+0000 7fdda7c0f800 1 -- 172.21.15.132:0/2229975729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ee11540 msgr2=0x55ec8ee13e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.382+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/2229975729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ee11540 0x55ec8ee13e70 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fdd94055040 tx=0x7fdd9404c000 comp rx=0 tx=0).stop 2024-05-08T18:51:50.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.383+0000 7fdda7c0f800 1 -- 172.21.15.132:0/2229975729 shutdown_connections 2024-05-08T18:51:50.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.383+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/2229975729 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ee11540 0x55ec8ee13e70 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.383+0000 7fdda7c0f800 1 -- 172.21.15.132:0/2229975729 >> 172.21.15.132:0/2229975729 conn(0x55ec8ee0ceb0 msgr2=0x55ec8ef00070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.383+0000 7fdda7c0f800 1 -- 172.21.15.132:0/2229975729 shutdown_connections 2024-05-08T18:51:50.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.383+0000 7fdda7c0f800 1 -- 172.21.15.132:0/2229975729 wait complete. 2024-05-08T18:51:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.383+0000 7fdda7c0f800 1 Processor -- start 2024-05-08T18:51:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.383+0000 7fdda7c0f800 1 -- start start 2024-05-08T18:51:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.383+0000 7fdda7c0f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ee11540 0x55ec8ef0e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.383+0000 7fdda7c0f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ec8ee1ca00 con 0x55ec8ee11540 2024-05-08T18:51:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.383+0000 7fdda31d5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ee11540 0x55ec8ef0e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.383+0000 7fdda31d5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ee11540 0x55ec8ef0e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56786/0 (socket says 172.21.15.132:56786) 2024-05-08T18:51:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.383+0000 7fdda31d5640 1 -- 172.21.15.132:0/1330741051 learned_addr learned my addr 172.21.15.132:0/1330741051 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.384+0000 7fdda31d5640 1 -- 172.21.15.132:0/1330741051 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec8ef0e940 con 0x55ec8ee11540 2024-05-08T18:51:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.384+0000 7fdda31d5640 1 --2- 172.21.15.132:0/1330741051 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ee11540 0x55ec8ef0e400 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400a520 tx=0x7fdd94003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.384+0000 7fdc8fe07640 1 -- 172.21.15.132:0/1330741051 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd94073070 con 0x55ec8ee11540 2024-05-08T18:51:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.384+0000 7fdc8fe07640 1 -- 172.21.15.132:0/1330741051 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd9405d570 con 0x55ec8ee11540 2024-05-08T18:51:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.384+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1330741051 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ec8ef0ebd0 con 0x55ec8ee11540 2024-05-08T18:51:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.384+0000 7fdc8fe07640 1 -- 172.21.15.132:0/1330741051 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd94057070 con 0x55ec8ee11540 2024-05-08T18:51:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.384+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1330741051 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec8ef11880 con 0x55ec8ee11540 2024-05-08T18:51:50.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.385+0000 7fdc8fe07640 1 -- 172.21.15.132:0/1330741051 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fdd94076070 con 0x55ec8ee11540 2024-05-08T18:51:50.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.385+0000 7fdc8fe07640 1 --2- 172.21.15.132:0/1330741051 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc8803bb50 0x7fdc8803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.385+0000 7fdc8fe07640 1 -- 172.21.15.132:0/1330741051 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fdd940940a0 con 0x55ec8ee11540 2024-05-08T18:51:50.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.385+0000 7fdd9a9d4640 1 --2- 172.21.15.132:0/1330741051 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc8803bb50 0x7fdc8803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.385+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/1330741051 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ec8ee14530 0x55ec8ef15640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.385+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1330741051 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef15b80 con 0x55ec8ee14530 2024-05-08T18:51:50.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.386+0000 7fdda39d6640 1 --2- 172.21.15.132:0/1330741051 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ec8ee14530 0x55ec8ef15640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.391 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.386+0000 7fdd9a9d4640 1 --2- 172.21.15.132:0/1330741051 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc8803bb50 0x7fdc8803e010 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c000f60 tx=0x7fdd8c001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.386+0000 7fdda39d6640 1 --2- 172.21.15.132:0/1330741051 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ec8ee14530 0x55ec8ef15640 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.386+0000 7fdda39d6640 1 -- 172.21.15.132:0/1330741051 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd9c00a4a0 con 0x55ec8ee14530 2024-05-08T18:51:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.386+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1330741051 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef12c10 con 0x55ec8ee14530 2024-05-08T18:51:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.386+0000 7fdda39d6640 1 -- 172.21.15.132:0/1330741051 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdd9c00a4a0 con 0x55ec8ee14530 2024-05-08T18:51:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.386+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/1330741051 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ec8ef17e90 0x55ec8ef1a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.386+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1330741051 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef1a970 con 0x55ec8ef17e90 2024-05-08T18:51:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.386+0000 7fdda31d5640 1 --2- 172.21.15.132:0/1330741051 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ec8ef17e90 0x55ec8ef1a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.387+0000 7fdda31d5640 1 --2- 172.21.15.132:0/1330741051 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ec8ef17e90 0x55ec8ef1a280 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.387+0000 7fdda31d5640 1 -- 172.21.15.132:0/1330741051 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdd94075030 con 0x55ec8ef17e90 2024-05-08T18:51:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.387+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1330741051 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef16d30 con 0x55ec8ee14530 2024-05-08T18:51:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.387+0000 7fdda39d6640 1 -- 172.21.15.132:0/1330741051 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdd9c00a4a0 con 0x55ec8ee14530 2024-05-08T18:51:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.387+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1330741051 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef17210 con 0x55ec8ee14530 2024-05-08T18:51:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.388+0000 7fdda39d6640 1 -- 172.21.15.132:0/1330741051 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdd9c00a4a0 con 0x55ec8ee14530 2024-05-08T18:51:50.392 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.388+0000 7fdda7c0f800 1 Processor -- start 2024-05-08T18:51:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.388+0000 7fdda7c0f800 1 -- start start 2024-05-08T18:51:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.388+0000 7fdda7c0f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ef298b0 0x55ec8ef29cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.388+0000 7fdda7c0f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ec8ed04fc0 con 0x55ec8ef298b0 2024-05-08T18:51:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.388+0000 7fdda39d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ef298b0 0x55ec8ef29cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.388+0000 7fdda39d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ef298b0 0x55ec8ef29cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56792/0 (socket says 172.21.15.132:56792) 2024-05-08T18:51:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.389+0000 7fdda39d6640 1 -- 172.21.15.132:0/188552285 learned_addr learned my addr 172.21.15.132:0/188552285 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.389+0000 7fdda39d6640 1 -- 172.21.15.132:0/188552285 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec8ef2a210 con 0x55ec8ef298b0 2024-05-08T18:51:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.389+0000 7fdda39d6640 1 --2- 172.21.15.132:0/188552285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ef298b0 0x55ec8ef29cd0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x55ec8ef15f40 tx=0x7fdd9c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.389+0000 7fdc8d602640 1 -- 172.21.15.132:0/188552285 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd9c014450 con 0x55ec8ef298b0 2024-05-08T18:51:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.389+0000 7fdda7c0f800 1 -- 172.21.15.132:0/188552285 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ec8ef2ac80 con 0x55ec8ef298b0 2024-05-08T18:51:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.389+0000 7fdc8d602640 1 -- 172.21.15.132:0/188552285 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd9c014610 con 0x55ec8ef298b0 2024-05-08T18:51:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.389+0000 7fdc8d602640 1 -- 172.21.15.132:0/188552285 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd9c028060 con 0x55ec8ef298b0 2024-05-08T18:51:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.389+0000 7fdda7c0f800 1 -- 172.21.15.132:0/188552285 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec8ef2b180 con 0x55ec8ef298b0 2024-05-08T18:51:50.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.390+0000 7fdc8d602640 1 -- 172.21.15.132:0/188552285 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fdd9c011040 con 0x55ec8ef298b0 2024-05-08T18:51:50.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.390+0000 7fdc8d602640 1 --2- 172.21.15.132:0/188552285 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc7c03bb50 0x7fdc7c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.390+0000 7fdc8d602640 1 -- 172.21.15.132:0/188552285 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fdd9c01e070 con 0x55ec8ef298b0 2024-05-08T18:51:50.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.390+0000 7fdda31d5640 1 --2- 172.21.15.132:0/188552285 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc7c03bb50 0x7fdc7c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.391+0000 7fdda7c0f800 1 Processor -- start 2024-05-08T18:51:50.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.391+0000 7fdda31d5640 1 --2- 172.21.15.132:0/188552285 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc7c03bb50 0x7fdc7c03e010 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55ec8ef15fe0 tx=0x7fdd94066750 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.391+0000 7fdda7c0f800 1 -- start start 2024-05-08T18:51:50.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.391+0000 7fdda7c0f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ef36b00 0x55ec8ef36f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.391+0000 7fdda7c0f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ec8ee126f0 con 0x55ec8ef36b00 2024-05-08T18:51:50.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.391+0000 7fdda39d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ef36b00 0x55ec8ef36f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.391+0000 7fdda39d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ef36b00 0x55ec8ef36f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56796/0 (socket says 172.21.15.132:56796) 2024-05-08T18:51:50.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.391+0000 7fdda39d6640 1 -- 172.21.15.132:0/2796945871 learned_addr learned my addr 172.21.15.132:0/2796945871 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:50.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.391+0000 7fdda39d6640 1 -- 172.21.15.132:0/2796945871 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec8ef374f0 con 0x55ec8ef36b00 2024-05-08T18:51:50.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.391+0000 7fdda39d6640 1 --2- 172.21.15.132:0/2796945871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ef36b00 0x55ec8ef36f20 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c022fd0 tx=0x7fdd9c02c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57c2aa81fbba79f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.392+0000 7fdc86ffd640 1 -- 172.21.15.132:0/2796945871 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd9c016b00 con 0x55ec8ef36b00 2024-05-08T18:51:50.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.392+0000 7fdc86ffd640 1 -- 172.21.15.132:0/2796945871 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd9c04bc30 con 0x55ec8ef36b00 2024-05-08T18:51:50.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.392+0000 7fdc86ffd640 1 -- 172.21.15.132:0/2796945871 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd9c04bf10 con 0x55ec8ef36b00 2024-05-08T18:51:50.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.392+0000 7fdda7c0f800 1 -- 172.21.15.132:0/2796945871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ef36b00 msgr2=0x55ec8ef36f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.392+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/2796945871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ef36b00 0x55ec8ef36f20 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c022fd0 tx=0x7fdd9c02c5a0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.392+0000 7fdda7c0f800 1 -- 172.21.15.132:0/2796945871 shutdown_connections 2024-05-08T18:51:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.392+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/2796945871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ef36b00 0x55ec8ef36f20 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.392+0000 7fdda7c0f800 1 -- 172.21.15.132:0/2796945871 >> 172.21.15.132:0/2796945871 conn(0x55ec8ef32eb0 msgr2=0x55ec8ef30f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.392+0000 7fdda7c0f800 1 -- 172.21.15.132:0/2796945871 shutdown_connections 2024-05-08T18:51:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.392+0000 7fdda7c0f800 1 -- 172.21.15.132:0/2796945871 wait complete. 2024-05-08T18:51:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.392+0000 7fdda7c0f800 1 Processor -- start 2024-05-08T18:51:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.392+0000 7fdda7c0f800 1 -- start start 2024-05-08T18:51:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.393+0000 7fdda7c0f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ef36b00 0x55ec8ef3e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.393+0000 7fdda7c0f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55ec8ef37c50 con 0x55ec8ef36b00 2024-05-08T18:51:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.393+0000 7fdda39d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ef36b00 0x55ec8ef3e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.393+0000 7fdda39d6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ef36b00 0x55ec8ef3e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:56810/0 (socket says 172.21.15.132:56810) 2024-05-08T18:51:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.393+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 learned_addr learned my addr 172.21.15.132:0/1916704030 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.393+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec8ef3e630 con 0x55ec8ef36b00 2024-05-08T18:51:50.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.393+0000 7fdda39d6640 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ef36b00 0x55ec8ef3e0f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c051040 tx=0x7fdd9c052cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.393+0000 7fdc857fa640 1 -- 172.21.15.132:0/1916704030 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd9c031070 con 0x55ec8ef36b00 2024-05-08T18:51:50.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.393+0000 7fdc857fa640 1 -- 172.21.15.132:0/1916704030 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd9c014bc0 con 0x55ec8ef36b00 2024-05-08T18:51:50.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.393+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ec8ef3e8c0 con 0x55ec8ef36b00 2024-05-08T18:51:50.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.393+0000 7fdc857fa640 1 -- 172.21.15.132:0/1916704030 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd9c044040 con 0x55ec8ef36b00 2024-05-08T18:51:50.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.394+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec8ef41570 con 0x55ec8ef36b00 2024-05-08T18:51:50.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.394+0000 7fdc857fa640 1 -- 172.21.15.132:0/1916704030 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fdd9c054a60 con 0x55ec8ef36b00 2024-05-08T18:51:50.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.395+0000 7fdc857fa640 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc6c03bb50 0x7fdc6c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.395+0000 7fdc857fa640 1 -- 172.21.15.132:0/1916704030 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fdd9c00e040 con 0x55ec8ef36b00 2024-05-08T18:51:50.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.395+0000 7fdda31d5640 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc6c03bb50 0x7fdc6c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.395+0000 7fdda7c0f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.395+0000 7fdda31d5640 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc6c03bb50 0x7fdc6c03e010 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdd94052fd0 tx=0x7fdd9407f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.395+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ec8ef49d50 0x55ec8ef4c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.395+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef4c960 con 0x55ec8ef49d50 2024-05-08T18:51:50.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.395+0000 7fdd9a9d4640 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ec8ef49d50 0x55ec8ef4c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.396+0000 7fdd9a9d4640 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ec8ef49d50 0x55ec8ef4c210 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.396+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd8c00f610 con 0x55ec8ef49d50 2024-05-08T18:51:50.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.396+0000 7fdda7c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.396+0000 7fdda7c0f800 20 realm 2024-05-08T18:51:50.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.396+0000 7fdda7c0f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.396+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef491a0 con 0x55ec8ef49d50 2024-05-08T18:51:50.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.396+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd8c00f610 con 0x55ec8ef49d50 2024-05-08T18:51:50.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.396+0000 7fdda7c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.396+0000 7fdda7c0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:50.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.396+0000 7fdda7c0f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.396+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef4d450 con 0x55ec8ef49d50 2024-05-08T18:51:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.396+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd8c00f610 con 0x55ec8ef49d50 2024-05-08T18:51:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.396+0000 7fdda7c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.396+0000 7fdda7c0f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.396+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef4dd20 con 0x55ec8ef49d50 2024-05-08T18:51:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.396+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdd8c00f610 con 0x55ec8ef49d50 2024-05-08T18:51:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.397+0000 7fdda7c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.397+0000 7fdda7c0f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.397+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ec8ef4e740 0x55ec8ef50b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.397+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef51220 con 0x55ec8ef4e740 2024-05-08T18:51:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.397+0000 7fdda39d6640 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ec8ef4e740 0x55ec8ef50b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.397+0000 7fdda39d6640 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ec8ef4e740 0x55ec8ef50b30 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.397+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdd9c03e070 con 0x55ec8ef4e740 2024-05-08T18:51:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.397+0000 7fdda7c0f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.397+0000 7fdda7c0f800 20 searching for the correct realm 2024-05-08T18:51:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.397+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef52b70 con 0x55ec8ef4e740 2024-05-08T18:51:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.398+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.398+0000 7fdda39d6640 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fdd9c014070 0x7fdd9c002560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.398+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef52b70 con 0x7fdd9c014070 2024-05-08T18:51:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.398+0000 7fdda31d5640 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fdd9c014070 0x7fdd9c002560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.398+0000 7fdda31d5640 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fdd9c014070 0x7fdd9c002560 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.398+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.398+0000 7fdda31d5640 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fdd940a1040 0x7fdd9405c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.398+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef52b70 con 0x7fdd940a1040 2024-05-08T18:51:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.399+0000 7fdd9a9d4640 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fdd940a1040 0x7fdd9405c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.399+0000 7fdd9a9d4640 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fdd940a1040 0x7fdd9405c910 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.399+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8c00f610 con 0x7fdd940a1040 2024-05-08T18:51:50.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.399+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef52b70 con 0x55ec8ef49d50 2024-05-08T18:51:50.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.400+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8c00f610 con 0x55ec8ef49d50 2024-05-08T18:51:50.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.400+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef52b70 con 0x55ec8ef49d50 2024-05-08T18:51:50.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.400+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.400+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef52b70 con 0x7fdd940a1040 2024-05-08T18:51:50.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.400+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8c02b040 con 0x7fdd940a1040 2024-05-08T18:51:50.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.400+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef52b70 con 0x7fdd940a1040 2024-05-08T18:51:50.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.400+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8c02b040 con 0x7fdd940a1040 2024-05-08T18:51:50.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.400+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef52b70 con 0x7fdd9c014070 2024-05-08T18:51:50.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.401+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.401+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef52b70 con 0x55ec8ef4e740 2024-05-08T18:51:50.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.401+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.401+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef52b70 con 0x55ec8ef49d50 2024-05-08T18:51:50.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.401+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.401+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef52b70 con 0x7fdd940a1040 2024-05-08T18:51:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.401+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8c02b040 con 0x7fdd940a1040 2024-05-08T18:51:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.401+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef52b70 con 0x55ec8ef49d50 2024-05-08T18:51:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.402+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.402+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef52b70 con 0x7fdd9c014070 2024-05-08T18:51:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.402+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.402+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef52b70 con 0x55ec8ef4e740 2024-05-08T18:51:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.402+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.402+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fdd9c064040 con 0x55ec8ef4e740 2024-05-08T18:51:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.402+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.402+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fdd9c064040 con 0x7fdd940a1040 2024-05-08T18:51:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.403+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8c02b040 con 0x7fdd940a1040 2024-05-08T18:51:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.403+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fdd9c064040 con 0x55ec8ef4e740 2024-05-08T18:51:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.403+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.403+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fdd9c064040 con 0x55ec8ef4e740 2024-05-08T18:51:50.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.403+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.403+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fdd9c064040 con 0x55ec8ef49d50 2024-05-08T18:51:50.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.403+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.403+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fdd9c064040 con 0x55ec8ef49d50 2024-05-08T18:51:50.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.403+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.403+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fdd9c064040 con 0x7fdd940a1040 2024-05-08T18:51:50.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.404+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8c02b040 con 0x7fdd940a1040 2024-05-08T18:51:50.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.404+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fdd9c064040 con 0x55ec8ef4e740 2024-05-08T18:51:50.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.404+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.404+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fdd9c064040 con 0x7fdd9c014070 2024-05-08T18:51:50.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.404+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.404+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fdd9c064040 con 0x55ec8ef49d50 2024-05-08T18:51:50.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.404+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.404+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fdd9c064040 con 0x7fdd9c014070 2024-05-08T18:51:50.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.405+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.405+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fdd9c064040 con 0x55ec8ef4e740 2024-05-08T18:51:50.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.405+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.405+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fdd9c064040 con 0x7fdd940a1040 2024-05-08T18:51:50.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.405+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8c02b040 con 0x7fdd940a1040 2024-05-08T18:51:50.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.405+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fdd9c064040 con 0x7fdd9c014070 2024-05-08T18:51:50.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.405+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.405+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fdd9c064040 con 0x55ec8ef4e740 2024-05-08T18:51:50.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.406+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.406+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fdd9c064040 con 0x7fdd940a1040 2024-05-08T18:51:50.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.406+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8c02b040 con 0x7fdd940a1040 2024-05-08T18:51:50.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.406+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fdd9c064040 con 0x55ec8ef49d50 2024-05-08T18:51:50.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.406+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.406+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fdd9c064040 con 0x7fdd9c014070 2024-05-08T18:51:50.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.406+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.406+0000 7fdda7c0f800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:50.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.406+0000 7fdda7c0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:50.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.406+0000 7fdda7c0f800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:50.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.406+0000 7fdda7c0f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:50.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.406+0000 7fdda7c0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:50.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.406+0000 7fdda7c0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:50.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.406+0000 7fdda7c0f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.406+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef51ae0 con 0x55ec8ef49d50 2024-05-08T18:51:50.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.407+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.407+0000 7fdda7c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.407+0000 7fdda7c0f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.407+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef51ed0 con 0x55ec8ef49d50 2024-05-08T18:51:50.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.407+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.407+0000 7fdda7c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:50.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.407+0000 7fdda7c0f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.407+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef522f0 con 0x55ec8ef49d50 2024-05-08T18:51:50.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.407+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.407+0000 7fdda7c0f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:50.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.407+0000 7fdda7c0f800 20 zone default found 2024-05-08T18:51:50.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.407+0000 7fdda7c0f800 4 Realm: () 2024-05-08T18:51:50.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.407+0000 7fdda7c0f800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:50.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.407+0000 7fdda7c0f800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:50.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.407+0000 7fdda7c0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:50.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.407+0000 7fdda7c0f800 20 zonegroup default 2024-05-08T18:51:50.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.407+0000 7fdda7c0f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.407+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef52ff0 con 0x7fdd9c014070 2024-05-08T18:51:50.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.407+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.407+0000 7fdda7c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.407+0000 7fdda7c0f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.407+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef552a0 con 0x55ec8ef4e740 2024-05-08T18:51:50.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.408+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.408+0000 7fdda7c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.408+0000 7fdda7c0f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.408+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef55640 con 0x55ec8ef4e740 2024-05-08T18:51:50.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.408+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.408+0000 7fdda7c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.408+0000 7fdda7c0f800 20 started sync module instance, tier type = 2024-05-08T18:51:50.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.408+0000 7fdda7c0f800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:50.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.408+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef546e0 con 0x7fdd9c014070 2024-05-08T18:51:50.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.409+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.409+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94474499083008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef55af0 con 0x7fdd9c014070 2024-05-08T18:51:50.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.409+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef56340 con 0x55ec8ef49d50 2024-05-08T18:51:50.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.410+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94474499083008] v27'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.410+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.410+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94474499085888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef56340 con 0x55ec8ef49d50 2024-05-08T18:51:50.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.410+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef56e40 con 0x55ec8ef4e740 2024-05-08T18:51:50.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.411+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.412+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94474499090736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef56e40 con 0x55ec8ef4e740 2024-05-08T18:51:50.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.412+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef57e30 con 0x7fdd9c014070 2024-05-08T18:51:50.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.412+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94474499085888] v27'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.412+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94474499090736] v27'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.413+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.413+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94474499093088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef55e90 con 0x7fdd9c014070 2024-05-08T18:51:50.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.413+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef586d0 con 0x55ec8ef49d50 2024-05-08T18:51:50.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.414+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94474499093088] v27'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.414+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.414+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94474499097120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef58640 con 0x55ec8ef49d50 2024-05-08T18:51:50.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.414+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef59590 con 0x7fdd940a1040 2024-05-08T18:51:50.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.415+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94474499097120] v27'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.415+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x7fdd940a1040 2024-05-08T18:51:50.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.415+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94474499099248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef59590 con 0x7fdd940a1040 2024-05-08T18:51:50.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.415+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef59fa0 con 0x7fdd940a1040 2024-05-08T18:51:50.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.417+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94474499099248] v27'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x7fdd940a1040 2024-05-08T18:51:50.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.417+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x7fdd940a1040 2024-05-08T18:51:50.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.417+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94474499101376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef59fa0 con 0x7fdd940a1040 2024-05-08T18:51:50.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.417+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef5a960 con 0x7fdd940a1040 2024-05-08T18:51:50.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.418+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94474499101376] v27'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x7fdd940a1040 2024-05-08T18:51:50.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.418+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x7fdd940a1040 2024-05-08T18:51:50.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.418+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94474499106448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef59fa0 con 0x7fdd940a1040 2024-05-08T18:51:50.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.418+0000 7fdda7c0f800 20 add_watcher() i=0 2024-05-08T18:51:50.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.418+0000 7fdda7c0f800 20 add_watcher() i=1 2024-05-08T18:51:50.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.418+0000 7fdda7c0f800 20 add_watcher() i=2 2024-05-08T18:51:50.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.418+0000 7fdda7c0f800 20 add_watcher() i=3 2024-05-08T18:51:50.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.418+0000 7fdda7c0f800 20 add_watcher() i=4 2024-05-08T18:51:50.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.418+0000 7fdda7c0f800 20 add_watcher() i=5 2024-05-08T18:51:50.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.418+0000 7fdda7c0f800 20 add_watcher() i=6 2024-05-08T18:51:50.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.419+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94474499106448] v27'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x7fdd940a1040 2024-05-08T18:51:50.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.419+0000 7fdda7c0f800 20 add_watcher() i=7 2024-05-08T18:51:50.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.419+0000 7fdda7c0f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:50.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.419+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef5dd80 con 0x55ec8ef49d50 2024-05-08T18:51:50.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.419+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.419+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94474499103936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef5b280 con 0x55ec8ef49d50 2024-05-08T18:51:50.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.420+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94474499103936] v27'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.420+0000 7fdc59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:50.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.420+0000 7fdda7c0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:50.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.420+0000 7fdda7c0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:50.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.420+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef5daa0 con 0x55ec8ef49d50 2024-05-08T18:51:50.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.422+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.422+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef66df0 con 0x7fdd940a1040 2024-05-08T18:51:50.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.423+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x7fdd940a1040 2024-05-08T18:51:50.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.423+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef66df0 con 0x55ec8ef4e740 2024-05-08T18:51:50.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.424+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.424+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef672a0 con 0x55ec8ef49d50 2024-05-08T18:51:50.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.425+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'219 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.425+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef672a0 con 0x7fdd9c014070 2024-05-08T18:51:50.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.426+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'68 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.426+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef678b0 con 0x55ec8ef4e740 2024-05-08T18:51:50.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.427+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'46 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.427+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef67940 con 0x55ec8ef49d50 2024-05-08T18:51:50.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.428+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.428+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef679d0 con 0x7fdd940a1040 2024-05-08T18:51:50.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.429+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'47 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x7fdd940a1040 2024-05-08T18:51:50.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.429+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef679d0 con 0x7fdd9c014070 2024-05-08T18:51:50.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.430+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.430+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef67f60 con 0x55ec8ef4e740 2024-05-08T18:51:50.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.431+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.431+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef67f60 con 0x7fdd9c014070 2024-05-08T18:51:50.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.432+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'69 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.432+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef67f60 con 0x7fdd940a1040 2024-05-08T18:51:50.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.434+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x7fdd940a1040 2024-05-08T18:51:50.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.434+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef67f60 con 0x7fdd9c014070 2024-05-08T18:51:50.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.435+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.435+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef67f60 con 0x7fdd940a1040 2024-05-08T18:51:50.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.436+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'51 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x7fdd940a1040 2024-05-08T18:51:50.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.436+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef67f60 con 0x55ec8ef49d50 2024-05-08T18:51:50.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.437+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'220 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.437+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef67f60 con 0x55ec8ef4e740 2024-05-08T18:51:50.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.438+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'62 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.438+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef66e40 con 0x7fdd9c014070 2024-05-08T18:51:50.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.439+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'70 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.439+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef66e40 con 0x55ec8ef4e740 2024-05-08T18:51:50.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.440+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.440+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef67f60 con 0x55ec8ef49d50 2024-05-08T18:51:50.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.441+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.441+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef67f60 con 0x55ec8ef49d50 2024-05-08T18:51:50.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.442+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'221 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.442+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef67f60 con 0x55ec8ef4e740 2024-05-08T18:51:50.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.443+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'63 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.443+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef67f60 con 0x7fdd9c014070 2024-05-08T18:51:50.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.444+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.444+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef67f60 con 0x55ec8ef4e740 2024-05-08T18:51:50.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.445+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'29 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.445+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef67f60 con 0x55ec8ef4e740 2024-05-08T18:51:50.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.446+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'33 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.446+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef67f60 con 0x55ec8ef4e740 2024-05-08T18:51:50.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.447+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.447+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef67f60 con 0x55ec8ef4e740 2024-05-08T18:51:50.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.448+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'47 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.448+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef67f60 con 0x7fdd940a1040 2024-05-08T18:51:50.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.449+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x7fdd940a1040 2024-05-08T18:51:50.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.449+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef67f60 con 0x55ec8ef4e740 2024-05-08T18:51:50.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.450+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.450+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef67f60 con 0x7fdd940a1040 2024-05-08T18:51:50.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.452+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'48 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x7fdd940a1040 2024-05-08T18:51:50.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.452+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef67f60 con 0x55ec8ef4e740 2024-05-08T18:51:50.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.453+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'64 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.453+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef67f60 con 0x7fdd940a1040 2024-05-08T18:51:50.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.454+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'52 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x7fdd940a1040 2024-05-08T18:51:50.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.454+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef67f60 con 0x7fdd9c014070 2024-05-08T18:51:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.455+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.455+0000 7fdc58fe1640 20 reqs_thread_entry: start 2024-05-08T18:51:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.455+0000 7fdda7c0f800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.456+0000 7fdda7c0f800 20 Filter name: none 2024-05-08T18:51:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.456+0000 7fdbd27fc640 20 reqs_thread_entry: start 2024-05-08T18:51:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.456+0000 7fdda7c0f800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-05-08T18:51:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.456+0000 7fdda7c0f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.456+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef92f20 con 0x7fdd9c014070 2024-05-08T18:51:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.456+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 20 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.456+0000 7fdda7c0f800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:51:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.456+0000 7fdda7c0f800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-05-08T18:51:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.456+0000 7fdda7c0f800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T18:51:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.456+0000 7fdda7c0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:51:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.456+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef95850 con 0x55ec8ef49d50 2024-05-08T18:51:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.456+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.456+0000 7fdda7c0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 : miss 2024-05-08T18:51:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.456+0000 7fdda7c0f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.456+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:96 8.18 8:1f32a4ab:root::.bucket.meta.myfoo6%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef95740 con 0x55ec8ef49d50 2024-05-08T18:51:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.457+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(96 .bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv20 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.457+0000 7fdda7c0f800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:51:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.457+0000 7fdda7c0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 info.flags=0x17 2024-05-08T18:51:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.457+0000 7fdda7c0f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 to cache LRU end 2024-05-08T18:51:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.457+0000 7fdda7c0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:51:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.457+0000 7fdda7c0f800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-05-08T18:51:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.457+0000 7fdda7c0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 2024-05-08T18:51:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.457+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:97 4.10 4:089cb5ef:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8f012c70 con 0x55ec8ef4e740 2024-05-08T18:51:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.457+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== osd_op_reply(97 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.457+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:98 4.14 4:290a0c8f:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8f012cf0 con 0x55ec8ef4e740 2024-05-08T18:51:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.457+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 28 ==== osd_op_reply(98 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.457+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:99 4.6 4:63ee3cce:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8f012cf0 con 0x55ec8ef4e740 2024-05-08T18:51:50.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.458+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 29 ==== osd_op_reply(99 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.458+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:100 4.35 4:acfcfe55:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8f012cf0 con 0x55ec8ef49d50 2024-05-08T18:51:50.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.458+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(100 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.458+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:101 4.b 4:d11f7132:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8f012cf0 con 0x7fdd9c014070 2024-05-08T18:51:50.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.458+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 21 ==== osd_op_reply(101 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.458+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:102 4.8 4:1283cf10:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8f012cf0 con 0x55ec8ef4e740 2024-05-08T18:51:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.459+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 30 ==== osd_op_reply(102 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.459+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:103 4.33 4:ccad2c2f:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8f012cf0 con 0x7fdd940a1040 2024-05-08T18:51:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.459+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(103 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd8c02b040 con 0x7fdd940a1040 2024-05-08T18:51:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.459+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:104 4.39 4:9d016cb3:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8f012c90 con 0x55ec8ef4e740 2024-05-08T18:51:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.459+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 31 ==== osd_op_reply(104 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.460+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:105 4.1d 4:bb67ae50:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8f012c90 con 0x55ec8ef4e740 2024-05-08T18:51:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.460+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 32 ==== osd_op_reply(105 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd9c05e040 con 0x55ec8ef4e740 2024-05-08T18:51:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.460+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:106 4.31 4:8d378f2a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8f012c90 con 0x55ec8ef49d50 2024-05-08T18:51:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.460+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(106 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.9 [call out=289b] v0'0 uv11 ondisk = 0) ==== 194+0+289 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.460+0000 7fdda7c0f800 10 cls_bucket_list_unordered: got thirteen 2024-05-08T18:51:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.460+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:107 4.2a 4:54f62651:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8f012c90 con 0x55ec8ef49d50 2024-05-08T18:51:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.461+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 32 ==== osd_op_reply(107 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.10 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.461+0000 7fdda7c0f800 20 get_obj_state: octx=0x7fdd8c00f590 obj=myfoo6:thirteen state=0x55ec8f010cf8 s->prefetch_data=0 2024-05-08T18:51:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.461+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:108 3.20 3:06d5260b:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8f011b20 con 0x7fdd9c014070 2024-05-08T18:51:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.461+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 22 ==== osd_op_reply(108 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9_thirteen [getxattrs out=820b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+836 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.461+0000 7fdda7c0f800 10 manifest: total_size = 8 2024-05-08T18:51:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.461+0000 7fdda7c0f800 20 get_obj_state: setting s->obj_tag to _JaSzj_KCtQXMqfHiFQkpG4hqPWnOcro 2024-05-08T18:51:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.461+0000 7fdda7c0f800 20 get_obj_state: octx=0x7fdd8c00f590 obj=myfoo6:thirteen state=0x55ec8f010cf8 s->prefetch_data=0 2024-05-08T18:51:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.461+0000 7fdda7c0f800 20 prepare_atomic_modification: state is not atomic. state=0x55ec8f010cf8 2024-05-08T18:51:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.461+0000 7fdda7c0f800 20 bucket index object: :.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.9 2024-05-08T18:51:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.461+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:109 4.31 4:8d378f2a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8f0123b0 con 0x55ec8ef49d50 2024-05-08T18:51:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.462+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 33 ==== osd_op_reply(109 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.9 [stat,call,call] v27'13 uv13 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fdd8c02b040 con 0x55ec8ef49d50 2024-05-08T18:51:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.462+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:110 3.20 3:06d5260b:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8f0123b0 con 0x7fdd9c014070 2024-05-08T18:51:50.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.464+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 23 ==== osd_op_reply(110 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9_thirteen [call] v27'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.464+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:111 4.31 4:8d378f2a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef99e40 con 0x55ec8ef49d50 2024-05-08T18:51:50.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.464+0000 7fdda7c0f800 20 list_objects_ordered: starting attempt 1 2024-05-08T18:51:50.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.464+0000 7fdda7c0f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-08T18:51:50.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.464+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:112 4.10 4:089cb5ef:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef99e40 con 0x55ec8ef4e740 2024-05-08T18:51:50.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.464+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:113 4.14 4:290a0c8f:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9e100 con 0x55ec8ef4e740 2024-05-08T18:51:50.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.464+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:114 4.6 4:63ee3cce:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8efa0a00 con 0x55ec8ef4e740 2024-05-08T18:51:50.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.464+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:115 4.35 4:acfcfe55:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8efa3340 con 0x55ec8ef49d50 2024-05-08T18:51:50.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.464+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:116 4.b 4:d11f7132:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8efa0a00 con 0x7fdd9c014070 2024-05-08T18:51:50.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.464+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 33 ==== osd_op_reply(112 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd9c07d040 con 0x55ec8ef4e740 2024-05-08T18:51:50.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.464+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:117 4.8 4:1283cf10:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8efa8190 con 0x55ec8ef4e740 2024-05-08T18:51:50.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.464+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 34 ==== osd_op_reply(115 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd8c04a040 con 0x55ec8ef49d50 2024-05-08T18:51:50.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.464+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 34 ==== osd_op_reply(113 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd9c07d040 con 0x55ec8ef4e740 2024-05-08T18:51:50.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.464+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 35 ==== osd_op_reply(114 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd9c07d040 con 0x55ec8ef4e740 2024-05-08T18:51:50.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.464+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:118 4.33 4:ccad2c2f:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9f9c0 con 0x7fdd940a1040 2024-05-08T18:51:50.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.464+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 24 ==== osd_op_reply(116 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.465+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:119 4.39 4:9d016cb3:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9bd80 con 0x55ec8ef4e740 2024-05-08T18:51:50.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.465+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:120 4.1d 4:bb67ae50:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9d880 con 0x55ec8ef4e740 2024-05-08T18:51:50.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.465+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:121 4.31 4:8d378f2a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8efa4350 con 0x55ec8ef49d50 2024-05-08T18:51:50.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.465+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:122 4.2a 4:54f62651:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8efa4350 con 0x55ec8ef49d50 2024-05-08T18:51:50.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.465+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 36 ==== osd_op_reply(117 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd9c07d040 con 0x55ec8ef4e740 2024-05-08T18:51:50.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.465+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 37 ==== osd_op_reply(119 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd9c07d040 con 0x55ec8ef4e740 2024-05-08T18:51:50.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.465+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(118 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd8c04a040 con 0x7fdd940a1040 2024-05-08T18:51:50.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.465+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 35 ==== osd_op_reply(122 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.10 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdd8c04a040 con 0x55ec8ef49d50 2024-05-08T18:51:50.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.465+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 38 ==== osd_op_reply(120 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd9c07d040 con 0x55ec8ef4e740 2024-05-08T18:51:50.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.465+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 36 ==== osd_op_reply(111 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.9 [stat,call,call] v27'14 uv14 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fdd8c04a040 con 0x55ec8ef49d50 2024-05-08T18:51:50.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.465+0000 7fdc867fc640 20 handle_completion(): completion ok for obj=thirteen 2024-05-08T18:51:50.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.465+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 37 ==== osd_op_reply(121 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.9 [call out=124b] v0'0 uv14 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fdd8c04a040 con 0x55ec8ef49d50 2024-05-08T18:51:50.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdda7c0f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-08T18:51:50.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdda7c0f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-08T18:51:50.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdda7c0f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-08T18:51:50.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdda7c0f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-08T18:51:50.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdda7c0f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9])"; uploads.size()=0; is_truncated=0 2024-05-08T18:51:50.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:123 4.10 4:089cb5ef:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8efa43b0 con 0x55ec8ef4e740 2024-05-08T18:51:50.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:124 4.14 4:290a0c8f:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8efa5780 con 0x55ec8ef4e740 2024-05-08T18:51:50.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:125 4.6 4:63ee3cce:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9d3d0 con 0x55ec8ef4e740 2024-05-08T18:51:50.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:126 4.35 4:acfcfe55:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9d840 con 0x55ec8ef49d50 2024-05-08T18:51:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:127 4.b 4:d11f7132:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8efa43b0 con 0x7fdd9c014070 2024-05-08T18:51:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:128 4.8 4:1283cf10:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8efa5780 con 0x55ec8ef4e740 2024-05-08T18:51:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:129 4.33 4:ccad2c2f:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9d3d0 con 0x7fdd940a1040 2024-05-08T18:51:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:130 4.39 4:9d016cb3:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8efab630 con 0x55ec8ef4e740 2024-05-08T18:51:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:131 4.1d 4:bb67ae50:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8efae020 con 0x55ec8ef4e740 2024-05-08T18:51:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:132 4.31 4:8d378f2a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8efb0c00 con 0x55ec8ef49d50 2024-05-08T18:51:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:133 4.2a 4:54f62651:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8efb3840 con 0x55ec8ef49d50 2024-05-08T18:51:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 38 ==== osd_op_reply(126 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd8c04a040 con 0x55ec8ef49d50 2024-05-08T18:51:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 25 ==== osd_op_reply(127 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 39 ==== osd_op_reply(123 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd9c07d040 con 0x55ec8ef4e740 2024-05-08T18:51:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 40 ==== osd_op_reply(128 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd9c07d040 con 0x55ec8ef4e740 2024-05-08T18:51:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 41 ==== osd_op_reply(124 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd9c07d040 con 0x55ec8ef4e740 2024-05-08T18:51:50.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 42 ==== osd_op_reply(125 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd9c07d040 con 0x55ec8ef4e740 2024-05-08T18:51:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 39 ==== osd_op_reply(132 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.9 [call out=124b] v0'0 uv14 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fdd8c04a040 con 0x55ec8ef49d50 2024-05-08T18:51:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 43 ==== osd_op_reply(130 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd9c07d040 con 0x55ec8ef4e740 2024-05-08T18:51:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.466+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 40 ==== osd_op_reply(133 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.10 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fdd8c04a040 con 0x55ec8ef49d50 2024-05-08T18:51:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.467+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 44 ==== osd_op_reply(131 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd9c07d040 con 0x55ec8ef4e740 2024-05-08T18:51:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.467+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(129 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fdd8c04a040 con 0x7fdd940a1040 2024-05-08T18:51:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.467+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9d840 con 0x55ec8ef49d50 2024-05-08T18:51:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.468+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 41 ==== osd_op_reply(134 bud.buckets [call] v27'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdd8c04a040 con 0x55ec8ef49d50 2024-05-08T18:51:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.468+0000 7fdda7c0f800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-05-08T18:51:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.468+0000 7fdda7c0f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.468+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9d840 con 0x55ec8ef49d50 2024-05-08T18:51:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.468+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 42 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv19 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7fdd8c04a040 con 0x55ec8ef49d50 2024-05-08T18:51:50.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.468+0000 7fdda7c0f800 20 rados_obj.operate() r=0 bl.length=166 2024-05-08T18:51:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.468+0000 7fdda7c0f800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-05-08T18:51:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.468+0000 7fdda7c0f800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-05-08T18:51:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.468+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9d820 con 0x55ec8ef49d50 2024-05-08T18:51:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.469+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 43 ==== osd_op_reply(136 myfoo6 [call,call,delete] v27'21 uv21 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fdd8c04a040 con 0x55ec8ef49d50 2024-05-08T18:51:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.469+0000 7fdda7c0f800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-05-08T18:51:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.469+0000 7fdda7c0f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-05-08T18:51:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.469+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94474499381280 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9d2a0 con 0x7fdd9c014070 2024-05-08T18:51:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.469+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 26 ==== watch-notify(notify (1) cookie 94474499093088 notify 115964117033 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55ec8ef67ba0 con 0x7fdd9c014070 2024-05-08T18:51:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.469+0000 7fdc867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117033 cookie 94474499093088 notifier 4746 bl.length()=150 2024-05-08T18:51:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.469+0000 7fdc867fc640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fdbd80032c0 con 0x7fdd9c014070 2024-05-08T18:51:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.469+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 27 ==== osd_op_reply(137 notify.3 [notify cookie 94474499381280 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.470+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 28 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.470+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 29 ==== watch-notify(notify_complete (2) cookie 94474499381280 notify 115964117033 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ec8ef5dc30 con 0x7fdd9c014070 2024-05-08T18:51:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.470+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:139 8.18 8:1f32a4ab:root::.bucket.meta.myfoo6%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9d820 con 0x55ec8ef49d50 2024-05-08T18:51:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.471+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 44 ==== osd_op_reply(139 .bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 [call,call,delete] v27'22 uv22 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7fdd8c04a040 con 0x55ec8ef49d50 2024-05-08T18:51:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.471+0000 7fdda7c0f800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 from cache 2024-05-08T18:51:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.471+0000 7fdda7c0f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9, ofs0, ns] 2024-05-08T18:51:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.471+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:140 7.e 7:7759931f:::notify.3:head [notify cookie 94474499859152 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9d820 con 0x7fdd9c014070 2024-05-08T18:51:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.471+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 30 ==== watch-notify(notify (1) cookie 94474499093088 notify 115964117034 ret 0) ==== 249+0+0 (crc 0 0 0) 0x55ec8ef5dc30 con 0x7fdd9c014070 2024-05-08T18:51:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.471+0000 7fdc86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117034 cookie 94474499093088 notifier 4746 bl.length()=207 2024-05-08T18:51:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.471+0000 7fdc86ffd640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:141 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fdc68003d60 con 0x7fdd9c014070 2024-05-08T18:51:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.471+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 31 ==== osd_op_reply(140 notify.3 [notify cookie 94474499859152 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.472+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 32 ==== watch-notify(notify_complete (2) cookie 94474499859152 notify 115964117034 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ec8ef11880 con 0x7fdd9c014070 2024-05-08T18:51:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.472+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 33 ==== osd_op_reply(141 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.472+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:142 4.10 4:089cb5ef:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9d820 con 0x55ec8ef4e740 2024-05-08T18:51:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.472+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:143 4.14 4:290a0c8f:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9d2a0 con 0x55ec8ef4e740 2024-05-08T18:51:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.472+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:144 4.6 4:63ee3cce:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8efb0b20 con 0x55ec8ef4e740 2024-05-08T18:51:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.472+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:145 4.35 4:acfcfe55:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9c630 con 0x55ec8ef49d50 2024-05-08T18:51:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.472+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:146 4.b 4:d11f7132:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef93a80 con 0x7fdd9c014070 2024-05-08T18:51:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.472+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:147 4.8 4:1283cf10:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9d820 con 0x55ec8ef4e740 2024-05-08T18:51:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.472+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:148 4.33 4:ccad2c2f:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8efb0b20 con 0x7fdd940a1040 2024-05-08T18:51:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.472+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:149 4.39 4:9d016cb3:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9c630 con 0x55ec8ef4e740 2024-05-08T18:51:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.472+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:150 4.1d 4:bb67ae50:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8efb0b20 con 0x55ec8ef4e740 2024-05-08T18:51:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.472+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:151 4.31 4:8d378f2a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9d820 con 0x55ec8ef49d50 2024-05-08T18:51:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.472+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:152 4.2a 4:54f62651:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef93a80 con 0x55ec8ef49d50 2024-05-08T18:51:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.473+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 34 ==== osd_op_reply(146 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.4 [delete] v27'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.473+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 45 ==== osd_op_reply(145 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.3 [delete] v27'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdd8c04a040 con 0x55ec8ef49d50 2024-05-08T18:51:50.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.474+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 45 ==== osd_op_reply(143 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.1 [delete] v27'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdd9c07d040 con 0x55ec8ef4e740 2024-05-08T18:51:50.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.474+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 46 ==== osd_op_reply(144 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.2 [delete] v27'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdd9c07d040 con 0x55ec8ef4e740 2024-05-08T18:51:50.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.474+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 46 ==== osd_op_reply(151 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.9 [delete] v27'15 uv15 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdd8c04a040 con 0x55ec8ef49d50 2024-05-08T18:51:50.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.474+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 47 ==== osd_op_reply(142 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.0 [delete] v27'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdd9c07d040 con 0x55ec8ef4e740 2024-05-08T18:51:50.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.474+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(148 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.6 [delete] v27'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdd8c04a040 con 0x7fdd940a1040 2024-05-08T18:51:50.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.474+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 48 ==== osd_op_reply(149 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.7 [delete] v27'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdd9c07d040 con 0x55ec8ef4e740 2024-05-08T18:51:50.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.474+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 47 ==== osd_op_reply(152 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.10 [delete] v27'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fdd8c04a040 con 0x55ec8ef49d50 2024-05-08T18:51:50.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.474+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 49 ==== osd_op_reply(150 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.8 [delete] v27'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdd9c07d040 con 0x55ec8ef4e740 2024-05-08T18:51:50.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.474+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 50 ==== osd_op_reply(147 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9.5 [delete] v27'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdd9c07d040 con 0x55ec8ef4e740 2024-05-08T18:51:50.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.474+0000 7fdda7c0f800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 : miss 2024-05-08T18:51:50.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.474+0000 7fdda7c0f800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.474+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:153 6.10 6:0c4d5541:::pubsub..bucket.myfoo6%2fbda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9d820 con 0x7fdd940a1040 2024-05-08T18:51:50.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.475+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(153 pubsub..bucket.myfoo6/bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fdd8c04a040 con 0x7fdd940a1040 2024-05-08T18:51:50.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.475+0000 7fdda7c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.475+0000 7fdda7c0f800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 info.flags=0x0 2024-05-08T18:51:50.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.475+0000 7fdda7c0f800 10 adding default.rgw.log++pubsub..bucket.myfoo6/bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 to cache LRU end 2024-05-08T18:51:50.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.475+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:154 6.10 6:0c4d5541:::pubsub..bucket.myfoo6%2fbda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8efb0b20 con 0x7fdd940a1040 2024-05-08T18:51:50.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.476+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== osd_op_reply(154 pubsub..bucket.myfoo6/bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.9 [delete] v27'6 uv5 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fdd8c04a040 con 0x7fdd940a1040 2024-05-08T18:51:50.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.476+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9c630 con 0x55ec8ef49d50 2024-05-08T18:51:50.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.477+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 48 ==== osd_op_reply(155 bud.buckets [call] v27'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdd8c04a040 con 0x55ec8ef49d50 2024-05-08T18:51:50.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.477+0000 7fdda7c0f800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-05-08T18:51:50.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.477+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9d7b0 con 0x55ec8ef49d50 2024-05-08T18:51:50.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.478+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 49 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v27'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fdd8c04a040 con 0x55ec8ef49d50 2024-05-08T18:51:50.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.478+0000 7fdda7c0f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-05-08T18:51:50.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.478+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94474499381168 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9d2a0 con 0x7fdd940a1040 2024-05-08T18:51:50.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.478+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 28 ==== watch-notify(notify (1) cookie 94474499099248 notify 115964117015 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55ec8ef94c90 con 0x7fdd940a1040 2024-05-08T18:51:50.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.478+0000 7fdc867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117015 cookie 94474499099248 notifier 4746 bl.length()=170 2024-05-08T18:51:50.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.478+0000 7fdc867fc640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fdbd80032c0 con 0x7fdd940a1040 2024-05-08T18:51:50.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.478+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 29 ==== osd_op_reply(157 notify.5 [notify cookie 94474499381168 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdd8c04a040 con 0x7fdd940a1040 2024-05-08T18:51:50.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.478+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 30 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8c04a040 con 0x7fdd940a1040 2024-05-08T18:51:50.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.479+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 31 ==== watch-notify(notify_complete (2) cookie 94474499381168 notify 115964117015 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ec8ef5da60 con 0x7fdd940a1040 2024-05-08T18:51:50.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.479+0000 7fdda7c0f800 10 removing email index: 2024-05-08T18:51:50.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.479+0000 7fdda7c0f800 10 removing user buckets index 2024-05-08T18:51:50.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.479+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9d7b0 con 0x55ec8ef49d50 2024-05-08T18:51:50.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.480+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 50 ==== osd_op_reply(159 bud.buckets [delete] v27'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdd8c04a040 con 0x55ec8ef49d50 2024-05-08T18:51:50.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.480+0000 7fdda7c0f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-05-08T18:51:50.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.480+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94474499381168 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9d2a0 con 0x7fdd940a1040 2024-05-08T18:51:50.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.480+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 32 ==== watch-notify(notify (1) cookie 94474499101376 notify 115964117016 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55ec8ef5da60 con 0x7fdd940a1040 2024-05-08T18:51:50.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.480+0000 7fdc86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117016 cookie 94474499101376 notifier 4746 bl.length()=160 2024-05-08T18:51:50.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.480+0000 7fdc86ffd640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fdc68003d60 con 0x7fdd940a1040 2024-05-08T18:51:50.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.480+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 33 ==== osd_op_reply(160 notify.6 [notify cookie 94474499381168 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdd8c04a040 con 0x7fdd940a1040 2024-05-08T18:51:50.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.480+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 34 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8c04a040 con 0x7fdd940a1040 2024-05-08T18:51:50.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.481+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 35 ==== watch-notify(notify_complete (2) cookie 94474499381168 notify 115964117016 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ec8ef5de40 con 0x7fdd940a1040 2024-05-08T18:51:50.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.481+0000 7fdda7c0f800 10 removing user index: bud 2024-05-08T18:51:50.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.481+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9d7b0 con 0x7fdd9c014070 2024-05-08T18:51:50.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.481+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 35 ==== osd_op_reply(162 bud [call,call,delete] v27'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.481+0000 7fdda7c0f800 10 removing default.rgw.meta+users.uid+bud from cache 2024-05-08T18:51:50.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.481+0000 7fdda7c0f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-05-08T18:51:50.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.481+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94474499381168 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef9d2a0 con 0x7fdd940a1040 2024-05-08T18:51:50.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.482+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 36 ==== watch-notify(notify (1) cookie 94474499099248 notify 115964117017 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55ec8ef5de40 con 0x7fdd940a1040 2024-05-08T18:51:50.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.482+0000 7fdc867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117017 cookie 94474499099248 notifier 4746 bl.length()=152 2024-05-08T18:51:50.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.482+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 37 ==== osd_op_reply(163 notify.5 [notify cookie 94474499381168 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdd8c04a040 con 0x7fdd940a1040 2024-05-08T18:51:50.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.482+0000 7fdc867fc640 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fdbd80032c0 con 0x7fdd940a1040 2024-05-08T18:51:50.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.482+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 38 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8c04a040 con 0x7fdd940a1040 2024-05-08T18:51:50.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.482+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 39 ==== watch-notify(notify_complete (2) cookie 94474499381168 notify 115964117017 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ec8ef5d270 con 0x7fdd940a1040 2024-05-08T18:51:50.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.483+0000 7fdc59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:50.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.483+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94474499103936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef635f0 con 0x55ec8ef49d50 2024-05-08T18:51:50.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.484+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 51 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94474499103936] v27'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd8c04a040 con 0x55ec8ef49d50 2024-05-08T18:51:50.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.484+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94474499083008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef635f0 con 0x7fdd9c014070 2024-05-08T18:51:50.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.485+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 36 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94474499083008] v27'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.485+0000 7fdda7c0f800 20 remove_watcher() i=0 2024-05-08T18:51:50.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.485+0000 7fdda7c0f800 2 removed watcher, disabling cache 2024-05-08T18:51:50.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.485+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94474499085888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef635f0 con 0x55ec8ef49d50 2024-05-08T18:51:50.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.486+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 52 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94474499085888] v27'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8c04a040 con 0x55ec8ef49d50 2024-05-08T18:51:50.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.486+0000 7fdda7c0f800 20 remove_watcher() i=1 2024-05-08T18:51:50.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.486+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94474499090736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef635f0 con 0x55ec8ef4e740 2024-05-08T18:51:50.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.487+0000 7fdda39d6640 1 -- 172.21.15.132:0/1916704030 <== osd.3 v2:172.21.15.132:6816/17827703 51 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94474499090736] v27'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd9c07d040 con 0x55ec8ef4e740 2024-05-08T18:51:50.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.487+0000 7fdda7c0f800 20 remove_watcher() i=2 2024-05-08T18:51:50.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.487+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94474499093088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef635f0 con 0x7fdd9c014070 2024-05-08T18:51:50.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.488+0000 7fdda31d5640 1 -- 172.21.15.132:0/1916704030 <== osd.2 v2:172.21.15.132:6808/1108348591 37 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94474499093088] v27'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd94075030 con 0x7fdd9c014070 2024-05-08T18:51:50.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.488+0000 7fdda7c0f800 20 remove_watcher() i=3 2024-05-08T18:51:50.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.488+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94474499097120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef635f0 con 0x55ec8ef49d50 2024-05-08T18:51:50.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.489+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.1 v2:172.21.15.132:6800/3697320277 53 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94474499097120] v27'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8c04a040 con 0x55ec8ef49d50 2024-05-08T18:51:50.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.489+0000 7fdda7c0f800 20 remove_watcher() i=4 2024-05-08T18:51:50.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.489+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94474499099248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef635f0 con 0x7fdd940a1040 2024-05-08T18:51:50.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.491+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 40 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94474499099248] v27'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8c04a040 con 0x7fdd940a1040 2024-05-08T18:51:50.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.491+0000 7fdda7c0f800 20 remove_watcher() i=5 2024-05-08T18:51:50.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.491+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94474499101376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef635f0 con 0x7fdd940a1040 2024-05-08T18:51:50.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.492+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 41 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94474499101376] v27'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8c04a040 con 0x7fdd940a1040 2024-05-08T18:51:50.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.492+0000 7fdda7c0f800 20 remove_watcher() i=6 2024-05-08T18:51:50.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.492+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94474499106448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec8ef635f0 con 0x7fdd940a1040 2024-05-08T18:51:50.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.493+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 <== osd.0 v2:172.21.15.42:6800/1521799280 42 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94474499106448] v27'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8c04a040 con 0x7fdd940a1040 2024-05-08T18:51:50.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.493+0000 7fdda7c0f800 20 remove_watcher() i=7 2024-05-08T18:51:50.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.493+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fdd940a1040 msgr2=0x7fdd9405c910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.493+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fdd940a1040 0x7fdd9405c910 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.493+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ec8ef49d50 msgr2=0x55ec8ef4c210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.493+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ec8ef49d50 0x55ec8ef4c210 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.493+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fdd9c014070 msgr2=0x7fdd9c002560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.493+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fdd9c014070 0x7fdd9c002560 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.493+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ec8ef4e740 msgr2=0x55ec8ef50b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.493+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ec8ef4e740 0x55ec8ef50b30 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.493+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc6c03bb50 msgr2=0x7fdc6c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.493+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc6c03bb50 0x7fdc6c03e010 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdd94052fd0 tx=0x7fdd9407f000 comp rx=0 tx=0).stop 2024-05-08T18:51:50.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.493+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ef36b00 msgr2=0x55ec8ef3e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.493+0000 7fdd9a9d4640 1 -- 172.21.15.132:0/1916704030 reap_dead start 2024-05-08T18:51:50.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.493+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ef36b00 0x55ec8ef3e0f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c051040 tx=0x7fdd9c052cf0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.493+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 shutdown_connections 2024-05-08T18:51:50.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.493+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/1916704030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ef36b00 0x55ec8ef3e0f0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.493+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 >> 172.21.15.132:0/1916704030 conn(0x55ec8ef32eb0 msgr2=0x55ec8ef38370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.493+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 shutdown_connections 2024-05-08T18:51:50.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.493+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1916704030 wait complete. 2024-05-08T18:51:50.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 -- 172.21.15.132:0/188552285 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc7c03bb50 msgr2=0x7fdc7c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/188552285 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc7c03bb50 0x7fdc7c03e010 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55ec8ef15fe0 tx=0x7fdd94066750 comp rx=0 tx=0).stop 2024-05-08T18:51:50.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 -- 172.21.15.132:0/188552285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ef298b0 msgr2=0x55ec8ef29cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/188552285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ef298b0 0x55ec8ef29cd0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x55ec8ef15f40 tx=0x7fdd9c018830 comp rx=0 tx=0).stop 2024-05-08T18:51:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 -- 172.21.15.132:0/188552285 shutdown_connections 2024-05-08T18:51:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/188552285 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc7c03bb50 0x7fdc7c03e010 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/188552285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ef298b0 0x55ec8ef29cd0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 -- 172.21.15.132:0/188552285 >> 172.21.15.132:0/188552285 conn(0x55ec8ef1d950 msgr2=0x55ec8ef1dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 -- 172.21.15.132:0/188552285 shutdown_connections 2024-05-08T18:51:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 -- 172.21.15.132:0/188552285 wait complete. 2024-05-08T18:51:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1330741051 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ec8ee14530 msgr2=0x55ec8ef15640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/1330741051 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ec8ee14530 0x55ec8ef15640 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1330741051 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ec8ef17e90 msgr2=0x55ec8ef1a280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/1330741051 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ec8ef17e90 0x55ec8ef1a280 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1330741051 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc8803bb50 msgr2=0x7fdc8803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/1330741051 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc8803bb50 0x7fdc8803e010 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c000f60 tx=0x7fdd8c001370 comp rx=0 tx=0).stop 2024-05-08T18:51:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1330741051 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ee11540 msgr2=0x55ec8ef0e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/1330741051 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ee11540 0x55ec8ef0e400 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400a520 tx=0x7fdd94003020 comp rx=0 tx=0).stop 2024-05-08T18:51:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1330741051 shutdown_connections 2024-05-08T18:51:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/1330741051 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55ec8ef17e90 0x55ec8ef1a280 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/1330741051 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55ec8ee14530 0x55ec8ef15640 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/1330741051 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc8803bb50 0x7fdc8803e010 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 --2- 172.21.15.132:0/1330741051 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ec8ee11540 0x55ec8ef0e400 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1330741051 >> 172.21.15.132:0/1330741051 conn(0x55ec8ee0ceb0 msgr2=0x55ec8ee12c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1330741051 shutdown_connections 2024-05-08T18:51:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.494+0000 7fdda7c0f800 1 -- 172.21.15.132:0/1330741051 wait complete. 2024-05-08T18:51:50.502 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-05-08T18:51:50.502 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-05-08T18:51:50.503 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-05-08T18:51:50.548 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:51:50.548 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:51:50.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.549+0000 7f21f3c62800 1 Processor -- start 2024-05-08T18:51:50.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.549+0000 7f21f3c62800 1 -- start start 2024-05-08T18:51:50.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.549+0000 7f21f3c62800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x56403a52ca30 0x56403a52ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.549+0000 7f21f3c62800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56403a52f360 con 0x56403a5267e0 2024-05-08T18:51:50.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.549+0000 7f21f3c62800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x56403a3c6e20 con 0x56403a52ca30 2024-05-08T18:51:50.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.550+0000 7f21ebfff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x56403a52ca30 0x56403a52ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.550+0000 7f21f175a640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x56403a5267e0 0x56403a526c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:52720/0 (socket says 172.21.15.132:52720) 2024-05-08T18:51:50.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.550+0000 7f21f175a640 1 -- 172.21.15.132:0/3964169066 learned_addr learned my addr 172.21.15.132:0/3964169066 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:51:50.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.550+0000 7f21ebfff640 1 -- 172.21.15.132:0/3964169066 >> v1:172.21.15.42:6789/0 conn(0x56403a5267e0 legacy=0x56403a526c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.550+0000 7f21ebfff640 1 -- 172.21.15.132:0/3964169066 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403a530540 con 0x56403a52ca30 2024-05-08T18:51:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.552+0000 7f21ebfff640 1 --2- 172.21.15.132:0/3964169066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a52ca30 0x56403a52ee20 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00a470 tx=0x7f21dc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7520b67e98d93c74 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.552+0000 7f21f0f59640 1 -- 172.21.15.132:0/3964169066 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21dc057070 con 0x56403a52ca30 2024-05-08T18:51:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.552+0000 7f21f0f59640 1 -- 172.21.15.132:0/3964169066 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21dc052570 con 0x56403a52ca30 2024-05-08T18:51:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.552+0000 7f21f0f59640 1 -- 172.21.15.132:0/3964169066 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21dc052870 con 0x56403a52ca30 2024-05-08T18:51:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.553+0000 7f21f3c62800 1 -- 172.21.15.132:0/3964169066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a52ca30 msgr2=0x56403a52ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.553+0000 7f21f3c62800 1 --2- 172.21.15.132:0/3964169066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a52ca30 0x56403a52ee20 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00a470 tx=0x7f21dc01ce90 comp rx=0 tx=0).stop 2024-05-08T18:51:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.553+0000 7f21f3c62800 1 -- 172.21.15.132:0/3964169066 shutdown_connections 2024-05-08T18:51:50.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.553+0000 7f21f3c62800 1 --2- 172.21.15.132:0/3964169066 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a52ca30 0x56403a52ee20 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.553+0000 7f21f3c62800 1 -- 172.21.15.132:0/3964169066 >> 172.21.15.132:0/3964169066 conn(0x56403a51feb0 msgr2=0x56403a5222d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.553+0000 7f21f3c62800 1 -- 172.21.15.132:0/3964169066 shutdown_connections 2024-05-08T18:51:50.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.553+0000 7f21f3c62800 1 -- 172.21.15.132:0/3964169066 wait complete. 2024-05-08T18:51:50.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.566+0000 7f21f3c62800 1 Processor -- start 2024-05-08T18:51:50.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.567+0000 7f21f3c62800 1 -- start start 2024-05-08T18:51:50.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.567+0000 7f21f3c62800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a5267e0 0x56403a619810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.567+0000 7f21f3c62800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56403a4715c0 con 0x56403a5267e0 2024-05-08T18:51:50.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.567+0000 7f21f175a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a5267e0 0x56403a619810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.567+0000 7f21f175a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a5267e0 0x56403a619810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:34040/0 (socket says 172.21.15.132:34040) 2024-05-08T18:51:50.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.567+0000 7f21f175a640 1 -- 172.21.15.132:0/425692374 learned_addr learned my addr 172.21.15.132:0/425692374 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:50.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.567+0000 7f21f175a640 1 -- 172.21.15.132:0/425692374 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403a619de0 con 0x56403a5267e0 2024-05-08T18:51:50.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.568+0000 7f21f175a640 1 --2- 172.21.15.132:0/425692374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a5267e0 0x56403a619810 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f21e4001e10 tx=0x7f21e400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab74f0a266f37389 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.568+0000 7f20df606640 1 -- 172.21.15.132:0/425692374 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21e4012020 con 0x56403a5267e0 2024-05-08T18:51:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.568+0000 7f20df606640 1 -- 172.21.15.132:0/425692374 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21e400e5a0 con 0x56403a5267e0 2024-05-08T18:51:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.568+0000 7f20df606640 1 -- 172.21.15.132:0/425692374 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21e400e8e0 con 0x56403a5267e0 2024-05-08T18:51:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.568+0000 7f21f3c62800 1 -- 172.21.15.132:0/425692374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a5267e0 msgr2=0x56403a619810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.568+0000 7f21f3c62800 1 --2- 172.21.15.132:0/425692374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a5267e0 0x56403a619810 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f21e4001e10 tx=0x7f21e400b780 comp rx=0 tx=0).stop 2024-05-08T18:51:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.568+0000 7f21f3c62800 1 -- 172.21.15.132:0/425692374 shutdown_connections 2024-05-08T18:51:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.568+0000 7f21f3c62800 1 --2- 172.21.15.132:0/425692374 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a5267e0 0x56403a619810 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.568+0000 7f21f3c62800 1 -- 172.21.15.132:0/425692374 >> 172.21.15.132:0/425692374 conn(0x56403a51feb0 msgr2=0x56403a615130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.568+0000 7f21f3c62800 1 -- 172.21.15.132:0/425692374 shutdown_connections 2024-05-08T18:51:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.569+0000 7f21f3c62800 1 -- 172.21.15.132:0/425692374 wait complete. 2024-05-08T18:51:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.569+0000 7f21f3c62800 1 Processor -- start 2024-05-08T18:51:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.569+0000 7f21f3c62800 1 -- start start 2024-05-08T18:51:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.569+0000 7f21f3c62800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a5267e0 0x56403a621320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.569+0000 7f21f3c62800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56403a52f830 con 0x56403a5267e0 2024-05-08T18:51:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.569+0000 7f21f175a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a5267e0 0x56403a621320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.569+0000 7f21f175a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a5267e0 0x56403a621320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:34044/0 (socket says 172.21.15.132:34044) 2024-05-08T18:51:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.569+0000 7f21f175a640 1 -- 172.21.15.132:0/1838644069 learned_addr learned my addr 172.21.15.132:0/1838644069 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.570+0000 7f21f175a640 1 -- 172.21.15.132:0/1838644069 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403a621860 con 0x56403a5267e0 2024-05-08T18:51:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.570+0000 7f21f175a640 1 --2- 172.21.15.132:0/1838644069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a5267e0 0x56403a621320 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f21e4004170 tx=0x7f21e4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.570+0000 7f20dde03640 1 -- 172.21.15.132:0/1838644069 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21e4012030 con 0x56403a5267e0 2024-05-08T18:51:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.570+0000 7f20dde03640 1 -- 172.21.15.132:0/1838644069 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21e4001470 con 0x56403a5267e0 2024-05-08T18:51:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.570+0000 7f21f3c62800 1 -- 172.21.15.132:0/1838644069 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56403a621af0 con 0x56403a5267e0 2024-05-08T18:51:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.570+0000 7f20dde03640 1 -- 172.21.15.132:0/1838644069 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21e401a8d0 con 0x56403a5267e0 2024-05-08T18:51:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.570+0000 7f21f3c62800 1 -- 172.21.15.132:0/1838644069 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56403a6247a0 con 0x56403a5267e0 2024-05-08T18:51:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.571+0000 7f20dde03640 1 -- 172.21.15.132:0/1838644069 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f21e4015020 con 0x56403a5267e0 2024-05-08T18:51:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.571+0000 7f20dde03640 1 --2- 172.21.15.132:0/1838644069 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f20d803bb50 0x7f20d803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.571+0000 7f20dde03640 1 -- 172.21.15.132:0/1838644069 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f21e4020030 con 0x56403a5267e0 2024-05-08T18:51:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.571+0000 7f21ebfff640 1 --2- 172.21.15.132:0/1838644069 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f20d803bb50 0x7f20d803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.571+0000 7f21f3c62800 1 --2- 172.21.15.132:0/1838644069 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56403a52ca30 0x56403a628560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.571+0000 7f21f3c62800 1 -- 172.21.15.132:0/1838644069 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a628aa0 con 0x56403a52ca30 2024-05-08T18:51:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.571+0000 7f21f1f5b640 1 --2- 172.21.15.132:0/1838644069 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56403a52ca30 0x56403a628560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.572+0000 7f21ebfff640 1 --2- 172.21.15.132:0/1838644069 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f20d803bb50 0x7f20d803e010 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00a470 tx=0x7f21dc04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.572+0000 7f21f1f5b640 1 --2- 172.21.15.132:0/1838644069 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56403a52ca30 0x56403a628560 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.572+0000 7f21f1f5b640 1 -- 172.21.15.132:0/1838644069 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21ec00a4a0 con 0x56403a52ca30 2024-05-08T18:51:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.572+0000 7f21f3c62800 1 -- 172.21.15.132:0/1838644069 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a625b10 con 0x56403a52ca30 2024-05-08T18:51:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.572+0000 7f21f1f5b640 1 -- 172.21.15.132:0/1838644069 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f21ec00a4a0 con 0x56403a52ca30 2024-05-08T18:51:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.572+0000 7f21f3c62800 1 --2- 172.21.15.132:0/1838644069 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56403a62ad40 0x56403a62d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.572+0000 7f21f3c62800 1 -- 172.21.15.132:0/1838644069 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a62d820 con 0x56403a62ad40 2024-05-08T18:51:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.572+0000 7f21f175a640 1 --2- 172.21.15.132:0/1838644069 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56403a62ad40 0x56403a62d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.573+0000 7f21f175a640 1 --2- 172.21.15.132:0/1838644069 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56403a62ad40 0x56403a62d130 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.573+0000 7f21f175a640 1 -- 172.21.15.132:0/1838644069 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f21e4018430 con 0x56403a62ad40 2024-05-08T18:51:50.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.573+0000 7f21f3c62800 1 -- 172.21.15.132:0/1838644069 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a629be0 con 0x56403a52ca30 2024-05-08T18:51:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.573+0000 7f21f1f5b640 1 -- 172.21.15.132:0/1838644069 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f21ec00a4a0 con 0x56403a52ca30 2024-05-08T18:51:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.573+0000 7f21f3c62800 1 -- 172.21.15.132:0/1838644069 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a62a0c0 con 0x56403a52ca30 2024-05-08T18:51:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.573+0000 7f21f1f5b640 1 -- 172.21.15.132:0/1838644069 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f21ec00a4a0 con 0x56403a52ca30 2024-05-08T18:51:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.574+0000 7f21f3c62800 1 Processor -- start 2024-05-08T18:51:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.574+0000 7f21f3c62800 1 -- start start 2024-05-08T18:51:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.574+0000 7f21f3c62800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a63c760 0x56403a63cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.574+0000 7f21f3c62800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56403a417fc0 con 0x56403a63c760 2024-05-08T18:51:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.574+0000 7f21f1f5b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a63c760 0x56403a63cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.574+0000 7f21f1f5b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a63c760 0x56403a63cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:34054/0 (socket says 172.21.15.132:34054) 2024-05-08T18:51:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.574+0000 7f21f1f5b640 1 -- 172.21.15.132:0/1390541328 learned_addr learned my addr 172.21.15.132:0/1390541328 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.574+0000 7f21f1f5b640 1 -- 172.21.15.132:0/1390541328 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403a63d0c0 con 0x56403a63c760 2024-05-08T18:51:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.575+0000 7f21f1f5b640 1 --2- 172.21.15.132:0/1390541328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a63c760 0x56403a63cb80 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x56403a6223b0 tx=0x7f21ec018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.575+0000 7f20d6ffd640 1 -- 172.21.15.132:0/1390541328 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21ec014450 con 0x56403a63c760 2024-05-08T18:51:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.575+0000 7f20d6ffd640 1 -- 172.21.15.132:0/1390541328 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ec014610 con 0x56403a63c760 2024-05-08T18:51:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.575+0000 7f21f3c62800 1 -- 172.21.15.132:0/1390541328 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56403a63db30 con 0x56403a63c760 2024-05-08T18:51:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.575+0000 7f20d6ffd640 1 -- 172.21.15.132:0/1390541328 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21ec014930 con 0x56403a63c760 2024-05-08T18:51:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.575+0000 7f21f3c62800 1 -- 172.21.15.132:0/1390541328 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56403a63e030 con 0x56403a63c760 2024-05-08T18:51:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.576+0000 7f20d6ffd640 1 -- 172.21.15.132:0/1390541328 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f21ec011040 con 0x56403a63c760 2024-05-08T18:51:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.576+0000 7f20d6ffd640 1 --2- 172.21.15.132:0/1390541328 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f20c803bb50 0x7f20c803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.576+0000 7f20d6ffd640 1 -- 172.21.15.132:0/1390541328 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f21ec01e070 con 0x56403a63c760 2024-05-08T18:51:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.576+0000 7f21f175a640 1 --2- 172.21.15.132:0/1390541328 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f20c803bb50 0x7f20c803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.576+0000 7f21f3c62800 1 Processor -- start 2024-05-08T18:51:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.576+0000 7f21f3c62800 1 -- start start 2024-05-08T18:51:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.576+0000 7f21f175a640 1 --2- 172.21.15.132:0/1390541328 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f20c803bb50 0x7f20c803e010 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x56403a628eb0 tx=0x7f21e403f040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.576+0000 7f21f3c62800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a649ab0 0x56403a649ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.576+0000 7f21f3c62800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56403a61a160 con 0x56403a649ab0 2024-05-08T18:51:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.577+0000 7f21f1f5b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a649ab0 0x56403a649ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.577+0000 7f21f1f5b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a649ab0 0x56403a649ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:34060/0 (socket says 172.21.15.132:34060) 2024-05-08T18:51:50.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.577+0000 7f21f1f5b640 1 -- 172.21.15.132:0/4221028276 learned_addr learned my addr 172.21.15.132:0/4221028276 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:50.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.577+0000 7f21f1f5b640 1 -- 172.21.15.132:0/4221028276 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403a64a4a0 con 0x56403a649ab0 2024-05-08T18:51:50.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.577+0000 7f21f1f5b640 1 --2- 172.21.15.132:0/4221028276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a649ab0 0x56403a649ed0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f21ec052cd0 tx=0x7f21ec001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6531079dd7137c11 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.577+0000 7f20d4ff9640 1 -- 172.21.15.132:0/4221028276 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21ec028030 con 0x56403a649ab0 2024-05-08T18:51:50.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.578+0000 7f20d4ff9640 1 -- 172.21.15.132:0/4221028276 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ec011330 con 0x56403a649ab0 2024-05-08T18:51:50.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.578+0000 7f20d4ff9640 1 -- 172.21.15.132:0/4221028276 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21ec014ad0 con 0x56403a649ab0 2024-05-08T18:51:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.578+0000 7f21f3c62800 1 -- 172.21.15.132:0/4221028276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a649ab0 msgr2=0x56403a649ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.578+0000 7f21f3c62800 1 --2- 172.21.15.132:0/4221028276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a649ab0 0x56403a649ed0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f21ec052cd0 tx=0x7f21ec001670 comp rx=0 tx=0).stop 2024-05-08T18:51:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.578+0000 7f21f3c62800 1 -- 172.21.15.132:0/4221028276 shutdown_connections 2024-05-08T18:51:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.578+0000 7f21f3c62800 1 --2- 172.21.15.132:0/4221028276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a649ab0 0x56403a649ed0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.578+0000 7f21f3c62800 1 -- 172.21.15.132:0/4221028276 >> 172.21.15.132:0/4221028276 conn(0x56403a645dc0 msgr2=0x56403a643e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.578+0000 7f21f3c62800 1 -- 172.21.15.132:0/4221028276 shutdown_connections 2024-05-08T18:51:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.578+0000 7f21f3c62800 1 -- 172.21.15.132:0/4221028276 wait complete. 2024-05-08T18:51:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.578+0000 7f21f3c62800 1 Processor -- start 2024-05-08T18:51:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.578+0000 7f21f3c62800 1 -- start start 2024-05-08T18:51:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.579+0000 7f21f3c62800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a649ab0 0x56403a650fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.579+0000 7f21f3c62800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56403a64abf0 con 0x56403a649ab0 2024-05-08T18:51:50.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.579+0000 7f21f1f5b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a649ab0 0x56403a650fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.579+0000 7f21f1f5b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a649ab0 0x56403a650fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:34066/0 (socket says 172.21.15.132:34066) 2024-05-08T18:51:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.579+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 learned_addr learned my addr 172.21.15.132:0/3132973245 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:51:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.579+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403a651520 con 0x56403a649ab0 2024-05-08T18:51:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.579+0000 7f21f1f5b640 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a649ab0 0x56403a650fe0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f21ec001700 tx=0x7f21ec052c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.579+0000 7f20c6ffd640 1 -- 172.21.15.132:0/3132973245 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21ec001980 con 0x56403a649ab0 2024-05-08T18:51:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.579+0000 7f20c6ffd640 1 -- 172.21.15.132:0/3132973245 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ec032070 con 0x56403a649ab0 2024-05-08T18:51:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.579+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56403a6517b0 con 0x56403a649ab0 2024-05-08T18:51:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.579+0000 7f20c6ffd640 1 -- 172.21.15.132:0/3132973245 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21ec001c70 con 0x56403a649ab0 2024-05-08T18:51:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.579+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56403a654460 con 0x56403a649ab0 2024-05-08T18:51:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.580+0000 7f20c6ffd640 1 -- 172.21.15.132:0/3132973245 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f21ec02b570 con 0x56403a649ab0 2024-05-08T18:51:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.580+0000 7f20c6ffd640 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f20bc03bb50 0x7f20bc03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.580+0000 7f20c6ffd640 1 -- 172.21.15.132:0/3132973245 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f21ec04a040 con 0x56403a649ab0 2024-05-08T18:51:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.580+0000 7f21f175a640 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f20bc03bb50 0x7f20bc03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.581+0000 7f21f175a640 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f20bc03bb50 0x7f20bc03e010 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f21e400e550 tx=0x7f21e4045070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.581+0000 7f21f3c62800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.581+0000 7f21f3c62800 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56403a65cc70 0x56403a65f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.581+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a65f880 con 0x56403a65cc70 2024-05-08T18:51:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.581+0000 7f21ebfff640 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56403a65cc70 0x56403a65f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.581+0000 7f21ebfff640 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56403a65cc70 0x56403a65f130 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.582+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21dc05a040 con 0x56403a65cc70 2024-05-08T18:51:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.582+0000 7f21f3c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.582+0000 7f21f3c62800 20 realm 2024-05-08T18:51:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.582+0000 7f21f3c62800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.582+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a65fc50 con 0x56403a65cc70 2024-05-08T18:51:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.582+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21dc05a040 con 0x56403a65cc70 2024-05-08T18:51:50.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.582+0000 7f21f3c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.582+0000 7f21f3c62800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:51:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.582+0000 7f21f3c62800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.582+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a660520 con 0x56403a65cc70 2024-05-08T18:51:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.582+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21dc05a040 con 0x56403a65cc70 2024-05-08T18:51:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.582+0000 7f21f3c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.582+0000 7f21f3c62800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.582+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6608c0 con 0x56403a65cc70 2024-05-08T18:51:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.582+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f21dc05a040 con 0x56403a65cc70 2024-05-08T18:51:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.582+0000 7f21f3c62800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.582+0000 7f21f3c62800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.582+0000 7f21f3c62800 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56403a661620 0x56403a663a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.582+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a664020 con 0x56403a661620 2024-05-08T18:51:50.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.583+0000 7f21f1f5b640 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56403a661620 0x56403a663a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.583+0000 7f21f1f5b640 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56403a661620 0x56403a663a10 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.583+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f21ec02a070 con 0x56403a661620 2024-05-08T18:51:50.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.583+0000 7f21f3c62800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:51:50.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.583+0000 7f21f3c62800 20 searching for the correct realm 2024-05-08T18:51:50.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.583+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x56403a661620 2024-05-08T18:51:50.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.584+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21ec02a070 con 0x56403a661620 2024-05-08T18:51:50.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.584+0000 7f21f1f5b640 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f21ec014070 0x7f21ec02b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.584+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x7f21ec014070 2024-05-08T18:51:50.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.584+0000 7f21f175a640 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f21ec014070 0x7f21ec02b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.584+0000 7f21f175a640 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f21ec014070 0x7f21ec02b860 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.584+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.584+0000 7f21f175a640 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f21e4017050 0x7f21e403d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:51:50.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.584+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x7f21e4017050 2024-05-08T18:51:50.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.585+0000 7f21ebfff640 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f21e4017050 0x7f21e403d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:51:50.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.585+0000 7f21ebfff640 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f21e4017050 0x7f21e403d850 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:51:50.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.585+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21dc05a040 con 0x7f21e4017050 2024-05-08T18:51:50.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.585+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x56403a65cc70 2024-05-08T18:51:50.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.585+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21dc05a040 con 0x56403a65cc70 2024-05-08T18:51:50.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.585+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x56403a65cc70 2024-05-08T18:51:50.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.586+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21dc05a040 con 0x56403a65cc70 2024-05-08T18:51:50.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.586+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x7f21e4017050 2024-05-08T18:51:50.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.586+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21dc05a040 con 0x7f21e4017050 2024-05-08T18:51:50.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.586+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x7f21e4017050 2024-05-08T18:51:50.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.586+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21dc05a040 con 0x7f21e4017050 2024-05-08T18:51:50.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.586+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x7f21ec014070 2024-05-08T18:51:50.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.586+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.586+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x56403a661620 2024-05-08T18:51:50.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.587+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21ec02a070 con 0x56403a661620 2024-05-08T18:51:50.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.587+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x56403a65cc70 2024-05-08T18:51:50.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.587+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21dc05a040 con 0x56403a65cc70 2024-05-08T18:51:50.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.587+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x7f21e4017050 2024-05-08T18:51:50.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.587+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21dc05a040 con 0x7f21e4017050 2024-05-08T18:51:50.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.587+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x56403a65cc70 2024-05-08T18:51:50.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.587+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f21dc05a040 con 0x56403a65cc70 2024-05-08T18:51:50.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.587+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x7f21ec014070 2024-05-08T18:51:50.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.588+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.588+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x56403a661620 2024-05-08T18:51:50.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.588+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f21ec02a070 con 0x56403a661620 2024-05-08T18:51:50.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.588+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x56403a661620 2024-05-08T18:51:50.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.588+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21ec02a070 con 0x56403a661620 2024-05-08T18:51:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.588+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x7f21e4017050 2024-05-08T18:51:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.588+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21dc05a040 con 0x7f21e4017050 2024-05-08T18:51:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.588+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x56403a661620 2024-05-08T18:51:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.589+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21ec02a070 con 0x56403a661620 2024-05-08T18:51:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.589+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x56403a661620 2024-05-08T18:51:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.589+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21ec02a070 con 0x56403a661620 2024-05-08T18:51:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.589+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x56403a65cc70 2024-05-08T18:51:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.589+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21dc05a040 con 0x56403a65cc70 2024-05-08T18:51:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.589+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x56403a65cc70 2024-05-08T18:51:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.589+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f21dc05a040 con 0x56403a65cc70 2024-05-08T18:51:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.589+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x7f21e4017050 2024-05-08T18:51:50.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.590+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21dc07d040 con 0x7f21e4017050 2024-05-08T18:51:50.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.590+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x56403a661620 2024-05-08T18:51:50.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.590+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.590+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x7f21ec014070 2024-05-08T18:51:50.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.590+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.590+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x56403a65cc70 2024-05-08T18:51:50.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.590+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21dc07d040 con 0x56403a65cc70 2024-05-08T18:51:50.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.590+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x7f21ec014070 2024-05-08T18:51:50.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.591+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.591+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x56403a661620 2024-05-08T18:51:50.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.591+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.591+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x7f21e4017050 2024-05-08T18:51:50.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.591+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21dc07d040 con 0x7f21e4017050 2024-05-08T18:51:50.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.591+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x7f21ec014070 2024-05-08T18:51:50.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.592+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.592+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x56403a661620 2024-05-08T18:51:50.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.592+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.592+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x7f21e4017050 2024-05-08T18:51:50.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.592+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21dc07d040 con 0x7f21e4017050 2024-05-08T18:51:50.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.592+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x56403a65cc70 2024-05-08T18:51:50.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.592+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f21dc07d040 con 0x56403a65cc70 2024-05-08T18:51:50.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.592+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56403a665970 con 0x7f21ec014070 2024-05-08T18:51:50.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:51:50.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:51:50.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:51:50.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:51:50.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:51:50.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:51:50.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a664a10 con 0x56403a65cc70 2024-05-08T18:51:50.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x56403a65cc70 2024-05-08T18:51:50.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6652b0 con 0x56403a65cc70 2024-05-08T18:51:50.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f21dc07d040 con 0x56403a65cc70 2024-05-08T18:51:50.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:51:50.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a665df0 con 0x56403a65cc70 2024-05-08T18:51:50.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f21dc07d040 con 0x56403a65cc70 2024-05-08T18:51:50.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:51:50.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 20 zone default found 2024-05-08T18:51:50.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 4 Realm: () 2024-05-08T18:51:50.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:51:50.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:51:50.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:51:50.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 20 zonegroup default 2024-05-08T18:51:50.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.593+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a666200 con 0x7f21ec014070 2024-05-08T18:51:50.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.594+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.594+0000 7f21f3c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.594+0000 7f21f3c62800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.594+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6684d0 con 0x56403a661620 2024-05-08T18:51:50.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.594+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.594+0000 7f21f3c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.594+0000 7f21f3c62800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.594+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a668870 con 0x56403a661620 2024-05-08T18:51:50.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.594+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.594+0000 7f21f3c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.594+0000 7f21f3c62800 20 started sync module instance, tier type = 2024-05-08T18:51:50.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.594+0000 7f21f3c62800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:51:50.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.594+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a667960 con 0x7f21ec014070 2024-05-08T18:51:50.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.595+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.595+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94833857691008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6690c0 con 0x7f21ec014070 2024-05-08T18:51:50.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.595+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a669910 con 0x56403a65cc70 2024-05-08T18:51:50.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.596+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94833857691008] v27'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.597+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x56403a65cc70 2024-05-08T18:51:50.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.597+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94833857694736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a669950 con 0x56403a65cc70 2024-05-08T18:51:50.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.597+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a66a440 con 0x56403a661620 2024-05-08T18:51:50.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.598+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94833857694736] v27'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x56403a65cc70 2024-05-08T18:51:50.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.598+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.598+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94833857699600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a66a400 con 0x56403a661620 2024-05-08T18:51:50.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.598+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a66af70 con 0x7f21ec014070 2024-05-08T18:51:50.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.599+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.599+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94833857702528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a66b810 con 0x7f21ec014070 2024-05-08T18:51:50.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.599+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a66c2d0 con 0x56403a65cc70 2024-05-08T18:51:50.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.599+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94833857699600] v27'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.600+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x56403a65cc70 2024-05-08T18:51:50.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.600+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94833857702528] v27'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.600+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94833857707424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a66c6c0 con 0x56403a65cc70 2024-05-08T18:51:50.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.600+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a66cbd0 con 0x7f21e4017050 2024-05-08T18:51:50.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.601+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94833857707424] v27'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x56403a65cc70 2024-05-08T18:51:50.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.601+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x7f21e4017050 2024-05-08T18:51:50.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.601+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94833857704800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a66cbd0 con 0x7f21e4017050 2024-05-08T18:51:50.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.601+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a66cbd0 con 0x7f21e4017050 2024-05-08T18:51:50.615 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.602+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94833857704800] v27'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x7f21e4017050 2024-05-08T18:51:50.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.602+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x7f21e4017050 2024-05-08T18:51:50.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.602+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94833857696864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a66d610 con 0x7f21e4017050 2024-05-08T18:51:50.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.602+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a66dfd0 con 0x7f21e4017050 2024-05-08T18:51:50.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.603+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94833857696864] v27'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x7f21e4017050 2024-05-08T18:51:50.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.603+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x7f21e4017050 2024-05-08T18:51:50.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.603+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94833857712960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a66dfd0 con 0x7f21e4017050 2024-05-08T18:51:50.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.603+0000 7f21f3c62800 20 add_watcher() i=0 2024-05-08T18:51:50.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.603+0000 7f21f3c62800 20 add_watcher() i=1 2024-05-08T18:51:50.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.603+0000 7f21f3c62800 20 add_watcher() i=2 2024-05-08T18:51:50.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.603+0000 7f21f3c62800 20 add_watcher() i=3 2024-05-08T18:51:50.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.603+0000 7f21f3c62800 20 add_watcher() i=4 2024-05-08T18:51:50.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.603+0000 7f21f3c62800 20 add_watcher() i=5 2024-05-08T18:51:50.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.603+0000 7f21f3c62800 20 add_watcher() i=6 2024-05-08T18:51:50.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.604+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94833857712960] v27'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x7f21e4017050 2024-05-08T18:51:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.604+0000 7f21f3c62800 20 add_watcher() i=7 2024-05-08T18:51:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.604+0000 7f21f3c62800 2 all 8 watchers are set, enabling cache 2024-05-08T18:51:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.604+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6713d0 con 0x56403a65cc70 2024-05-08T18:51:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.605+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f21dc07d040 con 0x56403a65cc70 2024-05-08T18:51:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.605+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94833857715440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a66e8f0 con 0x56403a65cc70 2024-05-08T18:51:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.606+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94833857715440] v27'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x56403a65cc70 2024-05-08T18:51:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.606+0000 7f20a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.606+0000 7f21f3c62800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:51:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.606+0000 7f21f3c62800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:51:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.606+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a671080 con 0x56403a65cc70 2024-05-08T18:51:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.607+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x56403a65cc70 2024-05-08T18:51:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.607+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67a420 con 0x7f21e4017050 2024-05-08T18:51:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.608+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x7f21e4017050 2024-05-08T18:51:50.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.608+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67a420 con 0x56403a661620 2024-05-08T18:51:50.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.609+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.610+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67a8d0 con 0x56403a65cc70 2024-05-08T18:51:50.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.611+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'224 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x56403a65cc70 2024-05-08T18:51:50.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.611+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67ae40 con 0x7f21ec014070 2024-05-08T18:51:50.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.612+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'71 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.612+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b220 con 0x56403a661620 2024-05-08T18:51:50.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.612+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'48 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.613+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b350 con 0x56403a65cc70 2024-05-08T18:51:50.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.614+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x56403a65cc70 2024-05-08T18:51:50.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.614+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b350 con 0x7f21e4017050 2024-05-08T18:51:50.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.615+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'49 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x7f21e4017050 2024-05-08T18:51:50.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.615+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b350 con 0x7f21ec014070 2024-05-08T18:51:50.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.616+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.616+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b7b0 con 0x56403a661620 2024-05-08T18:51:50.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.617+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.617+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b7b0 con 0x7f21ec014070 2024-05-08T18:51:50.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.618+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'72 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.618+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b7b0 con 0x7f21e4017050 2024-05-08T18:51:50.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.619+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x7f21e4017050 2024-05-08T18:51:50.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.619+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b7b0 con 0x7f21ec014070 2024-05-08T18:51:50.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.620+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.620+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b7b0 con 0x7f21e4017050 2024-05-08T18:51:50.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.621+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'53 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x7f21e4017050 2024-05-08T18:51:50.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.621+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b7b0 con 0x56403a65cc70 2024-05-08T18:51:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.622+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'225 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x56403a65cc70 2024-05-08T18:51:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.622+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b7b0 con 0x56403a661620 2024-05-08T18:51:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.623+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'65 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.623+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b840 con 0x7f21ec014070 2024-05-08T18:51:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.624+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'73 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.624+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b840 con 0x56403a661620 2024-05-08T18:51:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.625+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.625+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67bc40 con 0x56403a65cc70 2024-05-08T18:51:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.627+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x56403a65cc70 2024-05-08T18:51:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.627+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67bc40 con 0x56403a65cc70 2024-05-08T18:51:50.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.628+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'226 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x56403a65cc70 2024-05-08T18:51:50.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.628+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67bc40 con 0x56403a661620 2024-05-08T18:51:50.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.629+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'66 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.629+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b3a0 con 0x7f21ec014070 2024-05-08T18:51:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.630+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.630+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b3a0 con 0x56403a661620 2024-05-08T18:51:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.631+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.631+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b3a0 con 0x56403a661620 2024-05-08T18:51:50.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.631+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'34 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.631+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b3a0 con 0x56403a661620 2024-05-08T18:51:50.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.632+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.632+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b3a0 con 0x56403a661620 2024-05-08T18:51:50.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.633+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'49 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.633+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b3a0 con 0x7f21e4017050 2024-05-08T18:51:50.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.635+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x7f21e4017050 2024-05-08T18:51:50.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.635+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b3a0 con 0x56403a661620 2024-05-08T18:51:50.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.636+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.636+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b3a0 con 0x7f21e4017050 2024-05-08T18:51:50.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.637+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'50 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x7f21e4017050 2024-05-08T18:51:50.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.637+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b3a0 con 0x56403a661620 2024-05-08T18:51:50.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.638+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'67 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.638+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b3a0 con 0x7f21e4017050 2024-05-08T18:51:50.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.640+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'54 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21dc07d040 con 0x7f21e4017050 2024-05-08T18:51:50.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.640+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a67b3a0 con 0x7f21ec014070 2024-05-08T18:51:50.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.641+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.641+0000 7f20a67e4640 20 reqs_thread_entry: start 2024-05-08T18:51:50.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.641+0000 7f21f3c62800 20 init_complete bucket index max shards: 11 2024-05-08T18:51:50.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.641+0000 7f21f3c62800 20 Filter name: none 2024-05-08T18:51:50.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.641+0000 7f2017fff640 20 reqs_thread_entry: start 2024-05-08T18:51:50.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.641+0000 7f21f3c62800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:51:50.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.641+0000 7f21f3c62800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.641+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6a68d0 con 0x7f21e4017050 2024-05-08T18:51:50.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.642+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f21dc07d040 con 0x7f21e4017050 2024-05-08T18:51:50.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.642+0000 7f21f3c62800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:51:50.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.642+0000 7f21f3c62800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-08T18:51:50.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.642+0000 7f21f3c62800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:51:50.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.642+0000 7f21f3c62800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:51:50.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.642+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6a91c0 con 0x7f21e4017050 2024-05-08T18:51:50.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.643+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f21dc07d040 con 0x7f21e4017050 2024-05-08T18:51:50.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.643+0000 7f21f3c62800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10 : miss 2024-05-08T18:51:50.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.643+0000 7f21f3c62800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.643+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:96 8.3 8:c0098a2f:root::.bucket.meta.myfoo7%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6a9070 con 0x56403a65cc70 2024-05-08T18:51:50.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.643+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(96 .bucket.meta.myfoo7:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7f21dc07d040 con 0x56403a65cc70 2024-05-08T18:51:50.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.643+0000 7f21f3c62800 20 rados_obj.operate() r=0 bl.length=382 2024-05-08T18:51:50.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.643+0000 7f21f3c62800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10 info.flags=0x17 2024-05-08T18:51:50.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.643+0000 7f21f3c62800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10 to cache LRU end 2024-05-08T18:51:50.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.643+0000 7f21f3c62800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:51:50.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.643+0000 7f21f3c62800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:51:50.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.643+0000 7f21f3c62800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10 2024-05-08T18:51:50.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.643+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:97 4.23 4:c55bde04:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a726580 con 0x7f21e4017050 2024-05-08T18:51:50.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.644+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(97 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21dc07d040 con 0x7f21e4017050 2024-05-08T18:51:50.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.644+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:98 4.e 4:708a5689:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a726580 con 0x7f21ec014070 2024-05-08T18:51:50.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.644+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 20 ==== osd_op_reply(98 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.644+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:99 4.1e 4:7944f5c9:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a726580 con 0x7f21e4017050 2024-05-08T18:51:50.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.644+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(99 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.2 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21dc07d040 con 0x7f21e4017050 2024-05-08T18:51:50.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.644+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:100 4.31 4:8e7cea8a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a726580 con 0x56403a65cc70 2024-05-08T18:51:50.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.645+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(100 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.3 [call out=85b] v0'0 uv12 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21dc07d040 con 0x56403a65cc70 2024-05-08T18:51:50.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.645+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:101 4.2f 4:f712c7e2:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a7265e0 con 0x56403a65cc70 2024-05-08T18:51:50.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.645+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(101 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21dc08f060 con 0x56403a65cc70 2024-05-08T18:51:50.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.645+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:102 4.10 4:0aa2b2f9:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a726620 con 0x56403a661620 2024-05-08T18:51:50.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.645+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== osd_op_reply(102 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.5 [call out=377b] v0'0 uv6 ondisk = 0) ==== 195+0+377 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.645+0000 7f21f3c62800 10 cls_bucket_list_unordered: got fourteen 2024-05-08T18:51:50.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.645+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:103 4.33 4:ced89ddb:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a726660 con 0x7f21e4017050 2024-05-08T18:51:50.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.646+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(103 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.6 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21dc08f060 con 0x7f21e4017050 2024-05-08T18:51:50.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.646+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:104 4.1d 4:b990892f:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a726660 con 0x56403a661620 2024-05-08T18:51:50.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.646+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 28 ==== osd_op_reply(104 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.646+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:105 4.8 4:11b8fe21:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a726660 con 0x56403a661620 2024-05-08T18:51:50.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.646+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 29 ==== osd_op_reply(105 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.646+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:106 4.0 4:008e536a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a726660 con 0x7f21ec014070 2024-05-08T18:51:50.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.647+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 21 ==== osd_op_reply(106 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.9 [call out=85b] v0'0 uv19 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.647+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:107 4.3c 4:3ce5e2cb:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a726660 con 0x56403a65cc70 2024-05-08T18:51:50.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.647+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(107 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f21dc08f060 con 0x56403a65cc70 2024-05-08T18:51:50.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.647+0000 7f21f3c62800 20 get_obj_state: octx=0x56403a649e90 obj=myfoo7:fourteen state=0x56403a724628 s->prefetch_data=0 2024-05-08T18:51:50.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.647+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:108 3.3 3:c2d89e9c:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a725450 con 0x7f21ec014070 2024-05-08T18:51:50.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.647+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 22 ==== osd_op_reply(108 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10_fourteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+872 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.647+0000 7f21f3c62800 10 manifest: total_size = 8 2024-05-08T18:51:50.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.647+0000 7f21f3c62800 20 get_obj_state: setting s->obj_tag to bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7873132280156201190 2024-05-08T18:51:50.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.647+0000 7f21f3c62800 20 get_obj_state: octx=0x56403a649e90 obj=myfoo7:fourteen state=0x56403a724628 s->prefetch_data=0 2024-05-08T18:51:50.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.647+0000 7f21f3c62800 20 prepare_atomic_modification: state is not atomic. state=0x56403a724628 2024-05-08T18:51:50.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.647+0000 7f21f3c62800 20 bucket index object: :.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.5 2024-05-08T18:51:50.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.647+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:109 4.10 4:0aa2b2f9:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a725d10 con 0x56403a661620 2024-05-08T18:51:50.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.648+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 30 ==== osd_op_reply(109 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.5 [stat,call,call] v27'8 uv8 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.649+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:110 3.3 3:c2d89e9c:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a725d10 con 0x7f21ec014070 2024-05-08T18:51:50.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.650+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 23 ==== osd_op_reply(110 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10_fourteen [call] v27'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.650+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:111 4.10 4:0aa2b2f9:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a725c60 con 0x56403a661620 2024-05-08T18:51:50.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.650+0000 7f21f3c62800 20 list_objects_ordered: starting attempt 1 2024-05-08T18:51:50.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.650+0000 7f21f3c62800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-08T18:51:50.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.650+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:112 4.23 4:c55bde04:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a725c60 con 0x7f21e4017050 2024-05-08T18:51:50.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.650+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:113 4.e 4:708a5689:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b1aa0 con 0x7f21ec014070 2024-05-08T18:51:50.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.650+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:114 4.1e 4:7944f5c9:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b43e0 con 0x7f21e4017050 2024-05-08T18:51:50.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.650+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:115 4.31 4:8e7cea8a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a725c60 con 0x56403a65cc70 2024-05-08T18:51:50.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.650+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:116 4.2f 4:f712c7e2:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b43e0 con 0x56403a65cc70 2024-05-08T18:51:50.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.650+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:117 4.10 4:0aa2b2f9:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6bb8d0 con 0x56403a661620 2024-05-08T18:51:50.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.650+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:118 4.33 4:ced89ddb:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6be1a0 con 0x7f21e4017050 2024-05-08T18:51:50.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.650+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:119 4.1d 4:b990892f:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6c0cd0 con 0x56403a661620 2024-05-08T18:51:50.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.650+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:120 4.8 4:11b8fe21:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6c3b30 con 0x56403a661620 2024-05-08T18:51:50.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.650+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:121 4.0 4:008e536a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6c69b0 con 0x7f21ec014070 2024-05-08T18:51:50.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.650+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:122 4.3c 4:3ce5e2cb:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6c9360 con 0x56403a65cc70 2024-05-08T18:51:50.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.650+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== osd_op_reply(114 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.2 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21dc08f060 con 0x7f21e4017050 2024-05-08T18:51:50.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.650+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 28 ==== osd_op_reply(112 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21dc08f060 con 0x7f21e4017050 2024-05-08T18:51:50.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.650+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 24 ==== osd_op_reply(113 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.650+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 32 ==== osd_op_reply(115 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.3 [call out=85b] v0'0 uv12 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21dc08f060 con 0x56403a65cc70 2024-05-08T18:51:50.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.651+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 33 ==== osd_op_reply(116 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21dc08f060 con 0x56403a65cc70 2024-05-08T18:51:50.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.651+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 29 ==== osd_op_reply(118 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.6 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21dc097060 con 0x7f21e4017050 2024-05-08T18:51:50.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.651+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 31 ==== osd_op_reply(120 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.651+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 32 ==== osd_op_reply(119 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.651+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 34 ==== osd_op_reply(122 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f21dc097060 con 0x56403a65cc70 2024-05-08T18:51:50.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.651+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 25 ==== osd_op_reply(121 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.9 [call out=85b] v0'0 uv19 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.651+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 33 ==== osd_op_reply(111 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.5 [stat,call,call] v27'9 uv9 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.651+0000 7f20d4ff9640 20 handle_completion(): completion ok for obj=fourteen 2024-05-08T18:51:50.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.651+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 34 ==== osd_op_reply(117 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.5 [call out=124b] v0'0 uv9 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.651+0000 7f21f3c62800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-08T18:51:50.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.651+0000 7f21f3c62800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-08T18:51:50.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.651+0000 7f21f3c62800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-08T18:51:50.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.651+0000 7f21f3c62800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-08T18:51:50.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.651+0000 7f21f3c62800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10])"; uploads.size()=0; is_truncated=0 2024-05-08T18:51:50.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.651+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:123 4.23 4:c55bde04:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6c34e0 con 0x7f21e4017050 2024-05-08T18:51:50.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.651+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:124 4.e 4:708a5689:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b1f10 con 0x7f21ec014070 2024-05-08T18:51:50.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.651+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:125 4.1e 4:7944f5c9:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6beb20 con 0x7f21e4017050 2024-05-08T18:51:50.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.651+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:126 4.31 4:8e7cea8a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6c03c0 con 0x56403a65cc70 2024-05-08T18:51:50.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.651+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:127 4.2f 4:f712c7e2:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6bb3d0 con 0x56403a65cc70 2024-05-08T18:51:50.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.651+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:128 4.10 4:0aa2b2f9:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b1f10 con 0x56403a661620 2024-05-08T18:51:50.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.651+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:129 4.33 4:ced89ddb:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6beb20 con 0x7f21e4017050 2024-05-08T18:51:50.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.651+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:130 4.1d 4:b990892f:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6c03c0 con 0x56403a661620 2024-05-08T18:51:50.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.652+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:131 4.8 4:11b8fe21:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b1f10 con 0x56403a661620 2024-05-08T18:51:50.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.652+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:132 4.0 4:008e536a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6bb3d0 con 0x7f21ec014070 2024-05-08T18:51:50.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.652+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:133 4.3c 4:3ce5e2cb:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6be180 con 0x56403a65cc70 2024-05-08T18:51:50.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.652+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 30 ==== osd_op_reply(125 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.2 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21dc097060 con 0x7f21e4017050 2024-05-08T18:51:50.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.652+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 26 ==== osd_op_reply(124 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.652+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 31 ==== osd_op_reply(129 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.6 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21dc097060 con 0x7f21e4017050 2024-05-08T18:51:50.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.652+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 35 ==== osd_op_reply(128 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.5 [call out=124b] v0'0 uv9 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.652+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 32 ==== osd_op_reply(123 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21dc097060 con 0x7f21e4017050 2024-05-08T18:51:50.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.652+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 35 ==== osd_op_reply(126 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.3 [call out=85b] v0'0 uv12 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21dc097060 con 0x56403a65cc70 2024-05-08T18:51:50.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.652+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 36 ==== osd_op_reply(130 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.652+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 36 ==== osd_op_reply(133 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f21dc097060 con 0x56403a65cc70 2024-05-08T18:51:50.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.652+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 37 ==== osd_op_reply(127 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21dc097060 con 0x56403a65cc70 2024-05-08T18:51:50.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.652+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 27 ==== osd_op_reply(132 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.9 [call out=85b] v0'0 uv19 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.652+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 37 ==== osd_op_reply(131 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.652+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6c61e0 con 0x7f21e4017050 2024-05-08T18:51:50.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.653+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 33 ==== osd_op_reply(134 fud.buckets [call] v27'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f21dc097060 con 0x7f21e4017050 2024-05-08T18:51:50.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.653+0000 7f21f3c62800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-05-08T18:51:50.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.653+0000 7f21f3c62800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.653+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6c61e0 con 0x7f21ec014070 2024-05-08T18:51:50.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.654+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 28 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.654+0000 7f21f3c62800 20 rados_obj.operate() r=0 bl.length=168 2024-05-08T18:51:50.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.654+0000 7f21f3c62800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-05-08T18:51:50.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.654+0000 7f21f3c62800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-05-08T18:51:50.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.654+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6c61e0 con 0x7f21ec014070 2024-05-08T18:51:50.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.655+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 29 ==== osd_op_reply(136 myfoo7 [call,call,delete] v27'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f21e4018430 con 0x7f21ec014070 2024-05-08T18:51:50.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.655+0000 7f21f3c62800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-05-08T18:51:50.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.655+0000 7f21f3c62800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-05-08T18:51:50.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.655+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94833858045552 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6c68f0 con 0x7f21ec014070 2024-05-08T18:51:50.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.655+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 30 ==== watch-notify(notify (1) cookie 94833857702528 notify 115964117035 ret 0) ==== 192+0+0 (crc 0 0 0) 0x56403a670d00 con 0x7f21ec014070 2024-05-08T18:51:50.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.655+0000 7f20d4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117035 cookie 94833857702528 notifier 4753 bl.length()=150 2024-05-08T18:51:50.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.655+0000 7f20d4ff9640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f20b4003d60 con 0x7f21ec014070 2024-05-08T18:51:50.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.655+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 31 ==== osd_op_reply(137 notify.3 [notify cookie 94833858045552 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f21e4066020 con 0x7f21ec014070 2024-05-08T18:51:50.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.656+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 32 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21e4066020 con 0x7f21ec014070 2024-05-08T18:51:50.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.656+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 33 ==== watch-notify(notify_complete (2) cookie 94833858045552 notify 115964117035 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56403a679410 con 0x7f21ec014070 2024-05-08T18:51:50.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.656+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:139 8.3 8:c0098a2f:root::.bucket.meta.myfoo7%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b1b00 con 0x56403a65cc70 2024-05-08T18:51:50.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.657+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 38 ==== osd_op_reply(139 .bucket.meta.myfoo7:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10 [call,call,delete] v27'3 uv3 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f21dc097060 con 0x56403a65cc70 2024-05-08T18:51:50.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.657+0000 7f21f3c62800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10 from cache 2024-05-08T18:51:50.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.657+0000 7f21f3c62800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10, ofs0, ns] 2024-05-08T18:51:50.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.657+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:140 7.15 7:a93a5511:::notify.2:head [notify cookie 94833858045552 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b1b00 con 0x56403a661620 2024-05-08T18:51:50.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.657+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 38 ==== watch-notify(notify (1) cookie 94833857699600 notify 115964117000 ret 0) ==== 250+0+0 (crc 0 0 0) 0x56403a67abf0 con 0x56403a661620 2024-05-08T18:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.657+0000 7f20c7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117000 cookie 94833857699600 notifier 4753 bl.length()=208 2024-05-08T18:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.657+0000 7f20c7fff640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:141 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f20240032c0 con 0x56403a661620 2024-05-08T18:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.657+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 39 ==== osd_op_reply(140 notify.2 [notify cookie 94833858045552 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.657+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 40 ==== watch-notify(notify_complete (2) cookie 94833858045552 notify 115964117000 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56403a6517b0 con 0x56403a661620 2024-05-08T18:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.657+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 41 ==== osd_op_reply(141 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.657+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:142 4.23 4:c55bde04:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b1b00 con 0x7f21e4017050 2024-05-08T18:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.657+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:143 4.e 4:708a5689:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6c68f0 con 0x7f21ec014070 2024-05-08T18:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.657+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:144 4.1e 4:7944f5c9:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6c33a0 con 0x7f21e4017050 2024-05-08T18:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.657+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:145 4.31 4:8e7cea8a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b1b00 con 0x56403a65cc70 2024-05-08T18:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.658+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:146 4.2f 4:f712c7e2:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6c33a0 con 0x56403a65cc70 2024-05-08T18:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.658+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:147 4.10 4:0aa2b2f9:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6c2cb0 con 0x56403a661620 2024-05-08T18:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.658+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:148 4.33 4:ced89ddb:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b1b00 con 0x7f21e4017050 2024-05-08T18:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.658+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:149 4.1d 4:b990892f:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6c33a0 con 0x56403a661620 2024-05-08T18:51:50.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.658+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:150 4.8 4:11b8fe21:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6a7350 con 0x56403a661620 2024-05-08T18:51:50.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.658+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:151 4.0 4:008e536a:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b1b00 con 0x7f21ec014070 2024-05-08T18:51:50.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.658+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:152 4.3c 4:3ce5e2cb:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b1b00 con 0x56403a65cc70 2024-05-08T18:51:50.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.659+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 42 ==== osd_op_reply(147 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.5 [delete] v27'10 uv10 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.659+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 34 ==== osd_op_reply(148 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.6 [delete] v27'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f21dc097060 con 0x7f21e4017050 2024-05-08T18:51:50.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.659+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 35 ==== osd_op_reply(144 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.2 [delete] v27'3 uv3 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f21dc097060 con 0x7f21e4017050 2024-05-08T18:51:50.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.659+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 34 ==== osd_op_reply(151 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.9 [delete] v27'20 uv20 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f21e4066020 con 0x7f21ec014070 2024-05-08T18:51:50.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.659+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 39 ==== osd_op_reply(152 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.10 [delete] v27'4 uv4 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f21dc097060 con 0x56403a65cc70 2024-05-08T18:51:50.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.659+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 43 ==== osd_op_reply(150 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.8 [delete] v27'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.659+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 40 ==== osd_op_reply(146 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.4 [delete] v27'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f21dc097060 con 0x56403a65cc70 2024-05-08T18:51:50.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.660+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 41 ==== osd_op_reply(145 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.3 [delete] v27'16 uv16 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f21dc097060 con 0x56403a65cc70 2024-05-08T18:51:50.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.660+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 35 ==== osd_op_reply(143 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.1 [delete] v27'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f21e4066020 con 0x7f21ec014070 2024-05-08T18:51:50.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.660+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 36 ==== osd_op_reply(142 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.0 [delete] v27'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f21dc097060 con 0x7f21e4017050 2024-05-08T18:51:50.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.660+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 44 ==== osd_op_reply(149 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10.7 [delete] v27'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.660+0000 7f21f3c62800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10 : miss 2024-05-08T18:51:50.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.660+0000 7f21f3c62800 20 rados->read ofs=0 len=0 2024-05-08T18:51:50.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.660+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:153 6.b 6:d64baad1:::pubsub..bucket.myfoo7%2fbda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b1b00 con 0x56403a661620 2024-05-08T18:51:50.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.660+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 45 ==== osd_op_reply(153 pubsub..bucket.myfoo7/bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.660+0000 7f21f3c62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:51:50.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.660+0000 7f21f3c62800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10 info.flags=0x0 2024-05-08T18:51:50.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.660+0000 7f21f3c62800 10 adding default.rgw.log++pubsub..bucket.myfoo7/bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10 to cache LRU end 2024-05-08T18:51:50.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.660+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:154 6.b 6:d64baad1:::pubsub..bucket.myfoo7%2fbda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b1b00 con 0x56403a661620 2024-05-08T18:51:50.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.661+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 46 ==== osd_op_reply(154 pubsub..bucket.myfoo7/bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.10 [delete] v27'29 uv21 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.661+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b1b00 con 0x7f21e4017050 2024-05-08T18:51:50.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.662+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 37 ==== osd_op_reply(155 fud.buckets [call] v27'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f21dc097060 con 0x7f21e4017050 2024-05-08T18:51:50.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.662+0000 7f21f3c62800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-05-08T18:51:50.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.662+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b1b00 con 0x7f21e4017050 2024-05-08T18:51:50.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.664+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 38 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v27'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f21dc097060 con 0x7f21e4017050 2024-05-08T18:51:50.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.664+0000 7f21f3c62800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:51:50.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.664+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94833858045552 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b1b00 con 0x56403a661620 2024-05-08T18:51:50.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.664+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 47 ==== watch-notify(notify (1) cookie 94833857699600 notify 115964117001 ret 0) ==== 212+0+0 (crc 0 0 0) 0x56403a6517b0 con 0x56403a661620 2024-05-08T18:51:50.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.664+0000 7f20c7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117001 cookie 94833857699600 notifier 4753 bl.length()=170 2024-05-08T18:51:50.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.664+0000 7f20c7fff640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f20240032c0 con 0x56403a661620 2024-05-08T18:51:50.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.664+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 48 ==== osd_op_reply(157 notify.2 [notify cookie 94833858045552 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.664+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 49 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.664+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 50 ==== watch-notify(notify_complete (2) cookie 94833858045552 notify 115964117001 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56403a651520 con 0x56403a661620 2024-05-08T18:51:50.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.664+0000 7f21f3c62800 10 removing email index: 2024-05-08T18:51:50.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.664+0000 7f21f3c62800 10 removing user buckets index 2024-05-08T18:51:50.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.664+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b1b00 con 0x7f21e4017050 2024-05-08T18:51:50.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.665+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 39 ==== osd_op_reply(159 fud.buckets [delete] v27'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f21dc097060 con 0x7f21e4017050 2024-05-08T18:51:50.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.665+0000 7f21f3c62800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-05-08T18:51:50.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.665+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94833858045552 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b1b00 con 0x7f21e4017050 2024-05-08T18:51:50.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.666+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 40 ==== watch-notify(notify (1) cookie 94833857696864 notify 115964117018 ret 0) ==== 202+0+0 (crc 0 0 0) 0x56403a6a85a0 con 0x7f21e4017050 2024-05-08T18:51:50.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.666+0000 7f20d4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117018 cookie 94833857696864 notifier 4753 bl.length()=160 2024-05-08T18:51:50.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.666+0000 7f20d4ff9640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f20b4003d60 con 0x7f21e4017050 2024-05-08T18:51:50.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.666+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 41 ==== osd_op_reply(160 notify.6 [notify cookie 94833858045552 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f21dc097060 con 0x7f21e4017050 2024-05-08T18:51:50.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.666+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 42 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21dc097060 con 0x7f21e4017050 2024-05-08T18:51:50.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.666+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 43 ==== watch-notify(notify_complete (2) cookie 94833858045552 notify 115964117018 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56403a654460 con 0x7f21e4017050 2024-05-08T18:51:50.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.666+0000 7f21f3c62800 10 removing user index: fud 2024-05-08T18:51:50.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.666+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b1b00 con 0x7f21e4017050 2024-05-08T18:51:50.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.667+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 44 ==== osd_op_reply(162 fud [call,call,delete] v27'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f21dc097060 con 0x7f21e4017050 2024-05-08T18:51:50.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.667+0000 7f21f3c62800 10 removing default.rgw.meta+users.uid+fud from cache 2024-05-08T18:51:50.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.667+0000 7f21f3c62800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-08T18:51:50.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.667+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94833858045552 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b1b00 con 0x7f21e4017050 2024-05-08T18:51:50.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.667+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 45 ==== watch-notify(notify (1) cookie 94833857704800 notify 115964117019 ret 0) ==== 194+0+0 (crc 0 0 0) 0x56403a654460 con 0x7f21e4017050 2024-05-08T18:51:50.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.667+0000 7f20c7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117019 cookie 94833857704800 notifier 4753 bl.length()=152 2024-05-08T18:51:50.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.667+0000 7f20c7fff640 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f20240032a0 con 0x7f21e4017050 2024-05-08T18:51:50.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.667+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 46 ==== osd_op_reply(163 notify.5 [notify cookie 94833858045552 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f21dc097060 con 0x7f21e4017050 2024-05-08T18:51:50.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.668+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 47 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21dc097060 con 0x7f21e4017050 2024-05-08T18:51:50.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.668+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 48 ==== watch-notify(notify_complete (2) cookie 94833858045552 notify 115964117019 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56403a6711b0 con 0x7f21e4017050 2024-05-08T18:51:50.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.669+0000 7f20a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:51:50.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.669+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94833857715440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6b1b00 con 0x56403a65cc70 2024-05-08T18:51:50.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.669+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 42 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94833857715440] v27'227 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f21dc097060 con 0x56403a65cc70 2024-05-08T18:51:50.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.669+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94833857691008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6756d0 con 0x7f21ec014070 2024-05-08T18:51:50.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.670+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 36 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94833857691008] v27'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21e4066020 con 0x7f21ec014070 2024-05-08T18:51:50.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.670+0000 7f21f3c62800 20 remove_watcher() i=0 2024-05-08T18:51:50.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.670+0000 7f21f3c62800 2 removed watcher, disabling cache 2024-05-08T18:51:50.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.670+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94833857694736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6756d0 con 0x56403a65cc70 2024-05-08T18:51:50.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.672+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 43 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94833857694736] v27'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21dc097060 con 0x56403a65cc70 2024-05-08T18:51:50.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.672+0000 7f21f3c62800 20 remove_watcher() i=1 2024-05-08T18:51:50.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.672+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94833857699600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6756d0 con 0x56403a661620 2024-05-08T18:51:50.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.673+0000 7f21f1f5b640 1 -- 172.21.15.132:0/3132973245 <== osd.3 v2:172.21.15.132:6816/17827703 51 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94833857699600] v27'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21ec06b040 con 0x56403a661620 2024-05-08T18:51:50.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.673+0000 7f21f3c62800 20 remove_watcher() i=2 2024-05-08T18:51:50.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.673+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94833857702528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6756d0 con 0x7f21ec014070 2024-05-08T18:51:50.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.674+0000 7f21f175a640 1 -- 172.21.15.132:0/3132973245 <== osd.2 v2:172.21.15.132:6808/1108348591 37 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94833857702528] v27'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21e4066020 con 0x7f21ec014070 2024-05-08T18:51:50.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.674+0000 7f21f3c62800 20 remove_watcher() i=3 2024-05-08T18:51:50.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.674+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94833857707424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6756d0 con 0x56403a65cc70 2024-05-08T18:51:50.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.675+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.1 v2:172.21.15.132:6800/3697320277 44 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94833857707424] v27'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21dc097060 con 0x56403a65cc70 2024-05-08T18:51:50.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.675+0000 7f21f3c62800 20 remove_watcher() i=4 2024-05-08T18:51:50.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.675+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94833857704800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6756d0 con 0x7f21e4017050 2024-05-08T18:51:50.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.677+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 49 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94833857704800] v27'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21dc097060 con 0x7f21e4017050 2024-05-08T18:51:50.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.677+0000 7f21f3c62800 20 remove_watcher() i=5 2024-05-08T18:51:50.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.677+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94833857696864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6756d0 con 0x7f21e4017050 2024-05-08T18:51:50.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.678+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 50 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94833857696864] v27'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21dc097060 con 0x7f21e4017050 2024-05-08T18:51:50.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.678+0000 7f21f3c62800 20 remove_watcher() i=6 2024-05-08T18:51:50.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.678+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94833857712960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56403a6756d0 con 0x7f21e4017050 2024-05-08T18:51:50.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 <== osd.0 v2:172.21.15.42:6800/1521799280 51 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94833857712960] v27'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21dc097060 con 0x7f21e4017050 2024-05-08T18:51:50.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 20 remove_watcher() i=7 2024-05-08T18:51:50.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f21e4017050 msgr2=0x7f21e403d850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f21e4017050 0x7f21e403d850 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56403a65cc70 msgr2=0x56403a65f130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56403a65cc70 0x56403a65f130 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f21ec014070 msgr2=0x7f21ec02b860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f21ec014070 0x7f21ec02b860 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56403a661620 msgr2=0x56403a663a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56403a661620 0x56403a663a10 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f20bc03bb50 msgr2=0x7f20bc03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.682 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f20bc03bb50 0x7f20bc03e010 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f21e400e550 tx=0x7f21e4045070 comp rx=0 tx=0).stop 2024-05-08T18:51:50.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a649ab0 msgr2=0x56403a650fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21ebfff640 1 -- 172.21.15.132:0/3132973245 reap_dead start 2024-05-08T18:51:50.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a649ab0 0x56403a650fe0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f21ec001700 tx=0x7f21ec052c60 comp rx=0 tx=0).stop 2024-05-08T18:51:50.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 shutdown_connections 2024-05-08T18:51:50.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 --2- 172.21.15.132:0/3132973245 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a649ab0 0x56403a650fe0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 >> 172.21.15.132:0/3132973245 conn(0x56403a645dc0 msgr2=0x56403a643420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 shutdown_connections 2024-05-08T18:51:50.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 -- 172.21.15.132:0/3132973245 wait complete. 2024-05-08T18:51:50.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 -- 172.21.15.132:0/1390541328 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f20c803bb50 msgr2=0x7f20c803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 --2- 172.21.15.132:0/1390541328 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f20c803bb50 0x7f20c803e010 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x56403a628eb0 tx=0x7f21e403f040 comp rx=0 tx=0).stop 2024-05-08T18:51:50.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 -- 172.21.15.132:0/1390541328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a63c760 msgr2=0x56403a63cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 --2- 172.21.15.132:0/1390541328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a63c760 0x56403a63cb80 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x56403a6223b0 tx=0x7f21ec018830 comp rx=0 tx=0).stop 2024-05-08T18:51:50.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 -- 172.21.15.132:0/1390541328 shutdown_connections 2024-05-08T18:51:50.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 --2- 172.21.15.132:0/1390541328 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f20c803bb50 0x7f20c803e010 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 --2- 172.21.15.132:0/1390541328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a63c760 0x56403a63cb80 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.679+0000 7f21f3c62800 1 -- 172.21.15.132:0/1390541328 >> 172.21.15.132:0/1390541328 conn(0x56403a630800 msgr2=0x56403a630c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.680+0000 7f21f3c62800 1 -- 172.21.15.132:0/1390541328 shutdown_connections 2024-05-08T18:51:50.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.680+0000 7f21f3c62800 1 -- 172.21.15.132:0/1390541328 wait complete. 2024-05-08T18:51:50.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.680+0000 7f21f3c62800 1 -- 172.21.15.132:0/1838644069 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56403a52ca30 msgr2=0x56403a628560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.680+0000 7f21f3c62800 1 --2- 172.21.15.132:0/1838644069 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56403a52ca30 0x56403a628560 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.680+0000 7f21f3c62800 1 -- 172.21.15.132:0/1838644069 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56403a62ad40 msgr2=0x56403a62d130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.680+0000 7f21f3c62800 1 --2- 172.21.15.132:0/1838644069 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56403a62ad40 0x56403a62d130 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.680+0000 7f21f3c62800 1 -- 172.21.15.132:0/1838644069 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f20d803bb50 msgr2=0x7f20d803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.680+0000 7f21f3c62800 1 --2- 172.21.15.132:0/1838644069 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f20d803bb50 0x7f20d803e010 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00a470 tx=0x7f21dc04e000 comp rx=0 tx=0).stop 2024-05-08T18:51:50.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.680+0000 7f21f3c62800 1 -- 172.21.15.132:0/1838644069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a5267e0 msgr2=0x56403a621320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:51:50.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.680+0000 7f21f3c62800 1 --2- 172.21.15.132:0/1838644069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a5267e0 0x56403a621320 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f21e4004170 tx=0x7f21e4000ed0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.680+0000 7f21f3c62800 1 -- 172.21.15.132:0/1838644069 shutdown_connections 2024-05-08T18:51:50.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.680+0000 7f21f3c62800 1 --2- 172.21.15.132:0/1838644069 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56403a62ad40 0x56403a62d130 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.680+0000 7f21f3c62800 1 --2- 172.21.15.132:0/1838644069 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56403a52ca30 0x56403a628560 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.680+0000 7f21f3c62800 1 --2- 172.21.15.132:0/1838644069 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f20d803bb50 0x7f20d803e010 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.680+0000 7f21f3c62800 1 --2- 172.21.15.132:0/1838644069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56403a5267e0 0x56403a621320 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:51:50.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.680+0000 7f21f3c62800 1 -- 172.21.15.132:0/1838644069 >> 172.21.15.132:0/1838644069 conn(0x56403a51feb0 msgr2=0x56403a613930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:51:50.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.680+0000 7f21f3c62800 1 -- 172.21.15.132:0/1838644069 shutdown_connections 2024-05-08T18:51:50.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:51:50.680+0000 7f21f3c62800 1 -- 172.21.15.132:0/1838644069 wait complete. 2024-05-08T18:52:30.690 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-05-08T18:52:30.690 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-05-08T18:52:30.691 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-05-08T18:52:30.745 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:30.745 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:30.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.747+0000 7f277312f800 1 Processor -- start 2024-05-08T18:52:30.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.747+0000 7f277312f800 1 -- start start 2024-05-08T18:52:30.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.747+0000 7f277312f800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55f6ff8cc6a0 0x55f6ff8d51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.747+0000 7f277312f800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f6ff83f510 con 0x55f6ff8cab60 2024-05-08T18:52:30.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.747+0000 7f277312f800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55f6ff76ce20 con 0x55f6ff8cc6a0 2024-05-08T18:52:30.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.747+0000 7f27665c9640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55f6ff8cc6a0 0x55f6ff8d51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.747+0000 7f276edca640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55f6ff8cab60 0x55f6ff8caf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48002/0 (socket says 172.21.15.132:48002) 2024-05-08T18:52:30.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.747+0000 7f276edca640 1 -- 172.21.15.132:0/393399343 learned_addr learned my addr 172.21.15.132:0/393399343 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:52:30.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.748+0000 7f27665c9640 1 -- 172.21.15.132:0/393399343 >> v1:172.21.15.42:6789/0 conn(0x55f6ff8cab60 legacy=0x55f6ff8caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.748+0000 7f27665c9640 1 -- 172.21.15.132:0/393399343 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ff8d66f0 con 0x55f6ff8cc6a0 2024-05-08T18:52:30.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.750+0000 7f27665c9640 1 --2- 172.21.15.132:0/393399343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff8cc6a0 0x55f6ff8d51a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f275800a470 tx=0x7f275801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104e3eacc0b0f763 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.750+0000 7f276e5c9640 1 -- 172.21.15.132:0/393399343 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2758057070 con 0x55f6ff8cc6a0 2024-05-08T18:52:30.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.750+0000 7f276e5c9640 1 -- 172.21.15.132:0/393399343 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f275804adc0 con 0x55f6ff8cc6a0 2024-05-08T18:52:30.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.750+0000 7f276e5c9640 1 -- 172.21.15.132:0/393399343 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2758052590 con 0x55f6ff8cc6a0 2024-05-08T18:52:30.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.750+0000 7f277312f800 1 -- 172.21.15.132:0/393399343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff8cc6a0 msgr2=0x55f6ff8d51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.750+0000 7f277312f800 1 --2- 172.21.15.132:0/393399343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff8cc6a0 0x55f6ff8d51a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f275800a470 tx=0x7f275801ce90 comp rx=0 tx=0).stop 2024-05-08T18:52:30.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.750+0000 7f277312f800 1 -- 172.21.15.132:0/393399343 shutdown_connections 2024-05-08T18:52:30.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.750+0000 7f277312f800 1 --2- 172.21.15.132:0/393399343 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff8cc6a0 0x55f6ff8d51a0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.750+0000 7f277312f800 1 -- 172.21.15.132:0/393399343 >> 172.21.15.132:0/393399343 conn(0x55f6ff8c6720 msgr2=0x55f6ff8c8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:30.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.750+0000 7f277312f800 1 -- 172.21.15.132:0/393399343 shutdown_connections 2024-05-08T18:52:30.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.750+0000 7f277312f800 1 -- 172.21.15.132:0/393399343 wait complete. 2024-05-08T18:52:30.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.766+0000 7f277312f800 1 Processor -- start 2024-05-08T18:52:30.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.766+0000 7f277312f800 1 -- start start 2024-05-08T18:52:30.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.766+0000 7f277312f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff8cab60 0x55f6ff9bf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.766+0000 7f277312f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f6ff8175b0 con 0x55f6ff8cab60 2024-05-08T18:52:30.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.767+0000 7f276edca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff8cab60 0x55f6ff9bf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.767+0000 7f276edca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff8cab60 0x55f6ff9bf960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52630/0 (socket says 172.21.15.132:52630) 2024-05-08T18:52:30.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.767+0000 7f276edca640 1 -- 172.21.15.132:0/3737383646 learned_addr learned my addr 172.21.15.132:0/3737383646 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:30.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.767+0000 7f276edca640 1 -- 172.21.15.132:0/3737383646 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ff9bff30 con 0x55f6ff8cab60 2024-05-08T18:52:30.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.767+0000 7f276edca640 1 --2- 172.21.15.132:0/3737383646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff8cab60 0x55f6ff9bf960 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2760001de0 tx=0x7f276000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5788e9b25fbc87 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.768+0000 7f265ce09640 1 -- 172.21.15.132:0/3737383646 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2760012020 con 0x55f6ff8cab60 2024-05-08T18:52:30.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.768+0000 7f265ce09640 1 -- 172.21.15.132:0/3737383646 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276000e5a0 con 0x55f6ff8cab60 2024-05-08T18:52:30.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.768+0000 7f265ce09640 1 -- 172.21.15.132:0/3737383646 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276000e8c0 con 0x55f6ff8cab60 2024-05-08T18:52:30.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.768+0000 7f277312f800 1 -- 172.21.15.132:0/3737383646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff8cab60 msgr2=0x55f6ff9bf960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.768+0000 7f277312f800 1 --2- 172.21.15.132:0/3737383646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff8cab60 0x55f6ff9bf960 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2760001de0 tx=0x7f276000b6c0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.768+0000 7f277312f800 1 -- 172.21.15.132:0/3737383646 shutdown_connections 2024-05-08T18:52:30.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.768+0000 7f277312f800 1 --2- 172.21.15.132:0/3737383646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff8cab60 0x55f6ff9bf960 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.768+0000 7f277312f800 1 -- 172.21.15.132:0/3737383646 >> 172.21.15.132:0/3737383646 conn(0x55f6ff8c6720 msgr2=0x55f6ff9bb280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:30.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.768+0000 7f277312f800 1 -- 172.21.15.132:0/3737383646 shutdown_connections 2024-05-08T18:52:30.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.768+0000 7f277312f800 1 -- 172.21.15.132:0/3737383646 wait complete. 2024-05-08T18:52:30.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.769+0000 7f277312f800 1 Processor -- start 2024-05-08T18:52:30.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.769+0000 7f277312f800 1 -- start start 2024-05-08T18:52:30.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.769+0000 7f277312f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff8cab60 0x55f6ff9c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.769+0000 7f277312f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f6ff8d59b0 con 0x55f6ff8cab60 2024-05-08T18:52:30.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.769+0000 7f276edca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff8cab60 0x55f6ff9c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.769+0000 7f276edca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff8cab60 0x55f6ff9c74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52638/0 (socket says 172.21.15.132:52638) 2024-05-08T18:52:30.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.769+0000 7f276edca640 1 -- 172.21.15.132:0/2104226282 learned_addr learned my addr 172.21.15.132:0/2104226282 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:30.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.769+0000 7f276edca640 1 -- 172.21.15.132:0/2104226282 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ff9c79f0 con 0x55f6ff8cab60 2024-05-08T18:52:30.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.770+0000 7f276edca640 1 --2- 172.21.15.132:0/2104226282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff8cab60 0x55f6ff9c74b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f276000c010 tx=0x7f2760000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.770+0000 7f265b606640 1 -- 172.21.15.132:0/2104226282 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2760012070 con 0x55f6ff8cab60 2024-05-08T18:52:30.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.770+0000 7f265b606640 1 -- 172.21.15.132:0/2104226282 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276001a7a0 con 0x55f6ff8cab60 2024-05-08T18:52:30.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.770+0000 7f277312f800 1 -- 172.21.15.132:0/2104226282 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6ff9c7c80 con 0x55f6ff8cab60 2024-05-08T18:52:30.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.770+0000 7f265b606640 1 -- 172.21.15.132:0/2104226282 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276001aa80 con 0x55f6ff8cab60 2024-05-08T18:52:30.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.770+0000 7f277312f800 1 -- 172.21.15.132:0/2104226282 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6ff9ca930 con 0x55f6ff8cab60 2024-05-08T18:52:30.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.771+0000 7f265b606640 1 -- 172.21.15.132:0/2104226282 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2760015020 con 0x55f6ff8cab60 2024-05-08T18:52:30.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.771+0000 7f265b606640 1 --2- 172.21.15.132:0/2104226282 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f265403bba0 0x7f265403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.771+0000 7f265b606640 1 -- 172.21.15.132:0/2104226282 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f2760020070 con 0x55f6ff8cab60 2024-05-08T18:52:30.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.771+0000 7f27665c9640 1 --2- 172.21.15.132:0/2104226282 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f265403bba0 0x7f265403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.771+0000 7f277312f800 1 --2- 172.21.15.132:0/2104226282 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f6ff8cc6a0 0x55f6ff9ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.772+0000 7f277312f800 1 -- 172.21.15.132:0/2104226282 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f6ff9cec30 con 0x55f6ff8cc6a0 2024-05-08T18:52:30.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.772+0000 7f276f5cb640 1 --2- 172.21.15.132:0/2104226282 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f6ff8cc6a0 0x55f6ff9ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.772+0000 7f27665c9640 1 --2- 172.21.15.132:0/2104226282 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f265403bba0 0x7f265403e060 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2758054000 tx=0x7f275804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.772+0000 7f276f5cb640 1 --2- 172.21.15.132:0/2104226282 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f6ff8cc6a0 0x55f6ff9ce6f0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.772+0000 7f276f5cb640 1 -- 172.21.15.132:0/2104226282 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f276800a4a0 con 0x55f6ff8cc6a0 2024-05-08T18:52:30.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.772+0000 7f277312f800 1 -- 172.21.15.132:0/2104226282 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f6ff9cbcc0 con 0x55f6ff8cc6a0 2024-05-08T18:52:30.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.773+0000 7f276f5cb640 1 -- 172.21.15.132:0/2104226282 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f276800a4a0 con 0x55f6ff8cc6a0 2024-05-08T18:52:30.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.773+0000 7f277312f800 1 --2- 172.21.15.132:0/2104226282 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f6ff9d0f80 0x55f6ff9d3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.773+0000 7f277312f800 1 -- 172.21.15.132:0/2104226282 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f6ff9d3a60 con 0x55f6ff9d0f80 2024-05-08T18:52:30.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.773+0000 7f276edca640 1 --2- 172.21.15.132:0/2104226282 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f6ff9d0f80 0x55f6ff9d3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.773+0000 7f276edca640 1 --2- 172.21.15.132:0/2104226282 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f6ff9d0f80 0x55f6ff9d3370 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.773+0000 7f276edca640 1 -- 172.21.15.132:0/2104226282 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f276002b070 con 0x55f6ff9d0f80 2024-05-08T18:52:30.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.773+0000 7f277312f800 1 -- 172.21.15.132:0/2104226282 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f6ff9cfdf0 con 0x55f6ff8cc6a0 2024-05-08T18:52:30.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.774+0000 7f276f5cb640 1 -- 172.21.15.132:0/2104226282 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f276800a4a0 con 0x55f6ff8cc6a0 2024-05-08T18:52:30.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.774+0000 7f277312f800 1 -- 172.21.15.132:0/2104226282 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f6ff9d0260 con 0x55f6ff8cc6a0 2024-05-08T18:52:30.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.774+0000 7f276f5cb640 1 -- 172.21.15.132:0/2104226282 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f276800a4a0 con 0x55f6ff8cc6a0 2024-05-08T18:52:30.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.774+0000 7f277312f800 1 Processor -- start 2024-05-08T18:52:30.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.774+0000 7f277312f800 1 -- start start 2024-05-08T18:52:30.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.775+0000 7f277312f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff9e2a00 0x55f6ff9e2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.775+0000 7f277312f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f6ff7bdfc0 con 0x55f6ff9e2a00 2024-05-08T18:52:30.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.775+0000 7f276f5cb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff9e2a00 0x55f6ff9e2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.775+0000 7f276f5cb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff9e2a00 0x55f6ff9e2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52654/0 (socket says 172.21.15.132:52654) 2024-05-08T18:52:30.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.775+0000 7f276f5cb640 1 -- 172.21.15.132:0/533080419 learned_addr learned my addr 172.21.15.132:0/533080419 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:30.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.775+0000 7f276f5cb640 1 -- 172.21.15.132:0/533080419 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ff9e3360 con 0x55f6ff9e2a00 2024-05-08T18:52:30.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.776+0000 7f276f5cb640 1 --2- 172.21.15.132:0/533080419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff9e2a00 0x55f6ff9e2e20 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x55f6ff9c88b0 tx=0x7f2768018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.776+0000 7f2658e01640 1 -- 172.21.15.132:0/533080419 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2768014450 con 0x55f6ff9e2a00 2024-05-08T18:52:30.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.776+0000 7f2658e01640 1 -- 172.21.15.132:0/533080419 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27680145f0 con 0x55f6ff9e2a00 2024-05-08T18:52:30.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.776+0000 7f2658e01640 1 -- 172.21.15.132:0/533080419 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27680148f0 con 0x55f6ff9e2a00 2024-05-08T18:52:30.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.776+0000 7f277312f800 1 -- 172.21.15.132:0/533080419 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6ff9e3dd0 con 0x55f6ff9e2a00 2024-05-08T18:52:30.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.776+0000 7f277312f800 1 -- 172.21.15.132:0/533080419 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6ff9e42d0 con 0x55f6ff9e2a00 2024-05-08T18:52:30.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.777+0000 7f2658e01640 1 -- 172.21.15.132:0/533080419 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2768011040 con 0x55f6ff9e2a00 2024-05-08T18:52:30.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.777+0000 7f2658e01640 1 --2- 172.21.15.132:0/533080419 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f264803bb50 0x7f264803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.777+0000 7f2658e01640 1 -- 172.21.15.132:0/533080419 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f276801e070 con 0x55f6ff9e2a00 2024-05-08T18:52:30.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.777+0000 7f276edca640 1 --2- 172.21.15.132:0/533080419 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f264803bb50 0x7f264803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.777+0000 7f277312f800 1 Processor -- start 2024-05-08T18:52:30.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.777+0000 7f277312f800 1 -- start start 2024-05-08T18:52:30.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.778+0000 7f276edca640 1 --2- 172.21.15.132:0/533080419 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f264803bb50 0x7f264803e010 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2760022b30 tx=0x7f2760050ca0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.778+0000 7f277312f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff9efcc0 0x55f6ff9f00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.778+0000 7f277312f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f6ff9c02b0 con 0x55f6ff9efcc0 2024-05-08T18:52:30.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.778+0000 7f276f5cb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff9efcc0 0x55f6ff9f00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.778+0000 7f276f5cb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff9efcc0 0x55f6ff9f00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52664/0 (socket says 172.21.15.132:52664) 2024-05-08T18:52:30.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.778+0000 7f276f5cb640 1 -- 172.21.15.132:0/2669639294 learned_addr learned my addr 172.21.15.132:0/2669639294 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:30.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.778+0000 7f276f5cb640 1 -- 172.21.15.132:0/2669639294 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ff9f06b0 con 0x55f6ff9efcc0 2024-05-08T18:52:30.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.778+0000 7f276f5cb640 1 --2- 172.21.15.132:0/2669639294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff9efcc0 0x55f6ff9f00e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2768052c30 tx=0x7f27680118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4f14d7e488ecfb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.779+0000 7f26527fc640 1 -- 172.21.15.132:0/2669639294 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2768047020 con 0x55f6ff9efcc0 2024-05-08T18:52:30.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.779+0000 7f26527fc640 1 -- 172.21.15.132:0/2669639294 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2768022c70 con 0x55f6ff9efcc0 2024-05-08T18:52:30.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.779+0000 7f26527fc640 1 -- 172.21.15.132:0/2669639294 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2768022e40 con 0x55f6ff9efcc0 2024-05-08T18:52:30.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.779+0000 7f277312f800 1 -- 172.21.15.132:0/2669639294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff9efcc0 msgr2=0x55f6ff9f00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.779+0000 7f277312f800 1 --2- 172.21.15.132:0/2669639294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff9efcc0 0x55f6ff9f00e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2768052c30 tx=0x7f27680118e0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.779+0000 7f277312f800 1 -- 172.21.15.132:0/2669639294 shutdown_connections 2024-05-08T18:52:30.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.779+0000 7f277312f800 1 --2- 172.21.15.132:0/2669639294 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff9efcc0 0x55f6ff9f00e0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.779+0000 7f277312f800 1 -- 172.21.15.132:0/2669639294 >> 172.21.15.132:0/2669639294 conn(0x55f6ff9ec020 msgr2=0x55f6ff9ea080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:30.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.779+0000 7f277312f800 1 -- 172.21.15.132:0/2669639294 shutdown_connections 2024-05-08T18:52:30.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.779+0000 7f277312f800 1 -- 172.21.15.132:0/2669639294 wait complete. 2024-05-08T18:52:30.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.779+0000 7f277312f800 1 Processor -- start 2024-05-08T18:52:30.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.779+0000 7f277312f800 1 -- start start 2024-05-08T18:52:30.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.780+0000 7f277312f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff9efcc0 0x55f6ff9f72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.780+0000 7f277312f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55f6ff9f0e20 con 0x55f6ff9efcc0 2024-05-08T18:52:30.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.780+0000 7f276f5cb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff9efcc0 0x55f6ff9f72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.780+0000 7f276f5cb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff9efcc0 0x55f6ff9f72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52680/0 (socket says 172.21.15.132:52680) 2024-05-08T18:52:30.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.780+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 learned_addr learned my addr 172.21.15.132:0/2907175543 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:30.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.780+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6ff9f7820 con 0x55f6ff9efcc0 2024-05-08T18:52:30.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.780+0000 7f276f5cb640 1 --2- 172.21.15.132:0/2907175543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff9efcc0 0x55f6ff9f72e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2768011f60 tx=0x7f2768052b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.780+0000 7f2650ff9640 1 -- 172.21.15.132:0/2907175543 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276802b560 con 0x55f6ff9efcc0 2024-05-08T18:52:30.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.780+0000 7f2650ff9640 1 -- 172.21.15.132:0/2907175543 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276802b700 con 0x55f6ff9efcc0 2024-05-08T18:52:30.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.780+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f6ff9f7ab0 con 0x55f6ff9efcc0 2024-05-08T18:52:30.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.780+0000 7f2650ff9640 1 -- 172.21.15.132:0/2907175543 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f276802ba20 con 0x55f6ff9efcc0 2024-05-08T18:52:30.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.781+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6ff9fa760 con 0x55f6ff9efcc0 2024-05-08T18:52:30.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.782+0000 7f2650ff9640 1 -- 172.21.15.132:0/2907175543 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2768051030 con 0x55f6ff9efcc0 2024-05-08T18:52:30.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.782+0000 7f2650ff9640 1 --2- 172.21.15.132:0/2907175543 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f263803bb50 0x7f263803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.782+0000 7f2650ff9640 1 -- 172.21.15.132:0/2907175543 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f276800e040 con 0x55f6ff9efcc0 2024-05-08T18:52:30.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.782+0000 7f276edca640 1 --2- 172.21.15.132:0/2907175543 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f263803bb50 0x7f263803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.782+0000 7f276edca640 1 --2- 172.21.15.132:0/2907175543 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f263803bb50 0x7f263803e010 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2760017fd0 tx=0x7f276004d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.782+0000 7f277312f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.782+0000 7f277312f800 1 --2- 172.21.15.132:0/2907175543 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f6ffa02f70 0x55f6ffa05430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.782+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa05b80 con 0x55f6ffa02f70 2024-05-08T18:52:30.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.783+0000 7f27665c9640 1 --2- 172.21.15.132:0/2907175543 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f6ffa02f70 0x55f6ffa05430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.783+0000 7f27665c9640 1 --2- 172.21.15.132:0/2907175543 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f6ffa02f70 0x55f6ffa05430 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.783+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.783+0000 7f277312f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:30.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.783+0000 7f277312f800 20 realm 2024-05-08T18:52:30.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.783+0000 7f277312f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.783+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa05fb0 con 0x55f6ffa02f70 2024-05-08T18:52:30.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.783+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.783+0000 7f277312f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:30.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.783+0000 7f277312f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:52:30.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.783+0000 7f277312f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.783+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa06880 con 0x55f6ffa02f70 2024-05-08T18:52:30.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.784+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.784+0000 7f277312f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:30.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.784+0000 7f277312f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.784+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa06c20 con 0x55f6ffa02f70 2024-05-08T18:52:30.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.784+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.784+0000 7f277312f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:30.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.784+0000 7f277312f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.784+0000 7f277312f800 1 --2- 172.21.15.132:0/2907175543 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f6ffa07980 0x55f6ffa09d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.784+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0a380 con 0x55f6ffa07980 2024-05-08T18:52:30.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.784+0000 7f276f5cb640 1 --2- 172.21.15.132:0/2907175543 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f6ffa07980 0x55f6ffa09d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.784+0000 7f276f5cb640 1 --2- 172.21.15.132:0/2907175543 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f6ffa07980 0x55f6ffa09d70 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.785+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2768049070 con 0x55f6ffa07980 2024-05-08T18:52:30.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.785+0000 7f277312f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:52:30.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.785+0000 7f277312f800 20 searching for the correct realm 2024-05-08T18:52:30.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.785+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x55f6ffa07980 2024-05-08T18:52:30.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.785+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2768049070 con 0x55f6ffa07980 2024-05-08T18:52:30.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.785+0000 7f276f5cb640 1 --2- 172.21.15.132:0/2907175543 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2768035020 0x7f2768023a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.785+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x7f2768035020 2024-05-08T18:52:30.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.785+0000 7f276edca640 1 --2- 172.21.15.132:0/2907175543 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2768035020 0x7f2768023a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.786+0000 7f276edca640 1 --2- 172.21.15.132:0/2907175543 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2768035020 0x7f2768023a70 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.786+0000 7f276edca640 1 -- 172.21.15.132:0/2907175543 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276002b070 con 0x7f2768035020 2024-05-08T18:52:30.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.786+0000 7f276edca640 1 --2- 172.21.15.132:0/2907175543 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f276003c040 0x7f27600529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.786+0000 7f276edca640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x7f276003c040 2024-05-08T18:52:30.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.786+0000 7f27665c9640 1 --2- 172.21.15.132:0/2907175543 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f276003c040 0x7f27600529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.787+0000 7f27665c9640 1 --2- 172.21.15.132:0/2907175543 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f276003c040 0x7f27600529d0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.787+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f275805a040 con 0x7f276003c040 2024-05-08T18:52:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.787+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x55f6ffa02f70 2024-05-08T18:52:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.787+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.787+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x55f6ffa02f70 2024-05-08T18:52:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.788+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.788+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x7f276003c040 2024-05-08T18:52:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.788+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f275805a040 con 0x7f276003c040 2024-05-08T18:52:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.788+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x7f276003c040 2024-05-08T18:52:30.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.788+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f275805a040 con 0x7f276003c040 2024-05-08T18:52:30.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.788+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x7f2768035020 2024-05-08T18:52:30.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.789+0000 7f276edca640 1 -- 172.21.15.132:0/2907175543 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276002b070 con 0x7f2768035020 2024-05-08T18:52:30.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.789+0000 7f276edca640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x55f6ffa07980 2024-05-08T18:52:30.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.789+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2768061040 con 0x55f6ffa07980 2024-05-08T18:52:30.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.789+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x55f6ffa02f70 2024-05-08T18:52:30.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.789+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.789+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x7f276003c040 2024-05-08T18:52:30.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.789+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f275805a040 con 0x7f276003c040 2024-05-08T18:52:30.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.789+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x55f6ffa02f70 2024-05-08T18:52:30.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.790+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.790+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x7f2768035020 2024-05-08T18:52:30.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.790+0000 7f276edca640 1 -- 172.21.15.132:0/2907175543 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f276002b070 con 0x7f2768035020 2024-05-08T18:52:30.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.790+0000 7f276edca640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x55f6ffa07980 2024-05-08T18:52:30.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.790+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2768061040 con 0x55f6ffa07980 2024-05-08T18:52:30.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.790+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x55f6ffa07980 2024-05-08T18:52:30.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.790+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2768061040 con 0x55f6ffa07980 2024-05-08T18:52:30.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.790+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x7f276003c040 2024-05-08T18:52:30.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.791+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f275805a040 con 0x7f276003c040 2024-05-08T18:52:30.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.791+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x55f6ffa07980 2024-05-08T18:52:30.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.791+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2768061040 con 0x55f6ffa07980 2024-05-08T18:52:30.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.791+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x55f6ffa07980 2024-05-08T18:52:30.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.791+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2768061040 con 0x55f6ffa07980 2024-05-08T18:52:30.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.791+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x55f6ffa02f70 2024-05-08T18:52:30.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.792+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.792+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x55f6ffa02f70 2024-05-08T18:52:30.804 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.792+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.792+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x7f276003c040 2024-05-08T18:52:30.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.792+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f275805a040 con 0x7f276003c040 2024-05-08T18:52:30.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.792+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x55f6ffa07980 2024-05-08T18:52:30.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.792+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2768061040 con 0x55f6ffa07980 2024-05-08T18:52:30.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.792+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x7f2768035020 2024-05-08T18:52:30.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.793+0000 7f276edca640 1 -- 172.21.15.132:0/2907175543 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276002b070 con 0x7f2768035020 2024-05-08T18:52:30.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.793+0000 7f276edca640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x55f6ffa02f70 2024-05-08T18:52:30.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.793+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.793+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x7f2768035020 2024-05-08T18:52:30.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.793+0000 7f276edca640 1 -- 172.21.15.132:0/2907175543 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276002b070 con 0x7f2768035020 2024-05-08T18:52:30.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.793+0000 7f276edca640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x55f6ffa07980 2024-05-08T18:52:30.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.794+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2768061040 con 0x55f6ffa07980 2024-05-08T18:52:30.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.794+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x7f276003c040 2024-05-08T18:52:30.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.794+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f275805a040 con 0x7f276003c040 2024-05-08T18:52:30.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.794+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x7f2768035020 2024-05-08T18:52:30.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.794+0000 7f276edca640 1 -- 172.21.15.132:0/2907175543 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276002b070 con 0x7f2768035020 2024-05-08T18:52:30.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.794+0000 7f276edca640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x55f6ffa07980 2024-05-08T18:52:30.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.794+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2768061040 con 0x55f6ffa07980 2024-05-08T18:52:30.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.795+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x7f276003c040 2024-05-08T18:52:30.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.795+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f275805a040 con 0x7f276003c040 2024-05-08T18:52:30.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.795+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x55f6ffa02f70 2024-05-08T18:52:30.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.795+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.795+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0bc90 con 0x7f2768035020 2024-05-08T18:52:30.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.795+0000 7f276edca640 1 -- 172.21.15.132:0/2907175543 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f276002b070 con 0x7f2768035020 2024-05-08T18:52:30.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.795+0000 7f277312f800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:52:30.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.795+0000 7f277312f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:52:30.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.795+0000 7f277312f800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:52:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f277312f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:52:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f277312f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:52:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f277312f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:52:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f277312f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0b860 con 0x55f6ffa02f70 2024-05-08T18:52:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f277312f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f277312f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0acc0 con 0x55f6ffa02f70 2024-05-08T18:52:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f277312f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f277312f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0b160 con 0x55f6ffa02f70 2024-05-08T18:52:30.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f277312f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:52:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f277312f800 20 zone default found 2024-05-08T18:52:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f277312f800 4 Realm: () 2024-05-08T18:52:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f277312f800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:52:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f277312f800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:52:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f277312f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:52:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f277312f800 20 zonegroup default 2024-05-08T18:52:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f277312f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.796+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0c110 con 0x7f2768035020 2024-05-08T18:52:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.797+0000 7f276edca640 1 -- 172.21.15.132:0/2907175543 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f276002b070 con 0x7f2768035020 2024-05-08T18:52:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.797+0000 7f277312f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.797+0000 7f277312f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.797+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0e390 con 0x55f6ffa07980 2024-05-08T18:52:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.797+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2768061040 con 0x55f6ffa07980 2024-05-08T18:52:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.797+0000 7f277312f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.797+0000 7f277312f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.797+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0e730 con 0x55f6ffa07980 2024-05-08T18:52:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.797+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2768061040 con 0x55f6ffa07980 2024-05-08T18:52:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.797+0000 7f277312f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.797+0000 7f277312f800 20 started sync module instance, tier type = 2024-05-08T18:52:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.797+0000 7f277312f800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:52:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.797+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0d7d0 con 0x7f2768035020 2024-05-08T18:52:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.798+0000 7f276edca640 1 -- 172.21.15.132:0/2907175543 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276002b070 con 0x7f2768035020 2024-05-08T18:52:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.798+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94519339047872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0dfe0 con 0x7f2768035020 2024-05-08T18:52:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.798+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0f0f0 con 0x55f6ffa02f70 2024-05-08T18:52:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.799+0000 7f276edca640 1 -- 172.21.15.132:0/2907175543 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94519339047872] v27'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276002b070 con 0x7f2768035020 2024-05-08T18:52:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.800+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.800+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94519339050800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0f4e0 con 0x55f6ffa02f70 2024-05-08T18:52:30.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.800+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0ff40 con 0x55f6ffa07980 2024-05-08T18:52:30.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.801+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94519339050800] v27'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.802+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2768061040 con 0x55f6ffa07980 2024-05-08T18:52:30.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.802+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94519339055600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0ff00 con 0x55f6ffa07980 2024-05-08T18:52:30.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.802+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa109f0 con 0x7f2768035020 2024-05-08T18:52:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.803+0000 7f276edca640 1 -- 172.21.15.132:0/2907175543 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276002b070 con 0x7f2768035020 2024-05-08T18:52:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.803+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94519339058432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa11290 con 0x7f2768035020 2024-05-08T18:52:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.803+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa11d50 con 0x55f6ffa02f70 2024-05-08T18:52:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.803+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94519339055600] v27'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2768061040 con 0x55f6ffa07980 2024-05-08T18:52:30.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.804+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.804+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94519339063424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa12170 con 0x55f6ffa02f70 2024-05-08T18:52:30.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.804+0000 7f276edca640 1 -- 172.21.15.132:0/2907175543 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94519339058432] v27'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276002b070 con 0x7f2768035020 2024-05-08T18:52:30.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.804+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa10e20 con 0x7f276003c040 2024-05-08T18:52:30.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.805+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f275805a040 con 0x7f276003c040 2024-05-08T18:52:30.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.805+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94519339065584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa12b30 con 0x7f276003c040 2024-05-08T18:52:30.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.805+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa13550 con 0x7f276003c040 2024-05-08T18:52:30.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.805+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94519339063424] v27'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.806+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94519339065584] v27'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f275805a040 con 0x7f276003c040 2024-05-08T18:52:30.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.807+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f275805a040 con 0x7f276003c040 2024-05-08T18:52:30.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.807+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94519339069504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa126c0 con 0x7f276003c040 2024-05-08T18:52:30.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.807+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa13be0 con 0x7f276003c040 2024-05-08T18:52:30.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.808+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94519339069504] v27'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f275805a040 con 0x7f276003c040 2024-05-08T18:52:30.815 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.808+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f275805a040 con 0x7f276003c040 2024-05-08T18:52:30.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.808+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94519339051856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa13be0 con 0x7f276003c040 2024-05-08T18:52:30.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.808+0000 7f277312f800 20 add_watcher() i=0 2024-05-08T18:52:30.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.808+0000 7f277312f800 20 add_watcher() i=1 2024-05-08T18:52:30.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.808+0000 7f277312f800 20 add_watcher() i=2 2024-05-08T18:52:30.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.808+0000 7f277312f800 20 add_watcher() i=3 2024-05-08T18:52:30.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.808+0000 7f277312f800 20 add_watcher() i=4 2024-05-08T18:52:30.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.808+0000 7f277312f800 20 add_watcher() i=5 2024-05-08T18:52:30.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.808+0000 7f277312f800 20 add_watcher() i=6 2024-05-08T18:52:30.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.809+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94519339051856] v27'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f275805a040 con 0x7f276003c040 2024-05-08T18:52:30.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.809+0000 7f277312f800 20 add_watcher() i=7 2024-05-08T18:52:30.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.809+0000 7f277312f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:52:30.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.809+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa16df0 con 0x55f6ffa02f70 2024-05-08T18:52:30.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.809+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.809+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94519339071648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa14170 con 0x55f6ffa02f70 2024-05-08T18:52:30.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.810+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94519339071648] v27'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.810+0000 7f26257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:30.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.811+0000 7f277312f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:30.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.811+0000 7f277312f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:30.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.811+0000 7f277312f800 5 note: GC not initialized 2024-05-08T18:52:30.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.811+0000 7f259ffff640 20 reqs_thread_entry: start 2024-05-08T18:52:30.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.811+0000 7f277312f800 20 init_complete bucket index max shards: 11 2024-05-08T18:52:30.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.811+0000 7f277312f800 20 Filter name: none 2024-05-08T18:52:30.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.811+0000 7f259dffb640 20 reqs_thread_entry: start 2024-05-08T18:52:30.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.811+0000 7f277312f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:52:30.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.811+0000 7f277312f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.811+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa4a330 con 0x55f6ffa02f70 2024-05-08T18:52:30.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.812+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.812+0000 7f277312f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:52:30.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.812+0000 7f277312f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:52:30.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.812+0000 7f277312f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:52:30.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.812+0000 7f277312f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:52:30.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.812+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa4cc60 con 0x7f276003c040 2024-05-08T18:52:30.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.813+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(63 usage.10 [call] v27'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f275805a040 con 0x7f276003c040 2024-05-08T18:52:30.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.813+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa4cc60 con 0x7f276003c040 2024-05-08T18:52:30.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.814+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(64 usage.10 [call] v27'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f275805a040 con 0x7f276003c040 2024-05-08T18:52:30.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.815+0000 7f26257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:30.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.815+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94519339071648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa16580 con 0x55f6ffa02f70 2024-05-08T18:52:30.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.816+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94519339071648] v27'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.816+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94519339047872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa138a0 con 0x7f2768035020 2024-05-08T18:52:30.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.817+0000 7f276edca640 1 -- 172.21.15.132:0/2907175543 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94519339047872] v27'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276002b070 con 0x7f2768035020 2024-05-08T18:52:30.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.817+0000 7f277312f800 20 remove_watcher() i=0 2024-05-08T18:52:30.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.817+0000 7f277312f800 2 removed watcher, disabling cache 2024-05-08T18:52:30.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.817+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94519339050800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa138a0 con 0x55f6ffa02f70 2024-05-08T18:52:30.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.819+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94519339050800] v27'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.819+0000 7f277312f800 20 remove_watcher() i=1 2024-05-08T18:52:30.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.819+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94519339055600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0e730 con 0x55f6ffa07980 2024-05-08T18:52:30.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.820+0000 7f276f5cb640 1 -- 172.21.15.132:0/2907175543 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94519339055600] v27'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2768061040 con 0x55f6ffa07980 2024-05-08T18:52:30.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.820+0000 7f277312f800 20 remove_watcher() i=2 2024-05-08T18:52:30.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.820+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94519339058432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa138a0 con 0x7f2768035020 2024-05-08T18:52:30.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.821+0000 7f276edca640 1 -- 172.21.15.132:0/2907175543 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94519339058432] v27'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f276002b070 con 0x7f2768035020 2024-05-08T18:52:30.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.821+0000 7f277312f800 20 remove_watcher() i=3 2024-05-08T18:52:30.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.821+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94519339063424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa0f9f0 con 0x55f6ffa02f70 2024-05-08T18:52:30.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.822+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94519339063424] v27'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f275805a040 con 0x55f6ffa02f70 2024-05-08T18:52:30.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.822+0000 7f277312f800 20 remove_watcher() i=4 2024-05-08T18:52:30.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.822+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94519339065584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa49ed0 con 0x7f276003c040 2024-05-08T18:52:30.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.824+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94519339065584] v27'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f275805a040 con 0x7f276003c040 2024-05-08T18:52:30.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.824+0000 7f277312f800 20 remove_watcher() i=5 2024-05-08T18:52:30.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.824+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94519339069504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa49ed0 con 0x7f276003c040 2024-05-08T18:52:30.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.825+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94519339069504] v27'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f275805a040 con 0x7f276003c040 2024-05-08T18:52:30.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.825+0000 7f277312f800 20 remove_watcher() i=6 2024-05-08T18:52:30.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.825+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94519339051856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f6ffa49ed0 con 0x7f276003c040 2024-05-08T18:52:30.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.826+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94519339051856] v27'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f275805a040 con 0x7f276003c040 2024-05-08T18:52:30.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.826+0000 7f277312f800 20 remove_watcher() i=7 2024-05-08T18:52:30.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.826+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f276003c040 msgr2=0x7f27600529d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.826+0000 7f277312f800 1 --2- 172.21.15.132:0/2907175543 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f276003c040 0x7f27600529d0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.826+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f6ffa02f70 msgr2=0x55f6ffa05430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.826+0000 7f277312f800 1 --2- 172.21.15.132:0/2907175543 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f6ffa02f70 0x55f6ffa05430 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.826+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2768035020 msgr2=0x7f2768023a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.826+0000 7f277312f800 1 --2- 172.21.15.132:0/2907175543 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2768035020 0x7f2768023a70 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.826+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f6ffa07980 msgr2=0x55f6ffa09d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.826+0000 7f277312f800 1 --2- 172.21.15.132:0/2907175543 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f6ffa07980 0x55f6ffa09d70 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.826+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f263803bb50 msgr2=0x7f263803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.826+0000 7f277312f800 1 --2- 172.21.15.132:0/2907175543 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f263803bb50 0x7f263803e010 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2760017fd0 tx=0x7f276004d000 comp rx=0 tx=0).stop 2024-05-08T18:52:30.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.826+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff9efcc0 msgr2=0x55f6ff9f72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.826+0000 7f277312f800 1 --2- 172.21.15.132:0/2907175543 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff9efcc0 0x55f6ff9f72e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2768011f60 tx=0x7f2768052b90 comp rx=0 tx=0).stop 2024-05-08T18:52:30.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.826+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 reap_dead start 2024-05-08T18:52:30.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.826+0000 7f27665c9640 1 -- 172.21.15.132:0/2907175543 reap_dead start 2024-05-08T18:52:30.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.826+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 shutdown_connections 2024-05-08T18:52:30.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.826+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 >> 172.21.15.132:0/2907175543 conn(0x55f6ff9ec020 msgr2=0x55f6ff9e9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:30.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.826+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 shutdown_connections 2024-05-08T18:52:30.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.826+0000 7f277312f800 1 -- 172.21.15.132:0/2907175543 wait complete. 2024-05-08T18:52:30.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.826+0000 7f277312f800 1 -- 172.21.15.132:0/533080419 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f264803bb50 msgr2=0x7f264803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.826+0000 7f277312f800 1 --2- 172.21.15.132:0/533080419 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f264803bb50 0x7f264803e010 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2760022b30 tx=0x7f2760050ca0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 -- 172.21.15.132:0/533080419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff9e2a00 msgr2=0x55f6ff9e2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 --2- 172.21.15.132:0/533080419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff9e2a00 0x55f6ff9e2e20 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x55f6ff9c88b0 tx=0x7f2768018830 comp rx=0 tx=0).stop 2024-05-08T18:52:30.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 -- 172.21.15.132:0/533080419 shutdown_connections 2024-05-08T18:52:30.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 --2- 172.21.15.132:0/533080419 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f264803bb50 0x7f264803e010 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 --2- 172.21.15.132:0/533080419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff9e2a00 0x55f6ff9e2e20 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 -- 172.21.15.132:0/533080419 >> 172.21.15.132:0/533080419 conn(0x55f6ff9d6aa0 msgr2=0x55f6ff9d6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:30.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 -- 172.21.15.132:0/533080419 shutdown_connections 2024-05-08T18:52:30.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 -- 172.21.15.132:0/533080419 wait complete. 2024-05-08T18:52:30.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 -- 172.21.15.132:0/2104226282 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f6ff8cc6a0 msgr2=0x55f6ff9ce6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 --2- 172.21.15.132:0/2104226282 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f6ff8cc6a0 0x55f6ff9ce6f0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 -- 172.21.15.132:0/2104226282 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f6ff9d0f80 msgr2=0x55f6ff9d3370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 --2- 172.21.15.132:0/2104226282 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f6ff9d0f80 0x55f6ff9d3370 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 -- 172.21.15.132:0/2104226282 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f265403bba0 msgr2=0x7f265403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 --2- 172.21.15.132:0/2104226282 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f265403bba0 0x7f265403e060 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2758054000 tx=0x7f275804e000 comp rx=0 tx=0).stop 2024-05-08T18:52:30.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 -- 172.21.15.132:0/2104226282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff8cab60 msgr2=0x55f6ff9c74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 --2- 172.21.15.132:0/2104226282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff8cab60 0x55f6ff9c74b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f276000c010 tx=0x7f2760000ed0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 -- 172.21.15.132:0/2104226282 shutdown_connections 2024-05-08T18:52:30.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 --2- 172.21.15.132:0/2104226282 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55f6ff9d0f80 0x55f6ff9d3370 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 --2- 172.21.15.132:0/2104226282 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55f6ff8cc6a0 0x55f6ff9ce6f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 --2- 172.21.15.132:0/2104226282 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f265403bba0 0x7f265403e060 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 --2- 172.21.15.132:0/2104226282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55f6ff8cab60 0x55f6ff9c74b0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 -- 172.21.15.132:0/2104226282 >> 172.21.15.132:0/2104226282 conn(0x55f6ff8c6720 msgr2=0x55f6ff9b9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:30.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 -- 172.21.15.132:0/2104226282 shutdown_connections 2024-05-08T18:52:30.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.827+0000 7f277312f800 1 -- 172.21.15.132:0/2104226282 wait complete. 2024-05-08T18:52:30.835 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-05-08T18:52:30.836 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-05-08T18:52:30.836 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-05-08T18:52:30.880 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:30.880 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:30.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.881+0000 7fdd91806800 1 Processor -- start 2024-05-08T18:52:30.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.881+0000 7fdd91806800 1 -- start start 2024-05-08T18:52:30.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.881+0000 7fdd91806800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55a53c8666a0 0x55a53c868a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.881+0000 7fdd91806800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a53c869060 con 0x55a53c8622b0 2024-05-08T18:52:30.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.881+0000 7fdd91806800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55a53c702e20 con 0x55a53c8666a0 2024-05-08T18:52:30.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.882+0000 7fdd8eafd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55a53c8666a0 0x55a53c868a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.882+0000 7fdd8f2fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55a53c8622b0 0x55a53c8626d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48016/0 (socket says 172.21.15.132:48016) 2024-05-08T18:52:30.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.882+0000 7fdd8eafd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55a53c8666a0 0x55a53c868a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52692/0 (socket says 172.21.15.132:52692) 2024-05-08T18:52:30.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.882+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/900370853 learned_addr learned my addr 172.21.15.132:0/900370853 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:52:30.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.882+0000 7fdd8eafd640 1 -- 172.21.15.132:0/900370853 >> v1:172.21.15.42:6789/0 conn(0x55a53c8622b0 legacy=0x55a53c8626d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.882+0000 7fdd8eafd640 1 -- 172.21.15.132:0/900370853 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a53c86a290 con 0x55a53c8666a0 2024-05-08T18:52:30.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.884+0000 7fdd8eafd640 1 --2- 172.21.15.132:0/900370853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c8666a0 0x55a53c868a90 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400a470 tx=0x7fdd8401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29d08987ccd49fc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.884+0000 7fdd8e2fc640 1 -- 172.21.15.132:0/900370853 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd84057070 con 0x55a53c8666a0 2024-05-08T18:52:30.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.884+0000 7fdd8e2fc640 1 -- 172.21.15.132:0/900370853 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd84052570 con 0x55a53c8666a0 2024-05-08T18:52:30.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.884+0000 7fdd8e2fc640 1 -- 172.21.15.132:0/900370853 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd84052870 con 0x55a53c8666a0 2024-05-08T18:52:30.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.885+0000 7fdd91806800 1 -- 172.21.15.132:0/900370853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c8666a0 msgr2=0x55a53c868a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.885+0000 7fdd91806800 1 --2- 172.21.15.132:0/900370853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c8666a0 0x55a53c868a90 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400a470 tx=0x7fdd8401ce90 comp rx=0 tx=0).stop 2024-05-08T18:52:30.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.885+0000 7fdd91806800 1 -- 172.21.15.132:0/900370853 shutdown_connections 2024-05-08T18:52:30.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.885+0000 7fdd91806800 1 --2- 172.21.15.132:0/900370853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c8666a0 0x55a53c868a90 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.885+0000 7fdd91806800 1 -- 172.21.15.132:0/900370853 >> 172.21.15.132:0/900370853 conn(0x55a53c85d830 msgr2=0x55a53c85fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:30.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.885+0000 7fdd91806800 1 -- 172.21.15.132:0/900370853 shutdown_connections 2024-05-08T18:52:30.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.885+0000 7fdd91806800 1 -- 172.21.15.132:0/900370853 wait complete. 2024-05-08T18:52:30.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.899+0000 7fdd91806800 1 Processor -- start 2024-05-08T18:52:30.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.899+0000 7fdd91806800 1 -- start start 2024-05-08T18:52:30.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.899+0000 7fdd91806800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c8622b0 0x55a53c953620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.899+0000 7fdd91806800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a53c7ad5b0 con 0x55a53c8622b0 2024-05-08T18:52:30.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.899+0000 7fdd8f2fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c8622b0 0x55a53c953620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.899+0000 7fdd8f2fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c8622b0 0x55a53c953620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52698/0 (socket says 172.21.15.132:52698) 2024-05-08T18:52:30.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.899+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/4123230197 learned_addr learned my addr 172.21.15.132:0/4123230197 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:30.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.900+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/4123230197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a53c953bf0 con 0x55a53c8622b0 2024-05-08T18:52:30.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.900+0000 7fdd8f2fe640 1 --2- 172.21.15.132:0/4123230197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c8622b0 0x55a53c953620 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdd80001e10 tx=0x7fdd8000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e6d7ce6b2bd3f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.900+0000 7fdc7d60a640 1 -- 172.21.15.132:0/4123230197 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd80012020 con 0x55a53c8622b0 2024-05-08T18:52:30.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.900+0000 7fdc7d60a640 1 -- 172.21.15.132:0/4123230197 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd8000e5a0 con 0x55a53c8622b0 2024-05-08T18:52:30.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.900+0000 7fdc7d60a640 1 -- 172.21.15.132:0/4123230197 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd8000e8e0 con 0x55a53c8622b0 2024-05-08T18:52:30.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.901+0000 7fdd91806800 1 -- 172.21.15.132:0/4123230197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c8622b0 msgr2=0x55a53c953620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.901+0000 7fdd91806800 1 --2- 172.21.15.132:0/4123230197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c8622b0 0x55a53c953620 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdd80001e10 tx=0x7fdd8000b780 comp rx=0 tx=0).stop 2024-05-08T18:52:30.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.901+0000 7fdd91806800 1 -- 172.21.15.132:0/4123230197 shutdown_connections 2024-05-08T18:52:30.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.901+0000 7fdd91806800 1 --2- 172.21.15.132:0/4123230197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c8622b0 0x55a53c953620 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.901+0000 7fdd91806800 1 -- 172.21.15.132:0/4123230197 >> 172.21.15.132:0/4123230197 conn(0x55a53c85d830 msgr2=0x55a53c94ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:30.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.901+0000 7fdd91806800 1 -- 172.21.15.132:0/4123230197 shutdown_connections 2024-05-08T18:52:30.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.901+0000 7fdd91806800 1 -- 172.21.15.132:0/4123230197 wait complete. 2024-05-08T18:52:30.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.901+0000 7fdd91806800 1 Processor -- start 2024-05-08T18:52:30.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.901+0000 7fdd91806800 1 -- start start 2024-05-08T18:52:30.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.901+0000 7fdd91806800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c8622b0 0x55a53c95b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.901+0000 7fdd91806800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a53c869530 con 0x55a53c8622b0 2024-05-08T18:52:30.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.902+0000 7fdd8f2fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c8622b0 0x55a53c95b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.902+0000 7fdd8f2fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c8622b0 0x55a53c95b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52700/0 (socket says 172.21.15.132:52700) 2024-05-08T18:52:30.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.902+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/2527194801 learned_addr learned my addr 172.21.15.132:0/2527194801 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:30.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.902+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/2527194801 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a53c95b6d0 con 0x55a53c8622b0 2024-05-08T18:52:30.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.902+0000 7fdd8f2fe640 1 --2- 172.21.15.132:0/2527194801 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c8622b0 0x55a53c95b190 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fdd80001e10 tx=0x7fdd80000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.902+0000 7fdc7be07640 1 -- 172.21.15.132:0/2527194801 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd80012030 con 0x55a53c8622b0 2024-05-08T18:52:30.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.902+0000 7fdc7be07640 1 -- 172.21.15.132:0/2527194801 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd8001a7a0 con 0x55a53c8622b0 2024-05-08T18:52:30.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.902+0000 7fdd91806800 1 -- 172.21.15.132:0/2527194801 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a53c95b960 con 0x55a53c8622b0 2024-05-08T18:52:30.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.902+0000 7fdc7be07640 1 -- 172.21.15.132:0/2527194801 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd8001aac0 con 0x55a53c8622b0 2024-05-08T18:52:30.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.902+0000 7fdd91806800 1 -- 172.21.15.132:0/2527194801 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a53c95e610 con 0x55a53c8622b0 2024-05-08T18:52:30.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.903+0000 7fdc7be07640 1 -- 172.21.15.132:0/2527194801 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fdd80015020 con 0x55a53c8622b0 2024-05-08T18:52:30.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.904+0000 7fdc7be07640 1 --2- 172.21.15.132:0/2527194801 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc7403bb50 0x7fdc7403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.904+0000 7fdc7be07640 1 -- 172.21.15.132:0/2527194801 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fdd80020030 con 0x55a53c8622b0 2024-05-08T18:52:30.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.904+0000 7fdd8eafd640 1 --2- 172.21.15.132:0/2527194801 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc7403bb50 0x7fdc7403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.904+0000 7fdd91806800 1 --2- 172.21.15.132:0/2527194801 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a53c8666a0 0x55a53c9623d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.904+0000 7fdd91806800 1 -- 172.21.15.132:0/2527194801 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a53c962960 con 0x55a53c8666a0 2024-05-08T18:52:30.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.904+0000 7fdd8faff640 1 --2- 172.21.15.132:0/2527194801 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a53c8666a0 0x55a53c9623d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.904+0000 7fdd8eafd640 1 --2- 172.21.15.132:0/2527194801 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc7403bb50 0x7fdc7403e010 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdd84054000 tx=0x7fdd8404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.904+0000 7fdd8faff640 1 --2- 172.21.15.132:0/2527194801 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a53c8666a0 0x55a53c9623d0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.904+0000 7fdd8faff640 1 -- 172.21.15.132:0/2527194801 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd8800a4a0 con 0x55a53c8666a0 2024-05-08T18:52:30.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.904+0000 7fdd91806800 1 -- 172.21.15.132:0/2527194801 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a53c95f9a0 con 0x55a53c8666a0 2024-05-08T18:52:30.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.905+0000 7fdd8faff640 1 -- 172.21.15.132:0/2527194801 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdd8800a4a0 con 0x55a53c8666a0 2024-05-08T18:52:30.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.905+0000 7fdd91806800 1 --2- 172.21.15.132:0/2527194801 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a53c964c90 0x55a53c967080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.905+0000 7fdd91806800 1 -- 172.21.15.132:0/2527194801 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a53c967720 con 0x55a53c964c90 2024-05-08T18:52:30.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.905+0000 7fdd8f2fe640 1 --2- 172.21.15.132:0/2527194801 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a53c964c90 0x55a53c967080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.905+0000 7fdd8f2fe640 1 --2- 172.21.15.132:0/2527194801 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a53c964c90 0x55a53c967080 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.905+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/2527194801 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdd80018430 con 0x55a53c964c90 2024-05-08T18:52:30.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.905+0000 7fdd91806800 1 -- 172.21.15.132:0/2527194801 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a53c963b30 con 0x55a53c8666a0 2024-05-08T18:52:30.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.906+0000 7fdd8faff640 1 -- 172.21.15.132:0/2527194801 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdd8800a4a0 con 0x55a53c8666a0 2024-05-08T18:52:30.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.906+0000 7fdd91806800 1 -- 172.21.15.132:0/2527194801 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a53c964010 con 0x55a53c8666a0 2024-05-08T18:52:30.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.906+0000 7fdd8faff640 1 -- 172.21.15.132:0/2527194801 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdd8800a4a0 con 0x55a53c8666a0 2024-05-08T18:52:30.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.906+0000 7fdd91806800 1 Processor -- start 2024-05-08T18:52:30.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.906+0000 7fdd91806800 1 -- start start 2024-05-08T18:52:30.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.906+0000 7fdd91806800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c9766a0 0x55a53c976ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.906+0000 7fdd91806800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a53c753fc0 con 0x55a53c9766a0 2024-05-08T18:52:30.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.907+0000 7fdd8faff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c9766a0 0x55a53c976ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.907+0000 7fdd8faff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c9766a0 0x55a53c976ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52706/0 (socket says 172.21.15.132:52706) 2024-05-08T18:52:30.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.907+0000 7fdd8faff640 1 -- 172.21.15.132:0/3371507733 learned_addr learned my addr 172.21.15.132:0/3371507733 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:30.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.907+0000 7fdd8faff640 1 -- 172.21.15.132:0/3371507733 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a53c977000 con 0x55a53c9766a0 2024-05-08T18:52:30.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.907+0000 7fdd8faff640 1 --2- 172.21.15.132:0/3371507733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c9766a0 0x55a53c976ac0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x55a53c95c060 tx=0x7fdd880188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.907+0000 7fdc79602640 1 -- 172.21.15.132:0/3371507733 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd88014450 con 0x55a53c9766a0 2024-05-08T18:52:30.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.908+0000 7fdc79602640 1 -- 172.21.15.132:0/3371507733 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd880145f0 con 0x55a53c9766a0 2024-05-08T18:52:30.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.908+0000 7fdd91806800 1 -- 172.21.15.132:0/3371507733 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a53c977a70 con 0x55a53c9766a0 2024-05-08T18:52:30.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.908+0000 7fdc79602640 1 -- 172.21.15.132:0/3371507733 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd880148d0 con 0x55a53c9766a0 2024-05-08T18:52:30.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.908+0000 7fdd91806800 1 -- 172.21.15.132:0/3371507733 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a53c977f70 con 0x55a53c9766a0 2024-05-08T18:52:30.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.909+0000 7fdc79602640 1 -- 172.21.15.132:0/3371507733 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fdd88011040 con 0x55a53c9766a0 2024-05-08T18:52:30.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.909+0000 7fdc79602640 1 --2- 172.21.15.132:0/3371507733 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc6803bba0 0x7fdc6803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.909+0000 7fdc79602640 1 -- 172.21.15.132:0/3371507733 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fdd8801e070 con 0x55a53c9766a0 2024-05-08T18:52:30.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.909+0000 7fdd8f2fe640 1 --2- 172.21.15.132:0/3371507733 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc6803bba0 0x7fdc6803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.909+0000 7fdd91806800 1 Processor -- start 2024-05-08T18:52:30.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.909+0000 7fdd8f2fe640 1 --2- 172.21.15.132:0/3371507733 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc6803bba0 0x7fdc6803e060 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55a53c962db0 tx=0x7fdd8000bf70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.909+0000 7fdd91806800 1 -- start start 2024-05-08T18:52:30.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.909+0000 7fdd91806800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c983960 0x55a53c983d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.909+0000 7fdd91806800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a53c953f70 con 0x55a53c983960 2024-05-08T18:52:30.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.910+0000 7fdd8faff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c983960 0x55a53c983d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.910+0000 7fdd8faff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c983960 0x55a53c983d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52720/0 (socket says 172.21.15.132:52720) 2024-05-08T18:52:30.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.910+0000 7fdd8faff640 1 -- 172.21.15.132:0/1689695774 learned_addr learned my addr 172.21.15.132:0/1689695774 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:30.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.910+0000 7fdd8faff640 1 -- 172.21.15.132:0/1689695774 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a53c984350 con 0x55a53c983960 2024-05-08T18:52:30.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.910+0000 7fdd8faff640 1 --2- 172.21.15.132:0/1689695774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c983960 0x55a53c983d80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fdd88005a80 tx=0x7fdd880013d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b3039e2a9c9409 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.910+0000 7fdc72ffd640 1 -- 172.21.15.132:0/1689695774 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd880168f0 con 0x55a53c983960 2024-05-08T18:52:30.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.910+0000 7fdc72ffd640 1 -- 172.21.15.132:0/1689695774 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd88016a90 con 0x55a53c983960 2024-05-08T18:52:30.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.910+0000 7fdc72ffd640 1 -- 172.21.15.132:0/1689695774 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd88014ba0 con 0x55a53c983960 2024-05-08T18:52:30.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.911+0000 7fdd91806800 1 -- 172.21.15.132:0/1689695774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c983960 msgr2=0x55a53c983d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.911+0000 7fdd91806800 1 --2- 172.21.15.132:0/1689695774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c983960 0x55a53c983d80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fdd88005a80 tx=0x7fdd880013d0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.911+0000 7fdd91806800 1 -- 172.21.15.132:0/1689695774 shutdown_connections 2024-05-08T18:52:30.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.911+0000 7fdd91806800 1 --2- 172.21.15.132:0/1689695774 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c983960 0x55a53c983d80 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.911+0000 7fdd91806800 1 -- 172.21.15.132:0/1689695774 >> 172.21.15.132:0/1689695774 conn(0x55a53c97fcc0 msgr2=0x55a53c97dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:30.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.911+0000 7fdd91806800 1 -- 172.21.15.132:0/1689695774 shutdown_connections 2024-05-08T18:52:30.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.911+0000 7fdd91806800 1 -- 172.21.15.132:0/1689695774 wait complete. 2024-05-08T18:52:30.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.911+0000 7fdd91806800 1 Processor -- start 2024-05-08T18:52:30.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.911+0000 7fdd91806800 1 -- start start 2024-05-08T18:52:30.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.911+0000 7fdd91806800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c983960 0x55a53c98af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.911+0000 7fdd91806800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55a53c984ac0 con 0x55a53c983960 2024-05-08T18:52:30.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.912+0000 7fdd8faff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c983960 0x55a53c98af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.912+0000 7fdd8faff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c983960 0x55a53c98af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52728/0 (socket says 172.21.15.132:52728) 2024-05-08T18:52:30.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.912+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 learned_addr learned my addr 172.21.15.132:0/3034818544 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:30.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.912+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a53c98b490 con 0x55a53c983960 2024-05-08T18:52:30.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.912+0000 7fdd8faff640 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c983960 0x55a53c98af50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fdd88052f40 tx=0x7fdd88052bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.912+0000 7fdc717fa640 1 -- 172.21.15.132:0/3034818544 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd880543d0 con 0x55a53c983960 2024-05-08T18:52:30.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.912+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a53c98b720 con 0x55a53c983960 2024-05-08T18:52:30.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.912+0000 7fdc717fa640 1 -- 172.21.15.132:0/3034818544 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd88054570 con 0x55a53c983960 2024-05-08T18:52:30.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.912+0000 7fdc717fa640 1 -- 172.21.15.132:0/3034818544 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd8802b480 con 0x55a53c983960 2024-05-08T18:52:30.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.912+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a53c98e3d0 con 0x55a53c983960 2024-05-08T18:52:30.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.913+0000 7fdc717fa640 1 -- 172.21.15.132:0/3034818544 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fdd8804e040 con 0x55a53c983960 2024-05-08T18:52:30.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.913+0000 7fdd91806800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.913+0000 7fdc717fa640 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc5803bb50 0x7fdc5803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.913+0000 7fdc717fa640 1 -- 172.21.15.132:0/3034818544 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fdd8800e040 con 0x55a53c983960 2024-05-08T18:52:30.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.913+0000 7fdd8f2fe640 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc5803bb50 0x7fdc5803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.914+0000 7fdd91806800 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a53c996a20 0x55a53c998ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.914+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a53c999610 con 0x55a53c996a20 2024-05-08T18:52:30.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.914+0000 7fdd8eafd640 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a53c996a20 0x55a53c998ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.914+0000 7fdd8f2fe640 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc5803bb50 0x7fdc5803e010 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdd8000b7c0 tx=0x7fdd80017f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.914+0000 7fdd8eafd640 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a53c996a20 0x55a53c998ec0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.914+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd8405a040 con 0x55a53c996a20 2024-05-08T18:52:30.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.914+0000 7fdd91806800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.914+0000 7fdd91806800 20 realm 2024-05-08T18:52:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.914+0000 7fdd91806800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.914+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9999e0 con 0x55a53c996a20 2024-05-08T18:52:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.914+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd8405a040 con 0x55a53c996a20 2024-05-08T18:52:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.914+0000 7fdd91806800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.914+0000 7fdd91806800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:52:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.914+0000 7fdd91806800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.914+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99a280 con 0x55a53c996a20 2024-05-08T18:52:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.915+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd8405a040 con 0x55a53c996a20 2024-05-08T18:52:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.915+0000 7fdd91806800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.915+0000 7fdd91806800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.915+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99a620 con 0x55a53c996a20 2024-05-08T18:52:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.915+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdd8405a040 con 0x55a53c996a20 2024-05-08T18:52:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.915+0000 7fdd91806800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.915+0000 7fdd91806800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.915+0000 7fdd91806800 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a53c99b380 0x55a53c99d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.915+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99dcb0 con 0x55a53c99b380 2024-05-08T18:52:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.915+0000 7fdd8faff640 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a53c99b380 0x55a53c99d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.915+0000 7fdd8faff640 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a53c99b380 0x55a53c99d770 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.916+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdd8802a070 con 0x55a53c99b380 2024-05-08T18:52:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.916+0000 7fdd91806800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:52:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.916+0000 7fdd91806800 20 searching for the correct realm 2024-05-08T18:52:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.916+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x55a53c99b380 2024-05-08T18:52:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.916+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8802a070 con 0x55a53c99b380 2024-05-08T18:52:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.916+0000 7fdd8faff640 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fdd88014070 0x7fdd8801ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.916+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x7fdd88014070 2024-05-08T18:52:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.916+0000 7fdd8f2fe640 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fdd88014070 0x7fdd8801ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.916+0000 7fdd8f2fe640 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fdd88014070 0x7fdd8801ba00 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.917+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/3034818544 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd80018430 con 0x7fdd88014070 2024-05-08T18:52:30.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.917+0000 7fdd8f2fe640 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fdd80017050 0x7fdd8000d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:30.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.917+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x7fdd80017050 2024-05-08T18:52:30.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.917+0000 7fdd8eafd640 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fdd80017050 0x7fdd8000d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:30.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.918+0000 7fdd8eafd640 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fdd80017050 0x7fdd8000d5f0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:30.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.918+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8405a040 con 0x7fdd80017050 2024-05-08T18:52:30.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.918+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x55a53c996a20 2024-05-08T18:52:30.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.918+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8405a040 con 0x55a53c996a20 2024-05-08T18:52:30.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.918+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x55a53c996a20 2024-05-08T18:52:30.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.918+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8405a040 con 0x55a53c996a20 2024-05-08T18:52:30.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.918+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x7fdd80017050 2024-05-08T18:52:30.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.919+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8405a040 con 0x7fdd80017050 2024-05-08T18:52:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.919+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x7fdd80017050 2024-05-08T18:52:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.919+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8405a040 con 0x7fdd80017050 2024-05-08T18:52:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.919+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x7fdd88014070 2024-05-08T18:52:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.919+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/3034818544 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd80018430 con 0x7fdd88014070 2024-05-08T18:52:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.919+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x55a53c99b380 2024-05-08T18:52:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.919+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8802a070 con 0x55a53c99b380 2024-05-08T18:52:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.919+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x55a53c996a20 2024-05-08T18:52:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.920+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8405a040 con 0x55a53c996a20 2024-05-08T18:52:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.920+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x7fdd80017050 2024-05-08T18:52:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.920+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8405a040 con 0x7fdd80017050 2024-05-08T18:52:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.920+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x55a53c996a20 2024-05-08T18:52:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.920+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdd8405a040 con 0x55a53c996a20 2024-05-08T18:52:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.920+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x7fdd88014070 2024-05-08T18:52:30.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.921+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/3034818544 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdd80018430 con 0x7fdd88014070 2024-05-08T18:52:30.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.921+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x55a53c99b380 2024-05-08T18:52:30.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.921+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdd8802a070 con 0x55a53c99b380 2024-05-08T18:52:30.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.921+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x55a53c99b380 2024-05-08T18:52:30.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.921+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8802a070 con 0x55a53c99b380 2024-05-08T18:52:30.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.921+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x7fdd80017050 2024-05-08T18:52:30.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.921+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8405a040 con 0x7fdd80017050 2024-05-08T18:52:30.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.921+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x55a53c99b380 2024-05-08T18:52:30.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.922+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8802a070 con 0x55a53c99b380 2024-05-08T18:52:30.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.922+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x55a53c99b380 2024-05-08T18:52:30.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.922+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8802a070 con 0x55a53c99b380 2024-05-08T18:52:30.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.922+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x55a53c996a20 2024-05-08T18:52:30.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.922+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8405a040 con 0x55a53c996a20 2024-05-08T18:52:30.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.922+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x55a53c996a20 2024-05-08T18:52:30.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.922+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdd8405a040 con 0x55a53c996a20 2024-05-08T18:52:30.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.922+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x7fdd80017050 2024-05-08T18:52:30.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.923+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8407d040 con 0x7fdd80017050 2024-05-08T18:52:30.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.923+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x55a53c99b380 2024-05-08T18:52:30.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.923+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8802a070 con 0x55a53c99b380 2024-05-08T18:52:30.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.923+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x7fdd88014070 2024-05-08T18:52:30.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.923+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/3034818544 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd80018430 con 0x7fdd88014070 2024-05-08T18:52:30.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.923+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x55a53c996a20 2024-05-08T18:52:30.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.924+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8407d040 con 0x55a53c996a20 2024-05-08T18:52:30.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.924+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x7fdd88014070 2024-05-08T18:52:30.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.924+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/3034818544 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd80018430 con 0x7fdd88014070 2024-05-08T18:52:30.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.924+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x55a53c99b380 2024-05-08T18:52:30.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.924+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8802a070 con 0x55a53c99b380 2024-05-08T18:52:30.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.924+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x7fdd80017050 2024-05-08T18:52:30.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.924+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8407d040 con 0x7fdd80017050 2024-05-08T18:52:30.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.924+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x7fdd88014070 2024-05-08T18:52:30.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.925+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/3034818544 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd80018430 con 0x7fdd88014070 2024-05-08T18:52:30.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.925+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x55a53c99b380 2024-05-08T18:52:30.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.925+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8802a070 con 0x55a53c99b380 2024-05-08T18:52:30.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.925+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x7fdd80017050 2024-05-08T18:52:30.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.925+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd8407d040 con 0x7fdd80017050 2024-05-08T18:52:30.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.925+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x55a53c996a20 2024-05-08T18:52:30.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.926+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdd8407d040 con 0x55a53c996a20 2024-05-08T18:52:30.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.926+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99f660 con 0x7fdd88014070 2024-05-08T18:52:30.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.926+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/3034818544 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd80018430 con 0x7fdd88014070 2024-05-08T18:52:30.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.926+0000 7fdd91806800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:52:30.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.926+0000 7fdd91806800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:52:30.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.926+0000 7fdd91806800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:52:30.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.926+0000 7fdd91806800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:52:30.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.926+0000 7fdd91806800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:52:30.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.926+0000 7fdd91806800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:52:30.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.926+0000 7fdd91806800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.926+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99e730 con 0x55a53c996a20 2024-05-08T18:52:30.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.926+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd8407d040 con 0x55a53c996a20 2024-05-08T18:52:30.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.926+0000 7fdd91806800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:30.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.926+0000 7fdd91806800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.926+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99efd0 con 0x55a53c996a20 2024-05-08T18:52:30.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.926+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdd8407d040 con 0x55a53c996a20 2024-05-08T18:52:30.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.926+0000 7fdd91806800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:30.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.926+0000 7fdd91806800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.926+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99e370 con 0x55a53c996a20 2024-05-08T18:52:30.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.926+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdd8407d040 con 0x55a53c996a20 2024-05-08T18:52:30.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.926+0000 7fdd91806800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:52:30.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.927+0000 7fdd91806800 20 zone default found 2024-05-08T18:52:30.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.927+0000 7fdd91806800 4 Realm: () 2024-05-08T18:52:30.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.927+0000 7fdd91806800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:52:30.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.927+0000 7fdd91806800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:52:30.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.927+0000 7fdd91806800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:52:30.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.927+0000 7fdd91806800 20 zonegroup default 2024-05-08T18:52:30.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.927+0000 7fdd91806800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.927+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a53c99ffe0 con 0x7fdd88014070 2024-05-08T18:52:30.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.927+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/3034818544 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdd80018430 con 0x7fdd88014070 2024-05-08T18:52:30.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.927+0000 7fdd91806800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:30.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.927+0000 7fdd91806800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.927+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a1df0 con 0x55a53c99b380 2024-05-08T18:52:30.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.927+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdd8802a070 con 0x55a53c99b380 2024-05-08T18:52:30.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.927+0000 7fdd91806800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:30.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.927+0000 7fdd91806800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.927+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a22e0 con 0x55a53c99b380 2024-05-08T18:52:30.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.927+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdd8802a070 con 0x55a53c99b380 2024-05-08T18:52:30.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.927+0000 7fdd91806800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:30.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.927+0000 7fdd91806800 20 started sync module instance, tier type = 2024-05-08T18:52:30.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.927+0000 7fdd91806800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:52:30.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.927+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a1200 con 0x7fdd88014070 2024-05-08T18:52:30.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.928+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/3034818544 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd80018430 con 0x7fdd88014070 2024-05-08T18:52:30.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.928+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94168174695920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a2bf0 con 0x7fdd88014070 2024-05-08T18:52:30.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.928+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a3440 con 0x55a53c996a20 2024-05-08T18:52:30.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.929+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/3034818544 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94168174695920] v27'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd80018430 con 0x7fdd88014070 2024-05-08T18:52:30.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.930+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8407d040 con 0x55a53c996a20 2024-05-08T18:52:30.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.930+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94168174700352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a34a0 con 0x55a53c996a20 2024-05-08T18:52:30.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.930+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a3fb0 con 0x55a53c99b380 2024-05-08T18:52:30.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.931+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94168174700352] v27'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8407d040 con 0x55a53c996a20 2024-05-08T18:52:30.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.931+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8802a070 con 0x55a53c99b380 2024-05-08T18:52:30.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.931+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94168174705248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a3f70 con 0x55a53c99b380 2024-05-08T18:52:30.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.931+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a4a60 con 0x7fdd88014070 2024-05-08T18:52:30.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.932+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/3034818544 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd80018430 con 0x7fdd88014070 2024-05-08T18:52:30.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.932+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94168174705248] v27'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8802a070 con 0x55a53c99b380 2024-05-08T18:52:30.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.932+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94168174708080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a4a60 con 0x7fdd88014070 2024-05-08T18:52:30.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.932+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a2f90 con 0x55a53c996a20 2024-05-08T18:52:30.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.933+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/3034818544 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94168174708080] v27'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd80018430 con 0x7fdd88014070 2024-05-08T18:52:30.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.933+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8407d040 con 0x55a53c996a20 2024-05-08T18:52:30.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.933+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94168174710352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a2f90 con 0x55a53c996a20 2024-05-08T18:52:30.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.933+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a6020 con 0x7fdd80017050 2024-05-08T18:52:30.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.935+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8407d040 con 0x7fdd80017050 2024-05-08T18:52:30.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.935+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94168174713712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a6440 con 0x7fdd80017050 2024-05-08T18:52:30.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.935+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a6ef0 con 0x7fdd80017050 2024-05-08T18:52:30.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.935+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94168174710352] v27'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8407d040 con 0x55a53c996a20 2024-05-08T18:52:30.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.936+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94168174713712] v27'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8407d040 con 0x7fdd80017050 2024-05-08T18:52:30.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.936+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8407d040 con 0x7fdd80017050 2024-05-08T18:52:30.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.936+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94168174712144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a5f90 con 0x7fdd80017050 2024-05-08T18:52:30.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.936+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a7580 con 0x7fdd80017050 2024-05-08T18:52:30.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.937+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94168174712144] v27'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8407d040 con 0x7fdd80017050 2024-05-08T18:52:30.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.937+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8407d040 con 0x7fdd80017050 2024-05-08T18:52:30.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.937+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94168174717392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a7580 con 0x7fdd80017050 2024-05-08T18:52:30.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.937+0000 7fdd91806800 20 add_watcher() i=0 2024-05-08T18:52:30.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.937+0000 7fdd91806800 20 add_watcher() i=1 2024-05-08T18:52:30.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.937+0000 7fdd91806800 20 add_watcher() i=2 2024-05-08T18:52:30.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.937+0000 7fdd91806800 20 add_watcher() i=3 2024-05-08T18:52:30.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.937+0000 7fdd91806800 20 add_watcher() i=4 2024-05-08T18:52:30.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.937+0000 7fdd91806800 20 add_watcher() i=5 2024-05-08T18:52:30.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.937+0000 7fdd91806800 20 add_watcher() i=6 2024-05-08T18:52:30.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.938+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94168174717392] v27'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8407d040 con 0x7fdd80017050 2024-05-08T18:52:30.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.938+0000 7fdd91806800 20 add_watcher() i=7 2024-05-08T18:52:30.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.938+0000 7fdd91806800 2 all 8 watchers are set, enabling cache 2024-05-08T18:52:30.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.938+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9aa710 con 0x55a53c996a20 2024-05-08T18:52:30.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.938+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdd8407d040 con 0x55a53c996a20 2024-05-08T18:52:30.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.939+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94168174719184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a79a0 con 0x55a53c996a20 2024-05-08T18:52:30.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.939+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94168174719184] v27'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd8407d040 con 0x55a53c996a20 2024-05-08T18:52:30.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.940+0000 7fdc45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:30.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.940+0000 7fdd91806800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:30.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.940+0000 7fdd91806800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:30.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.940+0000 7fdd91806800 5 note: GC not initialized 2024-05-08T18:52:30.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.940+0000 7fdc44fe1640 20 reqs_thread_entry: start 2024-05-08T18:52:30.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.940+0000 7fdd91806800 20 init_complete bucket index max shards: 11 2024-05-08T18:52:30.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.940+0000 7fdd91806800 20 Filter name: none 2024-05-08T18:52:30.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.940+0000 7fdbbe7fc640 20 reqs_thread_entry: start 2024-05-08T18:52:30.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.940+0000 7fdd91806800 20 rados->read ofs=0 len=0 2024-05-08T18:52:30.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.940+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9dd780 con 0x55a53c996a20 2024-05-08T18:52:30.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.941+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fdd8407d040 con 0x55a53c996a20 2024-05-08T18:52:30.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.941+0000 7fdd91806800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:52:30.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.941+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9deb70 con 0x7fdd80017050 2024-05-08T18:52:30.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.941+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7fdd8407d040 con 0x7fdd80017050 2024-05-08T18:52:30.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.942+0000 7fdc45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:30.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.942+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94168174719184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a9710 con 0x55a53c996a20 2024-05-08T18:52:30.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.943+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94168174719184] v27'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd8407d040 con 0x55a53c996a20 2024-05-08T18:52:30.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.943+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94168174695920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a70d0 con 0x7fdd88014070 2024-05-08T18:52:30.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.944+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/3034818544 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94168174695920] v27'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd80018430 con 0x7fdd88014070 2024-05-08T18:52:30.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.944+0000 7fdd91806800 20 remove_watcher() i=0 2024-05-08T18:52:30.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.944+0000 7fdd91806800 2 removed watcher, disabling cache 2024-05-08T18:52:30.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.944+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94168174700352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a70d0 con 0x55a53c996a20 2024-05-08T18:52:30.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.945+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94168174700352] v27'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8407d040 con 0x55a53c996a20 2024-05-08T18:52:30.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.945+0000 7fdd91806800 20 remove_watcher() i=1 2024-05-08T18:52:30.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.946+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94168174705248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a2740 con 0x55a53c99b380 2024-05-08T18:52:30.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.947+0000 7fdd8faff640 1 -- 172.21.15.132:0/3034818544 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94168174705248] v27'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8802a070 con 0x55a53c99b380 2024-05-08T18:52:30.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.947+0000 7fdd91806800 20 remove_watcher() i=2 2024-05-08T18:52:30.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.947+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94168174708080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a70d0 con 0x7fdd88014070 2024-05-08T18:52:30.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.948+0000 7fdd8f2fe640 1 -- 172.21.15.132:0/3034818544 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94168174708080] v27'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd80018430 con 0x7fdd88014070 2024-05-08T18:52:30.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.948+0000 7fdd91806800 20 remove_watcher() i=3 2024-05-08T18:52:30.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.948+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94168174710352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a3a60 con 0x55a53c996a20 2024-05-08T18:52:30.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.949+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94168174710352] v27'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8407d040 con 0x55a53c996a20 2024-05-08T18:52:30.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.949+0000 7fdd91806800 20 remove_watcher() i=4 2024-05-08T18:52:30.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.949+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94168174713712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a2740 con 0x7fdd80017050 2024-05-08T18:52:30.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.950+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94168174713712] v27'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8407d040 con 0x7fdd80017050 2024-05-08T18:52:30.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.950+0000 7fdd91806800 20 remove_watcher() i=5 2024-05-08T18:52:30.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.950+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94168174712144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a70d0 con 0x7fdd80017050 2024-05-08T18:52:30.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.951+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94168174712144] v27'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8407d040 con 0x7fdd80017050 2024-05-08T18:52:30.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.951+0000 7fdd91806800 20 remove_watcher() i=6 2024-05-08T18:52:30.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.951+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94168174717392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55a53c9a3a60 con 0x7fdd80017050 2024-05-08T18:52:30.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94168174717392] v27'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd8407d040 con 0x7fdd80017050 2024-05-08T18:52:30.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 20 remove_watcher() i=7 2024-05-08T18:52:30.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fdd80017050 msgr2=0x7fdd8000d5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fdd80017050 0x7fdd8000d5f0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a53c996a20 msgr2=0x55a53c998ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a53c996a20 0x55a53c998ec0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fdd88014070 msgr2=0x7fdd8801ba00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fdd88014070 0x7fdd8801ba00 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a53c99b380 msgr2=0x55a53c99d770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a53c99b380 0x55a53c99d770 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc5803bb50 msgr2=0x7fdc5803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc5803bb50 0x7fdc5803e010 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdd8000b7c0 tx=0x7fdd80017f90 comp rx=0 tx=0).stop 2024-05-08T18:52:30.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c983960 msgr2=0x55a53c98af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd8eafd640 1 -- 172.21.15.132:0/3034818544 reap_dead start 2024-05-08T18:52:30.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c983960 0x55a53c98af50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fdd88052f40 tx=0x7fdd88052bb0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 shutdown_connections 2024-05-08T18:52:30.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 --2- 172.21.15.132:0/3034818544 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c983960 0x55a53c98af50 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 >> 172.21.15.132:0/3034818544 conn(0x55a53c97fcc0 msgr2=0x55a53c97d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:30.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 shutdown_connections 2024-05-08T18:52:30.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 -- 172.21.15.132:0/3034818544 wait complete. 2024-05-08T18:52:30.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 -- 172.21.15.132:0/3371507733 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc6803bba0 msgr2=0x7fdc6803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 --2- 172.21.15.132:0/3371507733 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc6803bba0 0x7fdc6803e060 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55a53c962db0 tx=0x7fdd8000bf70 comp rx=0 tx=0).stop 2024-05-08T18:52:30.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 -- 172.21.15.132:0/3371507733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c9766a0 msgr2=0x55a53c976ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 --2- 172.21.15.132:0/3371507733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c9766a0 0x55a53c976ac0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x55a53c95c060 tx=0x7fdd880188f0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 -- 172.21.15.132:0/3371507733 shutdown_connections 2024-05-08T18:52:30.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 --2- 172.21.15.132:0/3371507733 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc6803bba0 0x7fdc6803e060 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 --2- 172.21.15.132:0/3371507733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c9766a0 0x55a53c976ac0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 -- 172.21.15.132:0/3371507733 >> 172.21.15.132:0/3371507733 conn(0x55a53c96a740 msgr2=0x55a53c96ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:30.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 -- 172.21.15.132:0/3371507733 shutdown_connections 2024-05-08T18:52:30.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.953+0000 7fdd91806800 1 -- 172.21.15.132:0/3371507733 wait complete. 2024-05-08T18:52:30.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.954+0000 7fdd91806800 1 -- 172.21.15.132:0/2527194801 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a53c8666a0 msgr2=0x55a53c9623d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.954+0000 7fdd91806800 1 --2- 172.21.15.132:0/2527194801 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a53c8666a0 0x55a53c9623d0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.954+0000 7fdd91806800 1 -- 172.21.15.132:0/2527194801 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a53c964c90 msgr2=0x55a53c967080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.954+0000 7fdd91806800 1 --2- 172.21.15.132:0/2527194801 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a53c964c90 0x55a53c967080 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.954+0000 7fdd91806800 1 -- 172.21.15.132:0/2527194801 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc7403bb50 msgr2=0x7fdc7403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.954+0000 7fdd91806800 1 --2- 172.21.15.132:0/2527194801 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc7403bb50 0x7fdc7403e010 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdd84054000 tx=0x7fdd8404e000 comp rx=0 tx=0).stop 2024-05-08T18:52:30.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.954+0000 7fdd91806800 1 -- 172.21.15.132:0/2527194801 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c8622b0 msgr2=0x55a53c95b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:30.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.954+0000 7fdd91806800 1 --2- 172.21.15.132:0/2527194801 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c8622b0 0x55a53c95b190 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fdd80001e10 tx=0x7fdd80000ed0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.954+0000 7fdd91806800 1 -- 172.21.15.132:0/2527194801 shutdown_connections 2024-05-08T18:52:30.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.954+0000 7fdd91806800 1 --2- 172.21.15.132:0/2527194801 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55a53c964c90 0x55a53c967080 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.954+0000 7fdd91806800 1 --2- 172.21.15.132:0/2527194801 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55a53c8666a0 0x55a53c9623d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.954+0000 7fdd91806800 1 --2- 172.21.15.132:0/2527194801 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdc7403bb50 0x7fdc7403e010 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.954+0000 7fdd91806800 1 --2- 172.21.15.132:0/2527194801 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a53c8622b0 0x55a53c95b190 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:30.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.954+0000 7fdd91806800 1 -- 172.21.15.132:0/2527194801 >> 172.21.15.132:0/2527194801 conn(0x55a53c85d830 msgr2=0x55a53c94d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:30.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.954+0000 7fdd91806800 1 -- 172.21.15.132:0/2527194801 shutdown_connections 2024-05-08T18:52:30.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:30.954+0000 7fdd91806800 1 -- 172.21.15.132:0/2527194801 wait complete. 2024-05-08T18:52:30.962 INFO:teuthology.orchestra.run.smithi132.stdout:{"entries":[],"summary":[]} 2024-05-08T18:52:30.962 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-05-08T18:52:30.962 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-05-08T18:52:30.962 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-05-08T18:52:30.962 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-05-08T18:52:31.007 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:31.008 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:31.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.009+0000 7fcf4293e800 1 Processor -- start 2024-05-08T18:52:31.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.009+0000 7fcf4293e800 1 -- start start 2024-05-08T18:52:31.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.009+0000 7fcf4293e800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x558226c62b70 0x558226c62f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.009+0000 7fcf4293e800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558226bd7ef0 con 0x558226c634d0 2024-05-08T18:52:31.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.009+0000 7fcf4293e800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x558226b04e20 con 0x558226c62b70 2024-05-08T18:52:31.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.010+0000 7fcf40436640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x558226c62b70 0x558226c62f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.010+0000 7fcf40436640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x558226c62b70 0x558226c62f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52744/0 (socket says 172.21.15.132:52744) 2024-05-08T18:52:31.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.010+0000 7fcf40436640 1 -- 172.21.15.132:0/126133192 learned_addr learned my addr 172.21.15.132:0/126133192 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.010+0000 7fcf3fc35640 1 --1- 172.21.15.132:0/126133192 >> v1:172.21.15.42:6789/0 conn(0x558226c634d0 0x558226c63980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48032/0 (socket says 172.21.15.132:48032) 2024-05-08T18:52:31.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.010+0000 7fcf40436640 1 -- 172.21.15.132:0/126133192 >> v1:172.21.15.42:6789/0 conn(0x558226c634d0 legacy=0x558226c63980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.010+0000 7fcf40436640 1 -- 172.21.15.132:0/126133192 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558226c64090 con 0x558226c62b70 2024-05-08T18:52:31.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.012+0000 7fcf40436640 1 --2- 172.21.15.132:0/126133192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226c62b70 0x558226c62f90 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fcf38005fd0 tx=0x7fcf3801cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc5e28d5e224598 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.012+0000 7fcf3f434640 1 -- 172.21.15.132:0/126133192 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf38052540 con 0x558226c62b70 2024-05-08T18:52:31.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.012+0000 7fcf3f434640 1 -- 172.21.15.132:0/126133192 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf3804e070 con 0x558226c62b70 2024-05-08T18:52:31.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.012+0000 7fcf3f434640 1 -- 172.21.15.132:0/126133192 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf38052890 con 0x558226c62b70 2024-05-08T18:52:31.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.012+0000 7fcf4293e800 1 -- 172.21.15.132:0/126133192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226c62b70 msgr2=0x558226c62f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.012+0000 7fcf4293e800 1 --2- 172.21.15.132:0/126133192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226c62b70 0x558226c62f90 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fcf38005fd0 tx=0x7fcf3801cd80 comp rx=0 tx=0).stop 2024-05-08T18:52:31.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.013+0000 7fcf4293e800 1 -- 172.21.15.132:0/126133192 shutdown_connections 2024-05-08T18:52:31.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.013+0000 7fcf4293e800 1 --2- 172.21.15.132:0/126133192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226c62b70 0x558226c62f90 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.013+0000 7fcf4293e800 1 -- 172.21.15.132:0/126133192 >> 172.21.15.132:0/126133192 conn(0x558226c5e6b0 msgr2=0x558226c60b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.013+0000 7fcf4293e800 1 -- 172.21.15.132:0/126133192 shutdown_connections 2024-05-08T18:52:31.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.013+0000 7fcf4293e800 1 -- 172.21.15.132:0/126133192 wait complete. 2024-05-08T18:52:31.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.026+0000 7fcf4293e800 1 Processor -- start 2024-05-08T18:52:31.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.026+0000 7fcf4293e800 1 -- start start 2024-05-08T18:52:31.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.027+0000 7fcf4293e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226c62b70 0x558226d57a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.027+0000 7fcf4293e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558226baf5c0 con 0x558226c62b70 2024-05-08T18:52:31.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.027+0000 7fcf40436640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226c62b70 0x558226d57a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.027+0000 7fcf40436640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226c62b70 0x558226d57a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52758/0 (socket says 172.21.15.132:52758) 2024-05-08T18:52:31.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.027+0000 7fcf40436640 1 -- 172.21.15.132:0/3060255822 learned_addr learned my addr 172.21.15.132:0/3060255822 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.027+0000 7fcf40436640 1 -- 172.21.15.132:0/3060255822 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558226d57fe0 con 0x558226c62b70 2024-05-08T18:52:31.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.027+0000 7fcf40436640 1 --2- 172.21.15.132:0/3060255822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226c62b70 0x558226d57a10 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fcf3801ba70 tx=0x7fcf3804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08a0170a6a3be4b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.028+0000 7fce2e60c640 1 -- 172.21.15.132:0/3060255822 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf38052820 con 0x558226c62b70 2024-05-08T18:52:31.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.028+0000 7fce2e60c640 1 -- 172.21.15.132:0/3060255822 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf38062070 con 0x558226c62b70 2024-05-08T18:52:31.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.028+0000 7fce2e60c640 1 -- 172.21.15.132:0/3060255822 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf38052b10 con 0x558226c62b70 2024-05-08T18:52:31.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.028+0000 7fcf4293e800 1 -- 172.21.15.132:0/3060255822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226c62b70 msgr2=0x558226d57a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.028+0000 7fcf4293e800 1 --2- 172.21.15.132:0/3060255822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226c62b70 0x558226d57a10 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fcf3801ba70 tx=0x7fcf3804c000 comp rx=0 tx=0).stop 2024-05-08T18:52:31.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.028+0000 7fcf4293e800 1 -- 172.21.15.132:0/3060255822 shutdown_connections 2024-05-08T18:52:31.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.028+0000 7fcf4293e800 1 --2- 172.21.15.132:0/3060255822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226c62b70 0x558226d57a10 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.028+0000 7fcf4293e800 1 -- 172.21.15.132:0/3060255822 >> 172.21.15.132:0/3060255822 conn(0x558226c5e6b0 msgr2=0x558226d53330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.028+0000 7fcf4293e800 1 -- 172.21.15.132:0/3060255822 shutdown_connections 2024-05-08T18:52:31.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.028+0000 7fcf4293e800 1 -- 172.21.15.132:0/3060255822 wait complete. 2024-05-08T18:52:31.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.029+0000 7fcf4293e800 1 Processor -- start 2024-05-08T18:52:31.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.029+0000 7fcf4293e800 1 -- start start 2024-05-08T18:52:31.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.029+0000 7fcf4293e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226c62b70 0x558226d5f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.029+0000 7fcf4293e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558226c645c0 con 0x558226c62b70 2024-05-08T18:52:31.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.029+0000 7fcf40436640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226c62b70 0x558226d5f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.029+0000 7fcf40436640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226c62b70 0x558226d5f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52770/0 (socket says 172.21.15.132:52770) 2024-05-08T18:52:31.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.029+0000 7fcf40436640 1 -- 172.21.15.132:0/1869010018 learned_addr learned my addr 172.21.15.132:0/1869010018 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.029+0000 7fcf40436640 1 -- 172.21.15.132:0/1869010018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558226d5f9d0 con 0x558226c62b70 2024-05-08T18:52:31.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.030+0000 7fcf40436640 1 --2- 172.21.15.132:0/1869010018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226c62b70 0x558226d5f490 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800a190 tx=0x7fcf38003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.030+0000 7fce2ce09640 1 -- 172.21.15.132:0/1869010018 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf38071570 con 0x558226c62b70 2024-05-08T18:52:31.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.030+0000 7fce2ce09640 1 -- 172.21.15.132:0/1869010018 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf38058040 con 0x558226c62b70 2024-05-08T18:52:31.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.030+0000 7fcf4293e800 1 -- 172.21.15.132:0/1869010018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558226d5fc60 con 0x558226c62b70 2024-05-08T18:52:31.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.030+0000 7fce2ce09640 1 -- 172.21.15.132:0/1869010018 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf38071840 con 0x558226c62b70 2024-05-08T18:52:31.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.030+0000 7fcf4293e800 1 -- 172.21.15.132:0/1869010018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558226d628c0 con 0x558226c62b70 2024-05-08T18:52:31.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.031+0000 7fce2ce09640 1 -- 172.21.15.132:0/1869010018 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fcf38050070 con 0x558226c62b70 2024-05-08T18:52:31.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.031+0000 7fce2ce09640 1 --2- 172.21.15.132:0/1869010018 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fce2803bba0 0x7fce2803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.031+0000 7fce2ce09640 1 -- 172.21.15.132:0/1869010018 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fcf38094990 con 0x558226c62b70 2024-05-08T18:52:31.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.031+0000 7fcf3fc35640 1 --2- 172.21.15.132:0/1869010018 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fce2803bba0 0x7fce2803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.031+0000 7fcf4293e800 1 --2- 172.21.15.132:0/1869010018 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558226c634d0 0x558226d66680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.031+0000 7fcf4293e800 1 -- 172.21.15.132:0/1869010018 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226d66c00 con 0x558226c634d0 2024-05-08T18:52:31.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.031+0000 7fcf40c37640 1 --2- 172.21.15.132:0/1869010018 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558226c634d0 0x558226d66680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.031+0000 7fcf3fc35640 1 --2- 172.21.15.132:0/1869010018 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fce2803bba0 0x7fce2803e060 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcf28000f60 tx=0x7fcf28001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.032+0000 7fcf40c37640 1 --2- 172.21.15.132:0/1869010018 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558226c634d0 0x558226d66680 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.032+0000 7fcf40c37640 1 -- 172.21.15.132:0/1869010018 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf300083e0 con 0x558226c634d0 2024-05-08T18:52:31.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.032+0000 7fcf4293e800 1 -- 172.21.15.132:0/1869010018 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226d63c30 con 0x558226c634d0 2024-05-08T18:52:31.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.032+0000 7fcf40c37640 1 -- 172.21.15.132:0/1869010018 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcf300083e0 con 0x558226c634d0 2024-05-08T18:52:31.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.032+0000 7fcf4293e800 1 --2- 172.21.15.132:0/1869010018 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558226d68f10 0x558226d6b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.032+0000 7fcf4293e800 1 -- 172.21.15.132:0/1869010018 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226d6b9f0 con 0x558226d68f10 2024-05-08T18:52:31.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.032+0000 7fcf40436640 1 --2- 172.21.15.132:0/1869010018 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558226d68f10 0x558226d6b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.033+0000 7fcf40436640 1 --2- 172.21.15.132:0/1869010018 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558226d68f10 0x558226d6b300 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.033+0000 7fcf40436640 1 -- 172.21.15.132:0/1869010018 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcf38077020 con 0x558226d68f10 2024-05-08T18:52:31.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.033+0000 7fcf4293e800 1 -- 172.21.15.132:0/1869010018 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226d67db0 con 0x558226c634d0 2024-05-08T18:52:31.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.033+0000 7fcf40c37640 1 -- 172.21.15.132:0/1869010018 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcf300083e0 con 0x558226c634d0 2024-05-08T18:52:31.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.033+0000 7fcf4293e800 1 -- 172.21.15.132:0/1869010018 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226d68270 con 0x558226c634d0 2024-05-08T18:52:31.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.033+0000 7fcf40c37640 1 -- 172.21.15.132:0/1869010018 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcf300083e0 con 0x558226c634d0 2024-05-08T18:52:31.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.034+0000 7fcf4293e800 1 Processor -- start 2024-05-08T18:52:31.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.034+0000 7fcf4293e800 1 -- start start 2024-05-08T18:52:31.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.034+0000 7fcf4293e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226d7a990 0x558226d7adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.034+0000 7fcf4293e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558226b55fc0 con 0x558226d7a990 2024-05-08T18:52:31.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.034+0000 7fcf40c37640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226d7a990 0x558226d7adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.034+0000 7fcf40c37640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226d7a990 0x558226d7adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52782/0 (socket says 172.21.15.132:52782) 2024-05-08T18:52:31.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.034+0000 7fcf40c37640 1 -- 172.21.15.132:0/1536679408 learned_addr learned my addr 172.21.15.132:0/1536679408 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.035+0000 7fcf40c37640 1 -- 172.21.15.132:0/1536679408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558226d7b2f0 con 0x558226d7a990 2024-05-08T18:52:31.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.035+0000 7fcf40c37640 1 --2- 172.21.15.132:0/1536679408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226d7a990 0x558226d7adb0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x558226d60840 tx=0x7fcf3000aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.035+0000 7fce25ffb640 1 -- 172.21.15.132:0/1536679408 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf30007d00 con 0x558226d7a990 2024-05-08T18:52:31.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.035+0000 7fce25ffb640 1 -- 172.21.15.132:0/1536679408 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf3001e020 con 0x558226d7a990 2024-05-08T18:52:31.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.035+0000 7fcf4293e800 1 -- 172.21.15.132:0/1536679408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558226d7bd60 con 0x558226d7a990 2024-05-08T18:52:31.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.035+0000 7fce25ffb640 1 -- 172.21.15.132:0/1536679408 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf30019420 con 0x558226d7a990 2024-05-08T18:52:31.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.035+0000 7fcf4293e800 1 -- 172.21.15.132:0/1536679408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558226d7c260 con 0x558226d7a990 2024-05-08T18:52:31.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.036+0000 7fce25ffb640 1 -- 172.21.15.132:0/1536679408 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fcf30016040 con 0x558226d7a990 2024-05-08T18:52:31.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.036+0000 7fce25ffb640 1 --2- 172.21.15.132:0/1536679408 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fce1803bba0 0x7fce1803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.036+0000 7fce25ffb640 1 -- 172.21.15.132:0/1536679408 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fcf3001f030 con 0x558226d7a990 2024-05-08T18:52:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.036+0000 7fcf40436640 1 --2- 172.21.15.132:0/1536679408 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fce1803bba0 0x7fce1803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.036+0000 7fcf4293e800 1 Processor -- start 2024-05-08T18:52:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.037+0000 7fcf4293e800 1 -- start start 2024-05-08T18:52:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.037+0000 7fcf40436640 1 --2- 172.21.15.132:0/1536679408 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fce1803bba0 0x7fce1803e060 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x558226d67080 tx=0x7fcf38092d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.037+0000 7fcf4293e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226d87c50 0x558226d88070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.037+0000 7fcf4293e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558226d582a0 con 0x558226d87c50 2024-05-08T18:52:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.037+0000 7fcf40c37640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226d87c50 0x558226d88070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.037+0000 7fcf40c37640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226d87c50 0x558226d88070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52798/0 (socket says 172.21.15.132:52798) 2024-05-08T18:52:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.037+0000 7fcf40c37640 1 -- 172.21.15.132:0/1528570367 learned_addr learned my addr 172.21.15.132:0/1528570367 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.037+0000 7fcf40c37640 1 -- 172.21.15.132:0/1528570367 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558226d88640 con 0x558226d87c50 2024-05-08T18:52:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.037+0000 7fcf40c37640 1 --2- 172.21.15.132:0/1528570367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226d87c50 0x558226d88070 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fcf30052c50 tx=0x7fcf30015e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf79ba32a3a02f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.037+0000 7fce1f7fe640 1 -- 172.21.15.132:0/1528570367 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf3001d030 con 0x558226d87c50 2024-05-08T18:52:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.038+0000 7fce1f7fe640 1 -- 172.21.15.132:0/1528570367 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf30014e10 con 0x558226d87c50 2024-05-08T18:52:31.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.038+0000 7fce1f7fe640 1 -- 172.21.15.132:0/1528570367 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf300173b0 con 0x558226d87c50 2024-05-08T18:52:31.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.038+0000 7fcf4293e800 1 -- 172.21.15.132:0/1528570367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226d87c50 msgr2=0x558226d88070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.038+0000 7fcf4293e800 1 --2- 172.21.15.132:0/1528570367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226d87c50 0x558226d88070 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fcf30052c50 tx=0x7fcf30015e60 comp rx=0 tx=0).stop 2024-05-08T18:52:31.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.038+0000 7fcf4293e800 1 -- 172.21.15.132:0/1528570367 shutdown_connections 2024-05-08T18:52:31.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.038+0000 7fcf4293e800 1 --2- 172.21.15.132:0/1528570367 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226d87c50 0x558226d88070 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.038+0000 7fcf4293e800 1 -- 172.21.15.132:0/1528570367 >> 172.21.15.132:0/1528570367 conn(0x558226d83fb0 msgr2=0x558226d82010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.038+0000 7fcf4293e800 1 -- 172.21.15.132:0/1528570367 shutdown_connections 2024-05-08T18:52:31.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.038+0000 7fcf4293e800 1 -- 172.21.15.132:0/1528570367 wait complete. 2024-05-08T18:52:31.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.038+0000 7fcf4293e800 1 Processor -- start 2024-05-08T18:52:31.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.038+0000 7fcf4293e800 1 -- start start 2024-05-08T18:52:31.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.039+0000 7fcf4293e800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226d87c50 0x558226d8f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.039+0000 7fcf4293e800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x558226d88db0 con 0x558226d87c50 2024-05-08T18:52:31.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.039+0000 7fcf40c37640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226d87c50 0x558226d8f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.039+0000 7fcf40c37640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226d87c50 0x558226d8f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52800/0 (socket says 172.21.15.132:52800) 2024-05-08T18:52:31.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.039+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 learned_addr learned my addr 172.21.15.132:0/39500664 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.039+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558226d8f7a0 con 0x558226d87c50 2024-05-08T18:52:31.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.039+0000 7fcf40c37640 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226d87c50 0x558226d8f260 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fcf30022590 tx=0x7fcf30052bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.039+0000 7fce1dffb640 1 -- 172.21.15.132:0/39500664 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf30054450 con 0x558226d87c50 2024-05-08T18:52:31.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.039+0000 7fce1dffb640 1 -- 172.21.15.132:0/39500664 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf30045070 con 0x558226d87c50 2024-05-08T18:52:31.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.039+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558226d8fa30 con 0x558226d87c50 2024-05-08T18:52:31.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.039+0000 7fce1dffb640 1 -- 172.21.15.132:0/39500664 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf300169f0 con 0x558226d87c50 2024-05-08T18:52:31.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.039+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558226d926e0 con 0x558226d87c50 2024-05-08T18:52:31.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.040+0000 7fce1dffb640 1 -- 172.21.15.132:0/39500664 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fcf3004e070 con 0x558226d87c50 2024-05-08T18:52:31.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.040+0000 7fce1dffb640 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fce1003bb50 0x7fce1003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.040+0000 7fce1dffb640 1 -- 172.21.15.132:0/39500664 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fcf3002f880 con 0x558226d87c50 2024-05-08T18:52:31.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.040+0000 7fcf40436640 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fce1003bb50 0x7fce1003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.041+0000 7fcf40436640 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fce1003bb50 0x7fce1003e010 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcf380930d0 tx=0x7fcf38084000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.041+0000 7fcf4293e800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.041+0000 7fcf4293e800 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558226d9ad70 0x558226d9d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.041+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226d9d980 con 0x558226d9ad70 2024-05-08T18:52:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.041+0000 7fcf3fc35640 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558226d9ad70 0x558226d9d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.041+0000 7fcf3fc35640 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558226d9ad70 0x558226d9d230 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.042+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf2800f610 con 0x558226d9ad70 2024-05-08T18:52:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.042+0000 7fcf4293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.042+0000 7fcf4293e800 20 realm 2024-05-08T18:52:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.042+0000 7fcf4293e800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.042+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226d9a1c0 con 0x558226d9ad70 2024-05-08T18:52:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.042+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf2800f610 con 0x558226d9ad70 2024-05-08T18:52:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.042+0000 7fcf4293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.042+0000 7fcf4293e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:52:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.042+0000 7fcf4293e800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.042+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226d9e470 con 0x558226d9ad70 2024-05-08T18:52:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.042+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf2800f610 con 0x558226d9ad70 2024-05-08T18:52:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.042+0000 7fcf4293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.042+0000 7fcf4293e800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.042+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226d9ed40 con 0x558226d9ad70 2024-05-08T18:52:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.042+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcf2800f610 con 0x558226d9ad70 2024-05-08T18:52:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.042+0000 7fcf4293e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.042+0000 7fcf4293e800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.042+0000 7fcf4293e800 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558226d9f760 0x558226da1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.042+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226da2240 con 0x558226d9f760 2024-05-08T18:52:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.042+0000 7fcf40c37640 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558226d9f760 0x558226da1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.043+0000 7fcf40c37640 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558226d9f760 0x558226da1b50 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.043+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.043+0000 7fcf4293e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:52:31.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.043+0000 7fcf4293e800 20 searching for the correct realm 2024-05-08T18:52:31.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.043+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558226da3b10 con 0x558226d9f760 2024-05-08T18:52:31.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.043+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.043+0000 7fcf40c37640 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fcf30019040 0x7fcf30017910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.043+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x7fcf30019040 2024-05-08T18:52:31.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.044+0000 7fcf40436640 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fcf30019040 0x7fcf30017910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.044+0000 7fcf40436640 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fcf30019040 0x7fcf30017910 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.044+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf38077020 con 0x7fcf30019040 2024-05-08T18:52:31.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.044+0000 7fcf40436640 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fcf38052030 0x7fcf38091500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.044+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x7fcf38052030 2024-05-08T18:52:31.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.044+0000 7fcf3fc35640 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fcf38052030 0x7fcf38091500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.045+0000 7fcf3fc35640 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fcf38052030 0x7fcf38091500 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.045+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf2800f610 con 0x7fcf38052030 2024-05-08T18:52:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.045+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x558226d9ad70 2024-05-08T18:52:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.045+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf2800f610 con 0x558226d9ad70 2024-05-08T18:52:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.045+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x558226d9ad70 2024-05-08T18:52:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.045+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.045+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x7fcf38052030 2024-05-08T18:52:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.046+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.046+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x7fcf38052030 2024-05-08T18:52:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.046+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.046+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x7fcf30019040 2024-05-08T18:52:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.046+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.046+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x558226d9f760 2024-05-08T18:52:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.047+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.047+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x558226d9ad70 2024-05-08T18:52:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.047+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.047+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x7fcf38052030 2024-05-08T18:52:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.047+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.047+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x558226d9ad70 2024-05-08T18:52:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.048+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.048+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x7fcf30019040 2024-05-08T18:52:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.048+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.048+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x558226d9f760 2024-05-08T18:52:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.048+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.048+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x558226d9f760 2024-05-08T18:52:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.048+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.048+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x7fcf38052030 2024-05-08T18:52:31.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.049+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.049+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x558226d9f760 2024-05-08T18:52:31.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.049+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.049+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x558226d9f760 2024-05-08T18:52:31.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.049+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.049+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x558226d9ad70 2024-05-08T18:52:31.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.049+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.049+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x558226d9ad70 2024-05-08T18:52:31.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.050+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.050+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x7fcf38052030 2024-05-08T18:52:31.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.050+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.050+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x558226d9f760 2024-05-08T18:52:31.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.050+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.050+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x7fcf30019040 2024-05-08T18:52:31.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.050+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.050+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x558226d9ad70 2024-05-08T18:52:31.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.051+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.051+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x7fcf30019040 2024-05-08T18:52:31.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.051+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.051+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x558226d9f760 2024-05-08T18:52:31.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.051+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.051+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x7fcf38052030 2024-05-08T18:52:31.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.051+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.051+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x7fcf30019040 2024-05-08T18:52:31.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.052+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.052+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x558226d9f760 2024-05-08T18:52:31.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.052+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.052+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x7fcf38052030 2024-05-08T18:52:31.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.052+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.052+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x558226d9ad70 2024-05-08T18:52:31.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.052+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.052+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fcf30036030 con 0x7fcf30019040 2024-05-08T18:52:31.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:52:31.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:52:31.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:52:31.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:52:31.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:52:31.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:52:31.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226da2b00 con 0x558226d9ad70 2024-05-08T18:52:31.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226da2f00 con 0x558226d9ad70 2024-05-08T18:52:31.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:31.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226da33a0 con 0x558226d9ad70 2024-05-08T18:52:31.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:52:31.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 20 zone default found 2024-05-08T18:52:31.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 4 Realm: () 2024-05-08T18:52:31.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:52:31.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:52:31.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:52:31.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 20 zonegroup default 2024-05-08T18:52:31.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.053+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226da3c80 con 0x7fcf30019040 2024-05-08T18:52:31.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.054+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.054+0000 7fcf4293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.054+0000 7fcf4293e800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.054+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226da5f50 con 0x558226d9f760 2024-05-08T18:52:31.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.054+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.054+0000 7fcf4293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.054+0000 7fcf4293e800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.054+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226da62f0 con 0x558226d9f760 2024-05-08T18:52:31.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.054+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.054+0000 7fcf4293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.054+0000 7fcf4293e800 20 started sync module instance, tier type = 2024-05-08T18:52:31.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.054+0000 7fcf4293e800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:52:31.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.054+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226da5390 con 0x7fcf30019040 2024-05-08T18:52:31.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.055+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.055+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94017485952896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226da5ba0 con 0x7fcf30019040 2024-05-08T18:52:31.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.055+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226da6c90 con 0x558226d9ad70 2024-05-08T18:52:31.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.056+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94017485952896] v27'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.057+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.057+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94017485955824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226da70b0 con 0x558226d9ad70 2024-05-08T18:52:31.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.057+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226da7af0 con 0x558226d9f760 2024-05-08T18:52:31.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.058+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94017485955824] v27'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.058+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.058+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94017485960640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226da7ab0 con 0x558226d9f760 2024-05-08T18:52:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.058+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226da8600 con 0x7fcf30019040 2024-05-08T18:52:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.059+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.059+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94017485960640] v27'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.059+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94017485963568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226da8ed0 con 0x7fcf30019040 2024-05-08T18:52:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.059+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226da6750 con 0x558226d9ad70 2024-05-08T18:52:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.060+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.060+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94017485968480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226da9d30 con 0x558226d9ad70 2024-05-08T18:52:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.060+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226daa7b0 con 0x7fcf38052030 2024-05-08T18:52:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.060+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94017485963568] v27'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.061+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94017485968480] v27'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.061+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.061+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94017485972128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226da9880 con 0x7fcf38052030 2024-05-08T18:52:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.061+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226dab050 con 0x7fcf38052030 2024-05-08T18:52:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.062+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94017485972128] v27'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.062+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.062+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94017485965856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226da9880 con 0x7fcf38052030 2024-05-08T18:52:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.062+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226dab6c0 con 0x7fcf38052030 2024-05-08T18:52:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.063+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(58 notify.7 [create] v27'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.063+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94017485975952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226dabb30 con 0x7fcf38052030 2024-05-08T18:52:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.064+0000 7fcf4293e800 20 add_watcher() i=0 2024-05-08T18:52:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.064+0000 7fcf4293e800 20 add_watcher() i=1 2024-05-08T18:52:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.064+0000 7fcf4293e800 20 add_watcher() i=2 2024-05-08T18:52:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.064+0000 7fcf4293e800 20 add_watcher() i=3 2024-05-08T18:52:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.064+0000 7fcf4293e800 20 add_watcher() i=4 2024-05-08T18:52:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.064+0000 7fcf4293e800 20 add_watcher() i=5 2024-05-08T18:52:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.064+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94017485965856] v27'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.064+0000 7fcf4293e800 20 add_watcher() i=6 2024-05-08T18:52:31.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.064+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94017485975952] v27'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.064+0000 7fcf4293e800 20 add_watcher() i=7 2024-05-08T18:52:31.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.064+0000 7fcf4293e800 2 all 8 watchers are set, enabling cache 2024-05-08T18:52:31.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.064+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226dabb30 con 0x558226d9ad70 2024-05-08T18:52:31.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.065+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.065+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94017485977216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226dabaa0 con 0x558226d9ad70 2024-05-08T18:52:31.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.066+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94017485977216] v27'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.066+0000 7fcdf67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.066+0000 7fcf4293e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.066+0000 7fcf4293e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.066+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db7460 con 0x558226d9ad70 2024-05-08T18:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.067+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.067+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db7b30 con 0x7fcf38052030 2024-05-08T18:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.069+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.069+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db7f50 con 0x558226d9f760 2024-05-08T18:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.070+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.070+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db7f10 con 0x558226d9ad70 2024-05-08T18:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.071+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'233 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.071+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db7fa0 con 0x7fcf30019040 2024-05-08T18:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.072+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'74 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.072+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db89e0 con 0x558226d9f760 2024-05-08T18:52:31.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.073+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'50 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.073+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db89e0 con 0x558226d9ad70 2024-05-08T18:52:31.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.074+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.074+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db89e0 con 0x7fcf38052030 2024-05-08T18:52:31.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.075+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'51 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.075+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db89e0 con 0x7fcf30019040 2024-05-08T18:52:31.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.076+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.076+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db52d0 con 0x558226d9f760 2024-05-08T18:52:31.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.077+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.077+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db52a0 con 0x7fcf30019040 2024-05-08T18:52:31.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.078+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'75 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.078+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db53d0 con 0x7fcf38052030 2024-05-08T18:52:31.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.079+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.079+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db53d0 con 0x7fcf30019040 2024-05-08T18:52:31.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.080+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.080+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db53d0 con 0x7fcf38052030 2024-05-08T18:52:31.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.081+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'55 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.081+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db53d0 con 0x558226d9ad70 2024-05-08T18:52:31.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.082+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'234 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.082+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db53d0 con 0x558226d9f760 2024-05-08T18:52:31.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.083+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'68 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.083+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db55a0 con 0x7fcf30019040 2024-05-08T18:52:31.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.084+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'76 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.084+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db55a0 con 0x558226d9f760 2024-05-08T18:52:31.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.085+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.085+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db55a0 con 0x558226d9ad70 2024-05-08T18:52:31.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.087+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.087+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db55a0 con 0x558226d9ad70 2024-05-08T18:52:31.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.088+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'235 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.088+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db55a0 con 0x558226d9f760 2024-05-08T18:52:31.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.089+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'69 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.089+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db55a0 con 0x7fcf30019040 2024-05-08T18:52:31.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.090+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.090+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db55a0 con 0x558226d9f760 2024-05-08T18:52:31.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.091+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.091+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db55a0 con 0x558226d9f760 2024-05-08T18:52:31.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.091+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'35 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.091+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db55a0 con 0x558226d9f760 2024-05-08T18:52:31.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.092+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.092+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db55a0 con 0x558226d9f760 2024-05-08T18:52:31.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.093+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'51 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.093+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db55a0 con 0x7fcf38052030 2024-05-08T18:52:31.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.095+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.095+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db55a0 con 0x558226d9f760 2024-05-08T18:52:31.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.096+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.095 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.096+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db55a0 con 0x7fcf38052030 2024-05-08T18:52:31.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.097+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'52 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.096 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.097+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db55a0 con 0x558226d9f760 2024-05-08T18:52:31.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.098+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'70 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.097 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.098+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db55a0 con 0x7fcf38052030 2024-05-08T18:52:31.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.099+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'56 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.099+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db55a0 con 0x7fcf30019040 2024-05-08T18:52:31.099 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.100+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.100+0000 7fcdf57e2640 20 reqs_thread_entry: start 2024-05-08T18:52:31.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.100+0000 7fcf4293e800 20 init_complete bucket index max shards: 11 2024-05-08T18:52:31.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.101+0000 7fcf4293e800 20 Filter name: none 2024-05-08T18:52:31.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.101+0000 7fcd66ffd640 20 reqs_thread_entry: start 2024-05-08T18:52:31.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.101+0000 7fcf4293e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:52:31.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.101+0000 7fcf4293e800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.101+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226de3ef0 con 0x558226d9ad70 2024-05-08T18:52:31.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.101+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.101+0000 7fcf4293e800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:52:31.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.101+0000 7fcf4293e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:52:31.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.101+0000 7fcf4293e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:52:31.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.101+0000 7fcf4293e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:52:31.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.101+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226de3df0 con 0x7fcf30019040 2024-05-08T18:52:31.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.101+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.101+0000 7fcf4293e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7 : miss 2024-05-08T18:52:31.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.101+0000 7fcf4293e800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.101+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:96 8.10 8:0ed10ffd:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226de64a0 con 0x558226d9f760 2024-05-08T18:52:31.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.102+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== osd_op_reply(96 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.102+0000 7fcf4293e800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:52:31.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.102+0000 7fcf4293e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7 info.flags=0x17 2024-05-08T18:52:31.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.102+0000 7fcf4293e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7 to cache LRU end 2024-05-08T18:52:31.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.102+0000 7fcf4293e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:52:31.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.102+0000 7fcf4293e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:52:31.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.102+0000 7fcf4293e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7 2024-05-08T18:52:31.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.102+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:97 4.26 4:66adbfcc:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e63bc0 con 0x7fcf38052030 2024-05-08T18:52:31.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.102+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(97 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.102+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:98 4.7 4:e1652a3c:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e63bc0 con 0x7fcf38052030 2024-05-08T18:52:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.103+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(98 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.103+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:99 4.24 4:25fefe9b:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e63bc0 con 0x7fcf38052030 2024-05-08T18:52:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.103+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(99 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.103+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:100 4.a 4:5393720d:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e63bc0 con 0x7fcf30019040 2024-05-08T18:52:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.103+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 21 ==== osd_op_reply(100 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.103+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:101 4.20 4:04e37dca:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e63bc0 con 0x558226d9ad70 2024-05-08T18:52:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.104+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(101 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.4 [call out=425b] v0'0 uv7 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.104+0000 7fcf4293e800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-05-08T18:52:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.104+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:102 4.27 4:e6f8654d:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e63b80 con 0x558226d9ad70 2024-05-08T18:52:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.104+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(102 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.104+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:103 4.17 4:ebb41f06:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e63be0 con 0x7fcf38052030 2024-05-08T18:52:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.105+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(103 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.105+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:104 4.3 4:c3f8eab0:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e63be0 con 0x7fcf30019040 2024-05-08T18:52:31.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.105+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 22 ==== osd_op_reply(104 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.105+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:105 4.1e 4:79381170:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e63be0 con 0x7fcf38052030 2024-05-08T18:52:31.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.105+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(105 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.105+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:106 4.36 4:6d5591e4:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e63be0 con 0x558226d9ad70 2024-05-08T18:52:31.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.106+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(106 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.106+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:107 4.2c 4:368bca65:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e63ba0 con 0x558226d9ad70 2024-05-08T18:52:31.114 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.106+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 32 ==== osd_op_reply(107 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.106+0000 7fcf4293e800 20 get_obj_state: octx=0x7fcf2800f590 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x558226e61c48 s->prefetch_data=0 2024-05-08T18:52:31.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.106+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:108 3.2d 3:b43cc1c5:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e62a70 con 0x558226d9f760 2024-05-08T18:52:31.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.106+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 28 ==== osd_op_reply(108 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.106+0000 7fcf4293e800 10 manifest: total_size = 6 2024-05-08T18:52:31.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.106+0000 7fcf4293e800 20 get_obj_state: setting s->obj_tag to bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.5044457095843966476 2024-05-08T18:52:31.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.106+0000 7fcf4293e800 20 get_obj_state: octx=0x7fcf2800f590 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x558226e61c48 s->prefetch_data=0 2024-05-08T18:52:31.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.106+0000 7fcf4293e800 20 prepare_atomic_modification: state is not atomic. state=0x558226e61c48 2024-05-08T18:52:31.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.106+0000 7fcf4293e800 20 bucket index object: :.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.4 2024-05-08T18:52:31.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.106+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:109 4.20 4:04e37dca:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226e634d0 con 0x558226d9ad70 2024-05-08T18:52:31.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.108+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 33 ==== osd_op_reply(109 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.4 [stat,call,call] v27'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.108+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:110 3.2d 3:b43cc1c5:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226e634d0 con 0x558226d9f760 2024-05-08T18:52:31.115 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.109+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 29 ==== osd_op_reply(110 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7_15f6f8dc036519d7fe15b39338f6e5db [call] v27'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.109+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:111 4.20 4:04e37dca:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226deb0f0 con 0x558226d9ad70 2024-05-08T18:52:31.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.109+0000 7fcf4293e800 20 list_objects_ordered: starting attempt 1 2024-05-08T18:52:31.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.109+0000 7fcf4293e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-08T18:52:31.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.109+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:112 4.26 4:66adbfcc:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226deb0f0 con 0x7fcf38052030 2024-05-08T18:52:31.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.109+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:113 4.7 4:e1652a3c:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226def3f0 con 0x7fcf38052030 2024-05-08T18:52:31.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.109+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:114 4.24 4:25fefe9b:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226deb0f0 con 0x7fcf38052030 2024-05-08T18:52:31.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.109+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:115 4.a 4:5393720d:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226df41c0 con 0x7fcf30019040 2024-05-08T18:52:31.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.109+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:116 4.20 4:04e37dca:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226df6ab0 con 0x558226d9ad70 2024-05-08T18:52:31.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.109+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:117 4.27 4:e6f8654d:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226df41c0 con 0x558226d9ad70 2024-05-08T18:52:31.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.109+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:118 4.17 4:ebb41f06:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226dfbf70 con 0x7fcf38052030 2024-05-08T18:52:31.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.109+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:119 4.3 4:c3f8eab0:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226dfe7e0 con 0x7fcf30019040 2024-05-08T18:52:31.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.109+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:120 4.1e 4:79381170:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e01390 con 0x7fcf38052030 2024-05-08T18:52:31.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.109+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:121 4.36 4:6d5591e4:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e04210 con 0x558226d9ad70 2024-05-08T18:52:31.116 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.110+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:122 4.2c 4:368bca65:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226dfbf70 con 0x558226d9ad70 2024-05-08T18:52:31.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.110+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 23 ==== osd_op_reply(115 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.110+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 24 ==== osd_op_reply(119 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.110+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== osd_op_reply(113 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.110+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 28 ==== osd_op_reply(112 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.110+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 29 ==== osd_op_reply(114 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.110+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 30 ==== osd_op_reply(118 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.110+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 31 ==== osd_op_reply(120 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.110+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 34 ==== osd_op_reply(117 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.110+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 35 ==== osd_op_reply(121 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.110+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 36 ==== osd_op_reply(122 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 37 ==== osd_op_reply(111 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.4 [stat,call,call] v27'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fce1f7fe640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-05-08T18:52:31.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 38 ==== osd_op_reply(116 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.4 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.117 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf4293e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-08T18:52:31.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf4293e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-08T18:52:31.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf4293e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-08T18:52:31.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf4293e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-08T18:52:31.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf4293e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7])"; uploads.size()=0; is_truncated=0 2024-05-08T18:52:31.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:123 4.26 4:66adbfcc:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e04210 con 0x7fcf38052030 2024-05-08T18:52:31.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:124 4.7 4:e1652a3c:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226df59c0 con 0x7fcf38052030 2024-05-08T18:52:31.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:125 4.24 4:25fefe9b:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226df5df0 con 0x7fcf38052030 2024-05-08T18:52:31.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:126 4.a 4:5393720d:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226df6690 con 0x7fcf30019040 2024-05-08T18:52:31.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:127 4.20 4:04e37dca:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e03d80 con 0x558226d9ad70 2024-05-08T18:52:31.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:128 4.27 4:e6f8654d:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e04210 con 0x558226d9ad70 2024-05-08T18:52:31.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:129 4.17 4:ebb41f06:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226df59c0 con 0x7fcf38052030 2024-05-08T18:52:31.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:130 4.3 4:c3f8eab0:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226df5df0 con 0x7fcf30019040 2024-05-08T18:52:31.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:131 4.1e 4:79381170:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226df59c0 con 0x7fcf38052030 2024-05-08T18:52:31.118 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:132 4.36 4:6d5591e4:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226df5df0 con 0x558226d9ad70 2024-05-08T18:52:31.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:133 4.2c 4:368bca65:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e04210 con 0x558226d9ad70 2024-05-08T18:52:31.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 25 ==== osd_op_reply(126 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 26 ==== osd_op_reply(130 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 32 ==== osd_op_reply(125 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 33 ==== osd_op_reply(123 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 34 ==== osd_op_reply(124 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 35 ==== osd_op_reply(129 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 36 ==== osd_op_reply(131 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 39 ==== osd_op_reply(127 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.4 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.111+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 40 ==== osd_op_reply(128 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.112+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 41 ==== osd_op_reply(133 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.112+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 42 ==== osd_op_reply(132 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.112+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226e04210 con 0x7fcf30019040 2024-05-08T18:52:31.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.113+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 27 ==== osd_op_reply(134 foo.buckets [call] v27'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.113+0000 7fcf4293e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:52:31.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.113+0000 7fcf4293e800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.113+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e04210 con 0x7fcf30019040 2024-05-08T18:52:31.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.113+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 28 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.113+0000 7fcf4293e800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:52:31.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.113+0000 7fcf4293e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:52:31.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.113+0000 7fcf4293e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:52:31.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.113+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226e04210 con 0x7fcf30019040 2024-05-08T18:52:31.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.114+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 29 ==== osd_op_reply(136 myfoo [call,call,delete] v27'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.114+0000 7fcf4293e800 10 removing default.rgw.meta+root+myfoo from cache 2024-05-08T18:52:31.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.114+0000 7fcf4293e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:52:31.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.114+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94017486236736 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e04210 con 0x7fcf38052030 2024-05-08T18:52:31.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.114+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 37 ==== watch-notify(notify (1) cookie 94017485965856 notify 115964117020 ret 0) ==== 191+0+0 (crc 0 0 0) 0x558226db7b30 con 0x7fcf38052030 2024-05-08T18:52:31.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.114+0000 7fce1effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117020 cookie 94017485965856 notifier 4774 bl.length()=149 2024-05-08T18:52:31.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.114+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 38 ==== osd_op_reply(137 notify.6 [notify cookie 94017486236736 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.114+0000 7fce1effd640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fcd740032c0 con 0x7fcf38052030 2024-05-08T18:52:31.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.114+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 39 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.115+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 40 ==== watch-notify(notify_complete (2) cookie 94017486236736 notify 115964117020 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558226db7420 con 0x7fcf38052030 2024-05-08T18:52:31.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.115+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:139 8.10 8:0ed10ffd:root::.bucket.meta.myfoo%3abda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226e04210 con 0x558226d9f760 2024-05-08T18:52:31.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.116+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 30 ==== osd_op_reply(139 .bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7 [call,call,delete] v27'4 uv4 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.116+0000 7fcf4293e800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7 from cache 2024-05-08T18:52:31.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.116+0000 7fcf4293e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7, ofs0, ns] 2024-05-08T18:52:31.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.116+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:140 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94017486216528 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e04210 con 0x7fcf30019040 2024-05-08T18:52:31.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.116+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 30 ==== watch-notify(notify (1) cookie 94017485952896 notify 115964117036 ret 0) ==== 248+0+0 (crc 0 0 0) 0x558226db6e10 con 0x7fcf30019040 2024-05-08T18:52:31.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.116+0000 7fce1effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117036 cookie 94017485952896 notifier 4774 bl.length()=206 2024-05-08T18:52:31.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.116+0000 7fce1effd640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:141 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fcd740032c0 con 0x7fcf30019040 2024-05-08T18:52:31.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.116+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 31 ==== osd_op_reply(140 notify.0 [notify cookie 94017486216528 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.116+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 32 ==== osd_op_reply(141 notify.0 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.116+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 33 ==== watch-notify(notify_complete (2) cookie 94017486216528 notify 115964117036 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcf38080040 con 0x7fcf30019040 2024-05-08T18:52:31.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.116+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:142 4.26 4:66adbfcc:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226e04210 con 0x7fcf38052030 2024-05-08T18:52:31.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.116+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:143 4.7 4:e1652a3c:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226e62930 con 0x7fcf38052030 2024-05-08T18:52:31.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.116+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:144 4.24 4:25fefe9b:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226de4e40 con 0x7fcf38052030 2024-05-08T18:52:31.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.116+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:145 4.a 4:5393720d:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226df9650 con 0x7fcf30019040 2024-05-08T18:52:31.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.116+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:146 4.20 4:04e37dca:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226e04210 con 0x558226d9ad70 2024-05-08T18:52:31.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.117+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:147 4.27 4:e6f8654d:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226e62930 con 0x558226d9ad70 2024-05-08T18:52:31.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.117+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:148 4.17 4:ebb41f06:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226de4e40 con 0x7fcf38052030 2024-05-08T18:52:31.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.117+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:149 4.3 4:c3f8eab0:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226e04210 con 0x7fcf30019040 2024-05-08T18:52:31.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.117+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:150 4.1e 4:79381170:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226df9650 con 0x7fcf38052030 2024-05-08T18:52:31.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.117+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:151 4.36 4:6d5591e4:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226de4e40 con 0x558226d9ad70 2024-05-08T18:52:31.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.117+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:152 4.2c 4:368bca65:::.dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226e62930 con 0x558226d9ad70 2024-05-08T18:52:31.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.118+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 43 ==== osd_op_reply(146 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.4 [delete] v27'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.118+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 34 ==== osd_op_reply(145 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.3 [delete] v27'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.118+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 44 ==== osd_op_reply(147 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.5 [delete] v27'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.120+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 45 ==== osd_op_reply(152 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.10 [delete] v27'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.120+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 35 ==== osd_op_reply(149 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.7 [delete] v27'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.120+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 46 ==== osd_op_reply(151 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.9 [delete] v27'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.120+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 41 ==== osd_op_reply(150 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.8 [delete] v27'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.120+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 42 ==== osd_op_reply(148 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.6 [delete] v27'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.120+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 43 ==== osd_op_reply(143 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.1 [delete] v27'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.120+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 44 ==== osd_op_reply(144 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.2 [delete] v27'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.120+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 45 ==== osd_op_reply(142 .dir.bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7.0 [delete] v27'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.120+0000 7fcf4293e800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7 : miss 2024-05-08T18:52:31.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.120+0000 7fcf4293e800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.120+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:153 6.18 6:1ce68d5a:::pubsub..bucket.myfoo%2fbda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e62930 con 0x7fcf38052030 2024-05-08T18:52:31.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.121+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 46 ==== osd_op_reply(153 pubsub..bucket.myfoo/bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.121+0000 7fcf4293e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.121+0000 7fcf4293e800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7 info.flags=0x0 2024-05-08T18:52:31.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.121+0000 7fcf4293e800 10 adding default.rgw.log++pubsub..bucket.myfoo/bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7 to cache LRU end 2024-05-08T18:52:31.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.121+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:154 6.18 6:1ce68d5a:::pubsub..bucket.myfoo%2fbda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226e62930 con 0x7fcf38052030 2024-05-08T18:52:31.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.122+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 47 ==== osd_op_reply(154 pubsub..bucket.myfoo/bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.7 [delete] v27'29 uv21 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.122+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226e62930 con 0x7fcf30019040 2024-05-08T18:52:31.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.123+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 36 ==== osd_op_reply(155 foo.buckets [call] v27'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.123+0000 7fcf4293e800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-05-08T18:52:31.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.123+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226e62930 con 0x7fcf38052030 2024-05-08T18:52:31.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.124+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 48 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v27'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.124+0000 7fcf4293e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-05-08T18:52:31.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.124+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94017486216528 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e62930 con 0x7fcf30019040 2024-05-08T18:52:31.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.124+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 37 ==== watch-notify(notify (1) cookie 94017485963568 notify 115964117037 ret 0) ==== 212+0+0 (crc 0 0 0) 0x7fcf38080040 con 0x7fcf30019040 2024-05-08T18:52:31.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.124+0000 7fce1effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117037 cookie 94017485963568 notifier 4774 bl.length()=170 2024-05-08T18:52:31.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.124+0000 7fce1effd640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fcd740032c0 con 0x7fcf30019040 2024-05-08T18:52:31.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.124+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 38 ==== osd_op_reply(157 notify.3 [notify cookie 94017486216528 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.124+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 39 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.124+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 40 ==== watch-notify(notify_complete (2) cookie 94017486216528 notify 115964117037 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558226d628c0 con 0x7fcf30019040 2024-05-08T18:52:31.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.124+0000 7fcf4293e800 10 removing email index: foo@foo.com 2024-05-08T18:52:31.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.124+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226e62930 con 0x558226d9ad70 2024-05-08T18:52:31.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.125+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 47 ==== osd_op_reply(159 foo@foo.com [delete] v27'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.125+0000 7fcf4293e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-05-08T18:52:31.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.125+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94017486216528 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e62930 con 0x7fcf30019040 2024-05-08T18:52:31.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.126+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 41 ==== watch-notify(notify (1) cookie 94017485963568 notify 115964117038 ret 0) ==== 204+0+0 (crc 0 0 0) 0x558226d628c0 con 0x7fcf30019040 2024-05-08T18:52:31.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.126+0000 7fce1f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117038 cookie 94017485963568 notifier 4774 bl.length()=162 2024-05-08T18:52:31.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.126+0000 7fce1f7fe640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fce04003d60 con 0x7fcf30019040 2024-05-08T18:52:31.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.126+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 42 ==== osd_op_reply(160 notify.3 [notify cookie 94017486216528 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.126+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 43 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.126+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 44 ==== watch-notify(notify_complete (2) cookie 94017486216528 notify 115964117038 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558226d5fc60 con 0x7fcf30019040 2024-05-08T18:52:31.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.126+0000 7fcf4293e800 10 removing user buckets index 2024-05-08T18:52:31.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.126+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226e62930 con 0x7fcf30019040 2024-05-08T18:52:31.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.127+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 45 ==== osd_op_reply(162 foo.buckets [delete] v27'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.127+0000 7fcf4293e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-05-08T18:52:31.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.127+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94017486216528 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e62930 con 0x7fcf38052030 2024-05-08T18:52:31.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.127+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 49 ==== watch-notify(notify (1) cookie 94017485972128 notify 115964117021 ret 0) ==== 202+0+0 (crc 0 0 0) 0x558226db7420 con 0x7fcf38052030 2024-05-08T18:52:31.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.127+0000 7fce1effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117021 cookie 94017485972128 notifier 4774 bl.length()=160 2024-05-08T18:52:31.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.127+0000 7fce1effd640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fcd740032c0 con 0x7fcf38052030 2024-05-08T18:52:31.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.127+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 50 ==== osd_op_reply(163 notify.5 [notify cookie 94017486216528 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.128+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 51 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.128+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 52 ==== watch-notify(notify_complete (2) cookie 94017486216528 notify 115964117021 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558226db7800 con 0x7fcf38052030 2024-05-08T18:52:31.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.128+0000 7fcf4293e800 10 removing user index: foo 2024-05-08T18:52:31.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.128+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226e62930 con 0x558226d9ad70 2024-05-08T18:52:31.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.129+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 48 ==== osd_op_reply(165 foo [call,call,delete] v27'23 uv23 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.129+0000 7fcf4293e800 10 removing default.rgw.meta+users.uid+foo from cache 2024-05-08T18:52:31.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.129+0000 7fcf4293e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:52:31.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.129+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94017486216528 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558226e62930 con 0x558226d9ad70 2024-05-08T18:52:31.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.129+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 49 ==== watch-notify(notify (1) cookie 94017485968480 notify 115964117010 ret 0) ==== 194+0+0 (crc 0 0 0) 0x558226db7800 con 0x558226d9ad70 2024-05-08T18:52:31.134 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.129+0000 7fce1f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117010 cookie 94017485968480 notifier 4774 bl.length()=152 2024-05-08T18:52:31.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.129+0000 7fce1f7fe640 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fce04003d60 con 0x558226d9ad70 2024-05-08T18:52:31.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.129+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 50 ==== osd_op_reply(166 notify.4 [notify cookie 94017486216528 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.129+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 51 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.129+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 52 ==== watch-notify(notify_complete (2) cookie 94017486216528 notify 115964117010 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558226db5c30 con 0x558226d9ad70 2024-05-08T18:52:31.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.130+0000 7fcdf67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:31.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.130+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94017485977216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db62d0 con 0x558226d9ad70 2024-05-08T18:52:31.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.131+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 53 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94017485977216] v27'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.131+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94017485952896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db62d0 con 0x7fcf30019040 2024-05-08T18:52:31.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.132+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 46 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94017485952896] v27'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.132+0000 7fcf4293e800 20 remove_watcher() i=0 2024-05-08T18:52:31.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.132+0000 7fcf4293e800 2 removed watcher, disabling cache 2024-05-08T18:52:31.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.132+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94017485955824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db62d0 con 0x558226d9ad70 2024-05-08T18:52:31.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.133+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 54 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94017485955824] v27'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.133+0000 7fcf4293e800 20 remove_watcher() i=1 2024-05-08T18:52:31.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.133+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94017485960640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db62d0 con 0x558226d9f760 2024-05-08T18:52:31.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.134+0000 7fcf40c37640 1 -- 172.21.15.132:0/39500664 <== osd.3 v2:172.21.15.132:6816/17827703 31 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94017485960640] v27'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3004a070 con 0x558226d9f760 2024-05-08T18:52:31.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.134+0000 7fcf4293e800 20 remove_watcher() i=2 2024-05-08T18:52:31.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.134+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94017485963568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db62d0 con 0x7fcf30019040 2024-05-08T18:52:31.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.135+0000 7fcf40436640 1 -- 172.21.15.132:0/39500664 <== osd.2 v2:172.21.15.132:6808/1108348591 47 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94017485963568] v27'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf380a1040 con 0x7fcf30019040 2024-05-08T18:52:31.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.135+0000 7fcf4293e800 20 remove_watcher() i=3 2024-05-08T18:52:31.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.135+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94017485968480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db62d0 con 0x558226d9ad70 2024-05-08T18:52:31.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.136+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.1 v2:172.21.15.132:6800/3697320277 55 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94017485968480] v27'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x558226d9ad70 2024-05-08T18:52:31.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.136+0000 7fcf4293e800 20 remove_watcher() i=4 2024-05-08T18:52:31.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.136+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94017485972128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db62d0 con 0x7fcf38052030 2024-05-08T18:52:31.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.137+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 53 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94017485972128] v27'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.137+0000 7fcf4293e800 20 remove_watcher() i=5 2024-05-08T18:52:31.139 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.137+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94017485965856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db62d0 con 0x7fcf38052030 2024-05-08T18:52:31.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.138+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 54 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94017485965856] v27'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.138+0000 7fcf4293e800 20 remove_watcher() i=6 2024-05-08T18:52:31.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.139+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94017485975952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558226db62d0 con 0x7fcf38052030 2024-05-08T18:52:31.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 <== osd.0 v2:172.21.15.42:6800/1521799280 55 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94017485975952] v27'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf2802b040 con 0x7fcf38052030 2024-05-08T18:52:31.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 20 remove_watcher() i=7 2024-05-08T18:52:31.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fcf38052030 msgr2=0x7fcf38091500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fcf38052030 0x7fcf38091500 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558226d9ad70 msgr2=0x558226d9d230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558226d9ad70 0x558226d9d230 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fcf30019040 msgr2=0x7fcf30017910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fcf30019040 0x7fcf30017910 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558226d9f760 msgr2=0x558226da1b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558226d9f760 0x558226da1b50 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fce1003bb50 msgr2=0x7fce1003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fce1003bb50 0x7fce1003e010 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcf380930d0 tx=0x7fcf38084000 comp rx=0 tx=0).stop 2024-05-08T18:52:31.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226d87c50 msgr2=0x558226d8f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226d87c50 0x558226d8f260 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fcf30022590 tx=0x7fcf30052bb0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf3fc35640 1 -- 172.21.15.132:0/39500664 reap_dead start 2024-05-08T18:52:31.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 shutdown_connections 2024-05-08T18:52:31.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 --2- 172.21.15.132:0/39500664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226d87c50 0x558226d8f260 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 >> 172.21.15.132:0/39500664 conn(0x558226d83fb0 msgr2=0x558226d81610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 shutdown_connections 2024-05-08T18:52:31.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 -- 172.21.15.132:0/39500664 wait complete. 2024-05-08T18:52:31.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 -- 172.21.15.132:0/1536679408 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fce1803bba0 msgr2=0x7fce1803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 --2- 172.21.15.132:0/1536679408 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fce1803bba0 0x7fce1803e060 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x558226d67080 tx=0x7fcf38092d40 comp rx=0 tx=0).stop 2024-05-08T18:52:31.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 -- 172.21.15.132:0/1536679408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226d7a990 msgr2=0x558226d7adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 --2- 172.21.15.132:0/1536679408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226d7a990 0x558226d7adb0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x558226d60840 tx=0x7fcf3000aec0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 -- 172.21.15.132:0/1536679408 shutdown_connections 2024-05-08T18:52:31.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 --2- 172.21.15.132:0/1536679408 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fce1803bba0 0x7fce1803e060 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.140+0000 7fcf4293e800 1 --2- 172.21.15.132:0/1536679408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226d7a990 0x558226d7adb0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.141+0000 7fcf4293e800 1 -- 172.21.15.132:0/1536679408 >> 172.21.15.132:0/1536679408 conn(0x558226d6ea30 msgr2=0x558226d6ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.141+0000 7fcf4293e800 1 -- 172.21.15.132:0/1536679408 shutdown_connections 2024-05-08T18:52:31.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.141+0000 7fcf4293e800 1 -- 172.21.15.132:0/1536679408 wait complete. 2024-05-08T18:52:31.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.141+0000 7fcf4293e800 1 -- 172.21.15.132:0/1869010018 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558226c634d0 msgr2=0x558226d66680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.141+0000 7fcf4293e800 1 --2- 172.21.15.132:0/1869010018 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558226c634d0 0x558226d66680 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.141+0000 7fcf4293e800 1 -- 172.21.15.132:0/1869010018 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558226d68f10 msgr2=0x558226d6b300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.141+0000 7fcf4293e800 1 --2- 172.21.15.132:0/1869010018 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558226d68f10 0x558226d6b300 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.141+0000 7fcf4293e800 1 -- 172.21.15.132:0/1869010018 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fce2803bba0 msgr2=0x7fce2803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.141+0000 7fcf4293e800 1 --2- 172.21.15.132:0/1869010018 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fce2803bba0 0x7fce2803e060 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcf28000f60 tx=0x7fcf28001370 comp rx=0 tx=0).stop 2024-05-08T18:52:31.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.141+0000 7fcf4293e800 1 -- 172.21.15.132:0/1869010018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226c62b70 msgr2=0x558226d5f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.141+0000 7fcf4293e800 1 --2- 172.21.15.132:0/1869010018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226c62b70 0x558226d5f490 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800a190 tx=0x7fcf38003330 comp rx=0 tx=0).stop 2024-05-08T18:52:31.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.141+0000 7fcf4293e800 1 -- 172.21.15.132:0/1869010018 shutdown_connections 2024-05-08T18:52:31.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.141+0000 7fcf4293e800 1 --2- 172.21.15.132:0/1869010018 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x558226d68f10 0x558226d6b300 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.141+0000 7fcf4293e800 1 --2- 172.21.15.132:0/1869010018 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x558226c634d0 0x558226d66680 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.141+0000 7fcf4293e800 1 --2- 172.21.15.132:0/1869010018 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fce2803bba0 0x7fce2803e060 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.141+0000 7fcf4293e800 1 --2- 172.21.15.132:0/1869010018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x558226c62b70 0x558226d5f490 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.141+0000 7fcf4293e800 1 -- 172.21.15.132:0/1869010018 >> 172.21.15.132:0/1869010018 conn(0x558226c5e6b0 msgr2=0x558226d51b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.141+0000 7fcf4293e800 1 -- 172.21.15.132:0/1869010018 shutdown_connections 2024-05-08T18:52:31.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.141+0000 7fcf4293e800 1 -- 172.21.15.132:0/1869010018 wait complete. 2024-05-08T18:52:31.149 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:52:31.149 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:52:31.149 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:52:31.193 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:31.193 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:31.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.195+0000 7f8a0b923800 1 Processor -- start 2024-05-08T18:52:31.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.195+0000 7f8a0b923800 1 -- start start 2024-05-08T18:52:31.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.195+0000 7f8a0b923800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x557ff8acf5d0 0x557ff8ad19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.195+0000 7f8a0b923800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557ff8ad1f90 con 0x557ff8acb140 2024-05-08T18:52:31.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.195+0000 7f8a0b923800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x557ff896ce20 con 0x557ff8acf5d0 2024-05-08T18:52:31.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.195+0000 7f89fffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x557ff8acf5d0 0x557ff8ad19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.195+0000 7f8a07563640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x557ff8acb140 0x557ff8acb560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48048/0 (socket says 172.21.15.132:48048) 2024-05-08T18:52:31.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.195+0000 7f89fffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x557ff8acf5d0 0x557ff8ad19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52802/0 (socket says 172.21.15.132:52802) 2024-05-08T18:52:31.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.195+0000 7f8a07563640 1 -- 172.21.15.132:0/1262950666 learned_addr learned my addr 172.21.15.132:0/1262950666 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:52:31.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.196+0000 7f89fffff640 1 -- 172.21.15.132:0/1262950666 >> v1:172.21.15.42:6789/0 conn(0x557ff8acb140 legacy=0x557ff8acb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.196+0000 7f89fffff640 1 -- 172.21.15.132:0/1262950666 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ff8ad31c0 con 0x557ff8acf5d0 2024-05-08T18:52:31.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.197+0000 7f89fffff640 1 --2- 172.21.15.132:0/1262950666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8acf5d0 0x557ff8ad19c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f89f000a470 tx=0x7f89f001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544aab419339627e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.198+0000 7f8a06d62640 1 -- 172.21.15.132:0/1262950666 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89f0057070 con 0x557ff8acf5d0 2024-05-08T18:52:31.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.198+0000 7f8a06d62640 1 -- 172.21.15.132:0/1262950666 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89f0052570 con 0x557ff8acf5d0 2024-05-08T18:52:31.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.198+0000 7f8a06d62640 1 -- 172.21.15.132:0/1262950666 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89f0052870 con 0x557ff8acf5d0 2024-05-08T18:52:31.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.198+0000 7f8a0b923800 1 -- 172.21.15.132:0/1262950666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8acf5d0 msgr2=0x557ff8ad19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.198+0000 7f8a0b923800 1 --2- 172.21.15.132:0/1262950666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8acf5d0 0x557ff8ad19c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f89f000a470 tx=0x7f89f001ce90 comp rx=0 tx=0).stop 2024-05-08T18:52:31.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.198+0000 7f8a0b923800 1 -- 172.21.15.132:0/1262950666 shutdown_connections 2024-05-08T18:52:31.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.198+0000 7f8a0b923800 1 --2- 172.21.15.132:0/1262950666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8acf5d0 0x557ff8ad19c0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.198+0000 7f8a0b923800 1 -- 172.21.15.132:0/1262950666 >> 172.21.15.132:0/1262950666 conn(0x557ff8ac6720 msgr2=0x557ff8ac8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.198+0000 7f8a0b923800 1 -- 172.21.15.132:0/1262950666 shutdown_connections 2024-05-08T18:52:31.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.198+0000 7f8a0b923800 1 -- 172.21.15.132:0/1262950666 wait complete. 2024-05-08T18:52:31.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.212+0000 7f8a0b923800 1 Processor -- start 2024-05-08T18:52:31.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.212+0000 7f8a0b923800 1 -- start start 2024-05-08T18:52:31.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.212+0000 7f8a0b923800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8acb140 0x557ff8bb93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.212+0000 7f8a0b923800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557ff8a175b0 con 0x557ff8acb140 2024-05-08T18:52:31.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.212+0000 7f8a07563640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8acb140 0x557ff8bb93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.212+0000 7f8a07563640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8acb140 0x557ff8bb93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52812/0 (socket says 172.21.15.132:52812) 2024-05-08T18:52:31.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.212+0000 7f8a07563640 1 -- 172.21.15.132:0/737249562 learned_addr learned my addr 172.21.15.132:0/737249562 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.213+0000 7f8a07563640 1 -- 172.21.15.132:0/737249562 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ff8bb7960 con 0x557ff8acb140 2024-05-08T18:52:31.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.213+0000 7f8a07563640 1 --2- 172.21.15.132:0/737249562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8acb140 0x557ff8bb93a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f89f8001e10 tx=0x7f89f800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3e8c94180810c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.213+0000 7f88f560a640 1 -- 172.21.15.132:0/737249562 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89f8012020 con 0x557ff8acb140 2024-05-08T18:52:31.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.213+0000 7f88f560a640 1 -- 172.21.15.132:0/737249562 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89f800e5a0 con 0x557ff8acb140 2024-05-08T18:52:31.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.213+0000 7f88f560a640 1 -- 172.21.15.132:0/737249562 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89f800e8e0 con 0x557ff8acb140 2024-05-08T18:52:31.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.214+0000 7f8a0b923800 1 -- 172.21.15.132:0/737249562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8acb140 msgr2=0x557ff8bb93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.214+0000 7f8a0b923800 1 --2- 172.21.15.132:0/737249562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8acb140 0x557ff8bb93a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f89f8001e10 tx=0x7f89f800b780 comp rx=0 tx=0).stop 2024-05-08T18:52:31.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.214+0000 7f8a0b923800 1 -- 172.21.15.132:0/737249562 shutdown_connections 2024-05-08T18:52:31.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.214+0000 7f8a0b923800 1 --2- 172.21.15.132:0/737249562 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8acb140 0x557ff8bb93a0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.214+0000 7f8a0b923800 1 -- 172.21.15.132:0/737249562 >> 172.21.15.132:0/737249562 conn(0x557ff8ac6720 msgr2=0x557ff8bbba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.214+0000 7f8a0b923800 1 -- 172.21.15.132:0/737249562 shutdown_connections 2024-05-08T18:52:31.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.214+0000 7f8a0b923800 1 -- 172.21.15.132:0/737249562 wait complete. 2024-05-08T18:52:31.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.214+0000 7f8a0b923800 1 Processor -- start 2024-05-08T18:52:31.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.214+0000 7f8a0b923800 1 -- start start 2024-05-08T18:52:31.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.214+0000 7f8a0b923800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8acb140 0x557ff8bc73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.214+0000 7f8a0b923800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557ff8ad2460 con 0x557ff8acb140 2024-05-08T18:52:31.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.214+0000 7f8a07563640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8acb140 0x557ff8bc73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.214+0000 7f8a07563640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8acb140 0x557ff8bc73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52828/0 (socket says 172.21.15.132:52828) 2024-05-08T18:52:31.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.214+0000 7f8a07563640 1 -- 172.21.15.132:0/2169576825 learned_addr learned my addr 172.21.15.132:0/2169576825 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.215+0000 7f8a07563640 1 -- 172.21.15.132:0/2169576825 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ff8bc78f0 con 0x557ff8acb140 2024-05-08T18:52:31.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.215+0000 7f8a07563640 1 --2- 172.21.15.132:0/2169576825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8acb140 0x557ff8bc73b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f89f800b7c0 tx=0x7f89f8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.215+0000 7f88f3e07640 1 -- 172.21.15.132:0/2169576825 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89f8012030 con 0x557ff8acb140 2024-05-08T18:52:31.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.215+0000 7f88f3e07640 1 -- 172.21.15.132:0/2169576825 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89f8001470 con 0x557ff8acb140 2024-05-08T18:52:31.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.215+0000 7f88f3e07640 1 -- 172.21.15.132:0/2169576825 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89f801a8d0 con 0x557ff8acb140 2024-05-08T18:52:31.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.215+0000 7f8a0b923800 1 -- 172.21.15.132:0/2169576825 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557ff8bc7b80 con 0x557ff8acb140 2024-05-08T18:52:31.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.215+0000 7f8a0b923800 1 -- 172.21.15.132:0/2169576825 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ff8bca830 con 0x557ff8acb140 2024-05-08T18:52:31.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.216+0000 7f88f3e07640 1 -- 172.21.15.132:0/2169576825 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f89f8015020 con 0x557ff8acb140 2024-05-08T18:52:31.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.216+0000 7f88f3e07640 1 --2- 172.21.15.132:0/2169576825 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f88ec03bb50 0x7f88ec03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.216+0000 7f88f3e07640 1 -- 172.21.15.132:0/2169576825 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f89f8020030 con 0x557ff8acb140 2024-05-08T18:52:31.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.216+0000 7f89fffff640 1 --2- 172.21.15.132:0/2169576825 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f88ec03bb50 0x7f88ec03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.217+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2169576825 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x557ff8acf5d0 0x557ff8bce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.217+0000 7f8a0b923800 1 -- 172.21.15.132:0/2169576825 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557ff8bceb80 con 0x557ff8acf5d0 2024-05-08T18:52:31.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.217+0000 7f8a07d64640 1 --2- 172.21.15.132:0/2169576825 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x557ff8acf5d0 0x557ff8bce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.217+0000 7f89fffff640 1 --2- 172.21.15.132:0/2169576825 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f88ec03bb50 0x7f88ec03e010 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f89f0054000 tx=0x7f89f004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.217+0000 7f8a07d64640 1 --2- 172.21.15.132:0/2169576825 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x557ff8acf5d0 0x557ff8bce5f0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.217+0000 7f8a07d64640 1 -- 172.21.15.132:0/2169576825 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a0000a4a0 con 0x557ff8acf5d0 2024-05-08T18:52:31.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.217+0000 7f8a0b923800 1 -- 172.21.15.132:0/2169576825 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557ff8bcbbc0 con 0x557ff8acf5d0 2024-05-08T18:52:31.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.218+0000 7f8a07d64640 1 -- 172.21.15.132:0/2169576825 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8a0000a4a0 con 0x557ff8acf5d0 2024-05-08T18:52:31.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.218+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2169576825 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x557ff8bd0ed0 0x557ff8bd32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.218+0000 7f8a0b923800 1 -- 172.21.15.132:0/2169576825 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557ff8bd3960 con 0x557ff8bd0ed0 2024-05-08T18:52:31.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.218+0000 7f8a07563640 1 --2- 172.21.15.132:0/2169576825 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x557ff8bd0ed0 0x557ff8bd32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.218+0000 7f8a07563640 1 --2- 172.21.15.132:0/2169576825 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x557ff8bd0ed0 0x557ff8bd32c0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.218+0000 7f8a07563640 1 -- 172.21.15.132:0/2169576825 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f89f8043130 con 0x557ff8bd0ed0 2024-05-08T18:52:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.218+0000 7f8a0b923800 1 -- 172.21.15.132:0/2169576825 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557ff8bcfd70 con 0x557ff8acf5d0 2024-05-08T18:52:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.219+0000 7f8a07d64640 1 -- 172.21.15.132:0/2169576825 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8a0000a4a0 con 0x557ff8acf5d0 2024-05-08T18:52:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.219+0000 7f8a0b923800 1 -- 172.21.15.132:0/2169576825 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557ff8bd0250 con 0x557ff8acf5d0 2024-05-08T18:52:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.219+0000 7f8a07d64640 1 -- 172.21.15.132:0/2169576825 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8a0000a4a0 con 0x557ff8acf5d0 2024-05-08T18:52:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.219+0000 7f8a0b923800 1 Processor -- start 2024-05-08T18:52:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.219+0000 7f8a0b923800 1 -- start start 2024-05-08T18:52:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.219+0000 7f8a0b923800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8be28e0 0x557ff8be2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.219+0000 7f8a0b923800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557ff89bdfc0 con 0x557ff8be28e0 2024-05-08T18:52:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.220+0000 7f8a07d64640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8be28e0 0x557ff8be2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.220+0000 7f8a07d64640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8be28e0 0x557ff8be2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52834/0 (socket says 172.21.15.132:52834) 2024-05-08T18:52:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.220+0000 7f8a07d64640 1 -- 172.21.15.132:0/2941605014 learned_addr learned my addr 172.21.15.132:0/2941605014 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.220+0000 7f8a07d64640 1 -- 172.21.15.132:0/2941605014 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ff8be3240 con 0x557ff8be28e0 2024-05-08T18:52:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.220+0000 7f8a07d64640 1 --2- 172.21.15.132:0/2941605014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8be28e0 0x557ff8be2d00 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x557ff8bc8280 tx=0x7f8a000188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.220+0000 7f88f1602640 1 -- 172.21.15.132:0/2941605014 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a00014450 con 0x557ff8be28e0 2024-05-08T18:52:31.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.220+0000 7f8a0b923800 1 -- 172.21.15.132:0/2941605014 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557ff8be3cb0 con 0x557ff8be28e0 2024-05-08T18:52:31.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.220+0000 7f88f1602640 1 -- 172.21.15.132:0/2941605014 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a000145f0 con 0x557ff8be28e0 2024-05-08T18:52:31.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.220+0000 7f88f1602640 1 -- 172.21.15.132:0/2941605014 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a00028060 con 0x557ff8be28e0 2024-05-08T18:52:31.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.220+0000 7f8a0b923800 1 -- 172.21.15.132:0/2941605014 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ff8be41b0 con 0x557ff8be28e0 2024-05-08T18:52:31.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.221+0000 7f88f1602640 1 -- 172.21.15.132:0/2941605014 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8a00011040 con 0x557ff8be28e0 2024-05-08T18:52:31.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.221+0000 7f88f1602640 1 --2- 172.21.15.132:0/2941605014 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f88e003bb50 0x7f88e003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.221+0000 7f88f1602640 1 -- 172.21.15.132:0/2941605014 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f8a0001e070 con 0x557ff8be28e0 2024-05-08T18:52:31.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.222+0000 7f8a07563640 1 --2- 172.21.15.132:0/2941605014 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f88e003bb50 0x7f88e003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.222+0000 7f8a0b923800 1 Processor -- start 2024-05-08T18:52:31.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.222+0000 7f8a07563640 1 --2- 172.21.15.132:0/2941605014 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f88e003bb50 0x7f88e003e010 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x557ff8bceff0 tx=0x7f89f8016670 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.222+0000 7f8a0b923800 1 -- start start 2024-05-08T18:52:31.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.222+0000 7f8a0b923800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8befba0 0x557ff8beffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.222+0000 7f8a0b923800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557ff8bb7ce0 con 0x557ff8befba0 2024-05-08T18:52:31.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.222+0000 7f8a07d64640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8befba0 0x557ff8beffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.222+0000 7f8a07d64640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8befba0 0x557ff8beffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52838/0 (socket says 172.21.15.132:52838) 2024-05-08T18:52:31.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.222+0000 7f8a07d64640 1 -- 172.21.15.132:0/1804666446 learned_addr learned my addr 172.21.15.132:0/1804666446 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.222+0000 7f8a07d64640 1 -- 172.21.15.132:0/1804666446 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ff8bf0590 con 0x557ff8befba0 2024-05-08T18:52:31.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.223+0000 7f8a07d64640 1 --2- 172.21.15.132:0/1804666446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8befba0 0x557ff8beffc0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8a00052c60 tx=0x7f8a00013520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b38010566fa5f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.223+0000 7f88eaffd640 1 -- 172.21.15.132:0/1804666446 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a00044020 con 0x557ff8befba0 2024-05-08T18:52:31.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.223+0000 7f88eaffd640 1 -- 172.21.15.132:0/1804666446 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a0002b350 con 0x557ff8befba0 2024-05-08T18:52:31.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.223+0000 7f88eaffd640 1 -- 172.21.15.132:0/1804666446 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a00054110 con 0x557ff8befba0 2024-05-08T18:52:31.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.223+0000 7f8a0b923800 1 -- 172.21.15.132:0/1804666446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8befba0 msgr2=0x557ff8beffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.223+0000 7f8a0b923800 1 --2- 172.21.15.132:0/1804666446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8befba0 0x557ff8beffc0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8a00052c60 tx=0x7f8a00013520 comp rx=0 tx=0).stop 2024-05-08T18:52:31.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.223+0000 7f8a0b923800 1 -- 172.21.15.132:0/1804666446 shutdown_connections 2024-05-08T18:52:31.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.223+0000 7f8a0b923800 1 --2- 172.21.15.132:0/1804666446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8befba0 0x557ff8beffc0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.223+0000 7f8a0b923800 1 -- 172.21.15.132:0/1804666446 >> 172.21.15.132:0/1804666446 conn(0x557ff8bebf00 msgr2=0x557ff8be9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.223+0000 7f8a0b923800 1 -- 172.21.15.132:0/1804666446 shutdown_connections 2024-05-08T18:52:31.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.223+0000 7f8a0b923800 1 -- 172.21.15.132:0/1804666446 wait complete. 2024-05-08T18:52:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.224+0000 7f8a0b923800 1 Processor -- start 2024-05-08T18:52:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.224+0000 7f8a0b923800 1 -- start start 2024-05-08T18:52:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.224+0000 7f8a0b923800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8befba0 0x557ff8bf7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.224+0000 7f8a0b923800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557ff8bf0d00 con 0x557ff8befba0 2024-05-08T18:52:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.224+0000 7f8a07d64640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8befba0 0x557ff8bf7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.224+0000 7f8a07d64640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8befba0 0x557ff8bf7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52850/0 (socket says 172.21.15.132:52850) 2024-05-08T18:52:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.224+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 learned_addr learned my addr 172.21.15.132:0/2255535796 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.224+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ff8bf7680 con 0x557ff8befba0 2024-05-08T18:52:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.224+0000 7f8a07d64640 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8befba0 0x557ff8bf7140 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8a00052c60 tx=0x7f8a00052bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.224+0000 7f88e97fa640 1 -- 172.21.15.132:0/2255535796 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a00011330 con 0x557ff8befba0 2024-05-08T18:52:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.224+0000 7f88e97fa640 1 -- 172.21.15.132:0/2255535796 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a00054660 con 0x557ff8befba0 2024-05-08T18:52:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.224+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557ff8bf7910 con 0x557ff8befba0 2024-05-08T18:52:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.225+0000 7f88e97fa640 1 -- 172.21.15.132:0/2255535796 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a000119a0 con 0x557ff8befba0 2024-05-08T18:52:31.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.225+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ff8bfa5c0 con 0x557ff8befba0 2024-05-08T18:52:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.225+0000 7f88e97fa640 1 -- 172.21.15.132:0/2255535796 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8a00011b40 con 0x557ff8befba0 2024-05-08T18:52:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.225+0000 7f88e97fa640 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f88d003bb50 0x7f88d003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.226+0000 7f88e97fa640 1 -- 172.21.15.132:0/2255535796 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f8a0000e040 con 0x557ff8befba0 2024-05-08T18:52:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.226+0000 7f8a07563640 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f88d003bb50 0x7f88d003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.226+0000 7f8a0b923800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.226+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x557ff8c02e20 0x557ff8c052e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.226+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c05a30 con 0x557ff8c02e20 2024-05-08T18:52:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.226+0000 7f8a07563640 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f88d003bb50 0x7f88d003e010 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f89f800c010 tx=0x7f89f8047000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.226+0000 7f89fffff640 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x557ff8c02e20 0x557ff8c052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.226+0000 7f89fffff640 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x557ff8c02e20 0x557ff8c052e0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.227+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89f005a040 con 0x557ff8c02e20 2024-05-08T18:52:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.227+0000 7f8a0b923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.227+0000 7f8a0b923800 20 realm 2024-05-08T18:52:31.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.227+0000 7f8a0b923800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.227+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c05e00 con 0x557ff8c02e20 2024-05-08T18:52:31.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.227+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89f005a040 con 0x557ff8c02e20 2024-05-08T18:52:31.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.227+0000 7f8a0b923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.227+0000 7f8a0b923800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:52:31.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.227+0000 7f8a0b923800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.227+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c066d0 con 0x557ff8c02e20 2024-05-08T18:52:31.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.227+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89f005a040 con 0x557ff8c02e20 2024-05-08T18:52:31.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.227+0000 7f8a0b923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.227+0000 7f8a0b923800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.227+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c06a70 con 0x557ff8c02e20 2024-05-08T18:52:31.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.227+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f89f005a040 con 0x557ff8c02e20 2024-05-08T18:52:31.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.227+0000 7f8a0b923800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:31.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.227+0000 7f8a0b923800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.227+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x557ff8c07520 0x557ff8c09910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.227+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0a070 con 0x557ff8c07520 2024-05-08T18:52:31.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.227+0000 7f8a07d64640 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x557ff8c07520 0x557ff8c09910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.228+0000 7f8a07d64640 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x557ff8c07520 0x557ff8c09910 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.228+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8a0003d020 con 0x557ff8c07520 2024-05-08T18:52:31.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.228+0000 7f8a0b923800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:52:31.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.228+0000 7f8a0b923800 20 searching for the correct realm 2024-05-08T18:52:31.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.228+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x557ff8c07520 2024-05-08T18:52:31.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.228+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0003d020 con 0x557ff8c07520 2024-05-08T18:52:31.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.228+0000 7f8a07d64640 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f8a00014070 0x7f8a00007950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.228+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x7f8a00014070 2024-05-08T18:52:31.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.229+0000 7f8a07563640 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f8a00014070 0x7f8a00007950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.229+0000 7f8a07563640 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f8a00014070 0x7f8a00007950 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.229+0000 7f8a07563640 1 -- 172.21.15.132:0/2255535796 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f8043130 con 0x7f8a00014070 2024-05-08T18:52:31.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.229+0000 7f8a07563640 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f89f8017050 0x7f89f802d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.229+0000 7f8a07563640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x7f89f8017050 2024-05-08T18:52:31.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.229+0000 7f89fffff640 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f89f8017050 0x7f89f802d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.230+0000 7f89fffff640 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f89f8017050 0x7f89f802d610 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.230+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f005a040 con 0x7f89f8017050 2024-05-08T18:52:31.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.230+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x557ff8c02e20 2024-05-08T18:52:31.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.230+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f005a040 con 0x557ff8c02e20 2024-05-08T18:52:31.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.230+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x557ff8c02e20 2024-05-08T18:52:31.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.230+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f005a040 con 0x557ff8c02e20 2024-05-08T18:52:31.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.230+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x7f89f8017050 2024-05-08T18:52:31.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.231+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f005a040 con 0x7f89f8017050 2024-05-08T18:52:31.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.231+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x7f89f8017050 2024-05-08T18:52:31.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.231+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f005a040 con 0x7f89f8017050 2024-05-08T18:52:31.240 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.231+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x7f8a00014070 2024-05-08T18:52:31.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.231+0000 7f8a07563640 1 -- 172.21.15.132:0/2255535796 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f8043130 con 0x7f8a00014070 2024-05-08T18:52:31.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.231+0000 7f8a07563640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x557ff8c07520 2024-05-08T18:52:31.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.231+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0003d020 con 0x557ff8c07520 2024-05-08T18:52:31.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.231+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x557ff8c02e20 2024-05-08T18:52:31.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.232+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f005a040 con 0x557ff8c02e20 2024-05-08T18:52:31.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.232+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x7f89f8017050 2024-05-08T18:52:31.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.232+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f005a040 con 0x7f89f8017050 2024-05-08T18:52:31.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.232+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x557ff8c02e20 2024-05-08T18:52:31.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.232+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f89f005a040 con 0x557ff8c02e20 2024-05-08T18:52:31.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.232+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x7f8a00014070 2024-05-08T18:52:31.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.232+0000 7f8a07563640 1 -- 172.21.15.132:0/2255535796 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f89f8043130 con 0x7f8a00014070 2024-05-08T18:52:31.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.232+0000 7f8a07563640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x557ff8c07520 2024-05-08T18:52:31.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.232+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8a0003d020 con 0x557ff8c07520 2024-05-08T18:52:31.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.233+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x557ff8c07520 2024-05-08T18:52:31.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.233+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0003d020 con 0x557ff8c07520 2024-05-08T18:52:31.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.233+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x7f89f8017050 2024-05-08T18:52:31.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.233+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f005a040 con 0x7f89f8017050 2024-05-08T18:52:31.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.233+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x557ff8c07520 2024-05-08T18:52:31.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.233+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0003d020 con 0x557ff8c07520 2024-05-08T18:52:31.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.233+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x557ff8c07520 2024-05-08T18:52:31.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.233+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0003d020 con 0x557ff8c07520 2024-05-08T18:52:31.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.233+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x557ff8c02e20 2024-05-08T18:52:31.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.234+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f005a040 con 0x557ff8c02e20 2024-05-08T18:52:31.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.234+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x557ff8c02e20 2024-05-08T18:52:31.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.234+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f89f005a040 con 0x557ff8c02e20 2024-05-08T18:52:31.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.234+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x7f89f8017050 2024-05-08T18:52:31.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.234+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f007d040 con 0x7f89f8017050 2024-05-08T18:52:31.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.234+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x557ff8c07520 2024-05-08T18:52:31.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.234+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0003d020 con 0x557ff8c07520 2024-05-08T18:52:31.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.235+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x7f8a00014070 2024-05-08T18:52:31.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.235+0000 7f8a07563640 1 -- 172.21.15.132:0/2255535796 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f8043130 con 0x7f8a00014070 2024-05-08T18:52:31.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.235+0000 7f8a07563640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x557ff8c02e20 2024-05-08T18:52:31.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.235+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f007d040 con 0x557ff8c02e20 2024-05-08T18:52:31.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.235+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x7f8a00014070 2024-05-08T18:52:31.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.235+0000 7f8a07563640 1 -- 172.21.15.132:0/2255535796 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f8043130 con 0x7f8a00014070 2024-05-08T18:52:31.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.235+0000 7f8a07563640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x557ff8c07520 2024-05-08T18:52:31.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.235+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0003d020 con 0x557ff8c07520 2024-05-08T18:52:31.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.235+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x7f89f8017050 2024-05-08T18:52:31.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.236+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f007d040 con 0x7f89f8017050 2024-05-08T18:52:31.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.236+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x7f8a00014070 2024-05-08T18:52:31.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.236+0000 7f8a07563640 1 -- 172.21.15.132:0/2255535796 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f8043130 con 0x7f8a00014070 2024-05-08T18:52:31.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.236+0000 7f8a07563640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x557ff8c07520 2024-05-08T18:52:31.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.236+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a0003d020 con 0x557ff8c07520 2024-05-08T18:52:31.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.236+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x7f89f8017050 2024-05-08T18:52:31.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.237+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f007d040 con 0x7f89f8017050 2024-05-08T18:52:31.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.237+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x557ff8c02e20 2024-05-08T18:52:31.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.237+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f89f007d040 con 0x557ff8c02e20 2024-05-08T18:52:31.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.237+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ba50 con 0x7f8a00014070 2024-05-08T18:52:31.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.237+0000 7f8a07563640 1 -- 172.21.15.132:0/2255535796 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89f8043130 con 0x7f8a00014070 2024-05-08T18:52:31.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:52:31.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:52:31.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:52:31.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:52:31.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:52:31.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:52:31.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ab20 con 0x557ff8c02e20 2024-05-08T18:52:31.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89f007d040 con 0x557ff8c02e20 2024-05-08T18:52:31.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0a760 con 0x557ff8c02e20 2024-05-08T18:52:31.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f89f007d040 con 0x557ff8c02e20 2024-05-08T18:52:31.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:31.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0b440 con 0x557ff8c02e20 2024-05-08T18:52:31.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f89f007d040 con 0x557ff8c02e20 2024-05-08T18:52:31.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:52:31.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 20 zone default found 2024-05-08T18:52:31.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 4 Realm: () 2024-05-08T18:52:31.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:52:31.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:52:31.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:52:31.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 20 zonegroup default 2024-05-08T18:52:31.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0c3d0 con 0x7f8a00014070 2024-05-08T18:52:31.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a07563640 1 -- 172.21.15.132:0/2255535796 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f89f8043130 con 0x7f8a00014070 2024-05-08T18:52:31.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.238+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0e1b0 con 0x557ff8c07520 2024-05-08T18:52:31.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.239+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8a0003d020 con 0x557ff8c07520 2024-05-08T18:52:31.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.239+0000 7f8a0b923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.239+0000 7f8a0b923800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.239+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0e620 con 0x557ff8c07520 2024-05-08T18:52:31.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.239+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8a0003d020 con 0x557ff8c07520 2024-05-08T18:52:31.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.239+0000 7f8a0b923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.239+0000 7f8a0b923800 20 started sync module instance, tier type = 2024-05-08T18:52:31.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.239+0000 7f8a0b923800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:52:31.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.239+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0d5f0 con 0x7f8a00014070 2024-05-08T18:52:31.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.240+0000 7f8a07563640 1 -- 172.21.15.132:0/2255535796 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f8043130 con 0x7f8a00014070 2024-05-08T18:52:31.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.240+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94008122593600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0ea80 con 0x7f8a00014070 2024-05-08T18:52:31.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.240+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0f2d0 con 0x557ff8c02e20 2024-05-08T18:52:31.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.241+0000 7f8a07563640 1 -- 172.21.15.132:0/2255535796 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94008122593600] v27'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f8043130 con 0x7f8a00014070 2024-05-08T18:52:31.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.241+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f007d040 con 0x557ff8c02e20 2024-05-08T18:52:31.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.241+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94008122600992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c0f6f0 con 0x557ff8c02e20 2024-05-08T18:52:31.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.242+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c100b0 con 0x557ff8c07520 2024-05-08T18:52:31.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.243+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94008122600992] v27'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f007d040 con 0x557ff8c02e20 2024-05-08T18:52:31.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.243+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0003d020 con 0x557ff8c07520 2024-05-08T18:52:31.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.243+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94008122602528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c100b0 con 0x557ff8c07520 2024-05-08T18:52:31.255 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.243+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c10a70 con 0x7f8a00014070 2024-05-08T18:52:31.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.244+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94008122602528] v27'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0003d020 con 0x557ff8c07520 2024-05-08T18:52:31.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.244+0000 7f8a07563640 1 -- 172.21.15.132:0/2255535796 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f8043130 con 0x7f8a00014070 2024-05-08T18:52:31.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.244+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94008122604544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c10020 con 0x7f8a00014070 2024-05-08T18:52:31.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.244+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c11930 con 0x557ff8c02e20 2024-05-08T18:52:31.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.247+0000 7f8a07563640 1 -- 172.21.15.132:0/2255535796 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94008122604544] v27'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f8043130 con 0x7f8a00014070 2024-05-08T18:52:31.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.247+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f007d040 con 0x557ff8c02e20 2024-05-08T18:52:31.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.247+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94008122610816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c118a0 con 0x557ff8c02e20 2024-05-08T18:52:31.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.247+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c127f0 con 0x7f89f8017050 2024-05-08T18:52:31.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.248+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94008122610816] v27'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f007d040 con 0x557ff8c02e20 2024-05-08T18:52:31.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.248+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f007d040 con 0x7f89f8017050 2024-05-08T18:52:31.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.248+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94008122612944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c127f0 con 0x7f89f8017050 2024-05-08T18:52:31.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.248+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c13240 con 0x7f89f8017050 2024-05-08T18:52:31.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.249+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94008122612944] v27'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f007d040 con 0x7f89f8017050 2024-05-08T18:52:31.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.250+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f007d040 con 0x7f89f8017050 2024-05-08T18:52:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.250+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94008122617168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c127f0 con 0x7f89f8017050 2024-05-08T18:52:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.250+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c13c50 con 0x7f89f8017050 2024-05-08T18:52:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.251+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94008122617168] v27'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f007d040 con 0x7f89f8017050 2024-05-08T18:52:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.251+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f007d040 con 0x7f89f8017050 2024-05-08T18:52:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.251+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94008122614592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c127e0 con 0x7f89f8017050 2024-05-08T18:52:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.251+0000 7f8a0b923800 20 add_watcher() i=0 2024-05-08T18:52:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.251+0000 7f8a0b923800 20 add_watcher() i=1 2024-05-08T18:52:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.251+0000 7f8a0b923800 20 add_watcher() i=2 2024-05-08T18:52:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.251+0000 7f8a0b923800 20 add_watcher() i=3 2024-05-08T18:52:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.251+0000 7f8a0b923800 20 add_watcher() i=4 2024-05-08T18:52:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.251+0000 7f8a0b923800 20 add_watcher() i=5 2024-05-08T18:52:31.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.251+0000 7f8a0b923800 20 add_watcher() i=6 2024-05-08T18:52:31.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.252+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94008122614592] v27'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f007d040 con 0x7f89f8017050 2024-05-08T18:52:31.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.252+0000 7f8a0b923800 20 add_watcher() i=7 2024-05-08T18:52:31.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.252+0000 7f8a0b923800 2 all 8 watchers are set, enabling cache 2024-05-08T18:52:31.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.252+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c174b0 con 0x557ff8c02e20 2024-05-08T18:52:31.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.252+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f89f007d040 con 0x557ff8c02e20 2024-05-08T18:52:31.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.252+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94008122621904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c148e0 con 0x557ff8c02e20 2024-05-08T18:52:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.253+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94008122621904] v27'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f89f007d040 con 0x557ff8c02e20 2024-05-08T18:52:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.253+0000 7f88bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.253+0000 7f8a0b923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.253+0000 7f8a0b923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.253+0000 7f8a0b923800 5 note: GC not initialized 2024-05-08T18:52:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.253+0000 7f88bcfe1640 20 reqs_thread_entry: start 2024-05-08T18:52:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.254+0000 7f8a0b923800 20 init_complete bucket index max shards: 11 2024-05-08T18:52:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.254+0000 7f8a0b923800 20 Filter name: none 2024-05-08T18:52:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.254+0000 7f88367fc640 20 reqs_thread_entry: start 2024-05-08T18:52:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.254+0000 7f8a0b923800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.254+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c4a3b0 con 0x557ff8c02e20 2024-05-08T18:52:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.254+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f89f007d040 con 0x557ff8c02e20 2024-05-08T18:52:31.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.254+0000 7f8a0b923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:could not fetch user info: no user info saved 2024-05-08T18:52:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.255+0000 7f88bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.255+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94008122621904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c4a370 con 0x557ff8c02e20 2024-05-08T18:52:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.256+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94008122621904] v27'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f89f007d040 con 0x557ff8c02e20 2024-05-08T18:52:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.256+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94008122593600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c4a370 con 0x7f8a00014070 2024-05-08T18:52:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.257+0000 7f8a07563640 1 -- 172.21.15.132:0/2255535796 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94008122593600] v27'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f8043130 con 0x7f8a00014070 2024-05-08T18:52:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.257+0000 7f8a0b923800 20 remove_watcher() i=0 2024-05-08T18:52:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.257+0000 7f8a0b923800 2 removed watcher, disabling cache 2024-05-08T18:52:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.257+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94008122600992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c4a370 con 0x557ff8c02e20 2024-05-08T18:52:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.258+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94008122600992] v27'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f007d040 con 0x557ff8c02e20 2024-05-08T18:52:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.258+0000 7f8a0b923800 20 remove_watcher() i=1 2024-05-08T18:52:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.258+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94008122602528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c4a370 con 0x557ff8c07520 2024-05-08T18:52:31.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.259+0000 7f8a07d64640 1 -- 172.21.15.132:0/2255535796 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94008122602528] v27'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a0003d020 con 0x557ff8c07520 2024-05-08T18:52:31.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.259+0000 7f8a0b923800 20 remove_watcher() i=2 2024-05-08T18:52:31.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.259+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94008122604544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c4a370 con 0x7f8a00014070 2024-05-08T18:52:31.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.260+0000 7f8a07563640 1 -- 172.21.15.132:0/2255535796 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94008122604544] v27'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f8043130 con 0x7f8a00014070 2024-05-08T18:52:31.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.260+0000 7f8a0b923800 20 remove_watcher() i=3 2024-05-08T18:52:31.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.260+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94008122610816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c4a370 con 0x557ff8c02e20 2024-05-08T18:52:31.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.261+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94008122610816] v27'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f007d040 con 0x557ff8c02e20 2024-05-08T18:52:31.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.261+0000 7f8a0b923800 20 remove_watcher() i=4 2024-05-08T18:52:31.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.261+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94008122612944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c4a370 con 0x7f89f8017050 2024-05-08T18:52:31.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.262+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94008122612944] v27'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f007d040 con 0x7f89f8017050 2024-05-08T18:52:31.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.262+0000 7f8a0b923800 20 remove_watcher() i=5 2024-05-08T18:52:31.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.262+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94008122617168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c4a370 con 0x7f89f8017050 2024-05-08T18:52:31.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.263+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94008122617168] v27'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f007d040 con 0x7f89f8017050 2024-05-08T18:52:31.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.263+0000 7f8a0b923800 20 remove_watcher() i=6 2024-05-08T18:52:31.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.263+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94008122614592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557ff8c4a370 con 0x7f89f8017050 2024-05-08T18:52:31.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.264+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94008122614592] v27'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89f007d040 con 0x7f89f8017050 2024-05-08T18:52:31.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.264+0000 7f8a0b923800 20 remove_watcher() i=7 2024-05-08T18:52:31.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f89f8017050 msgr2=0x7f89f802d610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f89f8017050 0x7f89f802d610 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x557ff8c02e20 msgr2=0x557ff8c052e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x557ff8c02e20 0x557ff8c052e0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f8a00014070 msgr2=0x7f8a00007950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f8a00014070 0x7f8a00007950 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x557ff8c07520 msgr2=0x557ff8c09910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x557ff8c07520 0x557ff8c09910 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f88d003bb50 msgr2=0x7f88d003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f88d003bb50 0x7f88d003e010 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f89f800c010 tx=0x7f89f8047000 comp rx=0 tx=0).stop 2024-05-08T18:52:31.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8befba0 msgr2=0x557ff8bf7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f89fffff640 1 -- 172.21.15.132:0/2255535796 reap_dead start 2024-05-08T18:52:31.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8befba0 0x557ff8bf7140 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8a00052c60 tx=0x7f8a00052bf0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 shutdown_connections 2024-05-08T18:52:31.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2255535796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8befba0 0x557ff8bf7140 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 >> 172.21.15.132:0/2255535796 conn(0x557ff8bebf00 msgr2=0x557ff8be9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 shutdown_connections 2024-05-08T18:52:31.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 -- 172.21.15.132:0/2255535796 wait complete. 2024-05-08T18:52:31.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 -- 172.21.15.132:0/2941605014 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f88e003bb50 msgr2=0x7f88e003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2941605014 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f88e003bb50 0x7f88e003e010 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x557ff8bceff0 tx=0x7f89f8016670 comp rx=0 tx=0).stop 2024-05-08T18:52:31.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 -- 172.21.15.132:0/2941605014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8be28e0 msgr2=0x557ff8be2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2941605014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8be28e0 0x557ff8be2d00 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x557ff8bc8280 tx=0x7f8a000188f0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 -- 172.21.15.132:0/2941605014 shutdown_connections 2024-05-08T18:52:31.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2941605014 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f88e003bb50 0x7f88e003e010 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2941605014 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8be28e0 0x557ff8be2d00 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 -- 172.21.15.132:0/2941605014 >> 172.21.15.132:0/2941605014 conn(0x557ff8bd6980 msgr2=0x557ff8bd6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 -- 172.21.15.132:0/2941605014 shutdown_connections 2024-05-08T18:52:31.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.265+0000 7f8a0b923800 1 -- 172.21.15.132:0/2941605014 wait complete. 2024-05-08T18:52:31.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.266+0000 7f8a0b923800 1 -- 172.21.15.132:0/2169576825 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x557ff8acf5d0 msgr2=0x557ff8bce5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.266+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2169576825 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x557ff8acf5d0 0x557ff8bce5f0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.266+0000 7f8a0b923800 1 -- 172.21.15.132:0/2169576825 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x557ff8bd0ed0 msgr2=0x557ff8bd32c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.266+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2169576825 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x557ff8bd0ed0 0x557ff8bd32c0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.266+0000 7f8a0b923800 1 -- 172.21.15.132:0/2169576825 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f88ec03bb50 msgr2=0x7f88ec03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.266+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2169576825 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f88ec03bb50 0x7f88ec03e010 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f89f0054000 tx=0x7f89f004e000 comp rx=0 tx=0).stop 2024-05-08T18:52:31.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.266+0000 7f8a0b923800 1 -- 172.21.15.132:0/2169576825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8acb140 msgr2=0x557ff8bc73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.266+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2169576825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8acb140 0x557ff8bc73b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f89f800b7c0 tx=0x7f89f8000ed0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.266+0000 7f8a0b923800 1 -- 172.21.15.132:0/2169576825 shutdown_connections 2024-05-08T18:52:31.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.266+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2169576825 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x557ff8bd0ed0 0x557ff8bd32c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.266+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2169576825 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x557ff8acf5d0 0x557ff8bce5f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.266+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2169576825 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f88ec03bb50 0x7f88ec03e010 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.266+0000 7f8a0b923800 1 --2- 172.21.15.132:0/2169576825 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557ff8acb140 0x557ff8bc73b0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.266+0000 7f8a0b923800 1 -- 172.21.15.132:0/2169576825 >> 172.21.15.132:0/2169576825 conn(0x557ff8ac6720 msgr2=0x557ff8bb6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.266+0000 7f8a0b923800 1 -- 172.21.15.132:0/2169576825 shutdown_connections 2024-05-08T18:52:31.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.266+0000 7f8a0b923800 1 -- 172.21.15.132:0/2169576825 wait complete. 2024-05-08T18:52:31.274 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-08T18:52:31.274 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-05-08T18:52:31.274 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-05-08T18:52:31.274 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-05-08T18:52:31.317 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:31.317 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:31.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.318+0000 7f984e936800 1 Processor -- start 2024-05-08T18:52:31.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.319+0000 7f984e936800 1 -- start start 2024-05-08T18:52:31.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.319+0000 7f984e936800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x562e6735e700 0x562e67360af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.319+0000 7f984e936800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562e673610c0 con 0x562e6735a3b0 2024-05-08T18:52:31.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.319+0000 7f984e936800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x562e671fae20 con 0x562e6735e700 2024-05-08T18:52:31.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.319+0000 7f9843fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x562e6735e700 0x562e67360af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.319+0000 7f984a6c5640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x562e6735a3b0 0x562e6735a7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48054/0 (socket says 172.21.15.132:48054) 2024-05-08T18:52:31.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.319+0000 7f984a6c5640 1 -- 172.21.15.132:0/2436565096 learned_addr learned my addr 172.21.15.132:0/2436565096 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:52:31.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.319+0000 7f9843fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x562e6735e700 0x562e67360af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52860/0 (socket says 172.21.15.132:52860) 2024-05-08T18:52:31.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.319+0000 7f9843fff640 1 -- 172.21.15.132:0/2436565096 >> v1:172.21.15.42:6789/0 conn(0x562e6735a3b0 legacy=0x562e6735a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.319+0000 7f9843fff640 1 -- 172.21.15.132:0/2436565096 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e673622f0 con 0x562e6735e700 2024-05-08T18:52:31.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.319+0000 7f9849ec4640 1 -- 172.21.15.132:0/2436565096 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3151361404 0 0) 0x562e673610c0 con 0x562e6735a3b0 2024-05-08T18:52:31.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.321+0000 7f9843fff640 1 --2- 172.21.15.132:0/2436565096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e6735e700 0x562e67360af0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f983400a470 tx=0x7f983401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7fe2836de499a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.321+0000 7f9849ec4640 1 -- 172.21.15.132:0/2436565096 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9834057070 con 0x562e6735e700 2024-05-08T18:52:31.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.321+0000 7f9849ec4640 1 -- 172.21.15.132:0/2436565096 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9834052570 con 0x562e6735e700 2024-05-08T18:52:31.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.321+0000 7f9849ec4640 1 -- 172.21.15.132:0/2436565096 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9834052870 con 0x562e6735e700 2024-05-08T18:52:31.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.322+0000 7f984e936800 1 -- 172.21.15.132:0/2436565096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e6735e700 msgr2=0x562e67360af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.322+0000 7f984e936800 1 --2- 172.21.15.132:0/2436565096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e6735e700 0x562e67360af0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f983400a470 tx=0x7f983401ce90 comp rx=0 tx=0).stop 2024-05-08T18:52:31.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.322+0000 7f984e936800 1 -- 172.21.15.132:0/2436565096 shutdown_connections 2024-05-08T18:52:31.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.322+0000 7f984e936800 1 --2- 172.21.15.132:0/2436565096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e6735e700 0x562e67360af0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.322+0000 7f984e936800 1 -- 172.21.15.132:0/2436565096 >> 172.21.15.132:0/2436565096 conn(0x562e67355970 msgr2=0x562e67357d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.322+0000 7f984e936800 1 -- 172.21.15.132:0/2436565096 shutdown_connections 2024-05-08T18:52:31.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.322+0000 7f984e936800 1 -- 172.21.15.132:0/2436565096 wait complete. 2024-05-08T18:52:31.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.335+0000 7f984e936800 1 Processor -- start 2024-05-08T18:52:31.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.335+0000 7f984e936800 1 -- start start 2024-05-08T18:52:31.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.336+0000 7f984e936800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e6735a3b0 0x562e6744b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.336+0000 7f984e936800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562e672a55b0 con 0x562e6735a3b0 2024-05-08T18:52:31.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.336+0000 7f984a6c5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e6735a3b0 0x562e6744b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.336+0000 7f984a6c5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e6735a3b0 0x562e6744b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52872/0 (socket says 172.21.15.132:52872) 2024-05-08T18:52:31.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.336+0000 7f984a6c5640 1 -- 172.21.15.132:0/2411655951 learned_addr learned my addr 172.21.15.132:0/2411655951 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.336+0000 7f984a6c5640 1 -- 172.21.15.132:0/2411655951 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e6744bb10 con 0x562e6735a3b0 2024-05-08T18:52:31.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.336+0000 7f984a6c5640 1 --2- 172.21.15.132:0/2411655951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e6735a3b0 0x562e6744b540 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f983c00b240 tx=0x7f983c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5edd6035343a97df server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.337+0000 7f9738608640 1 -- 172.21.15.132:0/2411655951 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f983c008070 con 0x562e6735a3b0 2024-05-08T18:52:31.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.337+0000 7f9738608640 1 -- 172.21.15.132:0/2411655951 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f983c00d500 con 0x562e6735a3b0 2024-05-08T18:52:31.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.337+0000 7f9738608640 1 -- 172.21.15.132:0/2411655951 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f983c00d860 con 0x562e6735a3b0 2024-05-08T18:52:31.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.337+0000 7f984e936800 1 -- 172.21.15.132:0/2411655951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e6735a3b0 msgr2=0x562e6744b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.337+0000 7f984e936800 1 --2- 172.21.15.132:0/2411655951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e6735a3b0 0x562e6744b540 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f983c00b240 tx=0x7f983c00b700 comp rx=0 tx=0).stop 2024-05-08T18:52:31.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.337+0000 7f984e936800 1 -- 172.21.15.132:0/2411655951 shutdown_connections 2024-05-08T18:52:31.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.337+0000 7f984e936800 1 --2- 172.21.15.132:0/2411655951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e6735a3b0 0x562e6744b540 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.337+0000 7f984e936800 1 -- 172.21.15.132:0/2411655951 >> 172.21.15.132:0/2411655951 conn(0x562e67355970 msgr2=0x562e67446e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.337+0000 7f984e936800 1 -- 172.21.15.132:0/2411655951 shutdown_connections 2024-05-08T18:52:31.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.337+0000 7f984e936800 1 -- 172.21.15.132:0/2411655951 wait complete. 2024-05-08T18:52:31.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.338+0000 7f984e936800 1 Processor -- start 2024-05-08T18:52:31.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.338+0000 7f984e936800 1 -- start start 2024-05-08T18:52:31.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.338+0000 7f984e936800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e6735a3b0 0x562e674530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.338+0000 7f984e936800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562e67361590 con 0x562e6735a3b0 2024-05-08T18:52:31.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.338+0000 7f984a6c5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e6735a3b0 0x562e674530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.338+0000 7f984a6c5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e6735a3b0 0x562e674530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52874/0 (socket says 172.21.15.132:52874) 2024-05-08T18:52:31.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.338+0000 7f984a6c5640 1 -- 172.21.15.132:0/2840843942 learned_addr learned my addr 172.21.15.132:0/2840843942 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.338+0000 7f984a6c5640 1 -- 172.21.15.132:0/2840843942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e67453620 con 0x562e6735a3b0 2024-05-08T18:52:31.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.339+0000 7f984a6c5640 1 --2- 172.21.15.132:0/2840843942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e6735a3b0 0x562e674530e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f983c000f60 tx=0x7f983c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.339+0000 7f9736e05640 1 -- 172.21.15.132:0/2840843942 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f983c019870 con 0x562e6735a3b0 2024-05-08T18:52:31.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.339+0000 7f9736e05640 1 -- 172.21.15.132:0/2840843942 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f983c019a10 con 0x562e6735a3b0 2024-05-08T18:52:31.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.339+0000 7f984e936800 1 -- 172.21.15.132:0/2840843942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e674538b0 con 0x562e6735a3b0 2024-05-08T18:52:31.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.339+0000 7f9736e05640 1 -- 172.21.15.132:0/2840843942 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f983c019d10 con 0x562e6735a3b0 2024-05-08T18:52:31.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.339+0000 7f984e936800 1 -- 172.21.15.132:0/2840843942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e67456560 con 0x562e6735a3b0 2024-05-08T18:52:31.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.339+0000 7f984e936800 1 Processor -- start 2024-05-08T18:52:31.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.340+0000 7f984e936800 1 -- start start 2024-05-08T18:52:31.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.340+0000 7f984e936800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e67460750 0x562e67460b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.340+0000 7f984e936800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562e6724bfc0 con 0x562e67460750 2024-05-08T18:52:31.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.340+0000 7f984aec6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e67460750 0x562e67460b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.340+0000 7f984aec6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e67460750 0x562e67460b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52884/0 (socket says 172.21.15.132:52884) 2024-05-08T18:52:31.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.340+0000 7f984aec6640 1 -- 172.21.15.132:0/1169659328 learned_addr learned my addr 172.21.15.132:0/1169659328 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.340+0000 7f9736e05640 1 -- 172.21.15.132:0/2840843942 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f983c017040 con 0x562e6735a3b0 2024-05-08T18:52:31.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.340+0000 7f984aec6640 1 -- 172.21.15.132:0/1169659328 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e674610b0 con 0x562e67460750 2024-05-08T18:52:31.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.340+0000 7f9736e05640 1 --2- 172.21.15.132:0/2840843942 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f973003bba0 0x7f973003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.340+0000 7f984aec6640 1 --2- 172.21.15.132:0/1169659328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e67460750 0x562e67460b70 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f984400a430 tx=0x7f984400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61d72d256480268 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.340+0000 7f9736e05640 1 -- 172.21.15.132:0/2840843942 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f983c015020 con 0x562e6735a3b0 2024-05-08T18:52:31.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.340+0000 7f984a6c5640 1 --2- 172.21.15.132:0/2840843942 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f973003bba0 0x7f973003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.341+0000 7f9734e01640 1 -- 172.21.15.132:0/1169659328 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9844015070 con 0x562e67460750 2024-05-08T18:52:31.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.341+0000 7f9734e01640 1 -- 172.21.15.132:0/1169659328 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9844001670 con 0x562e67460750 2024-05-08T18:52:31.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.341+0000 7f9734e01640 1 -- 172.21.15.132:0/1169659328 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9844001990 con 0x562e67460750 2024-05-08T18:52:31.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.341+0000 7f984e936800 1 -- 172.21.15.132:0/1169659328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e67460750 msgr2=0x562e67460b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.341+0000 7f984a6c5640 1 --2- 172.21.15.132:0/2840843942 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f973003bba0 0x7f973003e060 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f983c001540 tx=0x7f983c019eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.341+0000 7f984e936800 1 --2- 172.21.15.132:0/1169659328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e67460750 0x562e67460b70 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f984400a430 tx=0x7f984400a8f0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.341+0000 7f984e936800 1 -- 172.21.15.132:0/1169659328 shutdown_connections 2024-05-08T18:52:31.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.341+0000 7f984e936800 1 --2- 172.21.15.132:0/1169659328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e67460750 0x562e67460b70 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.341+0000 7f984e936800 1 -- 172.21.15.132:0/1169659328 >> 172.21.15.132:0/1169659328 conn(0x562e6735e700 msgr2=0x562e6745d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.341+0000 7f984e936800 1 -- 172.21.15.132:0/1169659328 shutdown_connections 2024-05-08T18:52:31.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.341+0000 7f984e936800 1 -- 172.21.15.132:0/1169659328 wait complete. 2024-05-08T18:52:31.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.341+0000 7f984e936800 1 Processor -- start 2024-05-08T18:52:31.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.341+0000 7f984e936800 1 -- start start 2024-05-08T18:52:31.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.342+0000 7f984e936800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e67460750 0x562e67467bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.342+0000 7f984e936800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562e67461a40 con 0x562e67460750 2024-05-08T18:52:31.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.342+0000 7f984aec6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e67460750 0x562e67467bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.342+0000 7f984aec6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e67460750 0x562e67467bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52892/0 (socket says 172.21.15.132:52892) 2024-05-08T18:52:31.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.342+0000 7f984aec6640 1 -- 172.21.15.132:0/1794894385 learned_addr learned my addr 172.21.15.132:0/1794894385 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.342+0000 7f984aec6640 1 -- 172.21.15.132:0/1794894385 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e67468110 con 0x562e67460750 2024-05-08T18:52:31.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.342+0000 7f984aec6640 1 --2- 172.21.15.132:0/1794894385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e67460750 0x562e67467bd0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9844013040 tx=0x7f9844003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.342+0000 7f972effd640 1 -- 172.21.15.132:0/1794894385 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9844020020 con 0x562e67460750 2024-05-08T18:52:31.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.342+0000 7f972effd640 1 -- 172.21.15.132:0/1794894385 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98440108e0 con 0x562e67460750 2024-05-08T18:52:31.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.342+0000 7f984e936800 1 -- 172.21.15.132:0/1794894385 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e674683a0 con 0x562e67460750 2024-05-08T18:52:31.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.342+0000 7f972effd640 1 -- 172.21.15.132:0/1794894385 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9844015040 con 0x562e67460750 2024-05-08T18:52:31.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.342+0000 7f984e936800 1 -- 172.21.15.132:0/1794894385 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e6746b050 con 0x562e67460750 2024-05-08T18:52:31.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.343+0000 7f972effd640 1 -- 172.21.15.132:0/1794894385 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9844023020 con 0x562e67460750 2024-05-08T18:52:31.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.343+0000 7f972effd640 1 --2- 172.21.15.132:0/1794894385 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f972403bba0 0x7f972403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.343+0000 7f972effd640 1 -- 172.21.15.132:0/1794894385 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f9844052330 con 0x562e67460750 2024-05-08T18:52:31.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.344+0000 7f9843fff640 1 --2- 172.21.15.132:0/1794894385 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f972403bba0 0x7f972403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.344+0000 7f984e936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:31.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.344+0000 7f984e936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:31.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.344+0000 7f9843fff640 1 --2- 172.21.15.132:0/1794894385 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f972403bba0 0x7f972403e060 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9834054000 tx=0x7f983404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.344+0000 7f984e936800 1 Processor -- start 2024-05-08T18:52:31.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.344+0000 7f984e936800 1 -- start start 2024-05-08T18:52:31.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.344+0000 7f984e936800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e674822b0 0x562e674826d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.344+0000 7f984e936800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x562e6744be90 con 0x562e674822b0 2024-05-08T18:52:31.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.344+0000 7f984a6c5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e674822b0 0x562e674826d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.344+0000 7f984a6c5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e674822b0 0x562e674826d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52900/0 (socket says 172.21.15.132:52900) 2024-05-08T18:52:31.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.344+0000 7f984a6c5640 1 -- 172.21.15.132:0/3329349305 learned_addr learned my addr 172.21.15.132:0/3329349305 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.345+0000 7f984a6c5640 1 -- 172.21.15.132:0/3329349305 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e67482c10 con 0x562e674822b0 2024-05-08T18:52:31.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.345+0000 7f984a6c5640 1 --2- 172.21.15.132:0/3329349305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e674822b0 0x562e674826d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f983c0517d0 tx=0x7f983c018e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.345+0000 7f970efe5640 1 -- 172.21.15.132:0/3329349305 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f983c00e750 con 0x562e674822b0 2024-05-08T18:52:31.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.345+0000 7f970efe5640 1 -- 172.21.15.132:0/3329349305 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f983c035020 con 0x562e674822b0 2024-05-08T18:52:31.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.345+0000 7f984e936800 1 -- 172.21.15.132:0/3329349305 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e67483680 con 0x562e674822b0 2024-05-08T18:52:31.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.345+0000 7f970efe5640 1 -- 172.21.15.132:0/3329349305 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f983c0183d0 con 0x562e674822b0 2024-05-08T18:52:31.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.345+0000 7f984e936800 1 -- 172.21.15.132:0/3329349305 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e67483b80 con 0x562e674822b0 2024-05-08T18:52:31.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.346+0000 7f970efe5640 1 -- 172.21.15.132:0/3329349305 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f983c018570 con 0x562e674822b0 2024-05-08T18:52:31.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.346+0000 7f970efe5640 1 --2- 172.21.15.132:0/3329349305 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f968c03bb50 0x7f968c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.346+0000 7f970efe5640 1 -- 172.21.15.132:0/3329349305 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f983c036030 con 0x562e674822b0 2024-05-08T18:52:31.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.346+0000 7f9843fff640 1 --2- 172.21.15.132:0/3329349305 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f968c03bb50 0x7f968c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.346+0000 7f970cfe1640 20 reqs_thread_entry: start 2024-05-08T18:52:31.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.346+0000 7f984e936800 1 --2- 172.21.15.132:0/2840843942 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562e6748fec0 0x562e67492350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.346+0000 7f9843fff640 1 --2- 172.21.15.132:0/3329349305 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f968c03bb50 0x7f968c03e010 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9834052540 tx=0x7f9834005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.346+0000 7f984e936800 1 -- 172.21.15.132:0/2840843942 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562e67492a20 con 0x562e6748fec0 2024-05-08T18:52:31.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.347+0000 7f984aec6640 1 --2- 172.21.15.132:0/2840843942 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562e6748fec0 0x562e67492350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.347+0000 7f984aec6640 1 --2- 172.21.15.132:0/2840843942 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562e6748fec0 0x562e67492350 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.347+0000 7f984aec6640 1 -- 172.21.15.132:0/2840843942 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f984400e070 con 0x562e6748fec0 2024-05-08T18:52:31.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.347+0000 7f984e936800 1 --2- 172.21.15.132:0/2840843942 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562e674947f0 0x562e67496be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.347+0000 7f984e936800 1 -- 172.21.15.132:0/2840843942 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:2 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562e674972d0 con 0x562e674947f0 2024-05-08T18:52:31.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.347+0000 7f984a6c5640 1 --2- 172.21.15.132:0/2840843942 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562e674947f0 0x562e67496be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.347+0000 7f984a6c5640 1 --2- 172.21.15.132:0/2840843942 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562e674947f0 0x562e67496be0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.348+0000 7f984a6c5640 1 -- 172.21.15.132:0/2840843942 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(2 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f983c05e040 con 0x562e674947f0 2024-05-08T18:52:31.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 -- 172.21.15.132:0/1794894385 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f972403bba0 msgr2=0x7f972403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 --2- 172.21.15.132:0/1794894385 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f972403bba0 0x7f972403e060 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9834054000 tx=0x7f983404e000 comp rx=0 tx=0).stop 2024-05-08T18:52:31.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 -- 172.21.15.132:0/1794894385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e67460750 msgr2=0x562e67467bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 --2- 172.21.15.132:0/1794894385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e67460750 0x562e67467bd0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9844013040 tx=0x7f9844003370 comp rx=0 tx=0).stop 2024-05-08T18:52:31.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 -- 172.21.15.132:0/1794894385 shutdown_connections 2024-05-08T18:52:31.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 --2- 172.21.15.132:0/1794894385 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f972403bba0 0x7f972403e060 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 --2- 172.21.15.132:0/1794894385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e67460750 0x562e67467bd0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 -- 172.21.15.132:0/1794894385 >> 172.21.15.132:0/1794894385 conn(0x562e6735e700 msgr2=0x562e6745a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 -- 172.21.15.132:0/1794894385 shutdown_connections 2024-05-08T18:52:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 -- 172.21.15.132:0/1794894385 wait complete. 2024-05-08T18:52:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 -- 172.21.15.132:0/3329349305 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f968c03bb50 msgr2=0x7f968c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 --2- 172.21.15.132:0/3329349305 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f968c03bb50 0x7f968c03e010 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9834052540 tx=0x7f9834005a00 comp rx=0 tx=0).stop 2024-05-08T18:52:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 -- 172.21.15.132:0/3329349305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e674822b0 msgr2=0x562e674826d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 --2- 172.21.15.132:0/3329349305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e674822b0 0x562e674826d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f983c0517d0 tx=0x7f983c018e30 comp rx=0 tx=0).stop 2024-05-08T18:52:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 -- 172.21.15.132:0/3329349305 shutdown_connections 2024-05-08T18:52:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 --2- 172.21.15.132:0/3329349305 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f968c03bb50 0x7f968c03e010 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 --2- 172.21.15.132:0/3329349305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e674822b0 0x562e674826d0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 -- 172.21.15.132:0/3329349305 >> 172.21.15.132:0/3329349305 conn(0x562e67476d60 msgr2=0x562e67477780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 -- 172.21.15.132:0/3329349305 shutdown_connections 2024-05-08T18:52:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 -- 172.21.15.132:0/3329349305 wait complete. 2024-05-08T18:52:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 -- 172.21.15.132:0/2840843942 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562e6748fec0 msgr2=0x562e67492350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 --2- 172.21.15.132:0/2840843942 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562e6748fec0 0x562e67492350 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 -- 172.21.15.132:0/2840843942 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562e674947f0 msgr2=0x562e67496be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 --2- 172.21.15.132:0/2840843942 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562e674947f0 0x562e67496be0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 -- 172.21.15.132:0/2840843942 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f973003bba0 msgr2=0x7f973003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 --2- 172.21.15.132:0/2840843942 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f973003bba0 0x7f973003e060 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f983c001540 tx=0x7f983c019eb0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 -- 172.21.15.132:0/2840843942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e6735a3b0 msgr2=0x562e674530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 --2- 172.21.15.132:0/2840843942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e6735a3b0 0x562e674530e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f983c000f60 tx=0x7f983c000ed0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.349+0000 7f984e936800 1 -- 172.21.15.132:0/2840843942 shutdown_connections 2024-05-08T18:52:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.350+0000 7f984e936800 1 --2- 172.21.15.132:0/2840843942 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x562e674947f0 0x562e67496be0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.350+0000 7f984e936800 1 --2- 172.21.15.132:0/2840843942 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x562e6748fec0 0x562e67492350 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.350+0000 7f984e936800 1 --2- 172.21.15.132:0/2840843942 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f973003bba0 0x7f973003e060 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.350+0000 7f984e936800 1 --2- 172.21.15.132:0/2840843942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x562e6735a3b0 0x562e674530e0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.350+0000 7f984e936800 1 -- 172.21.15.132:0/2840843942 >> 172.21.15.132:0/2840843942 conn(0x562e67355970 msgr2=0x562e67445660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.350+0000 7f984e936800 1 -- 172.21.15.132:0/2840843942 shutdown_connections 2024-05-08T18:52:31.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.350+0000 7f984e936800 1 -- 172.21.15.132:0/2840843942 wait complete. 2024-05-08T18:52:31.359 INFO:teuthology.orchestra.run.smithi132.stdout:{"id":"bda7b4b2-a5a7-480e-b283-597f208ae0d4","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-05-08T18:52:31.359 DEBUG:tasks.util.rgw: json result: {'id': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-05-08T18:52:31.359 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-05-08T18:52:31.360 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-05-08T18:52:31.360 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-05-08T18:52:31.441 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:31.441 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:31.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.443+0000 7f48a7087800 1 Processor -- start 2024-05-08T18:52:31.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.443+0000 7f48a7087800 1 -- start start 2024-05-08T18:52:31.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.443+0000 7f48a7087800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5580b4cf6d40 0x5580b4cf9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.443+0000 7f48a7087800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5580b4cfd180 con 0x5580b4cf9670 2024-05-08T18:52:31.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.443+0000 7f48a7087800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x5580b4b96e20 con 0x5580b4cf6d40 2024-05-08T18:52:31.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.443+0000 7f48a4b7f640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5580b4cf6d40 0x5580b4cf9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.443+0000 7f48a4b7f640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5580b4cf6d40 0x5580b4cf9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52902/0 (socket says 172.21.15.132:52902) 2024-05-08T18:52:31.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.443+0000 7f489ffff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x5580b4cf9670 0x5580b4cfba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48064/0 (socket says 172.21.15.132:48064) 2024-05-08T18:52:31.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.443+0000 7f48a4b7f640 1 -- 172.21.15.132:0/2785336347 learned_addr learned my addr 172.21.15.132:0/2785336347 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.444+0000 7f48a4b7f640 1 -- 172.21.15.132:0/2785336347 >> v1:172.21.15.42:6789/0 conn(0x5580b4cf9670 legacy=0x5580b4cfba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.444+0000 7f48a4b7f640 1 -- 172.21.15.132:0/2785336347 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580b4cfe360 con 0x5580b4cf6d40 2024-05-08T18:52:31.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.444+0000 7f489f7fe640 1 -- 172.21.15.132:0/2785336347 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2357989942 0 0) 0x5580b4cfd180 con 0x5580b4cf9670 2024-05-08T18:52:31.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.445+0000 7f48a4b7f640 1 --2- 172.21.15.132:0/2785336347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf6d40 0x5580b4cf9130 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f489800a520 tx=0x7f489801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3807b08921902105 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.446+0000 7f489f7fe640 1 -- 172.21.15.132:0/2785336347 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4898057070 con 0x5580b4cf6d40 2024-05-08T18:52:31.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.446+0000 7f489f7fe640 1 -- 172.21.15.132:0/2785336347 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4898052570 con 0x5580b4cf6d40 2024-05-08T18:52:31.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.446+0000 7f489f7fe640 1 -- 172.21.15.132:0/2785336347 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f489804ae60 con 0x5580b4cf6d40 2024-05-08T18:52:31.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.446+0000 7f48a7087800 1 -- 172.21.15.132:0/2785336347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf6d40 msgr2=0x5580b4cf9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.446+0000 7f48a7087800 1 --2- 172.21.15.132:0/2785336347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf6d40 0x5580b4cf9130 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f489800a520 tx=0x7f489801d010 comp rx=0 tx=0).stop 2024-05-08T18:52:31.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.446+0000 7f48a7087800 1 -- 172.21.15.132:0/2785336347 shutdown_connections 2024-05-08T18:52:31.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.446+0000 7f48a7087800 1 --2- 172.21.15.132:0/2785336347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf6d40 0x5580b4cf9130 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.446+0000 7f48a7087800 1 -- 172.21.15.132:0/2785336347 >> 172.21.15.132:0/2785336347 conn(0x5580b4cf0690 msgr2=0x5580b4cf2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.446+0000 7f48a7087800 1 -- 172.21.15.132:0/2785336347 shutdown_connections 2024-05-08T18:52:31.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.446+0000 7f48a7087800 1 -- 172.21.15.132:0/2785336347 wait complete. 2024-05-08T18:52:31.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.460+0000 7f48a7087800 1 Processor -- start 2024-05-08T18:52:31.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.460+0000 7f48a7087800 1 -- start start 2024-05-08T18:52:31.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.460+0000 7f48a7087800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf6d40 0x5580b4de73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.460+0000 7f48a7087800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5580b4c415a0 con 0x5580b4cf6d40 2024-05-08T18:52:31.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.461+0000 7f48a4b7f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf6d40 0x5580b4de73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.461+0000 7f48a4b7f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf6d40 0x5580b4de73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52912/0 (socket says 172.21.15.132:52912) 2024-05-08T18:52:31.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.461+0000 7f48a4b7f640 1 -- 172.21.15.132:0/2698509567 learned_addr learned my addr 172.21.15.132:0/2698509567 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.461+0000 7f48a4b7f640 1 -- 172.21.15.132:0/2698509567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580b4de7970 con 0x5580b4cf6d40 2024-05-08T18:52:31.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.461+0000 7f48a4b7f640 1 --2- 172.21.15.132:0/2698509567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf6d40 0x5580b4de73a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4898055040 tx=0x7f489804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7db8bee5e13f62a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.461+0000 7f4792e05640 1 -- 172.21.15.132:0/2698509567 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4898062070 con 0x5580b4cf6d40 2024-05-08T18:52:31.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.461+0000 7f4792e05640 1 -- 172.21.15.132:0/2698509567 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4898052720 con 0x5580b4cf6d40 2024-05-08T18:52:31.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.461+0000 7f4792e05640 1 -- 172.21.15.132:0/2698509567 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4898057040 con 0x5580b4cf6d40 2024-05-08T18:52:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.462+0000 7f48a7087800 1 -- 172.21.15.132:0/2698509567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf6d40 msgr2=0x5580b4de73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.462+0000 7f48a7087800 1 --2- 172.21.15.132:0/2698509567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf6d40 0x5580b4de73a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4898055040 tx=0x7f489804c000 comp rx=0 tx=0).stop 2024-05-08T18:52:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.462+0000 7f48a7087800 1 -- 172.21.15.132:0/2698509567 shutdown_connections 2024-05-08T18:52:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.462+0000 7f48a7087800 1 --2- 172.21.15.132:0/2698509567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf6d40 0x5580b4de73a0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.462+0000 7f48a7087800 1 -- 172.21.15.132:0/2698509567 >> 172.21.15.132:0/2698509567 conn(0x5580b4cf0690 msgr2=0x5580b4de2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.462+0000 7f48a7087800 1 -- 172.21.15.132:0/2698509567 shutdown_connections 2024-05-08T18:52:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.462+0000 7f48a7087800 1 -- 172.21.15.132:0/2698509567 wait complete. 2024-05-08T18:52:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.462+0000 7f48a7087800 1 Processor -- start 2024-05-08T18:52:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.462+0000 7f48a7087800 1 -- start start 2024-05-08T18:52:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.462+0000 7f48a7087800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf6d40 0x5580b4deee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.462+0000 7f48a7087800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5580b4cfd650 con 0x5580b4cf6d40 2024-05-08T18:52:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.463+0000 7f48a4b7f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf6d40 0x5580b4deee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.463+0000 7f48a4b7f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf6d40 0x5580b4deee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52916/0 (socket says 172.21.15.132:52916) 2024-05-08T18:52:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.463+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 learned_addr learned my addr 172.21.15.132:0/3334180193 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.463+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580b4def360 con 0x5580b4cf6d40 2024-05-08T18:52:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.463+0000 7f48a4b7f640 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf6d40 0x5580b4deee20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f4898005400 tx=0x7f4898002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.463+0000 7f4791602640 1 -- 172.21.15.132:0/3334180193 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4898057050 con 0x5580b4cf6d40 2024-05-08T18:52:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.463+0000 7f4791602640 1 -- 172.21.15.132:0/3334180193 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4898067450 con 0x5580b4cf6d40 2024-05-08T18:52:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.463+0000 7f48a7087800 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580b4def5f0 con 0x5580b4cf6d40 2024-05-08T18:52:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.463+0000 7f4791602640 1 -- 172.21.15.132:0/3334180193 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4898062040 con 0x5580b4cf6d40 2024-05-08T18:52:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.463+0000 7f48a7087800 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580b4df22a0 con 0x5580b4cf6d40 2024-05-08T18:52:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.464+0000 7f48a7087800 1 Processor -- start 2024-05-08T18:52:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.464+0000 7f48a7087800 1 -- start start 2024-05-08T18:52:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.464+0000 7f48a7087800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf67d0 0x5580b4cf4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.464+0000 7f48a7087800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5580b4be7fc0 con 0x5580b4cf67d0 2024-05-08T18:52:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.464+0000 7f4791602640 1 -- 172.21.15.132:0/3334180193 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4898067730 con 0x5580b4cf6d40 2024-05-08T18:52:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.464+0000 7f48a5380640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf67d0 0x5580b4cf4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.464+0000 7f4791602640 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f478c03bb50 0x7f478c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.464+0000 7f48a5380640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf67d0 0x5580b4cf4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52926/0 (socket says 172.21.15.132:52926) 2024-05-08T18:52:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.464+0000 7f48a5380640 1 -- 172.21.15.132:0/927734092 learned_addr learned my addr 172.21.15.132:0/927734092 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.465+0000 7f4791602640 1 -- 172.21.15.132:0/3334180193 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f4898094460 con 0x5580b4cf6d40 2024-05-08T18:52:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.465+0000 7f48a4b7f640 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f478c03bb50 0x7f478c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.465+0000 7f48a5380640 1 -- 172.21.15.132:0/927734092 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580b4cf5260 con 0x5580b4cf67d0 2024-05-08T18:52:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.465+0000 7f48a5380640 1 --2- 172.21.15.132:0/927734092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf67d0 0x5580b4cf4d20 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f48a000a430 tx=0x7f48a000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31bab386ea13356 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.465+0000 7f48a4b7f640 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f478c03bb50 0x7f478c03e010 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f489805cf00 tx=0x7f489805b640 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.465+0000 7f478affd640 1 -- 172.21.15.132:0/927734092 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48a0015070 con 0x5580b4cf67d0 2024-05-08T18:52:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.465+0000 7f478affd640 1 -- 172.21.15.132:0/927734092 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48a0001670 con 0x5580b4cf67d0 2024-05-08T18:52:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.465+0000 7f478affd640 1 -- 172.21.15.132:0/927734092 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48a0001990 con 0x5580b4cf67d0 2024-05-08T18:52:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.465+0000 7f48a7087800 1 -- 172.21.15.132:0/927734092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf67d0 msgr2=0x5580b4cf4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.465+0000 7f48a7087800 1 --2- 172.21.15.132:0/927734092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf67d0 0x5580b4cf4d20 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f48a000a430 tx=0x7f48a000a8f0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.466+0000 7f48a7087800 1 -- 172.21.15.132:0/927734092 shutdown_connections 2024-05-08T18:52:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.466+0000 7f48a7087800 1 --2- 172.21.15.132:0/927734092 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf67d0 0x5580b4cf4d20 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.466+0000 7f48a7087800 1 -- 172.21.15.132:0/927734092 >> 172.21.15.132:0/927734092 conn(0x5580b4cf9670 msgr2=0x5580b4df8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.466+0000 7f48a7087800 1 -- 172.21.15.132:0/927734092 shutdown_connections 2024-05-08T18:52:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.466+0000 7f48a7087800 1 -- 172.21.15.132:0/927734092 wait complete. 2024-05-08T18:52:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.466+0000 7f48a7087800 1 Processor -- start 2024-05-08T18:52:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.466+0000 7f48a7087800 1 -- start start 2024-05-08T18:52:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.466+0000 7f48a7087800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf67d0 0x5580b4e05ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.466+0000 7f48a7087800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5580b4cf54f0 con 0x5580b4cf67d0 2024-05-08T18:52:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.466+0000 7f48a5380640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf67d0 0x5580b4e05ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.466+0000 7f48a5380640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf67d0 0x5580b4e05ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52932/0 (socket says 172.21.15.132:52932) 2024-05-08T18:52:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.466+0000 7f48a5380640 1 -- 172.21.15.132:0/2020617573 learned_addr learned my addr 172.21.15.132:0/2020617573 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.466+0000 7f48a5380640 1 -- 172.21.15.132:0/2020617573 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580b4e06020 con 0x5580b4cf67d0 2024-05-08T18:52:31.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.467+0000 7f48a5380640 1 --2- 172.21.15.132:0/2020617573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf67d0 0x5580b4e05ae0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f48a0013040 tx=0x7f48a0003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.467+0000 7f47897fa640 1 -- 172.21.15.132:0/2020617573 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48a0020020 con 0x5580b4cf67d0 2024-05-08T18:52:31.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.467+0000 7f47897fa640 1 -- 172.21.15.132:0/2020617573 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48a00108e0 con 0x5580b4cf67d0 2024-05-08T18:52:31.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.467+0000 7f47897fa640 1 -- 172.21.15.132:0/2020617573 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48a0015040 con 0x5580b4cf67d0 2024-05-08T18:52:31.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.467+0000 7f48a7087800 1 -- 172.21.15.132:0/2020617573 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580b4e062b0 con 0x5580b4cf67d0 2024-05-08T18:52:31.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.467+0000 7f48a7087800 1 -- 172.21.15.132:0/2020617573 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580b4e08f60 con 0x5580b4cf67d0 2024-05-08T18:52:31.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.468+0000 7f47897fa640 1 -- 172.21.15.132:0/2020617573 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f48a0023020 con 0x5580b4cf67d0 2024-05-08T18:52:31.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.468+0000 7f47897fa640 1 --2- 172.21.15.132:0/2020617573 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f477c03bb50 0x7f477c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.468+0000 7f47897fa640 1 -- 172.21.15.132:0/2020617573 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f48a0052350 con 0x5580b4cf67d0 2024-05-08T18:52:31.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.468+0000 7f48a7087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:31.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.468+0000 7f48a7087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:31.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.468+0000 7f489ffff640 1 --2- 172.21.15.132:0/2020617573 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f477c03bb50 0x7f477c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.469+0000 7f48a7087800 1 Processor -- start 2024-05-08T18:52:31.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.469+0000 7f489ffff640 1 --2- 172.21.15.132:0/2020617573 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f477c03bb50 0x7f477c03e010 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4890000c00 tx=0x7f4890001330 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.469+0000 7f48a7087800 1 -- start start 2024-05-08T18:52:31.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.469+0000 7f48a7087800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4e20190 0x5580b4e205b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.469+0000 7f48a7087800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5580b4de7c30 con 0x5580b4e20190 2024-05-08T18:52:31.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.469+0000 7f48a4b7f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4e20190 0x5580b4e205b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.469+0000 7f48a4b7f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4e20190 0x5580b4e205b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52942/0 (socket says 172.21.15.132:52942) 2024-05-08T18:52:31.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.469+0000 7f48a4b7f640 1 -- 172.21.15.132:0/4093146360 learned_addr learned my addr 172.21.15.132:0/4093146360 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.469+0000 7f48a4b7f640 1 -- 172.21.15.132:0/4093146360 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580b4e20af0 con 0x5580b4e20190 2024-05-08T18:52:31.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.470+0000 7f48a4b7f640 1 --2- 172.21.15.132:0/4093146360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4e20190 0x5580b4e205b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4898078c40 tx=0x7f489805bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.470+0000 7f47697e2640 1 -- 172.21.15.132:0/4093146360 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f489805cb00 con 0x5580b4e20190 2024-05-08T18:52:31.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.470+0000 7f47697e2640 1 -- 172.21.15.132:0/4093146360 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f489805cca0 con 0x5580b4e20190 2024-05-08T18:52:31.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.470+0000 7f48a7087800 1 -- 172.21.15.132:0/4093146360 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580b4e21560 con 0x5580b4e20190 2024-05-08T18:52:31.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.470+0000 7f47697e2640 1 -- 172.21.15.132:0/4093146360 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4898092250 con 0x5580b4e20190 2024-05-08T18:52:31.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.470+0000 7f48a7087800 1 -- 172.21.15.132:0/4093146360 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580b4e21a60 con 0x5580b4e20190 2024-05-08T18:52:31.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.471+0000 7f47697e2640 1 -- 172.21.15.132:0/4093146360 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f4898081070 con 0x5580b4e20190 2024-05-08T18:52:31.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.471+0000 7f47697e2640 1 --2- 172.21.15.132:0/4093146360 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f46dc03bb50 0x7f46dc03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.471+0000 7f47697e2640 1 -- 172.21.15.132:0/4093146360 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f489808c070 con 0x5580b4e20190 2024-05-08T18:52:31.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.471+0000 7f489ffff640 1 --2- 172.21.15.132:0/4093146360 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f46dc03bb50 0x7f46dc03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.471+0000 7f489ffff640 1 --2- 172.21.15.132:0/4093146360 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f46dc03bb50 0x7f46dc03e010 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4890000f60 tx=0x7f4890006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.471+0000 7f46f2ffd640 20 reqs_thread_entry: start 2024-05-08T18:52:31.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.471+0000 7f48a7087800 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5580b4e2db90 0x5580b4e2ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.471+0000 7f48a7087800 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e30610 con 0x5580b4e2db90 2024-05-08T18:52:31.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.471+0000 7f48a5380640 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5580b4e2db90 0x5580b4e2ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.472+0000 7f48a5380640 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5580b4e2db90 0x5580b4e2ff80 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.472+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48a000e070 con 0x5580b4e2db90 2024-05-08T18:52:31.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.472+0000 7f48a7087800 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e30ed0 con 0x5580b4e2db90 2024-05-08T18:52:31.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.472+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f48a000e070 con 0x5580b4e2db90 2024-05-08T18:52:31.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.472+0000 7f48a7087800 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5580b4e327e0 0x5580b4e34c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.472+0000 7f48a7087800 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e353c0 con 0x5580b4e327e0 2024-05-08T18:52:31.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.472+0000 7f48a4b7f640 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5580b4e327e0 0x5580b4e34c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.473+0000 7f48a4b7f640 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5580b4e327e0 0x5580b4e34c30 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.473+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4898080030 con 0x5580b4e327e0 2024-05-08T18:52:31.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.473+0000 7f48a7087800 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e42500 con 0x5580b4e2db90 2024-05-08T18:52:31.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.473+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48a000e070 con 0x5580b4e2db90 2024-05-08T18:52:31.486 INFO:teuthology.orchestra.run.smithi132.stderr:NOTICE: set zone's realm_id= 2024-05-08T18:52:31.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.473+0000 7f48a7087800 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x5580b4e327e0 2024-05-08T18:52:31.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.474+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(5 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4898080030 con 0x5580b4e327e0 2024-05-08T18:52:31.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.474+0000 7f48a4b7f640 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4898084040 0x7f489808f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.474+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x7f4898084040 2024-05-08T18:52:31.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.474+0000 7f489ffff640 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4898084040 0x7f489808f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.474+0000 7f489ffff640 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4898084040 0x7f489808f410 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.474+0000 7f489ffff640 1 -- 172.21.15.132:0/3334180193 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489001e040 con 0x7f4898084040 2024-05-08T18:52:31.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.475+0000 7f489ffff640 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f489001ec10 0x7f489001c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.475+0000 7f489ffff640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x7f489001ec10 2024-05-08T18:52:31.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.475+0000 7f48a5380640 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f489001ec10 0x7f489001c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.475+0000 7f48a5380640 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f489001ec10 0x7f489001c970 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.475+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a000e070 con 0x7f489001ec10 2024-05-08T18:52:31.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.475+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x5580b4e2db90 2024-05-08T18:52:31.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.476+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a000e070 con 0x5580b4e2db90 2024-05-08T18:52:31.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.476+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x5580b4e2db90 2024-05-08T18:52:31.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.476+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a000e070 con 0x5580b4e2db90 2024-05-08T18:52:31.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.476+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x7f489001ec10 2024-05-08T18:52:31.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.476+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a000e070 con 0x7f489001ec10 2024-05-08T18:52:31.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.476+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x7f489001ec10 2024-05-08T18:52:31.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.476+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a000e070 con 0x7f489001ec10 2024-05-08T18:52:31.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.476+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x7f4898084040 2024-05-08T18:52:31.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.477+0000 7f489ffff640 1 -- 172.21.15.132:0/3334180193 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489001e040 con 0x7f4898084040 2024-05-08T18:52:31.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.477+0000 7f489ffff640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x5580b4e327e0 2024-05-08T18:52:31.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.477+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4898080030 con 0x5580b4e327e0 2024-05-08T18:52:31.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.477+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x5580b4e2db90 2024-05-08T18:52:31.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.477+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a000e070 con 0x5580b4e2db90 2024-05-08T18:52:31.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.477+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x7f489001ec10 2024-05-08T18:52:31.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.477+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a000e070 con 0x7f489001ec10 2024-05-08T18:52:31.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.477+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x5580b4e2db90 2024-05-08T18:52:31.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.477+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(16 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f48a000e070 con 0x5580b4e2db90 2024-05-08T18:52:31.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.477+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x7f4898084040 2024-05-08T18:52:31.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.478+0000 7f489ffff640 1 -- 172.21.15.132:0/3334180193 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(17 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f489002b040 con 0x7f4898084040 2024-05-08T18:52:31.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.478+0000 7f489ffff640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x5580b4e327e0 2024-05-08T18:52:31.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.478+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(18 [pgnls start_epoch 27 out=107b] v25'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4898080030 con 0x5580b4e327e0 2024-05-08T18:52:31.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.478+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x5580b4e327e0 2024-05-08T18:52:31.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.478+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4898080030 con 0x5580b4e327e0 2024-05-08T18:52:31.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.478+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x7f489001ec10 2024-05-08T18:52:31.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.478+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a000e070 con 0x7f489001ec10 2024-05-08T18:52:31.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.478+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x5580b4e327e0 2024-05-08T18:52:31.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.479+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4898080030 con 0x5580b4e327e0 2024-05-08T18:52:31.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.479+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x5580b4e327e0 2024-05-08T18:52:31.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.479+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4898080030 con 0x5580b4e327e0 2024-05-08T18:52:31.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.479+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x5580b4e2db90 2024-05-08T18:52:31.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.479+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a000e070 con 0x5580b4e2db90 2024-05-08T18:52:31.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.479+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x5580b4e2db90 2024-05-08T18:52:31.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.479+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=74b] v18'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f48a000e070 con 0x5580b4e2db90 2024-05-08T18:52:31.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.479+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x7f489001ec10 2024-05-08T18:52:31.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.480+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(25 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a000e070 con 0x7f489001ec10 2024-05-08T18:52:31.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.480+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x5580b4e327e0 2024-05-08T18:52:31.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.480+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4898080030 con 0x5580b4e327e0 2024-05-08T18:52:31.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.480+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x7f4898084040 2024-05-08T18:52:31.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.480+0000 7f489ffff640 1 -- 172.21.15.132:0/3334180193 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489002b040 con 0x7f4898084040 2024-05-08T18:52:31.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.480+0000 7f489ffff640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x5580b4e2db90 2024-05-08T18:52:31.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.480+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a000e070 con 0x5580b4e2db90 2024-05-08T18:52:31.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.480+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x7f4898084040 2024-05-08T18:52:31.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.481+0000 7f489ffff640 1 -- 172.21.15.132:0/3334180193 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489002b040 con 0x7f4898084040 2024-05-08T18:52:31.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.481+0000 7f489ffff640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x5580b4e327e0 2024-05-08T18:52:31.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.481+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4898080030 con 0x5580b4e327e0 2024-05-08T18:52:31.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.481+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x7f489001ec10 2024-05-08T18:52:31.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.481+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a000e070 con 0x7f489001ec10 2024-05-08T18:52:31.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.481+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x7f4898084040 2024-05-08T18:52:31.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.481+0000 7f489ffff640 1 -- 172.21.15.132:0/3334180193 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489002b040 con 0x7f4898084040 2024-05-08T18:52:31.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.481+0000 7f489ffff640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x5580b4e327e0 2024-05-08T18:52:31.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.482+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4898080030 con 0x5580b4e327e0 2024-05-08T18:52:31.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.482+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x7f489001ec10 2024-05-08T18:52:31.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.482+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48a000e070 con 0x7f489001ec10 2024-05-08T18:52:31.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.482+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x5580b4e2db90 2024-05-08T18:52:31.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.482+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(35 [pgnls start_epoch 27 out=115b] v18'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f48a000e070 con 0x5580b4e2db90 2024-05-08T18:52:31.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.482+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e398c0 con 0x7f4898084040 2024-05-08T18:52:31.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.482+0000 7f489ffff640 1 -- 172.21.15.132:0/3334180193 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(36 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f489002b040 con 0x7f4898084040 2024-05-08T18:52:31.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.482+0000 7f48a7087800 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e3c370 con 0x5580b4e2db90 2024-05-08T18:52:31.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.483+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f48a000e070 con 0x5580b4e2db90 2024-05-08T18:52:31.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.483+0000 7f48a7087800 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:38 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e403d0 con 0x5580b4e327e0 2024-05-08T18:52:31.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.483+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(38 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4898080030 con 0x5580b4e327e0 2024-05-08T18:52:31.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.483+0000 7f48a7087800 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:39 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e31af0 con 0x5580b4e327e0 2024-05-08T18:52:31.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.485+0000 7f48a4b7f640 1 -- 172.21.15.132:0/3334180193 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(39 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [create,call,writefull 0~1155] v27'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f4898080030 con 0x5580b4e327e0 2024-05-08T18:52:31.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.485+0000 7f48a7087800 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e3ed50 con 0x5580b4e2db90 2024-05-08T18:52:31.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.486+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v27'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f48a000e070 con 0x5580b4e2db90 2024-05-08T18:52:31.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.486+0000 7f48a7087800 1 -- 172.21.15.132:0/3334180193 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5580b4e3c7f0 con 0x5580b4e2db90 2024-05-08T18:52:31.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.487+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v27'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f48a000e070 con 0x5580b4e2db90 2024-05-08T18:52:31.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.487+0000 7f48a7087800 1 -- 172.21.15.132:0/2020617573 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f477c03bb50 msgr2=0x7f477c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.487+0000 7f48a7087800 1 --2- 172.21.15.132:0/2020617573 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f477c03bb50 0x7f477c03e010 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4890000c00 tx=0x7f4890001330 comp rx=0 tx=0).stop 2024-05-08T18:52:31.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.487+0000 7f48a7087800 1 -- 172.21.15.132:0/2020617573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf67d0 msgr2=0x5580b4e05ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.487+0000 7f48a7087800 1 --2- 172.21.15.132:0/2020617573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf67d0 0x5580b4e05ae0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f48a0013040 tx=0x7f48a0003370 comp rx=0 tx=0).stop 2024-05-08T18:52:31.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.487+0000 7f48a7087800 1 -- 172.21.15.132:0/2020617573 shutdown_connections 2024-05-08T18:52:31.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.487+0000 7f48a7087800 1 --2- 172.21.15.132:0/2020617573 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f477c03bb50 0x7f477c03e010 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.487+0000 7f48a7087800 1 --2- 172.21.15.132:0/2020617573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf67d0 0x5580b4e05ae0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.487+0000 7f48a7087800 1 -- 172.21.15.132:0/2020617573 >> 172.21.15.132:0/2020617573 conn(0x5580b4cf9670 msgr2=0x5580b4df65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.487+0000 7f48a7087800 1 -- 172.21.15.132:0/2020617573 shutdown_connections 2024-05-08T18:52:31.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 -- 172.21.15.132:0/2020617573 wait complete. 2024-05-08T18:52:31.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 -- 172.21.15.132:0/4093146360 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f46dc03bb50 msgr2=0x7f46dc03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 --2- 172.21.15.132:0/4093146360 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f46dc03bb50 0x7f46dc03e010 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4890000f60 tx=0x7f4890006000 comp rx=0 tx=0).stop 2024-05-08T18:52:31.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 -- 172.21.15.132:0/4093146360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4e20190 msgr2=0x5580b4e205b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 --2- 172.21.15.132:0/4093146360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4e20190 0x5580b4e205b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4898078c40 tx=0x7f489805bb40 comp rx=0 tx=0).stop 2024-05-08T18:52:31.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 -- 172.21.15.132:0/4093146360 shutdown_connections 2024-05-08T18:52:31.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 --2- 172.21.15.132:0/4093146360 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f46dc03bb50 0x7f46dc03e010 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 --2- 172.21.15.132:0/4093146360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4e20190 0x5580b4e205b0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 -- 172.21.15.132:0/4093146360 >> 172.21.15.132:0/4093146360 conn(0x5580b4e14c60 msgr2=0x5580b4e15680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 -- 172.21.15.132:0/4093146360 shutdown_connections 2024-05-08T18:52:31.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 -- 172.21.15.132:0/4093146360 wait complete. 2024-05-08T18:52:31.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 -- 172.21.15.132:0/3334180193 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f489001ec10 msgr2=0x7f489001c970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f489001ec10 0x7f489001c970 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 -- 172.21.15.132:0/3334180193 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5580b4e2db90 msgr2=0x5580b4e2ff80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5580b4e2db90 0x5580b4e2ff80 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 -- 172.21.15.132:0/3334180193 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4898084040 msgr2=0x7f489808f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f4898084040 0x7f489808f410 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 -- 172.21.15.132:0/3334180193 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5580b4e327e0 msgr2=0x5580b4e34c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5580b4e327e0 0x5580b4e34c30 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 -- 172.21.15.132:0/3334180193 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f478c03bb50 msgr2=0x7f478c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f478c03bb50 0x7f478c03e010 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f489805cf00 tx=0x7f489805b640 comp rx=0 tx=0).stop 2024-05-08T18:52:31.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 -- 172.21.15.132:0/3334180193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf6d40 msgr2=0x5580b4deee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a5380640 1 -- 172.21.15.132:0/3334180193 reap_dead start 2024-05-08T18:52:31.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf6d40 0x5580b4deee20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f4898005400 tx=0x7f4898002fb0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 -- 172.21.15.132:0/3334180193 shutdown_connections 2024-05-08T18:52:31.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 --2- 172.21.15.132:0/3334180193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5580b4cf6d40 0x5580b4deee20 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.488+0000 7f48a7087800 1 -- 172.21.15.132:0/3334180193 >> 172.21.15.132:0/3334180193 conn(0x5580b4cf0690 msgr2=0x5580b4de14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.489+0000 7f48a7087800 1 -- 172.21.15.132:0/3334180193 shutdown_connections 2024-05-08T18:52:31.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.489+0000 7f48a7087800 1 -- 172.21.15.132:0/3334180193 wait complete. 2024-05-08T18:52:31.498 INFO:teuthology.orchestra.run.smithi132.stdout:{"id":"bda7b4b2-a5a7-480e-b283-597f208ae0d4","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-05-08T18:52:31.499 DEBUG:tasks.util.rgw: json result: {'id': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-05-08T18:52:31.499 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-05-08T18:52:31.499 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-05-08T18:52:31.499 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-05-08T18:52:31.581 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:31.581 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:31.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.582+0000 7f5c06b33800 1 Processor -- start 2024-05-08T18:52:31.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.582+0000 7f5c06b33800 1 -- start start 2024-05-08T18:52:31.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.582+0000 7f5c06b33800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x556db7c2c850 0x556db7c2ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.583+0000 7f5c06b33800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556db7c2f180 con 0x556db7c28d40 2024-05-08T18:52:31.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.583+0000 7f5c06b33800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x556db7ac8e20 con 0x556db7c2c850 2024-05-08T18:52:31.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.583+0000 7f5bf9fc9640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x556db7c2c850 0x556db7c2ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.583+0000 7f5bf9fc9640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x556db7c2c850 0x556db7c2ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52958/0 (socket says 172.21.15.132:52958) 2024-05-08T18:52:31.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.583+0000 7f5c027ca640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x556db7c28d40 0x556db7c2b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48072/0 (socket says 172.21.15.132:48072) 2024-05-08T18:52:31.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.583+0000 7f5bf9fc9640 1 -- 172.21.15.132:0/197762573 learned_addr learned my addr 172.21.15.132:0/197762573 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.583+0000 7f5bf9fc9640 1 -- 172.21.15.132:0/197762573 >> v1:172.21.15.42:6789/0 conn(0x556db7c28d40 legacy=0x556db7c2b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.583+0000 7f5bf9fc9640 1 -- 172.21.15.132:0/197762573 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556db7c30360 con 0x556db7c2c850 2024-05-08T18:52:31.584 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.585+0000 7f5bf9fc9640 1 --2- 172.21.15.132:0/197762573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7c2c850 0x556db7c2ec40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5bec00a520 tx=0x7f5bec01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb96b6b4d94232 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.585+0000 7f5c01fc9640 1 -- 172.21.15.132:0/197762573 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bec057070 con 0x556db7c2c850 2024-05-08T18:52:31.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.585+0000 7f5c01fc9640 1 -- 172.21.15.132:0/197762573 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bec052570 con 0x556db7c2c850 2024-05-08T18:52:31.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.585+0000 7f5c01fc9640 1 -- 172.21.15.132:0/197762573 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bec04ae60 con 0x556db7c2c850 2024-05-08T18:52:31.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.586+0000 7f5c06b33800 1 -- 172.21.15.132:0/197762573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7c2c850 msgr2=0x556db7c2ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.586+0000 7f5c06b33800 1 --2- 172.21.15.132:0/197762573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7c2c850 0x556db7c2ec40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5bec00a520 tx=0x7f5bec01d010 comp rx=0 tx=0).stop 2024-05-08T18:52:31.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.586+0000 7f5c06b33800 1 -- 172.21.15.132:0/197762573 shutdown_connections 2024-05-08T18:52:31.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.586+0000 7f5c06b33800 1 --2- 172.21.15.132:0/197762573 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7c2c850 0x556db7c2ec40 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.586+0000 7f5c06b33800 1 -- 172.21.15.132:0/197762573 >> 172.21.15.132:0/197762573 conn(0x556db7c22690 msgr2=0x556db7c24af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.586+0000 7f5c06b33800 1 -- 172.21.15.132:0/197762573 shutdown_connections 2024-05-08T18:52:31.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.586+0000 7f5c06b33800 1 -- 172.21.15.132:0/197762573 wait complete. 2024-05-08T18:52:31.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.599+0000 7f5c06b33800 1 Processor -- start 2024-05-08T18:52:31.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.599+0000 7f5c06b33800 1 -- start start 2024-05-08T18:52:31.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.599+0000 7f5c06b33800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7c28d40 0x556db7d19660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.599+0000 7f5c06b33800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556db7b735a0 con 0x556db7c28d40 2024-05-08T18:52:31.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.600+0000 7f5c027ca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7c28d40 0x556db7d19660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.600+0000 7f5c027ca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7c28d40 0x556db7d19660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52960/0 (socket says 172.21.15.132:52960) 2024-05-08T18:52:31.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.600+0000 7f5c027ca640 1 -- 172.21.15.132:0/383482895 learned_addr learned my addr 172.21.15.132:0/383482895 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.600+0000 7f5c027ca640 1 -- 172.21.15.132:0/383482895 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556db7d19c30 con 0x556db7c28d40 2024-05-08T18:52:31.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.600+0000 7f5c027ca640 1 --2- 172.21.15.132:0/383482895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7c28d40 0x556db7d19660 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4001e90 tx=0x7f5bf400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f4d7ad51258ab4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.600+0000 7f5af0608640 1 -- 172.21.15.132:0/383482895 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf400e5c0 con 0x556db7c28d40 2024-05-08T18:52:31.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.600+0000 7f5af0608640 1 -- 172.21.15.132:0/383482895 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf4006070 con 0x556db7c28d40 2024-05-08T18:52:31.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.600+0000 7f5af0608640 1 -- 172.21.15.132:0/383482895 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf400e890 con 0x556db7c28d40 2024-05-08T18:52:31.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.601+0000 7f5c06b33800 1 -- 172.21.15.132:0/383482895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7c28d40 msgr2=0x556db7d19660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.601+0000 7f5c06b33800 1 --2- 172.21.15.132:0/383482895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7c28d40 0x556db7d19660 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4001e90 tx=0x7f5bf400b6c0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.601+0000 7f5c06b33800 1 -- 172.21.15.132:0/383482895 shutdown_connections 2024-05-08T18:52:31.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.601+0000 7f5c06b33800 1 --2- 172.21.15.132:0/383482895 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7c28d40 0x556db7d19660 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.601+0000 7f5c06b33800 1 -- 172.21.15.132:0/383482895 >> 172.21.15.132:0/383482895 conn(0x556db7c22690 msgr2=0x556db7d14f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.601+0000 7f5c06b33800 1 -- 172.21.15.132:0/383482895 shutdown_connections 2024-05-08T18:52:31.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.601+0000 7f5c06b33800 1 -- 172.21.15.132:0/383482895 wait complete. 2024-05-08T18:52:31.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.601+0000 7f5c06b33800 1 Processor -- start 2024-05-08T18:52:31.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.601+0000 7f5c06b33800 1 -- start start 2024-05-08T18:52:31.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.602+0000 7f5c06b33800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7c28d40 0x556db7c28680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.602+0000 7f5c06b33800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556db7c2f650 con 0x556db7c28d40 2024-05-08T18:52:31.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.602+0000 7f5c027ca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7c28d40 0x556db7c28680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.602+0000 7f5c027ca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7c28d40 0x556db7c28680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52964/0 (socket says 172.21.15.132:52964) 2024-05-08T18:52:31.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.602+0000 7f5c027ca640 1 -- 172.21.15.132:0/3505361613 learned_addr learned my addr 172.21.15.132:0/3505361613 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.602+0000 7f5c027ca640 1 -- 172.21.15.132:0/3505361613 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556db7c26d70 con 0x556db7c28d40 2024-05-08T18:52:31.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.602+0000 7f5c027ca640 1 --2- 172.21.15.132:0/3505361613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7c28d40 0x556db7c28680 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4001ed0 tx=0x7f5bf4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.602+0000 7f5aeee05640 1 -- 172.21.15.132:0/3505361613 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf401a880 con 0x556db7c28d40 2024-05-08T18:52:31.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.602+0000 7f5aeee05640 1 -- 172.21.15.132:0/3505361613 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf401aa20 con 0x556db7c28d40 2024-05-08T18:52:31.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.602+0000 7f5aeee05640 1 -- 172.21.15.132:0/3505361613 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf401ad40 con 0x556db7c28d40 2024-05-08T18:52:31.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.602+0000 7f5c06b33800 1 -- 172.21.15.132:0/3505361613 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556db7c27000 con 0x556db7c28d40 2024-05-08T18:52:31.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.603+0000 7f5c06b33800 1 -- 172.21.15.132:0/3505361613 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556db7c27520 con 0x556db7c28d40 2024-05-08T18:52:31.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.603+0000 7f5c06b33800 1 Processor -- start 2024-05-08T18:52:31.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.603+0000 7f5c06b33800 1 -- start start 2024-05-08T18:52:31.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.603+0000 7f5c06b33800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7d30a90 0x556db7d30eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.603+0000 7f5c06b33800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556db7b19fc0 con 0x556db7d30a90 2024-05-08T18:52:31.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.603+0000 7f5aeee05640 1 -- 172.21.15.132:0/3505361613 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5bf4017070 con 0x556db7c28d40 2024-05-08T18:52:31.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.603+0000 7f5c02fcb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7d30a90 0x556db7d30eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.603+0000 7f5c02fcb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7d30a90 0x556db7d30eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52978/0 (socket says 172.21.15.132:52978) 2024-05-08T18:52:31.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.603+0000 7f5c02fcb640 1 -- 172.21.15.132:0/1480277305 learned_addr learned my addr 172.21.15.132:0/1480277305 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.604+0000 7f5aeee05640 1 --2- 172.21.15.132:0/3505361613 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ae803bb50 0x7f5ae803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.604+0000 7f5aeee05640 1 -- 172.21.15.132:0/3505361613 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f5bf4015020 con 0x556db7c28d40 2024-05-08T18:52:31.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.604+0000 7f5c02fcb640 1 -- 172.21.15.132:0/1480277305 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556db7d313f0 con 0x556db7d30a90 2024-05-08T18:52:31.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.604+0000 7f5c027ca640 1 --2- 172.21.15.132:0/3505361613 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ae803bb50 0x7f5ae803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.604+0000 7f5c02fcb640 1 --2- 172.21.15.132:0/1480277305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7d30a90 0x556db7d30eb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc00a430 tx=0x7f5bfc00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718d3c2a189e9edc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.604+0000 7f5c027ca640 1 --2- 172.21.15.132:0/3505361613 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ae803bb50 0x7f5ae803e010 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4001520 tx=0x7f5bf4035040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.604+0000 7f5aece01640 1 -- 172.21.15.132:0/1480277305 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bfc015070 con 0x556db7d30a90 2024-05-08T18:52:31.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.604+0000 7f5aece01640 1 -- 172.21.15.132:0/1480277305 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bfc001670 con 0x556db7d30a90 2024-05-08T18:52:31.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.604+0000 7f5aece01640 1 -- 172.21.15.132:0/1480277305 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bfc001990 con 0x556db7d30a90 2024-05-08T18:52:31.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.605+0000 7f5c06b33800 1 -- 172.21.15.132:0/1480277305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7d30a90 msgr2=0x556db7d30eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.605+0000 7f5c06b33800 1 --2- 172.21.15.132:0/1480277305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7d30a90 0x556db7d30eb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc00a430 tx=0x7f5bfc00a8f0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.605+0000 7f5c06b33800 1 -- 172.21.15.132:0/1480277305 shutdown_connections 2024-05-08T18:52:31.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.605+0000 7f5c06b33800 1 --2- 172.21.15.132:0/1480277305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7d30a90 0x556db7d30eb0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.605+0000 7f5c06b33800 1 -- 172.21.15.132:0/1480277305 >> 172.21.15.132:0/1480277305 conn(0x556db7c2c850 msgr2=0x556db7d2d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.605+0000 7f5c06b33800 1 -- 172.21.15.132:0/1480277305 shutdown_connections 2024-05-08T18:52:31.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.605+0000 7f5c06b33800 1 -- 172.21.15.132:0/1480277305 wait complete. 2024-05-08T18:52:31.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.605+0000 7f5c06b33800 1 Processor -- start 2024-05-08T18:52:31.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.605+0000 7f5c06b33800 1 -- start start 2024-05-08T18:52:31.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.605+0000 7f5c06b33800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7d30a90 0x556db7d38020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.605+0000 7f5c06b33800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556db7d31d80 con 0x556db7d30a90 2024-05-08T18:52:31.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.605+0000 7f5c02fcb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7d30a90 0x556db7d38020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.605+0000 7f5c02fcb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7d30a90 0x556db7d38020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:52990/0 (socket says 172.21.15.132:52990) 2024-05-08T18:52:31.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.605+0000 7f5c02fcb640 1 -- 172.21.15.132:0/3141353993 learned_addr learned my addr 172.21.15.132:0/3141353993 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.606+0000 7f5c02fcb640 1 -- 172.21.15.132:0/3141353993 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556db7d38560 con 0x556db7d30a90 2024-05-08T18:52:31.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.606+0000 7f5c02fcb640 1 --2- 172.21.15.132:0/3141353993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7d30a90 0x556db7d38020 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc00a930 tx=0x7f5bfc003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.606+0000 7f5ae6ffd640 1 -- 172.21.15.132:0/3141353993 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bfc020020 con 0x556db7d30a90 2024-05-08T18:52:31.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.606+0000 7f5ae6ffd640 1 -- 172.21.15.132:0/3141353993 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bfc0108b0 con 0x556db7d30a90 2024-05-08T18:52:31.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.606+0000 7f5c06b33800 1 -- 172.21.15.132:0/3141353993 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556db7d387f0 con 0x556db7d30a90 2024-05-08T18:52:31.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.606+0000 7f5ae6ffd640 1 -- 172.21.15.132:0/3141353993 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bfc015040 con 0x556db7d30a90 2024-05-08T18:52:31.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.606+0000 7f5c06b33800 1 -- 172.21.15.132:0/3141353993 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556db7d3b4a0 con 0x556db7d30a90 2024-05-08T18:52:31.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.607+0000 7f5ae6ffd640 1 -- 172.21.15.132:0/3141353993 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5bfc023020 con 0x556db7d30a90 2024-05-08T18:52:31.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.607+0000 7f5ae6ffd640 1 --2- 172.21.15.132:0/3141353993 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5adc03bba0 0x7f5adc03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.607+0000 7f5ae6ffd640 1 -- 172.21.15.132:0/3141353993 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f5bfc052240 con 0x556db7d30a90 2024-05-08T18:52:31.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.607+0000 7f5bf9fc9640 1 --2- 172.21.15.132:0/3141353993 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5adc03bba0 0x7f5adc03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.608+0000 7f5c06b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:31.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.608+0000 7f5c06b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:31.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.608+0000 7f5bf9fc9640 1 --2- 172.21.15.132:0/3141353993 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5adc03bba0 0x7f5adc03e060 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5bec054000 tx=0x7f5bec04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.608+0000 7f5c06b33800 1 Processor -- start 2024-05-08T18:52:31.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.608+0000 7f5c06b33800 1 -- start start 2024-05-08T18:52:31.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.608+0000 7f5c06b33800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7d526a0 0x556db7d52ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.608+0000 7f5c06b33800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556db7d19fb0 con 0x556db7d526a0 2024-05-08T18:52:31.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.609+0000 7f5c027ca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7d526a0 0x556db7d52ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.609+0000 7f5c027ca640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7d526a0 0x556db7d52ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53006/0 (socket says 172.21.15.132:53006) 2024-05-08T18:52:31.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.609+0000 7f5c027ca640 1 -- 172.21.15.132:0/3576024614 learned_addr learned my addr 172.21.15.132:0/3576024614 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.609+0000 7f5c027ca640 1 -- 172.21.15.132:0/3576024614 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556db7d53000 con 0x556db7d526a0 2024-05-08T18:52:31.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.609+0000 7f5c027ca640 1 --2- 172.21.15.132:0/3576024614 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7d526a0 0x556db7d52ac0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4017cc0 tx=0x7f5bf4052d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.609+0000 7f5ac77e6640 1 -- 172.21.15.132:0/3576024614 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf4017e00 con 0x556db7d526a0 2024-05-08T18:52:31.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.609+0000 7f5ac77e6640 1 -- 172.21.15.132:0/3576024614 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf4017360 con 0x556db7d526a0 2024-05-08T18:52:31.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.609+0000 7f5ac77e6640 1 -- 172.21.15.132:0/3576024614 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf400f810 con 0x556db7d526a0 2024-05-08T18:52:31.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.609+0000 7f5c06b33800 1 -- 172.21.15.132:0/3576024614 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556db7d53a70 con 0x556db7d526a0 2024-05-08T18:52:31.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.609+0000 7f5c06b33800 1 -- 172.21.15.132:0/3576024614 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556db7d53f70 con 0x556db7d526a0 2024-05-08T18:52:31.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.610+0000 7f5ac77e6640 1 -- 172.21.15.132:0/3576024614 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f5bf4024d10 con 0x556db7d526a0 2024-05-08T18:52:31.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.610+0000 7f5ac77e6640 1 --2- 172.21.15.132:0/3576024614 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5a4003bba0 0x7f5a4003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.610+0000 7f5ac77e6640 1 -- 172.21.15.132:0/3576024614 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f5bf404abe0 con 0x556db7d526a0 2024-05-08T18:52:31.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.610+0000 7f5bf9fc9640 1 --2- 172.21.15.132:0/3576024614 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5a4003bba0 0x7f5a4003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.611+0000 7f5ac57e2640 20 reqs_thread_entry: start 2024-05-08T18:52:31.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.611+0000 7f5c06b33800 1 --2- 172.21.15.132:0/3505361613 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x556db7d600a0 0x556db7d624b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.611+0000 7f5c06b33800 1 -- 172.21.15.132:0/3505361613 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556db7d62b30 con 0x556db7d600a0 2024-05-08T18:52:31.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.611+0000 7f5bf9fc9640 1 --2- 172.21.15.132:0/3576024614 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5a4003bba0 0x7f5a4003e060 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5bec000c00 tx=0x7f5bec005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.611+0000 7f5c02fcb640 1 --2- 172.21.15.132:0/3505361613 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x556db7d600a0 0x556db7d624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.611+0000 7f5c02fcb640 1 --2- 172.21.15.132:0/3505361613 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x556db7d600a0 0x556db7d624b0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.611+0000 7f5c02fcb640 1 -- 172.21.15.132:0/3505361613 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bfc010d70 con 0x556db7d600a0 2024-05-08T18:52:31.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.611+0000 7f5c06b33800 1 -- 172.21.15.132:0/3505361613 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556db7d63410 con 0x556db7d600a0 2024-05-08T18:52:31.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.612+0000 7f5c02fcb640 1 -- 172.21.15.132:0/3505361613 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5bfc010d70 con 0x556db7d600a0 2024-05-08T18:52:31.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.612+0000 7f5c06b33800 1 --2- 172.21.15.132:0/3505361613 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556db7d64d20 0x556db7d671b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.612+0000 7f5c06b33800 1 -- 172.21.15.132:0/3505361613 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556db7d67940 con 0x556db7d64d20 2024-05-08T18:52:31.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.612+0000 7f5c027ca640 1 --2- 172.21.15.132:0/3505361613 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556db7d64d20 0x556db7d671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.612+0000 7f5c027ca640 1 --2- 172.21.15.132:0/3505361613 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556db7d64d20 0x556db7d671b0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.612+0000 7f5c027ca640 1 -- 172.21.15.132:0/3505361613 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f5bf4050070 con 0x556db7d64d20 2024-05-08T18:52:31.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.613+0000 7f5c06b33800 1 -- 172.21.15.132:0/3141353993 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5adc03bba0 msgr2=0x7f5adc03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.613+0000 7f5c06b33800 1 --2- 172.21.15.132:0/3141353993 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5adc03bba0 0x7f5adc03e060 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5bec054000 tx=0x7f5bec04e000 comp rx=0 tx=0).stop 2024-05-08T18:52:31.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.613+0000 7f5c06b33800 1 -- 172.21.15.132:0/3141353993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7d30a90 msgr2=0x556db7d38020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.613+0000 7f5c06b33800 1 --2- 172.21.15.132:0/3141353993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7d30a90 0x556db7d38020 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc00a930 tx=0x7f5bfc003370 comp rx=0 tx=0).stop 2024-05-08T18:52:31.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.613+0000 7f5c06b33800 1 -- 172.21.15.132:0/3141353993 shutdown_connections 2024-05-08T18:52:31.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.613+0000 7f5c06b33800 1 --2- 172.21.15.132:0/3141353993 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5adc03bba0 0x7f5adc03e060 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.613+0000 7f5c06b33800 1 --2- 172.21.15.132:0/3141353993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7d30a90 0x556db7d38020 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.613+0000 7f5c06b33800 1 -- 172.21.15.132:0/3141353993 >> 172.21.15.132:0/3141353993 conn(0x556db7c2c850 msgr2=0x556db7d2ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.613+0000 7f5c06b33800 1 -- 172.21.15.132:0/3141353993 shutdown_connections 2024-05-08T18:52:31.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.613+0000 7f5c06b33800 1 -- 172.21.15.132:0/3141353993 wait complete. 2024-05-08T18:52:31.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 -- 172.21.15.132:0/3576024614 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5a4003bba0 msgr2=0x7f5a4003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 --2- 172.21.15.132:0/3576024614 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5a4003bba0 0x7f5a4003e060 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5bec000c00 tx=0x7f5bec005ac0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 -- 172.21.15.132:0/3576024614 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7d526a0 msgr2=0x556db7d52ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 --2- 172.21.15.132:0/3576024614 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7d526a0 0x556db7d52ac0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4017cc0 tx=0x7f5bf4052d10 comp rx=0 tx=0).stop 2024-05-08T18:52:31.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 -- 172.21.15.132:0/3576024614 shutdown_connections 2024-05-08T18:52:31.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 --2- 172.21.15.132:0/3576024614 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5a4003bba0 0x7f5a4003e060 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 --2- 172.21.15.132:0/3576024614 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7d526a0 0x556db7d52ac0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 -- 172.21.15.132:0/3576024614 >> 172.21.15.132:0/3576024614 conn(0x556db7d47130 msgr2=0x556db7d47b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 -- 172.21.15.132:0/3576024614 shutdown_connections 2024-05-08T18:52:31.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 -- 172.21.15.132:0/3576024614 wait complete. 2024-05-08T18:52:31.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 -- 172.21.15.132:0/3505361613 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x556db7d600a0 msgr2=0x556db7d624b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 --2- 172.21.15.132:0/3505361613 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x556db7d600a0 0x556db7d624b0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 -- 172.21.15.132:0/3505361613 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556db7d64d20 msgr2=0x556db7d671b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 --2- 172.21.15.132:0/3505361613 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556db7d64d20 0x556db7d671b0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 -- 172.21.15.132:0/3505361613 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ae803bb50 msgr2=0x7f5ae803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 --2- 172.21.15.132:0/3505361613 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ae803bb50 0x7f5ae803e010 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4001520 tx=0x7f5bf4035040 comp rx=0 tx=0).stop 2024-05-08T18:52:31.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 -- 172.21.15.132:0/3505361613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7c28d40 msgr2=0x556db7c28680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 --2- 172.21.15.132:0/3505361613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7c28d40 0x556db7c28680 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4001ed0 tx=0x7f5bf4000ed0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 -- 172.21.15.132:0/3505361613 shutdown_connections 2024-05-08T18:52:31.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 --2- 172.21.15.132:0/3505361613 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556db7d64d20 0x556db7d671b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 --2- 172.21.15.132:0/3505361613 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x556db7d600a0 0x556db7d624b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 --2- 172.21.15.132:0/3505361613 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5ae803bb50 0x7f5ae803e010 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 --2- 172.21.15.132:0/3505361613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556db7c28d40 0x556db7c28680 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 -- 172.21.15.132:0/3505361613 >> 172.21.15.132:0/3505361613 conn(0x556db7c22690 msgr2=0x556db7d13780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 -- 172.21.15.132:0/3505361613 shutdown_connections 2024-05-08T18:52:31.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.614+0000 7f5c06b33800 1 -- 172.21.15.132:0/3505361613 wait complete. 2024-05-08T18:52:31.623 INFO:teuthology.orchestra.run.smithi132.stdout:{"id":"bda7b4b2-a5a7-480e-b283-597f208ae0d4","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-05-08T18:52:31.623 DEBUG:tasks.util.rgw: json result: {'id': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-05-08T18:52:31.623 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-08T18:52:31.624 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-08T18:52:31.624 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-05-08T18:52:31.709 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:31.709 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:31.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.710+0000 7f910220f800 1 Processor -- start 2024-05-08T18:52:31.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.710+0000 7f910220f800 1 -- start start 2024-05-08T18:52:31.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.711+0000 7f910220f800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55e5c19da930 0x55e5c19dcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.711+0000 7f910220f800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e5c19dd260 con 0x55e5c19d6e20 2024-05-08T18:52:31.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.711+0000 7f910220f800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55e5c1876e20 con 0x55e5c19da930 2024-05-08T18:52:31.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.711+0000 7f90fd066640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55e5c19da930 0x55e5c19dcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.711+0000 7f90fd867640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55e5c19d6e20 0x55e5c19d9210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48088/0 (socket says 172.21.15.132:48088) 2024-05-08T18:52:31.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.711+0000 7f90fd867640 1 -- 172.21.15.132:0/1732929257 learned_addr learned my addr 172.21.15.132:0/1732929257 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:52:31.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.711+0000 7f90fd066640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55e5c19da930 0x55e5c19dcd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53008/0 (socket says 172.21.15.132:53008) 2024-05-08T18:52:31.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.711+0000 7f90fd066640 1 -- 172.21.15.132:0/1732929257 >> v1:172.21.15.42:6789/0 conn(0x55e5c19d6e20 legacy=0x55e5c19d9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.711+0000 7f90fd066640 1 -- 172.21.15.132:0/1732929257 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5c19de440 con 0x55e5c19da930 2024-05-08T18:52:31.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.713+0000 7f90fd066640 1 --2- 172.21.15.132:0/1732929257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19da930 0x55e5c19dcd20 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f90f400a470 tx=0x7f90f401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d92864a6737ec6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.713+0000 7f90fc865640 1 -- 172.21.15.132:0/1732929257 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90f4057070 con 0x55e5c19da930 2024-05-08T18:52:31.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.713+0000 7f90fc865640 1 -- 172.21.15.132:0/1732929257 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f4052570 con 0x55e5c19da930 2024-05-08T18:52:31.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.713+0000 7f90fc865640 1 -- 172.21.15.132:0/1732929257 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90f4052870 con 0x55e5c19da930 2024-05-08T18:52:31.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.714+0000 7f910220f800 1 -- 172.21.15.132:0/1732929257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19da930 msgr2=0x55e5c19dcd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.714+0000 7f910220f800 1 --2- 172.21.15.132:0/1732929257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19da930 0x55e5c19dcd20 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f90f400a470 tx=0x7f90f401ce90 comp rx=0 tx=0).stop 2024-05-08T18:52:31.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.714+0000 7f910220f800 1 -- 172.21.15.132:0/1732929257 shutdown_connections 2024-05-08T18:52:31.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.714+0000 7f910220f800 1 --2- 172.21.15.132:0/1732929257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19da930 0x55e5c19dcd20 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.714+0000 7f910220f800 1 -- 172.21.15.132:0/1732929257 >> 172.21.15.132:0/1732929257 conn(0x55e5c19d0810 msgr2=0x55e5c19d2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.714+0000 7f910220f800 1 -- 172.21.15.132:0/1732929257 shutdown_connections 2024-05-08T18:52:31.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.714+0000 7f910220f800 1 -- 172.21.15.132:0/1732929257 wait complete. 2024-05-08T18:52:31.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.728+0000 7f910220f800 1 Processor -- start 2024-05-08T18:52:31.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.728+0000 7f910220f800 1 -- start start 2024-05-08T18:52:31.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.728+0000 7f910220f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d6e20 0x55e5c1ac7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.728+0000 7f910220f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e5c19215d0 con 0x55e5c19d6e20 2024-05-08T18:52:31.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.728+0000 7f90fd867640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d6e20 0x55e5c1ac7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.728+0000 7f90fd867640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d6e20 0x55e5c1ac7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53024/0 (socket says 172.21.15.132:53024) 2024-05-08T18:52:31.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.728+0000 7f90fd867640 1 -- 172.21.15.132:0/2239938421 learned_addr learned my addr 172.21.15.132:0/2239938421 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.729+0000 7f90fd867640 1 -- 172.21.15.132:0/2239938421 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5c1ac7d00 con 0x55e5c19d6e20 2024-05-08T18:52:31.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.729+0000 7f90fd867640 1 --2- 172.21.15.132:0/2239938421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d6e20 0x55e5c1ac7730 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f90f00017a0 tx=0x7f90f0001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261610e64d073ed9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.729+0000 7f8febe07640 1 -- 172.21.15.132:0/2239938421 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90f0004520 con 0x55e5c19d6e20 2024-05-08T18:52:31.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.729+0000 7f8febe07640 1 -- 172.21.15.132:0/2239938421 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f00046c0 con 0x55e5c19d6e20 2024-05-08T18:52:31.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.729+0000 7f8febe07640 1 -- 172.21.15.132:0/2239938421 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90f0004a00 con 0x55e5c19d6e20 2024-05-08T18:52:31.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.730+0000 7f910220f800 1 -- 172.21.15.132:0/2239938421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d6e20 msgr2=0x55e5c1ac7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.730+0000 7f910220f800 1 --2- 172.21.15.132:0/2239938421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d6e20 0x55e5c1ac7730 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f90f00017a0 tx=0x7f90f0001c60 comp rx=0 tx=0).stop 2024-05-08T18:52:31.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.730+0000 7f910220f800 1 -- 172.21.15.132:0/2239938421 shutdown_connections 2024-05-08T18:52:31.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.730+0000 7f910220f800 1 --2- 172.21.15.132:0/2239938421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d6e20 0x55e5c1ac7730 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.730+0000 7f910220f800 1 -- 172.21.15.132:0/2239938421 >> 172.21.15.132:0/2239938421 conn(0x55e5c19d0810 msgr2=0x55e5c1ac3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.730+0000 7f910220f800 1 -- 172.21.15.132:0/2239938421 shutdown_connections 2024-05-08T18:52:31.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.730+0000 7f910220f800 1 -- 172.21.15.132:0/2239938421 wait complete. 2024-05-08T18:52:31.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.730+0000 7f910220f800 1 Processor -- start 2024-05-08T18:52:31.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.730+0000 7f910220f800 1 -- start start 2024-05-08T18:52:31.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.730+0000 7f910220f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d6e20 0x55e5c1acf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.730+0000 7f910220f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e5c19dd730 con 0x55e5c19d6e20 2024-05-08T18:52:31.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.730+0000 7f90fd867640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d6e20 0x55e5c1acf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.730+0000 7f90fd867640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d6e20 0x55e5c1acf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53036/0 (socket says 172.21.15.132:53036) 2024-05-08T18:52:31.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.730+0000 7f90fd867640 1 -- 172.21.15.132:0/1638759909 learned_addr learned my addr 172.21.15.132:0/1638759909 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.731+0000 7f90fd867640 1 -- 172.21.15.132:0/1638759909 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5c1acf7c0 con 0x55e5c19d6e20 2024-05-08T18:52:31.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.731+0000 7f90fd867640 1 --2- 172.21.15.132:0/1638759909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d6e20 0x55e5c1acf280 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f90f0000f80 tx=0x7f90f0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.731+0000 7f8fea604640 1 -- 172.21.15.132:0/1638759909 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90f0022020 con 0x55e5c19d6e20 2024-05-08T18:52:31.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.731+0000 7f8fea604640 1 -- 172.21.15.132:0/1638759909 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f0014980 con 0x55e5c19d6e20 2024-05-08T18:52:31.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.731+0000 7f910220f800 1 -- 172.21.15.132:0/1638759909 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5c1acfa50 con 0x55e5c19d6e20 2024-05-08T18:52:31.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.731+0000 7f8fea604640 1 -- 172.21.15.132:0/1638759909 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90f0014d00 con 0x55e5c19d6e20 2024-05-08T18:52:31.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.731+0000 7f910220f800 1 -- 172.21.15.132:0/1638759909 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5c1ad2700 con 0x55e5c19d6e20 2024-05-08T18:52:31.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.732+0000 7f910220f800 1 Processor -- start 2024-05-08T18:52:31.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.732+0000 7f910220f800 1 -- start start 2024-05-08T18:52:31.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.732+0000 7f910220f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d68b0 0x55e5c19d4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.732+0000 7f910220f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e5c18c7fc0 con 0x55e5c19d68b0 2024-05-08T18:52:31.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.732+0000 7f8fea604640 1 -- 172.21.15.132:0/1638759909 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f90f0025020 con 0x55e5c19d6e20 2024-05-08T18:52:31.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.732+0000 7f90fe068640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d68b0 0x55e5c19d4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.732+0000 7f90fe068640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d68b0 0x55e5c19d4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53052/0 (socket says 172.21.15.132:53052) 2024-05-08T18:52:31.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.732+0000 7f90fe068640 1 -- 172.21.15.132:0/4083324441 learned_addr learned my addr 172.21.15.132:0/4083324441 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.732+0000 7f8fea604640 1 --2- 172.21.15.132:0/1638759909 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8fe403bb50 0x7f8fe403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.732+0000 7f8fea604640 1 -- 172.21.15.132:0/1638759909 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f90f0018030 con 0x55e5c19d6e20 2024-05-08T18:52:31.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.733+0000 7f90fe068640 1 -- 172.21.15.132:0/4083324441 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5c19d5340 con 0x55e5c19d68b0 2024-05-08T18:52:31.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.733+0000 7f90fd867640 1 --2- 172.21.15.132:0/1638759909 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8fe403bb50 0x7f8fe403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.733+0000 7f90fe068640 1 --2- 172.21.15.132:0/4083324441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d68b0 0x55e5c19d4e00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f90f800a400 tx=0x7f90f800a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3984360847deb641 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.733+0000 7f8fe3fff640 1 -- 172.21.15.132:0/4083324441 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90f80087e0 con 0x55e5c19d68b0 2024-05-08T18:52:31.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.733+0000 7f8fe3fff640 1 -- 172.21.15.132:0/4083324441 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f80089a0 con 0x55e5c19d68b0 2024-05-08T18:52:31.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.733+0000 7f8fe3fff640 1 -- 172.21.15.132:0/4083324441 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90f8008d00 con 0x55e5c19d68b0 2024-05-08T18:52:31.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.733+0000 7f910220f800 1 -- 172.21.15.132:0/4083324441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d68b0 msgr2=0x55e5c19d4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.733+0000 7f910220f800 1 --2- 172.21.15.132:0/4083324441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d68b0 0x55e5c19d4e00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f90f800a400 tx=0x7f90f800a8c0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.733+0000 7f90fd867640 1 --2- 172.21.15.132:0/1638759909 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8fe403bb50 0x7f8fe403e010 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f90f00068f0 tx=0x7f90f0006820 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.733+0000 7f910220f800 1 -- 172.21.15.132:0/4083324441 shutdown_connections 2024-05-08T18:52:31.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.733+0000 7f910220f800 1 --2- 172.21.15.132:0/4083324441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d68b0 0x55e5c19d4e00 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.733+0000 7f910220f800 1 -- 172.21.15.132:0/4083324441 >> 172.21.15.132:0/4083324441 conn(0x55e5c19da930 msgr2=0x55e5c1ad93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.733+0000 7f910220f800 1 -- 172.21.15.132:0/4083324441 shutdown_connections 2024-05-08T18:52:31.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.734+0000 7f910220f800 1 -- 172.21.15.132:0/4083324441 wait complete. 2024-05-08T18:52:31.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.734+0000 7f910220f800 1 Processor -- start 2024-05-08T18:52:31.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.734+0000 7f910220f800 1 -- start start 2024-05-08T18:52:31.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.734+0000 7f910220f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d68b0 0x55e5c1ae5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.734+0000 7f910220f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e5c19d5630 con 0x55e5c19d68b0 2024-05-08T18:52:31.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.734+0000 7f90fe068640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d68b0 0x55e5c1ae5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.734+0000 7f90fe068640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d68b0 0x55e5c1ae5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53064/0 (socket says 172.21.15.132:53064) 2024-05-08T18:52:31.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.734+0000 7f90fe068640 1 -- 172.21.15.132:0/1292447956 learned_addr learned my addr 172.21.15.132:0/1292447956 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.735+0000 7f90fe068640 1 -- 172.21.15.132:0/1292447956 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5c1ae6530 con 0x55e5c19d68b0 2024-05-08T18:52:31.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.735+0000 7f90fe068640 1 --2- 172.21.15.132:0/1292447956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d68b0 0x55e5c1ae5ff0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f90f8010000 tx=0x7f90f8002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.735+0000 7f8fe27fc640 1 -- 172.21.15.132:0/1292447956 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90f8022020 con 0x55e5c19d68b0 2024-05-08T18:52:31.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.735+0000 7f8fe27fc640 1 -- 172.21.15.132:0/1292447956 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f8019040 con 0x55e5c19d68b0 2024-05-08T18:52:31.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.735+0000 7f910220f800 1 -- 172.21.15.132:0/1292447956 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5c1ae67c0 con 0x55e5c19d68b0 2024-05-08T18:52:31.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.735+0000 7f8fe27fc640 1 -- 172.21.15.132:0/1292447956 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90f8013950 con 0x55e5c19d68b0 2024-05-08T18:52:31.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.735+0000 7f910220f800 1 -- 172.21.15.132:0/1292447956 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5c1ae9470 con 0x55e5c19d68b0 2024-05-08T18:52:31.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.736+0000 7f8fe27fc640 1 -- 172.21.15.132:0/1292447956 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f90f8025020 con 0x55e5c19d68b0 2024-05-08T18:52:31.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.736+0000 7f910220f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:31.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.736+0000 7f910220f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:31.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.736+0000 7f8fe27fc640 1 --2- 172.21.15.132:0/1292447956 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8fd803bb50 0x7f8fd803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.736+0000 7f8fe27fc640 1 -- 172.21.15.132:0/1292447956 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f90f8052590 con 0x55e5c19d68b0 2024-05-08T18:52:31.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.737+0000 7f90fd066640 1 --2- 172.21.15.132:0/1292447956 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8fd803bb50 0x7f8fd803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.737+0000 7f910220f800 1 Processor -- start 2024-05-08T18:52:31.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.737+0000 7f910220f800 1 -- start start 2024-05-08T18:52:31.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.737+0000 7f910220f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c1b00670 0x55e5c1b00a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.737+0000 7f910220f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55e5c1ac8080 con 0x55e5c1b00670 2024-05-08T18:52:31.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.737+0000 7f90fd066640 1 --2- 172.21.15.132:0/1292447956 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8fd803bb50 0x7f8fd803e010 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f90f4054000 tx=0x7f90f404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.737+0000 7f90fd867640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c1b00670 0x55e5c1b00a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.737+0000 7f90fd867640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c1b00670 0x55e5c1b00a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53068/0 (socket says 172.21.15.132:53068) 2024-05-08T18:52:31.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.737+0000 7f90fd867640 1 -- 172.21.15.132:0/983733939 learned_addr learned my addr 172.21.15.132:0/983733939 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.738+0000 7f90fd867640 1 -- 172.21.15.132:0/983733939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5c1b00fb0 con 0x55e5c1b00670 2024-05-08T18:52:31.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.738+0000 7f90fd867640 1 --2- 172.21.15.132:0/983733939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c1b00670 0x55e5c1b00a70 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f90f0006a10 tx=0x7f90f0010ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.738+0000 7f8fc2fe5640 1 -- 172.21.15.132:0/983733939 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90f00128f0 con 0x55e5c1b00670 2024-05-08T18:52:31.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.738+0000 7f8fc2fe5640 1 -- 172.21.15.132:0/983733939 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f001dc00 con 0x55e5c1b00670 2024-05-08T18:52:31.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.738+0000 7f910220f800 1 -- 172.21.15.132:0/983733939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5c1b01a40 con 0x55e5c1b00670 2024-05-08T18:52:31.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.738+0000 7f8fc2fe5640 1 -- 172.21.15.132:0/983733939 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90f00263b0 con 0x55e5c1b00670 2024-05-08T18:52:31.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.738+0000 7f910220f800 1 -- 172.21.15.132:0/983733939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5c1b01f40 con 0x55e5c1b00670 2024-05-08T18:52:31.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.739+0000 7f8fc2fe5640 1 -- 172.21.15.132:0/983733939 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f90f0010070 con 0x55e5c1b00670 2024-05-08T18:52:31.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.739+0000 7f8fc2fe5640 1 --2- 172.21.15.132:0/983733939 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8f3403bb50 0x7f8f3403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.739+0000 7f8fc2fe5640 1 -- 172.21.15.132:0/983733939 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f90f0043070 con 0x55e5c1b00670 2024-05-08T18:52:31.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.739+0000 7f90fd066640 1 --2- 172.21.15.132:0/983733939 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8f3403bb50 0x7f8f3403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.739+0000 7f8fc0fe1640 20 reqs_thread_entry: start 2024-05-08T18:52:31.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.739+0000 7f90fd066640 1 --2- 172.21.15.132:0/983733939 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8f3403bb50 0x7f8f3403e010 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f90f4052540 tx=0x7f90f4005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.739+0000 7f910220f800 1 --2- 172.21.15.132:0/1638759909 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e5c1b0dfb0 0x55e5c1b10470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.739+0000 7f910220f800 1 -- 172.21.15.132:0/1638759909 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e5c1b10b40 con 0x55e5c1b0dfb0 2024-05-08T18:52:31.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.740+0000 7f90fe068640 1 --2- 172.21.15.132:0/1638759909 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e5c1b0dfb0 0x55e5c1b10470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.740+0000 7f90fe068640 1 --2- 172.21.15.132:0/1638759909 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e5c1b0dfb0 0x55e5c1b10470 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.740+0000 7f90fe068640 1 -- 172.21.15.132:0/1638759909 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90f801e420 con 0x55e5c1b0dfb0 2024-05-08T18:52:31.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.740+0000 7f910220f800 1 --2- 172.21.15.132:0/1638759909 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e5c1b12960 0x55e5c1b14d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.740+0000 7f910220f800 1 -- 172.21.15.132:0/1638759909 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:2 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e5c1b15420 con 0x55e5c1b12960 2024-05-08T18:52:31.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.740+0000 7f90fd867640 1 --2- 172.21.15.132:0/1638759909 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e5c1b12960 0x55e5c1b14d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.740+0000 7f90fd867640 1 --2- 172.21.15.132:0/1638759909 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e5c1b12960 0x55e5c1b14d50 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.741+0000 7f90fd867640 1 -- 172.21.15.132:0/1638759909 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(2 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f90f001b070 con 0x55e5c1b12960 2024-05-08T18:52:31.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.741+0000 7f910220f800 1 -- 172.21.15.132:0/1638759909 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5c1b12030 con 0x55e5c1b12960 2024-05-08T18:52:31.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.742+0000 7f90fd867640 1 -- 172.21.15.132:0/1638759909 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [stat,call,call,writefull 0~993] v27'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f90f001b070 con 0x55e5c1b12960 2024-05-08T18:52:31.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.743+0000 7f910220f800 1 -- 172.21.15.132:0/1292447956 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8fd803bb50 msgr2=0x7f8fd803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.743+0000 7f910220f800 1 --2- 172.21.15.132:0/1292447956 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8fd803bb50 0x7f8fd803e010 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f90f4054000 tx=0x7f90f404e000 comp rx=0 tx=0).stop 2024-05-08T18:52:31.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.743+0000 7f910220f800 1 -- 172.21.15.132:0/1292447956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d68b0 msgr2=0x55e5c1ae5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.743+0000 7f910220f800 1 --2- 172.21.15.132:0/1292447956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d68b0 0x55e5c1ae5ff0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f90f8010000 tx=0x7f90f8002ff0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.743+0000 7f910220f800 1 -- 172.21.15.132:0/1292447956 shutdown_connections 2024-05-08T18:52:31.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.743+0000 7f910220f800 1 --2- 172.21.15.132:0/1292447956 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8fd803bb50 0x7f8fd803e010 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.743+0000 7f910220f800 1 --2- 172.21.15.132:0/1292447956 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d68b0 0x55e5c1ae5ff0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.743+0000 7f910220f800 1 -- 172.21.15.132:0/1292447956 >> 172.21.15.132:0/1292447956 conn(0x55e5c19da930 msgr2=0x55e5c1ad69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.743+0000 7f910220f800 1 -- 172.21.15.132:0/1292447956 shutdown_connections 2024-05-08T18:52:31.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.743+0000 7f910220f800 1 -- 172.21.15.132:0/1292447956 wait complete. 2024-05-08T18:52:31.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.743+0000 7f910220f800 1 -- 172.21.15.132:0/983733939 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8f3403bb50 msgr2=0x7f8f3403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.743+0000 7f910220f800 1 --2- 172.21.15.132:0/983733939 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8f3403bb50 0x7f8f3403e010 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f90f4052540 tx=0x7f90f4005a00 comp rx=0 tx=0).stop 2024-05-08T18:52:31.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.743+0000 7f910220f800 1 -- 172.21.15.132:0/983733939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c1b00670 msgr2=0x55e5c1b00a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.743+0000 7f910220f800 1 --2- 172.21.15.132:0/983733939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c1b00670 0x55e5c1b00a70 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f90f0006a10 tx=0x7f90f0010ec0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.743+0000 7f910220f800 1 -- 172.21.15.132:0/983733939 shutdown_connections 2024-05-08T18:52:31.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.743+0000 7f910220f800 1 --2- 172.21.15.132:0/983733939 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8f3403bb50 0x7f8f3403e010 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.743+0000 7f910220f800 1 --2- 172.21.15.132:0/983733939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c1b00670 0x55e5c1b00a70 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.743+0000 7f910220f800 1 -- 172.21.15.132:0/983733939 >> 172.21.15.132:0/983733939 conn(0x55e5c1af5260 msgr2=0x55e5c1af5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.743+0000 7f910220f800 1 -- 172.21.15.132:0/983733939 shutdown_connections 2024-05-08T18:52:31.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.743+0000 7f910220f800 1 -- 172.21.15.132:0/983733939 wait complete. 2024-05-08T18:52:31.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.744+0000 7f910220f800 1 -- 172.21.15.132:0/1638759909 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e5c1b0dfb0 msgr2=0x55e5c1b10470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.744+0000 7f910220f800 1 --2- 172.21.15.132:0/1638759909 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e5c1b0dfb0 0x55e5c1b10470 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.744+0000 7f910220f800 1 -- 172.21.15.132:0/1638759909 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e5c1b12960 msgr2=0x55e5c1b14d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.744+0000 7f910220f800 1 --2- 172.21.15.132:0/1638759909 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e5c1b12960 0x55e5c1b14d50 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.744+0000 7f910220f800 1 -- 172.21.15.132:0/1638759909 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8fe403bb50 msgr2=0x7f8fe403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.744+0000 7f910220f800 1 --2- 172.21.15.132:0/1638759909 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8fe403bb50 0x7f8fe403e010 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f90f00068f0 tx=0x7f90f0006820 comp rx=0 tx=0).stop 2024-05-08T18:52:31.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.744+0000 7f910220f800 1 -- 172.21.15.132:0/1638759909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d6e20 msgr2=0x55e5c1acf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.744+0000 7f910220f800 1 --2- 172.21.15.132:0/1638759909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d6e20 0x55e5c1acf280 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f90f0000f80 tx=0x7f90f0001250 comp rx=0 tx=0).stop 2024-05-08T18:52:31.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.744+0000 7f910220f800 1 -- 172.21.15.132:0/1638759909 shutdown_connections 2024-05-08T18:52:31.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.744+0000 7f910220f800 1 --2- 172.21.15.132:0/1638759909 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55e5c1b12960 0x55e5c1b14d50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.744+0000 7f910220f800 1 --2- 172.21.15.132:0/1638759909 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55e5c1b0dfb0 0x55e5c1b10470 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.744+0000 7f910220f800 1 --2- 172.21.15.132:0/1638759909 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8fe403bb50 0x7f8fe403e010 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.744+0000 7f910220f800 1 --2- 172.21.15.132:0/1638759909 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55e5c19d6e20 0x55e5c1acf280 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.744+0000 7f910220f800 1 -- 172.21.15.132:0/1638759909 >> 172.21.15.132:0/1638759909 conn(0x55e5c19d0810 msgr2=0x55e5c1ac1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.744+0000 7f910220f800 1 -- 172.21.15.132:0/1638759909 shutdown_connections 2024-05-08T18:52:31.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.744+0000 7f910220f800 1 -- 172.21.15.132:0/1638759909 wait complete. 2024-05-08T18:52:31.752 INFO:teuthology.orchestra.run.smithi132.stdout:{"id":"bda7b4b2-a5a7-480e-b283-597f208ae0d4","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-05-08T18:52:31.752 DEBUG:tasks.util.rgw: json result: {'id': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-05-08T18:52:31.752 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-05-08T18:52:31.752 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-05-08T18:52:31.752 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-05-08T18:52:31.799 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:31.799 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:31.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.796+0000 7fc1dfb51800 1 Processor -- start 2024-05-08T18:52:31.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.796+0000 7fc1dfb51800 1 -- start start 2024-05-08T18:52:31.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.796+0000 7fc1dfb51800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x557d993f4a40 0x557d99489140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.796+0000 7fc1dfb51800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557d993f4f80 con 0x557d993f5dd0 2024-05-08T18:52:31.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.796+0000 7fc1dfb51800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x557d99320e20 con 0x557d993f4a40 2024-05-08T18:52:31.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.797+0000 7fc1dce4f640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x557d993f4a40 0x557d99489140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.797+0000 7fc1dce4f640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x557d993f4a40 0x557d99489140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53072/0 (socket says 172.21.15.132:53072) 2024-05-08T18:52:31.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.797+0000 7fc1dd650640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x557d993f5dd0 0x557d993f4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48104/0 (socket says 172.21.15.132:48104) 2024-05-08T18:52:31.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.797+0000 7fc1dce4f640 1 -- 172.21.15.132:0/178227951 learned_addr learned my addr 172.21.15.132:0/178227951 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.797+0000 7fc1dce4f640 1 -- 172.21.15.132:0/178227951 >> v1:172.21.15.42:6789/0 conn(0x557d993f5dd0 legacy=0x557d993f4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.797+0000 7fc1dce4f640 1 -- 172.21.15.132:0/178227951 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d993f5150 con 0x557d993f4a40 2024-05-08T18:52:31.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.799+0000 7fc1dce4f640 1 --2- 172.21.15.132:0/178227951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d993f4a40 0x557d99489140 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800a520 tx=0x7fc1c801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee59956abd5e76e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.799+0000 7fc1d7fff640 1 -- 172.21.15.132:0/178227951 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1c8057070 con 0x557d993f4a40 2024-05-08T18:52:31.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.799+0000 7fc1d7fff640 1 -- 172.21.15.132:0/178227951 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c8052570 con 0x557d993f4a40 2024-05-08T18:52:31.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.799+0000 7fc1d7fff640 1 -- 172.21.15.132:0/178227951 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1c804ae60 con 0x557d993f4a40 2024-05-08T18:52:31.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.799+0000 7fc1dfb51800 1 -- 172.21.15.132:0/178227951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d993f4a40 msgr2=0x557d99489140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.799+0000 7fc1dfb51800 1 --2- 172.21.15.132:0/178227951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d993f4a40 0x557d99489140 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800a520 tx=0x7fc1c801d010 comp rx=0 tx=0).stop 2024-05-08T18:52:31.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.799+0000 7fc1dfb51800 1 -- 172.21.15.132:0/178227951 shutdown_connections 2024-05-08T18:52:31.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.799+0000 7fc1dfb51800 1 --2- 172.21.15.132:0/178227951 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d993f4a40 0x557d99489140 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.799+0000 7fc1dfb51800 1 -- 172.21.15.132:0/178227951 >> 172.21.15.132:0/178227951 conn(0x557d9947b820 msgr2=0x557d9947dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.799+0000 7fc1dfb51800 1 -- 172.21.15.132:0/178227951 shutdown_connections 2024-05-08T18:52:31.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.800+0000 7fc1dfb51800 1 -- 172.21.15.132:0/178227951 wait complete. 2024-05-08T18:52:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.813+0000 7fc1dfb51800 1 Processor -- start 2024-05-08T18:52:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.814+0000 7fc1dfb51800 1 -- start start 2024-05-08T18:52:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.814+0000 7fc1dfb51800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d993f4a40 0x557d99573800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.814+0000 7fc1dfb51800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557d993cb5a0 con 0x557d993f4a40 2024-05-08T18:52:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.814+0000 7fc1dd650640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d993f4a40 0x557d99573800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.814+0000 7fc1dd650640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d993f4a40 0x557d99573800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53082/0 (socket says 172.21.15.132:53082) 2024-05-08T18:52:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.814+0000 7fc1dd650640 1 -- 172.21.15.132:0/3353272059 learned_addr learned my addr 172.21.15.132:0/3353272059 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.814+0000 7fc1dd650640 1 -- 172.21.15.132:0/3353272059 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d99573dd0 con 0x557d993f4a40 2024-05-08T18:52:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.815+0000 7fc1dd650640 1 --2- 172.21.15.132:0/3353272059 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d993f4a40 0x557d99573800 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0001eb0 tx=0x7fc1d000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c27975e6603b0b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.815+0000 7fc0cb606640 1 -- 172.21.15.132:0/3353272059 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d000e5c0 con 0x557d993f4a40 2024-05-08T18:52:31.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.815+0000 7fc0cb606640 1 -- 172.21.15.132:0/3353272059 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d0006070 con 0x557d993f4a40 2024-05-08T18:52:31.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.815+0000 7fc0cb606640 1 -- 172.21.15.132:0/3353272059 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d000e8b0 con 0x557d993f4a40 2024-05-08T18:52:31.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.816+0000 7fc1dfb51800 1 -- 172.21.15.132:0/3353272059 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d993f4a40 msgr2=0x557d99573800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.816+0000 7fc1dfb51800 1 --2- 172.21.15.132:0/3353272059 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d993f4a40 0x557d99573800 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0001eb0 tx=0x7fc1d000b6c0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.816+0000 7fc1dfb51800 1 -- 172.21.15.132:0/3353272059 shutdown_connections 2024-05-08T18:52:31.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.816+0000 7fc1dfb51800 1 --2- 172.21.15.132:0/3353272059 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d993f4a40 0x557d99573800 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.816+0000 7fc1dfb51800 1 -- 172.21.15.132:0/3353272059 >> 172.21.15.132:0/3353272059 conn(0x557d9947b820 msgr2=0x557d9956f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.816+0000 7fc1dfb51800 1 -- 172.21.15.132:0/3353272059 shutdown_connections 2024-05-08T18:52:31.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.816+0000 7fc1dfb51800 1 -- 172.21.15.132:0/3353272059 wait complete. 2024-05-08T18:52:31.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.816+0000 7fc1dfb51800 1 Processor -- start 2024-05-08T18:52:31.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.816+0000 7fc1dfb51800 1 -- start start 2024-05-08T18:52:31.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.816+0000 7fc1dfb51800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d993f4a40 0x557d9957b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.816+0000 7fc1dfb51800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557d99489950 con 0x557d993f4a40 2024-05-08T18:52:31.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.816+0000 7fc1dd650640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d993f4a40 0x557d9957b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.816+0000 7fc1dd650640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d993f4a40 0x557d9957b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53084/0 (socket says 172.21.15.132:53084) 2024-05-08T18:52:31.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.816+0000 7fc1dd650640 1 -- 172.21.15.132:0/2360754634 learned_addr learned my addr 172.21.15.132:0/2360754634 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.817+0000 7fc1dd650640 1 -- 172.21.15.132:0/2360754634 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d9957b8c0 con 0x557d993f4a40 2024-05-08T18:52:31.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.817+0000 7fc1dd650640 1 --2- 172.21.15.132:0/2360754634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d993f4a40 0x557d9957b380 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000c010 tx=0x7fc1d0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.817+0000 7fc0c9e03640 1 -- 172.21.15.132:0/2360754634 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d001a880 con 0x557d993f4a40 2024-05-08T18:52:31.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.817+0000 7fc0c9e03640 1 -- 172.21.15.132:0/2360754634 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d001aa20 con 0x557d993f4a40 2024-05-08T18:52:31.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.817+0000 7fc0c9e03640 1 -- 172.21.15.132:0/2360754634 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d001ad40 con 0x557d993f4a40 2024-05-08T18:52:31.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.817+0000 7fc1dfb51800 1 -- 172.21.15.132:0/2360754634 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d9957bb50 con 0x557d993f4a40 2024-05-08T18:52:31.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.817+0000 7fc1dfb51800 1 -- 172.21.15.132:0/2360754634 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d9957e800 con 0x557d993f4a40 2024-05-08T18:52:31.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.818+0000 7fc1dfb51800 1 Processor -- start 2024-05-08T18:52:31.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.818+0000 7fc1dfb51800 1 -- start start 2024-05-08T18:52:31.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.818+0000 7fc1dfb51800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d99588a10 0x557d99588e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.818+0000 7fc1dfb51800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557d99371fc0 con 0x557d99588a10 2024-05-08T18:52:31.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.818+0000 7fc0c9e03640 1 -- 172.21.15.132:0/2360754634 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc1d0017070 con 0x557d993f4a40 2024-05-08T18:52:31.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.818+0000 7fc1dde51640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d99588a10 0x557d99588e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.818+0000 7fc1dde51640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d99588a10 0x557d99588e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53090/0 (socket says 172.21.15.132:53090) 2024-05-08T18:52:31.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.818+0000 7fc1dde51640 1 -- 172.21.15.132:0/1197760062 learned_addr learned my addr 172.21.15.132:0/1197760062 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.818+0000 7fc0c9e03640 1 --2- 172.21.15.132:0/2360754634 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc0c403bb50 0x7fc0c403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.818+0000 7fc0c9e03640 1 -- 172.21.15.132:0/2360754634 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fc1d0015020 con 0x557d993f4a40 2024-05-08T18:52:31.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.818+0000 7fc1dde51640 1 -- 172.21.15.132:0/1197760062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d99589370 con 0x557d99588a10 2024-05-08T18:52:31.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.818+0000 7fc1dd650640 1 --2- 172.21.15.132:0/2360754634 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc0c403bb50 0x7fc0c403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.819+0000 7fc1dde51640 1 --2- 172.21.15.132:0/1197760062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d99588a10 0x557d99588e30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800a430 tx=0x7fc1d800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96124ed8bfa63b35 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.819+0000 7fc1dd650640 1 --2- 172.21.15.132:0/2360754634 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc0c403bb50 0x7fc0c403e010 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0017c90 tx=0x7fc1d0017b20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.819+0000 7fc0c37fe640 1 -- 172.21.15.132:0/1197760062 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d8015070 con 0x557d99588a10 2024-05-08T18:52:31.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.819+0000 7fc0c37fe640 1 -- 172.21.15.132:0/1197760062 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d8001670 con 0x557d99588a10 2024-05-08T18:52:31.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.819+0000 7fc0c37fe640 1 -- 172.21.15.132:0/1197760062 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d8001990 con 0x557d99588a10 2024-05-08T18:52:31.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.819+0000 7fc1dfb51800 1 -- 172.21.15.132:0/1197760062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d99588a10 msgr2=0x557d99588e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.819+0000 7fc1dfb51800 1 --2- 172.21.15.132:0/1197760062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d99588a10 0x557d99588e30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800a430 tx=0x7fc1d800a8f0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.819+0000 7fc1dfb51800 1 -- 172.21.15.132:0/1197760062 shutdown_connections 2024-05-08T18:52:31.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.819+0000 7fc1dfb51800 1 --2- 172.21.15.132:0/1197760062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d99588a10 0x557d99588e30 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.819+0000 7fc1dfb51800 1 -- 172.21.15.132:0/1197760062 >> 172.21.15.132:0/1197760062 conn(0x557d993f5dd0 msgr2=0x557d995854b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.819+0000 7fc1dfb51800 1 -- 172.21.15.132:0/1197760062 shutdown_connections 2024-05-08T18:52:31.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.819+0000 7fc1dfb51800 1 -- 172.21.15.132:0/1197760062 wait complete. 2024-05-08T18:52:31.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.820+0000 7fc1dfb51800 1 Processor -- start 2024-05-08T18:52:31.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.820+0000 7fc1dfb51800 1 -- start start 2024-05-08T18:52:31.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.820+0000 7fc1dfb51800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d99588a10 0x557d9958fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.820+0000 7fc1dfb51800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557d99589d00 con 0x557d99588a10 2024-05-08T18:52:31.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.820+0000 7fc1dde51640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d99588a10 0x557d9958fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.820+0000 7fc1dde51640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d99588a10 0x557d9958fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53094/0 (socket says 172.21.15.132:53094) 2024-05-08T18:52:31.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.820+0000 7fc1dde51640 1 -- 172.21.15.132:0/532993491 learned_addr learned my addr 172.21.15.132:0/532993491 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.820+0000 7fc1dde51640 1 -- 172.21.15.132:0/532993491 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d995903e0 con 0x557d99588a10 2024-05-08T18:52:31.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.820+0000 7fc1dde51640 1 --2- 172.21.15.132:0/532993491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d99588a10 0x557d9958fea0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8013040 tx=0x7fc1d8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.821+0000 7fc0c1ffb640 1 -- 172.21.15.132:0/532993491 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d8020020 con 0x557d99588a10 2024-05-08T18:52:31.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.821+0000 7fc0c1ffb640 1 -- 172.21.15.132:0/532993491 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d80108e0 con 0x557d99588a10 2024-05-08T18:52:31.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.821+0000 7fc1dfb51800 1 -- 172.21.15.132:0/532993491 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d99590670 con 0x557d99588a10 2024-05-08T18:52:31.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.821+0000 7fc0c1ffb640 1 -- 172.21.15.132:0/532993491 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d8015040 con 0x557d99588a10 2024-05-08T18:52:31.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.821+0000 7fc1dfb51800 1 -- 172.21.15.132:0/532993491 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d99593320 con 0x557d99588a10 2024-05-08T18:52:31.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.822+0000 7fc0c1ffb640 1 -- 172.21.15.132:0/532993491 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc1d8023020 con 0x557d99588a10 2024-05-08T18:52:31.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.822+0000 7fc0c1ffb640 1 --2- 172.21.15.132:0/532993491 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc0b803bb50 0x7fc0b803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.822+0000 7fc0c1ffb640 1 -- 172.21.15.132:0/532993491 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fc1d80523a0 con 0x557d99588a10 2024-05-08T18:52:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.822+0000 7fc1dce4f640 1 --2- 172.21.15.132:0/532993491 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc0b803bb50 0x7fc0b803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.822+0000 7fc1dfb51800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.822+0000 7fc1dfb51800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.823+0000 7fc1dfb51800 1 Processor -- start 2024-05-08T18:52:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.823+0000 7fc1dce4f640 1 --2- 172.21.15.132:0/532993491 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc0b803bb50 0x7fc0b803e010 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8054000 tx=0x7fc1c804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.823+0000 7fc1dfb51800 1 -- start start 2024-05-08T18:52:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.823+0000 7fc1dfb51800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d995aa580 0x557d995aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.823+0000 7fc1dfb51800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x557d99574150 con 0x557d995aa580 2024-05-08T18:52:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.823+0000 7fc1dd650640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d995aa580 0x557d995aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.823+0000 7fc1dd650640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d995aa580 0x557d995aa9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53100/0 (socket says 172.21.15.132:53100) 2024-05-08T18:52:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.823+0000 7fc1dd650640 1 -- 172.21.15.132:0/2541014327 learned_addr learned my addr 172.21.15.132:0/2541014327 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.823+0000 7fc1dd650640 1 -- 172.21.15.132:0/2541014327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d995aaee0 con 0x557d995aa580 2024-05-08T18:52:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.824+0000 7fc1dd650640 1 --2- 172.21.15.132:0/2541014327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d995aa580 0x557d995aa9a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc1d001cfd0 tx=0x7fc1d0052db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.831 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.824+0000 7fc0a1fe3640 1 -- 172.21.15.132:0/2541014327 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d0019690 con 0x557d995aa580 2024-05-08T18:52:31.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.824+0000 7fc0a1fe3640 1 -- 172.21.15.132:0/2541014327 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1d0017d50 con 0x557d995aa580 2024-05-08T18:52:31.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.824+0000 7fc0a1fe3640 1 -- 172.21.15.132:0/2541014327 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d001de20 con 0x557d995aa580 2024-05-08T18:52:31.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.824+0000 7fc1dfb51800 1 -- 172.21.15.132:0/2541014327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d995ab950 con 0x557d995aa580 2024-05-08T18:52:31.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.824+0000 7fc1dfb51800 1 -- 172.21.15.132:0/2541014327 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d995abe50 con 0x557d995aa580 2024-05-08T18:52:31.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.825+0000 7fc0a1fe3640 1 -- 172.21.15.132:0/2541014327 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc1d001c450 con 0x557d995aa580 2024-05-08T18:52:31.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.825+0000 7fc0a1fe3640 1 --2- 172.21.15.132:0/2541014327 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc02003bcf0 0x7fc02003e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.825+0000 7fc0a1fe3640 1 -- 172.21.15.132:0/2541014327 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fc1d0038070 con 0x557d995aa580 2024-05-08T18:52:31.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.825+0000 7fc1dce4f640 1 --2- 172.21.15.132:0/2541014327 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc02003bcf0 0x7fc02003e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.825+0000 7fc01b7fe640 20 reqs_thread_entry: start 2024-05-08T18:52:31.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.825+0000 7fc1dce4f640 1 --2- 172.21.15.132:0/2541014327 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc02003bcf0 0x7fc02003e1b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc1c804b010 tx=0x7fc1c8005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.825+0000 7fc1dfb51800 1 --2- 172.21.15.132:0/2360754634 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x557d995b7f80 0x557d995ba370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.825+0000 7fc1dfb51800 1 -- 172.21.15.132:0/2360754634 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557d995ba9d0 con 0x557d995b7f80 2024-05-08T18:52:31.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.825+0000 7fc1dde51640 1 --2- 172.21.15.132:0/2360754634 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x557d995b7f80 0x557d995ba370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.832 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.826+0000 7fc1dde51640 1 --2- 172.21.15.132:0/2360754634 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x557d995b7f80 0x557d995ba370 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.826+0000 7fc1dde51640 1 -- 172.21.15.132:0/2360754634 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1d800e070 con 0x557d995b7f80 2024-05-08T18:52:31.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.826+0000 7fc1dfb51800 1 -- 172.21.15.132:0/2360754634 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557d995baf50 con 0x557d995b7f80 2024-05-08T18:52:31.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.826+0000 7fc1dde51640 1 -- 172.21.15.132:0/2360754634 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc1d800e070 con 0x557d995b7f80 2024-05-08T18:52:31.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.826+0000 7fc1dfb51800 1 -- 172.21.15.132:0/2360754634 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557d995bc4e0 con 0x557d995b7f80 2024-05-08T18:52:31.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.827+0000 7fc1dde51640 1 -- 172.21.15.132:0/2360754634 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc1d800e070 con 0x557d995b7f80 2024-05-08T18:52:31.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.827+0000 7fc1dfb51800 1 -- 172.21.15.132:0/532993491 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc0b803bb50 msgr2=0x7fc0b803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.827+0000 7fc1dfb51800 1 --2- 172.21.15.132:0/532993491 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc0b803bb50 0x7fc0b803e010 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8054000 tx=0x7fc1c804e000 comp rx=0 tx=0).stop 2024-05-08T18:52:31.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.827+0000 7fc1dfb51800 1 -- 172.21.15.132:0/532993491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d99588a10 msgr2=0x557d9958fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.827+0000 7fc1dfb51800 1 --2- 172.21.15.132:0/532993491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d99588a10 0x557d9958fea0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8013040 tx=0x7fc1d8003370 comp rx=0 tx=0).stop 2024-05-08T18:52:31.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.827+0000 7fc1dfb51800 1 -- 172.21.15.132:0/532993491 shutdown_connections 2024-05-08T18:52:31.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.827+0000 7fc1dfb51800 1 --2- 172.21.15.132:0/532993491 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc0b803bb50 0x7fc0b803e010 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.827+0000 7fc1dfb51800 1 --2- 172.21.15.132:0/532993491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d99588a10 0x557d9958fea0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.827+0000 7fc1dfb51800 1 -- 172.21.15.132:0/532993491 >> 172.21.15.132:0/532993491 conn(0x557d993f5dd0 msgr2=0x557d99582af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.827+0000 7fc1dfb51800 1 -- 172.21.15.132:0/532993491 shutdown_connections 2024-05-08T18:52:31.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.827+0000 7fc1dfb51800 1 -- 172.21.15.132:0/532993491 wait complete. 2024-05-08T18:52:31.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 -- 172.21.15.132:0/2541014327 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc02003bcf0 msgr2=0x7fc02003e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 --2- 172.21.15.132:0/2541014327 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc02003bcf0 0x7fc02003e1b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc1c804b010 tx=0x7fc1c8005ac0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 -- 172.21.15.132:0/2541014327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d995aa580 msgr2=0x557d995aa9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 --2- 172.21.15.132:0/2541014327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d995aa580 0x557d995aa9a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc1d001cfd0 tx=0x7fc1d0052db0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 -- 172.21.15.132:0/2541014327 shutdown_connections 2024-05-08T18:52:31.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 --2- 172.21.15.132:0/2541014327 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc02003bcf0 0x7fc02003e1b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 --2- 172.21.15.132:0/2541014327 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d995aa580 0x557d995aa9a0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 -- 172.21.15.132:0/2541014327 >> 172.21.15.132:0/2541014327 conn(0x557d9959f030 msgr2=0x557d9959fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 -- 172.21.15.132:0/2541014327 shutdown_connections 2024-05-08T18:52:31.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 -- 172.21.15.132:0/2541014327 wait complete. 2024-05-08T18:52:31.834 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 -- 172.21.15.132:0/2360754634 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x557d995b7f80 msgr2=0x557d995ba370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 --2- 172.21.15.132:0/2360754634 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x557d995b7f80 0x557d995ba370 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 -- 172.21.15.132:0/2360754634 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc0c403bb50 msgr2=0x7fc0c403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 --2- 172.21.15.132:0/2360754634 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc0c403bb50 0x7fc0c403e010 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0017c90 tx=0x7fc1d0017b20 comp rx=0 tx=0).stop 2024-05-08T18:52:31.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 -- 172.21.15.132:0/2360754634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d993f4a40 msgr2=0x557d9957b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 --2- 172.21.15.132:0/2360754634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d993f4a40 0x557d9957b380 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000c010 tx=0x7fc1d0000ed0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 -- 172.21.15.132:0/2360754634 shutdown_connections 2024-05-08T18:52:31.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 --2- 172.21.15.132:0/2360754634 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x557d995b7f80 0x557d995ba370 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 --2- 172.21.15.132:0/2360754634 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc0c403bb50 0x7fc0c403e010 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 --2- 172.21.15.132:0/2360754634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x557d993f4a40 0x557d9957b380 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 -- 172.21.15.132:0/2360754634 >> 172.21.15.132:0/2360754634 conn(0x557d9947b820 msgr2=0x557d9956d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 -- 172.21.15.132:0/2360754634 shutdown_connections 2024-05-08T18:52:31.835 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.828+0000 7fc1dfb51800 1 -- 172.21.15.132:0/2360754634 wait complete. 2024-05-08T18:52:31.836 INFO:teuthology.orchestra.run.smithi132.stdout:{"id":"23dcc2a0-b283-45fd-8c01-831457a34b43","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"bda7b4b2-a5a7-480e-b283-597f208ae0d4","zones":[{"id":"bda7b4b2-a5a7-480e-b283-597f208ae0d4","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-05-08T18:52:31.836 DEBUG:tasks.util.rgw: json result: {'id': '23dcc2a0-b283-45fd-8c01-831457a34b43', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4', 'zones': [{'id': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-05-08T18:52:31.839 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-05-08T18:52:31.857 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-05-08T18:52:31.857 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-05-08T18:52:31.857 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-05-08T18:52:31.930 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:31.931 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:31.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.932+0000 7fde41733800 1 Processor -- start 2024-05-08T18:52:31.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.932+0000 7fde41733800 1 -- start start 2024-05-08T18:52:31.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.932+0000 7fde41733800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5633240bf590 0x5633240c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.932+0000 7fde41733800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5633240c2100 con 0x56332402e4d0 2024-05-08T18:52:31.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.932+0000 7fde41733800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x563323f5be20 con 0x5633240bf590 2024-05-08T18:52:31.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.933+0000 7fde3cbf4640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5633240bf590 0x5633240c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.933+0000 7fde3d3f5640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x56332402e4d0 0x5633240bde40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48112/0 (socket says 172.21.15.132:48112) 2024-05-08T18:52:31.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.933+0000 7fde3d3f5640 1 -- 172.21.15.132:0/1457260990 learned_addr learned my addr 172.21.15.132:0/1457260990 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:52:31.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.933+0000 7fde3cbf4640 1 -- 172.21.15.132:0/1457260990 >> v1:172.21.15.42:6789/0 conn(0x56332402e4d0 legacy=0x5633240bde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.933+0000 7fde2ffff640 1 -- 172.21.15.132:0/1457260990 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1328559700 0 0) 0x5633240c2100 con 0x56332402e4d0 2024-05-08T18:52:31.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.933+0000 7fde3cbf4640 1 -- 172.21.15.132:0/1457260990 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633240c3330 con 0x5633240bf590 2024-05-08T18:52:31.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.935+0000 7fde3cbf4640 1 --2- 172.21.15.132:0/1457260990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633240bf590 0x5633240c1a50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fde3400a470 tx=0x7fde3401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693b64064f5bafeb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.935+0000 7fde2ffff640 1 -- 172.21.15.132:0/1457260990 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde34057070 con 0x5633240bf590 2024-05-08T18:52:31.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.935+0000 7fde2ffff640 1 -- 172.21.15.132:0/1457260990 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde34052570 con 0x5633240bf590 2024-05-08T18:52:31.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.935+0000 7fde2ffff640 1 -- 172.21.15.132:0/1457260990 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde34052870 con 0x5633240bf590 2024-05-08T18:52:31.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.936+0000 7fde41733800 1 -- 172.21.15.132:0/1457260990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633240bf590 msgr2=0x5633240c1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.936+0000 7fde41733800 1 --2- 172.21.15.132:0/1457260990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633240bf590 0x5633240c1a50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fde3400a470 tx=0x7fde3401ce90 comp rx=0 tx=0).stop 2024-05-08T18:52:31.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.936+0000 7fde41733800 1 -- 172.21.15.132:0/1457260990 shutdown_connections 2024-05-08T18:52:31.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.936+0000 7fde41733800 1 --2- 172.21.15.132:0/1457260990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633240bf590 0x5633240c1a50 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.936+0000 7fde41733800 1 -- 172.21.15.132:0/1457260990 >> 172.21.15.132:0/1457260990 conn(0x5633240b5760 msgr2=0x5633240b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.936+0000 7fde41733800 1 -- 172.21.15.132:0/1457260990 shutdown_connections 2024-05-08T18:52:31.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.936+0000 7fde41733800 1 -- 172.21.15.132:0/1457260990 wait complete. 2024-05-08T18:52:31.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.950+0000 7fde41733800 1 Processor -- start 2024-05-08T18:52:31.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.950+0000 7fde41733800 1 -- start start 2024-05-08T18:52:31.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.950+0000 7fde41733800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56332402e4d0 0x5633240bb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.950+0000 7fde41733800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5633240066b0 con 0x56332402e4d0 2024-05-08T18:52:31.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.950+0000 7fde3d3f5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56332402e4d0 0x5633240bb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.950+0000 7fde3d3f5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56332402e4d0 0x5633240bb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53116/0 (socket says 172.21.15.132:53116) 2024-05-08T18:52:31.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.950+0000 7fde3d3f5640 1 -- 172.21.15.132:0/2824262845 learned_addr learned my addr 172.21.15.132:0/2824262845 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.951+0000 7fde3d3f5640 1 -- 172.21.15.132:0/2824262845 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633240b9d30 con 0x56332402e4d0 2024-05-08T18:52:31.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.951+0000 7fde3d3f5640 1 --2- 172.21.15.132:0/2824262845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56332402e4d0 0x5633240bb770 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fde30001630 tx=0x7fde30001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3935f513262b564 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.951+0000 7fdd2b606640 1 -- 172.21.15.132:0/2824262845 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde30003450 con 0x56332402e4d0 2024-05-08T18:52:31.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.951+0000 7fdd2b606640 1 -- 172.21.15.132:0/2824262845 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde300035f0 con 0x56332402e4d0 2024-05-08T18:52:31.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.951+0000 7fdd2b606640 1 -- 172.21.15.132:0/2824262845 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde30003990 con 0x56332402e4d0 2024-05-08T18:52:31.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.952+0000 7fde41733800 1 -- 172.21.15.132:0/2824262845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56332402e4d0 msgr2=0x5633240bb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.952+0000 7fde41733800 1 --2- 172.21.15.132:0/2824262845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56332402e4d0 0x5633240bb770 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fde30001630 tx=0x7fde30001af0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.952+0000 7fde41733800 1 -- 172.21.15.132:0/2824262845 shutdown_connections 2024-05-08T18:52:31.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.952+0000 7fde41733800 1 --2- 172.21.15.132:0/2824262845 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56332402e4d0 0x5633240bb770 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.952+0000 7fde41733800 1 -- 172.21.15.132:0/2824262845 >> 172.21.15.132:0/2824262845 conn(0x5633240b5760 msgr2=0x5633241a7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.952+0000 7fde41733800 1 -- 172.21.15.132:0/2824262845 shutdown_connections 2024-05-08T18:52:31.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.952+0000 7fde41733800 1 -- 172.21.15.132:0/2824262845 wait complete. 2024-05-08T18:52:31.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.952+0000 7fde41733800 1 Processor -- start 2024-05-08T18:52:31.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.952+0000 7fde41733800 1 -- start start 2024-05-08T18:52:31.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.952+0000 7fde41733800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56332402e4d0 0x5633241b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.952+0000 7fde41733800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5633240c25d0 con 0x56332402e4d0 2024-05-08T18:52:31.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.952+0000 7fde3d3f5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56332402e4d0 0x5633241b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.952+0000 7fde3d3f5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56332402e4d0 0x5633241b63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53122/0 (socket says 172.21.15.132:53122) 2024-05-08T18:52:31.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.952+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3110577555 learned_addr learned my addr 172.21.15.132:0/3110577555 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.953+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3110577555 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633241b6900 con 0x56332402e4d0 2024-05-08T18:52:31.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.953+0000 7fde3d3f5640 1 --2- 172.21.15.132:0/3110577555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56332402e4d0 0x5633241b63c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fde30006fa0 tx=0x7fde30001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.953+0000 7fdd29e03640 1 -- 172.21.15.132:0/3110577555 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde30013820 con 0x56332402e4d0 2024-05-08T18:52:31.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.953+0000 7fdd29e03640 1 -- 172.21.15.132:0/3110577555 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde30023070 con 0x56332402e4d0 2024-05-08T18:52:31.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.953+0000 7fde41733800 1 -- 172.21.15.132:0/3110577555 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5633241b6b90 con 0x56332402e4d0 2024-05-08T18:52:31.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.953+0000 7fdd29e03640 1 -- 172.21.15.132:0/3110577555 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde30013af0 con 0x56332402e4d0 2024-05-08T18:52:31.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.953+0000 7fde41733800 1 -- 172.21.15.132:0/3110577555 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633241b9840 con 0x56332402e4d0 2024-05-08T18:52:31.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.954+0000 7fdd29e03640 1 -- 172.21.15.132:0/3110577555 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fde30010070 con 0x56332402e4d0 2024-05-08T18:52:31.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.954+0000 7fdd29e03640 1 --2- 172.21.15.132:0/3110577555 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdd2403bb50 0x7fdd2403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.954+0000 7fdd29e03640 1 -- 172.21.15.132:0/3110577555 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fde30018070 con 0x56332402e4d0 2024-05-08T18:52:31.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.954+0000 7fde3cbf4640 1 --2- 172.21.15.132:0/3110577555 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdd2403bb50 0x7fdd2403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.954+0000 7fde41733800 1 --2- 172.21.15.132:0/3110577555 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5633240bf590 0x5633241bd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.954+0000 7fde41733800 1 -- 172.21.15.132:0/3110577555 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633241bdb40 con 0x5633240bf590 2024-05-08T18:52:31.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.955+0000 7fde3dbf6640 1 --2- 172.21.15.132:0/3110577555 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5633240bf590 0x5633241bd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.955+0000 7fde3cbf4640 1 --2- 172.21.15.132:0/3110577555 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdd2403bb50 0x7fdd2403e010 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fde34054000 tx=0x7fde3404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.955+0000 7fde3dbf6640 1 --2- 172.21.15.132:0/3110577555 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5633240bf590 0x5633241bd4d0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.955+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3110577555 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde380083e0 con 0x5633240bf590 2024-05-08T18:52:31.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.955+0000 7fde41733800 1 -- 172.21.15.132:0/3110577555 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633241babb0 con 0x5633240bf590 2024-05-08T18:52:31.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.955+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3110577555 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fde380083e0 con 0x5633240bf590 2024-05-08T18:52:31.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.955+0000 7fde41733800 1 --2- 172.21.15.132:0/3110577555 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5633241bfe50 0x5633241c2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.955+0000 7fde41733800 1 -- 172.21.15.132:0/3110577555 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633241c2930 con 0x5633241bfe50 2024-05-08T18:52:31.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.956+0000 7fde3d3f5640 1 --2- 172.21.15.132:0/3110577555 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5633241bfe50 0x5633241c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.956+0000 7fde3d3f5640 1 --2- 172.21.15.132:0/3110577555 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5633241bfe50 0x5633241c2240 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.956+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3110577555 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fde3001b040 con 0x5633241bfe50 2024-05-08T18:52:31.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.956+0000 7fde41733800 1 -- 172.21.15.132:0/3110577555 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633241becf0 con 0x5633240bf590 2024-05-08T18:52:31.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.956+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3110577555 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fde380083e0 con 0x5633240bf590 2024-05-08T18:52:31.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.956+0000 7fde41733800 1 -- 172.21.15.132:0/3110577555 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633241bf160 con 0x5633240bf590 2024-05-08T18:52:31.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.957+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3110577555 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fde380083e0 con 0x5633240bf590 2024-05-08T18:52:31.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.957+0000 7fde41733800 1 Processor -- start 2024-05-08T18:52:31.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.957+0000 7fde41733800 1 -- start start 2024-05-08T18:52:31.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.957+0000 7fde41733800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633241d18b0 0x5633241d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.957+0000 7fde41733800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x563323facfc0 con 0x5633241d18b0 2024-05-08T18:52:31.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.957+0000 7fde3dbf6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633241d18b0 0x5633241d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.957+0000 7fde3dbf6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633241d18b0 0x5633241d1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53136/0 (socket says 172.21.15.132:53136) 2024-05-08T18:52:31.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.957+0000 7fde3dbf6640 1 -- 172.21.15.132:0/2319151736 learned_addr learned my addr 172.21.15.132:0/2319151736 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.958+0000 7fde3dbf6640 1 -- 172.21.15.132:0/2319151736 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633241d2210 con 0x5633241d18b0 2024-05-08T18:52:31.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.958+0000 7fde3dbf6640 1 --2- 172.21.15.132:0/2319151736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633241d18b0 0x5633241d1cd0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x5633241b7290 tx=0x7fde3800af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.958+0000 7fdd22ffd640 1 -- 172.21.15.132:0/2319151736 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde38007d60 con 0x5633241d18b0 2024-05-08T18:52:31.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.958+0000 7fde41733800 1 -- 172.21.15.132:0/2319151736 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5633241d2c80 con 0x5633241d18b0 2024-05-08T18:52:31.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.958+0000 7fdd22ffd640 1 -- 172.21.15.132:0/2319151736 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde3801e020 con 0x5633241d18b0 2024-05-08T18:52:31.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.958+0000 7fde41733800 1 -- 172.21.15.132:0/2319151736 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633241d3180 con 0x5633241d18b0 2024-05-08T18:52:31.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.958+0000 7fdd22ffd640 1 -- 172.21.15.132:0/2319151736 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde38019550 con 0x5633241d18b0 2024-05-08T18:52:31.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.959+0000 7fdd22ffd640 1 -- 172.21.15.132:0/2319151736 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fde38016040 con 0x5633241d18b0 2024-05-08T18:52:31.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.959+0000 7fdd22ffd640 1 --2- 172.21.15.132:0/2319151736 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdd1403bb50 0x7fdd1403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.959+0000 7fdd22ffd640 1 -- 172.21.15.132:0/2319151736 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fde3801f030 con 0x5633241d18b0 2024-05-08T18:52:31.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.959+0000 7fde3d3f5640 1 --2- 172.21.15.132:0/2319151736 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdd1403bb50 0x7fdd1403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.960+0000 7fde41733800 1 Processor -- start 2024-05-08T18:52:31.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.960+0000 7fde41733800 1 -- start start 2024-05-08T18:52:31.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.960+0000 7fde3d3f5640 1 --2- 172.21.15.132:0/2319151736 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdd1403bb50 0x7fdd1403e010 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x5633241bdfc0 tx=0x7fde30002160 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.960+0000 7fde41733800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633241debb0 0x5633241defd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.960+0000 7fde41733800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5633240ba0b0 con 0x5633241debb0 2024-05-08T18:52:31.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.960+0000 7fde3dbf6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633241debb0 0x5633241defd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.960+0000 7fde3dbf6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633241debb0 0x5633241defd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53152/0 (socket says 172.21.15.132:53152) 2024-05-08T18:52:31.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.960+0000 7fde3dbf6640 1 -- 172.21.15.132:0/832777197 learned_addr learned my addr 172.21.15.132:0/832777197 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.960+0000 7fde3dbf6640 1 -- 172.21.15.132:0/832777197 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633241df5a0 con 0x5633241debb0 2024-05-08T18:52:31.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.961+0000 7fde3dbf6640 1 --2- 172.21.15.132:0/832777197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633241debb0 0x5633241defd0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fde38008aa0 tx=0x7fde38053270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5dd1c2a9757a1b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.961+0000 7fdd20ff9640 1 -- 172.21.15.132:0/832777197 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde3801d040 con 0x5633241debb0 2024-05-08T18:52:31.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.961+0000 7fdd20ff9640 1 -- 172.21.15.132:0/832777197 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde38019d00 con 0x5633241debb0 2024-05-08T18:52:31.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.961+0000 7fdd20ff9640 1 -- 172.21.15.132:0/832777197 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde380451f0 con 0x5633241debb0 2024-05-08T18:52:31.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.961+0000 7fde41733800 1 -- 172.21.15.132:0/832777197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633241debb0 msgr2=0x5633241defd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:31.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.961+0000 7fde41733800 1 --2- 172.21.15.132:0/832777197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633241debb0 0x5633241defd0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fde38008aa0 tx=0x7fde38053270 comp rx=0 tx=0).stop 2024-05-08T18:52:31.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.961+0000 7fde41733800 1 -- 172.21.15.132:0/832777197 shutdown_connections 2024-05-08T18:52:31.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.961+0000 7fde41733800 1 --2- 172.21.15.132:0/832777197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633241debb0 0x5633241defd0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:31.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.961+0000 7fde41733800 1 -- 172.21.15.132:0/832777197 >> 172.21.15.132:0/832777197 conn(0x5633241daf10 msgr2=0x5633241d8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:31.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.962+0000 7fde41733800 1 -- 172.21.15.132:0/832777197 shutdown_connections 2024-05-08T18:52:31.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.962+0000 7fde41733800 1 -- 172.21.15.132:0/832777197 wait complete. 2024-05-08T18:52:31.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.962+0000 7fde41733800 1 Processor -- start 2024-05-08T18:52:31.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.962+0000 7fde41733800 1 -- start start 2024-05-08T18:52:31.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.962+0000 7fde41733800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633241debb0 0x5633241e60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.962+0000 7fde41733800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5633241dfcc0 con 0x5633241debb0 2024-05-08T18:52:31.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.962+0000 7fde3dbf6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633241debb0 0x5633241e60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.962+0000 7fde3dbf6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633241debb0 0x5633241e60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53166/0 (socket says 172.21.15.132:53166) 2024-05-08T18:52:31.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.962+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 learned_addr learned my addr 172.21.15.132:0/3602161471 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:31.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.962+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633241e6630 con 0x5633241debb0 2024-05-08T18:52:31.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.963+0000 7fde3dbf6640 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633241debb0 0x5633241e60f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fde38044040 tx=0x7fde38052f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.963+0000 7fdd12ffd640 1 -- 172.21.15.132:0/3602161471 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde3801d050 con 0x5633241debb0 2024-05-08T18:52:31.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.963+0000 7fdd12ffd640 1 -- 172.21.15.132:0/3602161471 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde38032070 con 0x5633241debb0 2024-05-08T18:52:31.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.963+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5633241e68c0 con 0x5633241debb0 2024-05-08T18:52:31.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.963+0000 7fdd12ffd640 1 -- 172.21.15.132:0/3602161471 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde38015c20 con 0x5633241debb0 2024-05-08T18:52:31.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.963+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633241e9570 con 0x5633241debb0 2024-05-08T18:52:31.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.964+0000 7fdd12ffd640 1 -- 172.21.15.132:0/3602161471 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fde380223c0 con 0x5633241debb0 2024-05-08T18:52:31.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.964+0000 7fdd12ffd640 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdd0803bb00 0x7fdd0803dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.964+0000 7fdd12ffd640 1 -- 172.21.15.132:0/3602161471 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fde38038020 con 0x5633241debb0 2024-05-08T18:52:31.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.964+0000 7fde3d3f5640 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdd0803bb00 0x7fdd0803dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.964+0000 7fde3d3f5640 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdd0803bb00 0x7fdd0803dfc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fde3001d850 tx=0x7fde3001f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.965+0000 7fde41733800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.965+0000 7fde41733800 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5633241f1c80 0x5633241f4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.965+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633241f4890 con 0x5633241f1c80 2024-05-08T18:52:31.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.965+0000 7fde3cbf4640 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5633241f1c80 0x5633241f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.965+0000 7fde3cbf4640 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5633241f1c80 0x5633241f4140 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.965+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde3405a040 con 0x5633241f1c80 2024-05-08T18:52:31.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.965+0000 7fde41733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.965+0000 7fde41733800 20 realm 2024-05-08T18:52:31.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.965+0000 7fde41733800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.965+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633241f4c60 con 0x5633241f1c80 2024-05-08T18:52:31.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.965+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde3405a040 con 0x5633241f1c80 2024-05-08T18:52:31.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.965+0000 7fde41733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.965+0000 7fde41733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:52:31.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.965+0000 7fde41733800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.965+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633241f5530 con 0x5633241f1c80 2024-05-08T18:52:31.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.966+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde3405a040 con 0x5633241f1c80 2024-05-08T18:52:31.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.966+0000 7fde41733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.966+0000 7fde41733800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.966+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633241f58d0 con 0x5633241f1c80 2024-05-08T18:52:31.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.966+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fde3405a040 con 0x5633241f1c80 2024-05-08T18:52:31.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.966+0000 7fde41733800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:31.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.966+0000 7fde41733800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.966+0000 7fde41733800 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5633241f6630 0x5633241f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.966+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633241f9030 con 0x5633241f6630 2024-05-08T18:52:31.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.966+0000 7fde3dbf6640 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5633241f6630 0x5633241f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.966+0000 7fde3dbf6640 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5633241f6630 0x5633241f8a20 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.967+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fde3802a070 con 0x5633241f6630 2024-05-08T18:52:31.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.967+0000 7fde41733800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:52:31.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.967+0000 7fde41733800 20 searching for the correct realm 2024-05-08T18:52:31.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.967+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x5633241f6630 2024-05-08T18:52:31.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.967+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3802a070 con 0x5633241f6630 2024-05-08T18:52:31.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.967+0000 7fde3dbf6640 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fde38054070 0x7fde38051690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.967+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x7fde38054070 2024-05-08T18:52:31.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.967+0000 7fde3d3f5640 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fde38054070 0x7fde38051690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.967+0000 7fde3d3f5640 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fde38054070 0x7fde38051690 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.968+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3602161471 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3001b040 con 0x7fde38054070 2024-05-08T18:52:31.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.968+0000 7fde3d3f5640 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fde3004e040 0x7fde30028460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:31.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.968+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x7fde3004e040 2024-05-08T18:52:31.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.968+0000 7fde3cbf4640 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fde3004e040 0x7fde30028460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:31.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.969+0000 7fde3cbf4640 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fde3004e040 0x7fde30028460 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:31.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.969+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3405a040 con 0x7fde3004e040 2024-05-08T18:52:31.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.969+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x5633241f1c80 2024-05-08T18:52:31.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.969+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3405a040 con 0x5633241f1c80 2024-05-08T18:52:31.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.969+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x5633241f1c80 2024-05-08T18:52:31.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.969+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3405a040 con 0x5633241f1c80 2024-05-08T18:52:31.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.969+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x7fde3004e040 2024-05-08T18:52:31.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.970+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3405a040 con 0x7fde3004e040 2024-05-08T18:52:31.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.970+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x7fde3004e040 2024-05-08T18:52:31.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.970+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3405a040 con 0x7fde3004e040 2024-05-08T18:52:31.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.970+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x7fde38054070 2024-05-08T18:52:31.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.970+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3602161471 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3001b040 con 0x7fde38054070 2024-05-08T18:52:31.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.970+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x5633241f6630 2024-05-08T18:52:31.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.970+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3802a070 con 0x5633241f6630 2024-05-08T18:52:31.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.970+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x5633241f1c80 2024-05-08T18:52:31.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.971+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3405a040 con 0x5633241f1c80 2024-05-08T18:52:31.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.971+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x7fde3004e040 2024-05-08T18:52:31.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.971+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3405a040 con 0x7fde3004e040 2024-05-08T18:52:31.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.971+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x5633241f1c80 2024-05-08T18:52:31.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.971+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fde3405a040 con 0x5633241f1c80 2024-05-08T18:52:31.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.971+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x7fde38054070 2024-05-08T18:52:31.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.972+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3602161471 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fde30060040 con 0x7fde38054070 2024-05-08T18:52:31.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.972+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x5633241f6630 2024-05-08T18:52:31.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.972+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v27'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fde3802a070 con 0x5633241f6630 2024-05-08T18:52:31.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.972+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x5633241f6630 2024-05-08T18:52:31.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.972+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3802a070 con 0x5633241f6630 2024-05-08T18:52:31.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.972+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x7fde3004e040 2024-05-08T18:52:31.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.972+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3405a040 con 0x7fde3004e040 2024-05-08T18:52:31.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.973+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x5633241f6630 2024-05-08T18:52:31.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.973+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3802a070 con 0x5633241f6630 2024-05-08T18:52:31.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.973+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x5633241f6630 2024-05-08T18:52:31.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.973+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3802a070 con 0x5633241f6630 2024-05-08T18:52:31.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.973+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x5633241f1c80 2024-05-08T18:52:31.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.973+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3405a040 con 0x5633241f1c80 2024-05-08T18:52:31.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.973+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x5633241f1c80 2024-05-08T18:52:31.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.973+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v27'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fde3405a040 con 0x5633241f1c80 2024-05-08T18:52:31.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.973+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x7fde3004e040 2024-05-08T18:52:31.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.974+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3407d040 con 0x7fde3004e040 2024-05-08T18:52:31.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.974+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x5633241f6630 2024-05-08T18:52:31.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.974+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3802a070 con 0x5633241f6630 2024-05-08T18:52:31.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.974+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x7fde38054070 2024-05-08T18:52:31.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.974+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3602161471 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde30060040 con 0x7fde38054070 2024-05-08T18:52:31.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.974+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x5633241f1c80 2024-05-08T18:52:31.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.975+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3407d040 con 0x5633241f1c80 2024-05-08T18:52:31.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.975+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x7fde38054070 2024-05-08T18:52:31.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.975+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3602161471 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde30060040 con 0x7fde38054070 2024-05-08T18:52:31.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.975+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x5633241f6630 2024-05-08T18:52:31.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.975+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3802a070 con 0x5633241f6630 2024-05-08T18:52:31.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.975+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x7fde3004e040 2024-05-08T18:52:31.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.976+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3407d040 con 0x7fde3004e040 2024-05-08T18:52:31.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.976+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x7fde38054070 2024-05-08T18:52:31.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.976+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3602161471 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde30060040 con 0x7fde38054070 2024-05-08T18:52:31.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.976+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x5633241f6630 2024-05-08T18:52:31.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.976+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3802a070 con 0x5633241f6630 2024-05-08T18:52:31.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.976+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x7fde3004e040 2024-05-08T18:52:31.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.976+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3407d040 con 0x7fde3004e040 2024-05-08T18:52:31.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.976+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x5633241f1c80 2024-05-08T18:52:31.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.977+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v27'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fde3407d040 con 0x5633241f1c80 2024-05-08T18:52:31.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.977+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa940 con 0x7fde38054070 2024-05-08T18:52:31.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.977+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3602161471 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde30060040 con 0x7fde38054070 2024-05-08T18:52:31.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.977+0000 7fde41733800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:52:31.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.977+0000 7fde41733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:52:31.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.977+0000 7fde41733800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:52:31.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.977+0000 7fde41733800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:52:31.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.977+0000 7fde41733800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:52:31.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.977+0000 7fde41733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:52:31.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.977+0000 7fde41733800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.977+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633241fa510 con 0x5633241f1c80 2024-05-08T18:52:31.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.977+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x5633241f1c80 2024-05-08T18:52:31.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.977+0000 7fde41733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.977+0000 7fde41733800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.977+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633241f9d80 con 0x5633241f1c80 2024-05-08T18:52:31.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.977+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fde3407d040 con 0x5633241f1c80 2024-05-08T18:52:31.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.977+0000 7fde41733800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:31.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.977+0000 7fde41733800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.977+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633241fadc0 con 0x5633241f1c80 2024-05-08T18:52:31.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.978+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fde3407d040 con 0x5633241f1c80 2024-05-08T18:52:31.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.978+0000 7fde41733800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:52:31.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.978+0000 7fde41733800 20 zone default found 2024-05-08T18:52:31.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.978+0000 7fde41733800 4 Realm: () 2024-05-08T18:52:31.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.978+0000 7fde41733800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:52:31.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.978+0000 7fde41733800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:52:31.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.978+0000 7fde41733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:52:31.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.978+0000 7fde41733800 20 zonegroup default 2024-05-08T18:52:31.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.978+0000 7fde41733800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.978+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633241fb180 con 0x7fde38054070 2024-05-08T18:52:31.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.978+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3602161471 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fde30060040 con 0x7fde38054070 2024-05-08T18:52:31.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.978+0000 7fde41733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.978+0000 7fde41733800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.978+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633241fd450 con 0x5633241f6630 2024-05-08T18:52:31.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.978+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fde3802a070 con 0x5633241f6630 2024-05-08T18:52:31.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.978+0000 7fde41733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.978+0000 7fde41733800 20 rados->read ofs=0 len=0 2024-05-08T18:52:31.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.978+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633241fd7f0 con 0x5633241f6630 2024-05-08T18:52:31.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.978+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fde3802a070 con 0x5633241f6630 2024-05-08T18:52:31.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.978+0000 7fde41733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:31.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.978+0000 7fde41733800 20 started sync module instance, tier type = 2024-05-08T18:52:31.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.979+0000 7fde41733800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:52:31.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.979+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5633241fc890 con 0x7fde38054070 2024-05-08T18:52:31.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.980+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3602161471 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde30060040 con 0x7fde38054070 2024-05-08T18:52:31.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.980+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94777649382368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5633241fdc00 con 0x7fde38054070 2024-05-08T18:52:31.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.980+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5633241fe450 con 0x5633241f1c80 2024-05-08T18:52:31.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.981+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x5633241f1c80 2024-05-08T18:52:31.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.981+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94777649391600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5633241ff0c0 con 0x5633241f1c80 2024-05-08T18:52:31.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.981+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5633241ff970 con 0x5633241f6630 2024-05-08T18:52:31.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.982+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3602161471 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94777649382368] v27'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde30060040 con 0x7fde38054070 2024-05-08T18:52:31.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.982+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94777649391600] v27'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x5633241f1c80 2024-05-08T18:52:31.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.983+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3802a070 con 0x5633241f6630 2024-05-08T18:52:31.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.983+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94777649384576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5633241ff0c0 con 0x5633241f6630 2024-05-08T18:52:31.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.983+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563324200210 con 0x7fde38054070 2024-05-08T18:52:31.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.984+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3602161471 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde30060040 con 0x7fde38054070 2024-05-08T18:52:31.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.984+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94777649397088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563324200a60 con 0x7fde38054070 2024-05-08T18:52:31.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.984+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5633242012b0 con 0x5633241f1c80 2024-05-08T18:52:31.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.984+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94777649384576] v27'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3802a070 con 0x5633241f6630 2024-05-08T18:52:31.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.985+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3602161471 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94777649397088] v27'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde30060040 con 0x7fde38054070 2024-05-08T18:52:31.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.985+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x5633241f1c80 2024-05-08T18:52:31.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.985+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94777649399216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563324200e80 con 0x5633241f1c80 2024-05-08T18:52:31.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.985+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563324201840 con 0x7fde3004e040 2024-05-08T18:52:31.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.986+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94777649399216] v27'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x5633241f1c80 2024-05-08T18:52:31.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.986+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x7fde3004e040 2024-05-08T18:52:31.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.986+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94777649400576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563324201840 con 0x7fde3004e040 2024-05-08T18:52:31.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.986+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563324202200 con 0x7fde3004e040 2024-05-08T18:52:31.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.987+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(56 notify.6 [create] v27'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x7fde3004e040 2024-05-08T18:52:31.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.987+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94777649405264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563324202620 con 0x7fde3004e040 2024-05-08T18:52:31.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.987+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5633242030c0 con 0x7fde3004e040 2024-05-08T18:52:31.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.987+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94777649400576] v27'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x7fde3004e040 2024-05-08T18:52:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.988+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94777649405264] v27'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x7fde3004e040 2024-05-08T18:52:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.988+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x7fde3004e040 2024-05-08T18:52:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.989+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94777649408944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563324202170 con 0x7fde3004e040 2024-05-08T18:52:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.989+0000 7fde41733800 20 add_watcher() i=0 2024-05-08T18:52:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.989+0000 7fde41733800 20 add_watcher() i=1 2024-05-08T18:52:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.989+0000 7fde41733800 20 add_watcher() i=2 2024-05-08T18:52:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.989+0000 7fde41733800 20 add_watcher() i=3 2024-05-08T18:52:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.989+0000 7fde41733800 20 add_watcher() i=4 2024-05-08T18:52:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.989+0000 7fde41733800 20 add_watcher() i=5 2024-05-08T18:52:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.989+0000 7fde41733800 20 add_watcher() i=6 2024-05-08T18:52:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.989+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94777649408944] v27'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x7fde3004e040 2024-05-08T18:52:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.990+0000 7fde41733800 20 add_watcher() i=7 2024-05-08T18:52:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.990+0000 7fde41733800 2 all 8 watchers are set, enabling cache 2024-05-08T18:52:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.990+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5633242060b0 con 0x5633241f1c80 2024-05-08T18:52:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.990+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fde3407d040 con 0x5633241f1c80 2024-05-08T18:52:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.990+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94777649402768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563324203560 con 0x5633241f1c80 2024-05-08T18:52:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.991+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94777649402768] v27'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x5633241f1c80 2024-05-08T18:52:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.991+0000 7fdcf37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.991+0000 7fde41733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.991+0000 7fde41733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.991+0000 7fde41733800 5 note: GC not initialized 2024-05-08T18:52:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.991+0000 7fdcf27e4640 20 reqs_thread_entry: start 2024-05-08T18:52:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.991+0000 7fde41733800 20 init_complete bucket index max shards: 11 2024-05-08T18:52:32.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.991+0000 7fde41733800 20 Filter name: none 2024-05-08T18:52:32.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.992+0000 7fdc63fff640 20 reqs_thread_entry: start 2024-05-08T18:52:32.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.992+0000 7fde41733800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:52:32.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.992+0000 7fde41733800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.992+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563324239500 con 0x7fde3004e040 2024-05-08T18:52:32.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.992+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x7fde3004e040 2024-05-08T18:52:32.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.992+0000 7fde41733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.992+0000 7fde41733800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-05-08T18:52:32.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.992+0000 7fde41733800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:32.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.992+0000 7fde41733800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-05-08T18:52:32.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.992+0000 7fde41733800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.992+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563324237ca0 con 0x5633241f1c80 2024-05-08T18:52:32.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.992+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x5633241f1c80 2024-05-08T18:52:32.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.992+0000 7fde41733800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.992+0000 7fde41733800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-05-08T18:52:32.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.992+0000 7fde41733800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-05-08T18:52:32.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.992+0000 7fde41733800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-05-08T18:52:32.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.992+0000 7fde41733800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-05-08T18:52:32.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.993+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5633242385b0 con 0x7fde3004e040 2024-05-08T18:52:32.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.994+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v27'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x7fde3004e040 2024-05-08T18:52:32.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.994+0000 7fde41733800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:52:32.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.994+0000 7fde41733800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:32.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.994+0000 7fde41733800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:52:32.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.994+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94777649627280 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56332423ce40 con 0x5633241f1c80 2024-05-08T18:52:32.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.994+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== watch-notify(notify (1) cookie 94777649399216 notify 115964117011 ret 0) ==== 691+0+0 (crc 0 0 0) 0x563324238950 con 0x5633241f1c80 2024-05-08T18:52:32.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.994+0000 7fdd20ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117011 cookie 94777649399216 notifier 4823 bl.length()=649 2024-05-08T18:52:32.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.994+0000 7fdd20ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:52:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.994+0000 7fdd20ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.994+0000 7fdd20ff9640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fdd00003ea0 con 0x5633241f1c80 2024-05-08T18:52:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.994+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 notify.4 [notify cookie 94777649627280 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fde3407d040 con 0x5633241f1c80 2024-05-08T18:52:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.994+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x5633241f1c80 2024-05-08T18:52:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.994+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== watch-notify(notify_complete (2) cookie 94777649627280 notify 115964117011 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563324239020 con 0x5633241f1c80 2024-05-08T18:52:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.995+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563324238040 con 0x5633241f1c80 2024-05-08T18:52:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.996+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v27'24 uv24 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x5633241f1c80 2024-05-08T18:52:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.996+0000 7fde41733800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-05-08T18:52:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.996+0000 7fde41733800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-05-08T18:52:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.996+0000 7fde41733800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-05-08T18:52:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.996+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94777649627200 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56332423d250 con 0x5633241f6630 2024-05-08T18:52:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.996+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== watch-notify(notify (1) cookie 94777649384576 notify 115964117002 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5633241e68c0 con 0x5633241f6630 2024-05-08T18:52:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.996+0000 7fdd13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117002 cookie 94777649384576 notifier 4823 bl.length()=177 2024-05-08T18:52:32.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.996+0000 7fdd13fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-05-08T18:52:32.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.996+0000 7fdd13fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-05-08T18:52:32.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.996+0000 7fdd13fff640 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fdc70003400 con 0x5633241f6630 2024-05-08T18:52:32.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.996+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(68 notify.2 [notify cookie 94777649627200 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fde3802a070 con 0x5633241f6630 2024-05-08T18:52:32.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.996+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3802a070 con 0x5633241f6630 2024-05-08T18:52:32.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.996+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== watch-notify(notify_complete (2) cookie 94777649627200 notify 115964117002 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5633241e6630 con 0x5633241f6630 2024-05-08T18:52:32.005 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:52:31.994053Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:52:31.994040Z","tags":[],"group_ids":[]} 2024-05-08T18:52:32.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.997+0000 7fdcf37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:32.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.997+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94777649402768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56332423a8d0 con 0x5633241f1c80 2024-05-08T18:52:32.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.998+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94777649402768] v27'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x5633241f1c80 2024-05-08T18:52:32.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.998+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94777649382368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563324201390 con 0x7fde38054070 2024-05-08T18:52:32.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.999+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3602161471 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94777649382368] v27'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde30060040 con 0x7fde38054070 2024-05-08T18:52:32.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.999+0000 7fde41733800 20 remove_watcher() i=0 2024-05-08T18:52:32.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.999+0000 7fde41733800 2 removed watcher, disabling cache 2024-05-08T18:52:32.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:31.999+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94777649391600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563324201390 con 0x5633241f1c80 2024-05-08T18:52:32.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.000+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94777649391600] v27'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x5633241f1c80 2024-05-08T18:52:32.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.000+0000 7fde41733800 20 remove_watcher() i=1 2024-05-08T18:52:32.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.000+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94777649384576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5633241fe7f0 con 0x5633241f6630 2024-05-08T18:52:32.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.001+0000 7fde3dbf6640 1 -- 172.21.15.132:0/3602161471 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94777649384576] v27'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3802a070 con 0x5633241f6630 2024-05-08T18:52:32.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.001+0000 7fde41733800 20 remove_watcher() i=2 2024-05-08T18:52:32.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.001+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94777649397088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563324201390 con 0x7fde38054070 2024-05-08T18:52:32.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.002+0000 7fde3d3f5640 1 -- 172.21.15.132:0/3602161471 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94777649397088] v27'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde30060040 con 0x7fde38054070 2024-05-08T18:52:32.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.002+0000 7fde41733800 20 remove_watcher() i=3 2024-05-08T18:52:32.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.002+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94777649399216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5633241fcc80 con 0x5633241f1c80 2024-05-08T18:52:32.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.003+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94777649399216] v27'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x5633241f1c80 2024-05-08T18:52:32.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.003+0000 7fde41733800 20 remove_watcher() i=4 2024-05-08T18:52:32.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.004+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94777649400576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5633241fe7f0 con 0x7fde3004e040 2024-05-08T18:52:32.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.005+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94777649400576] v27'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x7fde3004e040 2024-05-08T18:52:32.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.005+0000 7fde41733800 20 remove_watcher() i=5 2024-05-08T18:52:32.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.005+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94777649405264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5633241ffd60 con 0x7fde3004e040 2024-05-08T18:52:32.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.006+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94777649405264] v27'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x7fde3004e040 2024-05-08T18:52:32.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.006+0000 7fde41733800 20 remove_watcher() i=6 2024-05-08T18:52:32.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.006+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94777649408944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563324201390 con 0x7fde3004e040 2024-05-08T18:52:32.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.007+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94777649408944] v27'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3407d040 con 0x7fde3004e040 2024-05-08T18:52:32.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.007+0000 7fde41733800 20 remove_watcher() i=7 2024-05-08T18:52:32.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.007+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fde3004e040 msgr2=0x7fde30028460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.007+0000 7fde41733800 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fde3004e040 0x7fde30028460 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.007+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5633241f1c80 msgr2=0x5633241f4140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.007+0000 7fde41733800 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5633241f1c80 0x5633241f4140 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.007+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fde38054070 msgr2=0x7fde38051690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.007+0000 7fde41733800 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fde38054070 0x7fde38051690 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.007+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5633241f6630 msgr2=0x5633241f8a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.007+0000 7fde41733800 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5633241f6630 0x5633241f8a20 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.007+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdd0803bb00 msgr2=0x7fdd0803dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.007+0000 7fde41733800 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdd0803bb00 0x7fdd0803dfc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fde3001d850 tx=0x7fde3001f000 comp rx=0 tx=0).stop 2024-05-08T18:52:32.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.007+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633241debb0 msgr2=0x5633241e60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.007+0000 7fde41733800 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633241debb0 0x5633241e60f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fde38044040 tx=0x7fde38052f30 comp rx=0 tx=0).stop 2024-05-08T18:52:32.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.007+0000 7fde3cbf4640 1 -- 172.21.15.132:0/3602161471 reap_dead start 2024-05-08T18:52:32.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.007+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 shutdown_connections 2024-05-08T18:52:32.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.007+0000 7fde41733800 1 --2- 172.21.15.132:0/3602161471 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633241debb0 0x5633241e60f0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.007+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 >> 172.21.15.132:0/3602161471 conn(0x5633241daf10 msgr2=0x5633241d8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 shutdown_connections 2024-05-08T18:52:32.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 -- 172.21.15.132:0/3602161471 wait complete. 2024-05-08T18:52:32.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 -- 172.21.15.132:0/2319151736 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdd1403bb50 msgr2=0x7fdd1403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 --2- 172.21.15.132:0/2319151736 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdd1403bb50 0x7fdd1403e010 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x5633241bdfc0 tx=0x7fde30002160 comp rx=0 tx=0).stop 2024-05-08T18:52:32.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 -- 172.21.15.132:0/2319151736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633241d18b0 msgr2=0x5633241d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 --2- 172.21.15.132:0/2319151736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633241d18b0 0x5633241d1cd0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x5633241b7290 tx=0x7fde3800af70 comp rx=0 tx=0).stop 2024-05-08T18:52:32.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 -- 172.21.15.132:0/2319151736 shutdown_connections 2024-05-08T18:52:32.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 --2- 172.21.15.132:0/2319151736 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdd1403bb50 0x7fdd1403e010 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 --2- 172.21.15.132:0/2319151736 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5633241d18b0 0x5633241d1cd0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 -- 172.21.15.132:0/2319151736 >> 172.21.15.132:0/2319151736 conn(0x5633241c5950 msgr2=0x5633241c5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 -- 172.21.15.132:0/2319151736 shutdown_connections 2024-05-08T18:52:32.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 -- 172.21.15.132:0/2319151736 wait complete. 2024-05-08T18:52:32.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 -- 172.21.15.132:0/3110577555 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5633240bf590 msgr2=0x5633241bd4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 --2- 172.21.15.132:0/3110577555 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5633240bf590 0x5633241bd4d0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 -- 172.21.15.132:0/3110577555 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5633241bfe50 msgr2=0x5633241c2240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 --2- 172.21.15.132:0/3110577555 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5633241bfe50 0x5633241c2240 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 -- 172.21.15.132:0/3110577555 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdd2403bb50 msgr2=0x7fdd2403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 --2- 172.21.15.132:0/3110577555 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdd2403bb50 0x7fdd2403e010 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fde34054000 tx=0x7fde3404e000 comp rx=0 tx=0).stop 2024-05-08T18:52:32.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 -- 172.21.15.132:0/3110577555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56332402e4d0 msgr2=0x5633241b63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 --2- 172.21.15.132:0/3110577555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56332402e4d0 0x5633241b63c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fde30006fa0 tx=0x7fde30001250 comp rx=0 tx=0).stop 2024-05-08T18:52:32.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 -- 172.21.15.132:0/3110577555 shutdown_connections 2024-05-08T18:52:32.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 --2- 172.21.15.132:0/3110577555 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5633241bfe50 0x5633241c2240 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 --2- 172.21.15.132:0/3110577555 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5633240bf590 0x5633241bd4d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 --2- 172.21.15.132:0/3110577555 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdd2403bb50 0x7fdd2403e010 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 --2- 172.21.15.132:0/3110577555 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56332402e4d0 0x5633241b63c0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 -- 172.21.15.132:0/3110577555 >> 172.21.15.132:0/3110577555 conn(0x5633240b5760 msgr2=0x5633240ba610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 -- 172.21.15.132:0/3110577555 shutdown_connections 2024-05-08T18:52:32.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.008+0000 7fde41733800 1 -- 172.21.15.132:0/3110577555 wait complete. 2024-05-08T18:52:32.017 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:52:31.994053Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:31.994040Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:32.017 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:52:31.994053Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:31.994040Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:32.017 ERROR:root:0 2024-05-08T18:52:32.018 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:52:32.024 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000004a8e4aaa5d5827db-00663bc9f0-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:52:32.024 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-05-08T18:52:32.035 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:52:32.035 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-05-08T18:52:32.047 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-05-08T18:52:32.048 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-05-08T18:52:32.062 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-05-08T18:52:32.063 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-05-08T18:52:32.071 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-05-08T18:52:32.071 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:52:32.074 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:52:32.075 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-05-08T18:52:32.078 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:52:32.079 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:52:32.079 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:52:32.079 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-05-08T18:52:32.125 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:32.125 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:32.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.126+0000 7f6c3c83d800 1 Processor -- start 2024-05-08T18:52:32.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.126+0000 7f6c3c83d800 1 -- start start 2024-05-08T18:52:32.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.127+0000 7f6c3c83d800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55acdcdbe6b0 0x55acdcdc0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.127+0000 7f6c3c83d800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55acdcdc1070 con 0x55acdcdba2c0 2024-05-08T18:52:32.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.127+0000 7f6c3c83d800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55acdcc5ae20 con 0x55acdcdbe6b0 2024-05-08T18:52:32.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.127+0000 7f6c39b34640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55acdcdbe6b0 0x55acdcdc0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.127+0000 7f6c39b34640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55acdcdbe6b0 0x55acdcdc0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53174/0 (socket says 172.21.15.132:53174) 2024-05-08T18:52:32.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.127+0000 7f6c3a335640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55acdcdba2c0 0x55acdcdba6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48122/0 (socket says 172.21.15.132:48122) 2024-05-08T18:52:32.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.127+0000 7f6c39b34640 1 -- 172.21.15.132:0/2938054711 learned_addr learned my addr 172.21.15.132:0/2938054711 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.127+0000 7f6c39b34640 1 -- 172.21.15.132:0/2938054711 >> v1:172.21.15.42:6789/0 conn(0x55acdcdba2c0 legacy=0x55acdcdba6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.127+0000 7f6c39b34640 1 -- 172.21.15.132:0/2938054711 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acdcdc22a0 con 0x55acdcdbe6b0 2024-05-08T18:52:32.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.129+0000 7f6c39b34640 1 --2- 172.21.15.132:0/2938054711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdcdbe6b0 0x55acdcdc0aa0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000a520 tx=0x7f6c3001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5e2341294428fe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.129+0000 7f6c39333640 1 -- 172.21.15.132:0/2938054711 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c30057070 con 0x55acdcdbe6b0 2024-05-08T18:52:32.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.129+0000 7f6c39333640 1 -- 172.21.15.132:0/2938054711 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c30052570 con 0x55acdcdbe6b0 2024-05-08T18:52:32.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.129+0000 7f6c39333640 1 -- 172.21.15.132:0/2938054711 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c3004ae60 con 0x55acdcdbe6b0 2024-05-08T18:52:32.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.130+0000 7f6c3c83d800 1 -- 172.21.15.132:0/2938054711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdcdbe6b0 msgr2=0x55acdcdc0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.130+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/2938054711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdcdbe6b0 0x55acdcdc0aa0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000a520 tx=0x7f6c3001d010 comp rx=0 tx=0).stop 2024-05-08T18:52:32.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.130+0000 7f6c3c83d800 1 -- 172.21.15.132:0/2938054711 shutdown_connections 2024-05-08T18:52:32.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.130+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/2938054711 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdcdbe6b0 0x55acdcdc0aa0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.130+0000 7f6c3c83d800 1 -- 172.21.15.132:0/2938054711 >> 172.21.15.132:0/2938054711 conn(0x55acdcdb5840 msgr2=0x55acdcdb7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.130+0000 7f6c3c83d800 1 -- 172.21.15.132:0/2938054711 shutdown_connections 2024-05-08T18:52:32.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.130+0000 7f6c3c83d800 1 -- 172.21.15.132:0/2938054711 wait complete. 2024-05-08T18:52:32.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.144+0000 7f6c3c83d800 1 Processor -- start 2024-05-08T18:52:32.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.144+0000 7f6c3c83d800 1 -- start start 2024-05-08T18:52:32.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.144+0000 7f6c3c83d800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdcdba2c0 0x55acdcd2fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.144+0000 7f6c3c83d800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55acdcd055c0 con 0x55acdcdba2c0 2024-05-08T18:52:32.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.144+0000 7f6c3a335640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdcdba2c0 0x55acdcd2fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.144+0000 7f6c3a335640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdcdba2c0 0x55acdcd2fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53186/0 (socket says 172.21.15.132:53186) 2024-05-08T18:52:32.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.144+0000 7f6c3a335640 1 -- 172.21.15.132:0/34163394 learned_addr learned my addr 172.21.15.132:0/34163394 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.145+0000 7f6c3a335640 1 -- 172.21.15.132:0/34163394 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acdcd2e240 con 0x55acdcdba2c0 2024-05-08T18:52:32.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.145+0000 7f6c3a335640 1 --2- 172.21.15.132:0/34163394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdcdba2c0 0x55acdcd2fc80 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c00b230 tx=0x7f6c2c00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b22a733339523e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.145+0000 7f6b28608640 1 -- 172.21.15.132:0/34163394 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c2c00e5c0 con 0x55acdcdba2c0 2024-05-08T18:52:32.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.145+0000 7f6b28608640 1 -- 172.21.15.132:0/34163394 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c2c006070 con 0x55acdcdba2c0 2024-05-08T18:52:32.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.145+0000 7f6b28608640 1 -- 172.21.15.132:0/34163394 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c2c00e890 con 0x55acdcdba2c0 2024-05-08T18:52:32.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.146+0000 7f6c3c83d800 1 -- 172.21.15.132:0/34163394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdcdba2c0 msgr2=0x55acdcd2fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.146+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/34163394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdcdba2c0 0x55acdcd2fc80 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c00b230 tx=0x7f6c2c00b6f0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.146+0000 7f6c3c83d800 1 -- 172.21.15.132:0/34163394 shutdown_connections 2024-05-08T18:52:32.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.146+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/34163394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdcdba2c0 0x55acdcd2fc80 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.146+0000 7f6c3c83d800 1 -- 172.21.15.132:0/34163394 >> 172.21.15.132:0/34163394 conn(0x55acdcdb5840 msgr2=0x55acdcea6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.146+0000 7f6c3c83d800 1 -- 172.21.15.132:0/34163394 shutdown_connections 2024-05-08T18:52:32.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.146+0000 7f6c3c83d800 1 -- 172.21.15.132:0/34163394 wait complete. 2024-05-08T18:52:32.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.146+0000 7f6c3c83d800 1 Processor -- start 2024-05-08T18:52:32.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.146+0000 7f6c3c83d800 1 -- start start 2024-05-08T18:52:32.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.146+0000 7f6c3c83d800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdcdba2c0 0x55acdceb5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.146+0000 7f6c3c83d800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55acdcdc1540 con 0x55acdcdba2c0 2024-05-08T18:52:32.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.146+0000 7f6c3a335640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdcdba2c0 0x55acdceb5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.146+0000 7f6c3a335640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdcdba2c0 0x55acdceb5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53202/0 (socket says 172.21.15.132:53202) 2024-05-08T18:52:32.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.146+0000 7f6c3a335640 1 -- 172.21.15.132:0/3810908693 learned_addr learned my addr 172.21.15.132:0/3810908693 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.147+0000 7f6c3a335640 1 -- 172.21.15.132:0/3810908693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acdceb59c0 con 0x55acdcdba2c0 2024-05-08T18:52:32.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.147+0000 7f6c3a335640 1 --2- 172.21.15.132:0/3810908693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdcdba2c0 0x55acdceb5480 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c000c00 tx=0x7f6c2c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.147+0000 7f6b26e05640 1 -- 172.21.15.132:0/3810908693 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c2c00f8d0 con 0x55acdcdba2c0 2024-05-08T18:52:32.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.147+0000 7f6b26e05640 1 -- 172.21.15.132:0/3810908693 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c2c00fa90 con 0x55acdcdba2c0 2024-05-08T18:52:32.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.147+0000 7f6c3c83d800 1 -- 172.21.15.132:0/3810908693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acdceb5c50 con 0x55acdcdba2c0 2024-05-08T18:52:32.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.147+0000 7f6b26e05640 1 -- 172.21.15.132:0/3810908693 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c2c00fdb0 con 0x55acdcdba2c0 2024-05-08T18:52:32.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.147+0000 7f6c3c83d800 1 -- 172.21.15.132:0/3810908693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acdceb88b0 con 0x55acdcdba2c0 2024-05-08T18:52:32.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.148+0000 7f6b26e05640 1 -- 172.21.15.132:0/3810908693 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6c2c017070 con 0x55acdcdba2c0 2024-05-08T18:52:32.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.148+0000 7f6b26e05640 1 --2- 172.21.15.132:0/3810908693 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6b2003bb50 0x7f6b2003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.148+0000 7f6b26e05640 1 -- 172.21.15.132:0/3810908693 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f6c2c015020 con 0x55acdcdba2c0 2024-05-08T18:52:32.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.148+0000 7f6c39b34640 1 --2- 172.21.15.132:0/3810908693 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6b2003bb50 0x7f6b2003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.148+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/3810908693 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55acdcdbe6b0 0x55acdcebc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.148+0000 7f6c3c83d800 1 -- 172.21.15.132:0/3810908693 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acdcebcbf0 con 0x55acdcdbe6b0 2024-05-08T18:52:32.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.148+0000 7f6c3ab36640 1 --2- 172.21.15.132:0/3810908693 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55acdcdbe6b0 0x55acdcebc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.149+0000 7f6c39b34640 1 --2- 172.21.15.132:0/3810908693 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6b2003bb50 0x7f6b2003e010 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6c30054000 tx=0x7f6c3004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.149+0000 7f6c3ab36640 1 --2- 172.21.15.132:0/3810908693 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55acdcdbe6b0 0x55acdcebc670 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.149+0000 7f6c3ab36640 1 -- 172.21.15.132:0/3810908693 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c3400a4a0 con 0x55acdcdbe6b0 2024-05-08T18:52:32.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.149+0000 7f6c3c83d800 1 -- 172.21.15.132:0/3810908693 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acdceb9c40 con 0x55acdcdbe6b0 2024-05-08T18:52:32.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.149+0000 7f6c3ab36640 1 -- 172.21.15.132:0/3810908693 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c3400a4a0 con 0x55acdcdbe6b0 2024-05-08T18:52:32.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.149+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/3810908693 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55acdcebef20 0x55acdcec1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.149+0000 7f6c3c83d800 1 -- 172.21.15.132:0/3810908693 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acdcec1a00 con 0x55acdcebef20 2024-05-08T18:52:32.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.149+0000 7f6c3a335640 1 --2- 172.21.15.132:0/3810908693 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55acdcebef20 0x55acdcec1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.150+0000 7f6c3a335640 1 --2- 172.21.15.132:0/3810908693 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55acdcebef20 0x55acdcec1310 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.150+0000 7f6c3a335640 1 -- 172.21.15.132:0/3810908693 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6c2c02e070 con 0x55acdcebef20 2024-05-08T18:52:32.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.150+0000 7f6c3c83d800 1 -- 172.21.15.132:0/3810908693 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acdcebdd90 con 0x55acdcdbe6b0 2024-05-08T18:52:32.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.150+0000 7f6c3ab36640 1 -- 172.21.15.132:0/3810908693 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c3400a4a0 con 0x55acdcdbe6b0 2024-05-08T18:52:32.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.150+0000 7f6c3c83d800 1 -- 172.21.15.132:0/3810908693 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acdcebe270 con 0x55acdcdbe6b0 2024-05-08T18:52:32.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.150+0000 7f6c3ab36640 1 -- 172.21.15.132:0/3810908693 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6c3400a4a0 con 0x55acdcdbe6b0 2024-05-08T18:52:32.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.151+0000 7f6c3c83d800 1 Processor -- start 2024-05-08T18:52:32.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.151+0000 7f6c3c83d800 1 -- start start 2024-05-08T18:52:32.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.151+0000 7f6c3c83d800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdced0910 0x55acdced0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.151+0000 7f6c3c83d800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55acdccabfc0 con 0x55acdced0910 2024-05-08T18:52:32.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.151+0000 7f6c3ab36640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdced0910 0x55acdced0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.151+0000 7f6c3ab36640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdced0910 0x55acdced0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53208/0 (socket says 172.21.15.132:53208) 2024-05-08T18:52:32.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.151+0000 7f6c3ab36640 1 -- 172.21.15.132:0/1638216712 learned_addr learned my addr 172.21.15.132:0/1638216712 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.152+0000 7f6c3ab36640 1 -- 172.21.15.132:0/1638216712 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acdced1270 con 0x55acdced0910 2024-05-08T18:52:32.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.152+0000 7f6c3ab36640 1 --2- 172.21.15.132:0/1638216712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdced0910 0x55acdced0d30 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x55acdcebcfd0 tx=0x7f6c34018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.152+0000 7f6b1ffff640 1 -- 172.21.15.132:0/1638216712 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c34014450 con 0x55acdced0910 2024-05-08T18:52:32.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.152+0000 7f6b1ffff640 1 -- 172.21.15.132:0/1638216712 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c34014610 con 0x55acdced0910 2024-05-08T18:52:32.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.152+0000 7f6c3c83d800 1 -- 172.21.15.132:0/1638216712 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acdced1ce0 con 0x55acdced0910 2024-05-08T18:52:32.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.152+0000 7f6b1ffff640 1 -- 172.21.15.132:0/1638216712 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c34014930 con 0x55acdced0910 2024-05-08T18:52:32.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.152+0000 7f6c3c83d800 1 -- 172.21.15.132:0/1638216712 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acdced21e0 con 0x55acdced0910 2024-05-08T18:52:32.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.153+0000 7f6b1ffff640 1 -- 172.21.15.132:0/1638216712 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6c34011040 con 0x55acdced0910 2024-05-08T18:52:32.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.153+0000 7f6b1ffff640 1 --2- 172.21.15.132:0/1638216712 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6b1403bb50 0x7f6b1403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.153+0000 7f6b1ffff640 1 -- 172.21.15.132:0/1638216712 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f6c3401e070 con 0x55acdced0910 2024-05-08T18:52:32.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.153+0000 7f6c3a335640 1 --2- 172.21.15.132:0/1638216712 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6b1403bb50 0x7f6b1403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.154+0000 7f6c3c83d800 1 Processor -- start 2024-05-08T18:52:32.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.154+0000 7f6c3a335640 1 --2- 172.21.15.132:0/1638216712 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6b1403bb50 0x7f6b1403e010 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c051950 tx=0x7f6c2c001540 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.154+0000 7f6c3c83d800 1 -- start start 2024-05-08T18:52:32.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.154+0000 7f6c3c83d800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdceddbf0 0x55acdcede010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.154+0000 7f6c3c83d800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55acdcd2e5c0 con 0x55acdceddbf0 2024-05-08T18:52:32.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.154+0000 7f6c3ab36640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdceddbf0 0x55acdcede010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.154+0000 7f6c3ab36640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdceddbf0 0x55acdcede010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53222/0 (socket says 172.21.15.132:53222) 2024-05-08T18:52:32.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.154+0000 7f6c3ab36640 1 -- 172.21.15.132:0/2066772673 learned_addr learned my addr 172.21.15.132:0/2066772673 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.154+0000 7f6c3ab36640 1 -- 172.21.15.132:0/2066772673 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acdcede5e0 con 0x55acdceddbf0 2024-05-08T18:52:32.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.155+0000 7f6c3ab36640 1 --2- 172.21.15.132:0/2066772673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdceddbf0 0x55acdcede010 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f6c34052cd0 tx=0x7f6c3402b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f5c25d53831d53 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.155+0000 7f6b1dffb640 1 -- 172.21.15.132:0/2066772673 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c34028070 con 0x55acdceddbf0 2024-05-08T18:52:32.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.155+0000 7f6b1dffb640 1 -- 172.21.15.132:0/2066772673 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c34016440 con 0x55acdceddbf0 2024-05-08T18:52:32.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.155+0000 7f6b1dffb640 1 -- 172.21.15.132:0/2066772673 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c34011a80 con 0x55acdceddbf0 2024-05-08T18:52:32.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.155+0000 7f6c3c83d800 1 -- 172.21.15.132:0/2066772673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdceddbf0 msgr2=0x55acdcede010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.155+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/2066772673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdceddbf0 0x55acdcede010 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f6c34052cd0 tx=0x7f6c3402b720 comp rx=0 tx=0).stop 2024-05-08T18:52:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.155+0000 7f6c3c83d800 1 -- 172.21.15.132:0/2066772673 shutdown_connections 2024-05-08T18:52:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.155+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/2066772673 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdceddbf0 0x55acdcede010 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.155+0000 7f6c3c83d800 1 -- 172.21.15.132:0/2066772673 >> 172.21.15.132:0/2066772673 conn(0x55acdced9f00 msgr2=0x55acdced7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.155+0000 7f6c3c83d800 1 -- 172.21.15.132:0/2066772673 shutdown_connections 2024-05-08T18:52:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.155+0000 7f6c3c83d800 1 -- 172.21.15.132:0/2066772673 wait complete. 2024-05-08T18:52:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.155+0000 7f6c3c83d800 1 Processor -- start 2024-05-08T18:52:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.156+0000 7f6c3c83d800 1 -- start start 2024-05-08T18:52:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.156+0000 7f6c3c83d800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdceddbf0 0x55acdcee5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.156+0000 7f6c3c83d800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55acdcededb0 con 0x55acdceddbf0 2024-05-08T18:52:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.156+0000 7f6c3ab36640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdceddbf0 0x55acdcee5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.156+0000 7f6c3ab36640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdceddbf0 0x55acdcee5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53236/0 (socket says 172.21.15.132:53236) 2024-05-08T18:52:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.156+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 learned_addr learned my addr 172.21.15.132:0/235758064 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.156+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acdcee5660 con 0x55acdceddbf0 2024-05-08T18:52:32.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.156+0000 7f6c3ab36640 1 --2- 172.21.15.132:0/235758064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdceddbf0 0x55acdcee5120 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6c340018a0 tx=0x7f6c34052c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.156+0000 7f6b0bfff640 1 -- 172.21.15.132:0/235758064 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c34001910 con 0x55acdceddbf0 2024-05-08T18:52:32.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.156+0000 7f6b0bfff640 1 -- 172.21.15.132:0/235758064 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c34032020 con 0x55acdceddbf0 2024-05-08T18:52:32.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.156+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acdcee58f0 con 0x55acdceddbf0 2024-05-08T18:52:32.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.156+0000 7f6b0bfff640 1 -- 172.21.15.132:0/235758064 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c34014e20 con 0x55acdceddbf0 2024-05-08T18:52:32.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.157+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acdcee85a0 con 0x55acdceddbf0 2024-05-08T18:52:32.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.157+0000 7f6b0bfff640 1 -- 172.21.15.132:0/235758064 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6c34054100 con 0x55acdceddbf0 2024-05-08T18:52:32.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.158+0000 7f6b0bfff640 1 --2- 172.21.15.132:0/235758064 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6b0403bb00 0x7f6b0403dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.158+0000 7f6b0bfff640 1 -- 172.21.15.132:0/235758064 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f6c34033030 con 0x55acdceddbf0 2024-05-08T18:52:32.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.158+0000 7f6c3a335640 1 --2- 172.21.15.132:0/235758064 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6b0403bb00 0x7f6b0403dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.158+0000 7f6c3a335640 1 --2- 172.21.15.132:0/235758064 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6b0403bb00 0x7f6b0403dfc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c019fb0 tx=0x7f6c2c04a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.158+0000 7f6c3c83d800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.158+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/235758064 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55acdcef0c60 0x55acdcef3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.158+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef3870 con 0x55acdcef0c60 2024-05-08T18:52:32.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.158+0000 7f6c39b34640 1 --2- 172.21.15.132:0/235758064 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55acdcef0c60 0x55acdcef3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.159+0000 7f6c39b34640 1 --2- 172.21.15.132:0/235758064 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55acdcef0c60 0x55acdcef3120 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.159+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.159+0000 7f6c3c83d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.159+0000 7f6c3c83d800 20 realm 2024-05-08T18:52:32.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.159+0000 7f6c3c83d800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.159+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef3c40 con 0x55acdcef0c60 2024-05-08T18:52:32.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.159+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.159+0000 7f6c3c83d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.159+0000 7f6c3c83d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:52:32.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.159+0000 7f6c3c83d800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.159+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef4510 con 0x55acdcef0c60 2024-05-08T18:52:32.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.159+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.159+0000 7f6c3c83d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.159+0000 7f6c3c83d800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.159+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef48b0 con 0x55acdcef0c60 2024-05-08T18:52:32.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.160+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.160+0000 7f6c3c83d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:32.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.160+0000 7f6c3c83d800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.160+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/235758064 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55acdcef5610 0x55acdcef7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.160+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef8010 con 0x55acdcef5610 2024-05-08T18:52:32.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.160+0000 7f6c3ab36640 1 --2- 172.21.15.132:0/235758064 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55acdcef5610 0x55acdcef7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.160+0000 7f6c3ab36640 1 --2- 172.21.15.132:0/235758064 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55acdcef5610 0x55acdcef7a00 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.160+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6c3402a070 con 0x55acdcef5610 2024-05-08T18:52:32.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.160+0000 7f6c3c83d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:52:32.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.160+0000 7f6c3c83d800 20 searching for the correct realm 2024-05-08T18:52:32.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.160+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x55acdcef5610 2024-05-08T18:52:32.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.161+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3402a070 con 0x55acdcef5610 2024-05-08T18:52:32.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.161+0000 7f6c3ab36640 1 --2- 172.21.15.132:0/235758064 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6c3404f020 0x7f6c34044a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.161+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x7f6c3404f020 2024-05-08T18:52:32.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.161+0000 7f6c3a335640 1 --2- 172.21.15.132:0/235758064 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6c3404f020 0x7f6c34044a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.161+0000 7f6c3a335640 1 --2- 172.21.15.132:0/235758064 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6c3404f020 0x7f6c34044a20 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.161+0000 7f6c3a335640 1 -- 172.21.15.132:0/235758064 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2c044d70 con 0x7f6c3404f020 2024-05-08T18:52:32.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.161+0000 7f6c3a335640 1 --2- 172.21.15.132:0/235758064 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f6c2c00f070 0x7f6c2c01a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.161+0000 7f6c3a335640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x7f6c2c00f070 2024-05-08T18:52:32.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.162+0000 7f6c39b34640 1 --2- 172.21.15.132:0/235758064 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f6c2c00f070 0x7f6c2c01a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.162+0000 7f6c39b34640 1 --2- 172.21.15.132:0/235758064 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f6c2c00f070 0x7f6c2c01a480 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.162+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3005a040 con 0x7f6c2c00f070 2024-05-08T18:52:32.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.162+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x55acdcef0c60 2024-05-08T18:52:32.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.163+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.163+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x55acdcef0c60 2024-05-08T18:52:32.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.163+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.163+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x7f6c2c00f070 2024-05-08T18:52:32.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.163+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3005a040 con 0x7f6c2c00f070 2024-05-08T18:52:32.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.163+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x7f6c2c00f070 2024-05-08T18:52:32.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.163+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3005a040 con 0x7f6c2c00f070 2024-05-08T18:52:32.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.163+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x7f6c3404f020 2024-05-08T18:52:32.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.164+0000 7f6c3a335640 1 -- 172.21.15.132:0/235758064 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2c044d70 con 0x7f6c3404f020 2024-05-08T18:52:32.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.164+0000 7f6c3a335640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x55acdcef5610 2024-05-08T18:52:32.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.164+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c34061040 con 0x55acdcef5610 2024-05-08T18:52:32.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.164+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x55acdcef0c60 2024-05-08T18:52:32.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.164+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.164+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x7f6c2c00f070 2024-05-08T18:52:32.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.164+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3005a040 con 0x7f6c2c00f070 2024-05-08T18:52:32.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.164+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x55acdcef0c60 2024-05-08T18:52:32.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.165+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.165+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x7f6c3404f020 2024-05-08T18:52:32.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.165+0000 7f6c3a335640 1 -- 172.21.15.132:0/235758064 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6c2c044d70 con 0x7f6c3404f020 2024-05-08T18:52:32.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.165+0000 7f6c3a335640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x55acdcef5610 2024-05-08T18:52:32.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.165+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v27'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6c34061040 con 0x55acdcef5610 2024-05-08T18:52:32.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.165+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x55acdcef5610 2024-05-08T18:52:32.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.165+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c34061040 con 0x55acdcef5610 2024-05-08T18:52:32.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.165+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x7f6c2c00f070 2024-05-08T18:52:32.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.166+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3005a040 con 0x7f6c2c00f070 2024-05-08T18:52:32.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.166+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x55acdcef5610 2024-05-08T18:52:32.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.166+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c34061040 con 0x55acdcef5610 2024-05-08T18:52:32.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.166+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x55acdcef5610 2024-05-08T18:52:32.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.166+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c34061040 con 0x55acdcef5610 2024-05-08T18:52:32.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.166+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x55acdcef0c60 2024-05-08T18:52:32.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.166+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.166+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x55acdcef0c60 2024-05-08T18:52:32.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.167+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v27'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.167+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x7f6c2c00f070 2024-05-08T18:52:32.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.167+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3005a040 con 0x7f6c2c00f070 2024-05-08T18:52:32.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.167+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x55acdcef5610 2024-05-08T18:52:32.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.167+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c34061040 con 0x55acdcef5610 2024-05-08T18:52:32.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.167+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x7f6c3404f020 2024-05-08T18:52:32.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.167+0000 7f6c3a335640 1 -- 172.21.15.132:0/235758064 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2c044d70 con 0x7f6c3404f020 2024-05-08T18:52:32.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.167+0000 7f6c3a335640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x55acdcef0c60 2024-05-08T18:52:32.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.168+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.168+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x7f6c3404f020 2024-05-08T18:52:32.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.168+0000 7f6c3a335640 1 -- 172.21.15.132:0/235758064 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2c044d70 con 0x7f6c3404f020 2024-05-08T18:52:32.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.168+0000 7f6c3a335640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x55acdcef5610 2024-05-08T18:52:32.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.168+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c34061040 con 0x55acdcef5610 2024-05-08T18:52:32.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.168+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x7f6c2c00f070 2024-05-08T18:52:32.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.168+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3005a040 con 0x7f6c2c00f070 2024-05-08T18:52:32.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.168+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x7f6c3404f020 2024-05-08T18:52:32.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.169+0000 7f6c3a335640 1 -- 172.21.15.132:0/235758064 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2c044d70 con 0x7f6c3404f020 2024-05-08T18:52:32.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.169+0000 7f6c3a335640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x55acdcef5610 2024-05-08T18:52:32.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.169+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c34061040 con 0x55acdcef5610 2024-05-08T18:52:32.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.169+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x7f6c2c00f070 2024-05-08T18:52:32.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.170+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3005a040 con 0x7f6c2c00f070 2024-05-08T18:52:32.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.170+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x55acdcef0c60 2024-05-08T18:52:32.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.170+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v27'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.170+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef9920 con 0x7f6c3404f020 2024-05-08T18:52:32.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.170+0000 7f6c3a335640 1 -- 172.21.15.132:0/235758064 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c2c044d70 con 0x7f6c3404f020 2024-05-08T18:52:32.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.170+0000 7f6c3c83d800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:52:32.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.170+0000 7f6c3c83d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:52:32.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.170+0000 7f6c3c83d800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:52:32.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.170+0000 7f6c3c83d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:52:32.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.170+0000 7f6c3c83d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:52:32.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.170+0000 7f6c3c83d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:52:32.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.170+0000 7f6c3c83d800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.170+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef94f0 con 0x55acdcef0c60 2024-05-08T18:52:32.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.170+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.170+0000 7f6c3c83d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.170+0000 7f6c3c83d800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.170+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef8d60 con 0x55acdcef0c60 2024-05-08T18:52:32.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.170+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.170+0000 7f6c3c83d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:32.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.170+0000 7f6c3c83d800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.186 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.170+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acdcef84a0 con 0x55acdcef0c60 2024-05-08T18:52:32.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.171+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.171+0000 7f6c3c83d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:52:32.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.171+0000 7f6c3c83d800 20 zone default found 2024-05-08T18:52:32.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.171+0000 7f6c3c83d800 4 Realm: () 2024-05-08T18:52:32.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.171+0000 7f6c3c83d800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:52:32.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.171+0000 7f6c3c83d800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:52:32.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.171+0000 7f6c3c83d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:52:32.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.171+0000 7f6c3c83d800 20 zonegroup default 2024-05-08T18:52:32.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.171+0000 7f6c3c83d800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.171+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acdcefa250 con 0x7f6c3404f020 2024-05-08T18:52:32.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.171+0000 7f6c3a335640 1 -- 172.21.15.132:0/235758064 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6c2c044d70 con 0x7f6c3404f020 2024-05-08T18:52:32.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.171+0000 7f6c3c83d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.171+0000 7f6c3c83d800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.188 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.171+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acdcefc480 con 0x55acdcef5610 2024-05-08T18:52:32.188 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.171+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c34061040 con 0x55acdcef5610 2024-05-08T18:52:32.188 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.171+0000 7f6c3c83d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.188 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.171+0000 7f6c3c83d800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.188 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.171+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acdcefc820 con 0x55acdcef5610 2024-05-08T18:52:32.188 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.171+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c34061040 con 0x55acdcef5610 2024-05-08T18:52:32.188 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.171+0000 7f6c3c83d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.188 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.171+0000 7f6c3c83d800 20 started sync module instance, tier type = 2024-05-08T18:52:32.188 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.171+0000 7f6c3c83d800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:52:32.188 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.172+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcefb8c0 con 0x7f6c3404f020 2024-05-08T18:52:32.188 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.173+0000 7f6c3a335640 1 -- 172.21.15.132:0/235758064 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2c044d70 con 0x7f6c3404f020 2024-05-08T18:52:32.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.173+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94200929434848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcefb520 con 0x7f6c3404f020 2024-05-08T18:52:32.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.173+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcefd1c0 con 0x55acdcef0c60 2024-05-08T18:52:32.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.174+0000 7f6c3a335640 1 -- 172.21.15.132:0/235758064 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94200929434848] v27'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2c044d70 con 0x7f6c3404f020 2024-05-08T18:52:32.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.174+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.174+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94200929438208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcefda60 con 0x55acdcef0c60 2024-05-08T18:52:32.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.174+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcefe420 con 0x55acdcef5610 2024-05-08T18:52:32.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.175+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c34061040 con 0x55acdcef5610 2024-05-08T18:52:32.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.175+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94200929443696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcefe880 con 0x55acdcef5610 2024-05-08T18:52:32.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.175+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdceff380 con 0x7f6c3404f020 2024-05-08T18:52:32.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.175+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94200929438208] v27'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.176+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94200929443696] v27'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c34061040 con 0x55acdcef5610 2024-05-08T18:52:32.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.176+0000 7f6c3a335640 1 -- 172.21.15.132:0/235758064 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2c044d70 con 0x7f6c3404f020 2024-05-08T18:52:32.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.176+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94200929447536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcefe390 con 0x7f6c3404f020 2024-05-08T18:52:32.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.176+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdceffd90 con 0x55acdcef0c60 2024-05-08T18:52:32.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.177+0000 7f6c3a335640 1 -- 172.21.15.132:0/235758064 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94200929447536] v27'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2c044d70 con 0x7f6c3404f020 2024-05-08T18:52:32.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.177+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.177+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94200929441200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdceffd90 con 0x55acdcef0c60 2024-05-08T18:52:32.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.177+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcf00750 con 0x7f6c2c00f070 2024-05-08T18:52:32.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.178+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94200929441200] v27'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.179+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x7f6c2c00f070 2024-05-08T18:52:32.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.179+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94200929450688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcf00750 con 0x7f6c2c00f070 2024-05-08T18:52:32.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.179+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcf01110 con 0x7f6c2c00f070 2024-05-08T18:52:32.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.180+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94200929450688] v27'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x7f6c2c00f070 2024-05-08T18:52:32.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.180+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x7f6c2c00f070 2024-05-08T18:52:32.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.180+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94200929452704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcf012f0 con 0x7f6c2c00f070 2024-05-08T18:52:32.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.180+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcf01b40 con 0x7f6c2c00f070 2024-05-08T18:52:32.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.181+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(58 notify.7 [create] v27'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x7f6c2c00f070 2024-05-08T18:52:32.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.181+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94200929452704] v27'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x7f6c2c00f070 2024-05-08T18:52:32.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.181+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94200929457360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcf00f00 con 0x7f6c2c00f070 2024-05-08T18:52:32.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.181+0000 7f6c3c83d800 20 add_watcher() i=0 2024-05-08T18:52:32.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.181+0000 7f6c3c83d800 20 add_watcher() i=1 2024-05-08T18:52:32.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.181+0000 7f6c3c83d800 20 add_watcher() i=2 2024-05-08T18:52:32.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.181+0000 7f6c3c83d800 20 add_watcher() i=3 2024-05-08T18:52:32.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.181+0000 7f6c3c83d800 20 add_watcher() i=4 2024-05-08T18:52:32.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.181+0000 7f6c3c83d800 20 add_watcher() i=5 2024-05-08T18:52:32.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.181+0000 7f6c3c83d800 20 add_watcher() i=6 2024-05-08T18:52:32.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.182+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94200929457360] v27'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x7f6c2c00f070 2024-05-08T18:52:32.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.182+0000 7f6c3c83d800 20 add_watcher() i=7 2024-05-08T18:52:32.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.182+0000 7f6c3c83d800 2 all 8 watchers are set, enabling cache 2024-05-08T18:52:32.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.182+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acdcf04f80 con 0x55acdcef0c60 2024-05-08T18:52:32.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.182+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.182+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94200929458480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcf024d0 con 0x55acdcef0c60 2024-05-08T18:52:32.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.183+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94200929458480] v27'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.183+0000 7f6af0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:32.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.184+0000 7f6c3c83d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:32.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.184+0000 7f6c3c83d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:32.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.184+0000 7f6c3c83d800 5 note: GC not initialized 2024-05-08T18:52:32.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.184+0000 7f6a6b7fe640 20 reqs_thread_entry: start 2024-05-08T18:52:32.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.184+0000 7f6c3c83d800 20 init_complete bucket index max shards: 11 2024-05-08T18:52:32.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.184+0000 7f6c3c83d800 20 Filter name: none 2024-05-08T18:52:32.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.184+0000 7f6a697fa640 20 reqs_thread_entry: start 2024-05-08T18:52:32.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.184+0000 7f6c3c83d800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:52:32.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.184+0000 7f6c3c83d800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.184+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acdcf38480 con 0x7f6c2c00f070 2024-05-08T18:52:32.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.185+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f6c3005a040 con 0x7f6c2c00f070 2024-05-08T18:52:32.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.185+0000 7f6c3c83d800 20 rados_obj.operate() r=0 bl.length=473 2024-05-08T18:52:32.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.185+0000 7f6c3c83d800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:52:32.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.185+0000 7f6c3c83d800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:32.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.185+0000 7f6c3c83d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:52:32.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.185+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcf3ece0 con 0x7f6c2c00f070 2024-05-08T18:52:32.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.186+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v27'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x7f6c2c00f070 2024-05-08T18:52:32.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.186+0000 7f6c3c83d800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:52:32.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.186+0000 7f6c3c83d800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:32.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.186+0000 7f6c3c83d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:52:32.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.186+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94200929707680 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acdcf3a2e0 con 0x55acdcef0c60 2024-05-08T18:52:32.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.186+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== watch-notify(notify (1) cookie 94200929441200 notify 115964117013 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55acdcdc22a0 con 0x55acdcef0c60 2024-05-08T18:52:32.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.186+0000 7f6b1dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117013 cookie 94200929441200 notifier 4830 bl.length()=636 2024-05-08T18:52:32.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.186+0000 7f6b1dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:52:32.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.186+0000 7f6b1dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:32.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.186+0000 7f6b1dffb640 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f6b00003ea0 con 0x55acdcef0c60 2024-05-08T18:52:32.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.186+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 notify.4 [notify cookie 94200929707680 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.186+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.186+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== watch-notify(notify_complete (2) cookie 94200929707680 notify 115964117013 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6c3005db60 con 0x55acdcef0c60 2024-05-08T18:52:32.199 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:52:31.994053Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:52:31.994040Z","tags":[],"group_ids":[]} 2024-05-08T18:52:32.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.187+0000 7f6af0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:32.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.187+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94200929458480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcf04b00 con 0x55acdcef0c60 2024-05-08T18:52:32.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.188+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94200929458480] v27'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.188+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94200929434848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcf018f0 con 0x7f6c3404f020 2024-05-08T18:52:32.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.189+0000 7f6c3a335640 1 -- 172.21.15.132:0/235758064 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94200929434848] v27'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2c044d70 con 0x7f6c3404f020 2024-05-08T18:52:32.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.189+0000 7f6c3c83d800 20 remove_watcher() i=0 2024-05-08T18:52:32.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.189+0000 7f6c3c83d800 2 removed watcher, disabling cache 2024-05-08T18:52:32.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.189+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94200929438208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcefbce0 con 0x55acdcef0c60 2024-05-08T18:52:32.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.190+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94200929438208] v27'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.190+0000 7f6c3c83d800 20 remove_watcher() i=1 2024-05-08T18:52:32.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.190+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94200929443696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcefbce0 con 0x55acdcef5610 2024-05-08T18:52:32.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.191+0000 7f6c3ab36640 1 -- 172.21.15.132:0/235758064 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94200929443696] v27'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c34061040 con 0x55acdcef5610 2024-05-08T18:52:32.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.191+0000 7f6c3c83d800 20 remove_watcher() i=2 2024-05-08T18:52:32.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.191+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94200929447536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcefdf70 con 0x7f6c3404f020 2024-05-08T18:52:32.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.192+0000 7f6c3a335640 1 -- 172.21.15.132:0/235758064 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94200929447536] v27'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c2c044d70 con 0x7f6c3404f020 2024-05-08T18:52:32.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.192+0000 7f6c3c83d800 20 remove_watcher() i=3 2024-05-08T18:52:32.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.192+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94200929441200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcefbce0 con 0x55acdcef0c60 2024-05-08T18:52:32.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.193+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94200929441200] v27'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x55acdcef0c60 2024-05-08T18:52:32.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.193+0000 7f6c3c83d800 20 remove_watcher() i=4 2024-05-08T18:52:32.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.194+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94200929450688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcefee70 con 0x7f6c2c00f070 2024-05-08T18:52:32.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.195+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94200929450688] v27'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x7f6c2c00f070 2024-05-08T18:52:32.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.195+0000 7f6c3c83d800 20 remove_watcher() i=5 2024-05-08T18:52:32.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.195+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94200929452704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcefdf70 con 0x7f6c2c00f070 2024-05-08T18:52:32.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.196+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94200929452704] v27'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x7f6c2c00f070 2024-05-08T18:52:32.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.196+0000 7f6c3c83d800 20 remove_watcher() i=6 2024-05-08T18:52:32.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.196+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94200929457360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acdcefbce0 con 0x7f6c2c00f070 2024-05-08T18:52:32.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.197+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94200929457360] v27'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3005a040 con 0x7f6c2c00f070 2024-05-08T18:52:32.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.197+0000 7f6c3c83d800 20 remove_watcher() i=7 2024-05-08T18:52:32.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.197+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f6c2c00f070 msgr2=0x7f6c2c01a480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.197+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/235758064 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f6c2c00f070 0x7f6c2c01a480 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.197+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55acdcef0c60 msgr2=0x55acdcef3120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.197+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/235758064 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55acdcef0c60 0x55acdcef3120 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.197+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6c3404f020 msgr2=0x7f6c34044a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.197+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/235758064 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6c3404f020 0x7f6c34044a20 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.197+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55acdcef5610 msgr2=0x55acdcef7a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.197+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/235758064 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55acdcef5610 0x55acdcef7a00 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.197+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6b0403bb00 msgr2=0x7f6b0403dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.197+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/235758064 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6b0403bb00 0x7f6b0403dfc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c019fb0 tx=0x7f6c2c04a000 comp rx=0 tx=0).stop 2024-05-08T18:52:32.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.197+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdceddbf0 msgr2=0x55acdcee5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.197+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/235758064 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdceddbf0 0x55acdcee5120 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6c340018a0 tx=0x7f6c34052c60 comp rx=0 tx=0).stop 2024-05-08T18:52:32.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.197+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 reap_dead start 2024-05-08T18:52:32.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.197+0000 7f6c39b34640 1 -- 172.21.15.132:0/235758064 reap_dead start 2024-05-08T18:52:32.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.197+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 shutdown_connections 2024-05-08T18:52:32.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.197+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 >> 172.21.15.132:0/235758064 conn(0x55acdced9f00 msgr2=0x55acdced75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.197+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 shutdown_connections 2024-05-08T18:52:32.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.197+0000 7f6c3c83d800 1 -- 172.21.15.132:0/235758064 wait complete. 2024-05-08T18:52:32.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 -- 172.21.15.132:0/1638216712 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6b1403bb50 msgr2=0x7f6b1403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/1638216712 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6b1403bb50 0x7f6b1403e010 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c051950 tx=0x7f6c2c001540 comp rx=0 tx=0).stop 2024-05-08T18:52:32.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 -- 172.21.15.132:0/1638216712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdced0910 msgr2=0x55acdced0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/1638216712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdced0910 0x55acdced0d30 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x55acdcebcfd0 tx=0x7f6c34018830 comp rx=0 tx=0).stop 2024-05-08T18:52:32.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 -- 172.21.15.132:0/1638216712 shutdown_connections 2024-05-08T18:52:32.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/1638216712 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6b1403bb50 0x7f6b1403e010 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/1638216712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdced0910 0x55acdced0d30 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 -- 172.21.15.132:0/1638216712 >> 172.21.15.132:0/1638216712 conn(0x55acdcec49b0 msgr2=0x55acdcec4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 -- 172.21.15.132:0/1638216712 shutdown_connections 2024-05-08T18:52:32.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 -- 172.21.15.132:0/1638216712 wait complete. 2024-05-08T18:52:32.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 -- 172.21.15.132:0/3810908693 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55acdcdbe6b0 msgr2=0x55acdcebc670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/3810908693 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55acdcdbe6b0 0x55acdcebc670 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 -- 172.21.15.132:0/3810908693 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55acdcebef20 msgr2=0x55acdcec1310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/3810908693 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55acdcebef20 0x55acdcec1310 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 -- 172.21.15.132:0/3810908693 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6b2003bb50 msgr2=0x7f6b2003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.210 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/3810908693 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6b2003bb50 0x7f6b2003e010 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6c30054000 tx=0x7f6c3004e000 comp rx=0 tx=0).stop 2024-05-08T18:52:32.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 -- 172.21.15.132:0/3810908693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdcdba2c0 msgr2=0x55acdceb5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/3810908693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdcdba2c0 0x55acdceb5480 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c000c00 tx=0x7f6c2c000ed0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 -- 172.21.15.132:0/3810908693 shutdown_connections 2024-05-08T18:52:32.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/3810908693 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55acdcebef20 0x55acdcec1310 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/3810908693 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55acdcdbe6b0 0x55acdcebc670 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/3810908693 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6b2003bb50 0x7f6b2003e010 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 --2- 172.21.15.132:0/3810908693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55acdcdba2c0 0x55acdceb5480 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 -- 172.21.15.132:0/3810908693 >> 172.21.15.132:0/3810908693 conn(0x55acdcdb5840 msgr2=0x55acdcd2eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 -- 172.21.15.132:0/3810908693 shutdown_connections 2024-05-08T18:52:32.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.198+0000 7f6c3c83d800 1 -- 172.21.15.132:0/3810908693 wait complete. 2024-05-08T18:52:32.212 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:52:31.994053Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:31.994040Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:32.212 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:52:31.994053Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:31.994040Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:32.213 ERROR:root:0 2024-05-08T18:52:32.213 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-05-08T18:52:32.213 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-05-08T18:52:32.213 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-05-08T18:52:32.265 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:32.266 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:32.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.267+0000 7f2d8dc36800 1 Processor -- start 2024-05-08T18:52:32.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.267+0000 7f2d8dc36800 1 -- start start 2024-05-08T18:52:32.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.267+0000 7f2d8dc36800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x556bba8a0d90 0x556bba8a3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.267+0000 7f2d8dc36800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556bba8a71d0 con 0x556bba8a36c0 2024-05-08T18:52:32.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.267+0000 7f2d8dc36800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x556bba740e20 con 0x556bba8a0d90 2024-05-08T18:52:32.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.267+0000 7f2d8b72e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x556bba8a0d90 0x556bba8a3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.268+0000 7f2d8b72e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x556bba8a0d90 0x556bba8a3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53246/0 (socket says 172.21.15.132:53246) 2024-05-08T18:52:32.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.268+0000 7f2d8b72e640 1 -- 172.21.15.132:0/4114739798 learned_addr learned my addr 172.21.15.132:0/4114739798 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.268+0000 7f2d83fff640 1 --1- 172.21.15.132:0/4114739798 >> v1:172.21.15.42:6789/0 conn(0x556bba8a36c0 0x556bba8a5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48132/0 (socket says 172.21.15.132:48132) 2024-05-08T18:52:32.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.268+0000 7f2d8b72e640 1 -- 172.21.15.132:0/4114739798 >> v1:172.21.15.42:6789/0 conn(0x556bba8a36c0 legacy=0x556bba8a5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.268+0000 7f2d8b72e640 1 -- 172.21.15.132:0/4114739798 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bba8a83b0 con 0x556bba8a0d90 2024-05-08T18:52:32.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.270+0000 7f2d8b72e640 1 --2- 172.21.15.132:0/4114739798 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba8a0d90 0x556bba8a3180 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c00a520 tx=0x7f2d7c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f65ce1e2be7922d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.270+0000 7f2d8af2d640 1 -- 172.21.15.132:0/4114739798 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d7c057070 con 0x556bba8a0d90 2024-05-08T18:52:32.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.270+0000 7f2d8af2d640 1 -- 172.21.15.132:0/4114739798 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d7c052570 con 0x556bba8a0d90 2024-05-08T18:52:32.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.270+0000 7f2d8af2d640 1 -- 172.21.15.132:0/4114739798 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d7c04ae60 con 0x556bba8a0d90 2024-05-08T18:52:32.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.271+0000 7f2d8dc36800 1 -- 172.21.15.132:0/4114739798 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba8a0d90 msgr2=0x556bba8a3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.271+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/4114739798 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba8a0d90 0x556bba8a3180 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c00a520 tx=0x7f2d7c01d010 comp rx=0 tx=0).stop 2024-05-08T18:52:32.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.271+0000 7f2d8dc36800 1 -- 172.21.15.132:0/4114739798 shutdown_connections 2024-05-08T18:52:32.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.271+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/4114739798 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba8a0d90 0x556bba8a3180 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.271+0000 7f2d8dc36800 1 -- 172.21.15.132:0/4114739798 >> 172.21.15.132:0/4114739798 conn(0x556bba89a6e0 msgr2=0x556bba89cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.271+0000 7f2d8dc36800 1 -- 172.21.15.132:0/4114739798 shutdown_connections 2024-05-08T18:52:32.271 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.271+0000 7f2d8dc36800 1 -- 172.21.15.132:0/4114739798 wait complete. 2024-05-08T18:52:32.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.284+0000 7f2d8dc36800 1 Processor -- start 2024-05-08T18:52:32.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.285+0000 7f2d8dc36800 1 -- start start 2024-05-08T18:52:32.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.285+0000 7f2d8dc36800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba8a0d90 0x556bba8a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.285+0000 7f2d8dc36800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556bba7eb6b0 con 0x556bba8a0d90 2024-05-08T18:52:32.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.285+0000 7f2d8b72e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba8a0d90 0x556bba8a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.285+0000 7f2d8b72e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba8a0d90 0x556bba8a06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53252/0 (socket says 172.21.15.132:53252) 2024-05-08T18:52:32.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.285+0000 7f2d8b72e640 1 -- 172.21.15.132:0/1132322350 learned_addr learned my addr 172.21.15.132:0/1132322350 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.285+0000 7f2d8b72e640 1 -- 172.21.15.132:0/1132322350 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bba89ec90 con 0x556bba8a0d90 2024-05-08T18:52:32.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.286+0000 7f2d8b72e640 1 --2- 172.21.15.132:0/1132322350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba8a0d90 0x556bba8a06d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c055040 tx=0x7f2d7c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0c5c6f24e12ab9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.286+0000 7f2c7960a640 1 -- 172.21.15.132:0/1132322350 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d7c057040 con 0x556bba8a0d90 2024-05-08T18:52:32.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.286+0000 7f2c7960a640 1 -- 172.21.15.132:0/1132322350 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d7c052720 con 0x556bba8a0d90 2024-05-08T18:52:32.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.286+0000 7f2c7960a640 1 -- 172.21.15.132:0/1132322350 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d7c052a20 con 0x556bba8a0d90 2024-05-08T18:52:32.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.287+0000 7f2d8dc36800 1 -- 172.21.15.132:0/1132322350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba8a0d90 msgr2=0x556bba8a06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.287+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/1132322350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba8a0d90 0x556bba8a06d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c055040 tx=0x7f2d7c04c000 comp rx=0 tx=0).stop 2024-05-08T18:52:32.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.287+0000 7f2d8dc36800 1 -- 172.21.15.132:0/1132322350 shutdown_connections 2024-05-08T18:52:32.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.287+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/1132322350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba8a0d90 0x556bba8a06d0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.287+0000 7f2d8dc36800 1 -- 172.21.15.132:0/1132322350 >> 172.21.15.132:0/1132322350 conn(0x556bba89a6e0 msgr2=0x556bba98cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.287+0000 7f2d8dc36800 1 -- 172.21.15.132:0/1132322350 shutdown_connections 2024-05-08T18:52:32.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.287+0000 7f2d8dc36800 1 -- 172.21.15.132:0/1132322350 wait complete. 2024-05-08T18:52:32.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.287+0000 7f2d8dc36800 1 Processor -- start 2024-05-08T18:52:32.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.287+0000 7f2d8dc36800 1 -- start start 2024-05-08T18:52:32.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.287+0000 7f2d8dc36800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba8a0d90 0x556bba99b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.287+0000 7f2d8dc36800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556bba8a7640 con 0x556bba8a0d90 2024-05-08T18:52:32.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.287+0000 7f2d8b72e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba8a0d90 0x556bba99b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.287+0000 7f2d8b72e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba8a0d90 0x556bba99b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53256/0 (socket says 172.21.15.132:53256) 2024-05-08T18:52:32.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.287+0000 7f2d8b72e640 1 -- 172.21.15.132:0/3412730630 learned_addr learned my addr 172.21.15.132:0/3412730630 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.288+0000 7f2d8b72e640 1 -- 172.21.15.132:0/3412730630 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bba99b890 con 0x556bba8a0d90 2024-05-08T18:52:32.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.288+0000 7f2d8b72e640 1 --2- 172.21.15.132:0/3412730630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba8a0d90 0x556bba99b350 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0524f0 tx=0x7f2d7c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.288+0000 7f2c77e07640 1 -- 172.21.15.132:0/3412730630 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d7c073070 con 0x556bba8a0d90 2024-05-08T18:52:32.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.288+0000 7f2c77e07640 1 -- 172.21.15.132:0/3412730630 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d7c05d440 con 0x556bba8a0d90 2024-05-08T18:52:32.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.288+0000 7f2c77e07640 1 -- 172.21.15.132:0/3412730630 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d7c057070 con 0x556bba8a0d90 2024-05-08T18:52:32.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.288+0000 7f2d8dc36800 1 -- 172.21.15.132:0/3412730630 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556bba99bb20 con 0x556bba8a0d90 2024-05-08T18:52:32.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.288+0000 7f2d8dc36800 1 -- 172.21.15.132:0/3412730630 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bba99e780 con 0x556bba8a0d90 2024-05-08T18:52:32.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.289+0000 7f2c77e07640 1 -- 172.21.15.132:0/3412730630 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2d7c076070 con 0x556bba8a0d90 2024-05-08T18:52:32.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.289+0000 7f2c77e07640 1 --2- 172.21.15.132:0/3412730630 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2c7003bba0 0x7f2c7003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.289+0000 7f2c77e07640 1 -- 172.21.15.132:0/3412730630 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f2d7c0941a0 con 0x556bba8a0d90 2024-05-08T18:52:32.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.289+0000 7f2d83fff640 1 --2- 172.21.15.132:0/3412730630 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2c7003bba0 0x7f2c7003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.290+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/3412730630 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x556bba8a36c0 0x556bba9a2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.290+0000 7f2d8dc36800 1 -- 172.21.15.132:0/3412730630 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556bba9a2ac0 con 0x556bba8a36c0 2024-05-08T18:52:32.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.290+0000 7f2d8bf2f640 1 --2- 172.21.15.132:0/3412730630 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x556bba8a36c0 0x556bba9a2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.290+0000 7f2d83fff640 1 --2- 172.21.15.132:0/3412730630 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2c7003bba0 0x7f2c7003e060 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2d74000f60 tx=0x7f2d74001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.290+0000 7f2d8bf2f640 1 --2- 172.21.15.132:0/3412730630 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x556bba8a36c0 0x556bba9a2540 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.290+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/3412730630 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d8400a4a0 con 0x556bba8a36c0 2024-05-08T18:52:32.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.290+0000 7f2d8dc36800 1 -- 172.21.15.132:0/3412730630 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556bba99fb10 con 0x556bba8a36c0 2024-05-08T18:52:32.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.290+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/3412730630 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2d8400a4a0 con 0x556bba8a36c0 2024-05-08T18:52:32.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.290+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/3412730630 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556bba9a4df0 0x556bba9a71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.290+0000 7f2d8dc36800 1 -- 172.21.15.132:0/3412730630 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556bba9a78d0 con 0x556bba9a4df0 2024-05-08T18:52:32.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.291+0000 7f2d8b72e640 1 --2- 172.21.15.132:0/3412730630 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556bba9a4df0 0x556bba9a71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.291+0000 7f2d8b72e640 1 --2- 172.21.15.132:0/3412730630 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556bba9a4df0 0x556bba9a71e0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.291+0000 7f2d8b72e640 1 -- 172.21.15.132:0/3412730630 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2d7c075030 con 0x556bba9a4df0 2024-05-08T18:52:32.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.291+0000 7f2d8dc36800 1 -- 172.21.15.132:0/3412730630 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556bba9a3c90 con 0x556bba8a36c0 2024-05-08T18:52:32.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.292+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/3412730630 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2d8400a4a0 con 0x556bba8a36c0 2024-05-08T18:52:32.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.292+0000 7f2d8dc36800 1 -- 172.21.15.132:0/3412730630 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556bba9a4170 con 0x556bba8a36c0 2024-05-08T18:52:32.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.292+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/3412730630 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2d8400a4a0 con 0x556bba8a36c0 2024-05-08T18:52:32.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.292+0000 7f2d8dc36800 1 Processor -- start 2024-05-08T18:52:32.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.292+0000 7f2d8dc36800 1 -- start start 2024-05-08T18:52:32.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.292+0000 7f2d8dc36800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba9b6810 0x556bba9b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.292+0000 7f2d8dc36800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556bba791fc0 con 0x556bba9b6810 2024-05-08T18:52:32.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.293+0000 7f2d8bf2f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba9b6810 0x556bba9b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.293+0000 7f2d8bf2f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba9b6810 0x556bba9b6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53258/0 (socket says 172.21.15.132:53258) 2024-05-08T18:52:32.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.293+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/4250284093 learned_addr learned my addr 172.21.15.132:0/4250284093 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.293+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/4250284093 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bba9b7170 con 0x556bba9b6810 2024-05-08T18:52:32.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.293+0000 7f2d8bf2f640 1 --2- 172.21.15.132:0/4250284093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba9b6810 0x556bba9b6c30 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x556bba9a2ea0 tx=0x7f2d84018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.293+0000 7f2c75602640 1 -- 172.21.15.132:0/4250284093 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d84014450 con 0x556bba9b6810 2024-05-08T18:52:32.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.293+0000 7f2c75602640 1 -- 172.21.15.132:0/4250284093 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d84014610 con 0x556bba9b6810 2024-05-08T18:52:32.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.293+0000 7f2c75602640 1 -- 172.21.15.132:0/4250284093 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d84014930 con 0x556bba9b6810 2024-05-08T18:52:32.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.293+0000 7f2d8dc36800 1 -- 172.21.15.132:0/4250284093 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556bba9b7be0 con 0x556bba9b6810 2024-05-08T18:52:32.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.293+0000 7f2d8dc36800 1 -- 172.21.15.132:0/4250284093 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bba9b80e0 con 0x556bba9b6810 2024-05-08T18:52:32.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.294+0000 7f2c75602640 1 -- 172.21.15.132:0/4250284093 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2d84011040 con 0x556bba9b6810 2024-05-08T18:52:32.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.294+0000 7f2c75602640 1 --2- 172.21.15.132:0/4250284093 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2c6403bb50 0x7f2c6403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.294+0000 7f2c75602640 1 -- 172.21.15.132:0/4250284093 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f2d8401e070 con 0x556bba9b6810 2024-05-08T18:52:32.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.294+0000 7f2d8b72e640 1 --2- 172.21.15.132:0/4250284093 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2c6403bb50 0x7f2c6403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.295+0000 7f2d8dc36800 1 Processor -- start 2024-05-08T18:52:32.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.295+0000 7f2d8dc36800 1 -- start start 2024-05-08T18:52:32.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.295+0000 7f2d8b72e640 1 --2- 172.21.15.132:0/4250284093 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2c6403bb50 0x7f2c6403e010 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x556bba9a2f40 tx=0x7f2d7c05d740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.295+0000 7f2d8dc36800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba9c3af0 0x556bba9c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.295+0000 7f2d8dc36800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556bba89ef50 con 0x556bba9c3af0 2024-05-08T18:52:32.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.295+0000 7f2d8bf2f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba9c3af0 0x556bba9c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.295+0000 7f2d8bf2f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba9c3af0 0x556bba9c3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53274/0 (socket says 172.21.15.132:53274) 2024-05-08T18:52:32.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.295+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2673345706 learned_addr learned my addr 172.21.15.132:0/2673345706 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.295+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2673345706 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bba9c44e0 con 0x556bba9c3af0 2024-05-08T18:52:32.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.296+0000 7f2d8bf2f640 1 --2- 172.21.15.132:0/2673345706 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba9c3af0 0x556bba9c3f10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2d84052cd0 tx=0x7f2d8402b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa548500fc80b132 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.296+0000 7f2c6effd640 1 -- 172.21.15.132:0/2673345706 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d84028030 con 0x556bba9c3af0 2024-05-08T18:52:32.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.296+0000 7f2c6effd640 1 -- 172.21.15.132:0/2673345706 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d84016440 con 0x556bba9c3af0 2024-05-08T18:52:32.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.296+0000 7f2c6effd640 1 -- 172.21.15.132:0/2673345706 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d84011a80 con 0x556bba9c3af0 2024-05-08T18:52:32.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.296+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2673345706 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba9c3af0 msgr2=0x556bba9c3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.296+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/2673345706 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba9c3af0 0x556bba9c3f10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2d84052cd0 tx=0x7f2d8402b720 comp rx=0 tx=0).stop 2024-05-08T18:52:32.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.296+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2673345706 shutdown_connections 2024-05-08T18:52:32.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.296+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/2673345706 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba9c3af0 0x556bba9c3f10 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.296+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2673345706 >> 172.21.15.132:0/2673345706 conn(0x556bba9bfe50 msgr2=0x556bba9bdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.296+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2673345706 shutdown_connections 2024-05-08T18:52:32.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.296+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2673345706 wait complete. 2024-05-08T18:52:32.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.296+0000 7f2d8dc36800 1 Processor -- start 2024-05-08T18:52:32.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.297+0000 7f2d8dc36800 1 -- start start 2024-05-08T18:52:32.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.297+0000 7f2d8dc36800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba9c3af0 0x556bba9cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.297+0000 7f2d8dc36800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x556bba9c4c50 con 0x556bba9c3af0 2024-05-08T18:52:32.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.297+0000 7f2d8bf2f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba9c3af0 0x556bba9cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.297+0000 7f2d8bf2f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba9c3af0 0x556bba9cb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53282/0 (socket says 172.21.15.132:53282) 2024-05-08T18:52:32.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.297+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 learned_addr learned my addr 172.21.15.132:0/2168159472 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.297+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bba9cb610 con 0x556bba9c3af0 2024-05-08T18:52:32.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.297+0000 7f2d8bf2f640 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba9c3af0 0x556bba9cb0d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2d84016c90 tx=0x7f2d84052c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.297+0000 7f2c6d7fa640 1 -- 172.21.15.132:0/2168159472 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d840540d0 con 0x556bba9c3af0 2024-05-08T18:52:32.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.298+0000 7f2c6d7fa640 1 -- 172.21.15.132:0/2168159472 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d84054270 con 0x556bba9c3af0 2024-05-08T18:52:32.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.298+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556bba9cb8a0 con 0x556bba9c3af0 2024-05-08T18:52:32.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.298+0000 7f2c6d7fa640 1 -- 172.21.15.132:0/2168159472 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d84054550 con 0x556bba9c3af0 2024-05-08T18:52:32.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.298+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bba9ce550 con 0x556bba9c3af0 2024-05-08T18:52:32.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.299+0000 7f2c6d7fa640 1 -- 172.21.15.132:0/2168159472 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2d84034020 con 0x556bba9c3af0 2024-05-08T18:52:32.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.299+0000 7f2c6d7fa640 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2c5403bb50 0x7f2c5403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.299+0000 7f2c6d7fa640 1 -- 172.21.15.132:0/2168159472 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f2d84032020 con 0x556bba9c3af0 2024-05-08T18:52:32.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.299+0000 7f2d8b72e640 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2c5403bb50 0x7f2c5403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.299+0000 7f2d8b72e640 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2c5403bb50 0x7f2c5403e010 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c05c720 tx=0x7f2d7c089000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.299+0000 7f2d8dc36800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.299+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x556bba9d6df0 0x556bba9d92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.299+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556bba9d9a00 con 0x556bba9d6df0 2024-05-08T18:52:32.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.299+0000 7f2d83fff640 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x556bba9d6df0 0x556bba9d92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.300+0000 7f2d83fff640 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x556bba9d6df0 0x556bba9d92b0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.300+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d7400f610 con 0x556bba9d6df0 2024-05-08T18:52:32.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.300+0000 7f2d8dc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.300+0000 7f2d8dc36800 20 realm 2024-05-08T18:52:32.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.300+0000 7f2d8dc36800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.300+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556bba9d6240 con 0x556bba9d6df0 2024-05-08T18:52:32.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.300+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d7400f610 con 0x556bba9d6df0 2024-05-08T18:52:32.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.300+0000 7f2d8dc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.300+0000 7f2d8dc36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:52:32.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.300+0000 7f2d8dc36800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.300+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556bba9da4f0 con 0x556bba9d6df0 2024-05-08T18:52:32.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.300+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d7400f610 con 0x556bba9d6df0 2024-05-08T18:52:32.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.300+0000 7f2d8dc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.300+0000 7f2d8dc36800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.300+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dadc0 con 0x556bba9d6df0 2024-05-08T18:52:32.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.301+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2d7400f610 con 0x556bba9d6df0 2024-05-08T18:52:32.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.301+0000 7f2d8dc36800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:32.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.301+0000 7f2d8dc36800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.301+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556bba9db7e0 0x556bba9ddbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.301+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556bba9de2c0 con 0x556bba9db7e0 2024-05-08T18:52:32.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.301+0000 7f2d8bf2f640 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556bba9db7e0 0x556bba9ddbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.301+0000 7f2d8bf2f640 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556bba9db7e0 0x556bba9ddbd0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.301+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2d8402a070 con 0x556bba9db7e0 2024-05-08T18:52:32.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.301+0000 7f2d8dc36800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:52:32.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.301+0000 7f2d8dc36800 20 searching for the correct realm 2024-05-08T18:52:32.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.301+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x556bba9db7e0 2024-05-08T18:52:32.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.302+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d8402a070 con 0x556bba9db7e0 2024-05-08T18:52:32.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.302+0000 7f2d8bf2f640 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2d84014070 0x7f2d840439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.302+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x7f2d84014070 2024-05-08T18:52:32.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.302+0000 7f2d8b72e640 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2d84014070 0x7f2d840439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.302+0000 7f2d8b72e640 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2d84014070 0x7f2d840439b0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.302+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7c075030 con 0x7f2d84014070 2024-05-08T18:52:32.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.303+0000 7f2d8b72e640 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2d7c085040 0x7f2d7c092700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.303+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x7f2d7c085040 2024-05-08T18:52:32.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.303+0000 7f2d83fff640 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2d7c085040 0x7f2d7c092700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.303+0000 7f2d83fff640 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2d7c085040 0x7f2d7c092700 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.304+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7400f610 con 0x7f2d7c085040 2024-05-08T18:52:32.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.304+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x556bba9d6df0 2024-05-08T18:52:32.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.304+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7400f610 con 0x556bba9d6df0 2024-05-08T18:52:32.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.304+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x556bba9d6df0 2024-05-08T18:52:32.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.304+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7402b040 con 0x556bba9d6df0 2024-05-08T18:52:32.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.304+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x7f2d7c085040 2024-05-08T18:52:32.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.304+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7402b040 con 0x7f2d7c085040 2024-05-08T18:52:32.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.304+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x7f2d7c085040 2024-05-08T18:52:32.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.305+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7402b040 con 0x7f2d7c085040 2024-05-08T18:52:32.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.305+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x7f2d84014070 2024-05-08T18:52:32.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.305+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7c075030 con 0x7f2d84014070 2024-05-08T18:52:32.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.305+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x556bba9db7e0 2024-05-08T18:52:32.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.305+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d8402a070 con 0x556bba9db7e0 2024-05-08T18:52:32.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.305+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x556bba9d6df0 2024-05-08T18:52:32.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.305+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7402b040 con 0x556bba9d6df0 2024-05-08T18:52:32.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.305+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x7f2d7c085040 2024-05-08T18:52:32.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.306+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7402b040 con 0x7f2d7c085040 2024-05-08T18:52:32.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.306+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x556bba9d6df0 2024-05-08T18:52:32.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.306+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2d7402b040 con 0x556bba9d6df0 2024-05-08T18:52:32.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.306+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x7f2d84014070 2024-05-08T18:52:32.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.306+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2d7c075030 con 0x7f2d84014070 2024-05-08T18:52:32.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.306+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x556bba9db7e0 2024-05-08T18:52:32.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.306+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v27'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2d8402a070 con 0x556bba9db7e0 2024-05-08T18:52:32.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.306+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x556bba9db7e0 2024-05-08T18:52:32.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.307+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d8402a070 con 0x556bba9db7e0 2024-05-08T18:52:32.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.307+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x7f2d7c085040 2024-05-08T18:52:32.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.307+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7402b040 con 0x7f2d7c085040 2024-05-08T18:52:32.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.307+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x556bba9db7e0 2024-05-08T18:52:32.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.307+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d8402a070 con 0x556bba9db7e0 2024-05-08T18:52:32.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.307+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x556bba9db7e0 2024-05-08T18:52:32.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.307+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d8402a070 con 0x556bba9db7e0 2024-05-08T18:52:32.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.307+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x556bba9d6df0 2024-05-08T18:52:32.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.308+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7402b040 con 0x556bba9d6df0 2024-05-08T18:52:32.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.308+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x556bba9d6df0 2024-05-08T18:52:32.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.308+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v27'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2d7402b040 con 0x556bba9d6df0 2024-05-08T18:52:32.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.308+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x7f2d7c085040 2024-05-08T18:52:32.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.308+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7402b040 con 0x7f2d7c085040 2024-05-08T18:52:32.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.308+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x556bba9db7e0 2024-05-08T18:52:32.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.308+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d8402a070 con 0x556bba9db7e0 2024-05-08T18:52:32.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.308+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x7f2d84014070 2024-05-08T18:52:32.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.309+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7c075030 con 0x7f2d84014070 2024-05-08T18:52:32.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.309+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x556bba9d6df0 2024-05-08T18:52:32.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.309+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7402b040 con 0x556bba9d6df0 2024-05-08T18:52:32.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.309+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x7f2d84014070 2024-05-08T18:52:32.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.309+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7c075030 con 0x7f2d84014070 2024-05-08T18:52:32.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.309+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x556bba9db7e0 2024-05-08T18:52:32.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.309+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d8402a070 con 0x556bba9db7e0 2024-05-08T18:52:32.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.309+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x7f2d7c085040 2024-05-08T18:52:32.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.310+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7402b040 con 0x7f2d7c085040 2024-05-08T18:52:32.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.310+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x7f2d84014070 2024-05-08T18:52:32.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.310+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7c075030 con 0x7f2d84014070 2024-05-08T18:52:32.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.310+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x556bba9db7e0 2024-05-08T18:52:32.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.311+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d8402a070 con 0x556bba9db7e0 2024-05-08T18:52:32.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.311+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x7f2d7c085040 2024-05-08T18:52:32.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.311+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7402b040 con 0x7f2d7c085040 2024-05-08T18:52:32.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.311+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x556bba9d6df0 2024-05-08T18:52:32.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.311+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v27'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2d7402b040 con 0x556bba9d6df0 2024-05-08T18:52:32.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.311+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dfc10 con 0x7f2d84014070 2024-05-08T18:52:32.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d7c075030 con 0x7f2d84014070 2024-05-08T18:52:32.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:52:32.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:52:32.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:52:32.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:52:32.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:52:32.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:52:32.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556bba9dec80 con 0x556bba9d6df0 2024-05-08T18:52:32.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d7402b040 con 0x556bba9d6df0 2024-05-08T18:52:32.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556bba9df520 con 0x556bba9d6df0 2024-05-08T18:52:32.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2d7402b040 con 0x556bba9d6df0 2024-05-08T18:52:32.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:32.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556bba9de8c0 con 0x556bba9d6df0 2024-05-08T18:52:32.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2d7402b040 con 0x556bba9d6df0 2024-05-08T18:52:32.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:52:32.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 20 zone default found 2024-05-08T18:52:32.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 4 Realm: () 2024-05-08T18:52:32.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:52:32.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:52:32.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:52:32.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 20 zonegroup default 2024-05-08T18:52:32.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e0540 con 0x7f2d84014070 2024-05-08T18:52:32.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.312+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2d7c075030 con 0x7f2d84014070 2024-05-08T18:52:32.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.313+0000 7f2d8dc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.313+0000 7f2d8dc36800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.313+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e2770 con 0x556bba9db7e0 2024-05-08T18:52:32.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.313+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2d8402a070 con 0x556bba9db7e0 2024-05-08T18:52:32.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.313+0000 7f2d8dc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.313+0000 7f2d8dc36800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.313+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e2b10 con 0x556bba9db7e0 2024-05-08T18:52:32.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.313+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2d8402a070 con 0x556bba9db7e0 2024-05-08T18:52:32.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.313+0000 7f2d8dc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.313+0000 7f2d8dc36800 20 started sync module instance, tier type = 2024-05-08T18:52:32.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.313+0000 7f2d8dc36800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:52:32.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.313+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e1bb0 con 0x7f2d84014070 2024-05-08T18:52:32.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.314+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7c075030 con 0x7f2d84014070 2024-05-08T18:52:32.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.314+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93921180784384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e2f00 con 0x7f2d84014070 2024-05-08T18:52:32.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.314+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e3750 con 0x556bba9d6df0 2024-05-08T18:52:32.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.315+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93921180784384] v27'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7c075030 con 0x7f2d84014070 2024-05-08T18:52:32.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.315+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7402b040 con 0x556bba9d6df0 2024-05-08T18:52:32.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.315+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93921180791456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e3b70 con 0x556bba9d6df0 2024-05-08T18:52:32.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.315+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e4400 con 0x556bba9db7e0 2024-05-08T18:52:32.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.317+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d8402a070 con 0x556bba9db7e0 2024-05-08T18:52:32.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.317+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93921180793712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e3ff0 con 0x556bba9db7e0 2024-05-08T18:52:32.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.317+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e53a0 con 0x7f2d84014070 2024-05-08T18:52:32.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.317+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93921180791456] v27'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7402b040 con 0x556bba9d6df0 2024-05-08T18:52:32.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.318+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93921180793712] v27'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d8402a070 con 0x556bba9db7e0 2024-05-08T18:52:32.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.318+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7c075030 con 0x7f2d84014070 2024-05-08T18:52:32.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.318+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93921180798576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e47f0 con 0x7f2d84014070 2024-05-08T18:52:32.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.318+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e5c80 con 0x556bba9d6df0 2024-05-08T18:52:32.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.319+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93921180798576] v27'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7c075030 con 0x7f2d84014070 2024-05-08T18:52:32.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.319+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7402b040 con 0x556bba9d6df0 2024-05-08T18:52:32.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.319+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93921180792512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e6070 con 0x556bba9d6df0 2024-05-08T18:52:32.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.319+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e6a30 con 0x7f2d7c085040 2024-05-08T18:52:32.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.320+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93921180792512] v27'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7402b040 con 0x556bba9d6df0 2024-05-08T18:52:32.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.321+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7402b040 con 0x7f2d7c085040 2024-05-08T18:52:32.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.321+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93921180800912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e6a30 con 0x7f2d7c085040 2024-05-08T18:52:32.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.321+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e7480 con 0x7f2d7c085040 2024-05-08T18:52:32.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.322+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(56 notify.6 [create] v27'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7402b040 con 0x7f2d7c085040 2024-05-08T18:52:32.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.322+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93921180807056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e78a0 con 0x7f2d7c085040 2024-05-08T18:52:32.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.322+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e83c0 con 0x7f2d7c085040 2024-05-08T18:52:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.322+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93921180800912] v27'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7402b040 con 0x7f2d7c085040 2024-05-08T18:52:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.323+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(58 notify.7 [create] v27'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7402b040 con 0x7f2d7c085040 2024-05-08T18:52:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.323+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93921180807056] v27'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7402b040 con 0x7f2d7c085040 2024-05-08T18:52:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.323+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93921180810896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e8380 con 0x7f2d7c085040 2024-05-08T18:52:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.323+0000 7f2d8dc36800 20 add_watcher() i=0 2024-05-08T18:52:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.323+0000 7f2d8dc36800 20 add_watcher() i=1 2024-05-08T18:52:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.323+0000 7f2d8dc36800 20 add_watcher() i=2 2024-05-08T18:52:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.323+0000 7f2d8dc36800 20 add_watcher() i=3 2024-05-08T18:52:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.323+0000 7f2d8dc36800 20 add_watcher() i=4 2024-05-08T18:52:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.323+0000 7f2d8dc36800 20 add_watcher() i=5 2024-05-08T18:52:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.323+0000 7f2d8dc36800 20 add_watcher() i=6 2024-05-08T18:52:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.324+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93921180810896] v27'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7402b040 con 0x7f2d7c085040 2024-05-08T18:52:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.324+0000 7f2d8dc36800 20 add_watcher() i=7 2024-05-08T18:52:32.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.324+0000 7f2d8dc36800 2 all 8 watchers are set, enabling cache 2024-05-08T18:52:32.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.324+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e6580 con 0x556bba9d6df0 2024-05-08T18:52:32.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.324+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2d7402b040 con 0x556bba9d6df0 2024-05-08T18:52:32.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.324+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93921180808112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e8ad0 con 0x556bba9d6df0 2024-05-08T18:52:32.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.325+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93921180808112] v27'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2d7402b040 con 0x556bba9d6df0 2024-05-08T18:52:32.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.325+0000 7f2c41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:32.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.325+0000 7f2d8dc36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:32.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.325+0000 7f2d8dc36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:32.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.325+0000 7f2d8dc36800 5 note: GC not initialized 2024-05-08T18:52:32.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.326+0000 7f2c40fe1640 20 reqs_thread_entry: start 2024-05-08T18:52:32.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.326+0000 7f2d8dc36800 20 init_complete bucket index max shards: 11 2024-05-08T18:52:32.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.326+0000 7f2d8dc36800 20 Filter name: none 2024-05-08T18:52:32.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.326+0000 7f2bba7fc640 20 reqs_thread_entry: start 2024-05-08T18:52:32.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.326+0000 7f2d8dc36800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-05-08T18:52:32.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.326+0000 7f2d8dc36800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.326+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556bbaa1e7f0 con 0x7f2d7c085040 2024-05-08T18:52:32.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.326+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f2d7402b040 con 0x7f2d7c085040 2024-05-08T18:52:32.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.326+0000 7f2d8dc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.326+0000 7f2d8dc36800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-05-08T18:52:32.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.326+0000 7f2d8dc36800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-08T18:52:32.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.326+0000 7f2d8dc36800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-05-08T18:52:32.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.327+0000 7f2d8dc36800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.327+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556bbaa1cf90 con 0x556bba9db7e0 2024-05-08T18:52:32.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.327+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f2d8402a070 con 0x556bba9db7e0 2024-05-08T18:52:32.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.327+0000 7f2d8dc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.327+0000 7f2d8dc36800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-05-08T18:52:32.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.327+0000 7f2d8dc36800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-05-08T18:52:32.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.327+0000 7f2d8dc36800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-05-08T18:52:32.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.327+0000 7f2d8dc36800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-05-08T18:52:32.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.327+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bbaa1d830 con 0x7f2d7c085040 2024-05-08T18:52:32.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.328+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v27'11 uv11 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f2d7402b040 con 0x7f2d7c085040 2024-05-08T18:52:32.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.328+0000 7f2d8dc36800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-05-08T18:52:32.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.328+0000 7f2d8dc36800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-08T18:52:32.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.328+0000 7f2d8dc36800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-05-08T18:52:32.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.328+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93921181029248 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556bbaa22130 con 0x7f2d84014070 2024-05-08T18:52:32.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.328+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== watch-notify(notify (1) cookie 93921180784384 notify 115964117041 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7f2d7c09c040 con 0x7f2d84014070 2024-05-08T18:52:32.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.328+0000 7f2c6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117041 cookie 93921180784384 notifier 4837 bl.length()=533 2024-05-08T18:52:32.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.329+0000 7f2c6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-05-08T18:52:32.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.329+0000 7f2c6effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-08T18:52:32.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.329+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(65 notify.0 [notify cookie 93921181029248 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2d7c075030 con 0x7f2d84014070 2024-05-08T18:52:32.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.329+0000 7f2c6effd640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f2c50003ea0 con 0x7f2d84014070 2024-05-08T18:52:32.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.329+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7c075030 con 0x7f2d84014070 2024-05-08T18:52:32.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.329+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== watch-notify(notify_complete (2) cookie 93921181029248 notify 115964117041 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556bba99e780 con 0x7f2d84014070 2024-05-08T18:52:32.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.329+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bbaa1d380 con 0x556bba9db7e0 2024-05-08T18:52:32.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.330+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v27'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f2d8402a070 con 0x556bba9db7e0 2024-05-08T18:52:32.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.330+0000 7f2d8dc36800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-05-08T18:52:32.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.330+0000 7f2d8dc36800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-05-08T18:52:32.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.330+0000 7f2d8dc36800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-05-08T18:52:32.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.330+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 93921181029248 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556bbaa22130 con 0x556bba9d6df0 2024-05-08T18:52:32.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.330+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== watch-notify(notify (1) cookie 93921180791456 notify 115964117014 ret 0) ==== 218+0+0 (crc 0 0 0) 0x556bbaa1dbd0 con 0x556bba9d6df0 2024-05-08T18:52:32.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.330+0000 7f2c6e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117014 cookie 93921180791456 notifier 4837 bl.length()=176 2024-05-08T18:52:32.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.330+0000 7f2c6e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-05-08T18:52:32.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.330+0000 7f2c6e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-05-08T18:52:32.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.330+0000 7f2c6e7fc640 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f2bc0003400 con 0x556bba9d6df0 2024-05-08T18:52:32.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.330+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(68 notify.1 [notify cookie 93921181029248 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2d7402b040 con 0x556bba9d6df0 2024-05-08T18:52:32.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.331+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7402b040 con 0x556bba9d6df0 2024-05-08T18:52:32.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.331+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== watch-notify(notify_complete (2) cookie 93921181029248 notify 115964117014 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556bbaa1e240 con 0x556bba9d6df0 2024-05-08T18:52:32.340 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-05-08T18:52:32.328382Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:52:32.328370Z","tags":[],"group_ids":[]} 2024-05-08T18:52:32.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.331+0000 7f2c41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:32.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.331+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93921180808112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9d39d0 con 0x556bba9d6df0 2024-05-08T18:52:32.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.332+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93921180808112] v27'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2d7402b040 con 0x556bba9d6df0 2024-05-08T18:52:32.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.332+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93921180784384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e73b0 con 0x7f2d84014070 2024-05-08T18:52:32.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.333+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93921180784384] v27'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7c075030 con 0x7f2d84014070 2024-05-08T18:52:32.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.333+0000 7f2d8dc36800 20 remove_watcher() i=0 2024-05-08T18:52:32.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.333+0000 7f2d8dc36800 2 removed watcher, disabling cache 2024-05-08T18:52:32.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.333+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93921180791456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e73b0 con 0x556bba9d6df0 2024-05-08T18:52:32.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.335+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93921180791456] v27'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7402b040 con 0x556bba9d6df0 2024-05-08T18:52:32.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.335+0000 7f2d8dc36800 20 remove_watcher() i=1 2024-05-08T18:52:32.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.335+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93921180793712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e73b0 con 0x556bba9db7e0 2024-05-08T18:52:32.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.336+0000 7f2d8bf2f640 1 -- 172.21.15.132:0/2168159472 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93921180793712] v27'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d8402a070 con 0x556bba9db7e0 2024-05-08T18:52:32.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.336+0000 7f2d8dc36800 20 remove_watcher() i=2 2024-05-08T18:52:32.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.336+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93921180798576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e3b70 con 0x7f2d84014070 2024-05-08T18:52:32.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.337+0000 7f2d8b72e640 1 -- 172.21.15.132:0/2168159472 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93921180798576] v27'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7c075030 con 0x7f2d84014070 2024-05-08T18:52:32.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.337+0000 7f2d8dc36800 20 remove_watcher() i=3 2024-05-08T18:52:32.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.337+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93921180792512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e73b0 con 0x556bba9d6df0 2024-05-08T18:52:32.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.338+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93921180792512] v27'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7402b040 con 0x556bba9d6df0 2024-05-08T18:52:32.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.338+0000 7f2d8dc36800 20 remove_watcher() i=4 2024-05-08T18:52:32.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.338+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93921180800912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e4e70 con 0x7f2d7c085040 2024-05-08T18:52:32.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.339+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93921180800912] v27'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7402b040 con 0x7f2d7c085040 2024-05-08T18:52:32.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.339+0000 7f2d8dc36800 20 remove_watcher() i=5 2024-05-08T18:52:32.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.339+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93921180807056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e73b0 con 0x7f2d7c085040 2024-05-08T18:52:32.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.340+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93921180807056] v27'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7402b040 con 0x7f2d7c085040 2024-05-08T18:52:32.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.340+0000 7f2d8dc36800 20 remove_watcher() i=6 2024-05-08T18:52:32.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.340+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93921180810896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556bba9e4e70 con 0x7f2d7c085040 2024-05-08T18:52:32.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.341+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93921180810896] v27'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d7402b040 con 0x7f2d7c085040 2024-05-08T18:52:32.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.341+0000 7f2d8dc36800 20 remove_watcher() i=7 2024-05-08T18:52:32.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.341+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2d7c085040 msgr2=0x7f2d7c092700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.341+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f2d7c085040 0x7f2d7c092700 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.341+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x556bba9d6df0 msgr2=0x556bba9d92b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.341+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x556bba9d6df0 0x556bba9d92b0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.341+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2d84014070 msgr2=0x7f2d840439b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.341+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f2d84014070 0x7f2d840439b0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.341+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556bba9db7e0 msgr2=0x556bba9ddbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.341+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556bba9db7e0 0x556bba9ddbd0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2c5403bb50 msgr2=0x7f2c5403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2c5403bb50 0x7f2c5403e010 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c05c720 tx=0x7f2d7c089000 comp rx=0 tx=0).stop 2024-05-08T18:52:32.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba9c3af0 msgr2=0x556bba9cb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d83fff640 1 -- 172.21.15.132:0/2168159472 reap_dead start 2024-05-08T18:52:32.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba9c3af0 0x556bba9cb0d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2d84016c90 tx=0x7f2d84052c60 comp rx=0 tx=0).stop 2024-05-08T18:52:32.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 shutdown_connections 2024-05-08T18:52:32.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/2168159472 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba9c3af0 0x556bba9cb0d0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 >> 172.21.15.132:0/2168159472 conn(0x556bba9bfe50 msgr2=0x556bba9bd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 shutdown_connections 2024-05-08T18:52:32.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 -- 172.21.15.132:0/2168159472 wait complete. 2024-05-08T18:52:32.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 -- 172.21.15.132:0/4250284093 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2c6403bb50 msgr2=0x7f2c6403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/4250284093 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2c6403bb50 0x7f2c6403e010 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x556bba9a2f40 tx=0x7f2d7c05d740 comp rx=0 tx=0).stop 2024-05-08T18:52:32.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 -- 172.21.15.132:0/4250284093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba9b6810 msgr2=0x556bba9b6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/4250284093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba9b6810 0x556bba9b6c30 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x556bba9a2ea0 tx=0x7f2d84018830 comp rx=0 tx=0).stop 2024-05-08T18:52:32.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 -- 172.21.15.132:0/4250284093 shutdown_connections 2024-05-08T18:52:32.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/4250284093 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2c6403bb50 0x7f2c6403e010 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/4250284093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba9b6810 0x556bba9b6c30 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 -- 172.21.15.132:0/4250284093 >> 172.21.15.132:0/4250284093 conn(0x556bba9aa8b0 msgr2=0x556bba9aacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 -- 172.21.15.132:0/4250284093 shutdown_connections 2024-05-08T18:52:32.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 -- 172.21.15.132:0/4250284093 wait complete. 2024-05-08T18:52:32.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 -- 172.21.15.132:0/3412730630 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x556bba8a36c0 msgr2=0x556bba9a2540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/3412730630 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x556bba8a36c0 0x556bba9a2540 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 -- 172.21.15.132:0/3412730630 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556bba9a4df0 msgr2=0x556bba9a71e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.342+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/3412730630 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556bba9a4df0 0x556bba9a71e0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.343+0000 7f2d8dc36800 1 -- 172.21.15.132:0/3412730630 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2c7003bba0 msgr2=0x7f2c7003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.343+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/3412730630 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2c7003bba0 0x7f2c7003e060 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2d74000f60 tx=0x7f2d74001370 comp rx=0 tx=0).stop 2024-05-08T18:52:32.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.343+0000 7f2d8dc36800 1 -- 172.21.15.132:0/3412730630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba8a0d90 msgr2=0x556bba99b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.343+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/3412730630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba8a0d90 0x556bba99b350 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0524f0 tx=0x7f2d7c003020 comp rx=0 tx=0).stop 2024-05-08T18:52:32.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.343+0000 7f2d8dc36800 1 -- 172.21.15.132:0/3412730630 shutdown_connections 2024-05-08T18:52:32.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.343+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/3412730630 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x556bba9a4df0 0x556bba9a71e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.343+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/3412730630 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x556bba8a36c0 0x556bba9a2540 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.343+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/3412730630 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f2c7003bba0 0x7f2c7003e060 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.343+0000 7f2d8dc36800 1 --2- 172.21.15.132:0/3412730630 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x556bba8a0d90 0x556bba99b350 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.343+0000 7f2d8dc36800 1 -- 172.21.15.132:0/3412730630 >> 172.21.15.132:0/3412730630 conn(0x556bba89a6e0 msgr2=0x556bba89f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.343+0000 7f2d8dc36800 1 -- 172.21.15.132:0/3412730630 shutdown_connections 2024-05-08T18:52:32.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.343+0000 7f2d8dc36800 1 -- 172.21.15.132:0/3412730630 wait complete. 2024-05-08T18:52:32.352 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-05-08T18:52:32.328382Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:32.328370Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:32.352 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-05-08T18:52:32.328382Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:32.328370Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:32.352 ERROR:root:0 2024-05-08T18:52:32.352 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:52:32.356 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:52:32.357 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-05-08T18:52:32.357 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-05-08T18:52:32.357 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-05-08T18:52:32.401 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:32.401 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:32.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.402+0000 7fbffe936800 1 Processor -- start 2024-05-08T18:52:32.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.402+0000 7fbffe936800 1 -- start start 2024-05-08T18:52:32.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.403+0000 7fbffe936800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55db86f86b60 0x55db86f86f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.403+0000 7fbffe936800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55db86efbee0 con 0x55db86f874c0 2024-05-08T18:52:32.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.403+0000 7fbffe936800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55db86e28e20 con 0x55db86f86b60 2024-05-08T18:52:32.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.403+0000 7fbffa6c5640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55db86f86b60 0x55db86f86f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.403+0000 7fbffa6c5640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55db86f86b60 0x55db86f86f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53288/0 (socket says 172.21.15.132:53288) 2024-05-08T18:52:32.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.403+0000 7fbffa6c5640 1 -- 172.21.15.132:0/3411967474 learned_addr learned my addr 172.21.15.132:0/3411967474 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.403+0000 7fbff1ec4640 1 --1- 172.21.15.132:0/3411967474 >> v1:172.21.15.42:6789/0 conn(0x55db86f874c0 0x55db86f87970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48146/0 (socket says 172.21.15.132:48146) 2024-05-08T18:52:32.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.403+0000 7fbffa6c5640 1 -- 172.21.15.132:0/3411967474 >> v1:172.21.15.42:6789/0 conn(0x55db86f874c0 legacy=0x55db86f87970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.403+0000 7fbffa6c5640 1 -- 172.21.15.132:0/3411967474 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db86f88080 con 0x55db86f86b60 2024-05-08T18:52:32.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.405+0000 7fbffa6c5640 1 --2- 172.21.15.132:0/3411967474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db86f86b60 0x55db86f86f80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fbfec00a520 tx=0x7fbfec01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125cf4a66010401e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.405+0000 7fbff9ec4640 1 -- 172.21.15.132:0/3411967474 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfec057070 con 0x55db86f86b60 2024-05-08T18:52:32.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.405+0000 7fbff9ec4640 1 -- 172.21.15.132:0/3411967474 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfec052570 con 0x55db86f86b60 2024-05-08T18:52:32.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.405+0000 7fbff9ec4640 1 -- 172.21.15.132:0/3411967474 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfec04ae60 con 0x55db86f86b60 2024-05-08T18:52:32.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.406+0000 7fbffe936800 1 -- 172.21.15.132:0/3411967474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db86f86b60 msgr2=0x55db86f86f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.406+0000 7fbffe936800 1 --2- 172.21.15.132:0/3411967474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db86f86b60 0x55db86f86f80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fbfec00a520 tx=0x7fbfec01d010 comp rx=0 tx=0).stop 2024-05-08T18:52:32.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.406+0000 7fbffe936800 1 -- 172.21.15.132:0/3411967474 shutdown_connections 2024-05-08T18:52:32.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.406+0000 7fbffe936800 1 --2- 172.21.15.132:0/3411967474 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db86f86b60 0x55db86f86f80 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.406+0000 7fbffe936800 1 -- 172.21.15.132:0/3411967474 >> 172.21.15.132:0/3411967474 conn(0x55db86f826a0 msgr2=0x55db86f84b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.406+0000 7fbffe936800 1 -- 172.21.15.132:0/3411967474 shutdown_connections 2024-05-08T18:52:32.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.406+0000 7fbffe936800 1 -- 172.21.15.132:0/3411967474 wait complete. 2024-05-08T18:52:32.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.419+0000 7fbffe936800 1 Processor -- start 2024-05-08T18:52:32.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.419+0000 7fbffe936800 1 -- start start 2024-05-08T18:52:32.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.420+0000 7fbffe936800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db86f86b60 0x55db8707ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.420+0000 7fbffe936800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55db86ed35b0 con 0x55db86f86b60 2024-05-08T18:52:32.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.420+0000 7fbffa6c5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db86f86b60 0x55db8707ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.420+0000 7fbffa6c5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db86f86b60 0x55db8707ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53304/0 (socket says 172.21.15.132:53304) 2024-05-08T18:52:32.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.420+0000 7fbffa6c5640 1 -- 172.21.15.132:0/4149516393 learned_addr learned my addr 172.21.15.132:0/4149516393 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.420+0000 7fbffa6c5640 1 -- 172.21.15.132:0/4149516393 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db8707c030 con 0x55db86f86b60 2024-05-08T18:52:32.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.421+0000 7fbffa6c5640 1 --2- 172.21.15.132:0/4149516393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db86f86b60 0x55db8707ba60 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fbfec055040 tx=0x7fbfec04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3caeeccd0dbe5d73 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.421+0000 7fbee8608640 1 -- 172.21.15.132:0/4149516393 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfec057040 con 0x55db86f86b60 2024-05-08T18:52:32.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.421+0000 7fbee8608640 1 -- 172.21.15.132:0/4149516393 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfec052720 con 0x55db86f86b60 2024-05-08T18:52:32.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.421+0000 7fbee8608640 1 -- 172.21.15.132:0/4149516393 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfec052a20 con 0x55db86f86b60 2024-05-08T18:52:32.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.422+0000 7fbffe936800 1 -- 172.21.15.132:0/4149516393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db86f86b60 msgr2=0x55db8707ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.422+0000 7fbffe936800 1 --2- 172.21.15.132:0/4149516393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db86f86b60 0x55db8707ba60 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fbfec055040 tx=0x7fbfec04c000 comp rx=0 tx=0).stop 2024-05-08T18:52:32.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.422+0000 7fbffe936800 1 -- 172.21.15.132:0/4149516393 shutdown_connections 2024-05-08T18:52:32.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.422+0000 7fbffe936800 1 --2- 172.21.15.132:0/4149516393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db86f86b60 0x55db8707ba60 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.422+0000 7fbffe936800 1 -- 172.21.15.132:0/4149516393 >> 172.21.15.132:0/4149516393 conn(0x55db86f826a0 msgr2=0x55db87077380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.422+0000 7fbffe936800 1 -- 172.21.15.132:0/4149516393 shutdown_connections 2024-05-08T18:52:32.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.422+0000 7fbffe936800 1 -- 172.21.15.132:0/4149516393 wait complete. 2024-05-08T18:52:32.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.422+0000 7fbffe936800 1 Processor -- start 2024-05-08T18:52:32.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.422+0000 7fbffe936800 1 -- start start 2024-05-08T18:52:32.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.422+0000 7fbffe936800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db86f86b60 0x55db870834e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.422+0000 7fbffe936800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55db86f885b0 con 0x55db86f86b60 2024-05-08T18:52:32.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.422+0000 7fbffa6c5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db86f86b60 0x55db870834e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.422+0000 7fbffa6c5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db86f86b60 0x55db870834e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53308/0 (socket says 172.21.15.132:53308) 2024-05-08T18:52:32.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.422+0000 7fbffa6c5640 1 -- 172.21.15.132:0/3907391933 learned_addr learned my addr 172.21.15.132:0/3907391933 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.423+0000 7fbffa6c5640 1 -- 172.21.15.132:0/3907391933 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db87083a20 con 0x55db86f86b60 2024-05-08T18:52:32.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.423+0000 7fbffa6c5640 1 --2- 172.21.15.132:0/3907391933 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db86f86b60 0x55db870834e0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fbfec052540 tx=0x7fbfec003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.423+0000 7fbee6e05640 1 -- 172.21.15.132:0/3907391933 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfec073070 con 0x55db86f86b60 2024-05-08T18:52:32.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.423+0000 7fbee6e05640 1 -- 172.21.15.132:0/3907391933 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfec05d440 con 0x55db86f86b60 2024-05-08T18:52:32.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.423+0000 7fbffe936800 1 -- 172.21.15.132:0/3907391933 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55db87083cb0 con 0x55db86f86b60 2024-05-08T18:52:32.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.423+0000 7fbee6e05640 1 -- 172.21.15.132:0/3907391933 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfec057070 con 0x55db86f86b60 2024-05-08T18:52:32.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.423+0000 7fbffe936800 1 -- 172.21.15.132:0/3907391933 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db87086960 con 0x55db86f86b60 2024-05-08T18:52:32.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.424+0000 7fbee6e05640 1 -- 172.21.15.132:0/3907391933 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fbfec076070 con 0x55db86f86b60 2024-05-08T18:52:32.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.424+0000 7fbee6e05640 1 --2- 172.21.15.132:0/3907391933 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbee003bba0 0x7fbee003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.424+0000 7fbee6e05640 1 -- 172.21.15.132:0/3907391933 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fbfec093f30 con 0x55db86f86b60 2024-05-08T18:52:32.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.424+0000 7fbff1ec4640 1 --2- 172.21.15.132:0/3907391933 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbee003bba0 0x7fbee003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.424+0000 7fbffe936800 1 --2- 172.21.15.132:0/3907391933 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55db86f874c0 0x55db8708a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.424+0000 7fbffe936800 1 -- 172.21.15.132:0/3907391933 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55db8708ac60 con 0x55db86f874c0 2024-05-08T18:52:32.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.424+0000 7fbffaec6640 1 --2- 172.21.15.132:0/3907391933 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55db86f874c0 0x55db8708a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.425+0000 7fbff1ec4640 1 --2- 172.21.15.132:0/3907391933 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbee003bba0 0x7fbee003e060 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4000f60 tx=0x7fbfe4001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.425+0000 7fbffaec6640 1 --2- 172.21.15.132:0/3907391933 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55db86f874c0 0x55db8708a720 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.425+0000 7fbffaec6640 1 -- 172.21.15.132:0/3907391933 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbff400a4a0 con 0x55db86f874c0 2024-05-08T18:52:32.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.425+0000 7fbffe936800 1 -- 172.21.15.132:0/3907391933 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55db87087cf0 con 0x55db86f874c0 2024-05-08T18:52:32.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.425+0000 7fbffaec6640 1 -- 172.21.15.132:0/3907391933 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbff400a4a0 con 0x55db86f874c0 2024-05-08T18:52:32.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.425+0000 7fbffe936800 1 --2- 172.21.15.132:0/3907391933 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55db8708cf70 0x55db8708f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.425+0000 7fbffe936800 1 -- 172.21.15.132:0/3907391933 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55db8708fa50 con 0x55db8708cf70 2024-05-08T18:52:32.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.425+0000 7fbffa6c5640 1 --2- 172.21.15.132:0/3907391933 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55db8708cf70 0x55db8708f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.426+0000 7fbffa6c5640 1 --2- 172.21.15.132:0/3907391933 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55db8708cf70 0x55db8708f360 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.426+0000 7fbffa6c5640 1 -- 172.21.15.132:0/3907391933 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbfec075030 con 0x55db8708cf70 2024-05-08T18:52:32.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.426+0000 7fbffe936800 1 -- 172.21.15.132:0/3907391933 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55db8708be10 con 0x55db86f874c0 2024-05-08T18:52:32.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.426+0000 7fbffaec6640 1 -- 172.21.15.132:0/3907391933 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbff400a4a0 con 0x55db86f874c0 2024-05-08T18:52:32.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.426+0000 7fbffe936800 1 -- 172.21.15.132:0/3907391933 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55db8708c2f0 con 0x55db86f874c0 2024-05-08T18:52:32.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.426+0000 7fbffaec6640 1 -- 172.21.15.132:0/3907391933 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbff400a4a0 con 0x55db86f874c0 2024-05-08T18:52:32.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.427+0000 7fbffe936800 1 Processor -- start 2024-05-08T18:52:32.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.427+0000 7fbffe936800 1 -- start start 2024-05-08T18:52:32.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.427+0000 7fbffe936800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db8709e990 0x55db8709edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.427+0000 7fbffe936800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55db86e79fc0 con 0x55db8709e990 2024-05-08T18:52:32.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.427+0000 7fbffaec6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db8709e990 0x55db8709edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.427+0000 7fbffaec6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db8709e990 0x55db8709edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53316/0 (socket says 172.21.15.132:53316) 2024-05-08T18:52:32.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.427+0000 7fbffaec6640 1 -- 172.21.15.132:0/3026824126 learned_addr learned my addr 172.21.15.132:0/3026824126 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.428+0000 7fbffaec6640 1 -- 172.21.15.132:0/3026824126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db8709f2f0 con 0x55db8709e990 2024-05-08T18:52:32.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.428+0000 7fbffaec6640 1 --2- 172.21.15.132:0/3026824126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db8709e990 0x55db8709edb0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fbff40056c0 tx=0x7fbff4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.428+0000 7fbedffff640 1 -- 172.21.15.132:0/3026824126 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbff4005050 con 0x55db8709e990 2024-05-08T18:52:32.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.428+0000 7fbedffff640 1 -- 172.21.15.132:0/3026824126 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff40051f0 con 0x55db8709e990 2024-05-08T18:52:32.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.428+0000 7fbffe936800 1 -- 172.21.15.132:0/3026824126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55db8709fd60 con 0x55db8709e990 2024-05-08T18:52:32.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.428+0000 7fbedffff640 1 -- 172.21.15.132:0/3026824126 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbff40054d0 con 0x55db8709e990 2024-05-08T18:52:32.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.428+0000 7fbffe936800 1 -- 172.21.15.132:0/3026824126 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db870a0260 con 0x55db8709e990 2024-05-08T18:52:32.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.429+0000 7fbedffff640 1 -- 172.21.15.132:0/3026824126 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fbff4011040 con 0x55db8709e990 2024-05-08T18:52:32.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.429+0000 7fbedffff640 1 --2- 172.21.15.132:0/3026824126 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbed403bab0 0x7fbed403df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.429+0000 7fbedffff640 1 -- 172.21.15.132:0/3026824126 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fbff401e070 con 0x55db8709e990 2024-05-08T18:52:32.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.429+0000 7fbffa6c5640 1 --2- 172.21.15.132:0/3026824126 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbed403bab0 0x7fbed403df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.429+0000 7fbffe936800 1 Processor -- start 2024-05-08T18:52:32.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.429+0000 7fbffa6c5640 1 --2- 172.21.15.132:0/3026824126 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbed403bab0 0x7fbed403df70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x55db8708b0c0 tx=0x7fbfec05df20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.429+0000 7fbffe936800 1 -- start start 2024-05-08T18:52:32.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.430+0000 7fbffe936800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db870abc40 0x55db870ac060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.430+0000 7fbffe936800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55db8707c2f0 con 0x55db870abc40 2024-05-08T18:52:32.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.430+0000 7fbffaec6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db870abc40 0x55db870ac060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.430+0000 7fbffaec6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db870abc40 0x55db870ac060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53326/0 (socket says 172.21.15.132:53326) 2024-05-08T18:52:32.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.430+0000 7fbffaec6640 1 -- 172.21.15.132:0/3623049490 learned_addr learned my addr 172.21.15.132:0/3623049490 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.430+0000 7fbffaec6640 1 -- 172.21.15.132:0/3623049490 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db870ac630 con 0x55db870abc40 2024-05-08T18:52:32.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.430+0000 7fbffaec6640 1 --2- 172.21.15.132:0/3623049490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db870abc40 0x55db870ac060 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbff402bd90 tx=0x7fbff4015830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2009ea7455d7c5b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.430+0000 7fbeddffb640 1 -- 172.21.15.132:0/3623049490 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbff4013ac0 con 0x55db870abc40 2024-05-08T18:52:32.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.431+0000 7fbeddffb640 1 -- 172.21.15.132:0/3623049490 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff4050030 con 0x55db870abc40 2024-05-08T18:52:32.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.431+0000 7fbeddffb640 1 -- 172.21.15.132:0/3623049490 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbff4013dd0 con 0x55db870abc40 2024-05-08T18:52:32.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.431+0000 7fbffe936800 1 -- 172.21.15.132:0/3623049490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db870abc40 msgr2=0x55db870ac060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.431+0000 7fbffe936800 1 --2- 172.21.15.132:0/3623049490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db870abc40 0x55db870ac060 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbff402bd90 tx=0x7fbff4015830 comp rx=0 tx=0).stop 2024-05-08T18:52:32.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.431+0000 7fbffe936800 1 -- 172.21.15.132:0/3623049490 shutdown_connections 2024-05-08T18:52:32.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.431+0000 7fbffe936800 1 --2- 172.21.15.132:0/3623049490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db870abc40 0x55db870ac060 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.431+0000 7fbffe936800 1 -- 172.21.15.132:0/3623049490 >> 172.21.15.132:0/3623049490 conn(0x55db870a7ff0 msgr2=0x55db870a6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.431+0000 7fbffe936800 1 -- 172.21.15.132:0/3623049490 shutdown_connections 2024-05-08T18:52:32.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.431+0000 7fbffe936800 1 -- 172.21.15.132:0/3623049490 wait complete. 2024-05-08T18:52:32.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.431+0000 7fbffe936800 1 Processor -- start 2024-05-08T18:52:32.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.431+0000 7fbffe936800 1 -- start start 2024-05-08T18:52:32.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.432+0000 7fbffe936800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db870abc40 0x55db870b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.432+0000 7fbffe936800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55db870acd90 con 0x55db870abc40 2024-05-08T18:52:32.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.432+0000 7fbffaec6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db870abc40 0x55db870b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.432+0000 7fbffaec6640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db870abc40 0x55db870b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53342/0 (socket says 172.21.15.132:53342) 2024-05-08T18:52:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.432+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 learned_addr learned my addr 172.21.15.132:0/581093654 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.432+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db870b37d0 con 0x55db870abc40 2024-05-08T18:52:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.432+0000 7fbffaec6640 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db870abc40 0x55db870b3290 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbff402bd90 tx=0x7fbff4052e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.432+0000 7fbecbfff640 1 -- 172.21.15.132:0/581093654 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbff4004600 con 0x55db870abc40 2024-05-08T18:52:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.432+0000 7fbecbfff640 1 -- 172.21.15.132:0/581093654 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff40047a0 con 0x55db870abc40 2024-05-08T18:52:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.432+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55db870b3a60 con 0x55db870abc40 2024-05-08T18:52:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.432+0000 7fbecbfff640 1 -- 172.21.15.132:0/581093654 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbff4004a80 con 0x55db870abc40 2024-05-08T18:52:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.432+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db870b6710 con 0x55db870abc40 2024-05-08T18:52:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.433+0000 7fbecbfff640 1 -- 172.21.15.132:0/581093654 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fbff403f390 con 0x55db870abc40 2024-05-08T18:52:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.433+0000 7fbecbfff640 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbec403bb50 0x7fbec403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.433+0000 7fbecbfff640 1 -- 172.21.15.132:0/581093654 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fbff400e040 con 0x55db870abc40 2024-05-08T18:52:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.433+0000 7fbffa6c5640 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbec403bb50 0x7fbec403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.434+0000 7fbffa6c5640 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbec403bb50 0x7fbec403e010 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbfec092670 tx=0x7fbfec084000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.434+0000 7fbffe936800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.434+0000 7fbffe936800 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55db870bef20 0x55db870c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.434+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55db870c1b30 con 0x55db870bef20 2024-05-08T18:52:32.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.434+0000 7fbff1ec4640 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55db870bef20 0x55db870c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.434+0000 7fbff1ec4640 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55db870bef20 0x55db870c13e0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.435+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfe400f610 con 0x55db870bef20 2024-05-08T18:52:32.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.435+0000 7fbffe936800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.435+0000 7fbffe936800 20 realm 2024-05-08T18:52:32.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.435+0000 7fbffe936800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.435+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55db870be370 con 0x55db870bef20 2024-05-08T18:52:32.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.435+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfe400f610 con 0x55db870bef20 2024-05-08T18:52:32.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.435+0000 7fbffe936800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.435+0000 7fbffe936800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:52:32.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.435+0000 7fbffe936800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.435+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55db870c2620 con 0x55db870bef20 2024-05-08T18:52:32.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.435+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfe400f610 con 0x55db870bef20 2024-05-08T18:52:32.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.435+0000 7fbffe936800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.435+0000 7fbffe936800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.435+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55db870c2ef0 con 0x55db870bef20 2024-05-08T18:52:32.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.435+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbfe400f610 con 0x55db870bef20 2024-05-08T18:52:32.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.435+0000 7fbffe936800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:32.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.435+0000 7fbffe936800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.435+0000 7fbffe936800 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55db870c3910 0x55db870c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.435+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55db870c63f0 con 0x55db870c3910 2024-05-08T18:52:32.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.435+0000 7fbffaec6640 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55db870c3910 0x55db870c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.436+0000 7fbffaec6640 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55db870c3910 0x55db870c5d00 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.436+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.436+0000 7fbffe936800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:52:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.436+0000 7fbffe936800 20 searching for the correct realm 2024-05-08T18:52:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.436+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x55db870c3910 2024-05-08T18:52:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.436+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.436+0000 7fbffaec6640 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fbff4014070 0x7fbff403faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.436+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x7fbff4014070 2024-05-08T18:52:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.437+0000 7fbffa6c5640 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fbff4014070 0x7fbff403faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.437+0000 7fbffa6c5640 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fbff4014070 0x7fbff403faa0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.437+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.437+0000 7fbffa6c5640 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fbfec078060 0x7fbfec078440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.437+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x7fbfec078060 2024-05-08T18:52:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.437+0000 7fbff1ec4640 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fbfec078060 0x7fbfec078440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.438+0000 7fbff1ec4640 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fbfec078060 0x7fbfec078440 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.438+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfe400f610 con 0x7fbfec078060 2024-05-08T18:52:32.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.438+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x55db870bef20 2024-05-08T18:52:32.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.438+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfe400f610 con 0x55db870bef20 2024-05-08T18:52:32.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.439+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x55db870bef20 2024-05-08T18:52:32.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.439+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.439+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x7fbfec078060 2024-05-08T18:52:32.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.439+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.439+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x7fbfec078060 2024-05-08T18:52:32.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.439+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.439+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x7fbff4014070 2024-05-08T18:52:32.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.439+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.439+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x55db870c3910 2024-05-08T18:52:32.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.440+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.440+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x55db870bef20 2024-05-08T18:52:32.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.440+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.440+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x7fbfec078060 2024-05-08T18:52:32.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.440+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.440+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x55db870bef20 2024-05-08T18:52:32.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.441+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.441+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x7fbff4014070 2024-05-08T18:52:32.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.441+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.441+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x55db870c3910 2024-05-08T18:52:32.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.441+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v27'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.441+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x55db870c3910 2024-05-08T18:52:32.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.441+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.441+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x7fbfec078060 2024-05-08T18:52:32.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.442+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.442+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x55db870c3910 2024-05-08T18:52:32.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.442+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.442+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x55db870c3910 2024-05-08T18:52:32.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.442+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.442+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x55db870bef20 2024-05-08T18:52:32.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.442+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.442+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x55db870bef20 2024-05-08T18:52:32.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.442+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v27'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.442+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x7fbfec078060 2024-05-08T18:52:32.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.443+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.443+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x55db870c3910 2024-05-08T18:52:32.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.443+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.443+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x7fbff4014070 2024-05-08T18:52:32.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.443+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.443+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x55db870bef20 2024-05-08T18:52:32.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.444+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.444+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x7fbff4014070 2024-05-08T18:52:32.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.444+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.444+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x55db870c3910 2024-05-08T18:52:32.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.444+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.444+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x7fbfec078060 2024-05-08T18:52:32.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.444+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.444+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x7fbff4014070 2024-05-08T18:52:32.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.445+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.445+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x55db870c3910 2024-05-08T18:52:32.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.445+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.445+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x7fbfec078060 2024-05-08T18:52:32.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.445+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.445+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x55db870bef20 2024-05-08T18:52:32.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.446+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v27'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.446+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7d40 con 0x7fbff4014070 2024-05-08T18:52:32.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.446+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.446+0000 7fbffe936800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:52:32.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.446+0000 7fbffe936800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:52:32.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.446+0000 7fbffe936800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:52:32.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.446+0000 7fbffe936800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:52:32.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.446+0000 7fbffe936800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:52:32.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.446+0000 7fbffe936800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:52:32.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.446+0000 7fbffe936800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.446+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55db870c6db0 con 0x55db870bef20 2024-05-08T18:52:32.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.446+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.446+0000 7fbffe936800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.446+0000 7fbffe936800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.446+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55db870c7650 con 0x55db870bef20 2024-05-08T18:52:32.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.446+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.446+0000 7fbffe936800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:32.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.446+0000 7fbffe936800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.446+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55db870c81c0 con 0x55db870bef20 2024-05-08T18:52:32.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbffe936800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:52:32.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbffe936800 20 zone default found 2024-05-08T18:52:32.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbffe936800 4 Realm: () 2024-05-08T18:52:32.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbffe936800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:52:32.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbffe936800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:52:32.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbffe936800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:52:32.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbffe936800 20 zonegroup default 2024-05-08T18:52:32.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbffe936800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55db870c85a0 con 0x7fbff4014070 2024-05-08T18:52:32.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbffe936800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbffe936800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55db870ca870 con 0x55db870c3910 2024-05-08T18:52:32.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbffe936800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbffe936800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55db870cac10 con 0x55db870c3910 2024-05-08T18:52:32.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbffe936800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbffe936800 20 started sync module instance, tier type = 2024-05-08T18:52:32.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbffe936800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:52:32.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.447+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870c9cb0 con 0x7fbff4014070 2024-05-08T18:52:32.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.449+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.449+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94401351950496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870ca4c0 con 0x7fbff4014070 2024-05-08T18:52:32.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.449+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870cb5f0 con 0x55db870bef20 2024-05-08T18:52:32.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.450+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94401351950496] v27'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.450+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.450+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94401351953424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870cb9e0 con 0x55db870bef20 2024-05-08T18:52:32.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.450+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870cc450 con 0x55db870c3910 2024-05-08T18:52:32.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.451+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94401351953424] v27'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.451+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.451+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94401351958304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870cc410 con 0x55db870c3910 2024-05-08T18:52:32.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.451+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870cce80 con 0x7fbff4014070 2024-05-08T18:52:32.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.452+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.452+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94401351961008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870cd750 con 0x7fbff4014070 2024-05-08T18:52:32.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.452+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870ce250 con 0x55db870bef20 2024-05-08T18:52:32.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.452+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94401351958304] v27'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.453+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.453+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94401351966016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870ce640 con 0x55db870bef20 2024-05-08T18:52:32.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.453+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94401351961008] v27'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.453+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870cf080 con 0x7fbfec078060 2024-05-08T18:52:32.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.454+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94401351966016] v27'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.455+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.455+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94401351963376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870cb030 con 0x7fbfec078060 2024-05-08T18:52:32.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.455+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870cf660 con 0x7fbfec078060 2024-05-08T18:52:32.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.456+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94401351963376] v27'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.456+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.456+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94401351969616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870cf660 con 0x7fbfec078060 2024-05-08T18:52:32.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.456+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870cff10 con 0x7fbfec078060 2024-05-08T18:52:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.457+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(58 notify.7 [create] v27'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.457+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94401351973040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870d0380 con 0x7fbfec078060 2024-05-08T18:52:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.457+0000 7fbffe936800 20 add_watcher() i=0 2024-05-08T18:52:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.457+0000 7fbffe936800 20 add_watcher() i=1 2024-05-08T18:52:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.457+0000 7fbffe936800 20 add_watcher() i=2 2024-05-08T18:52:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.457+0000 7fbffe936800 20 add_watcher() i=3 2024-05-08T18:52:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.457+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94401351969616] v27'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.457+0000 7fbffe936800 20 add_watcher() i=4 2024-05-08T18:52:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.457+0000 7fbffe936800 20 add_watcher() i=5 2024-05-08T18:52:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.457+0000 7fbffe936800 20 add_watcher() i=6 2024-05-08T18:52:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.458+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94401351973040] v27'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.458+0000 7fbffe936800 20 add_watcher() i=7 2024-05-08T18:52:32.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.458+0000 7fbffe936800 2 all 8 watchers are set, enabling cache 2024-05-08T18:52:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.458+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55db870d0380 con 0x55db870bef20 2024-05-08T18:52:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.458+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.458+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94401351974608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870d02f0 con 0x55db870bef20 2024-05-08T18:52:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.459+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94401351974608] v27'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.459+0000 7fbeb0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.459+0000 7fbffe936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.459+0000 7fbffe936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.459+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dbd50 con 0x55db870bef20 2024-05-08T18:52:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.460+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.460+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dc3a0 con 0x7fbfec078060 2024-05-08T18:52:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.462+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.462+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dc7c0 con 0x55db870c3910 2024-05-08T18:52:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.463+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.463+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dcba0 con 0x55db870bef20 2024-05-08T18:52:32.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.464+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'246 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.464+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dcb40 con 0x7fbff4014070 2024-05-08T18:52:32.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.465+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'77 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.465+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dcee0 con 0x55db870c3910 2024-05-08T18:52:32.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.466+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'52 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.466+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd030 con 0x55db870bef20 2024-05-08T18:52:32.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.467+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.467+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd030 con 0x7fbfec078060 2024-05-08T18:52:32.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.468+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'53 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.468+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd030 con 0x7fbff4014070 2024-05-08T18:52:32.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.469+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.469+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x55db870c3910 2024-05-08T18:52:32.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.470+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.470+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x7fbff4014070 2024-05-08T18:52:32.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.471+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'78 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.471+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x7fbfec078060 2024-05-08T18:52:32.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.472+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'35 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.472+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x7fbff4014070 2024-05-08T18:52:32.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.473+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.473+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x7fbfec078060 2024-05-08T18:52:32.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.474+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'57 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.474+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x55db870bef20 2024-05-08T18:52:32.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.475+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'247 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.475+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x55db870c3910 2024-05-08T18:52:32.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.477+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'71 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.477+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x7fbff4014070 2024-05-08T18:52:32.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.478+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'79 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.478+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x55db870c3910 2024-05-08T18:52:32.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.479+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.479+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x55db870bef20 2024-05-08T18:52:32.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.480+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.480+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x55db870bef20 2024-05-08T18:52:32.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.481+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'248 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.481+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x55db870c3910 2024-05-08T18:52:32.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.482+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'72 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.482+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x7fbff4014070 2024-05-08T18:52:32.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.483+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.483+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x55db870c3910 2024-05-08T18:52:32.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.484+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.484+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x55db870c3910 2024-05-08T18:52:32.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.485+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'36 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.485+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x55db870c3910 2024-05-08T18:52:32.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.486+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.486+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x55db870c3910 2024-05-08T18:52:32.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.486+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'53 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.487+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x7fbfec078060 2024-05-08T18:52:32.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.488+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.488+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x55db870c3910 2024-05-08T18:52:32.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.489+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.489+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x7fbfec078060 2024-05-08T18:52:32.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.490+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'54 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.490+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x55db870c3910 2024-05-08T18:52:32.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.491+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'73 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.491+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x7fbfec078060 2024-05-08T18:52:32.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.492+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'58 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.492+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870dd6e0 con 0x7fbff4014070 2024-05-08T18:52:32.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.493+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.494+0000 7fbe2b7fe640 20 reqs_thread_entry: start 2024-05-08T18:52:32.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.494+0000 7fbffe936800 20 init_complete bucket index max shards: 11 2024-05-08T18:52:32.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.494+0000 7fbffe936800 20 Filter name: none 2024-05-08T18:52:32.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.494+0000 7fbe297fa640 20 reqs_thread_entry: start 2024-05-08T18:52:32.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.494+0000 7fbffe936800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-05-08T18:52:32.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.494+0000 7fbffe936800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.494+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55db87108540 con 0x7fbfec078060 2024-05-08T18:52:32.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.494+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.494+0000 7fbffe936800 20 rados_obj.operate() r=0 bl.length=349 2024-05-08T18:52:32.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.494+0000 7fbffe936800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-05-08T18:52:32.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.494+0000 7fbffe936800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-08T18:52:32.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.494+0000 7fbffe936800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:52:32.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.494+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55db8710ae70 con 0x7fbfec078060 2024-05-08T18:52:32.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.495+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.495+0000 7fbffe936800 10 removing key index: system_akey 2024-05-08T18:52:32.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.495+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db87108e50 con 0x55db870c3910 2024-05-08T18:52:32.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.496+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== osd_op_reply(96 system_akey [delete] v27'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.496+0000 7fbffe936800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-05-08T18:52:32.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.496+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94401352210864 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55db8710b290 con 0x55db870bef20 2024-05-08T18:52:32.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.496+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== watch-notify(notify (1) cookie 94401351953424 notify 115964117015 ret 0) ==== 203+0+0 (crc 0 0 0) 0x55db870db700 con 0x55db870bef20 2024-05-08T18:52:32.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.496+0000 7fbeddffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117015 cookie 94401351953424 notifier 4844 bl.length()=161 2024-05-08T18:52:32.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.496+0000 7fbeddffb640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fbec0003d60 con 0x55db870bef20 2024-05-08T18:52:32.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.496+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(97 notify.1 [notify cookie 94401352210864 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.496+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.496+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== watch-notify(notify_complete (2) cookie 94401352210864 notify 115964117015 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55db870dbd10 con 0x55db870bef20 2024-05-08T18:52:32.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.497+0000 7fbffe936800 10 removing email index: 2024-05-08T18:52:32.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.497+0000 7fbffe936800 10 removing user buckets index 2024-05-08T18:52:32.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.497+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db87108e00 con 0x7fbfec078060 2024-05-08T18:52:32.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.498+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(99 system_user.buckets [delete] v27'12 uv11 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.498+0000 7fbffe936800 10 removing user index: system_user 2024-05-08T18:52:32.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.498+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db8710cfa0 con 0x7fbfec078060 2024-05-08T18:52:32.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.499+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(100 system_user [call,call,delete] v27'13 uv13 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.499+0000 7fbffe936800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-05-08T18:52:32.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.499+0000 7fbffe936800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-05-08T18:52:32.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.499+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94401352223472 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55db8710cf10 con 0x7fbff4014070 2024-05-08T18:52:32.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.499+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 20 ==== watch-notify(notify (1) cookie 94401351950496 notify 115964117042 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55db870dbee0 con 0x7fbff4014070 2024-05-08T18:52:32.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.499+0000 7fbedd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117042 cookie 94401351950496 notifier 4844 bl.length()=160 2024-05-08T18:52:32.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.499+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 21 ==== osd_op_reply(101 notify.0 [notify cookie 94401352223472 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.499+0000 7fbedd7fa640 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fbe300032c0 con 0x7fbff4014070 2024-05-08T18:52:32.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.499+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 22 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.499+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 23 ==== watch-notify(notify_complete (2) cookie 94401352223472 notify 115964117042 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbfec09f040 con 0x7fbff4014070 2024-05-08T18:52:32.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.500+0000 7fbeb0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:32.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.500+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94401351974608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870d9bf0 con 0x55db870bef20 2024-05-08T18:52:32.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.501+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94401351974608] v27'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.501+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94401351950496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870cfed0 con 0x7fbff4014070 2024-05-08T18:52:32.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.502+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 24 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94401351950496] v27'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.502+0000 7fbffe936800 20 remove_watcher() i=0 2024-05-08T18:52:32.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.502+0000 7fbffe936800 2 removed watcher, disabling cache 2024-05-08T18:52:32.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.502+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94401351953424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870cfed0 con 0x55db870bef20 2024-05-08T18:52:32.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.503+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94401351953424] v27'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.503+0000 7fbffe936800 20 remove_watcher() i=1 2024-05-08T18:52:32.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.504+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94401351958304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870cac10 con 0x55db870c3910 2024-05-08T18:52:32.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.505+0000 7fbffaec6640 1 -- 172.21.15.132:0/581093654 <== osd.3 v2:172.21.15.132:6816/17827703 28 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94401351958304] v27'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbff402a070 con 0x55db870c3910 2024-05-08T18:52:32.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.505+0000 7fbffe936800 20 remove_watcher() i=2 2024-05-08T18:52:32.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.505+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94401351961008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870cfed0 con 0x7fbff4014070 2024-05-08T18:52:32.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.505+0000 7fbffa6c5640 1 -- 172.21.15.132:0/581093654 <== osd.2 v2:172.21.15.132:6808/1108348591 25 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94401351961008] v27'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfec075030 con 0x7fbff4014070 2024-05-08T18:52:32.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.506+0000 7fbffe936800 20 remove_watcher() i=3 2024-05-08T18:52:32.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.506+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94401351966016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870cbf20 con 0x55db870bef20 2024-05-08T18:52:32.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.507+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.1 v2:172.21.15.132:6800/3697320277 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94401351966016] v27'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x55db870bef20 2024-05-08T18:52:32.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.507+0000 7fbffe936800 20 remove_watcher() i=4 2024-05-08T18:52:32.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.507+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94401351963376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870cac10 con 0x7fbfec078060 2024-05-08T18:52:32.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.508+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94401351963376] v27'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.508+0000 7fbffe936800 20 remove_watcher() i=5 2024-05-08T18:52:32.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.508+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94401351969616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870cfed0 con 0x7fbfec078060 2024-05-08T18:52:32.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.509+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94401351969616] v27'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.509+0000 7fbffe936800 20 remove_watcher() i=6 2024-05-08T18:52:32.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.509+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94401351973040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55db870cdd40 con 0x7fbfec078060 2024-05-08T18:52:32.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.510+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 <== osd.0 v2:172.21.15.42:6800/1521799280 28 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94401351973040] v27'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbfe402b040 con 0x7fbfec078060 2024-05-08T18:52:32.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.510+0000 7fbffe936800 20 remove_watcher() i=7 2024-05-08T18:52:32.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.510+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fbfec078060 msgr2=0x7fbfec078440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.510+0000 7fbffe936800 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fbfec078060 0x7fbfec078440 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.510+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55db870bef20 msgr2=0x55db870c13e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.510+0000 7fbffe936800 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55db870bef20 0x55db870c13e0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.510+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fbff4014070 msgr2=0x7fbff403faa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.510+0000 7fbffe936800 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fbff4014070 0x7fbff403faa0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.510+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55db870c3910 msgr2=0x55db870c5d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.510+0000 7fbffe936800 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55db870c3910 0x55db870c5d00 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.510+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbec403bb50 msgr2=0x7fbec403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.510+0000 7fbffe936800 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbec403bb50 0x7fbec403e010 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbfec092670 tx=0x7fbfec084000 comp rx=0 tx=0).stop 2024-05-08T18:52:32.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.510+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db870abc40 msgr2=0x55db870b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.510+0000 7fbffe936800 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db870abc40 0x55db870b3290 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbff402bd90 tx=0x7fbff4052e30 comp rx=0 tx=0).stop 2024-05-08T18:52:32.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.510+0000 7fbff1ec4640 1 -- 172.21.15.132:0/581093654 reap_dead start 2024-05-08T18:52:32.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 shutdown_connections 2024-05-08T18:52:32.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 --2- 172.21.15.132:0/581093654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db870abc40 0x55db870b3290 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 >> 172.21.15.132:0/581093654 conn(0x55db870a7ff0 msgr2=0x55db870ad4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 shutdown_connections 2024-05-08T18:52:32.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 -- 172.21.15.132:0/581093654 wait complete. 2024-05-08T18:52:32.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 -- 172.21.15.132:0/3026824126 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbed403bab0 msgr2=0x7fbed403df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 --2- 172.21.15.132:0/3026824126 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbed403bab0 0x7fbed403df70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x55db8708b0c0 tx=0x7fbfec05df20 comp rx=0 tx=0).stop 2024-05-08T18:52:32.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 -- 172.21.15.132:0/3026824126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db8709e990 msgr2=0x55db8709edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 --2- 172.21.15.132:0/3026824126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db8709e990 0x55db8709edb0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fbff40056c0 tx=0x7fbff4018830 comp rx=0 tx=0).stop 2024-05-08T18:52:32.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 -- 172.21.15.132:0/3026824126 shutdown_connections 2024-05-08T18:52:32.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 --2- 172.21.15.132:0/3026824126 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbed403bab0 0x7fbed403df70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 --2- 172.21.15.132:0/3026824126 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db8709e990 0x55db8709edb0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 -- 172.21.15.132:0/3026824126 >> 172.21.15.132:0/3026824126 conn(0x55db87092a30 msgr2=0x55db87092e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 -- 172.21.15.132:0/3026824126 shutdown_connections 2024-05-08T18:52:32.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 -- 172.21.15.132:0/3026824126 wait complete. 2024-05-08T18:52:32.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 -- 172.21.15.132:0/3907391933 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55db86f874c0 msgr2=0x55db8708a720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 --2- 172.21.15.132:0/3907391933 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55db86f874c0 0x55db8708a720 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 -- 172.21.15.132:0/3907391933 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55db8708cf70 msgr2=0x55db8708f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 --2- 172.21.15.132:0/3907391933 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55db8708cf70 0x55db8708f360 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 -- 172.21.15.132:0/3907391933 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbee003bba0 msgr2=0x7fbee003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 --2- 172.21.15.132:0/3907391933 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbee003bba0 0x7fbee003e060 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4000f60 tx=0x7fbfe4001370 comp rx=0 tx=0).stop 2024-05-08T18:52:32.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 -- 172.21.15.132:0/3907391933 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db86f86b60 msgr2=0x55db870834e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.511+0000 7fbffe936800 1 --2- 172.21.15.132:0/3907391933 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db86f86b60 0x55db870834e0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fbfec052540 tx=0x7fbfec003020 comp rx=0 tx=0).stop 2024-05-08T18:52:32.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.512+0000 7fbffe936800 1 -- 172.21.15.132:0/3907391933 shutdown_connections 2024-05-08T18:52:32.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.512+0000 7fbffe936800 1 --2- 172.21.15.132:0/3907391933 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55db8708cf70 0x55db8708f360 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.512+0000 7fbffe936800 1 --2- 172.21.15.132:0/3907391933 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55db86f874c0 0x55db8708a720 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.512+0000 7fbffe936800 1 --2- 172.21.15.132:0/3907391933 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbee003bba0 0x7fbee003e060 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.512+0000 7fbffe936800 1 --2- 172.21.15.132:0/3907391933 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55db86f86b60 0x55db870834e0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.512+0000 7fbffe936800 1 -- 172.21.15.132:0/3907391933 >> 172.21.15.132:0/3907391933 conn(0x55db86f826a0 msgr2=0x55db87075b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.512+0000 7fbffe936800 1 -- 172.21.15.132:0/3907391933 shutdown_connections 2024-05-08T18:52:32.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.512+0000 7fbffe936800 1 -- 172.21.15.132:0/3907391933 wait complete. 2024-05-08T18:52:32.520 ERROR:root:None 2024-05-08T18:52:32.520 ERROR:root:0 2024-05-08T18:52:32.520 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-05-08T18:52:32.520 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-05-08T18:52:32.520 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-05-08T18:52:32.573 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:32.573 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:32.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.575+0000 7fce5771f800 1 Processor -- start 2024-05-08T18:52:32.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.575+0000 7fce5771f800 1 -- start start 2024-05-08T18:52:32.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.575+0000 7fce5771f800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x561a85092ab0 0x561a85127170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.575+0000 7fce5771f800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561a85092ff0 con 0x561a85093e40 2024-05-08T18:52:32.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.575+0000 7fce5771f800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x561a84fbee20 con 0x561a85092ab0 2024-05-08T18:52:32.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.575+0000 7fce4bfff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x561a85092ab0 0x561a85127170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.575+0000 7fce533bc640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x561a85093e40 0x561a850923a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48156/0 (socket says 172.21.15.132:48156) 2024-05-08T18:52:32.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.575+0000 7fce533bc640 1 -- 172.21.15.132:0/3545153211 learned_addr learned my addr 172.21.15.132:0/3545153211 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:52:32.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.575+0000 7fce4bfff640 1 -- 172.21.15.132:0/3545153211 >> v1:172.21.15.42:6789/0 conn(0x561a85093e40 legacy=0x561a850923a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.576+0000 7fce52bbb640 1 -- 172.21.15.132:0/3545153211 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3316312542 0 0) 0x561a85092ff0 con 0x561a85093e40 2024-05-08T18:52:32.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.576+0000 7fce4bfff640 1 -- 172.21.15.132:0/3545153211 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a850931c0 con 0x561a85092ab0 2024-05-08T18:52:32.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.577+0000 7fce4bfff640 1 --2- 172.21.15.132:0/3545153211 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85092ab0 0x561a85127170 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00a470 tx=0x7fce3c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9399189e0217142 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.578+0000 7fce52bbb640 1 -- 172.21.15.132:0/3545153211 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce3c057070 con 0x561a85092ab0 2024-05-08T18:52:32.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.578+0000 7fce52bbb640 1 -- 172.21.15.132:0/3545153211 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce3c052570 con 0x561a85092ab0 2024-05-08T18:52:32.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.578+0000 7fce52bbb640 1 -- 172.21.15.132:0/3545153211 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce3c052870 con 0x561a85092ab0 2024-05-08T18:52:32.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.578+0000 7fce5771f800 1 -- 172.21.15.132:0/3545153211 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85092ab0 msgr2=0x561a85127170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.578+0000 7fce5771f800 1 --2- 172.21.15.132:0/3545153211 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85092ab0 0x561a85127170 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00a470 tx=0x7fce3c01ce90 comp rx=0 tx=0).stop 2024-05-08T18:52:32.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.578+0000 7fce5771f800 1 -- 172.21.15.132:0/3545153211 shutdown_connections 2024-05-08T18:52:32.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.578+0000 7fce5771f800 1 --2- 172.21.15.132:0/3545153211 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85092ab0 0x561a85127170 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.578+0000 7fce5771f800 1 -- 172.21.15.132:0/3545153211 >> 172.21.15.132:0/3545153211 conn(0x561a85119870 msgr2=0x561a8511bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.578+0000 7fce5771f800 1 -- 172.21.15.132:0/3545153211 shutdown_connections 2024-05-08T18:52:32.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.578+0000 7fce5771f800 1 -- 172.21.15.132:0/3545153211 wait complete. 2024-05-08T18:52:32.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.591+0000 7fce5771f800 1 Processor -- start 2024-05-08T18:52:32.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.592+0000 7fce5771f800 1 -- start start 2024-05-08T18:52:32.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.592+0000 7fce5771f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85092ab0 0x561a85211600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.592+0000 7fce5771f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561a850696b0 con 0x561a85092ab0 2024-05-08T18:52:32.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.592+0000 7fce533bc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85092ab0 0x561a85211600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.592+0000 7fce533bc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85092ab0 0x561a85211600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53362/0 (socket says 172.21.15.132:53362) 2024-05-08T18:52:32.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.592+0000 7fce533bc640 1 -- 172.21.15.132:0/1443878654 learned_addr learned my addr 172.21.15.132:0/1443878654 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.592+0000 7fce533bc640 1 -- 172.21.15.132:0/1443878654 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a85211bd0 con 0x561a85092ab0 2024-05-08T18:52:32.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.592+0000 7fce533bc640 1 --2- 172.21.15.132:0/1443878654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85092ab0 0x561a85211600 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fce44001e00 tx=0x7fce4400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562ef285efae0bbc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.593+0000 7fcd4160a640 1 -- 172.21.15.132:0/1443878654 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce44012020 con 0x561a85092ab0 2024-05-08T18:52:32.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.593+0000 7fcd4160a640 1 -- 172.21.15.132:0/1443878654 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce4400e5c0 con 0x561a85092ab0 2024-05-08T18:52:32.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.593+0000 7fcd4160a640 1 -- 172.21.15.132:0/1443878654 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce4400e8e0 con 0x561a85092ab0 2024-05-08T18:52:32.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.593+0000 7fce5771f800 1 -- 172.21.15.132:0/1443878654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85092ab0 msgr2=0x561a85211600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.593+0000 7fce5771f800 1 --2- 172.21.15.132:0/1443878654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85092ab0 0x561a85211600 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fce44001e00 tx=0x7fce4400b780 comp rx=0 tx=0).stop 2024-05-08T18:52:32.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.593+0000 7fce5771f800 1 -- 172.21.15.132:0/1443878654 shutdown_connections 2024-05-08T18:52:32.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.593+0000 7fce5771f800 1 --2- 172.21.15.132:0/1443878654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85092ab0 0x561a85211600 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.593+0000 7fce5771f800 1 -- 172.21.15.132:0/1443878654 >> 172.21.15.132:0/1443878654 conn(0x561a85119870 msgr2=0x561a8520cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.593+0000 7fce5771f800 1 -- 172.21.15.132:0/1443878654 shutdown_connections 2024-05-08T18:52:32.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.593+0000 7fce5771f800 1 -- 172.21.15.132:0/1443878654 wait complete. 2024-05-08T18:52:32.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.594+0000 7fce5771f800 1 Processor -- start 2024-05-08T18:52:32.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.594+0000 7fce5771f800 1 -- start start 2024-05-08T18:52:32.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.594+0000 7fce5771f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85092ab0 0x561a852191d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.594+0000 7fce5771f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561a851279b0 con 0x561a85092ab0 2024-05-08T18:52:32.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.594+0000 7fce533bc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85092ab0 0x561a852191d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.594+0000 7fce533bc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85092ab0 0x561a852191d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53376/0 (socket says 172.21.15.132:53376) 2024-05-08T18:52:32.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.594+0000 7fce533bc640 1 -- 172.21.15.132:0/642924253 learned_addr learned my addr 172.21.15.132:0/642924253 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.595+0000 7fce533bc640 1 -- 172.21.15.132:0/642924253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a85219710 con 0x561a85092ab0 2024-05-08T18:52:32.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.595+0000 7fce533bc640 1 --2- 172.21.15.132:0/642924253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85092ab0 0x561a852191d0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x561a85212390 tx=0x7fce44000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.595+0000 7fcd3fe07640 1 -- 172.21.15.132:0/642924253 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce44012030 con 0x561a85092ab0 2024-05-08T18:52:32.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.595+0000 7fcd3fe07640 1 -- 172.21.15.132:0/642924253 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce4401a700 con 0x561a85092ab0 2024-05-08T18:52:32.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.595+0000 7fce5771f800 1 -- 172.21.15.132:0/642924253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a852199a0 con 0x561a85092ab0 2024-05-08T18:52:32.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.595+0000 7fcd3fe07640 1 -- 172.21.15.132:0/642924253 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce4401a9e0 con 0x561a85092ab0 2024-05-08T18:52:32.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.595+0000 7fce5771f800 1 -- 172.21.15.132:0/642924253 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a8521c650 con 0x561a85092ab0 2024-05-08T18:52:32.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.596+0000 7fcd3fe07640 1 -- 172.21.15.132:0/642924253 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fce44015020 con 0x561a85092ab0 2024-05-08T18:52:32.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.596+0000 7fcd3fe07640 1 --2- 172.21.15.132:0/642924253 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcd3803bb50 0x7fcd3803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.596+0000 7fcd3fe07640 1 -- 172.21.15.132:0/642924253 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fce44020030 con 0x561a85092ab0 2024-05-08T18:52:32.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.596+0000 7fce4bfff640 1 --2- 172.21.15.132:0/642924253 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcd3803bb50 0x7fcd3803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.596+0000 7fce5771f800 1 --2- 172.21.15.132:0/642924253 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x561a85093e40 0x561a85220410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.596+0000 7fce5771f800 1 -- 172.21.15.132:0/642924253 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561a85220950 con 0x561a85093e40 2024-05-08T18:52:32.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.596+0000 7fce53bbd640 1 --2- 172.21.15.132:0/642924253 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x561a85093e40 0x561a85220410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.597+0000 7fce4bfff640 1 --2- 172.21.15.132:0/642924253 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcd3803bb50 0x7fcd3803e010 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00a470 tx=0x7fce3c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.597+0000 7fce53bbd640 1 --2- 172.21.15.132:0/642924253 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x561a85093e40 0x561a85220410 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.597+0000 7fce53bbd640 1 -- 172.21.15.132:0/642924253 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce4c00a4a0 con 0x561a85093e40 2024-05-08T18:52:32.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.597+0000 7fce5771f800 1 -- 172.21.15.132:0/642924253 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561a8521d990 con 0x561a85093e40 2024-05-08T18:52:32.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.597+0000 7fce53bbd640 1 -- 172.21.15.132:0/642924253 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce4c00a4a0 con 0x561a85093e40 2024-05-08T18:52:32.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.597+0000 7fce5771f800 1 --2- 172.21.15.132:0/642924253 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x561a85222c30 0x561a85225020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.597+0000 7fce5771f800 1 -- 172.21.15.132:0/642924253 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561a852256c0 con 0x561a85222c30 2024-05-08T18:52:32.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.597+0000 7fce533bc640 1 --2- 172.21.15.132:0/642924253 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x561a85222c30 0x561a85225020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.598+0000 7fce533bc640 1 --2- 172.21.15.132:0/642924253 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x561a85222c30 0x561a85225020 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.598+0000 7fce533bc640 1 -- 172.21.15.132:0/642924253 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fce4400c540 con 0x561a85222c30 2024-05-08T18:52:32.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.598+0000 7fce5771f800 1 -- 172.21.15.132:0/642924253 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561a85221ad0 con 0x561a85093e40 2024-05-08T18:52:32.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.598+0000 7fce53bbd640 1 -- 172.21.15.132:0/642924253 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce4c00a4a0 con 0x561a85093e40 2024-05-08T18:52:32.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.598+0000 7fce5771f800 1 -- 172.21.15.132:0/642924253 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561a85221fb0 con 0x561a85093e40 2024-05-08T18:52:32.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.598+0000 7fce53bbd640 1 -- 172.21.15.132:0/642924253 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fce4c00a4a0 con 0x561a85093e40 2024-05-08T18:52:32.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.599+0000 7fce5771f800 1 Processor -- start 2024-05-08T18:52:32.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.599+0000 7fce5771f800 1 -- start start 2024-05-08T18:52:32.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.599+0000 7fce5771f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85234680 0x561a85234aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.599+0000 7fce5771f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561a8500ffc0 con 0x561a85234680 2024-05-08T18:52:32.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.599+0000 7fce53bbd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85234680 0x561a85234aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.599+0000 7fce53bbd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85234680 0x561a85234aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53386/0 (socket says 172.21.15.132:53386) 2024-05-08T18:52:32.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.599+0000 7fce53bbd640 1 -- 172.21.15.132:0/3391866116 learned_addr learned my addr 172.21.15.132:0/3391866116 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.600+0000 7fce53bbd640 1 -- 172.21.15.132:0/3391866116 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a85234fe0 con 0x561a85234680 2024-05-08T18:52:32.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.600+0000 7fce53bbd640 1 --2- 172.21.15.132:0/3391866116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85234680 0x561a85234aa0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x561a8521a0a0 tx=0x7fce4c0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.600+0000 7fcd3d602640 1 -- 172.21.15.132:0/3391866116 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce4c014450 con 0x561a85234680 2024-05-08T18:52:32.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.600+0000 7fcd3d602640 1 -- 172.21.15.132:0/3391866116 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce4c0145f0 con 0x561a85234680 2024-05-08T18:52:32.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.600+0000 7fcd3d602640 1 -- 172.21.15.132:0/3391866116 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce4c0148d0 con 0x561a85234680 2024-05-08T18:52:32.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.600+0000 7fce5771f800 1 -- 172.21.15.132:0/3391866116 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a85235a50 con 0x561a85234680 2024-05-08T18:52:32.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.600+0000 7fce5771f800 1 -- 172.21.15.132:0/3391866116 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a85235f50 con 0x561a85234680 2024-05-08T18:52:32.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.601+0000 7fcd3d602640 1 -- 172.21.15.132:0/3391866116 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fce4c011040 con 0x561a85234680 2024-05-08T18:52:32.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.601+0000 7fcd3d602640 1 --2- 172.21.15.132:0/3391866116 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcd2c03bba0 0x7fcd2c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.601+0000 7fcd3d602640 1 -- 172.21.15.132:0/3391866116 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fce4c01e070 con 0x561a85234680 2024-05-08T18:52:32.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.601+0000 7fce533bc640 1 --2- 172.21.15.132:0/3391866116 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcd2c03bba0 0x7fcd2c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.601+0000 7fce5771f800 1 Processor -- start 2024-05-08T18:52:32.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.601+0000 7fce533bc640 1 --2- 172.21.15.132:0/3391866116 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcd2c03bba0 0x7fcd2c03e060 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x561a85220da0 tx=0x7fce4400c9b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.602+0000 7fce5771f800 1 -- start start 2024-05-08T18:52:32.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.602+0000 7fce5771f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a852418c0 0x561a85241ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.602+0000 7fce5771f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561a85211f50 con 0x561a852418c0 2024-05-08T18:52:32.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.602+0000 7fce53bbd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a852418c0 0x561a85241ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.602+0000 7fce53bbd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a852418c0 0x561a85241ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53398/0 (socket says 172.21.15.132:53398) 2024-05-08T18:52:32.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.602+0000 7fce53bbd640 1 -- 172.21.15.132:0/648015528 learned_addr learned my addr 172.21.15.132:0/648015528 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.602+0000 7fce53bbd640 1 -- 172.21.15.132:0/648015528 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a852422b0 con 0x561a852418c0 2024-05-08T18:52:32.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.602+0000 7fce53bbd640 1 --2- 172.21.15.132:0/648015528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a852418c0 0x561a85241ce0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fce4c018430 tx=0x7fce4c0118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5598f56a0406fe5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.602+0000 7fcd36ffd640 1 -- 172.21.15.132:0/648015528 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce4c011c00 con 0x561a852418c0 2024-05-08T18:52:32.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.602+0000 7fcd36ffd640 1 -- 172.21.15.132:0/648015528 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce4c011da0 con 0x561a852418c0 2024-05-08T18:52:32.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.602+0000 7fcd36ffd640 1 -- 172.21.15.132:0/648015528 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce4c051480 con 0x561a852418c0 2024-05-08T18:52:32.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.603+0000 7fce5771f800 1 -- 172.21.15.132:0/648015528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a852418c0 msgr2=0x561a85241ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.603+0000 7fce5771f800 1 --2- 172.21.15.132:0/648015528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a852418c0 0x561a85241ce0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fce4c018430 tx=0x7fce4c0118e0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.603+0000 7fce5771f800 1 -- 172.21.15.132:0/648015528 shutdown_connections 2024-05-08T18:52:32.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.603+0000 7fce5771f800 1 --2- 172.21.15.132:0/648015528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a852418c0 0x561a85241ce0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.603+0000 7fce5771f800 1 -- 172.21.15.132:0/648015528 >> 172.21.15.132:0/648015528 conn(0x561a8523dc70 msgr2=0x561a8523bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.603+0000 7fce5771f800 1 -- 172.21.15.132:0/648015528 shutdown_connections 2024-05-08T18:52:32.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.603+0000 7fce5771f800 1 -- 172.21.15.132:0/648015528 wait complete. 2024-05-08T18:52:32.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.603+0000 7fce5771f800 1 Processor -- start 2024-05-08T18:52:32.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.603+0000 7fce5771f800 1 -- start start 2024-05-08T18:52:32.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.603+0000 7fce5771f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a852418c0 0x561a85248dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.608 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.603+0000 7fce5771f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x561a852429b0 con 0x561a852418c0 2024-05-08T18:52:32.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.604+0000 7fce53bbd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a852418c0 0x561a85248dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.604+0000 7fce53bbd640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a852418c0 0x561a85248dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53408/0 (socket says 172.21.15.132:53408) 2024-05-08T18:52:32.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.604+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 learned_addr learned my addr 172.21.15.132:0/2814521992 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.604+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a85249310 con 0x561a852418c0 2024-05-08T18:52:32.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.604+0000 7fce53bbd640 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a852418c0 0x561a85248dd0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fce4c011f70 tx=0x7fce4c052b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.604+0000 7fcd357fa640 1 -- 172.21.15.132:0/2814521992 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce4c054280 con 0x561a852418c0 2024-05-08T18:52:32.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.604+0000 7fcd357fa640 1 -- 172.21.15.132:0/2814521992 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce4c031030 con 0x561a852418c0 2024-05-08T18:52:32.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.604+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a852495a0 con 0x561a852418c0 2024-05-08T18:52:32.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.604+0000 7fcd357fa640 1 -- 172.21.15.132:0/2814521992 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce4c0545b0 con 0x561a852418c0 2024-05-08T18:52:32.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.604+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a8524c250 con 0x561a852418c0 2024-05-08T18:52:32.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.605+0000 7fcd357fa640 1 -- 172.21.15.132:0/2814521992 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fce4c054850 con 0x561a852418c0 2024-05-08T18:52:32.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.605+0000 7fcd357fa640 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcd1c03bb50 0x7fcd1c03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.605+0000 7fcd357fa640 1 -- 172.21.15.132:0/2814521992 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fce4c00e040 con 0x561a852418c0 2024-05-08T18:52:32.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.605+0000 7fce533bc640 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcd1c03bb50 0x7fcd1c03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.606+0000 7fce533bc640 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcd1c03bb50 0x7fcd1c03e010 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fce4400c8a0 tx=0x7fce440434e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.606+0000 7fce5771f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.606+0000 7fce5771f800 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x561a85254b80 0x561a85257040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.606+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561a85257790 con 0x561a85254b80 2024-05-08T18:52:32.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.606+0000 7fce4bfff640 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x561a85254b80 0x561a85257040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.606+0000 7fce4bfff640 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x561a85254b80 0x561a85257040 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.607+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce3c05a040 con 0x561a85254b80 2024-05-08T18:52:32.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.607+0000 7fce5771f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.607+0000 7fce5771f800 20 realm 2024-05-08T18:52:32.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.607+0000 7fce5771f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.607+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561a85257b60 con 0x561a85254b80 2024-05-08T18:52:32.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.607+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce3c05a040 con 0x561a85254b80 2024-05-08T18:52:32.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.607+0000 7fce5771f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.607+0000 7fce5771f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:52:32.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.607+0000 7fce5771f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.607+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561a85258430 con 0x561a85254b80 2024-05-08T18:52:32.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.607+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce3c05a040 con 0x561a85254b80 2024-05-08T18:52:32.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.607+0000 7fce5771f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.607+0000 7fce5771f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.607+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561a852587d0 con 0x561a85254b80 2024-05-08T18:52:32.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.607+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce3c05a040 con 0x561a85254b80 2024-05-08T18:52:32.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.607+0000 7fce5771f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:32.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.607+0000 7fce5771f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.607+0000 7fce5771f800 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x561a85259530 0x561a8525b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.607+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561a8525bee0 con 0x561a85259530 2024-05-08T18:52:32.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.607+0000 7fce53bbd640 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x561a85259530 0x561a8525b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.608+0000 7fce53bbd640 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x561a85259530 0x561a8525b920 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.608+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fce4c02a070 con 0x561a85259530 2024-05-08T18:52:32.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.608+0000 7fce5771f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:52:32.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.608+0000 7fce5771f800 20 searching for the correct realm 2024-05-08T18:52:32.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.608+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x561a85259530 2024-05-08T18:52:32.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.609+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c02a070 con 0x561a85259530 2024-05-08T18:52:32.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.609+0000 7fce53bbd640 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fce4c014070 0x7fce4c023420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.609+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x7fce4c014070 2024-05-08T18:52:32.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.609+0000 7fce533bc640 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fce4c014070 0x7fce4c023420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.609+0000 7fce533bc640 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fce4c014070 0x7fce4c023420 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.609+0000 7fce533bc640 1 -- 172.21.15.132:0/2814521992 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4400c540 con 0x7fce4c014070 2024-05-08T18:52:32.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.609+0000 7fce533bc640 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fce44017050 0x7fce4403d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.609+0000 7fce533bc640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x7fce44017050 2024-05-08T18:52:32.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.609+0000 7fce4bfff640 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fce44017050 0x7fce4403d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.610+0000 7fce4bfff640 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fce44017050 0x7fce4403d9f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.610+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3c05a040 con 0x7fce44017050 2024-05-08T18:52:32.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.610+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x561a85254b80 2024-05-08T18:52:32.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.610+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3c05a040 con 0x561a85254b80 2024-05-08T18:52:32.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.610+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x561a85254b80 2024-05-08T18:52:32.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.610+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3c05a040 con 0x561a85254b80 2024-05-08T18:52:32.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.610+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x7fce44017050 2024-05-08T18:52:32.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.611+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3c05a040 con 0x7fce44017050 2024-05-08T18:52:32.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.611+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x7fce44017050 2024-05-08T18:52:32.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.611+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3c05a040 con 0x7fce44017050 2024-05-08T18:52:32.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.611+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x7fce4c014070 2024-05-08T18:52:32.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.611+0000 7fce533bc640 1 -- 172.21.15.132:0/2814521992 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4400c540 con 0x7fce4c014070 2024-05-08T18:52:32.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.611+0000 7fce533bc640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x561a85259530 2024-05-08T18:52:32.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.611+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c02a070 con 0x561a85259530 2024-05-08T18:52:32.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.612+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x561a85254b80 2024-05-08T18:52:32.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.612+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3c05a040 con 0x561a85254b80 2024-05-08T18:52:32.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.612+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x7fce44017050 2024-05-08T18:52:32.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.612+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3c05a040 con 0x7fce44017050 2024-05-08T18:52:32.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.612+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x561a85254b80 2024-05-08T18:52:32.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.612+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fce3c05a040 con 0x561a85254b80 2024-05-08T18:52:32.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.612+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x7fce4c014070 2024-05-08T18:52:32.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.613+0000 7fce533bc640 1 -- 172.21.15.132:0/2814521992 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fce4400c540 con 0x7fce4c014070 2024-05-08T18:52:32.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.613+0000 7fce533bc640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x561a85259530 2024-05-08T18:52:32.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.613+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v27'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fce4c02a070 con 0x561a85259530 2024-05-08T18:52:32.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.613+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x561a85259530 2024-05-08T18:52:32.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.613+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c02a070 con 0x561a85259530 2024-05-08T18:52:32.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.613+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x7fce44017050 2024-05-08T18:52:32.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.613+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3c05a040 con 0x7fce44017050 2024-05-08T18:52:32.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.613+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x561a85259530 2024-05-08T18:52:32.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.614+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c02a070 con 0x561a85259530 2024-05-08T18:52:32.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.614+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x561a85259530 2024-05-08T18:52:32.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.614+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c02a070 con 0x561a85259530 2024-05-08T18:52:32.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.614+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x561a85254b80 2024-05-08T18:52:32.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.614+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3c05a040 con 0x561a85254b80 2024-05-08T18:52:32.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.614+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x561a85254b80 2024-05-08T18:52:32.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.614+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v27'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fce3c05a040 con 0x561a85254b80 2024-05-08T18:52:32.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.614+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x7fce44017050 2024-05-08T18:52:32.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.615+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3c07d040 con 0x7fce44017050 2024-05-08T18:52:32.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.615+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x561a85259530 2024-05-08T18:52:32.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.615+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c06b040 con 0x561a85259530 2024-05-08T18:52:32.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.615+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x7fce4c014070 2024-05-08T18:52:32.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.615+0000 7fce533bc640 1 -- 172.21.15.132:0/2814521992 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4400c540 con 0x7fce4c014070 2024-05-08T18:52:32.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.615+0000 7fce533bc640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x561a85254b80 2024-05-08T18:52:32.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.615+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3c07d040 con 0x561a85254b80 2024-05-08T18:52:32.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.615+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x7fce4c014070 2024-05-08T18:52:32.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.616+0000 7fce533bc640 1 -- 172.21.15.132:0/2814521992 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4400c540 con 0x7fce4c014070 2024-05-08T18:52:32.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.616+0000 7fce533bc640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x561a85259530 2024-05-08T18:52:32.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.616+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c06b040 con 0x561a85259530 2024-05-08T18:52:32.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.616+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x7fce44017050 2024-05-08T18:52:32.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.616+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3c07d040 con 0x7fce44017050 2024-05-08T18:52:32.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.616+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x7fce4c014070 2024-05-08T18:52:32.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.617+0000 7fce533bc640 1 -- 172.21.15.132:0/2814521992 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4400c540 con 0x7fce4c014070 2024-05-08T18:52:32.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.617+0000 7fce533bc640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x561a85259530 2024-05-08T18:52:32.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.617+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4c06b040 con 0x561a85259530 2024-05-08T18:52:32.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.617+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x7fce44017050 2024-05-08T18:52:32.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.617+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce3c07d040 con 0x7fce44017050 2024-05-08T18:52:32.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.617+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x561a85254b80 2024-05-08T18:52:32.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.617+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v27'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fce3c07d040 con 0x561a85254b80 2024-05-08T18:52:32.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.617+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d830 con 0x7fce4c014070 2024-05-08T18:52:32.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce533bc640 1 -- 172.21.15.132:0/2814521992 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce4400c540 con 0x7fce4c014070 2024-05-08T18:52:32.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:52:32.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:52:32.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:52:32.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:52:32.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:52:32.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:52:32.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561a8525c8a0 con 0x561a85254b80 2024-05-08T18:52:32.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce3c07d040 con 0x561a85254b80 2024-05-08T18:52:32.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561a8525d140 con 0x561a85254b80 2024-05-08T18:52:32.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce3c07d040 con 0x561a85254b80 2024-05-08T18:52:32.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:32.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561a8525dcb0 con 0x561a85254b80 2024-05-08T18:52:32.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fce3c07d040 con 0x561a85254b80 2024-05-08T18:52:32.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:52:32.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 20 zone default found 2024-05-08T18:52:32.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 4 Realm: () 2024-05-08T18:52:32.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:52:32.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:52:32.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:52:32.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 20 zonegroup default 2024-05-08T18:52:32.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.618+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561a8525e090 con 0x7fce4c014070 2024-05-08T18:52:32.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.619+0000 7fce533bc640 1 -- 172.21.15.132:0/2814521992 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fce4400c540 con 0x7fce4c014070 2024-05-08T18:52:32.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.619+0000 7fce5771f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.619+0000 7fce5771f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.619+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561a85260360 con 0x561a85259530 2024-05-08T18:52:32.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.619+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce4c06b040 con 0x561a85259530 2024-05-08T18:52:32.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.619+0000 7fce5771f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.619+0000 7fce5771f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.619+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561a85260700 con 0x561a85259530 2024-05-08T18:52:32.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.619+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce4c06b040 con 0x561a85259530 2024-05-08T18:52:32.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.619+0000 7fce5771f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.619+0000 7fce5771f800 20 started sync module instance, tier type = 2024-05-08T18:52:32.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.619+0000 7fce5771f800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:52:32.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.619+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a8525f7f0 con 0x7fce4c014070 2024-05-08T18:52:32.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.620+0000 7fce533bc640 1 -- 172.21.15.132:0/2814521992 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4400c540 con 0x7fce4c014070 2024-05-08T18:52:32.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.620+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94671902997520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a8525f450 con 0x7fce4c014070 2024-05-08T18:52:32.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.620+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a85261460 con 0x561a85254b80 2024-05-08T18:52:32.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.621+0000 7fce533bc640 1 -- 172.21.15.132:0/2814521992 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94671902997520] v27'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4400c540 con 0x7fce4c014070 2024-05-08T18:52:32.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.622+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3c07d040 con 0x561a85254b80 2024-05-08T18:52:32.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.622+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94671903001248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a85261880 con 0x561a85254b80 2024-05-08T18:52:32.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.622+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a852622c0 con 0x561a85259530 2024-05-08T18:52:32.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.622+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94671903001248] v27'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3c07d040 con 0x561a85254b80 2024-05-08T18:52:32.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.623+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c06b040 con 0x561a85259530 2024-05-08T18:52:32.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.623+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94671903006096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a85262280 con 0x561a85259530 2024-05-08T18:52:32.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.623+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a85262df0 con 0x7fce4c014070 2024-05-08T18:52:32.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.624+0000 7fce533bc640 1 -- 172.21.15.132:0/2814521992 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4400c540 con 0x7fce4c014070 2024-05-08T18:52:32.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.624+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94671903009024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a85263690 con 0x7fce4c014070 2024-05-08T18:52:32.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.624+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a85264170 con 0x561a85254b80 2024-05-08T18:52:32.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.624+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94671903006096] v27'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c06b040 con 0x561a85259530 2024-05-08T18:52:32.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.625+0000 7fce533bc640 1 -- 172.21.15.132:0/2814521992 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94671903009024] v27'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4400c540 con 0x7fce4c014070 2024-05-08T18:52:32.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.625+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3c07d040 con 0x561a85254b80 2024-05-08T18:52:32.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.625+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94671903011296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a85260ec0 con 0x561a85254b80 2024-05-08T18:52:32.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.625+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a85264a50 con 0x7fce44017050 2024-05-08T18:52:32.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.626+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94671903011296] v27'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3c07d040 con 0x561a85254b80 2024-05-08T18:52:32.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.626+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3c07d040 con 0x7fce44017050 2024-05-08T18:52:32.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.626+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94671903014016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a852649c0 con 0x7fce44017050 2024-05-08T18:52:32.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.626+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a85265460 con 0x7fce44017050 2024-05-08T18:52:32.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.627+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94671903014016] v27'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3c07d040 con 0x7fce44017050 2024-05-08T18:52:32.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.628+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3c07d040 con 0x7fce44017050 2024-05-08T18:52:32.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.628+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94671903019408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a852649c0 con 0x7fce44017050 2024-05-08T18:52:32.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.628+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a85265e70 con 0x7fce44017050 2024-05-08T18:52:32.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.629+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94671903019408] v27'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3c07d040 con 0x7fce44017050 2024-05-08T18:52:32.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.629+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3c07d040 con 0x7fce44017050 2024-05-08T18:52:32.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.629+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94671903016208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a85266050 con 0x7fce44017050 2024-05-08T18:52:32.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.629+0000 7fce5771f800 20 add_watcher() i=0 2024-05-08T18:52:32.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.629+0000 7fce5771f800 20 add_watcher() i=1 2024-05-08T18:52:32.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.629+0000 7fce5771f800 20 add_watcher() i=2 2024-05-08T18:52:32.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.629+0000 7fce5771f800 20 add_watcher() i=3 2024-05-08T18:52:32.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.629+0000 7fce5771f800 20 add_watcher() i=4 2024-05-08T18:52:32.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.629+0000 7fce5771f800 20 add_watcher() i=5 2024-05-08T18:52:32.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.629+0000 7fce5771f800 20 add_watcher() i=6 2024-05-08T18:52:32.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.630+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94671903016208] v27'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3c07d040 con 0x7fce44017050 2024-05-08T18:52:32.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.630+0000 7fce5771f800 20 add_watcher() i=7 2024-05-08T18:52:32.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.630+0000 7fce5771f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:52:32.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.630+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561a852691e0 con 0x561a85254b80 2024-05-08T18:52:32.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.630+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fce3c07d040 con 0x561a85254b80 2024-05-08T18:52:32.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.630+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94671903034256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a85265fa0 con 0x561a85254b80 2024-05-08T18:52:32.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.631+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94671903034256] v27'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce3c07d040 con 0x561a85254b80 2024-05-08T18:52:32.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.631+0000 7fcd09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:32.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.631+0000 7fce5771f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:32.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.631+0000 7fce5771f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:32.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.631+0000 7fce5771f800 5 note: GC not initialized 2024-05-08T18:52:32.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.632+0000 7fcd08fe1640 20 reqs_thread_entry: start 2024-05-08T18:52:32.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.632+0000 7fce5771f800 20 init_complete bucket index max shards: 11 2024-05-08T18:52:32.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.632+0000 7fce5771f800 20 Filter name: none 2024-05-08T18:52:32.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.632+0000 7fcc827fc640 20 reqs_thread_entry: start 2024-05-08T18:52:32.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.632+0000 7fce5771f800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-05-08T18:52:32.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.632+0000 7fce5771f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.632+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561a8529c7e0 con 0x561a85259530 2024-05-08T18:52:32.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.632+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7fce4c06b040 con 0x561a85259530 2024-05-08T18:52:32.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.632+0000 7fce5771f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.632+0000 7fce5771f800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-05-08T18:52:32.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.632+0000 7fce5771f800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-08T18:52:32.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.632+0000 7fce5771f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-05-08T18:52:32.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.632+0000 7fce5771f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.632+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561a8529af80 con 0x561a85259530 2024-05-08T18:52:32.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.632+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7fce4c06b040 con 0x561a85259530 2024-05-08T18:52:32.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.632+0000 7fce5771f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.632+0000 7fce5771f800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-05-08T18:52:32.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.632+0000 7fce5771f800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-05-08T18:52:32.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.633+0000 7fce5771f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-05-08T18:52:32.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.633+0000 7fce5771f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-05-08T18:52:32.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.633+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a8529b820 con 0x561a85259530 2024-05-08T18:52:32.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.634+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v27'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fce4c06b040 con 0x561a85259530 2024-05-08T18:52:32.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.634+0000 7fce5771f800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-05-08T18:52:32.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.634+0000 7fce5771f800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-08T18:52:32.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.634+0000 7fce5771f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-05-08T18:52:32.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.634+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94671903241072 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561a8529fc70 con 0x561a85259530 2024-05-08T18:52:32.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.634+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== watch-notify(notify (1) cookie 94671903006096 notify 115964117003 ret 0) ==== 584+0+0 (crc 0 0 0) 0x561a8529c230 con 0x561a85259530 2024-05-08T18:52:32.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.634+0000 7fcd36ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117003 cookie 94671903006096 notifier 4851 bl.length()=542 2024-05-08T18:52:32.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.634+0000 7fcd36ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-05-08T18:52:32.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.634+0000 7fcd36ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-08T18:52:32.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.634+0000 7fcd36ffd640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fcd18003ea0 con 0x561a85259530 2024-05-08T18:52:32.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.634+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(65 notify.2 [notify cookie 94671903241072 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fce4c06b040 con 0x561a85259530 2024-05-08T18:52:32.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.634+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c06b040 con 0x561a85259530 2024-05-08T18:52:32.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.634+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== watch-notify(notify_complete (2) cookie 94671903241072 notify 115964117003 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561a852495a0 con 0x561a85259530 2024-05-08T18:52:32.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.634+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a8529b7d0 con 0x561a85259530 2024-05-08T18:52:32.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.635+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v27'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7fce4c06b040 con 0x561a85259530 2024-05-08T18:52:32.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.635+0000 7fce5771f800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-05-08T18:52:32.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.635+0000 7fce5771f800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-05-08T18:52:32.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.635+0000 7fce5771f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-05-08T18:52:32.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.636+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94671903240992 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561a8529b740 con 0x7fce44017050 2024-05-08T18:52:32.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.636+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== watch-notify(notify (1) cookie 94671903014016 notify 115964117022 ret 0) ==== 217+0+0 (crc 0 0 0) 0x561a850931c0 con 0x7fce44017050 2024-05-08T18:52:32.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.636+0000 7fcd367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117022 cookie 94671903014016 notifier 4851 bl.length()=175 2024-05-08T18:52:32.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.636+0000 7fcd367fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-05-08T18:52:32.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.636+0000 7fcd367fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-05-08T18:52:32.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.636+0000 7fcd367fc640 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fcc88003400 con 0x7fce44017050 2024-05-08T18:52:32.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.636+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(68 notify.5 [notify cookie 94671903240992 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fce3c07d040 con 0x7fce44017050 2024-05-08T18:52:32.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.636+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3c07d040 con 0x7fce44017050 2024-05-08T18:52:32.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.637+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== watch-notify(notify_complete (2) cookie 94671903240992 notify 115964117022 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fce3c05dd30 con 0x7fce44017050 2024-05-08T18:52:32.646 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-05-08T18:52:32.634122Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:52:32.634103Z","tags":[],"group_ids":[]} 2024-05-08T18:52:32.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.637+0000 7fcd09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:32.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.637+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94671903034256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a85268330 con 0x561a85254b80 2024-05-08T18:52:32.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.638+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94671903034256] v27'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce3c07d040 con 0x561a85254b80 2024-05-08T18:52:32.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.638+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94671902997520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a85268b90 con 0x7fce4c014070 2024-05-08T18:52:32.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.639+0000 7fce533bc640 1 -- 172.21.15.132:0/2814521992 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94671902997520] v27'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4400c540 con 0x7fce4c014070 2024-05-08T18:52:32.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.639+0000 7fce5771f800 20 remove_watcher() i=0 2024-05-08T18:52:32.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.639+0000 7fce5771f800 2 removed watcher, disabling cache 2024-05-08T18:52:32.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.639+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94671903001248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a85268b90 con 0x561a85254b80 2024-05-08T18:52:32.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.641+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94671903001248] v27'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3c07d040 con 0x561a85254b80 2024-05-08T18:52:32.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.641+0000 7fce5771f800 20 remove_watcher() i=1 2024-05-08T18:52:32.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.641+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94671903006096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a85268b90 con 0x561a85259530 2024-05-08T18:52:32.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.642+0000 7fce53bbd640 1 -- 172.21.15.132:0/2814521992 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94671903006096] v27'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4c06b040 con 0x561a85259530 2024-05-08T18:52:32.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.642+0000 7fce5771f800 20 remove_watcher() i=2 2024-05-08T18:52:32.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.642+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94671903009024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a85261d90 con 0x7fce4c014070 2024-05-08T18:52:32.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.643+0000 7fce533bc640 1 -- 172.21.15.132:0/2814521992 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94671903009024] v27'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce4400c540 con 0x7fce4c014070 2024-05-08T18:52:32.652 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.643+0000 7fce5771f800 20 remove_watcher() i=3 2024-05-08T18:52:32.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.643+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94671903011296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a85268b90 con 0x561a85254b80 2024-05-08T18:52:32.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.644+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94671903011296] v27'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3c07d040 con 0x561a85254b80 2024-05-08T18:52:32.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.644+0000 7fce5771f800 20 remove_watcher() i=4 2024-05-08T18:52:32.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.644+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94671903014016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a85262900 con 0x7fce44017050 2024-05-08T18:52:32.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.645+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94671903014016] v27'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3c07d040 con 0x7fce44017050 2024-05-08T18:52:32.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.645+0000 7fce5771f800 20 remove_watcher() i=5 2024-05-08T18:52:32.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.645+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94671903019408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a85261d90 con 0x7fce44017050 2024-05-08T18:52:32.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.646+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94671903019408] v27'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3c07d040 con 0x7fce44017050 2024-05-08T18:52:32.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.646+0000 7fce5771f800 20 remove_watcher() i=6 2024-05-08T18:52:32.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.646+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94671903016208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561a85268b90 con 0x7fce44017050 2024-05-08T18:52:32.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94671903016208] v27'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce3c07d040 con 0x7fce44017050 2024-05-08T18:52:32.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 20 remove_watcher() i=7 2024-05-08T18:52:32.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fce44017050 msgr2=0x7fce4403d9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.653 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fce44017050 0x7fce4403d9f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x561a85254b80 msgr2=0x561a85257040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x561a85254b80 0x561a85257040 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fce4c014070 msgr2=0x7fce4c023420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fce4c014070 0x7fce4c023420 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x561a85259530 msgr2=0x561a8525b920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x561a85259530 0x561a8525b920 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcd1c03bb50 msgr2=0x7fcd1c03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcd1c03bb50 0x7fcd1c03e010 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fce4400c8a0 tx=0x7fce440434e0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a852418c0 msgr2=0x561a85248dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce4bfff640 1 -- 172.21.15.132:0/2814521992 reap_dead start 2024-05-08T18:52:32.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a852418c0 0x561a85248dd0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fce4c011f70 tx=0x7fce4c052b20 comp rx=0 tx=0).stop 2024-05-08T18:52:32.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 shutdown_connections 2024-05-08T18:52:32.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 --2- 172.21.15.132:0/2814521992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a852418c0 0x561a85248dd0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.654 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 >> 172.21.15.132:0/2814521992 conn(0x561a8523dc70 msgr2=0x561a8523b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 shutdown_connections 2024-05-08T18:52:32.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 -- 172.21.15.132:0/2814521992 wait complete. 2024-05-08T18:52:32.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 -- 172.21.15.132:0/3391866116 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcd2c03bba0 msgr2=0x7fcd2c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 --2- 172.21.15.132:0/3391866116 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcd2c03bba0 0x7fcd2c03e060 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x561a85220da0 tx=0x7fce4400c9b0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 -- 172.21.15.132:0/3391866116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85234680 msgr2=0x561a85234aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 --2- 172.21.15.132:0/3391866116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85234680 0x561a85234aa0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x561a8521a0a0 tx=0x7fce4c0188f0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 -- 172.21.15.132:0/3391866116 shutdown_connections 2024-05-08T18:52:32.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 --2- 172.21.15.132:0/3391866116 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcd2c03bba0 0x7fcd2c03e060 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 --2- 172.21.15.132:0/3391866116 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85234680 0x561a85234aa0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 -- 172.21.15.132:0/3391866116 >> 172.21.15.132:0/3391866116 conn(0x561a85228720 msgr2=0x561a85228b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 -- 172.21.15.132:0/3391866116 shutdown_connections 2024-05-08T18:52:32.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.647+0000 7fce5771f800 1 -- 172.21.15.132:0/3391866116 wait complete. 2024-05-08T18:52:32.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.648+0000 7fce5771f800 1 -- 172.21.15.132:0/642924253 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x561a85093e40 msgr2=0x561a85220410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.648+0000 7fce5771f800 1 --2- 172.21.15.132:0/642924253 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x561a85093e40 0x561a85220410 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.648+0000 7fce5771f800 1 -- 172.21.15.132:0/642924253 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x561a85222c30 msgr2=0x561a85225020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.648+0000 7fce5771f800 1 --2- 172.21.15.132:0/642924253 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x561a85222c30 0x561a85225020 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.648+0000 7fce5771f800 1 -- 172.21.15.132:0/642924253 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcd3803bb50 msgr2=0x7fcd3803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.648+0000 7fce5771f800 1 --2- 172.21.15.132:0/642924253 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcd3803bb50 0x7fcd3803e010 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00a470 tx=0x7fce3c04e000 comp rx=0 tx=0).stop 2024-05-08T18:52:32.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.648+0000 7fce5771f800 1 -- 172.21.15.132:0/642924253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85092ab0 msgr2=0x561a852191d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.648+0000 7fce5771f800 1 --2- 172.21.15.132:0/642924253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85092ab0 0x561a852191d0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x561a85212390 tx=0x7fce44000ed0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.648+0000 7fce5771f800 1 -- 172.21.15.132:0/642924253 shutdown_connections 2024-05-08T18:52:32.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.648+0000 7fce5771f800 1 --2- 172.21.15.132:0/642924253 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x561a85222c30 0x561a85225020 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.648+0000 7fce5771f800 1 --2- 172.21.15.132:0/642924253 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x561a85093e40 0x561a85220410 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.648+0000 7fce5771f800 1 --2- 172.21.15.132:0/642924253 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcd3803bb50 0x7fcd3803e010 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.648+0000 7fce5771f800 1 --2- 172.21.15.132:0/642924253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x561a85092ab0 0x561a852191d0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.648+0000 7fce5771f800 1 -- 172.21.15.132:0/642924253 >> 172.21.15.132:0/642924253 conn(0x561a85119870 msgr2=0x561a8520b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.648+0000 7fce5771f800 1 -- 172.21.15.132:0/642924253 shutdown_connections 2024-05-08T18:52:32.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.648+0000 7fce5771f800 1 -- 172.21.15.132:0/642924253 wait complete. 2024-05-08T18:52:32.657 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-05-08T18:52:32.634122Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:32.634103Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:32.657 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-05-08T18:52:32.634122Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:32.634103Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:32.658 ERROR:root:0 2024-05-08T18:52:32.658 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:52:32.662 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:52:32.662 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-05-08T18:52:32.663 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-05-08T18:52:32.663 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-05-08T18:52:32.706 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:32.706 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:32.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.708+0000 7f9da7329800 1 Processor -- start 2024-05-08T18:52:32.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.708+0000 7f9da7329800 1 -- start start 2024-05-08T18:52:32.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.708+0000 7f9da7329800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55d531dbccd0 0x55d531dbf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.708+0000 7f9da7329800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d531dc3110 con 0x55d531dbf600 2024-05-08T18:52:32.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.708+0000 7f9da7329800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55d531c5ce20 con 0x55d531dbccd0 2024-05-08T18:52:32.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.708+0000 7f9da2f6a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55d531dbccd0 0x55d531dbf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.708+0000 7f9da2769640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55d531dbf600 0x55d531dc19f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48166/0 (socket says 172.21.15.132:48166) 2024-05-08T18:52:32.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.708+0000 7f9da2f6a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55d531dbccd0 0x55d531dbf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53414/0 (socket says 172.21.15.132:53414) 2024-05-08T18:52:32.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.708+0000 7f9da2769640 1 -- 172.21.15.132:0/4060015435 learned_addr learned my addr 172.21.15.132:0/4060015435 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:52:32.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.708+0000 7f9da2f6a640 1 -- 172.21.15.132:0/4060015435 >> v1:172.21.15.42:6789/0 conn(0x55d531dbf600 legacy=0x55d531dc19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.708+0000 7f9da2f6a640 1 -- 172.21.15.132:0/4060015435 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d531dc42f0 con 0x55d531dbccd0 2024-05-08T18:52:32.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.710+0000 7f9da2f6a640 1 --2- 172.21.15.132:0/4060015435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531dbccd0 0x55d531dbf0c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9d9400a470 tx=0x7f9d9401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc9f38649ffae91 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.710+0000 7f9da1f68640 1 -- 172.21.15.132:0/4060015435 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d94057070 con 0x55d531dbccd0 2024-05-08T18:52:32.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.711+0000 7f9da1f68640 1 -- 172.21.15.132:0/4060015435 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d94052570 con 0x55d531dbccd0 2024-05-08T18:52:32.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.711+0000 7f9da1f68640 1 -- 172.21.15.132:0/4060015435 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d94052870 con 0x55d531dbccd0 2024-05-08T18:52:32.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.711+0000 7f9da7329800 1 -- 172.21.15.132:0/4060015435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531dbccd0 msgr2=0x55d531dbf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.711+0000 7f9da7329800 1 --2- 172.21.15.132:0/4060015435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531dbccd0 0x55d531dbf0c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f9d9400a470 tx=0x7f9d9401ce90 comp rx=0 tx=0).stop 2024-05-08T18:52:32.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.711+0000 7f9da7329800 1 -- 172.21.15.132:0/4060015435 shutdown_connections 2024-05-08T18:52:32.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.711+0000 7f9da7329800 1 --2- 172.21.15.132:0/4060015435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531dbccd0 0x55d531dbf0c0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.711+0000 7f9da7329800 1 -- 172.21.15.132:0/4060015435 >> 172.21.15.132:0/4060015435 conn(0x55d531db6720 msgr2=0x55d531db8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.711+0000 7f9da7329800 1 -- 172.21.15.132:0/4060015435 shutdown_connections 2024-05-08T18:52:32.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.711+0000 7f9da7329800 1 -- 172.21.15.132:0/4060015435 wait complete. 2024-05-08T18:52:32.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.725+0000 7f9da7329800 1 Processor -- start 2024-05-08T18:52:32.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.725+0000 7f9da7329800 1 -- start start 2024-05-08T18:52:32.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.725+0000 7f9da7329800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531dbccd0 0x55d531ead620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.725+0000 7f9da7329800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d531d075b0 con 0x55d531dbccd0 2024-05-08T18:52:32.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.725+0000 7f9da2f6a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531dbccd0 0x55d531ead620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.725+0000 7f9da2f6a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531dbccd0 0x55d531ead620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53424/0 (socket says 172.21.15.132:53424) 2024-05-08T18:52:32.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.725+0000 7f9da2f6a640 1 -- 172.21.15.132:0/3892784675 learned_addr learned my addr 172.21.15.132:0/3892784675 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.726+0000 7f9da2f6a640 1 -- 172.21.15.132:0/3892784675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d531eadbf0 con 0x55d531dbccd0 2024-05-08T18:52:32.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.726+0000 7f9da2f6a640 1 --2- 172.21.15.132:0/3892784675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531dbccd0 0x55d531ead620 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9d94055040 tx=0x7f9d9404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4475a98803968 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.726+0000 7f9c90e09640 1 -- 172.21.15.132:0/3892784675 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d94057040 con 0x55d531dbccd0 2024-05-08T18:52:32.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.726+0000 7f9c90e09640 1 -- 172.21.15.132:0/3892784675 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d94052990 con 0x55d531dbccd0 2024-05-08T18:52:32.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.726+0000 7f9c90e09640 1 -- 172.21.15.132:0/3892784675 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d94052c70 con 0x55d531dbccd0 2024-05-08T18:52:32.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.727+0000 7f9da7329800 1 -- 172.21.15.132:0/3892784675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531dbccd0 msgr2=0x55d531ead620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.727+0000 7f9da7329800 1 --2- 172.21.15.132:0/3892784675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531dbccd0 0x55d531ead620 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9d94055040 tx=0x7f9d9404c000 comp rx=0 tx=0).stop 2024-05-08T18:52:32.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.727+0000 7f9da7329800 1 -- 172.21.15.132:0/3892784675 shutdown_connections 2024-05-08T18:52:32.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.727+0000 7f9da7329800 1 --2- 172.21.15.132:0/3892784675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531dbccd0 0x55d531ead620 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.727+0000 7f9da7329800 1 -- 172.21.15.132:0/3892784675 >> 172.21.15.132:0/3892784675 conn(0x55d531db6720 msgr2=0x55d531ea8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.727+0000 7f9da7329800 1 -- 172.21.15.132:0/3892784675 shutdown_connections 2024-05-08T18:52:32.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.727+0000 7f9da7329800 1 -- 172.21.15.132:0/3892784675 wait complete. 2024-05-08T18:52:32.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.727+0000 7f9da7329800 1 Processor -- start 2024-05-08T18:52:32.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.727+0000 7f9da7329800 1 -- start start 2024-05-08T18:52:32.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.727+0000 7f9da7329800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531dbccd0 0x55d531dbc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.727+0000 7f9da7329800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d531dc3580 con 0x55d531dbccd0 2024-05-08T18:52:32.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.727+0000 7f9da2f6a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531dbccd0 0x55d531dbc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.727+0000 7f9da2f6a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531dbccd0 0x55d531dbc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53438/0 (socket says 172.21.15.132:53438) 2024-05-08T18:52:32.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.727+0000 7f9da2f6a640 1 -- 172.21.15.132:0/3220318279 learned_addr learned my addr 172.21.15.132:0/3220318279 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.728+0000 7f9da2f6a640 1 -- 172.21.15.132:0/3220318279 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d531dbad00 con 0x55d531dbccd0 2024-05-08T18:52:32.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.728+0000 7f9da2f6a640 1 --2- 172.21.15.132:0/3220318279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531dbccd0 0x55d531dbc610 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f9d9400a470 tx=0x7f9d94003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.728+0000 7f9c8f606640 1 -- 172.21.15.132:0/3220318279 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d94073070 con 0x55d531dbccd0 2024-05-08T18:52:32.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.728+0000 7f9c8f606640 1 -- 172.21.15.132:0/3220318279 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d9405d650 con 0x55d531dbccd0 2024-05-08T18:52:32.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.728+0000 7f9da7329800 1 -- 172.21.15.132:0/3220318279 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d531dbaf90 con 0x55d531dbccd0 2024-05-08T18:52:32.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.728+0000 7f9c8f606640 1 -- 172.21.15.132:0/3220318279 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d94057070 con 0x55d531dbccd0 2024-05-08T18:52:32.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.728+0000 7f9da7329800 1 -- 172.21.15.132:0/3220318279 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d531dbb4b0 con 0x55d531dbccd0 2024-05-08T18:52:32.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.729+0000 7f9c8f606640 1 -- 172.21.15.132:0/3220318279 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9d94076070 con 0x55d531dbccd0 2024-05-08T18:52:32.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.729+0000 7f9c8f606640 1 --2- 172.21.15.132:0/3220318279 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c8803bb50 0x7f9c8803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.729+0000 7f9c8f606640 1 -- 172.21.15.132:0/3220318279 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f9d94094320 con 0x55d531dbccd0 2024-05-08T18:52:32.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.729+0000 7f9da2769640 1 --2- 172.21.15.132:0/3220318279 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c8803bb50 0x7f9c8803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.729+0000 7f9da7329800 1 --2- 172.21.15.132:0/3220318279 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d531dbf600 0x55d531ebe4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.730+0000 7f9da7329800 1 -- 172.21.15.132:0/3220318279 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d531ebeaa0 con 0x55d531dbf600 2024-05-08T18:52:32.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.730+0000 7f9da376b640 1 --2- 172.21.15.132:0/3220318279 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d531dbf600 0x55d531ebe4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.730+0000 7f9da2769640 1 --2- 172.21.15.132:0/3220318279 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c8803bb50 0x7f9c8803e010 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9d98000f60 tx=0x7f9d980012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.730+0000 7f9da376b640 1 --2- 172.21.15.132:0/3220318279 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d531dbf600 0x55d531ebe4c0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.730+0000 7f9da376b640 1 -- 172.21.15.132:0/3220318279 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d9c00a4a0 con 0x55d531dbf600 2024-05-08T18:52:32.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.730+0000 7f9da7329800 1 -- 172.21.15.132:0/3220318279 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d531ebf380 con 0x55d531dbf600 2024-05-08T18:52:32.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.730+0000 7f9da376b640 1 -- 172.21.15.132:0/3220318279 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9d9c00a4a0 con 0x55d531dbf600 2024-05-08T18:52:32.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.730+0000 7f9da7329800 1 --2- 172.21.15.132:0/3220318279 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d531ec0e00 0x55d531ec32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.730+0000 7f9da7329800 1 -- 172.21.15.132:0/3220318279 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d531ec3a50 con 0x55d531ec0e00 2024-05-08T18:52:32.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.731+0000 7f9da2f6a640 1 --2- 172.21.15.132:0/3220318279 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d531ec0e00 0x55d531ec32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.731+0000 7f9da2f6a640 1 --2- 172.21.15.132:0/3220318279 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d531ec0e00 0x55d531ec32c0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.731+0000 7f9da2f6a640 1 -- 172.21.15.132:0/3220318279 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9d94075030 con 0x55d531ec0e00 2024-05-08T18:52:32.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.731+0000 7f9da7329800 1 -- 172.21.15.132:0/3220318279 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d531ebfbd0 con 0x55d531dbf600 2024-05-08T18:52:32.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.731+0000 7f9da376b640 1 -- 172.21.15.132:0/3220318279 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9d9c00a4a0 con 0x55d531dbf600 2024-05-08T18:52:32.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.731+0000 7f9da7329800 1 -- 172.21.15.132:0/3220318279 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d531ebffb0 con 0x55d531dbf600 2024-05-08T18:52:32.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.732+0000 7f9da376b640 1 -- 172.21.15.132:0/3220318279 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9d9c00a4a0 con 0x55d531dbf600 2024-05-08T18:52:32.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.732+0000 7f9da7329800 1 Processor -- start 2024-05-08T18:52:32.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.732+0000 7f9da7329800 1 -- start start 2024-05-08T18:52:32.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.732+0000 7f9da7329800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531ed2990 0x55d531ed2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.732+0000 7f9da7329800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d531dbcb50 con 0x55d531ed2990 2024-05-08T18:52:32.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.732+0000 7f9da376b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531ed2990 0x55d531ed2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.732+0000 7f9da376b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531ed2990 0x55d531ed2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53452/0 (socket says 172.21.15.132:53452) 2024-05-08T18:52:32.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.732+0000 7f9da376b640 1 -- 172.21.15.132:0/1041771496 learned_addr learned my addr 172.21.15.132:0/1041771496 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.733+0000 7f9da376b640 1 -- 172.21.15.132:0/1041771496 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d531ed32f0 con 0x55d531ed2990 2024-05-08T18:52:32.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.733+0000 7f9da376b640 1 --2- 172.21.15.132:0/1041771496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531ed2990 0x55d531ed2db0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x55d531ebeea0 tx=0x7f9d9c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.733+0000 7f9c8ce01640 1 -- 172.21.15.132:0/1041771496 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d9c014450 con 0x55d531ed2990 2024-05-08T18:52:32.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.733+0000 7f9c8ce01640 1 -- 172.21.15.132:0/1041771496 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d9c014610 con 0x55d531ed2990 2024-05-08T18:52:32.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.733+0000 7f9da7329800 1 -- 172.21.15.132:0/1041771496 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d531ed3d60 con 0x55d531ed2990 2024-05-08T18:52:32.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.733+0000 7f9c8ce01640 1 -- 172.21.15.132:0/1041771496 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d9c014930 con 0x55d531ed2990 2024-05-08T18:52:32.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.733+0000 7f9da7329800 1 -- 172.21.15.132:0/1041771496 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d531ed4260 con 0x55d531ed2990 2024-05-08T18:52:32.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.734+0000 7f9c8ce01640 1 -- 172.21.15.132:0/1041771496 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9d9c011040 con 0x55d531ed2990 2024-05-08T18:52:32.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.734+0000 7f9c8ce01640 1 --2- 172.21.15.132:0/1041771496 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c7c03bba0 0x7f9c7c03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.734+0000 7f9c8ce01640 1 -- 172.21.15.132:0/1041771496 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f9d9c01e070 con 0x55d531ed2990 2024-05-08T18:52:32.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.734+0000 7f9da2f6a640 1 --2- 172.21.15.132:0/1041771496 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c7c03bba0 0x7f9c7c03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.734+0000 7f9da7329800 1 Processor -- start 2024-05-08T18:52:32.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.735+0000 7f9da7329800 1 -- start start 2024-05-08T18:52:32.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.735+0000 7f9da2f6a640 1 --2- 172.21.15.132:0/1041771496 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c7c03bba0 0x7f9c7c03e060 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55d531dbbac0 tx=0x7f9d94076360 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.735+0000 7f9da7329800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531edfc10 0x55d531ee0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.735+0000 7f9da7329800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d531cadfc0 con 0x55d531edfc10 2024-05-08T18:52:32.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.735+0000 7f9da376b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531edfc10 0x55d531ee0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.735+0000 7f9da376b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531edfc10 0x55d531ee0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53462/0 (socket says 172.21.15.132:53462) 2024-05-08T18:52:32.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.735+0000 7f9da376b640 1 -- 172.21.15.132:0/1190998598 learned_addr learned my addr 172.21.15.132:0/1190998598 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.735+0000 7f9da376b640 1 -- 172.21.15.132:0/1190998598 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d531ee0600 con 0x55d531edfc10 2024-05-08T18:52:32.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.735+0000 7f9da376b640 1 --2- 172.21.15.132:0/1190998598 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531edfc10 0x55d531ee0030 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c052c50 tx=0x7f9d9c0118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a34c07e91c2c9c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.735+0000 7f9c867fc640 1 -- 172.21.15.132:0/1190998598 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d9c011dc0 con 0x55d531edfc10 2024-05-08T18:52:32.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.736+0000 7f9c867fc640 1 -- 172.21.15.132:0/1190998598 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d9c001310 con 0x55d531edfc10 2024-05-08T18:52:32.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.736+0000 7f9c867fc640 1 -- 172.21.15.132:0/1190998598 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d9c014ad0 con 0x55d531edfc10 2024-05-08T18:52:32.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.736+0000 7f9da7329800 1 -- 172.21.15.132:0/1190998598 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531edfc10 msgr2=0x55d531ee0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.736+0000 7f9da7329800 1 --2- 172.21.15.132:0/1190998598 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531edfc10 0x55d531ee0030 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c052c50 tx=0x7f9d9c0118e0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.736+0000 7f9da7329800 1 -- 172.21.15.132:0/1190998598 shutdown_connections 2024-05-08T18:52:32.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.736+0000 7f9da7329800 1 --2- 172.21.15.132:0/1190998598 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531edfc10 0x55d531ee0030 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.736+0000 7f9da7329800 1 -- 172.21.15.132:0/1190998598 >> 172.21.15.132:0/1190998598 conn(0x55d531edbf70 msgr2=0x55d531ed9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.736+0000 7f9da7329800 1 -- 172.21.15.132:0/1190998598 shutdown_connections 2024-05-08T18:52:32.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.736+0000 7f9da7329800 1 -- 172.21.15.132:0/1190998598 wait complete. 2024-05-08T18:52:32.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.736+0000 7f9da7329800 1 Processor -- start 2024-05-08T18:52:32.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.736+0000 7f9da7329800 1 -- start start 2024-05-08T18:52:32.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.736+0000 7f9da7329800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531edfc10 0x55d531ee7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.736+0000 7f9da7329800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55d531ee0bf0 con 0x55d531edfc10 2024-05-08T18:52:32.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.737+0000 7f9da376b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531edfc10 0x55d531ee7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.737+0000 7f9da376b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531edfc10 0x55d531ee7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53468/0 (socket says 172.21.15.132:53468) 2024-05-08T18:52:32.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.737+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 learned_addr learned my addr 172.21.15.132:0/1760012393 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.737+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d531ee75b0 con 0x55d531edfc10 2024-05-08T18:52:32.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.737+0000 7f9da376b640 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531edfc10 0x55d531ee7070 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0119b0 tx=0x7f9d9c052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.737+0000 7f9c84ff9640 1 -- 172.21.15.132:0/1760012393 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d9c011dc0 con 0x55d531edfc10 2024-05-08T18:52:32.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.737+0000 7f9c84ff9640 1 -- 172.21.15.132:0/1760012393 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d9c04b340 con 0x55d531edfc10 2024-05-08T18:52:32.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.737+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d531ee7840 con 0x55d531edfc10 2024-05-08T18:52:32.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.737+0000 7f9c84ff9640 1 -- 172.21.15.132:0/1760012393 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d9c04b620 con 0x55d531edfc10 2024-05-08T18:52:32.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.737+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d531eea4f0 con 0x55d531edfc10 2024-05-08T18:52:32.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.738+0000 7f9c84ff9640 1 -- 172.21.15.132:0/1760012393 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9d9c02b350 con 0x55d531edfc10 2024-05-08T18:52:32.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.738+0000 7f9c84ff9640 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c6c03bb00 0x7f9c6c03dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.738+0000 7f9c84ff9640 1 -- 172.21.15.132:0/1760012393 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f9d9c00e040 con 0x55d531edfc10 2024-05-08T18:52:32.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.738+0000 7f9da2f6a640 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c6c03bb00 0x7f9c6c03dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.739+0000 7f9da2f6a640 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c6c03bb00 0x7f9c6c03dfc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9d9405b730 tx=0x7f9d9408b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.739+0000 7f9da7329800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.739+0000 7f9da7329800 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d531ef2cd0 0x55d531ef5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.739+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d531ef58e0 con 0x55d531ef2cd0 2024-05-08T18:52:32.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.739+0000 7f9da2769640 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d531ef2cd0 0x55d531ef5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.739+0000 7f9da2769640 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d531ef2cd0 0x55d531ef5190 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.739+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d98009050 con 0x55d531ef2cd0 2024-05-08T18:52:32.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.739+0000 7f9da7329800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.739+0000 7f9da7329800 20 realm 2024-05-08T18:52:32.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.739+0000 7f9da7329800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.739+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d531ef2120 con 0x55d531ef2cd0 2024-05-08T18:52:32.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.740+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d98009050 con 0x55d531ef2cd0 2024-05-08T18:52:32.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.740+0000 7f9da7329800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.740+0000 7f9da7329800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:52:32.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.740+0000 7f9da7329800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.740+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d531ef63d0 con 0x55d531ef2cd0 2024-05-08T18:52:32.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.740+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d98009050 con 0x55d531ef2cd0 2024-05-08T18:52:32.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.740+0000 7f9da7329800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.740+0000 7f9da7329800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.740+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d531ef6ca0 con 0x55d531ef2cd0 2024-05-08T18:52:32.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.740+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9d98009050 con 0x55d531ef2cd0 2024-05-08T18:52:32.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.740+0000 7f9da7329800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:32.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.740+0000 7f9da7329800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.740+0000 7f9da7329800 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d531ef75e0 0x55d531ef99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.740+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d531efa160 con 0x55d531ef75e0 2024-05-08T18:52:32.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.740+0000 7f9da376b640 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d531ef75e0 0x55d531ef99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.740+0000 7f9da376b640 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d531ef75e0 0x55d531ef99d0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.741+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.741+0000 7f9da7329800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:52:32.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.741+0000 7f9da7329800 20 searching for the correct realm 2024-05-08T18:52:32.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.741+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x55d531ef75e0 2024-05-08T18:52:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.741+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.741+0000 7f9da376b640 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9d9c014070 0x7f9d9c0239f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.741+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x7f9d9c014070 2024-05-08T18:52:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.741+0000 7f9da2f6a640 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9d9c014070 0x7f9d9c0239f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.742+0000 7f9da2f6a640 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9d9c014070 0x7f9d9c0239f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.742+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d94075030 con 0x7f9d9c014070 2024-05-08T18:52:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.742+0000 7f9da2f6a640 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f9d940a1040 0x7f9d9405b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.742+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x7f9d940a1040 2024-05-08T18:52:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.742+0000 7f9da2769640 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f9d940a1040 0x7f9d9405b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.742+0000 7f9da2769640 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f9d940a1040 0x7f9d9405b7a0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.743+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d98009050 con 0x7f9d940a1040 2024-05-08T18:52:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.743+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x55d531ef2cd0 2024-05-08T18:52:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.743+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d98009050 con 0x55d531ef2cd0 2024-05-08T18:52:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.743+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x55d531ef2cd0 2024-05-08T18:52:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.743+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.743+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x7f9d940a1040 2024-05-08T18:52:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.743+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.743+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x7f9d940a1040 2024-05-08T18:52:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.744+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.744+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x7f9d9c014070 2024-05-08T18:52:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.744+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d94075030 con 0x7f9d9c014070 2024-05-08T18:52:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.744+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x55d531ef75e0 2024-05-08T18:52:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.744+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.744+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x55d531ef2cd0 2024-05-08T18:52:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.744+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.744+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x7f9d940a1040 2024-05-08T18:52:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.745+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.745+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x55d531ef2cd0 2024-05-08T18:52:32.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.745+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.745+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x7f9d9c014070 2024-05-08T18:52:32.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.745+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9d94075030 con 0x7f9d9c014070 2024-05-08T18:52:32.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.745+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x55d531ef75e0 2024-05-08T18:52:32.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.745+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v27'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.745+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x55d531ef75e0 2024-05-08T18:52:32.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.746+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.746+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x7f9d940a1040 2024-05-08T18:52:32.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.746+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.746+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x55d531ef75e0 2024-05-08T18:52:32.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.746+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.746+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x55d531ef75e0 2024-05-08T18:52:32.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.746+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.746+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x55d531ef2cd0 2024-05-08T18:52:32.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.747+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.747+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x55d531ef2cd0 2024-05-08T18:52:32.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.747+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v27'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.747+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x7f9d940a1040 2024-05-08T18:52:32.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.747+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.747+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x55d531ef75e0 2024-05-08T18:52:32.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.747+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.747+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x7f9d9c014070 2024-05-08T18:52:32.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.748+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d94075030 con 0x7f9d9c014070 2024-05-08T18:52:32.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.748+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x55d531ef2cd0 2024-05-08T18:52:32.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.748+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.748+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x7f9d9c014070 2024-05-08T18:52:32.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.748+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d94075030 con 0x7f9d9c014070 2024-05-08T18:52:32.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.748+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x55d531ef75e0 2024-05-08T18:52:32.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.748+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.748+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x7f9d940a1040 2024-05-08T18:52:32.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.749+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.749+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x7f9d9c014070 2024-05-08T18:52:32.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.749+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d94075030 con 0x7f9d9c014070 2024-05-08T18:52:32.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.749+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x55d531ef75e0 2024-05-08T18:52:32.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.749+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.749+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x7f9d940a1040 2024-05-08T18:52:32.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.749+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.750+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x55d531ef2cd0 2024-05-08T18:52:32.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.750+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v27'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.750+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d531efba90 con 0x7f9d9c014070 2024-05-08T18:52:32.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.750+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d94075030 con 0x7f9d9c014070 2024-05-08T18:52:32.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.750+0000 7f9da7329800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:52:32.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.750+0000 7f9da7329800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:52:32.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.750+0000 7f9da7329800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:52:32.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.750+0000 7f9da7329800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:52:32.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.750+0000 7f9da7329800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:52:32.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.750+0000 7f9da7329800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:52:32.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.750+0000 7f9da7329800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.750+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d531efab20 con 0x55d531ef2cd0 2024-05-08T18:52:32.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.750+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.750+0000 7f9da7329800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.750+0000 7f9da7329800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.750+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d531efb3c0 con 0x55d531ef2cd0 2024-05-08T18:52:32.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.750+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.750+0000 7f9da7329800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:32.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.751+0000 7f9da7329800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.751+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d531efbf10 con 0x55d531ef2cd0 2024-05-08T18:52:32.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.751+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.751+0000 7f9da7329800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:52:32.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.751+0000 7f9da7329800 20 zone default found 2024-05-08T18:52:32.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.751+0000 7f9da7329800 4 Realm: () 2024-05-08T18:52:32.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.751+0000 7f9da7329800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:52:32.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.751+0000 7f9da7329800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:52:32.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.751+0000 7f9da7329800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:52:32.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.751+0000 7f9da7329800 20 zonegroup default 2024-05-08T18:52:32.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.751+0000 7f9da7329800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.751+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d531efc2f0 con 0x7f9d9c014070 2024-05-08T18:52:32.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.751+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9d94075030 con 0x7f9d9c014070 2024-05-08T18:52:32.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.751+0000 7f9da7329800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.751+0000 7f9da7329800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.751+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d531efe5c0 con 0x55d531ef75e0 2024-05-08T18:52:32.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.751+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.751+0000 7f9da7329800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.751+0000 7f9da7329800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.751+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d531efe960 con 0x55d531ef75e0 2024-05-08T18:52:32.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.751+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.752+0000 7f9da7329800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.752+0000 7f9da7329800 20 started sync module instance, tier type = 2024-05-08T18:52:32.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.752+0000 7f9da7329800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:52:32.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.752+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531efda50 con 0x7f9d9c014070 2024-05-08T18:52:32.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.753+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d94075030 con 0x7f9d9c014070 2024-05-08T18:52:32.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.753+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94374154198592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531eff200 con 0x7f9d9c014070 2024-05-08T18:52:32.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.753+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531effa50 con 0x55d531ef2cd0 2024-05-08T18:52:32.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.754+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94374154198592] v27'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d94075030 con 0x7f9d9c014070 2024-05-08T18:52:32.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.754+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.754+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94374154202448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531effa50 con 0x55d531ef2cd0 2024-05-08T18:52:32.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.754+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f00550 con 0x55d531ef75e0 2024-05-08T18:52:32.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.755+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94374154202448] v27'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.756+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.756+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94374154207296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531effa50 con 0x55d531ef75e0 2024-05-08T18:52:32.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.756+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f00fd0 con 0x7f9d9c014070 2024-05-08T18:52:32.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.757+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d94075030 con 0x7f9d9c014070 2024-05-08T18:52:32.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.757+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94374154210016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f00fa0 con 0x7f9d9c014070 2024-05-08T18:52:32.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.757+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f01fc0 con 0x55d531ef2cd0 2024-05-08T18:52:32.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.757+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94374154207296] v27'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.758+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94374154210016] v27'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d94075030 con 0x7f9d9c014070 2024-05-08T18:52:32.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.758+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.758+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94374154212288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f01f80 con 0x55d531ef2cd0 2024-05-08T18:52:32.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.758+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f02860 con 0x7f9d940a1040 2024-05-08T18:52:32.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.759+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94374154212288] v27'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.759+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.759+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94374154214032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f02430 con 0x7f9d940a1040 2024-05-08T18:52:32.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.759+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f02ee0 con 0x7f9d940a1040 2024-05-08T18:52:32.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.760+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(56 notify.6 [create] v27'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.760+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94374154217968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f03360 con 0x7f9d940a1040 2024-05-08T18:52:32.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.760+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f03e60 con 0x7f9d940a1040 2024-05-08T18:52:32.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.760+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94374154214032] v27'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.761+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94374154217968] v27'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.761+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.761+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94374154219024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f01f80 con 0x7f9d940a1040 2024-05-08T18:52:32.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.761+0000 7f9da7329800 20 add_watcher() i=0 2024-05-08T18:52:32.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.761+0000 7f9da7329800 20 add_watcher() i=1 2024-05-08T18:52:32.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.761+0000 7f9da7329800 20 add_watcher() i=2 2024-05-08T18:52:32.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.761+0000 7f9da7329800 20 add_watcher() i=3 2024-05-08T18:52:32.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.761+0000 7f9da7329800 20 add_watcher() i=4 2024-05-08T18:52:32.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.761+0000 7f9da7329800 20 add_watcher() i=5 2024-05-08T18:52:32.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.761+0000 7f9da7329800 20 add_watcher() i=6 2024-05-08T18:52:32.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.762+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94374154219024] v27'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.762+0000 7f9da7329800 20 add_watcher() i=7 2024-05-08T18:52:32.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.762+0000 7f9da7329800 2 all 8 watchers are set, enabling cache 2024-05-08T18:52:32.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.762+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d531f06e50 con 0x55d531ef2cd0 2024-05-08T18:52:32.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.763+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.763+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94374154221904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f042d0 con 0x55d531ef2cd0 2024-05-08T18:52:32.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.763+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94374154221904] v27'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.764+0000 7f9c597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:32.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.764+0000 7f9da7329800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:32.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.764+0000 7f9da7329800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:32.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.764+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f0f6f0 con 0x55d531ef2cd0 2024-05-08T18:52:32.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.765+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.765+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f0fd20 con 0x7f9d940a1040 2024-05-08T18:52:32.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.766+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.766+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f10180 con 0x55d531ef75e0 2024-05-08T18:52:32.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.767+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.767+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f105a0 con 0x55d531ef2cd0 2024-05-08T18:52:32.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.768+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'253 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.768+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f0d5a0 con 0x7f9d9c014070 2024-05-08T18:52:32.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.769+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'80 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9d94075030 con 0x7f9d9c014070 2024-05-08T18:52:32.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.769+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f0d5a0 con 0x55d531ef75e0 2024-05-08T18:52:32.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.770+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'54 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.770+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f0d5a0 con 0x55d531ef2cd0 2024-05-08T18:52:32.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.772+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.772+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f0d6d0 con 0x7f9d940a1040 2024-05-08T18:52:32.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.773+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'55 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.773+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f0d6d0 con 0x7f9d9c014070 2024-05-08T18:52:32.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.774+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9d94075030 con 0x7f9d9c014070 2024-05-08T18:52:32.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.774+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f11020 con 0x55d531ef75e0 2024-05-08T18:52:32.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.775+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.775+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f11020 con 0x7f9d9c014070 2024-05-08T18:52:32.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.776+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'81 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9d94075030 con 0x7f9d9c014070 2024-05-08T18:52:32.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.776+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f11020 con 0x7f9d940a1040 2024-05-08T18:52:32.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.777+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'36 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.777+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f11020 con 0x7f9d9c014070 2024-05-08T18:52:32.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.778+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9d94075030 con 0x7f9d9c014070 2024-05-08T18:52:32.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.778+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f11020 con 0x7f9d940a1040 2024-05-08T18:52:32.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.779+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'59 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.779+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f11020 con 0x55d531ef2cd0 2024-05-08T18:52:32.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.780+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'254 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.780+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f11020 con 0x55d531ef75e0 2024-05-08T18:52:32.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.782+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'74 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.782+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f110e0 con 0x7f9d9c014070 2024-05-08T18:52:32.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.783+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'82 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9d94075030 con 0x7f9d9c014070 2024-05-08T18:52:32.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.783+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f110e0 con 0x55d531ef75e0 2024-05-08T18:52:32.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.783+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.783+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f110b0 con 0x55d531ef2cd0 2024-05-08T18:52:32.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.785+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.785+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f110b0 con 0x55d531ef2cd0 2024-05-08T18:52:32.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.786+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'255 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.786+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f110b0 con 0x55d531ef75e0 2024-05-08T18:52:32.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.787+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'75 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.787+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f110e0 con 0x7f9d9c014070 2024-05-08T18:52:32.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.788+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9d94075030 con 0x7f9d9c014070 2024-05-08T18:52:32.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.788+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f110e0 con 0x55d531ef75e0 2024-05-08T18:52:32.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.789+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'33 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.789+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f110b0 con 0x55d531ef75e0 2024-05-08T18:52:32.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.789+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'37 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.789+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f11110 con 0x55d531ef75e0 2024-05-08T18:52:32.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.790+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.791+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f11110 con 0x55d531ef75e0 2024-05-08T18:52:32.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.792+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'55 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.791 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.792+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f110b0 con 0x7f9d940a1040 2024-05-08T18:52:32.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.793+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.793+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f110b0 con 0x55d531ef75e0 2024-05-08T18:52:32.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.794+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.794+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f11110 con 0x7f9d940a1040 2024-05-08T18:52:32.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.795+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'56 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.796+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f11110 con 0x55d531ef75e0 2024-05-08T18:52:32.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.796+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'76 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.796+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f110b0 con 0x7f9d940a1040 2024-05-08T18:52:32.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.797+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'60 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.798+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f110e0 con 0x7f9d9c014070 2024-05-08T18:52:32.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.798+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9d94075030 con 0x7f9d9c014070 2024-05-08T18:52:32.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.799+0000 7f9bd3fff640 20 reqs_thread_entry: start 2024-05-08T18:52:32.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.799+0000 7f9da7329800 20 init_complete bucket index max shards: 11 2024-05-08T18:52:32.799 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.799+0000 7f9da7329800 20 Filter name: none 2024-05-08T18:52:32.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.799+0000 7f9bd1ffb640 20 reqs_thread_entry: start 2024-05-08T18:52:32.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.799+0000 7f9da7329800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-05-08T18:52:32.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.799+0000 7f9da7329800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.799+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d531f3c270 con 0x55d531ef75e0 2024-05-08T18:52:32.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.800+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.800+0000 7f9da7329800 20 rados_obj.operate() r=0 bl.length=363 2024-05-08T18:52:32.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.800+0000 7f9da7329800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-05-08T18:52:32.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.800+0000 7f9da7329800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-08T18:52:32.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.800+0000 7f9da7329800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:52:32.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.800+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d531f3eba0 con 0x55d531ef75e0 2024-05-08T18:52:32.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.800+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 28 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f9d9c03d070 con 0x55d531ef75e0 2024-05-08T18:52:32.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.800+0000 7f9da7329800 10 removing key index: true_admin_akey 2024-05-08T18:52:32.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.800+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f3cb80 con 0x55d531ef75e0 2024-05-08T18:52:32.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.801+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 29 ==== osd_op_reply(96 true_admin_akey [delete] v27'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f9d9c06b040 con 0x55d531ef75e0 2024-05-08T18:52:32.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.801+0000 7f9da7329800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-05-08T18:52:32.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.801+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94374154458768 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d531f3f0d0 con 0x7f9d940a1040 2024-05-08T18:52:32.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.801+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== watch-notify(notify (1) cookie 94374154214032 notify 115964117023 ret 0) ==== 207+0+0 (crc 0 0 0) 0x55d531f0fd20 con 0x7f9d940a1040 2024-05-08T18:52:32.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.801+0000 7f9c867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117023 cookie 94374154214032 notifier 4858 bl.length()=165 2024-05-08T18:52:32.802 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.801+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(97 notify.5 [notify cookie 94374154458768 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.801+0000 7f9c867fc640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f9c68003d60 con 0x7f9d940a1040 2024-05-08T18:52:32.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.802+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.802+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== watch-notify(notify_complete (2) cookie 94374154458768 notify 115964117023 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d531f0f110 con 0x7f9d940a1040 2024-05-08T18:52:32.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.802+0000 7f9da7329800 10 removing email index: 2024-05-08T18:52:32.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.802+0000 7f9da7329800 10 removing user buckets index 2024-05-08T18:52:32.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.802+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f3f030 con 0x55d531ef75e0 2024-05-08T18:52:32.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.802+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 30 ==== osd_op_reply(99 a_user.buckets [delete] v27'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f9d9c06b040 con 0x55d531ef75e0 2024-05-08T18:52:32.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.803+0000 7f9da7329800 10 removing user index: a_user 2024-05-08T18:52:32.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.803+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f3e6a0 con 0x55d531ef75e0 2024-05-08T18:52:32.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.804+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 31 ==== osd_op_reply(100 a_user [call,call,delete] v27'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f9d9c06b040 con 0x55d531ef75e0 2024-05-08T18:52:32.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.804+0000 7f9da7329800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-05-08T18:52:32.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.804+0000 7f9da7329800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-05-08T18:52:32.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.804+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94374154464032 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d531f3db40 con 0x55d531ef75e0 2024-05-08T18:52:32.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.804+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 32 ==== watch-notify(notify (1) cookie 94374154207296 notify 115964117004 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55d531f0d6d0 con 0x55d531ef75e0 2024-05-08T18:52:32.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.804+0000 7f9c85ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117004 cookie 94374154207296 notifier 4858 bl.length()=155 2024-05-08T18:52:32.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.804+0000 7f9c85ffb640 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f9bd80032c0 con 0x55d531ef75e0 2024-05-08T18:52:32.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.804+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 33 ==== osd_op_reply(101 notify.2 [notify cookie 94374154464032 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9d9c06b040 con 0x55d531ef75e0 2024-05-08T18:52:32.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.804+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 34 ==== watch-notify(notify_complete (2) cookie 94374154464032 notify 115964117004 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d531ee7840 con 0x55d531ef75e0 2024-05-08T18:52:32.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.804+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 35 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d9c06b040 con 0x55d531ef75e0 2024-05-08T18:52:32.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.805+0000 7f9c597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:32.805 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.805+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94374154221904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f0c8d0 con 0x55d531ef2cd0 2024-05-08T18:52:32.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.806+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94374154221904] v27'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.806+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94374154198592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f0c8d0 con 0x7f9d9c014070 2024-05-08T18:52:32.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.807+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 <== osd.2 v2:172.21.15.132:6808/1108348591 20 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94374154198592] v27'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d94075030 con 0x7f9d9c014070 2024-05-08T18:52:32.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.807+0000 7f9da7329800 20 remove_watcher() i=0 2024-05-08T18:52:32.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.807+0000 7f9da7329800 2 removed watcher, disabling cache 2024-05-08T18:52:32.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.807+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94374154202448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531efde40 con 0x55d531ef2cd0 2024-05-08T18:52:32.807 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.808+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94374154202448] v27'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.808+0000 7f9da7329800 20 remove_watcher() i=1 2024-05-08T18:52:32.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.808+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94374154207296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531efde40 con 0x55d531ef75e0 2024-05-08T18:52:32.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.809+0000 7f9da376b640 1 -- 172.21.15.132:0/1760012393 <== osd.3 v2:172.21.15.132:6816/17827703 36 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94374154207296] v27'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d9c06b040 con 0x55d531ef75e0 2024-05-08T18:52:32.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.809+0000 7f9da7329800 20 remove_watcher() i=2 2024-05-08T18:52:32.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.809+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94374154210016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531efde40 con 0x7f9d9c014070 2024-05-08T18:52:32.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.810+0000 7f9da2f6a640 1 -- 172.21.15.132:0/1760012393 <== osd.2 v2:172.21.15.132:6808/1108348591 21 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94374154210016] v27'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d94075030 con 0x7f9d9c014070 2024-05-08T18:52:32.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.810+0000 7f9da7329800 20 remove_watcher() i=3 2024-05-08T18:52:32.810 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.810+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94374154212288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531efde40 con 0x55d531ef2cd0 2024-05-08T18:52:32.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.811+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94374154212288] v27'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x55d531ef2cd0 2024-05-08T18:52:32.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.811+0000 7f9da7329800 20 remove_watcher() i=4 2024-05-08T18:52:32.811 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.811+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94374154214032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f013c0 con 0x7f9d940a1040 2024-05-08T18:52:32.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.812+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94374154214032] v27'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.812+0000 7f9da7329800 20 remove_watcher() i=5 2024-05-08T18:52:32.812 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.812+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94374154217968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531efde40 con 0x7f9d940a1040 2024-05-08T18:52:32.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.813+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94374154217968] v27'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.813+0000 7f9da7329800 20 remove_watcher() i=6 2024-05-08T18:52:32.813 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.813+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94374154219024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d531f029f0 con 0x7f9d940a1040 2024-05-08T18:52:32.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.814+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 <== osd.0 v2:172.21.15.42:6800/1521799280 28 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94374154219024] v27'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d98029040 con 0x7f9d940a1040 2024-05-08T18:52:32.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.814+0000 7f9da7329800 20 remove_watcher() i=7 2024-05-08T18:52:32.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f9d940a1040 msgr2=0x7f9d9405b7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.816 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f9d940a1040 0x7f9d9405b7a0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d531ef2cd0 msgr2=0x55d531ef5190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d531ef2cd0 0x55d531ef5190 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9d9c014070 msgr2=0x7f9d9c0239f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9d9c014070 0x7f9d9c0239f0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d531ef75e0 msgr2=0x55d531ef99d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d531ef75e0 0x55d531ef99d0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c6c03bb00 msgr2=0x7f9c6c03dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c6c03bb00 0x7f9c6c03dfc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9d9405b730 tx=0x7f9d9408b000 comp rx=0 tx=0).stop 2024-05-08T18:52:32.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531edfc10 msgr2=0x55d531ee7070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da2769640 1 -- 172.21.15.132:0/1760012393 reap_dead start 2024-05-08T18:52:32.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531edfc10 0x55d531ee7070 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0119b0 tx=0x7f9d9c052be0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 shutdown_connections 2024-05-08T18:52:32.817 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 --2- 172.21.15.132:0/1760012393 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531edfc10 0x55d531ee7070 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 >> 172.21.15.132:0/1760012393 conn(0x55d531edbf70 msgr2=0x55d531ed95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 shutdown_connections 2024-05-08T18:52:32.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 -- 172.21.15.132:0/1760012393 wait complete. 2024-05-08T18:52:32.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 -- 172.21.15.132:0/1041771496 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c7c03bba0 msgr2=0x7f9c7c03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 --2- 172.21.15.132:0/1041771496 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c7c03bba0 0x7f9c7c03e060 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55d531dbbac0 tx=0x7f9d94076360 comp rx=0 tx=0).stop 2024-05-08T18:52:32.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 -- 172.21.15.132:0/1041771496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531ed2990 msgr2=0x55d531ed2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 --2- 172.21.15.132:0/1041771496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531ed2990 0x55d531ed2db0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x55d531ebeea0 tx=0x7f9d9c018830 comp rx=0 tx=0).stop 2024-05-08T18:52:32.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 -- 172.21.15.132:0/1041771496 shutdown_connections 2024-05-08T18:52:32.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 --2- 172.21.15.132:0/1041771496 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c7c03bba0 0x7f9c7c03e060 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 --2- 172.21.15.132:0/1041771496 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531ed2990 0x55d531ed2db0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 -- 172.21.15.132:0/1041771496 >> 172.21.15.132:0/1041771496 conn(0x55d531ec6a30 msgr2=0x55d531ec6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 -- 172.21.15.132:0/1041771496 shutdown_connections 2024-05-08T18:52:32.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.815+0000 7f9da7329800 1 -- 172.21.15.132:0/1041771496 wait complete. 2024-05-08T18:52:32.818 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.816+0000 7f9da7329800 1 -- 172.21.15.132:0/3220318279 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d531dbf600 msgr2=0x55d531ebe4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.816+0000 7f9da7329800 1 --2- 172.21.15.132:0/3220318279 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d531dbf600 0x55d531ebe4c0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.816+0000 7f9da7329800 1 -- 172.21.15.132:0/3220318279 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d531ec0e00 msgr2=0x55d531ec32c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.816+0000 7f9da7329800 1 --2- 172.21.15.132:0/3220318279 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d531ec0e00 0x55d531ec32c0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.816+0000 7f9da7329800 1 -- 172.21.15.132:0/3220318279 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c8803bb50 msgr2=0x7f9c8803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.816+0000 7f9da7329800 1 --2- 172.21.15.132:0/3220318279 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c8803bb50 0x7f9c8803e010 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9d98000f60 tx=0x7f9d980012b0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.816+0000 7f9da7329800 1 -- 172.21.15.132:0/3220318279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531dbccd0 msgr2=0x55d531dbc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.816+0000 7f9da7329800 1 --2- 172.21.15.132:0/3220318279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531dbccd0 0x55d531dbc610 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f9d9400a470 tx=0x7f9d94003020 comp rx=0 tx=0).stop 2024-05-08T18:52:32.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.816+0000 7f9da7329800 1 -- 172.21.15.132:0/3220318279 shutdown_connections 2024-05-08T18:52:32.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.816+0000 7f9da7329800 1 --2- 172.21.15.132:0/3220318279 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55d531ec0e00 0x55d531ec32c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.816+0000 7f9da7329800 1 --2- 172.21.15.132:0/3220318279 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55d531dbf600 0x55d531ebe4c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.816+0000 7f9da7329800 1 --2- 172.21.15.132:0/3220318279 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c8803bb50 0x7f9c8803e010 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.819 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.816+0000 7f9da7329800 1 --2- 172.21.15.132:0/3220318279 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d531dbccd0 0x55d531dbc610 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.816+0000 7f9da7329800 1 -- 172.21.15.132:0/3220318279 >> 172.21.15.132:0/3220318279 conn(0x55d531db6720 msgr2=0x55d531ea7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.816+0000 7f9da7329800 1 -- 172.21.15.132:0/3220318279 shutdown_connections 2024-05-08T18:52:32.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.816+0000 7f9da7329800 1 -- 172.21.15.132:0/3220318279 wait complete. 2024-05-08T18:52:32.824 ERROR:root:None 2024-05-08T18:52:32.824 ERROR:root:0 2024-05-08T18:52:32.824 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-05-08T18:52:32.824 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-05-08T18:52:32.825 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-05-08T18:52:32.871 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:32.871 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:32.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.872+0000 7ff964929800 1 Processor -- start 2024-05-08T18:52:32.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.872+0000 7ff964929800 1 -- start start 2024-05-08T18:52:32.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.872+0000 7ff964929800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x56527899fdf0 0x56527899e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.872+0000 7ff964929800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56527899edd0 con 0x56527899e890 2024-05-08T18:52:32.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.872+0000 7ff964929800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x5652788cae20 con 0x56527899fdf0 2024-05-08T18:52:32.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.873+0000 7ff9606e4640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x56527899fdf0 0x56527899e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.873+0000 7ff9606e4640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x56527899fdf0 0x56527899e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53474/0 (socket says 172.21.15.132:53474) 2024-05-08T18:52:32.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.873+0000 7ff957fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x56527899e890 0x565278a32150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48174/0 (socket says 172.21.15.132:48174) 2024-05-08T18:52:32.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.873+0000 7ff9606e4640 1 -- 172.21.15.132:0/386170697 learned_addr learned my addr 172.21.15.132:0/386170697 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.873+0000 7ff9606e4640 1 -- 172.21.15.132:0/386170697 >> v1:172.21.15.42:6789/0 conn(0x56527899e890 legacy=0x565278a32150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.873+0000 7ff9606e4640 1 -- 172.21.15.132:0/386170697 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56527899efa0 con 0x56527899fdf0 2024-05-08T18:52:32.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.873+0000 7ff95fee3640 1 -- 172.21.15.132:0/386170697 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2410638153 0 0) 0x56527899edd0 con 0x56527899e890 2024-05-08T18:52:32.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.875+0000 7ff9606e4640 1 --2- 172.21.15.132:0/386170697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56527899fdf0 0x56527899e350 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff95000a520 tx=0x7ff95001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607c0b41dd9f70a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.875+0000 7ff95fee3640 1 -- 172.21.15.132:0/386170697 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff950057070 con 0x56527899fdf0 2024-05-08T18:52:32.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.876+0000 7ff95fee3640 1 -- 172.21.15.132:0/386170697 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff950052570 con 0x56527899fdf0 2024-05-08T18:52:32.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.876+0000 7ff95fee3640 1 -- 172.21.15.132:0/386170697 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff950052870 con 0x56527899fdf0 2024-05-08T18:52:32.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.876+0000 7ff964929800 1 -- 172.21.15.132:0/386170697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56527899fdf0 msgr2=0x56527899e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.876+0000 7ff964929800 1 --2- 172.21.15.132:0/386170697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56527899fdf0 0x56527899e350 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff95000a520 tx=0x7ff95001d010 comp rx=0 tx=0).stop 2024-05-08T18:52:32.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.876+0000 7ff964929800 1 -- 172.21.15.132:0/386170697 shutdown_connections 2024-05-08T18:52:32.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.876+0000 7ff964929800 1 --2- 172.21.15.132:0/386170697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56527899fdf0 0x56527899e350 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.876+0000 7ff964929800 1 -- 172.21.15.132:0/386170697 >> 172.21.15.132:0/386170697 conn(0x565278a25840 msgr2=0x565278a27c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.876+0000 7ff964929800 1 -- 172.21.15.132:0/386170697 shutdown_connections 2024-05-08T18:52:32.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.876+0000 7ff964929800 1 -- 172.21.15.132:0/386170697 wait complete. 2024-05-08T18:52:32.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.890+0000 7ff964929800 1 Processor -- start 2024-05-08T18:52:32.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.890+0000 7ff964929800 1 -- start start 2024-05-08T18:52:32.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.890+0000 7ff964929800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56527899e890 0x565278b1d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.890+0000 7ff964929800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5652789755c0 con 0x56527899e890 2024-05-08T18:52:32.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.891+0000 7ff9606e4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56527899e890 0x565278b1d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.891+0000 7ff9606e4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56527899e890 0x565278b1d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53486/0 (socket says 172.21.15.132:53486) 2024-05-08T18:52:32.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.891+0000 7ff9606e4640 1 -- 172.21.15.132:0/2375323854 learned_addr learned my addr 172.21.15.132:0/2375323854 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.891+0000 7ff9606e4640 1 -- 172.21.15.132:0/2375323854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565278b1dd30 con 0x56527899e890 2024-05-08T18:52:32.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.891+0000 7ff9606e4640 1 --2- 172.21.15.132:0/2375323854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56527899e890 0x565278b1d760 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ff950055040 tx=0x7ff95004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b39024eeaaa6b98 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.891+0000 7ff84e60c640 1 -- 172.21.15.132:0/2375323854 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff950057040 con 0x56527899e890 2024-05-08T18:52:32.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.891+0000 7ff84e60c640 1 -- 172.21.15.132:0/2375323854 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff950052890 con 0x56527899e890 2024-05-08T18:52:32.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.891+0000 7ff84e60c640 1 -- 172.21.15.132:0/2375323854 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff950052bb0 con 0x56527899e890 2024-05-08T18:52:32.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.892+0000 7ff964929800 1 -- 172.21.15.132:0/2375323854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56527899e890 msgr2=0x565278b1d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.892+0000 7ff964929800 1 --2- 172.21.15.132:0/2375323854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56527899e890 0x565278b1d760 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ff950055040 tx=0x7ff95004c000 comp rx=0 tx=0).stop 2024-05-08T18:52:32.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.892+0000 7ff964929800 1 -- 172.21.15.132:0/2375323854 shutdown_connections 2024-05-08T18:52:32.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.892+0000 7ff964929800 1 --2- 172.21.15.132:0/2375323854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56527899e890 0x565278b1d760 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.892+0000 7ff964929800 1 -- 172.21.15.132:0/2375323854 >> 172.21.15.132:0/2375323854 conn(0x565278a25840 msgr2=0x565278b19080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.892+0000 7ff964929800 1 -- 172.21.15.132:0/2375323854 shutdown_connections 2024-05-08T18:52:32.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.892+0000 7ff964929800 1 -- 172.21.15.132:0/2375323854 wait complete. 2024-05-08T18:52:32.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.892+0000 7ff964929800 1 Processor -- start 2024-05-08T18:52:32.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.892+0000 7ff964929800 1 -- start start 2024-05-08T18:52:32.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.893+0000 7ff964929800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56527899e890 0x565278b251f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.893+0000 7ff964929800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x565278a35b50 con 0x56527899e890 2024-05-08T18:52:32.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.893+0000 7ff9606e4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56527899e890 0x565278b251f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.893+0000 7ff9606e4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56527899e890 0x565278b251f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53500/0 (socket says 172.21.15.132:53500) 2024-05-08T18:52:32.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.893+0000 7ff9606e4640 1 -- 172.21.15.132:0/3763254853 learned_addr learned my addr 172.21.15.132:0/3763254853 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.893+0000 7ff9606e4640 1 -- 172.21.15.132:0/3763254853 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565278b25730 con 0x56527899e890 2024-05-08T18:52:32.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.893+0000 7ff9606e4640 1 --2- 172.21.15.132:0/3763254853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56527899e890 0x565278b251f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ff950052540 tx=0x7ff950003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.893+0000 7ff84ce09640 1 -- 172.21.15.132:0/3763254853 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff950073070 con 0x56527899e890 2024-05-08T18:52:32.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.894+0000 7ff84ce09640 1 -- 172.21.15.132:0/3763254853 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff95005d570 con 0x56527899e890 2024-05-08T18:52:32.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.894+0000 7ff964929800 1 -- 172.21.15.132:0/3763254853 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565278b259c0 con 0x56527899e890 2024-05-08T18:52:32.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.894+0000 7ff84ce09640 1 -- 172.21.15.132:0/3763254853 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff950057070 con 0x56527899e890 2024-05-08T18:52:32.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.894+0000 7ff964929800 1 -- 172.21.15.132:0/3763254853 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565278b28670 con 0x56527899e890 2024-05-08T18:52:32.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.894+0000 7ff84ce09640 1 -- 172.21.15.132:0/3763254853 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff950076070 con 0x56527899e890 2024-05-08T18:52:32.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.895+0000 7ff84ce09640 1 --2- 172.21.15.132:0/3763254853 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff84803bba0 0x7ff84803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.895+0000 7ff84ce09640 1 -- 172.21.15.132:0/3763254853 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7ff9500941e0 con 0x56527899e890 2024-05-08T18:52:32.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.895+0000 7ff957fff640 1 --2- 172.21.15.132:0/3763254853 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff84803bba0 0x7ff84803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.895+0000 7ff964929800 1 --2- 172.21.15.132:0/3763254853 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56527899fdf0 0x565278b2c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.895+0000 7ff964929800 1 -- 172.21.15.132:0/3763254853 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565278b2c970 con 0x56527899fdf0 2024-05-08T18:52:32.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.895+0000 7ff960ee5640 1 --2- 172.21.15.132:0/3763254853 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56527899fdf0 0x565278b2c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.895+0000 7ff957fff640 1 --2- 172.21.15.132:0/3763254853 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff84803bba0 0x7ff84803e060 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff948000c00 tx=0x7ff9480013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.895+0000 7ff960ee5640 1 --2- 172.21.15.132:0/3763254853 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56527899fdf0 0x565278b2c430 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.896+0000 7ff960ee5640 1 -- 172.21.15.132:0/3763254853 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff95800a4a0 con 0x56527899fdf0 2024-05-08T18:52:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.896+0000 7ff964929800 1 -- 172.21.15.132:0/3763254853 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565278b299e0 con 0x56527899fdf0 2024-05-08T18:52:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.896+0000 7ff960ee5640 1 -- 172.21.15.132:0/3763254853 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff95800a4a0 con 0x56527899fdf0 2024-05-08T18:52:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.896+0000 7ff964929800 1 --2- 172.21.15.132:0/3763254853 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x565278b2ec40 0x565278b31030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.896+0000 7ff964929800 1 -- 172.21.15.132:0/3763254853 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565278b31700 con 0x565278b2ec40 2024-05-08T18:52:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.896+0000 7ff9606e4640 1 --2- 172.21.15.132:0/3763254853 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x565278b2ec40 0x565278b31030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.896+0000 7ff9606e4640 1 --2- 172.21.15.132:0/3763254853 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x565278b2ec40 0x565278b31030 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.896+0000 7ff9606e4640 1 -- 172.21.15.132:0/3763254853 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff950075030 con 0x565278b2ec40 2024-05-08T18:52:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.897+0000 7ff964929800 1 -- 172.21.15.132:0/3763254853 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565278b2dae0 con 0x56527899fdf0 2024-05-08T18:52:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.897+0000 7ff960ee5640 1 -- 172.21.15.132:0/3763254853 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff95800a4a0 con 0x56527899fdf0 2024-05-08T18:52:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.897+0000 7ff964929800 1 -- 172.21.15.132:0/3763254853 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565278b2df80 con 0x56527899fdf0 2024-05-08T18:52:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.897+0000 7ff960ee5640 1 -- 172.21.15.132:0/3763254853 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff95800a4a0 con 0x56527899fdf0 2024-05-08T18:52:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.897+0000 7ff964929800 1 Processor -- start 2024-05-08T18:52:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.897+0000 7ff964929800 1 -- start start 2024-05-08T18:52:32.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.898+0000 7ff964929800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565278b40660 0x565278b40a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.898+0000 7ff964929800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56527891bfc0 con 0x565278b40660 2024-05-08T18:52:32.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.898+0000 7ff960ee5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565278b40660 0x565278b40a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.898+0000 7ff960ee5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565278b40660 0x565278b40a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53514/0 (socket says 172.21.15.132:53514) 2024-05-08T18:52:32.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.898+0000 7ff960ee5640 1 -- 172.21.15.132:0/3609203015 learned_addr learned my addr 172.21.15.132:0/3609203015 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.898+0000 7ff960ee5640 1 -- 172.21.15.132:0/3609203015 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565278b40fc0 con 0x565278b40660 2024-05-08T18:52:32.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.898+0000 7ff960ee5640 1 --2- 172.21.15.132:0/3609203015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565278b40660 0x565278b40a80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x565278b2cd10 tx=0x7ff958018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.898+0000 7ff845ffb640 1 -- 172.21.15.132:0/3609203015 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff958014450 con 0x565278b40660 2024-05-08T18:52:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.898+0000 7ff845ffb640 1 -- 172.21.15.132:0/3609203015 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9580145f0 con 0x565278b40660 2024-05-08T18:52:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.898+0000 7ff845ffb640 1 -- 172.21.15.132:0/3609203015 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff958014910 con 0x565278b40660 2024-05-08T18:52:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.898+0000 7ff964929800 1 -- 172.21.15.132:0/3609203015 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565278b41a30 con 0x565278b40660 2024-05-08T18:52:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.899+0000 7ff964929800 1 -- 172.21.15.132:0/3609203015 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565278b41f30 con 0x565278b40660 2024-05-08T18:52:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.899+0000 7ff845ffb640 1 -- 172.21.15.132:0/3609203015 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff958011040 con 0x565278b40660 2024-05-08T18:52:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.900+0000 7ff845ffb640 1 --2- 172.21.15.132:0/3609203015 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff83803bb50 0x7ff83803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.900+0000 7ff845ffb640 1 -- 172.21.15.132:0/3609203015 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7ff95801e070 con 0x565278b40660 2024-05-08T18:52:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.900+0000 7ff9606e4640 1 --2- 172.21.15.132:0/3609203015 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff83803bb50 0x7ff83803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.900+0000 7ff964929800 1 Processor -- start 2024-05-08T18:52:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.900+0000 7ff9606e4640 1 --2- 172.21.15.132:0/3609203015 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff83803bb50 0x7ff83803e010 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x565278b2cdb0 tx=0x7ff950066ad0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.900+0000 7ff964929800 1 -- start start 2024-05-08T18:52:32.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.900+0000 7ff964929800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565278b4d960 0x565278b4dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.900+0000 7ff964929800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x565278b1dff0 con 0x565278b4d960 2024-05-08T18:52:32.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.900+0000 7ff960ee5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565278b4d960 0x565278b4dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.900+0000 7ff960ee5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565278b4d960 0x565278b4dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53530/0 (socket says 172.21.15.132:53530) 2024-05-08T18:52:32.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.900+0000 7ff960ee5640 1 -- 172.21.15.132:0/1223450192 learned_addr learned my addr 172.21.15.132:0/1223450192 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.901+0000 7ff960ee5640 1 -- 172.21.15.132:0/1223450192 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565278b4e350 con 0x565278b4d960 2024-05-08T18:52:32.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.901+0000 7ff960ee5640 1 --2- 172.21.15.132:0/1223450192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565278b4d960 0x565278b4dd80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7ff958052d00 tx=0x7ff958014f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37c768012a0864c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.901+0000 7ff8377fe640 1 -- 172.21.15.132:0/1223450192 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff958016440 con 0x565278b4d960 2024-05-08T18:52:32.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.901+0000 7ff8377fe640 1 -- 172.21.15.132:0/1223450192 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff958011330 con 0x565278b4d960 2024-05-08T18:52:32.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.901+0000 7ff8377fe640 1 -- 172.21.15.132:0/1223450192 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9580165e0 con 0x565278b4d960 2024-05-08T18:52:32.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.901+0000 7ff964929800 1 -- 172.21.15.132:0/1223450192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565278b4d960 msgr2=0x565278b4dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.901+0000 7ff964929800 1 --2- 172.21.15.132:0/1223450192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565278b4d960 0x565278b4dd80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7ff958052d00 tx=0x7ff958014f10 comp rx=0 tx=0).stop 2024-05-08T18:52:32.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.902+0000 7ff964929800 1 -- 172.21.15.132:0/1223450192 shutdown_connections 2024-05-08T18:52:32.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.902+0000 7ff964929800 1 --2- 172.21.15.132:0/1223450192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565278b4d960 0x565278b4dd80 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.902+0000 7ff964929800 1 -- 172.21.15.132:0/1223450192 >> 172.21.15.132:0/1223450192 conn(0x565278b49cc0 msgr2=0x565278b47d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.902+0000 7ff964929800 1 -- 172.21.15.132:0/1223450192 shutdown_connections 2024-05-08T18:52:32.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.902+0000 7ff964929800 1 -- 172.21.15.132:0/1223450192 wait complete. 2024-05-08T18:52:32.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.902+0000 7ff964929800 1 Processor -- start 2024-05-08T18:52:32.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.902+0000 7ff964929800 1 -- start start 2024-05-08T18:52:32.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.902+0000 7ff964929800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565278b4d960 0x565278b54f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.902+0000 7ff964929800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x565278b4eac0 con 0x565278b4d960 2024-05-08T18:52:32.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.902+0000 7ff960ee5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565278b4d960 0x565278b54f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.902+0000 7ff960ee5640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565278b4d960 0x565278b54f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53532/0 (socket says 172.21.15.132:53532) 2024-05-08T18:52:32.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.902+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 learned_addr learned my addr 172.21.15.132:0/1536067922 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:32.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.903+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565278b55470 con 0x565278b4d960 2024-05-08T18:52:32.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.903+0000 7ff960ee5640 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565278b4d960 0x565278b54f30 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff958022c20 tx=0x7ff958052c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.903+0000 7ff835ffb640 1 -- 172.21.15.132:0/1536067922 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9580545d0 con 0x565278b4d960 2024-05-08T18:52:32.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.903+0000 7ff835ffb640 1 -- 172.21.15.132:0/1536067922 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff958001770 con 0x565278b4d960 2024-05-08T18:52:32.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.903+0000 7ff835ffb640 1 -- 172.21.15.132:0/1536067922 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff958001a70 con 0x565278b4d960 2024-05-08T18:52:32.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.903+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565278b55700 con 0x565278b4d960 2024-05-08T18:52:32.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.903+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565278b583b0 con 0x565278b4d960 2024-05-08T18:52:32.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.904+0000 7ff835ffb640 1 -- 172.21.15.132:0/1536067922 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ff958001c10 con 0x565278b4d960 2024-05-08T18:52:32.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.904+0000 7ff835ffb640 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff82803bb50 0x7ff82803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.904+0000 7ff835ffb640 1 -- 172.21.15.132:0/1536067922 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7ff958033030 con 0x565278b4d960 2024-05-08T18:52:32.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.904+0000 7ff9606e4640 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff82803bb50 0x7ff82803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.904+0000 7ff9606e4640 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff82803bb50 0x7ff82803e010 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff950006ba0 tx=0x7ff95008b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.905+0000 7ff964929800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.905+0000 7ff964929800 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x565278b60a10 0x565278b62ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.905+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565278b63620 con 0x565278b60a10 2024-05-08T18:52:32.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.905+0000 7ff957fff640 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x565278b60a10 0x565278b62ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.905+0000 7ff957fff640 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x565278b60a10 0x565278b62ed0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.905+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff94800f5f0 con 0x565278b60a10 2024-05-08T18:52:32.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.905+0000 7ff964929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.905+0000 7ff964929800 20 realm 2024-05-08T18:52:32.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.905+0000 7ff964929800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.905+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565278b5fe60 con 0x565278b60a10 2024-05-08T18:52:32.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.905+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff94800f5f0 con 0x565278b60a10 2024-05-08T18:52:32.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.905+0000 7ff964929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.905+0000 7ff964929800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:52:32.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.905+0000 7ff964929800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.905+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565278b64110 con 0x565278b60a10 2024-05-08T18:52:32.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.906+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff94800f5f0 con 0x565278b60a10 2024-05-08T18:52:32.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.906+0000 7ff964929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.906+0000 7ff964929800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.906+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565278b649e0 con 0x565278b60a10 2024-05-08T18:52:32.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.906+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff94800f5f0 con 0x565278b60a10 2024-05-08T18:52:32.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.906+0000 7ff964929800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:32.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.906+0000 7ff964929800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.906+0000 7ff964929800 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x565278b65400 0x565278b677f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.906+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565278b67f60 con 0x565278b65400 2024-05-08T18:52:32.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.906+0000 7ff960ee5640 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x565278b65400 0x565278b677f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.906+0000 7ff960ee5640 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x565278b65400 0x565278b677f0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.906+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff95802a070 con 0x565278b65400 2024-05-08T18:52:32.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.906+0000 7ff964929800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:52:32.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.906+0000 7ff964929800 20 searching for the correct realm 2024-05-08T18:52:32.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.906+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x565278b65400 2024-05-08T18:52:32.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.907+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff95802a070 con 0x565278b65400 2024-05-08T18:52:32.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.907+0000 7ff960ee5640 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7ff958014070 0x7ff95802f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.907+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x7ff958014070 2024-05-08T18:52:32.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.907+0000 7ff9606e4640 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7ff958014070 0x7ff95802f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.907+0000 7ff9606e4640 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7ff958014070 0x7ff95802f990 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.908+0000 7ff9606e4640 1 -- 172.21.15.132:0/1536067922 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff950075030 con 0x7ff958014070 2024-05-08T18:52:32.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.908+0000 7ff9606e4640 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7ff950090040 0x7ff95005b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:32.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.908+0000 7ff9606e4640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x7ff950090040 2024-05-08T18:52:32.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.908+0000 7ff957fff640 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7ff950090040 0x7ff95005b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:32.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.908+0000 7ff957fff640 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7ff950090040 0x7ff95005b7a0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:32.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.909+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff94800f5f0 con 0x7ff950090040 2024-05-08T18:52:32.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.909+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x565278b60a10 2024-05-08T18:52:32.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.909+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff94800f5f0 con 0x565278b60a10 2024-05-08T18:52:32.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.909+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x565278b60a10 2024-05-08T18:52:32.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.909+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff94802b040 con 0x565278b60a10 2024-05-08T18:52:32.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.909+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x7ff950090040 2024-05-08T18:52:32.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.910+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff94802b040 con 0x7ff950090040 2024-05-08T18:52:32.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.910+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x7ff950090040 2024-05-08T18:52:32.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.910+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff94802b040 con 0x7ff950090040 2024-05-08T18:52:32.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.910+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x7ff958014070 2024-05-08T18:52:32.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.910+0000 7ff9606e4640 1 -- 172.21.15.132:0/1536067922 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff950075030 con 0x7ff958014070 2024-05-08T18:52:32.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.910+0000 7ff9606e4640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x565278b65400 2024-05-08T18:52:32.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.910+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff95802a070 con 0x565278b65400 2024-05-08T18:52:32.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.910+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x565278b60a10 2024-05-08T18:52:32.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.911+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff94802b040 con 0x565278b60a10 2024-05-08T18:52:32.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.911+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x7ff950090040 2024-05-08T18:52:32.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.911+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff94802b040 con 0x7ff950090040 2024-05-08T18:52:32.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.911+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x565278b60a10 2024-05-08T18:52:32.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.911+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff94802b040 con 0x565278b60a10 2024-05-08T18:52:32.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.911+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x7ff958014070 2024-05-08T18:52:32.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.911+0000 7ff9606e4640 1 -- 172.21.15.132:0/1536067922 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff950075030 con 0x7ff958014070 2024-05-08T18:52:32.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.911+0000 7ff9606e4640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x565278b65400 2024-05-08T18:52:32.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.912+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v27'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff95802a070 con 0x565278b65400 2024-05-08T18:52:32.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.912+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x565278b65400 2024-05-08T18:52:32.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.912+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff95802a070 con 0x565278b65400 2024-05-08T18:52:32.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.912+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x7ff950090040 2024-05-08T18:52:32.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.912+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff94802b040 con 0x7ff950090040 2024-05-08T18:52:32.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.912+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x565278b65400 2024-05-08T18:52:32.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.912+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff95802a070 con 0x565278b65400 2024-05-08T18:52:32.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.912+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x565278b65400 2024-05-08T18:52:32.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.913+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff95802a070 con 0x565278b65400 2024-05-08T18:52:32.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.913+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x565278b60a10 2024-05-08T18:52:32.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.913+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff94802b040 con 0x565278b60a10 2024-05-08T18:52:32.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.913+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x565278b60a10 2024-05-08T18:52:32.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.913+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v27'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff94802b040 con 0x565278b60a10 2024-05-08T18:52:32.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.913+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x7ff950090040 2024-05-08T18:52:32.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.913+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff94802b040 con 0x7ff950090040 2024-05-08T18:52:32.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.913+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x565278b65400 2024-05-08T18:52:32.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.914+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff95802a070 con 0x565278b65400 2024-05-08T18:52:32.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.914+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x7ff958014070 2024-05-08T18:52:32.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.914+0000 7ff9606e4640 1 -- 172.21.15.132:0/1536067922 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff950075030 con 0x7ff958014070 2024-05-08T18:52:32.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.914+0000 7ff9606e4640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x565278b60a10 2024-05-08T18:52:32.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.914+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff94802b040 con 0x565278b60a10 2024-05-08T18:52:32.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.914+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x7ff958014070 2024-05-08T18:52:32.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.914+0000 7ff9606e4640 1 -- 172.21.15.132:0/1536067922 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff950075030 con 0x7ff958014070 2024-05-08T18:52:32.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.914+0000 7ff9606e4640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x565278b65400 2024-05-08T18:52:32.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.915+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff95802a070 con 0x565278b65400 2024-05-08T18:52:32.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.915+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x7ff950090040 2024-05-08T18:52:32.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.915+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff94802b040 con 0x7ff950090040 2024-05-08T18:52:32.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.915+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x7ff958014070 2024-05-08T18:52:32.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.915+0000 7ff9606e4640 1 -- 172.21.15.132:0/1536067922 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff950075030 con 0x7ff958014070 2024-05-08T18:52:32.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.915+0000 7ff9606e4640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x565278b65400 2024-05-08T18:52:32.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.915+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff95802a070 con 0x565278b65400 2024-05-08T18:52:32.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.915+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x7ff950090040 2024-05-08T18:52:32.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.916+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff94802b040 con 0x7ff950090040 2024-05-08T18:52:32.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.916+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x565278b60a10 2024-05-08T18:52:32.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.916+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v27'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff94802b040 con 0x565278b60a10 2024-05-08T18:52:32.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.916+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565278b69890 con 0x7ff958014070 2024-05-08T18:52:32.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.916+0000 7ff9606e4640 1 -- 172.21.15.132:0/1536067922 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff950075030 con 0x7ff958014070 2024-05-08T18:52:32.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.916+0000 7ff964929800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:52:32.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.916+0000 7ff964929800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:52:32.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.916+0000 7ff964929800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:52:32.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.916+0000 7ff964929800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:52:32.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.916+0000 7ff964929800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:52:32.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.916+0000 7ff964929800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:52:32.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.916+0000 7ff964929800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.916+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565278b68920 con 0x565278b60a10 2024-05-08T18:52:32.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.917+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff94802b040 con 0x565278b60a10 2024-05-08T18:52:32.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.917+0000 7ff964929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.917+0000 7ff964929800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.917+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565278b691c0 con 0x565278b60a10 2024-05-08T18:52:32.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.917+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff94802b040 con 0x565278b60a10 2024-05-08T18:52:32.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.917+0000 7ff964929800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:32.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.917+0000 7ff964929800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.917+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565278b69d10 con 0x565278b60a10 2024-05-08T18:52:32.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.917+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff94802b040 con 0x565278b60a10 2024-05-08T18:52:32.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.917+0000 7ff964929800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:52:32.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.917+0000 7ff964929800 20 zone default found 2024-05-08T18:52:32.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.917+0000 7ff964929800 4 Realm: () 2024-05-08T18:52:32.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.917+0000 7ff964929800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:52:32.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.917+0000 7ff964929800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:52:32.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.917+0000 7ff964929800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:52:32.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.917+0000 7ff964929800 20 zonegroup default 2024-05-08T18:52:32.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.917+0000 7ff964929800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.917+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565278b6a0d0 con 0x7ff958014070 2024-05-08T18:52:32.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.917+0000 7ff9606e4640 1 -- 172.21.15.132:0/1536067922 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff950075030 con 0x7ff958014070 2024-05-08T18:52:32.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.917+0000 7ff964929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.917+0000 7ff964929800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.917+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565278b6c3a0 con 0x565278b65400 2024-05-08T18:52:32.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.918+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff95802a070 con 0x565278b65400 2024-05-08T18:52:32.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.918+0000 7ff964929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.918+0000 7ff964929800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.918+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565278b6c740 con 0x565278b65400 2024-05-08T18:52:32.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.918+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff95802a070 con 0x565278b65400 2024-05-08T18:52:32.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.918+0000 7ff964929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:32.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.918+0000 7ff964929800 20 started sync module instance, tier type = 2024-05-08T18:52:32.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.918+0000 7ff964929800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:52:32.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.918+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b6b7e0 con 0x7ff958014070 2024-05-08T18:52:32.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.919+0000 7ff9606e4640 1 -- 172.21.15.132:0/1536067922 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff950075030 con 0x7ff958014070 2024-05-08T18:52:32.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.919+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94912212548560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b6bff0 con 0x7ff958014070 2024-05-08T18:52:32.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.919+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b6d100 con 0x565278b60a10 2024-05-08T18:52:32.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.920+0000 7ff9606e4640 1 -- 172.21.15.132:0/1536067922 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94912212548560] v27'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff950075030 con 0x7ff958014070 2024-05-08T18:52:32.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.920+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff94802b040 con 0x565278b60a10 2024-05-08T18:52:32.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.920+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94912212551488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b6d4f0 con 0x565278b60a10 2024-05-08T18:52:32.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.920+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b6df30 con 0x565278b65400 2024-05-08T18:52:32.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.921+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff95802a070 con 0x565278b65400 2024-05-08T18:52:32.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.921+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94912212556288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b6def0 con 0x565278b65400 2024-05-08T18:52:32.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.921+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b6ef00 con 0x7ff958014070 2024-05-08T18:52:32.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.921+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94912212551488] v27'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff94802b040 con 0x565278b60a10 2024-05-08T18:52:32.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.922+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94912212556288] v27'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff95802a070 con 0x565278b65400 2024-05-08T18:52:32.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.923+0000 7ff9606e4640 1 -- 172.21.15.132:0/1536067922 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff950075030 con 0x7ff958014070 2024-05-08T18:52:32.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.923+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94912212558624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b6e9c0 con 0x7ff958014070 2024-05-08T18:52:32.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.923+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b6f910 con 0x565278b60a10 2024-05-08T18:52:32.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.924+0000 7ff9606e4640 1 -- 172.21.15.132:0/1536067922 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94912212558624] v27'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff950075030 con 0x7ff958014070 2024-05-08T18:52:32.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.924+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff94802b040 con 0x565278b60a10 2024-05-08T18:52:32.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.924+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94912212552544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b6f910 con 0x565278b60a10 2024-05-08T18:52:32.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.924+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b702d0 con 0x7ff950090040 2024-05-08T18:52:32.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.925+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff94802b040 con 0x7ff950090040 2024-05-08T18:52:32.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.925+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94912212552544] v27'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff94802b040 con 0x565278b60a10 2024-05-08T18:52:32.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.925+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94912212565536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b706f0 con 0x7ff950090040 2024-05-08T18:52:32.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.925+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b6f4a0 con 0x7ff950090040 2024-05-08T18:52:32.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.926+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94912212565536] v27'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff94802b040 con 0x7ff950090040 2024-05-08T18:52:32.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.926+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff94802b040 con 0x7ff950090040 2024-05-08T18:52:32.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.926+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94912212566592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b70660 con 0x7ff950090040 2024-05-08T18:52:32.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.926+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b716c0 con 0x7ff950090040 2024-05-08T18:52:32.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.927+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(58 notify.7 [create] v27'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff94802b040 con 0x7ff950090040 2024-05-08T18:52:32.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.927+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94912212566592] v27'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff94802b040 con 0x7ff950090040 2024-05-08T18:52:32.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.927+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94912212570512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b71680 con 0x7ff950090040 2024-05-08T18:52:32.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.927+0000 7ff964929800 20 add_watcher() i=0 2024-05-08T18:52:32.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.927+0000 7ff964929800 20 add_watcher() i=1 2024-05-08T18:52:32.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.927+0000 7ff964929800 20 add_watcher() i=2 2024-05-08T18:52:32.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.927+0000 7ff964929800 20 add_watcher() i=3 2024-05-08T18:52:32.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.927+0000 7ff964929800 20 add_watcher() i=4 2024-05-08T18:52:32.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.927+0000 7ff964929800 20 add_watcher() i=5 2024-05-08T18:52:32.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.927+0000 7ff964929800 20 add_watcher() i=6 2024-05-08T18:52:32.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.928+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94912212570512] v27'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff94802b040 con 0x7ff950090040 2024-05-08T18:52:32.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.928+0000 7ff964929800 20 add_watcher() i=7 2024-05-08T18:52:32.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.928+0000 7ff964929800 2 all 8 watchers are set, enabling cache 2024-05-08T18:52:32.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.928+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565278b74ae0 con 0x565278b60a10 2024-05-08T18:52:32.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.929+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff94802b040 con 0x565278b60a10 2024-05-08T18:52:32.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.929+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94912212569312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b72000 con 0x565278b60a10 2024-05-08T18:52:32.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.930+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94912212569312] v27'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff94802b040 con 0x565278b60a10 2024-05-08T18:52:32.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.930+0000 7ff816fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:32.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.930+0000 7ff964929800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:32.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.930+0000 7ff964929800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:32.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.930+0000 7ff964929800 5 note: GC not initialized 2024-05-08T18:52:32.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.930+0000 7ff815fdb640 20 reqs_thread_entry: start 2024-05-08T18:52:32.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.930+0000 7ff964929800 20 init_complete bucket index max shards: 11 2024-05-08T18:52:32.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.930+0000 7ff964929800 20 Filter name: none 2024-05-08T18:52:32.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.930+0000 7ff7877fe640 20 reqs_thread_entry: start 2024-05-08T18:52:32.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.930+0000 7ff964929800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:52:32.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.930+0000 7ff964929800 20 rados->read ofs=0 len=0 2024-05-08T18:52:32.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.931+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565278ba8040 con 0x7ff950090040 2024-05-08T18:52:32.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.931+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7ff94802b040 con 0x7ff950090040 2024-05-08T18:52:32.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.931+0000 7ff964929800 20 rados_obj.operate() r=0 bl.length=460 2024-05-08T18:52:32.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.931+0000 7ff964929800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:52:32.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.931+0000 7ff964929800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:32.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.931+0000 7ff964929800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:52:32.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.931+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278bae5d0 con 0x7ff950090040 2024-05-08T18:52:32.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.932+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v27'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff94802b040 con 0x7ff950090040 2024-05-08T18:52:32.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.932+0000 7ff964929800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:52:32.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.932+0000 7ff964929800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:32.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.932+0000 7ff964929800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:52:32.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.932+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94912212819856 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565278ba9bb0 con 0x565278b60a10 2024-05-08T18:52:32.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.933+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== watch-notify(notify (1) cookie 94912212552544 notify 115964117016 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7ff948018040 con 0x565278b60a10 2024-05-08T18:52:32.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.933+0000 7ff8377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117016 cookie 94912212552544 notifier 4865 bl.length()=666 2024-05-08T18:52:32.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.933+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 notify.4 [notify cookie 94912212819856 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff94802b040 con 0x565278b60a10 2024-05-08T18:52:32.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.933+0000 7ff8377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:52:32.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.933+0000 7ff8377fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:32.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.933+0000 7ff8377fe640 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7ff82c003ea0 con 0x565278b60a10 2024-05-08T18:52:32.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.933+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== watch-notify(notify_complete (2) cookie 94912212819856 notify 115964117016 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff94802fc60 con 0x565278b60a10 2024-05-08T18:52:32.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.933+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff94802b040 con 0x565278b60a10 2024-05-08T18:52:32.942 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:52:31.994053Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:52:31.994040Z","tags":[],"group_ids":[]} 2024-05-08T18:52:32.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.934+0000 7ff816fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:32.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.934+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94912212569312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b74230 con 0x565278b60a10 2024-05-08T18:52:32.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.935+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94912212569312] v27'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff94802b040 con 0x565278b60a10 2024-05-08T18:52:32.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.935+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94912212548560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278ba9ed0 con 0x7ff958014070 2024-05-08T18:52:32.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.936+0000 7ff9606e4640 1 -- 172.21.15.132:0/1536067922 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94912212548560] v27'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff950075030 con 0x7ff958014070 2024-05-08T18:52:32.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.936+0000 7ff964929800 20 remove_watcher() i=0 2024-05-08T18:52:32.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.936+0000 7ff964929800 2 removed watcher, disabling cache 2024-05-08T18:52:32.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.936+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94912212551488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b6bbd0 con 0x565278b60a10 2024-05-08T18:52:32.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.937+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94912212551488] v27'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff94802b040 con 0x565278b60a10 2024-05-08T18:52:32.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.937+0000 7ff964929800 20 remove_watcher() i=1 2024-05-08T18:52:32.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.937+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94912212556288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b6bbd0 con 0x565278b65400 2024-05-08T18:52:32.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.938+0000 7ff960ee5640 1 -- 172.21.15.132:0/1536067922 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94912212556288] v27'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff95802a070 con 0x565278b65400 2024-05-08T18:52:32.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.939+0000 7ff964929800 20 remove_watcher() i=2 2024-05-08T18:52:32.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.939+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94912212558624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b6bbd0 con 0x7ff958014070 2024-05-08T18:52:32.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.939+0000 7ff9606e4640 1 -- 172.21.15.132:0/1536067922 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94912212558624] v27'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff950075030 con 0x7ff958014070 2024-05-08T18:52:32.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.939+0000 7ff964929800 20 remove_watcher() i=3 2024-05-08T18:52:32.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.940+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94912212552544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b6e320 con 0x565278b60a10 2024-05-08T18:52:32.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.941+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94912212552544] v27'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff94802b040 con 0x565278b60a10 2024-05-08T18:52:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.941+0000 7ff964929800 20 remove_watcher() i=4 2024-05-08T18:52:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.941+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94912212565536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b6bbd0 con 0x7ff950090040 2024-05-08T18:52:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.942+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94912212565536] v27'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff94802b040 con 0x7ff950090040 2024-05-08T18:52:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.942+0000 7ff964929800 20 remove_watcher() i=5 2024-05-08T18:52:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.942+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94912212566592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b6bbd0 con 0x7ff950090040 2024-05-08T18:52:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.943+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94912212566592] v27'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff94802b040 con 0x7ff950090040 2024-05-08T18:52:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.943+0000 7ff964929800 20 remove_watcher() i=6 2024-05-08T18:52:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.943+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94912212570512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565278b6bbd0 con 0x7ff950090040 2024-05-08T18:52:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.944+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94912212570512] v27'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff94802b040 con 0x7ff950090040 2024-05-08T18:52:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.944+0000 7ff964929800 20 remove_watcher() i=7 2024-05-08T18:52:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.944+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7ff950090040 msgr2=0x7ff95005b7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.944+0000 7ff964929800 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7ff950090040 0x7ff95005b7a0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.944+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x565278b60a10 msgr2=0x565278b62ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.944+0000 7ff964929800 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x565278b60a10 0x565278b62ed0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.944+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7ff958014070 msgr2=0x7ff95802f990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.944+0000 7ff964929800 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7ff958014070 0x7ff95802f990 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.944+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x565278b65400 msgr2=0x565278b677f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.944+0000 7ff964929800 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x565278b65400 0x565278b677f0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.944+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff82803bb50 msgr2=0x7ff82803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.944+0000 7ff964929800 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff82803bb50 0x7ff82803e010 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff950006ba0 tx=0x7ff95008b000 comp rx=0 tx=0).stop 2024-05-08T18:52:32.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.944+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565278b4d960 msgr2=0x565278b54f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.944+0000 7ff957fff640 1 -- 172.21.15.132:0/1536067922 reap_dead start 2024-05-08T18:52:32.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.944+0000 7ff964929800 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565278b4d960 0x565278b54f30 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff958022c20 tx=0x7ff958052c60 comp rx=0 tx=0).stop 2024-05-08T18:52:32.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 shutdown_connections 2024-05-08T18:52:32.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 --2- 172.21.15.132:0/1536067922 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565278b4d960 0x565278b54f30 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 >> 172.21.15.132:0/1536067922 conn(0x565278b49cc0 msgr2=0x565278b47320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 shutdown_connections 2024-05-08T18:52:32.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 -- 172.21.15.132:0/1536067922 wait complete. 2024-05-08T18:52:32.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 -- 172.21.15.132:0/3609203015 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff83803bb50 msgr2=0x7ff83803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 --2- 172.21.15.132:0/3609203015 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff83803bb50 0x7ff83803e010 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x565278b2cdb0 tx=0x7ff950066ad0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 -- 172.21.15.132:0/3609203015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565278b40660 msgr2=0x565278b40a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 --2- 172.21.15.132:0/3609203015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565278b40660 0x565278b40a80 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x565278b2cd10 tx=0x7ff958018830 comp rx=0 tx=0).stop 2024-05-08T18:52:32.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 -- 172.21.15.132:0/3609203015 shutdown_connections 2024-05-08T18:52:32.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 --2- 172.21.15.132:0/3609203015 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff83803bb50 0x7ff83803e010 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 --2- 172.21.15.132:0/3609203015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565278b40660 0x565278b40a80 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 -- 172.21.15.132:0/3609203015 >> 172.21.15.132:0/3609203015 conn(0x565278b34700 msgr2=0x565278b34b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 -- 172.21.15.132:0/3609203015 shutdown_connections 2024-05-08T18:52:32.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 -- 172.21.15.132:0/3609203015 wait complete. 2024-05-08T18:52:32.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 -- 172.21.15.132:0/3763254853 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56527899fdf0 msgr2=0x565278b2c430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 --2- 172.21.15.132:0/3763254853 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56527899fdf0 0x565278b2c430 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 -- 172.21.15.132:0/3763254853 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x565278b2ec40 msgr2=0x565278b31030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 --2- 172.21.15.132:0/3763254853 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x565278b2ec40 0x565278b31030 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 -- 172.21.15.132:0/3763254853 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff84803bba0 msgr2=0x7ff84803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 --2- 172.21.15.132:0/3763254853 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff84803bba0 0x7ff84803e060 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff948000c00 tx=0x7ff9480013b0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 -- 172.21.15.132:0/3763254853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56527899e890 msgr2=0x565278b251f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.945+0000 7ff964929800 1 --2- 172.21.15.132:0/3763254853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56527899e890 0x565278b251f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ff950052540 tx=0x7ff950003020 comp rx=0 tx=0).stop 2024-05-08T18:52:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.946+0000 7ff964929800 1 -- 172.21.15.132:0/3763254853 shutdown_connections 2024-05-08T18:52:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.946+0000 7ff964929800 1 --2- 172.21.15.132:0/3763254853 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x565278b2ec40 0x565278b31030 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.946+0000 7ff964929800 1 --2- 172.21.15.132:0/3763254853 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56527899fdf0 0x565278b2c430 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.946+0000 7ff964929800 1 --2- 172.21.15.132:0/3763254853 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff84803bba0 0x7ff84803e060 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.946+0000 7ff964929800 1 --2- 172.21.15.132:0/3763254853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56527899e890 0x565278b251f0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.946+0000 7ff964929800 1 -- 172.21.15.132:0/3763254853 >> 172.21.15.132:0/3763254853 conn(0x565278a25840 msgr2=0x565278b17880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.946+0000 7ff964929800 1 -- 172.21.15.132:0/3763254853 shutdown_connections 2024-05-08T18:52:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:32.946+0000 7ff964929800 1 -- 172.21.15.132:0/3763254853 wait complete. 2024-05-08T18:52:32.954 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:52:31.994053Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:31.994040Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:32.954 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:52:31.994053Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:31.994040Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:32.954 ERROR:root:0 2024-05-08T18:52:32.954 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:52:32.958 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:52:32.958 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-05-08T18:52:32.959 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-05-08T18:52:32.959 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-05-08T18:52:33.005 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:33.006 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.007+0000 7fdcf7f2b800 1 Processor -- start 2024-05-08T18:52:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.007+0000 7fdcf7f2b800 1 -- start start 2024-05-08T18:52:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.007+0000 7fdcf7f2b800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5653076355e0 0x5653076379d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.007+0000 7fdcf7f2b800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565307637fa0 con 0x565307631150 2024-05-08T18:52:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.007+0000 7fdcf7f2b800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x5653074d2e20 con 0x5653076355e0 2024-05-08T18:52:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.008+0000 7fdcf334a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5653076355e0 0x5653076379d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.008+0000 7fdcf3b4b640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x565307631150 0x565307631570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48180/0 (socket says 172.21.15.132:48180) 2024-05-08T18:52:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.008+0000 7fdcf334a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5653076355e0 0x5653076379d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53546/0 (socket says 172.21.15.132:53546) 2024-05-08T18:52:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.008+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/1525302789 learned_addr learned my addr 172.21.15.132:0/1525302789 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:52:33.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.008+0000 7fdcf334a640 1 -- 172.21.15.132:0/1525302789 >> v1:172.21.15.42:6789/0 conn(0x565307631150 legacy=0x565307631570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.008+0000 7fdcf2b49640 1 -- 172.21.15.132:0/1525302789 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2722356086 0 0) 0x565307637fa0 con 0x565307631150 2024-05-08T18:52:33.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.008+0000 7fdcf334a640 1 -- 172.21.15.132:0/1525302789 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653076391d0 con 0x5653076355e0 2024-05-08T18:52:33.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.010+0000 7fdcf334a640 1 --2- 172.21.15.132:0/1525302789 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5653076355e0 0x5653076379d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00a470 tx=0x7fdcdc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2e0440bd7cf7e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.010+0000 7fdcf2b49640 1 -- 172.21.15.132:0/1525302789 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcdc057070 con 0x5653076355e0 2024-05-08T18:52:33.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.010+0000 7fdcf2b49640 1 -- 172.21.15.132:0/1525302789 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcdc052570 con 0x5653076355e0 2024-05-08T18:52:33.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.010+0000 7fdcf2b49640 1 -- 172.21.15.132:0/1525302789 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcdc052870 con 0x5653076355e0 2024-05-08T18:52:33.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.010+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/1525302789 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5653076355e0 msgr2=0x5653076379d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.010+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/1525302789 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5653076355e0 0x5653076379d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00a470 tx=0x7fdcdc01ce90 comp rx=0 tx=0).stop 2024-05-08T18:52:33.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.011+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/1525302789 shutdown_connections 2024-05-08T18:52:33.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.011+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/1525302789 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5653076355e0 0x5653076379d0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.011+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/1525302789 >> 172.21.15.132:0/1525302789 conn(0x56530762c730 msgr2=0x56530762eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.011+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/1525302789 shutdown_connections 2024-05-08T18:52:33.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.011+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/1525302789 wait complete. 2024-05-08T18:52:33.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.024+0000 7fdcf7f2b800 1 Processor -- start 2024-05-08T18:52:33.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.025+0000 7fdcf7f2b800 1 -- start start 2024-05-08T18:52:33.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.025+0000 7fdcf7f2b800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307631150 0x56530763cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.025+0000 7fdcf7f2b800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56530757d5c0 con 0x565307631150 2024-05-08T18:52:33.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.025+0000 7fdcf3b4b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307631150 0x56530763cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.025+0000 7fdcf3b4b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307631150 0x56530763cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53560/0 (socket says 172.21.15.132:53560) 2024-05-08T18:52:33.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.025+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/541525037 learned_addr learned my addr 172.21.15.132:0/541525037 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.025+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/541525037 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56530763b580 con 0x565307631150 2024-05-08T18:52:33.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.026+0000 7fdcf3b4b640 1 --2- 172.21.15.132:0/541525037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307631150 0x56530763cfc0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fdce400b240 tx=0x7fdce400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77682e02d3aa9898 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.026+0000 7fdbe1e0b640 1 -- 172.21.15.132:0/541525037 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdce4008070 con 0x565307631150 2024-05-08T18:52:33.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.026+0000 7fdbe1e0b640 1 -- 172.21.15.132:0/541525037 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdce400d500 con 0x565307631150 2024-05-08T18:52:33.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.026+0000 7fdbe1e0b640 1 -- 172.21.15.132:0/541525037 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdce400d860 con 0x565307631150 2024-05-08T18:52:33.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.027+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/541525037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307631150 msgr2=0x56530763cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.027+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/541525037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307631150 0x56530763cfc0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fdce400b240 tx=0x7fdce400b700 comp rx=0 tx=0).stop 2024-05-08T18:52:33.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.027+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/541525037 shutdown_connections 2024-05-08T18:52:33.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.027+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/541525037 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307631150 0x56530763cfc0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.027+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/541525037 >> 172.21.15.132:0/541525037 conn(0x56530762c730 msgr2=0x56530771ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.027+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/541525037 shutdown_connections 2024-05-08T18:52:33.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.027+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/541525037 wait complete. 2024-05-08T18:52:33.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.027+0000 7fdcf7f2b800 1 Processor -- start 2024-05-08T18:52:33.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.027+0000 7fdcf7f2b800 1 -- start start 2024-05-08T18:52:33.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.027+0000 7fdcf7f2b800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307631150 0x56530772d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.027+0000 7fdcf7f2b800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x565307638470 con 0x565307631150 2024-05-08T18:52:33.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.027+0000 7fdcf3b4b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307631150 0x56530772d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.027+0000 7fdcf3b4b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307631150 0x56530772d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53574/0 (socket says 172.21.15.132:53574) 2024-05-08T18:52:33.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.027+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/1128353101 learned_addr learned my addr 172.21.15.132:0/1128353101 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.028+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/1128353101 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56530772d800 con 0x565307631150 2024-05-08T18:52:33.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.028+0000 7fdcf3b4b640 1 --2- 172.21.15.132:0/1128353101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307631150 0x56530772d2c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fdce4000f60 tx=0x7fdce4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.028+0000 7fdbdbfff640 1 -- 172.21.15.132:0/1128353101 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdce4019870 con 0x565307631150 2024-05-08T18:52:33.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.028+0000 7fdbdbfff640 1 -- 172.21.15.132:0/1128353101 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdce4019a10 con 0x565307631150 2024-05-08T18:52:33.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.028+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/1128353101 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56530772da90 con 0x565307631150 2024-05-08T18:52:33.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.028+0000 7fdbdbfff640 1 -- 172.21.15.132:0/1128353101 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdce4019d10 con 0x565307631150 2024-05-08T18:52:33.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.028+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/1128353101 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565307730740 con 0x565307631150 2024-05-08T18:52:33.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.029+0000 7fdbdbfff640 1 -- 172.21.15.132:0/1128353101 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fdce4017040 con 0x565307631150 2024-05-08T18:52:33.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.029+0000 7fdbdbfff640 1 --2- 172.21.15.132:0/1128353101 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdbdc03bba0 0x7fdbdc03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.029+0000 7fdbdbfff640 1 -- 172.21.15.132:0/1128353101 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fdce4015020 con 0x565307631150 2024-05-08T18:52:33.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.029+0000 7fdcf334a640 1 --2- 172.21.15.132:0/1128353101 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdbdc03bba0 0x7fdbdc03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.030+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/1128353101 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5653076355e0 0x565307734500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.030+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/1128353101 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565307734a80 con 0x5653076355e0 2024-05-08T18:52:33.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.030+0000 7fdcf434c640 1 --2- 172.21.15.132:0/1128353101 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5653076355e0 0x565307734500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.030+0000 7fdcf334a640 1 --2- 172.21.15.132:0/1128353101 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdbdc03bba0 0x7fdbdc03e060 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc054000 tx=0x7fdcdc04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.030+0000 7fdcf434c640 1 --2- 172.21.15.132:0/1128353101 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5653076355e0 0x565307734500 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.030+0000 7fdcf434c640 1 -- 172.21.15.132:0/1128353101 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcec00a4a0 con 0x5653076355e0 2024-05-08T18:52:33.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.030+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/1128353101 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565307731ab0 con 0x5653076355e0 2024-05-08T18:52:33.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.031+0000 7fdcf434c640 1 -- 172.21.15.132:0/1128353101 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdcec00a4a0 con 0x5653076355e0 2024-05-08T18:52:33.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.031+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/1128353101 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x565307736d90 0x565307739180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.031+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/1128353101 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565307739820 con 0x565307736d90 2024-05-08T18:52:33.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.031+0000 7fdcf3b4b640 1 --2- 172.21.15.132:0/1128353101 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x565307736d90 0x565307739180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.031+0000 7fdcf3b4b640 1 --2- 172.21.15.132:0/1128353101 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x565307736d90 0x565307739180 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.031+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/1128353101 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdce402d070 con 0x565307736d90 2024-05-08T18:52:33.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.031+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/1128353101 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565307735c00 con 0x5653076355e0 2024-05-08T18:52:33.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.031+0000 7fdcf434c640 1 -- 172.21.15.132:0/1128353101 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdcec00a4a0 con 0x5653076355e0 2024-05-08T18:52:33.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.031+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/1128353101 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653077360e0 con 0x5653076355e0 2024-05-08T18:52:33.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.032+0000 7fdcf434c640 1 -- 172.21.15.132:0/1128353101 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdcec00a4a0 con 0x5653076355e0 2024-05-08T18:52:33.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.032+0000 7fdcf7f2b800 1 Processor -- start 2024-05-08T18:52:33.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.032+0000 7fdcf7f2b800 1 -- start start 2024-05-08T18:52:33.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.032+0000 7fdcf7f2b800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307748770 0x565307748b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.032+0000 7fdcf7f2b800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x565307523fc0 con 0x565307748770 2024-05-08T18:52:33.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.032+0000 7fdcf434c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307748770 0x565307748b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.032+0000 7fdcf434c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307748770 0x565307748b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53576/0 (socket says 172.21.15.132:53576) 2024-05-08T18:52:33.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.032+0000 7fdcf434c640 1 -- 172.21.15.132:0/2499786733 learned_addr learned my addr 172.21.15.132:0/2499786733 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.033+0000 7fdcf434c640 1 -- 172.21.15.132:0/2499786733 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653077490d0 con 0x565307748770 2024-05-08T18:52:33.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.033+0000 7fdcf434c640 1 --2- 172.21.15.132:0/2499786733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307748770 0x565307748b90 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x56530772e190 tx=0x7fdcec0188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.033+0000 7fdbd97fa640 1 -- 172.21.15.132:0/2499786733 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcec014450 con 0x565307748770 2024-05-08T18:52:33.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.033+0000 7fdbd97fa640 1 -- 172.21.15.132:0/2499786733 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcec0145f0 con 0x565307748770 2024-05-08T18:52:33.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.033+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/2499786733 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565307749b40 con 0x565307748770 2024-05-08T18:52:33.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.033+0000 7fdbd97fa640 1 -- 172.21.15.132:0/2499786733 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcec0148d0 con 0x565307748770 2024-05-08T18:52:33.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.033+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/2499786733 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56530774a040 con 0x565307748770 2024-05-08T18:52:33.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.034+0000 7fdbd97fa640 1 -- 172.21.15.132:0/2499786733 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fdcec011040 con 0x565307748770 2024-05-08T18:52:33.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.034+0000 7fdbd97fa640 1 --2- 172.21.15.132:0/2499786733 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdbcc03bba0 0x7fdbcc03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.034+0000 7fdbd97fa640 1 -- 172.21.15.132:0/2499786733 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fdcec01e070 con 0x565307748770 2024-05-08T18:52:33.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.034+0000 7fdcf3b4b640 1 --2- 172.21.15.132:0/2499786733 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdbcc03bba0 0x7fdbcc03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.035+0000 7fdcf7f2b800 1 Processor -- start 2024-05-08T18:52:33.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.035+0000 7fdcf3b4b640 1 --2- 172.21.15.132:0/2499786733 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdbcc03bba0 0x7fdbcc03e060 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdce401c5e0 tx=0x7fdce400eb50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.035+0000 7fdcf7f2b800 1 -- start start 2024-05-08T18:52:33.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.035+0000 7fdcf7f2b800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307755ac0 0x565307755ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.035+0000 7fdcf7f2b800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56530763b900 con 0x565307755ac0 2024-05-08T18:52:33.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.035+0000 7fdcf434c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307755ac0 0x565307755ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.035+0000 7fdcf434c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307755ac0 0x565307755ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53578/0 (socket says 172.21.15.132:53578) 2024-05-08T18:52:33.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.035+0000 7fdcf434c640 1 -- 172.21.15.132:0/3009184117 learned_addr learned my addr 172.21.15.132:0/3009184117 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.035+0000 7fdcf434c640 1 -- 172.21.15.132:0/3009184117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653077564b0 con 0x565307755ac0 2024-05-08T18:52:33.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.035+0000 7fdcf434c640 1 --2- 172.21.15.132:0/3009184117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307755ac0 0x565307755ee0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fdcec013fd0 tx=0x7fdcec0118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8ef7f71e374e76e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.036+0000 7fdbd2ffd640 1 -- 172.21.15.132:0/3009184117 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcec0168f0 con 0x565307755ac0 2024-05-08T18:52:33.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.036+0000 7fdbd2ffd640 1 -- 172.21.15.132:0/3009184117 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcec022ca0 con 0x565307755ac0 2024-05-08T18:52:33.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.036+0000 7fdbd2ffd640 1 -- 172.21.15.132:0/3009184117 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcec02bc50 con 0x565307755ac0 2024-05-08T18:52:33.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.036+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/3009184117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307755ac0 msgr2=0x565307755ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.036+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/3009184117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307755ac0 0x565307755ee0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fdcec013fd0 tx=0x7fdcec0118e0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.036+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/3009184117 shutdown_connections 2024-05-08T18:52:33.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.036+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/3009184117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307755ac0 0x565307755ee0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.036+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/3009184117 >> 172.21.15.132:0/3009184117 conn(0x565307751d40 msgr2=0x56530774fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.036+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/3009184117 shutdown_connections 2024-05-08T18:52:33.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.036+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/3009184117 wait complete. 2024-05-08T18:52:33.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.036+0000 7fdcf7f2b800 1 Processor -- start 2024-05-08T18:52:33.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.036+0000 7fdcf7f2b800 1 -- start start 2024-05-08T18:52:33.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.036+0000 7fdcf7f2b800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307755ac0 0x56530775d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.036+0000 7fdcf7f2b800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x565307756be0 con 0x565307755ac0 2024-05-08T18:52:33.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.037+0000 7fdcf434c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307755ac0 0x56530775d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.037+0000 7fdcf434c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307755ac0 0x56530775d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53580/0 (socket says 172.21.15.132:53580) 2024-05-08T18:52:33.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.037+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 learned_addr learned my addr 172.21.15.132:0/483439352 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.037+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56530775d540 con 0x565307755ac0 2024-05-08T18:52:33.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.037+0000 7fdcf434c640 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307755ac0 0x56530775d000 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fdcec013fd0 tx=0x7fdcec052b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.037+0000 7fdbd17fa640 1 -- 172.21.15.132:0/483439352 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcec022e50 con 0x565307755ac0 2024-05-08T18:52:33.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.037+0000 7fdbd17fa640 1 -- 172.21.15.132:0/483439352 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcec0545b0 con 0x565307755ac0 2024-05-08T18:52:33.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.037+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56530775d7d0 con 0x565307755ac0 2024-05-08T18:52:33.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.037+0000 7fdbd17fa640 1 -- 172.21.15.132:0/483439352 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcec02b4c0 con 0x565307755ac0 2024-05-08T18:52:33.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.037+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565307760480 con 0x565307755ac0 2024-05-08T18:52:33.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.038+0000 7fdbd17fa640 1 -- 172.21.15.132:0/483439352 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fdcec04a040 con 0x565307755ac0 2024-05-08T18:52:33.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.038+0000 7fdbd17fa640 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdbbc03bb50 0x7fdbbc03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.038+0000 7fdbd17fa640 1 -- 172.21.15.132:0/483439352 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fdcec048020 con 0x565307755ac0 2024-05-08T18:52:33.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.038+0000 7fdcf3b4b640 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdbbc03bb50 0x7fdbbc03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.039+0000 7fdcf3b4b640 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdbbc03bb50 0x7fdbbc03e010 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdce4000fb0 tx=0x7fdce404d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.039+0000 7fdcf7f2b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.039+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x565307768d20 0x56530776b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.039+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56530776b930 con 0x565307768d20 2024-05-08T18:52:33.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.039+0000 7fdcf334a640 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x565307768d20 0x56530776b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.039+0000 7fdcf334a640 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x565307768d20 0x56530776b1e0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.040+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcdc05a040 con 0x565307768d20 2024-05-08T18:52:33.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.040+0000 7fdcf7f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.040+0000 7fdcf7f2b800 20 realm 2024-05-08T18:52:33.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.040+0000 7fdcf7f2b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.040+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56530776bd00 con 0x565307768d20 2024-05-08T18:52:33.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.040+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcdc05a040 con 0x565307768d20 2024-05-08T18:52:33.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.040+0000 7fdcf7f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.040+0000 7fdcf7f2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:52:33.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.040+0000 7fdcf7f2b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.040+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56530776c5d0 con 0x565307768d20 2024-05-08T18:52:33.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.040+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcdc05a040 con 0x565307768d20 2024-05-08T18:52:33.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.040+0000 7fdcf7f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.040+0000 7fdcf7f2b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.040+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56530776c970 con 0x565307768d20 2024-05-08T18:52:33.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.040+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdcdc05a040 con 0x565307768d20 2024-05-08T18:52:33.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.040+0000 7fdcf7f2b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:33.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.040+0000 7fdcf7f2b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.040+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56530776d6d0 0x56530776fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.040+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653077700d0 con 0x56530776d6d0 2024-05-08T18:52:33.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.040+0000 7fdcf434c640 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56530776d6d0 0x56530776fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.041+0000 7fdcf434c640 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56530776d6d0 0x56530776fac0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.041+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdcec03f070 con 0x56530776d6d0 2024-05-08T18:52:33.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.041+0000 7fdcf7f2b800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:52:33.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.041+0000 7fdcf7f2b800 20 searching for the correct realm 2024-05-08T18:52:33.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.041+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x56530776d6d0 2024-05-08T18:52:33.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.041+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcec03f070 con 0x56530776d6d0 2024-05-08T18:52:33.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.041+0000 7fdcf434c640 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fdcec050070 0x7fdcec050a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.041+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x7fdcec050070 2024-05-08T18:52:33.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.041+0000 7fdcf3b4b640 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fdcec050070 0x7fdcec050a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.042+0000 7fdcf3b4b640 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fdcec050070 0x7fdcec050a60 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.042+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/483439352 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce402d070 con 0x7fdcec050070 2024-05-08T18:52:33.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.042+0000 7fdcf3b4b640 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fdce404a670 0x7fdce4043450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.042+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x7fdce404a670 2024-05-08T18:52:33.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.042+0000 7fdcf334a640 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fdce404a670 0x7fdce4043450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.043+0000 7fdcf334a640 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fdce404a670 0x7fdce4043450 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.043+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc05a040 con 0x7fdce404a670 2024-05-08T18:52:33.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.043+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x565307768d20 2024-05-08T18:52:33.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.043+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc05a040 con 0x565307768d20 2024-05-08T18:52:33.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.043+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x565307768d20 2024-05-08T18:52:33.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.043+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc05a040 con 0x565307768d20 2024-05-08T18:52:33.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.043+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x7fdce404a670 2024-05-08T18:52:33.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.044+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc05a040 con 0x7fdce404a670 2024-05-08T18:52:33.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.044+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x7fdce404a670 2024-05-08T18:52:33.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.044+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc05a040 con 0x7fdce404a670 2024-05-08T18:52:33.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.044+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x7fdcec050070 2024-05-08T18:52:33.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.044+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/483439352 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce402d070 con 0x7fdcec050070 2024-05-08T18:52:33.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.044+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x56530776d6d0 2024-05-08T18:52:33.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.044+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcec03f070 con 0x56530776d6d0 2024-05-08T18:52:33.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.044+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x565307768d20 2024-05-08T18:52:33.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.045+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc05a040 con 0x565307768d20 2024-05-08T18:52:33.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.045+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x7fdce404a670 2024-05-08T18:52:33.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.045+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc05a040 con 0x7fdce404a670 2024-05-08T18:52:33.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.045+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x565307768d20 2024-05-08T18:52:33.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.045+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdcdc05a040 con 0x565307768d20 2024-05-08T18:52:33.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.045+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x7fdcec050070 2024-05-08T18:52:33.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.045+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/483439352 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdce402d070 con 0x7fdcec050070 2024-05-08T18:52:33.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.045+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x56530776d6d0 2024-05-08T18:52:33.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.046+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v27'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdcec03f070 con 0x56530776d6d0 2024-05-08T18:52:33.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.046+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x56530776d6d0 2024-05-08T18:52:33.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.046+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcec03f070 con 0x56530776d6d0 2024-05-08T18:52:33.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.046+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x7fdce404a670 2024-05-08T18:52:33.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.046+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc05a040 con 0x7fdce404a670 2024-05-08T18:52:33.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.046+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x56530776d6d0 2024-05-08T18:52:33.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.046+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcec03f070 con 0x56530776d6d0 2024-05-08T18:52:33.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.046+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x56530776d6d0 2024-05-08T18:52:33.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.047+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcec03f070 con 0x56530776d6d0 2024-05-08T18:52:33.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.047+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x565307768d20 2024-05-08T18:52:33.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.047+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc05a040 con 0x565307768d20 2024-05-08T18:52:33.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.047+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x565307768d20 2024-05-08T18:52:33.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.047+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v27'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdcdc05a040 con 0x565307768d20 2024-05-08T18:52:33.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.047+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x7fdce404a670 2024-05-08T18:52:33.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.047+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc07d040 con 0x7fdce404a670 2024-05-08T18:52:33.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.047+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x56530776d6d0 2024-05-08T18:52:33.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.048+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcec03f070 con 0x56530776d6d0 2024-05-08T18:52:33.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.048+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x7fdcec050070 2024-05-08T18:52:33.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.048+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/483439352 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce402d070 con 0x7fdcec050070 2024-05-08T18:52:33.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.048+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x565307768d20 2024-05-08T18:52:33.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.048+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc07d040 con 0x565307768d20 2024-05-08T18:52:33.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.048+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x7fdcec050070 2024-05-08T18:52:33.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.048+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/483439352 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce402d070 con 0x7fdcec050070 2024-05-08T18:52:33.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.048+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x56530776d6d0 2024-05-08T18:52:33.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.049+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcec03f070 con 0x56530776d6d0 2024-05-08T18:52:33.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.049+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x7fdce404a670 2024-05-08T18:52:33.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.049+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc07d040 con 0x7fdce404a670 2024-05-08T18:52:33.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.049+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x7fdcec050070 2024-05-08T18:52:33.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.049+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/483439352 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce402d070 con 0x7fdcec050070 2024-05-08T18:52:33.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.049+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x56530776d6d0 2024-05-08T18:52:33.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.049+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcec03f070 con 0x56530776d6d0 2024-05-08T18:52:33.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.049+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x7fdce404a670 2024-05-08T18:52:33.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.050+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc07d040 con 0x7fdce404a670 2024-05-08T18:52:33.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.050+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x565307768d20 2024-05-08T18:52:33.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.050+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v27'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdcdc07d040 con 0x565307768d20 2024-05-08T18:52:33.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.050+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5653077719e0 con 0x7fdcec050070 2024-05-08T18:52:33.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.050+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/483439352 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce402d070 con 0x7fdcec050070 2024-05-08T18:52:33.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.050+0000 7fdcf7f2b800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:52:33.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.050+0000 7fdcf7f2b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:52:33.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.050+0000 7fdcf7f2b800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:52:33.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.050+0000 7fdcf7f2b800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:52:33.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.050+0000 7fdcf7f2b800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:52:33.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.050+0000 7fdcf7f2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:52:33.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.050+0000 7fdcf7f2b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.050+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653077715b0 con 0x565307768d20 2024-05-08T18:52:33.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.051+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcdc07d040 con 0x565307768d20 2024-05-08T18:52:33.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.051+0000 7fdcf7f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.051+0000 7fdcf7f2b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.051+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565307770e20 con 0x565307768d20 2024-05-08T18:52:33.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.051+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdcdc07d040 con 0x565307768d20 2024-05-08T18:52:33.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.051+0000 7fdcf7f2b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:33.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.051+0000 7fdcf7f2b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.051+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565307771e60 con 0x565307768d20 2024-05-08T18:52:33.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.051+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdcdc07d040 con 0x565307768d20 2024-05-08T18:52:33.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.051+0000 7fdcf7f2b800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:52:33.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.051+0000 7fdcf7f2b800 20 zone default found 2024-05-08T18:52:33.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.051+0000 7fdcf7f2b800 4 Realm: () 2024-05-08T18:52:33.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.051+0000 7fdcf7f2b800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:52:33.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.051+0000 7fdcf7f2b800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:52:33.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.051+0000 7fdcf7f2b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:52:33.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.051+0000 7fdcf7f2b800 20 zonegroup default 2024-05-08T18:52:33.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.051+0000 7fdcf7f2b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.051+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565307772260 con 0x7fdcec050070 2024-05-08T18:52:33.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.051+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/483439352 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdce402d070 con 0x7fdcec050070 2024-05-08T18:52:33.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.051+0000 7fdcf7f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.051+0000 7fdcf7f2b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.051+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565307774530 con 0x56530776d6d0 2024-05-08T18:52:33.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.052+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdcec03f070 con 0x56530776d6d0 2024-05-08T18:52:33.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.052+0000 7fdcf7f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.052+0000 7fdcf7f2b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.052+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653077748d0 con 0x56530776d6d0 2024-05-08T18:52:33.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.052+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdcec03f070 con 0x56530776d6d0 2024-05-08T18:52:33.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.052+0000 7fdcf7f2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.052+0000 7fdcf7f2b800 20 started sync module instance, tier type = 2024-05-08T18:52:33.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.052+0000 7fdcf7f2b800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:52:33.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.052+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653077739c0 con 0x7fdcec050070 2024-05-08T18:52:33.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.053+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/483439352 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce402d070 con 0x7fdcec050070 2024-05-08T18:52:33.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.053+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94914607529392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565307775170 con 0x7fdcec050070 2024-05-08T18:52:33.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.053+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653077759c0 con 0x565307768d20 2024-05-08T18:52:33.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.054+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/483439352 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94914607529392] v27'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce402d070 con 0x7fdcec050070 2024-05-08T18:52:33.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.054+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc07d040 con 0x565307768d20 2024-05-08T18:52:33.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.054+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94914607535376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565307775d60 con 0x565307768d20 2024-05-08T18:52:33.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.054+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565307776880 con 0x56530776d6d0 2024-05-08T18:52:33.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.055+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94914607535376] v27'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc07d040 con 0x565307768d20 2024-05-08T18:52:33.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.055+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcec03f070 con 0x56530776d6d0 2024-05-08T18:52:33.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.055+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94914607539024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565307776840 con 0x56530776d6d0 2024-05-08T18:52:33.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.055+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653077772d0 con 0x7fdcec050070 2024-05-08T18:52:33.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.056+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94914607539024] v27'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcec03f070 con 0x56530776d6d0 2024-05-08T18:52:33.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.056+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/483439352 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce402d070 con 0x7fdcec050070 2024-05-08T18:52:33.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.056+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94914607533248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653077776c0 con 0x7fdcec050070 2024-05-08T18:52:33.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.056+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653077780e0 con 0x565307768d20 2024-05-08T18:52:33.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.057+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/483439352 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94914607533248] v27'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce402d070 con 0x7fdcec050070 2024-05-08T18:52:33.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.058+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc07d040 con 0x565307768d20 2024-05-08T18:52:33.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.058+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94914607545296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653077780a0 con 0x565307768d20 2024-05-08T18:52:33.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.058+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565307778b80 con 0x7fdce404a670 2024-05-08T18:52:33.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.059+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94914607545296] v27'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc07d040 con 0x565307768d20 2024-05-08T18:52:33.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.059+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc07d040 con 0x7fdce404a670 2024-05-08T18:52:33.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.059+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94914607548016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565307778b40 con 0x7fdce404a670 2024-05-08T18:52:33.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.059+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565307779600 con 0x7fdce404a670 2024-05-08T18:52:33.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.060+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(56 notify.6 [create] v27'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc07d040 con 0x7fdce404a670 2024-05-08T18:52:33.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.060+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94914607550736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565307779530 con 0x7fdce404a670 2024-05-08T18:52:33.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.060+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56530777a530 con 0x7fdce404a670 2024-05-08T18:52:33.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.060+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94914607548016] v27'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc07d040 con 0x7fdce404a670 2024-05-08T18:52:33.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.061+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94914607550736] v27'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc07d040 con 0x7fdce404a670 2024-05-08T18:52:33.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.061+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc07d040 con 0x7fdce404a670 2024-05-08T18:52:33.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.061+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94914607541728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56530777a040 con 0x7fdce404a670 2024-05-08T18:52:33.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.061+0000 7fdcf7f2b800 20 add_watcher() i=0 2024-05-08T18:52:33.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.061+0000 7fdcf7f2b800 20 add_watcher() i=1 2024-05-08T18:52:33.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.061+0000 7fdcf7f2b800 20 add_watcher() i=2 2024-05-08T18:52:33.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.061+0000 7fdcf7f2b800 20 add_watcher() i=3 2024-05-08T18:52:33.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.061+0000 7fdcf7f2b800 20 add_watcher() i=4 2024-05-08T18:52:33.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.061+0000 7fdcf7f2b800 20 add_watcher() i=5 2024-05-08T18:52:33.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.061+0000 7fdcf7f2b800 20 add_watcher() i=6 2024-05-08T18:52:33.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.062+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94914607541728] v27'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc07d040 con 0x7fdce404a670 2024-05-08T18:52:33.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.062+0000 7fdcf7f2b800 20 add_watcher() i=7 2024-05-08T18:52:33.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.062+0000 7fdcf7f2b800 2 all 8 watchers are set, enabling cache 2024-05-08T18:52:33.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.062+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56530777d440 con 0x565307768d20 2024-05-08T18:52:33.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.062+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdcdc07d040 con 0x565307768d20 2024-05-08T18:52:33.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.062+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94914607552896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56530777a930 con 0x565307768d20 2024-05-08T18:52:33.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.063+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94914607552896] v27'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdcdc07d040 con 0x565307768d20 2024-05-08T18:52:33.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.063+0000 7fdba9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:33.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.064+0000 7fdcf7f2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:33.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.064+0000 7fdcf7f2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:33.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.064+0000 7fdcf7f2b800 5 note: GC not initialized 2024-05-08T18:52:33.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.064+0000 7fdba8fe1640 20 reqs_thread_entry: start 2024-05-08T18:52:33.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.064+0000 7fdcf7f2b800 20 init_complete bucket index max shards: 11 2024-05-08T18:52:33.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.064+0000 7fdcf7f2b800 20 Filter name: none 2024-05-08T18:52:33.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.064+0000 7fdb227fc640 20 reqs_thread_entry: start 2024-05-08T18:52:33.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.064+0000 7fdcf7f2b800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:52:33.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.064+0000 7fdcf7f2b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.064+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653077b0930 con 0x7fdce404a670 2024-05-08T18:52:33.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.065+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fdcdc07d040 con 0x7fdce404a670 2024-05-08T18:52:33.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.065+0000 7fdcf7f2b800 20 rados_obj.operate() r=0 bl.length=490 2024-05-08T18:52:33.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.065+0000 7fdcf7f2b800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:52:33.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.065+0000 7fdcf7f2b800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:33.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.065+0000 7fdcf7f2b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:52:33.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.065+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653077b71e0 con 0x7fdce404a670 2024-05-08T18:52:33.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.066+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v27'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fdcdc07d040 con 0x7fdce404a670 2024-05-08T18:52:33.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.066+0000 7fdcf7f2b800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:52:33.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.066+0000 7fdcf7f2b800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:33.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.066+0000 7fdcf7f2b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:52:33.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.066+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94914607803296 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5653077b27c0 con 0x565307768d20 2024-05-08T18:52:33.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.067+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== watch-notify(notify (1) cookie 94914607545296 notify 115964117017 ret 0) ==== 708+0+0 (crc 0 0 0) 0x5653076391d0 con 0x565307768d20 2024-05-08T18:52:33.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.067+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 notify.4 [notify cookie 94914607803296 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdcdc07d040 con 0x565307768d20 2024-05-08T18:52:33.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.067+0000 7fdbd2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117017 cookie 94914607545296 notifier 4872 bl.length()=666 2024-05-08T18:52:33.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.067+0000 7fdbd2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:52:33.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.067+0000 7fdbd2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:33.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.067+0000 7fdbd2ffd640 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fdbb8003ea0 con 0x565307768d20 2024-05-08T18:52:33.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.067+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc07d040 con 0x565307768d20 2024-05-08T18:52:33.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.067+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== watch-notify(notify_complete (2) cookie 94914607803296 notify 115964117017 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdcdc086430 con 0x565307768d20 2024-05-08T18:52:33.077 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:52:31.994053Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:52:31.994040Z","tags":[],"group_ids":[]} 2024-05-08T18:52:33.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.068+0000 7fdba9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:33.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.068+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94914607552896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5653077af900 con 0x565307768d20 2024-05-08T18:52:33.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.069+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94914607552896] v27'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdcdc07d040 con 0x565307768d20 2024-05-08T18:52:33.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.069+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94914607529392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565307779950 con 0x7fdcec050070 2024-05-08T18:52:33.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.070+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/483439352 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94914607529392] v27'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce402d070 con 0x7fdcec050070 2024-05-08T18:52:33.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.070+0000 7fdcf7f2b800 20 remove_watcher() i=0 2024-05-08T18:52:33.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.070+0000 7fdcf7f2b800 2 removed watcher, disabling cache 2024-05-08T18:52:33.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.070+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94914607535376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565307773db0 con 0x565307768d20 2024-05-08T18:52:33.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.071+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94914607535376] v27'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc07d040 con 0x565307768d20 2024-05-08T18:52:33.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.071+0000 7fdcf7f2b800 20 remove_watcher() i=1 2024-05-08T18:52:33.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.071+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94914607539024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565307773db0 con 0x56530776d6d0 2024-05-08T18:52:33.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.072+0000 7fdcf434c640 1 -- 172.21.15.132:0/483439352 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94914607539024] v27'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcec03f070 con 0x56530776d6d0 2024-05-08T18:52:33.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.072+0000 7fdcf7f2b800 20 remove_watcher() i=2 2024-05-08T18:52:33.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.072+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94914607533248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565307776350 con 0x7fdcec050070 2024-05-08T18:52:33.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.073+0000 7fdcf3b4b640 1 -- 172.21.15.132:0/483439352 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94914607533248] v27'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce402d070 con 0x7fdcec050070 2024-05-08T18:52:33.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.073+0000 7fdcf7f2b800 20 remove_watcher() i=3 2024-05-08T18:52:33.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.073+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94914607545296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565307773db0 con 0x565307768d20 2024-05-08T18:52:33.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.074+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94914607545296] v27'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc07d040 con 0x565307768d20 2024-05-08T18:52:33.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.074+0000 7fdcf7f2b800 20 remove_watcher() i=4 2024-05-08T18:52:33.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.074+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94914607548016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565307774cc0 con 0x7fdce404a670 2024-05-08T18:52:33.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.075+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94914607548016] v27'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc07d040 con 0x7fdce404a670 2024-05-08T18:52:33.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.075+0000 7fdcf7f2b800 20 remove_watcher() i=5 2024-05-08T18:52:33.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.075+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94914607550736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565307776350 con 0x7fdce404a670 2024-05-08T18:52:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.076+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94914607550736] v27'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc07d040 con 0x7fdce404a670 2024-05-08T18:52:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.076+0000 7fdcf7f2b800 20 remove_watcher() i=6 2024-05-08T18:52:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.076+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94914607541728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565307777bd0 con 0x7fdce404a670 2024-05-08T18:52:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.077+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94914607541728] v27'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc07d040 con 0x7fdce404a670 2024-05-08T18:52:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.077+0000 7fdcf7f2b800 20 remove_watcher() i=7 2024-05-08T18:52:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.077+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fdce404a670 msgr2=0x7fdce4043450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.077+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fdce404a670 0x7fdce4043450 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.077+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x565307768d20 msgr2=0x56530776b1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.077+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x565307768d20 0x56530776b1e0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.077+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fdcec050070 msgr2=0x7fdcec050a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.077+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fdcec050070 0x7fdcec050a60 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.077+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56530776d6d0 msgr2=0x56530776fac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.077+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56530776d6d0 0x56530776fac0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.077+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdbbc03bb50 msgr2=0x7fdbbc03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdbbc03bb50 0x7fdbbc03e010 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdce4000fb0 tx=0x7fdce404d000 comp rx=0 tx=0).stop 2024-05-08T18:52:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307755ac0 msgr2=0x56530775d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf334a640 1 -- 172.21.15.132:0/483439352 reap_dead start 2024-05-08T18:52:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307755ac0 0x56530775d000 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fdcec013fd0 tx=0x7fdcec052b90 comp rx=0 tx=0).stop 2024-05-08T18:52:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 shutdown_connections 2024-05-08T18:52:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/483439352 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307755ac0 0x56530775d000 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 >> 172.21.15.132:0/483439352 conn(0x565307751d40 msgr2=0x56530774f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 shutdown_connections 2024-05-08T18:52:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/483439352 wait complete. 2024-05-08T18:52:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/2499786733 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdbcc03bba0 msgr2=0x7fdbcc03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/2499786733 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdbcc03bba0 0x7fdbcc03e060 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdce401c5e0 tx=0x7fdce400eb50 comp rx=0 tx=0).stop 2024-05-08T18:52:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/2499786733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307748770 msgr2=0x565307748b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/2499786733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307748770 0x565307748b90 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x56530772e190 tx=0x7fdcec0188f0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/2499786733 shutdown_connections 2024-05-08T18:52:33.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/2499786733 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdbcc03bba0 0x7fdbcc03e060 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/2499786733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307748770 0x565307748b90 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/2499786733 >> 172.21.15.132:0/2499786733 conn(0x56530773c810 msgr2=0x56530773cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/2499786733 shutdown_connections 2024-05-08T18:52:33.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/2499786733 wait complete. 2024-05-08T18:52:33.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/1128353101 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5653076355e0 msgr2=0x565307734500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/1128353101 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5653076355e0 0x565307734500 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/1128353101 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x565307736d90 msgr2=0x565307739180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/1128353101 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x565307736d90 0x565307739180 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/1128353101 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdbdc03bba0 msgr2=0x7fdbdc03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/1128353101 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdbdc03bba0 0x7fdbdc03e060 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc054000 tx=0x7fdcdc04e000 comp rx=0 tx=0).stop 2024-05-08T18:52:33.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/1128353101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307631150 msgr2=0x56530772d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.078+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/1128353101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307631150 0x56530772d2c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fdce4000f60 tx=0x7fdce4000ed0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.079+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/1128353101 shutdown_connections 2024-05-08T18:52:33.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.079+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/1128353101 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x565307736d90 0x565307739180 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.079+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/1128353101 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5653076355e0 0x565307734500 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.079+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/1128353101 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fdbdc03bba0 0x7fdbdc03e060 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.079+0000 7fdcf7f2b800 1 --2- 172.21.15.132:0/1128353101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x565307631150 0x56530772d2c0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.079+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/1128353101 >> 172.21.15.132:0/1128353101 conn(0x56530762c730 msgr2=0x56530763be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.079+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/1128353101 shutdown_connections 2024-05-08T18:52:33.087 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.079+0000 7fdcf7f2b800 1 -- 172.21.15.132:0/1128353101 wait complete. 2024-05-08T18:52:33.088 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:52:31.994053Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:31.994040Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:33.088 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:52:31.994053Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:31.994040Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:33.088 ERROR:root:0 2024-05-08T18:52:33.088 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:52:33.092 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:52:33.093 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:52:33.093 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:52:33.093 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-05-08T18:52:33.139 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:33.139 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:33.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.140+0000 7f3c04d1f800 1 Processor -- start 2024-05-08T18:52:33.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.140+0000 7f3c04d1f800 1 -- start start 2024-05-08T18:52:33.140 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.141+0000 7f3c04d1f800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55fc781c58b0 0x55fc781c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.141+0000 7f3c04d1f800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fc781c2b40 con 0x55fc781c6210 2024-05-08T18:52:33.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.141+0000 7f3c04d1f800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x55fc78064e20 con 0x55fc781c58b0 2024-05-08T18:52:33.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.141+0000 7f3c009e7640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x55fc781c58b0 0x55fc781c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.141+0000 7f3bf81e6640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x55fc781c6210 0x55fc781c22f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48194/0 (socket says 172.21.15.132:48194) 2024-05-08T18:52:33.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.141+0000 7f3bf81e6640 1 -- 172.21.15.132:0/189548489 learned_addr learned my addr 172.21.15.132:0/189548489 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:52:33.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.141+0000 7f3c009e7640 1 -- 172.21.15.132:0/189548489 >> v1:172.21.15.42:6789/0 conn(0x55fc781c6210 legacy=0x55fc781c22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.141+0000 7f3bfbfff640 1 -- 172.21.15.132:0/189548489 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2671866959 0 0) 0x55fc781c2b40 con 0x55fc781c6210 2024-05-08T18:52:33.142 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.141+0000 7f3c009e7640 1 -- 172.21.15.132:0/189548489 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc781c2d60 con 0x55fc781c58b0 2024-05-08T18:52:33.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.143+0000 7f3c009e7640 1 --2- 172.21.15.132:0/189548489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc781c58b0 0x55fc781c5cd0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000a470 tx=0x7f3bf001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638aad23bcb0e51c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.143+0000 7f3bfbfff640 1 -- 172.21.15.132:0/189548489 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf0057070 con 0x55fc781c58b0 2024-05-08T18:52:33.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.143+0000 7f3bfbfff640 1 -- 172.21.15.132:0/189548489 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf004add0 con 0x55fc781c58b0 2024-05-08T18:52:33.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.143+0000 7f3bfbfff640 1 -- 172.21.15.132:0/189548489 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf0052590 con 0x55fc781c58b0 2024-05-08T18:52:33.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.144+0000 7f3c04d1f800 1 -- 172.21.15.132:0/189548489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc781c58b0 msgr2=0x55fc781c5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.144+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/189548489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc781c58b0 0x55fc781c5cd0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000a470 tx=0x7f3bf001ce90 comp rx=0 tx=0).stop 2024-05-08T18:52:33.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.144+0000 7f3c04d1f800 1 -- 172.21.15.132:0/189548489 shutdown_connections 2024-05-08T18:52:33.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.144+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/189548489 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc781c58b0 0x55fc781c5cd0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.144+0000 7f3c04d1f800 1 -- 172.21.15.132:0/189548489 >> 172.21.15.132:0/189548489 conn(0x55fc781bdeb0 msgr2=0x55fc781c02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.144+0000 7f3c04d1f800 1 -- 172.21.15.132:0/189548489 shutdown_connections 2024-05-08T18:52:33.144 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.144+0000 7f3c04d1f800 1 -- 172.21.15.132:0/189548489 wait complete. 2024-05-08T18:52:33.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.158+0000 7f3c04d1f800 1 Processor -- start 2024-05-08T18:52:33.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.158+0000 7f3c04d1f800 1 -- start start 2024-05-08T18:52:33.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.158+0000 7f3c04d1f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc781c58b0 0x55fc781c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.158+0000 7f3c04d1f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fc7810f5c0 con 0x55fc781c58b0 2024-05-08T18:52:33.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.159+0000 7f3c009e7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc781c58b0 0x55fc781c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.159+0000 7f3c009e7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc781c58b0 0x55fc781c4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53598/0 (socket says 172.21.15.132:53598) 2024-05-08T18:52:33.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.159+0000 7f3c009e7640 1 -- 172.21.15.132:0/1963244291 learned_addr learned my addr 172.21.15.132:0/1963244291 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.159+0000 7f3c009e7640 1 -- 172.21.15.132:0/1963244291 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc781c3510 con 0x55fc781c58b0 2024-05-08T18:52:33.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.159+0000 7f3c009e7640 1 --2- 172.21.15.132:0/1963244291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc781c58b0 0x55fc781c4f50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0055040 tx=0x7f3bf004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8794c2f450ecc96 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.159+0000 7f3aeee0d640 1 -- 172.21.15.132:0/1963244291 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf0057040 con 0x55fc781c58b0 2024-05-08T18:52:33.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.159+0000 7f3aeee0d640 1 -- 172.21.15.132:0/1963244291 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf0063070 con 0x55fc781c58b0 2024-05-08T18:52:33.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.159+0000 7f3aeee0d640 1 -- 172.21.15.132:0/1963244291 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf005d790 con 0x55fc781c58b0 2024-05-08T18:52:33.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.160+0000 7f3c04d1f800 1 -- 172.21.15.132:0/1963244291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc781c58b0 msgr2=0x55fc781c4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.160+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/1963244291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc781c58b0 0x55fc781c4f50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0055040 tx=0x7f3bf004c000 comp rx=0 tx=0).stop 2024-05-08T18:52:33.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.160+0000 7f3c04d1f800 1 -- 172.21.15.132:0/1963244291 shutdown_connections 2024-05-08T18:52:33.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.160+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/1963244291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc781c58b0 0x55fc781c4f50 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.160+0000 7f3c04d1f800 1 -- 172.21.15.132:0/1963244291 >> 172.21.15.132:0/1963244291 conn(0x55fc781bdeb0 msgr2=0x55fc782b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.160+0000 7f3c04d1f800 1 -- 172.21.15.132:0/1963244291 shutdown_connections 2024-05-08T18:52:33.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.160+0000 7f3c04d1f800 1 -- 172.21.15.132:0/1963244291 wait complete. 2024-05-08T18:52:33.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.160+0000 7f3c04d1f800 1 Processor -- start 2024-05-08T18:52:33.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.161+0000 7f3c04d1f800 1 -- start start 2024-05-08T18:52:33.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.161+0000 7f3c04d1f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc781c58b0 0x55fc782bf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.161+0000 7f3c04d1f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fc781cdb70 con 0x55fc781c58b0 2024-05-08T18:52:33.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.161+0000 7f3c009e7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc781c58b0 0x55fc782bf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.161+0000 7f3c009e7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc781c58b0 0x55fc782bf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53612/0 (socket says 172.21.15.132:53612) 2024-05-08T18:52:33.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.161+0000 7f3c009e7640 1 -- 172.21.15.132:0/3725733291 learned_addr learned my addr 172.21.15.132:0/3725733291 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.161+0000 7f3c009e7640 1 -- 172.21.15.132:0/3725733291 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc782bf920 con 0x55fc781c58b0 2024-05-08T18:52:33.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.162+0000 7f3c009e7640 1 --2- 172.21.15.132:0/3725733291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc781c58b0 0x55fc782bf3e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000a470 tx=0x7f3bf0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.162+0000 7f3aed60a640 1 -- 172.21.15.132:0/3725733291 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf0057050 con 0x55fc781c58b0 2024-05-08T18:52:33.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.162+0000 7f3aed60a640 1 -- 172.21.15.132:0/3725733291 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf005db40 con 0x55fc781c58b0 2024-05-08T18:52:33.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.162+0000 7f3aed60a640 1 -- 172.21.15.132:0/3725733291 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bf005de60 con 0x55fc781c58b0 2024-05-08T18:52:33.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.162+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3725733291 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc782bfbb0 con 0x55fc781c58b0 2024-05-08T18:52:33.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.162+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3725733291 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc782c2860 con 0x55fc781c58b0 2024-05-08T18:52:33.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.163+0000 7f3aed60a640 1 -- 172.21.15.132:0/3725733291 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f3bf0052440 con 0x55fc781c58b0 2024-05-08T18:52:33.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.163+0000 7f3aed60a640 1 --2- 172.21.15.132:0/3725733291 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f3ae803bba0 0x7f3ae803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.163+0000 7f3aed60a640 1 -- 172.21.15.132:0/3725733291 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f3bf0093d20 con 0x55fc781c58b0 2024-05-08T18:52:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.163+0000 7f3bf81e6640 1 --2- 172.21.15.132:0/3725733291 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f3ae803bba0 0x7f3ae803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.163+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/3725733291 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55fc781c6210 0x55fc782c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.163+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3725733291 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc782c6b60 con 0x55fc781c6210 2024-05-08T18:52:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.163+0000 7f3c011e8640 1 --2- 172.21.15.132:0/3725733291 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55fc781c6210 0x55fc782c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.163+0000 7f3bf81e6640 1 --2- 172.21.15.132:0/3725733291 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f3ae803bba0 0x7f3ae803e060 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3be8000c00 tx=0x7f3be80013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.163+0000 7f3c011e8640 1 --2- 172.21.15.132:0/3725733291 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55fc781c6210 0x55fc782c6620 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.164+0000 7f3c011e8640 1 -- 172.21.15.132:0/3725733291 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3bfc00a4a0 con 0x55fc781c6210 2024-05-08T18:52:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.164+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3725733291 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc782c3bd0 con 0x55fc781c6210 2024-05-08T18:52:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.164+0000 7f3c011e8640 1 -- 172.21.15.132:0/3725733291 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3bfc00a4a0 con 0x55fc781c6210 2024-05-08T18:52:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.164+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/3725733291 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55fc782c8ec0 0x55fc782cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.164+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3725733291 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc782cb950 con 0x55fc782c8ec0 2024-05-08T18:52:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.164+0000 7f3c009e7640 1 --2- 172.21.15.132:0/3725733291 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55fc782c8ec0 0x55fc782cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.164+0000 7f3c009e7640 1 --2- 172.21.15.132:0/3725733291 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55fc782c8ec0 0x55fc782cb2b0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.165+0000 7f3c009e7640 1 -- 172.21.15.132:0/3725733291 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3bf0078070 con 0x55fc782c8ec0 2024-05-08T18:52:33.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.165+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3725733291 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc782c7d30 con 0x55fc781c6210 2024-05-08T18:52:33.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.165+0000 7f3c011e8640 1 -- 172.21.15.132:0/3725733291 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3bfc00a4a0 con 0x55fc781c6210 2024-05-08T18:52:33.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.165+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3725733291 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc782c81c0 con 0x55fc781c6210 2024-05-08T18:52:33.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.165+0000 7f3c011e8640 1 -- 172.21.15.132:0/3725733291 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3bfc00a4a0 con 0x55fc781c6210 2024-05-08T18:52:33.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.166+0000 7f3c04d1f800 1 Processor -- start 2024-05-08T18:52:33.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.166+0000 7f3c04d1f800 1 -- start start 2024-05-08T18:52:33.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.166+0000 7f3c04d1f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc782da8e0 0x55fc782dad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.166+0000 7f3c04d1f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fc780b5fc0 con 0x55fc782da8e0 2024-05-08T18:52:33.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.166+0000 7f3c011e8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc782da8e0 0x55fc782dad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.166+0000 7f3c011e8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc782da8e0 0x55fc782dad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53628/0 (socket says 172.21.15.132:53628) 2024-05-08T18:52:33.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.166+0000 7f3c011e8640 1 -- 172.21.15.132:0/3107748033 learned_addr learned my addr 172.21.15.132:0/3107748033 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.166+0000 7f3c011e8640 1 -- 172.21.15.132:0/3107748033 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc782db240 con 0x55fc782da8e0 2024-05-08T18:52:33.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.166+0000 7f3c011e8640 1 --2- 172.21.15.132:0/3107748033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc782da8e0 0x55fc782dad00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x55fc782c6f40 tx=0x7f3bfc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.167+0000 7f3ae67fc640 1 -- 172.21.15.132:0/3107748033 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bfc014450 con 0x55fc782da8e0 2024-05-08T18:52:33.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.167+0000 7f3ae67fc640 1 -- 172.21.15.132:0/3107748033 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bfc014610 con 0x55fc782da8e0 2024-05-08T18:52:33.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.167+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3107748033 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc782dbcb0 con 0x55fc782da8e0 2024-05-08T18:52:33.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.167+0000 7f3ae67fc640 1 -- 172.21.15.132:0/3107748033 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bfc014930 con 0x55fc782da8e0 2024-05-08T18:52:33.169 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.167+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3107748033 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc782dc1b0 con 0x55fc782da8e0 2024-05-08T18:52:33.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.168+0000 7f3ae67fc640 1 -- 172.21.15.132:0/3107748033 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f3bfc011040 con 0x55fc782da8e0 2024-05-08T18:52:33.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.168+0000 7f3ae67fc640 1 --2- 172.21.15.132:0/3107748033 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f3ad803bb50 0x7f3ad803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.168+0000 7f3ae67fc640 1 -- 172.21.15.132:0/3107748033 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f3bfc01e070 con 0x55fc782da8e0 2024-05-08T18:52:33.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.168+0000 7f3c009e7640 1 --2- 172.21.15.132:0/3107748033 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f3ad803bb50 0x7f3ad803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.168+0000 7f3c04d1f800 1 Processor -- start 2024-05-08T18:52:33.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.168+0000 7f3c009e7640 1 --2- 172.21.15.132:0/3107748033 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f3ad803bb50 0x7f3ad803e010 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3bf005cb40 tx=0x7f3bf007d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.168+0000 7f3c04d1f800 1 -- start start 2024-05-08T18:52:33.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.168+0000 7f3c04d1f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc782e7bc0 0x55fc782e7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.189 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.168+0000 7f3c04d1f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fc781c37d0 con 0x55fc782e7bc0 2024-05-08T18:52:33.190 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.169+0000 7f3c011e8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc782e7bc0 0x55fc782e7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.190 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.169+0000 7f3c011e8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc782e7bc0 0x55fc782e7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53638/0 (socket says 172.21.15.132:53638) 2024-05-08T18:52:33.190 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.169+0000 7f3c011e8640 1 -- 172.21.15.132:0/997049192 learned_addr learned my addr 172.21.15.132:0/997049192 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.190 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.169+0000 7f3c011e8640 1 -- 172.21.15.132:0/997049192 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc782e85b0 con 0x55fc782e7bc0 2024-05-08T18:52:33.190 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.169+0000 7f3c011e8640 1 --2- 172.21.15.132:0/997049192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc782e7bc0 0x55fc782e7fe0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc052e20 tx=0x7f3bfc0118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2cc9ec24466e4da server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.190 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.169+0000 7f3ad7fff640 1 -- 172.21.15.132:0/997049192 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bfc011d30 con 0x55fc782e7bc0 2024-05-08T18:52:33.190 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.169+0000 7f3ad7fff640 1 -- 172.21.15.132:0/997049192 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bfc050070 con 0x55fc782e7bc0 2024-05-08T18:52:33.190 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.169+0000 7f3ad7fff640 1 -- 172.21.15.132:0/997049192 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bfc022df0 con 0x55fc782e7bc0 2024-05-08T18:52:33.190 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.170+0000 7f3c04d1f800 1 -- 172.21.15.132:0/997049192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc782e7bc0 msgr2=0x55fc782e7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.190 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.170+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/997049192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc782e7bc0 0x55fc782e7fe0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc052e20 tx=0x7f3bfc0118e0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.190 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.170+0000 7f3c04d1f800 1 -- 172.21.15.132:0/997049192 shutdown_connections 2024-05-08T18:52:33.191 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.170+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/997049192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc782e7bc0 0x55fc782e7fe0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.191 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.170+0000 7f3c04d1f800 1 -- 172.21.15.132:0/997049192 >> 172.21.15.132:0/997049192 conn(0x55fc782e3ed0 msgr2=0x55fc782e1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.191 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.170+0000 7f3c04d1f800 1 -- 172.21.15.132:0/997049192 shutdown_connections 2024-05-08T18:52:33.191 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.170+0000 7f3c04d1f800 1 -- 172.21.15.132:0/997049192 wait complete. 2024-05-08T18:52:33.191 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.170+0000 7f3c04d1f800 1 Processor -- start 2024-05-08T18:52:33.191 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.170+0000 7f3c04d1f800 1 -- start start 2024-05-08T18:52:33.191 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.170+0000 7f3c04d1f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc782e7bc0 0x55fc782ef0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.191 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.170+0000 7f3c04d1f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x55fc782e8d80 con 0x55fc782e7bc0 2024-05-08T18:52:33.191 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.171+0000 7f3c011e8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc782e7bc0 0x55fc782ef0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.191 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.171+0000 7f3c011e8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc782e7bc0 0x55fc782ef0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53642/0 (socket says 172.21.15.132:53642) 2024-05-08T18:52:33.191 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.171+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 learned_addr learned my addr 172.21.15.132:0/2261532770 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.171+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc782ef620 con 0x55fc782e7bc0 2024-05-08T18:52:33.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.171+0000 7f3c011e8640 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc782e7bc0 0x55fc782ef0e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc016c70 tx=0x7f3bfc052d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.171+0000 7f3ad67fc640 1 -- 172.21.15.132:0/2261532770 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bfc054240 con 0x55fc782e7bc0 2024-05-08T18:52:33.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.171+0000 7f3ad67fc640 1 -- 172.21.15.132:0/2261532770 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bfc031070 con 0x55fc782e7bc0 2024-05-08T18:52:33.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.171+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc782ef8b0 con 0x55fc782e7bc0 2024-05-08T18:52:33.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.171+0000 7f3ad67fc640 1 -- 172.21.15.132:0/2261532770 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bfc054510 con 0x55fc782e7bc0 2024-05-08T18:52:33.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.171+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc782f2560 con 0x55fc782e7bc0 2024-05-08T18:52:33.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.172+0000 7f3ad67fc640 1 -- 172.21.15.132:0/2261532770 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f3bfc046070 con 0x55fc782e7bc0 2024-05-08T18:52:33.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.172+0000 7f3ad67fc640 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f3acc03bba0 0x7f3acc03e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.172+0000 7f3ad67fc640 1 -- 172.21.15.132:0/2261532770 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f3bfc00e040 con 0x55fc782e7bc0 2024-05-08T18:52:33.192 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.172+0000 7f3c009e7640 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f3acc03bba0 0x7f3acc03e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.173+0000 7f3c009e7640 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f3acc03bba0 0x7f3acc03e060 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3bf005bfd0 tx=0x7f3bf0086000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.173+0000 7f3c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.173+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55fc782fadb0 0x55fc782fd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.173+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc782fd9c0 con 0x55fc782fadb0 2024-05-08T18:52:33.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.173+0000 7f3bf81e6640 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55fc782fadb0 0x55fc782fd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.173+0000 7f3bf81e6640 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55fc782fadb0 0x55fc782fd270 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.173+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3be800f5a0 con 0x55fc782fadb0 2024-05-08T18:52:33.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.173+0000 7f3c04d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.173+0000 7f3c04d1f800 20 realm 2024-05-08T18:52:33.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.173+0000 7f3c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.173+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc782fa200 con 0x55fc782fadb0 2024-05-08T18:52:33.193 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.174+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3be800f5a0 con 0x55fc782fadb0 2024-05-08T18:52:33.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.174+0000 7f3c04d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.174+0000 7f3c04d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:52:33.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.174+0000 7f3c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.174+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc782fe4b0 con 0x55fc782fadb0 2024-05-08T18:52:33.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.174+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3be800f5a0 con 0x55fc782fadb0 2024-05-08T18:52:33.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.174+0000 7f3c04d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.174+0000 7f3c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.174+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc782fed80 con 0x55fc782fadb0 2024-05-08T18:52:33.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.174+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3be800f5a0 con 0x55fc782fadb0 2024-05-08T18:52:33.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.174+0000 7f3c04d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:33.194 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.174+0000 7f3c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.174+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55fc782ff7a0 0x55fc78301b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.174+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc78302300 con 0x55fc782ff7a0 2024-05-08T18:52:33.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.174+0000 7f3c011e8640 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55fc782ff7a0 0x55fc78301b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.174+0000 7f3c011e8640 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55fc782ff7a0 0x55fc78301b90 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.175+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3bfc02a070 con 0x55fc782ff7a0 2024-05-08T18:52:33.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.175+0000 7f3c04d1f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:52:33.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.175+0000 7f3c04d1f800 20 searching for the correct realm 2024-05-08T18:52:33.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.175+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x55fc782ff7a0 2024-05-08T18:52:33.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.175+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bfc02a070 con 0x55fc782ff7a0 2024-05-08T18:52:33.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.175+0000 7f3c011e8640 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f3bfc048070 0x7f3bfc023a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.175+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x7f3bfc048070 2024-05-08T18:52:33.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.175+0000 7f3c009e7640 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f3bfc048070 0x7f3bfc023a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.176+0000 7f3c009e7640 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f3bfc048070 0x7f3bfc023a70 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.176+0000 7f3c009e7640 1 -- 172.21.15.132:0/2261532770 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf0078070 con 0x7f3bfc048070 2024-05-08T18:52:33.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.176+0000 7f3c009e7640 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f3bf0066380 0x7f3bf0093370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.176+0000 7f3c009e7640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x7f3bf0066380 2024-05-08T18:52:33.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.176+0000 7f3bf81e6640 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f3bf0066380 0x7f3bf0093370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.177+0000 7f3bf81e6640 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f3bf0066380 0x7f3bf0093370 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.177+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be800f5a0 con 0x7f3bf0066380 2024-05-08T18:52:33.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.177+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x55fc782fadb0 2024-05-08T18:52:33.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.177+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be800f5a0 con 0x55fc782fadb0 2024-05-08T18:52:33.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.177+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x55fc782fadb0 2024-05-08T18:52:33.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.177+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be802b040 con 0x55fc782fadb0 2024-05-08T18:52:33.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.177+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x7f3bf0066380 2024-05-08T18:52:33.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.178+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be802b040 con 0x7f3bf0066380 2024-05-08T18:52:33.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.178+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x7f3bf0066380 2024-05-08T18:52:33.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.178+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be802b040 con 0x7f3bf0066380 2024-05-08T18:52:33.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.178+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x7f3bfc048070 2024-05-08T18:52:33.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.178+0000 7f3c009e7640 1 -- 172.21.15.132:0/2261532770 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf0078070 con 0x7f3bfc048070 2024-05-08T18:52:33.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.178+0000 7f3c009e7640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x55fc782ff7a0 2024-05-08T18:52:33.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.178+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bfc02a070 con 0x55fc782ff7a0 2024-05-08T18:52:33.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.178+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x55fc782fadb0 2024-05-08T18:52:33.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.179+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be802b040 con 0x55fc782fadb0 2024-05-08T18:52:33.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.179+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x7f3bf0066380 2024-05-08T18:52:33.197 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.179+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be802b040 con 0x7f3bf0066380 2024-05-08T18:52:33.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.179+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x55fc782fadb0 2024-05-08T18:52:33.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.179+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3be802b040 con 0x55fc782fadb0 2024-05-08T18:52:33.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.179+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x7f3bfc048070 2024-05-08T18:52:33.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.179+0000 7f3c009e7640 1 -- 172.21.15.132:0/2261532770 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3bf0078070 con 0x7f3bfc048070 2024-05-08T18:52:33.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.179+0000 7f3c009e7640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x55fc782ff7a0 2024-05-08T18:52:33.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.180+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v27'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3bfc02a070 con 0x55fc782ff7a0 2024-05-08T18:52:33.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.180+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x55fc782ff7a0 2024-05-08T18:52:33.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.180+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bfc02a070 con 0x55fc782ff7a0 2024-05-08T18:52:33.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.180+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x7f3bf0066380 2024-05-08T18:52:33.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.180+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be802b040 con 0x7f3bf0066380 2024-05-08T18:52:33.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.180+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x55fc782ff7a0 2024-05-08T18:52:33.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.180+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bfc02a070 con 0x55fc782ff7a0 2024-05-08T18:52:33.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.180+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x55fc782ff7a0 2024-05-08T18:52:33.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.181+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bfc02a070 con 0x55fc782ff7a0 2024-05-08T18:52:33.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.181+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x55fc782fadb0 2024-05-08T18:52:33.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.181+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be802b040 con 0x55fc782fadb0 2024-05-08T18:52:33.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.181+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x55fc782fadb0 2024-05-08T18:52:33.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.181+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v27'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3be802b040 con 0x55fc782fadb0 2024-05-08T18:52:33.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.181+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x7f3bf0066380 2024-05-08T18:52:33.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.181+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be802b040 con 0x7f3bf0066380 2024-05-08T18:52:33.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.181+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x55fc782ff7a0 2024-05-08T18:52:33.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.182+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bfc02a070 con 0x55fc782ff7a0 2024-05-08T18:52:33.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.182+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x7f3bfc048070 2024-05-08T18:52:33.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.182+0000 7f3c009e7640 1 -- 172.21.15.132:0/2261532770 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf0078070 con 0x7f3bfc048070 2024-05-08T18:52:33.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.182+0000 7f3c009e7640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x55fc782fadb0 2024-05-08T18:52:33.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.182+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be802b040 con 0x55fc782fadb0 2024-05-08T18:52:33.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.182+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x7f3bfc048070 2024-05-08T18:52:33.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.182+0000 7f3c009e7640 1 -- 172.21.15.132:0/2261532770 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf0078070 con 0x7f3bfc048070 2024-05-08T18:52:33.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.182+0000 7f3c009e7640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x55fc782ff7a0 2024-05-08T18:52:33.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.183+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bfc02a070 con 0x55fc782ff7a0 2024-05-08T18:52:33.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.183+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x7f3bf0066380 2024-05-08T18:52:33.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.183+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be802b040 con 0x7f3bf0066380 2024-05-08T18:52:33.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.183+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x7f3bfc048070 2024-05-08T18:52:33.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.183+0000 7f3c009e7640 1 -- 172.21.15.132:0/2261532770 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf0078070 con 0x7f3bfc048070 2024-05-08T18:52:33.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.183+0000 7f3c009e7640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x55fc782ff7a0 2024-05-08T18:52:33.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.183+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bfc02a070 con 0x55fc782ff7a0 2024-05-08T18:52:33.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.183+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x7f3bf0066380 2024-05-08T18:52:33.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.184+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3be802b040 con 0x7f3bf0066380 2024-05-08T18:52:33.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.184+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x55fc782fadb0 2024-05-08T18:52:33.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.184+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v27'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3be802b040 con 0x55fc782fadb0 2024-05-08T18:52:33.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.184+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303c50 con 0x7f3bfc048070 2024-05-08T18:52:33.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.184+0000 7f3c009e7640 1 -- 172.21.15.132:0/2261532770 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3bf0078070 con 0x7f3bfc048070 2024-05-08T18:52:33.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.184+0000 7f3c04d1f800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:52:33.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.184+0000 7f3c04d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:52:33.201 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.184+0000 7f3c04d1f800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:52:33.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.184+0000 7f3c04d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:52:33.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.184+0000 7f3c04d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:52:33.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.184+0000 7f3c04d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:52:33.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.184+0000 7f3c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.184+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc78302cf0 con 0x55fc782fadb0 2024-05-08T18:52:33.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.184+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3be802b040 con 0x55fc782fadb0 2024-05-08T18:52:33.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.184+0000 7f3c04d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.184+0000 7f3c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.184+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc78303590 con 0x55fc782fadb0 2024-05-08T18:52:33.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.185+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3be802b040 con 0x55fc782fadb0 2024-05-08T18:52:33.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.185+0000 7f3c04d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:33.202 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.185+0000 7f3c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.185+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc783040d0 con 0x55fc782fadb0 2024-05-08T18:52:33.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.185+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3be802b040 con 0x55fc782fadb0 2024-05-08T18:52:33.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.185+0000 7f3c04d1f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:52:33.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.185+0000 7f3c04d1f800 20 zone default found 2024-05-08T18:52:33.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.185+0000 7f3c04d1f800 4 Realm: () 2024-05-08T18:52:33.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.185+0000 7f3c04d1f800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:52:33.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.185+0000 7f3c04d1f800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:52:33.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.185+0000 7f3c04d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:52:33.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.185+0000 7f3c04d1f800 20 zonegroup default 2024-05-08T18:52:33.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.185+0000 7f3c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.185+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc78304470 con 0x7f3bfc048070 2024-05-08T18:52:33.203 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.185+0000 7f3c009e7640 1 -- 172.21.15.132:0/2261532770 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3bf0078070 con 0x7f3bfc048070 2024-05-08T18:52:33.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.185+0000 7f3c04d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.185+0000 7f3c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.185+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc78306720 con 0x55fc782ff7a0 2024-05-08T18:52:33.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.185+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3bfc02a070 con 0x55fc782ff7a0 2024-05-08T18:52:33.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.185+0000 7f3c04d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.185+0000 7f3c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.185+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc78306ac0 con 0x55fc782ff7a0 2024-05-08T18:52:33.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.186+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3bfc02a070 con 0x55fc782ff7a0 2024-05-08T18:52:33.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.186+0000 7f3c04d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.186+0000 7f3c04d1f800 20 started sync module instance, tier type = 2024-05-08T18:52:33.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.186+0000 7f3c04d1f800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:52:33.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.186+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc78305b60 con 0x7f3bfc048070 2024-05-08T18:52:33.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.187+0000 7f3c009e7640 1 -- 172.21.15.132:0/2261532770 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf0078070 con 0x7f3bfc048070 2024-05-08T18:52:33.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.187+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94542836555648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc78306f70 con 0x7f3bfc048070 2024-05-08T18:52:33.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.187+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc783077c0 con 0x55fc782fadb0 2024-05-08T18:52:33.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.188+0000 7f3c009e7640 1 -- 172.21.15.132:0/2261532770 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94542836555648] v27'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf0078070 con 0x7f3bfc048070 2024-05-08T18:52:33.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.188+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be802b040 con 0x55fc782fadb0 2024-05-08T18:52:33.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.188+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94542836558528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc78307800 con 0x55fc782fadb0 2024-05-08T18:52:33.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.188+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc783082f0 con 0x55fc782ff7a0 2024-05-08T18:52:33.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.189+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94542836558528] v27'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be802b040 con 0x55fc782fadb0 2024-05-08T18:52:33.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.189+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bfc02a070 con 0x55fc782ff7a0 2024-05-08T18:52:33.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.189+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94542836563392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc783082b0 con 0x55fc782ff7a0 2024-05-08T18:52:33.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.189+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc78308d80 con 0x7f3bfc048070 2024-05-08T18:52:33.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.190+0000 7f3c009e7640 1 -- 172.21.15.132:0/2261532770 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf0078070 con 0x7f3bfc048070 2024-05-08T18:52:33.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.190+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94542836563392] v27'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bfc02a070 con 0x55fc782ff7a0 2024-05-08T18:52:33.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.190+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94542836560656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc78309120 con 0x7f3bfc048070 2024-05-08T18:52:33.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.190+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc78309ba0 con 0x55fc782fadb0 2024-05-08T18:52:33.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.191+0000 7f3c009e7640 1 -- 172.21.15.132:0/2261532770 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94542836560656] v27'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf0078070 con 0x7f3bfc048070 2024-05-08T18:52:33.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.191+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be802b040 con 0x55fc782fadb0 2024-05-08T18:52:33.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.191+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94542836569776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc78309ba0 con 0x55fc782fadb0 2024-05-08T18:52:33.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.191+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc7830a620 con 0x7f3bf0066380 2024-05-08T18:52:33.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.192+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94542836569776] v27'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be802b040 con 0x55fc782fadb0 2024-05-08T18:52:33.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.192+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be802b040 con 0x7f3bf0066380 2024-05-08T18:52:33.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.192+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94542836566080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc7830a5e0 con 0x7f3bf0066380 2024-05-08T18:52:33.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.192+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc7830b060 con 0x7f3bf0066380 2024-05-08T18:52:33.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.193+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94542836566080] v27'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be802b040 con 0x7f3bf0066380 2024-05-08T18:52:33.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.193+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be802b040 con 0x7f3bf0066380 2024-05-08T18:52:33.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.193+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94542836572976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc7830b060 con 0x7f3bf0066380 2024-05-08T18:52:33.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.193+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc7830ba60 con 0x7f3bf0066380 2024-05-08T18:52:33.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.194+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94542836572976] v27'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be802b040 con 0x7f3bf0066380 2024-05-08T18:52:33.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.195+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be802b040 con 0x7f3bf0066380 2024-05-08T18:52:33.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.195+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94542836577648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc7830bc40 con 0x7f3bf0066380 2024-05-08T18:52:33.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.195+0000 7f3c04d1f800 20 add_watcher() i=0 2024-05-08T18:52:33.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.195+0000 7f3c04d1f800 20 add_watcher() i=1 2024-05-08T18:52:33.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.195+0000 7f3c04d1f800 20 add_watcher() i=2 2024-05-08T18:52:33.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.195+0000 7f3c04d1f800 20 add_watcher() i=3 2024-05-08T18:52:33.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.195+0000 7f3c04d1f800 20 add_watcher() i=4 2024-05-08T18:52:33.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.195+0000 7f3c04d1f800 20 add_watcher() i=5 2024-05-08T18:52:33.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.195+0000 7f3c04d1f800 20 add_watcher() i=6 2024-05-08T18:52:33.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.196+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94542836577648] v27'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be802b040 con 0x7f3bf0066380 2024-05-08T18:52:33.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.196+0000 7f3c04d1f800 20 add_watcher() i=7 2024-05-08T18:52:33.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.196+0000 7f3c04d1f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:52:33.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.196+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc7830f010 con 0x55fc782fadb0 2024-05-08T18:52:33.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.196+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3be802b040 con 0x55fc782fadb0 2024-05-08T18:52:33.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.196+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94542836579120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc7830c400 con 0x55fc782fadb0 2024-05-08T18:52:33.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.197+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94542836579120] v27'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3be802b040 con 0x55fc782fadb0 2024-05-08T18:52:33.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.197+0000 7f3ab77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:33.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.197+0000 7f3c04d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:33.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.197+0000 7f3c04d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:33.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.197+0000 7f3c04d1f800 5 note: GC not initialized 2024-05-08T18:52:33.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.197+0000 7f3ab67e4640 20 reqs_thread_entry: start 2024-05-08T18:52:33.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.197+0000 7f3c04d1f800 20 init_complete bucket index max shards: 11 2024-05-08T18:52:33.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.198+0000 7f3c04d1f800 20 Filter name: none 2024-05-08T18:52:33.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.198+0000 7f3aaf7fe640 20 reqs_thread_entry: start 2024-05-08T18:52:33.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.198+0000 7f3c04d1f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:52:33.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.198+0000 7f3c04d1f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.198+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc783423c0 con 0x7f3bf0066380 2024-05-08T18:52:33.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.198+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f3be802b040 con 0x7f3bf0066380 2024-05-08T18:52:33.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.198+0000 7f3c04d1f800 20 rados_obj.operate() r=0 bl.length=490 2024-05-08T18:52:33.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.198+0000 7f3c04d1f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:52:33.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.198+0000 7f3c04d1f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:33.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.198+0000 7f3c04d1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:52:33.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.198+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc78348c60 con 0x7f3bf0066380 2024-05-08T18:52:33.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.200+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v27'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3be802b040 con 0x7f3bf0066380 2024-05-08T18:52:33.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.200+0000 7f3c04d1f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:52:33.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.200+0000 7f3c04d1f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:33.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.200+0000 7f3c04d1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:52:33.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.200+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94542836827680 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55fc78344240 con 0x55fc782fadb0 2024-05-08T18:52:33.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.200+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== watch-notify(notify (1) cookie 94542836569776 notify 115964117018 ret 0) ==== 721+0+0 (crc 0 0 0) 0x7f3be8018040 con 0x55fc782fadb0 2024-05-08T18:52:33.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.200+0000 7f3ad7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117018 cookie 94542836569776 notifier 4879 bl.length()=679 2024-05-08T18:52:33.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.200+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 notify.4 [notify cookie 94542836827680 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3be802b040 con 0x55fc782fadb0 2024-05-08T18:52:33.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.200+0000 7f3ad7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:52:33.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.200+0000 7f3ad7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:33.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.200+0000 7f3ad7fff640 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f3ac4003ea0 con 0x55fc782fadb0 2024-05-08T18:52:33.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.200+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be802b040 con 0x55fc782fadb0 2024-05-08T18:52:33.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.200+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== watch-notify(notify_complete (2) cookie 94542836827680 notify 115964117018 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3be802fb80 con 0x55fc782fadb0 2024-05-08T18:52:33.217 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:52:31.994053Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:52:31.994040Z","tags":[],"group_ids":[]} 2024-05-08T18:52:33.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.201+0000 7f3ab77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:33.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.201+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94542836579120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc78347250 con 0x55fc782fadb0 2024-05-08T18:52:33.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.202+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94542836579120] v27'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3be802b040 con 0x55fc782fadb0 2024-05-08T18:52:33.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.202+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94542836555648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc7830bb30 con 0x7f3bfc048070 2024-05-08T18:52:33.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.203+0000 7f3c009e7640 1 -- 172.21.15.132:0/2261532770 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94542836555648] v27'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf0078070 con 0x7f3bfc048070 2024-05-08T18:52:33.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.203+0000 7f3c04d1f800 20 remove_watcher() i=0 2024-05-08T18:52:33.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.203+0000 7f3c04d1f800 2 removed watcher, disabling cache 2024-05-08T18:52:33.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.203+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94542836558528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc7830bb30 con 0x55fc782fadb0 2024-05-08T18:52:33.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.205+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94542836558528] v27'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be802b040 con 0x55fc782fadb0 2024-05-08T18:52:33.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.205+0000 7f3c04d1f800 20 remove_watcher() i=1 2024-05-08T18:52:33.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.205+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94542836563392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc78306ac0 con 0x55fc782ff7a0 2024-05-08T18:52:33.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.206+0000 7f3c011e8640 1 -- 172.21.15.132:0/2261532770 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94542836563392] v27'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bfc02a070 con 0x55fc782ff7a0 2024-05-08T18:52:33.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.206+0000 7f3c04d1f800 20 remove_watcher() i=2 2024-05-08T18:52:33.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.206+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94542836560656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc7830bb30 con 0x7f3bfc048070 2024-05-08T18:52:33.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.207+0000 7f3c009e7640 1 -- 172.21.15.132:0/2261532770 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94542836560656] v27'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3bf0078070 con 0x7f3bfc048070 2024-05-08T18:52:33.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.207+0000 7f3c04d1f800 20 remove_watcher() i=3 2024-05-08T18:52:33.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.207+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94542836569776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc78306ac0 con 0x55fc782fadb0 2024-05-08T18:52:33.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.208+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94542836569776] v27'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be802b040 con 0x55fc782fadb0 2024-05-08T18:52:33.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.208+0000 7f3c04d1f800 20 remove_watcher() i=4 2024-05-08T18:52:33.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.208+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94542836566080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc78307310 con 0x7f3bf0066380 2024-05-08T18:52:33.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.209+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94542836566080] v27'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be802b040 con 0x7f3bf0066380 2024-05-08T18:52:33.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.209+0000 7f3c04d1f800 20 remove_watcher() i=5 2024-05-08T18:52:33.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.209+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94542836572976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc7830bb30 con 0x7f3bf0066380 2024-05-08T18:52:33.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.210+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94542836572976] v27'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be802b040 con 0x7f3bf0066380 2024-05-08T18:52:33.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.210+0000 7f3c04d1f800 20 remove_watcher() i=6 2024-05-08T18:52:33.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.210+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94542836577648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55fc7830bb30 con 0x7f3bf0066380 2024-05-08T18:52:33.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.211+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94542836577648] v27'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3be802b040 con 0x7f3bf0066380 2024-05-08T18:52:33.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.211+0000 7f3c04d1f800 20 remove_watcher() i=7 2024-05-08T18:52:33.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.211+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f3bf0066380 msgr2=0x7f3bf0093370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.225 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.211+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f3bf0066380 0x7f3bf0093370 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.211+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55fc782fadb0 msgr2=0x55fc782fd270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.211+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55fc782fadb0 0x55fc782fd270 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.211+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f3bfc048070 msgr2=0x7f3bfc023a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.211+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f3bfc048070 0x7f3bfc023a70 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.211+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55fc782ff7a0 msgr2=0x55fc78301b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.211+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55fc782ff7a0 0x55fc78301b90 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.211+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f3acc03bba0 msgr2=0x7f3acc03e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.211+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f3acc03bba0 0x7f3acc03e060 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3bf005bfd0 tx=0x7f3bf0086000 comp rx=0 tx=0).stop 2024-05-08T18:52:33.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc782e7bc0 msgr2=0x55fc782ef0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3bf81e6640 1 -- 172.21.15.132:0/2261532770 reap_dead start 2024-05-08T18:52:33.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc782e7bc0 0x55fc782ef0e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc016c70 tx=0x7f3bfc052d80 comp rx=0 tx=0).stop 2024-05-08T18:52:33.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 shutdown_connections 2024-05-08T18:52:33.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/2261532770 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc782e7bc0 0x55fc782ef0e0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 >> 172.21.15.132:0/2261532770 conn(0x55fc782e3ed0 msgr2=0x55fc782e1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 shutdown_connections 2024-05-08T18:52:33.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3c04d1f800 1 -- 172.21.15.132:0/2261532770 wait complete. 2024-05-08T18:52:33.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3107748033 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f3ad803bb50 msgr2=0x7f3ad803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/3107748033 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f3ad803bb50 0x7f3ad803e010 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3bf005cb40 tx=0x7f3bf007d040 comp rx=0 tx=0).stop 2024-05-08T18:52:33.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3107748033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc782da8e0 msgr2=0x55fc782dad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/3107748033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc782da8e0 0x55fc782dad00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x55fc782c6f40 tx=0x7f3bfc018830 comp rx=0 tx=0).stop 2024-05-08T18:52:33.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3107748033 shutdown_connections 2024-05-08T18:52:33.227 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/3107748033 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f3ad803bb50 0x7f3ad803e010 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/3107748033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc782da8e0 0x55fc782dad00 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.228 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3107748033 >> 172.21.15.132:0/3107748033 conn(0x55fc782ce980 msgr2=0x55fc782ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3107748033 shutdown_connections 2024-05-08T18:52:33.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3107748033 wait complete. 2024-05-08T18:52:33.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3725733291 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55fc781c6210 msgr2=0x55fc782c6620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/3725733291 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55fc781c6210 0x55fc782c6620 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3725733291 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55fc782c8ec0 msgr2=0x55fc782cb2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/3725733291 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55fc782c8ec0 0x55fc782cb2b0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.212+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3725733291 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f3ae803bba0 msgr2=0x7f3ae803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.213+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/3725733291 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f3ae803bba0 0x7f3ae803e060 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3be8000c00 tx=0x7f3be80013b0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.213+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3725733291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc781c58b0 msgr2=0x55fc782bf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.213+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/3725733291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc781c58b0 0x55fc782bf3e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000a470 tx=0x7f3bf0002fb0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.213+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3725733291 shutdown_connections 2024-05-08T18:52:33.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.213+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/3725733291 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x55fc782c8ec0 0x55fc782cb2b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.213+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/3725733291 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x55fc781c6210 0x55fc782c6620 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.213+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/3725733291 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f3ae803bba0 0x7f3ae803e060 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.213+0000 7f3c04d1f800 1 --2- 172.21.15.132:0/3725733291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55fc781c58b0 0x55fc782bf3e0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.213+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3725733291 >> 172.21.15.132:0/3725733291 conn(0x55fc781bdeb0 msgr2=0x55fc781c3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.213+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3725733291 shutdown_connections 2024-05-08T18:52:33.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.213+0000 7f3c04d1f800 1 -- 172.21.15.132:0/3725733291 wait complete. 2024-05-08T18:52:33.231 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:52:31.994053Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:31.994040Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:33.231 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:52:31.994053Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:31.994040Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:33.231 ERROR:root:0 2024-05-08T18:52:33.231 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:52:33.236 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:52:33.236 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-05-08T18:52:33.236 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-05-08T18:52:33.236 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-05-08T18:52:33.285 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:33.285 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:33.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.286+0000 7f607f81f800 1 Processor -- start 2024-05-08T18:52:33.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.286+0000 7f607f81f800 1 -- start start 2024-05-08T18:52:33.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.286+0000 7f607f81f800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x560859c6c150 0x560859c6c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.286+0000 7f607f81f800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560859c6cbf0 con 0x560859c6d3b0 2024-05-08T18:52:33.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.286+0000 7f607f81f800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x560859b0de20 con 0x560859c6c150 2024-05-08T18:52:33.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.286+0000 7f607d31e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x560859c6c150 0x560859c6c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.286+0000 7f6077fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x560859c6d3b0 0x560859c6d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48198/0 (socket says 172.21.15.132:48198) 2024-05-08T18:52:33.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.286+0000 7f6077fff640 1 -- 172.21.15.132:0/2238121032 learned_addr learned my addr 172.21.15.132:0/2238121032 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:52:33.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.287+0000 7f607d31e640 1 -- 172.21.15.132:0/2238121032 >> v1:172.21.15.42:6789/0 conn(0x560859c6d3b0 legacy=0x560859c6d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.287+0000 7f607cb1d640 1 -- 172.21.15.132:0/2238121032 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2781822347 0 0) 0x560859c6cbf0 con 0x560859c6d3b0 2024-05-08T18:52:33.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.287+0000 7f607d31e640 1 -- 172.21.15.132:0/2238121032 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560859c6df70 con 0x560859c6c150 2024-05-08T18:52:33.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.289+0000 7f607d31e640 1 --2- 172.21.15.132:0/2238121032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859c6c150 0x560859c6c570 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f607000a470 tx=0x7f607001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c7b97b69a98f0f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.289+0000 7f607cb1d640 1 -- 172.21.15.132:0/2238121032 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6070057070 con 0x560859c6c150 2024-05-08T18:52:33.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.289+0000 7f607cb1d640 1 -- 172.21.15.132:0/2238121032 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607004adc0 con 0x560859c6c150 2024-05-08T18:52:33.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.289+0000 7f607cb1d640 1 -- 172.21.15.132:0/2238121032 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6070052590 con 0x560859c6c150 2024-05-08T18:52:33.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.289+0000 7f607f81f800 1 -- 172.21.15.132:0/2238121032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859c6c150 msgr2=0x560859c6c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.289+0000 7f607f81f800 1 --2- 172.21.15.132:0/2238121032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859c6c150 0x560859c6c570 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f607000a470 tx=0x7f607001ce90 comp rx=0 tx=0).stop 2024-05-08T18:52:33.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.289+0000 7f607f81f800 1 -- 172.21.15.132:0/2238121032 shutdown_connections 2024-05-08T18:52:33.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.289+0000 7f607f81f800 1 --2- 172.21.15.132:0/2238121032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859c6c150 0x560859c6c570 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.289+0000 7f607f81f800 1 -- 172.21.15.132:0/2238121032 >> 172.21.15.132:0/2238121032 conn(0x560859c67730 msgr2=0x560859c69b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.289+0000 7f607f81f800 1 -- 172.21.15.132:0/2238121032 shutdown_connections 2024-05-08T18:52:33.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.289+0000 7f607f81f800 1 -- 172.21.15.132:0/2238121032 wait complete. 2024-05-08T18:52:33.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.303+0000 7f607f81f800 1 Processor -- start 2024-05-08T18:52:33.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.303+0000 7f607f81f800 1 -- start start 2024-05-08T18:52:33.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.303+0000 7f607f81f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859c6c150 0x560859be02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.303+0000 7f607f81f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560859bb85c0 con 0x560859c6c150 2024-05-08T18:52:33.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.304+0000 7f607d31e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859c6c150 0x560859be02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.304+0000 7f607d31e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859c6c150 0x560859be02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53660/0 (socket says 172.21.15.132:53660) 2024-05-08T18:52:33.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.304+0000 7f607d31e640 1 -- 172.21.15.132:0/395527258 learned_addr learned my addr 172.21.15.132:0/395527258 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.304+0000 7f607d31e640 1 -- 172.21.15.132:0/395527258 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560859d5f140 con 0x560859c6c150 2024-05-08T18:52:33.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.304+0000 7f607d31e640 1 --2- 172.21.15.132:0/395527258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859c6c150 0x560859be02d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f6070055040 tx=0x7f607004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2bfbaf0a818d5be server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.304+0000 7f5f6b606640 1 -- 172.21.15.132:0/395527258 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6070057040 con 0x560859c6c150 2024-05-08T18:52:33.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.304+0000 7f5f6b606640 1 -- 172.21.15.132:0/395527258 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6070063070 con 0x560859c6c150 2024-05-08T18:52:33.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.304+0000 7f5f6b606640 1 -- 172.21.15.132:0/395527258 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f607005d790 con 0x560859c6c150 2024-05-08T18:52:33.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.305+0000 7f607f81f800 1 -- 172.21.15.132:0/395527258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859c6c150 msgr2=0x560859be02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.305+0000 7f607f81f800 1 --2- 172.21.15.132:0/395527258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859c6c150 0x560859be02d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f6070055040 tx=0x7f607004c000 comp rx=0 tx=0).stop 2024-05-08T18:52:33.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.305+0000 7f607f81f800 1 -- 172.21.15.132:0/395527258 shutdown_connections 2024-05-08T18:52:33.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.305+0000 7f607f81f800 1 --2- 172.21.15.132:0/395527258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859c6c150 0x560859be02d0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.305+0000 7f607f81f800 1 -- 172.21.15.132:0/395527258 >> 172.21.15.132:0/395527258 conn(0x560859c67730 msgr2=0x560859d58e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.305+0000 7f607f81f800 1 -- 172.21.15.132:0/395527258 shutdown_connections 2024-05-08T18:52:33.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.305+0000 7f607f81f800 1 -- 172.21.15.132:0/395527258 wait complete. 2024-05-08T18:52:33.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.305+0000 7f607f81f800 1 Processor -- start 2024-05-08T18:52:33.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.306+0000 7f607f81f800 1 -- start start 2024-05-08T18:52:33.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.306+0000 7f607f81f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859c6c150 0x560859d68280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.306+0000 7f607f81f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560859c75880 con 0x560859c6c150 2024-05-08T18:52:33.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.306+0000 7f607d31e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859c6c150 0x560859d68280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.306+0000 7f607d31e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859c6c150 0x560859d68280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53668/0 (socket says 172.21.15.132:53668) 2024-05-08T18:52:33.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.306+0000 7f607d31e640 1 -- 172.21.15.132:0/1421537147 learned_addr learned my addr 172.21.15.132:0/1421537147 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.306+0000 7f607d31e640 1 -- 172.21.15.132:0/1421537147 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560859d687c0 con 0x560859c6c150 2024-05-08T18:52:33.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.307+0000 7f607d31e640 1 --2- 172.21.15.132:0/1421537147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859c6c150 0x560859d68280 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f6070060040 tx=0x7f6070002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.307+0000 7f5f69e03640 1 -- 172.21.15.132:0/1421537147 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6070057050 con 0x560859c6c150 2024-05-08T18:52:33.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.307+0000 7f5f69e03640 1 -- 172.21.15.132:0/1421537147 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f607005dcd0 con 0x560859c6c150 2024-05-08T18:52:33.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.307+0000 7f607f81f800 1 -- 172.21.15.132:0/1421537147 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560859d68a50 con 0x560859c6c150 2024-05-08T18:52:33.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.307+0000 7f5f69e03640 1 -- 172.21.15.132:0/1421537147 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6070052440 con 0x560859c6c150 2024-05-08T18:52:33.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.307+0000 7f607f81f800 1 -- 172.21.15.132:0/1421537147 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560859d6b700 con 0x560859c6c150 2024-05-08T18:52:33.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.308+0000 7f5f69e03640 1 -- 172.21.15.132:0/1421537147 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6070052600 con 0x560859c6c150 2024-05-08T18:52:33.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.308+0000 7f5f69e03640 1 --2- 172.21.15.132:0/1421537147 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5f6403bba0 0x7f5f6403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.308+0000 7f5f69e03640 1 -- 172.21.15.132:0/1421537147 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f6070093fc0 con 0x560859c6c150 2024-05-08T18:52:33.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.308+0000 7f6077fff640 1 --2- 172.21.15.132:0/1421537147 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5f6403bba0 0x7f5f6403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.308+0000 7f607f81f800 1 --2- 172.21.15.132:0/1421537147 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x560859c6d3b0 0x560859d6f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.308+0000 7f607f81f800 1 -- 172.21.15.132:0/1421537147 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560859d6fa00 con 0x560859c6d3b0 2024-05-08T18:52:33.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.308+0000 7f607db1f640 1 --2- 172.21.15.132:0/1421537147 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x560859c6d3b0 0x560859d6f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.308+0000 7f6077fff640 1 --2- 172.21.15.132:0/1421537147 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5f6403bba0 0x7f5f6403e060 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6068000c00 tx=0x7f60680013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.309+0000 7f607db1f640 1 --2- 172.21.15.132:0/1421537147 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x560859c6d3b0 0x560859d6f4c0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.309+0000 7f607db1f640 1 -- 172.21.15.132:0/1421537147 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f607800a4a0 con 0x560859c6d3b0 2024-05-08T18:52:33.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.309+0000 7f607f81f800 1 -- 172.21.15.132:0/1421537147 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560859d6ca70 con 0x560859c6d3b0 2024-05-08T18:52:33.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.309+0000 7f607db1f640 1 -- 172.21.15.132:0/1421537147 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f607800a4a0 con 0x560859c6d3b0 2024-05-08T18:52:33.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.309+0000 7f607f81f800 1 --2- 172.21.15.132:0/1421537147 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x560859d71cf0 0x560859d740e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.309+0000 7f607f81f800 1 -- 172.21.15.132:0/1421537147 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560859d747b0 con 0x560859d71cf0 2024-05-08T18:52:33.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.309+0000 7f607d31e640 1 --2- 172.21.15.132:0/1421537147 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x560859d71cf0 0x560859d740e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.310+0000 7f607d31e640 1 --2- 172.21.15.132:0/1421537147 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x560859d71cf0 0x560859d740e0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.310+0000 7f607d31e640 1 -- 172.21.15.132:0/1421537147 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6070078070 con 0x560859d71cf0 2024-05-08T18:52:33.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.310+0000 7f607f81f800 1 -- 172.21.15.132:0/1421537147 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560859d70b90 con 0x560859c6d3b0 2024-05-08T18:52:33.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.310+0000 7f607db1f640 1 -- 172.21.15.132:0/1421537147 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f607800a4a0 con 0x560859c6d3b0 2024-05-08T18:52:33.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.310+0000 7f607f81f800 1 -- 172.21.15.132:0/1421537147 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560859d71030 con 0x560859c6d3b0 2024-05-08T18:52:33.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.311+0000 7f607db1f640 1 -- 172.21.15.132:0/1421537147 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f607800a4a0 con 0x560859c6d3b0 2024-05-08T18:52:33.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.311+0000 7f607f81f800 1 Processor -- start 2024-05-08T18:52:33.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.311+0000 7f607f81f800 1 -- start start 2024-05-08T18:52:33.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.311+0000 7f607f81f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859d83710 0x560859d83b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.311+0000 7f607f81f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560859b5efc0 con 0x560859d83710 2024-05-08T18:52:33.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.311+0000 7f607db1f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859d83710 0x560859d83b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.311+0000 7f607db1f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859d83710 0x560859d83b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53670/0 (socket says 172.21.15.132:53670) 2024-05-08T18:52:33.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.311+0000 7f607db1f640 1 -- 172.21.15.132:0/2990733478 learned_addr learned my addr 172.21.15.132:0/2990733478 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.312+0000 7f607db1f640 1 -- 172.21.15.132:0/2990733478 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560859d84070 con 0x560859d83710 2024-05-08T18:52:33.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.312+0000 7f607db1f640 1 --2- 172.21.15.132:0/2990733478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859d83710 0x560859d83b30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x560859d6fdc0 tx=0x7f6078018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.312+0000 7f5f62ffd640 1 -- 172.21.15.132:0/2990733478 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6078014450 con 0x560859d83710 2024-05-08T18:52:33.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.312+0000 7f5f62ffd640 1 -- 172.21.15.132:0/2990733478 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60780145f0 con 0x560859d83710 2024-05-08T18:52:33.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.312+0000 7f607f81f800 1 -- 172.21.15.132:0/2990733478 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560859d84ae0 con 0x560859d83710 2024-05-08T18:52:33.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.312+0000 7f5f62ffd640 1 -- 172.21.15.132:0/2990733478 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6078014910 con 0x560859d83710 2024-05-08T18:52:33.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.312+0000 7f607f81f800 1 -- 172.21.15.132:0/2990733478 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560859d84fe0 con 0x560859d83710 2024-05-08T18:52:33.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.313+0000 7f5f62ffd640 1 -- 172.21.15.132:0/2990733478 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6078011040 con 0x560859d83710 2024-05-08T18:52:33.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.313+0000 7f5f62ffd640 1 --2- 172.21.15.132:0/2990733478 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5f5403bb50 0x7f5f5403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.313+0000 7f5f62ffd640 1 -- 172.21.15.132:0/2990733478 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f607801e070 con 0x560859d83710 2024-05-08T18:52:33.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.313+0000 7f607d31e640 1 --2- 172.21.15.132:0/2990733478 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5f5403bb50 0x7f5f5403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.313+0000 7f607f81f800 1 Processor -- start 2024-05-08T18:52:33.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.314+0000 7f607d31e640 1 --2- 172.21.15.132:0/2990733478 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5f5403bb50 0x7f5f5403e010 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x560859d6fe60 tx=0x7f6070092330 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.314+0000 7f607f81f800 1 -- start start 2024-05-08T18:52:33.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.314+0000 7f607f81f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859d90a10 0x560859d90e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.314+0000 7f607f81f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560859d63810 con 0x560859d90a10 2024-05-08T18:52:33.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.314+0000 7f607db1f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859d90a10 0x560859d90e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.314+0000 7f607db1f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859d90a10 0x560859d90e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53678/0 (socket says 172.21.15.132:53678) 2024-05-08T18:52:33.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.314+0000 7f607db1f640 1 -- 172.21.15.132:0/2097761575 learned_addr learned my addr 172.21.15.132:0/2097761575 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.314+0000 7f607db1f640 1 -- 172.21.15.132:0/2097761575 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560859d91400 con 0x560859d90a10 2024-05-08T18:52:33.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.314+0000 7f607db1f640 1 --2- 172.21.15.132:0/2097761575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859d90a10 0x560859d90e30 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f607802bfb0 tx=0x7f6078011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d3ba90d5ac21c39 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.315+0000 7f5f60ff9640 1 -- 172.21.15.132:0/2097761575 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6078016440 con 0x560859d90a10 2024-05-08T18:52:33.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.315+0000 7f5f60ff9640 1 -- 172.21.15.132:0/2097761575 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6078011330 con 0x560859d90a10 2024-05-08T18:52:33.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.315+0000 7f5f60ff9640 1 -- 172.21.15.132:0/2097761575 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60780165e0 con 0x560859d90a10 2024-05-08T18:52:33.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.315+0000 7f607f81f800 1 -- 172.21.15.132:0/2097761575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859d90a10 msgr2=0x560859d90e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.315+0000 7f607f81f800 1 --2- 172.21.15.132:0/2097761575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859d90a10 0x560859d90e30 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f607802bfb0 tx=0x7f6078011a80 comp rx=0 tx=0).stop 2024-05-08T18:52:33.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.315+0000 7f607f81f800 1 -- 172.21.15.132:0/2097761575 shutdown_connections 2024-05-08T18:52:33.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.315+0000 7f607f81f800 1 --2- 172.21.15.132:0/2097761575 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859d90a10 0x560859d90e30 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.315+0000 7f607f81f800 1 -- 172.21.15.132:0/2097761575 >> 172.21.15.132:0/2097761575 conn(0x560859d8cd20 msgr2=0x560859d8add0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.315+0000 7f607f81f800 1 -- 172.21.15.132:0/2097761575 shutdown_connections 2024-05-08T18:52:33.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.315+0000 7f607f81f800 1 -- 172.21.15.132:0/2097761575 wait complete. 2024-05-08T18:52:33.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.315+0000 7f607f81f800 1 Processor -- start 2024-05-08T18:52:33.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.315+0000 7f607f81f800 1 -- start start 2024-05-08T18:52:33.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.316+0000 7f607f81f800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859d90a10 0x560859d97f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.316+0000 7f607f81f800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x560859d91bd0 con 0x560859d90a10 2024-05-08T18:52:33.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.316+0000 7f607db1f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859d90a10 0x560859d97f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.316+0000 7f607db1f640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859d90a10 0x560859d97f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53694/0 (socket says 172.21.15.132:53694) 2024-05-08T18:52:33.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.316+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 learned_addr learned my addr 172.21.15.132:0/451362705 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.316+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560859d98490 con 0x560859d90a10 2024-05-08T18:52:33.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.316+0000 7f607db1f640 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859d90a10 0x560859d97f50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f6078052c20 tx=0x7f6078052c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.316+0000 7f5f52ffd640 1 -- 172.21.15.132:0/451362705 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60780542a0 con 0x560859d90a10 2024-05-08T18:52:33.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.316+0000 7f5f52ffd640 1 -- 172.21.15.132:0/451362705 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6078054440 con 0x560859d90a10 2024-05-08T18:52:33.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.316+0000 7f5f52ffd640 1 -- 172.21.15.132:0/451362705 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6078001770 con 0x560859d90a10 2024-05-08T18:52:33.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.316+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560859d98720 con 0x560859d90a10 2024-05-08T18:52:33.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.316+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560859d9b3d0 con 0x560859d90a10 2024-05-08T18:52:33.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.317+0000 7f5f52ffd640 1 -- 172.21.15.132:0/451362705 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6078001910 con 0x560859d90a10 2024-05-08T18:52:33.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.317+0000 7f5f52ffd640 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5f4803bba0 0x7f5f4803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.317+0000 7f5f52ffd640 1 -- 172.21.15.132:0/451362705 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f607800e040 con 0x560859d90a10 2024-05-08T18:52:33.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.317+0000 7f607d31e640 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5f4803bba0 0x7f5f4803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.318+0000 7f607d31e640 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5f4803bba0 0x7f5f4803e060 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f60700926c0 tx=0x7f6070083000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.318+0000 7f607f81f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.318+0000 7f607f81f800 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x560859da3bc0 0x560859da6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.318+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560859da67d0 con 0x560859da3bc0 2024-05-08T18:52:33.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.318+0000 7f6077fff640 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x560859da3bc0 0x560859da6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.318+0000 7f6077fff640 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x560859da3bc0 0x560859da6080 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.319+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f606800f5f0 con 0x560859da3bc0 2024-05-08T18:52:33.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.319+0000 7f607f81f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.319+0000 7f607f81f800 20 realm 2024-05-08T18:52:33.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.319+0000 7f607f81f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.319+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560859da3010 con 0x560859da3bc0 2024-05-08T18:52:33.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.319+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f606800f5f0 con 0x560859da3bc0 2024-05-08T18:52:33.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.319+0000 7f607f81f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.319+0000 7f607f81f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:52:33.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.319+0000 7f607f81f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.319+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560859da72c0 con 0x560859da3bc0 2024-05-08T18:52:33.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.319+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f606800f5f0 con 0x560859da3bc0 2024-05-08T18:52:33.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.319+0000 7f607f81f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.319+0000 7f607f81f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.319+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560859da7b90 con 0x560859da3bc0 2024-05-08T18:52:33.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.319+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f606800f5f0 con 0x560859da3bc0 2024-05-08T18:52:33.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.319+0000 7f607f81f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:33.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.319+0000 7f607f81f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.319+0000 7f607f81f800 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x560859da85b0 0x560859daa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.319+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560859dab110 con 0x560859da85b0 2024-05-08T18:52:33.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.320+0000 7f607db1f640 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x560859da85b0 0x560859daa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.320+0000 7f607db1f640 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x560859da85b0 0x560859daa9a0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.320+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f607805d040 con 0x560859da85b0 2024-05-08T18:52:33.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.320+0000 7f607f81f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:52:33.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.320+0000 7f607f81f800 20 searching for the correct realm 2024-05-08T18:52:33.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.320+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x560859da85b0 2024-05-08T18:52:33.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.321+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607805d040 con 0x560859da85b0 2024-05-08T18:52:33.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.321+0000 7f607db1f640 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6078014070 0x7f6078054a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.321+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x7f6078014070 2024-05-08T18:52:33.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.321+0000 7f607d31e640 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6078014070 0x7f6078054a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.321+0000 7f607d31e640 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6078014070 0x7f6078054a00 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.321+0000 7f607d31e640 1 -- 172.21.15.132:0/451362705 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6070092070 con 0x7f6078014070 2024-05-08T18:52:33.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.321+0000 7f607d31e640 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f6070099040 0x7f607005b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.321+0000 7f607d31e640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x7f6070099040 2024-05-08T18:52:33.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.321+0000 7f6077fff640 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f6070099040 0x7f607005b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.322+0000 7f6077fff640 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f6070099040 0x7f607005b370 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.322+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606800f5f0 con 0x7f6070099040 2024-05-08T18:52:33.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.322+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x560859da3bc0 2024-05-08T18:52:33.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.322+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606800f5f0 con 0x560859da3bc0 2024-05-08T18:52:33.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.322+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x560859da3bc0 2024-05-08T18:52:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.323+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606802b040 con 0x560859da3bc0 2024-05-08T18:52:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.323+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x7f6070099040 2024-05-08T18:52:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.323+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606802b040 con 0x7f6070099040 2024-05-08T18:52:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.323+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x7f6070099040 2024-05-08T18:52:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.323+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606802b040 con 0x7f6070099040 2024-05-08T18:52:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.323+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x7f6078014070 2024-05-08T18:52:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.323+0000 7f607d31e640 1 -- 172.21.15.132:0/451362705 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6070092070 con 0x7f6078014070 2024-05-08T18:52:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.323+0000 7f607d31e640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x560859da85b0 2024-05-08T18:52:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.324+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607805d040 con 0x560859da85b0 2024-05-08T18:52:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.324+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x560859da3bc0 2024-05-08T18:52:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.324+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606802b040 con 0x560859da3bc0 2024-05-08T18:52:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.324+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x7f6070099040 2024-05-08T18:52:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.324+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606802b040 con 0x7f6070099040 2024-05-08T18:52:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.324+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x560859da3bc0 2024-05-08T18:52:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.324+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f606802b040 con 0x560859da3bc0 2024-05-08T18:52:33.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.324+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x7f6078014070 2024-05-08T18:52:33.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.325+0000 7f607d31e640 1 -- 172.21.15.132:0/451362705 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6070092070 con 0x7f6078014070 2024-05-08T18:52:33.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.325+0000 7f607d31e640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x560859da85b0 2024-05-08T18:52:33.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.325+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v27'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f607805d040 con 0x560859da85b0 2024-05-08T18:52:33.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.325+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x560859da85b0 2024-05-08T18:52:33.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.325+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607805d040 con 0x560859da85b0 2024-05-08T18:52:33.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.325+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x7f6070099040 2024-05-08T18:52:33.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.325+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606802b040 con 0x7f6070099040 2024-05-08T18:52:33.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.326+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x560859da85b0 2024-05-08T18:52:33.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.326+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607805d040 con 0x560859da85b0 2024-05-08T18:52:33.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.326+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x560859da85b0 2024-05-08T18:52:33.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.326+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607805d040 con 0x560859da85b0 2024-05-08T18:52:33.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.326+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x560859da3bc0 2024-05-08T18:52:33.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.326+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606802b040 con 0x560859da3bc0 2024-05-08T18:52:33.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.326+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x560859da3bc0 2024-05-08T18:52:33.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.326+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v27'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f606802b040 con 0x560859da3bc0 2024-05-08T18:52:33.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.326+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x7f6070099040 2024-05-08T18:52:33.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.327+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606802b040 con 0x7f6070099040 2024-05-08T18:52:33.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.327+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x560859da85b0 2024-05-08T18:52:33.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.327+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607806d040 con 0x560859da85b0 2024-05-08T18:52:33.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.327+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x7f6078014070 2024-05-08T18:52:33.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.327+0000 7f607d31e640 1 -- 172.21.15.132:0/451362705 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6070092070 con 0x7f6078014070 2024-05-08T18:52:33.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.327+0000 7f607d31e640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x560859da3bc0 2024-05-08T18:52:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.327+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606802b040 con 0x560859da3bc0 2024-05-08T18:52:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.327+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x7f6078014070 2024-05-08T18:52:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.328+0000 7f607d31e640 1 -- 172.21.15.132:0/451362705 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6070092070 con 0x7f6078014070 2024-05-08T18:52:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.328+0000 7f607d31e640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x560859da85b0 2024-05-08T18:52:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.328+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607806d040 con 0x560859da85b0 2024-05-08T18:52:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.328+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x7f6070099040 2024-05-08T18:52:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.328+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606802b040 con 0x7f6070099040 2024-05-08T18:52:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.328+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x7f6078014070 2024-05-08T18:52:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.328+0000 7f607d31e640 1 -- 172.21.15.132:0/451362705 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6070092070 con 0x7f6078014070 2024-05-08T18:52:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.328+0000 7f607d31e640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x560859da85b0 2024-05-08T18:52:33.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.329+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f607806d040 con 0x560859da85b0 2024-05-08T18:52:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.329+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x7f6070099040 2024-05-08T18:52:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.329+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f606802b040 con 0x7f6070099040 2024-05-08T18:52:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.329+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x560859da3bc0 2024-05-08T18:52:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.329+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v27'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f606802b040 con 0x560859da3bc0 2024-05-08T18:52:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.329+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560859daca60 con 0x7f6078014070 2024-05-08T18:52:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607d31e640 1 -- 172.21.15.132:0/451362705 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6070092070 con 0x7f6078014070 2024-05-08T18:52:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:52:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:52:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:52:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:52:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:52:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:52:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560859dabad0 con 0x560859da3bc0 2024-05-08T18:52:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f606802b040 con 0x560859da3bc0 2024-05-08T18:52:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560859dac370 con 0x560859da3bc0 2024-05-08T18:52:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f606802b040 con 0x560859da3bc0 2024-05-08T18:52:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560859dacee0 con 0x560859da3bc0 2024-05-08T18:52:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f606802b040 con 0x560859da3bc0 2024-05-08T18:52:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:52:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 20 zone default found 2024-05-08T18:52:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 4 Realm: () 2024-05-08T18:52:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:52:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:52:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:52:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 20 zonegroup default 2024-05-08T18:52:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.330+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560859dad280 con 0x7f6078014070 2024-05-08T18:52:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.331+0000 7f607d31e640 1 -- 172.21.15.132:0/451362705 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6070092070 con 0x7f6078014070 2024-05-08T18:52:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.331+0000 7f607f81f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.331+0000 7f607f81f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.331+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560859daf530 con 0x560859da85b0 2024-05-08T18:52:33.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.331+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f607806d040 con 0x560859da85b0 2024-05-08T18:52:33.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.331+0000 7f607f81f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.331+0000 7f607f81f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.331+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560859daf8d0 con 0x560859da85b0 2024-05-08T18:52:33.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.331+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f607806d040 con 0x560859da85b0 2024-05-08T18:52:33.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.331+0000 7f607f81f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.331+0000 7f607f81f800 20 started sync module instance, tier type = 2024-05-08T18:52:33.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.331+0000 7f607f81f800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:52:33.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.331+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859dae9c0 con 0x7f6078014070 2024-05-08T18:52:33.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.332+0000 7f607d31e640 1 -- 172.21.15.132:0/451362705 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6070092070 con 0x7f6078014070 2024-05-08T18:52:33.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.332+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94593867247072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859db0120 con 0x7f6078014070 2024-05-08T18:52:33.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.332+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859db0970 con 0x560859da3bc0 2024-05-08T18:52:33.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.333+0000 7f607d31e640 1 -- 172.21.15.132:0/451362705 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94593867247072] v27'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6070092070 con 0x7f6078014070 2024-05-08T18:52:33.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.334+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606802b040 con 0x560859da3bc0 2024-05-08T18:52:33.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.334+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94593867250800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859db0a10 con 0x560859da3bc0 2024-05-08T18:52:33.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.334+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859db1510 con 0x560859da85b0 2024-05-08T18:52:33.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.335+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94593867250800] v27'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606802b040 con 0x560859da3bc0 2024-05-08T18:52:33.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.335+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607806d040 con 0x560859da85b0 2024-05-08T18:52:33.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.335+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94593867255808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859db14d0 con 0x560859da85b0 2024-05-08T18:52:33.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.335+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859db1f90 con 0x7f6078014070 2024-05-08T18:52:33.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.336+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94593867255808] v27'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607806d040 con 0x560859da85b0 2024-05-08T18:52:33.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.336+0000 7f607d31e640 1 -- 172.21.15.132:0/451362705 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6070092070 con 0x7f6078014070 2024-05-08T18:52:33.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.336+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94593867252928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859db2380 con 0x7f6078014070 2024-05-08T18:52:33.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.336+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859db2de0 con 0x560859da3bc0 2024-05-08T18:52:33.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.337+0000 7f607d31e640 1 -- 172.21.15.132:0/451362705 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94593867252928] v27'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6070092070 con 0x7f6078014070 2024-05-08T18:52:33.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.338+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606802b040 con 0x560859da3bc0 2024-05-08T18:52:33.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.338+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94593867258528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859db2da0 con 0x560859da3bc0 2024-05-08T18:52:33.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.338+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859db3820 con 0x7f6070099040 2024-05-08T18:52:33.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.339+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94593867258528] v27'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606802b040 con 0x560859da3bc0 2024-05-08T18:52:33.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.339+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606802b040 con 0x7f6070099040 2024-05-08T18:52:33.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.339+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94593867264816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859db2da0 con 0x7f6070099040 2024-05-08T18:52:33.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.339+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859db42a0 con 0x7f6070099040 2024-05-08T18:52:33.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.340+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(56 notify.6 [create] v27'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606802b040 con 0x7f6070099040 2024-05-08T18:52:33.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.340+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94593867267504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859db46c0 con 0x7f6070099040 2024-05-08T18:52:33.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.340+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859db51c0 con 0x7f6070099040 2024-05-08T18:52:33.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.340+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94593867264816] v27'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606802b040 con 0x7f6070099040 2024-05-08T18:52:33.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.341+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94593867267504] v27'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606802b040 con 0x7f6070099040 2024-05-08T18:52:33.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.341+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606802b040 con 0x7f6070099040 2024-05-08T18:52:33.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.341+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94593867271344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859db41d0 con 0x7f6070099040 2024-05-08T18:52:33.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.341+0000 7f607f81f800 20 add_watcher() i=0 2024-05-08T18:52:33.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.341+0000 7f607f81f800 20 add_watcher() i=1 2024-05-08T18:52:33.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.341+0000 7f607f81f800 20 add_watcher() i=2 2024-05-08T18:52:33.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.341+0000 7f607f81f800 20 add_watcher() i=3 2024-05-08T18:52:33.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.341+0000 7f607f81f800 20 add_watcher() i=4 2024-05-08T18:52:33.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.341+0000 7f607f81f800 20 add_watcher() i=5 2024-05-08T18:52:33.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.341+0000 7f607f81f800 20 add_watcher() i=6 2024-05-08T18:52:33.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.342+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94593867271344] v27'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606802b040 con 0x7f6070099040 2024-05-08T18:52:33.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.342+0000 7f607f81f800 20 add_watcher() i=7 2024-05-08T18:52:33.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.342+0000 7f607f81f800 2 all 8 watchers are set, enabling cache 2024-05-08T18:52:33.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.342+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560859db81b0 con 0x560859da3bc0 2024-05-08T18:52:33.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.342+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f606802b040 con 0x560859da3bc0 2024-05-08T18:52:33.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.342+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94593867262192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859db5630 con 0x560859da3bc0 2024-05-08T18:52:33.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.343+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94593867262192] v27'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f606802b040 con 0x560859da3bc0 2024-05-08T18:52:33.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.343+0000 7f5f337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:33.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.343+0000 7f607f81f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:33.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.343+0000 7f607f81f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:33.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.344+0000 7f607f81f800 5 note: GC not initialized 2024-05-08T18:52:33.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.344+0000 7f5f327e4640 20 reqs_thread_entry: start 2024-05-08T18:52:33.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.344+0000 7f607f81f800 20 init_complete bucket index max shards: 11 2024-05-08T18:52:33.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.344+0000 7f607f81f800 20 Filter name: none 2024-05-08T18:52:33.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.344+0000 7f5ea3fff640 20 reqs_thread_entry: start 2024-05-08T18:52:33.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.344+0000 7f607f81f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:52:33.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.344+0000 7f607f81f800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.344+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560859deb660 con 0x7f6070099040 2024-05-08T18:52:33.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.345+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f606802b040 con 0x7f6070099040 2024-05-08T18:52:33.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.345+0000 7f607f81f800 20 rados_obj.operate() r=0 bl.length=503 2024-05-08T18:52:33.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.345+0000 7f607f81f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:52:33.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.345+0000 7f607f81f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:33.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.345+0000 7f607f81f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:52:33.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.345+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859df1f10 con 0x7f6070099040 2024-05-08T18:52:33.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.346+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v27'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f606802b040 con 0x7f6070099040 2024-05-08T18:52:33.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.346+0000 7f607f81f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:52:33.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.346+0000 7f607f81f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:33.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.346+0000 7f607f81f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:52:33.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.346+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94593867520208 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560859ded590 con 0x560859da3bc0 2024-05-08T18:52:33.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.346+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== watch-notify(notify (1) cookie 94593867258528 notify 115964117019 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f6068018040 con 0x560859da3bc0 2024-05-08T18:52:33.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.346+0000 7f5f60ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117019 cookie 94593867258528 notifier 4886 bl.length()=636 2024-05-08T18:52:33.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.346+0000 7f5f60ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:52:33.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.346+0000 7f5f60ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:33.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.346+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 notify.4 [notify cookie 94593867520208 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f606802b040 con 0x560859da3bc0 2024-05-08T18:52:33.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.346+0000 7f5f60ff9640 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f5f40003ea0 con 0x560859da3bc0 2024-05-08T18:52:33.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.347+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606802b040 con 0x560859da3bc0 2024-05-08T18:52:33.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.347+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== watch-notify(notify_complete (2) cookie 94593867520208 notify 115964117019 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f606802fc40 con 0x560859da3bc0 2024-05-08T18:52:33.363 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:52:31.994053Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:52:31.994040Z","tags":[],"group_ids":[]} 2024-05-08T18:52:33.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.348+0000 7f5f337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:33.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.348+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94593867262192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859df09b0 con 0x560859da3bc0 2024-05-08T18:52:33.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.349+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94593867262192] v27'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f606802b040 con 0x560859da3bc0 2024-05-08T18:52:33.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.349+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94593867247072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859db28f0 con 0x7f6078014070 2024-05-08T18:52:33.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.350+0000 7f607d31e640 1 -- 172.21.15.132:0/451362705 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94593867247072] v27'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6070092070 con 0x7f6078014070 2024-05-08T18:52:33.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.350+0000 7f607f81f800 20 remove_watcher() i=0 2024-05-08T18:52:33.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.350+0000 7f607f81f800 2 removed watcher, disabling cache 2024-05-08T18:52:33.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.350+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94593867250800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859db28f0 con 0x560859da3bc0 2024-05-08T18:52:33.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.351+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94593867250800] v27'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606802b040 con 0x560859da3bc0 2024-05-08T18:52:33.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.351+0000 7f607f81f800 20 remove_watcher() i=1 2024-05-08T18:52:33.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.351+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94593867255808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859dafc70 con 0x560859da85b0 2024-05-08T18:52:33.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.352+0000 7f607db1f640 1 -- 172.21.15.132:0/451362705 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94593867255808] v27'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f607806d040 con 0x560859da85b0 2024-05-08T18:52:33.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.352+0000 7f607f81f800 20 remove_watcher() i=2 2024-05-08T18:52:33.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.352+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94593867252928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859db28f0 con 0x7f6078014070 2024-05-08T18:52:33.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.353+0000 7f607d31e640 1 -- 172.21.15.132:0/451362705 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94593867252928] v27'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6070092070 con 0x7f6078014070 2024-05-08T18:52:33.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.353+0000 7f607f81f800 20 remove_watcher() i=3 2024-05-08T18:52:33.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.353+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94593867258528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859db1000 con 0x560859da3bc0 2024-05-08T18:52:33.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.354+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94593867258528] v27'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606802b040 con 0x560859da3bc0 2024-05-08T18:52:33.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.354+0000 7f607f81f800 20 remove_watcher() i=4 2024-05-08T18:52:33.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.354+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94593867264816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859dafc70 con 0x7f6070099040 2024-05-08T18:52:33.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.355+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94593867264816] v27'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606802b040 con 0x7f6070099040 2024-05-08T18:52:33.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.355+0000 7f607f81f800 20 remove_watcher() i=5 2024-05-08T18:52:33.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.355+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94593867267504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859db28f0 con 0x7f6070099040 2024-05-08T18:52:33.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.356+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94593867267504] v27'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606802b040 con 0x7f6070099040 2024-05-08T18:52:33.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.356+0000 7f607f81f800 20 remove_watcher() i=6 2024-05-08T18:52:33.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.356+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94593867271344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560859db1000 con 0x7f6070099040 2024-05-08T18:52:33.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.357+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94593867271344] v27'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f606802b040 con 0x7f6070099040 2024-05-08T18:52:33.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.357+0000 7f607f81f800 20 remove_watcher() i=7 2024-05-08T18:52:33.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.357+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f6070099040 msgr2=0x7f607005b370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.357+0000 7f607f81f800 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f6070099040 0x7f607005b370 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x560859da3bc0 msgr2=0x560859da6080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x560859da3bc0 0x560859da6080 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6078014070 msgr2=0x7f6078054a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f6078014070 0x7f6078054a00 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x560859da85b0 msgr2=0x560859daa9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x560859da85b0 0x560859daa9a0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5f4803bba0 msgr2=0x7f5f4803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5f4803bba0 0x7f5f4803e060 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f60700926c0 tx=0x7f6070083000 comp rx=0 tx=0).stop 2024-05-08T18:52:33.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859d90a10 msgr2=0x560859d97f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f6077fff640 1 -- 172.21.15.132:0/451362705 reap_dead start 2024-05-08T18:52:33.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859d90a10 0x560859d97f50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f6078052c20 tx=0x7f6078052c50 comp rx=0 tx=0).stop 2024-05-08T18:52:33.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 shutdown_connections 2024-05-08T18:52:33.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 --2- 172.21.15.132:0/451362705 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859d90a10 0x560859d97f50 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 >> 172.21.15.132:0/451362705 conn(0x560859d8cd20 msgr2=0x560859d8a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 shutdown_connections 2024-05-08T18:52:33.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 -- 172.21.15.132:0/451362705 wait complete. 2024-05-08T18:52:33.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 -- 172.21.15.132:0/2990733478 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5f5403bb50 msgr2=0x7f5f5403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 --2- 172.21.15.132:0/2990733478 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5f5403bb50 0x7f5f5403e010 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x560859d6fe60 tx=0x7f6070092330 comp rx=0 tx=0).stop 2024-05-08T18:52:33.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 -- 172.21.15.132:0/2990733478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859d83710 msgr2=0x560859d83b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 --2- 172.21.15.132:0/2990733478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859d83710 0x560859d83b30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x560859d6fdc0 tx=0x7f6078018830 comp rx=0 tx=0).stop 2024-05-08T18:52:33.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 -- 172.21.15.132:0/2990733478 shutdown_connections 2024-05-08T18:52:33.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 --2- 172.21.15.132:0/2990733478 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5f5403bb50 0x7f5f5403e010 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 --2- 172.21.15.132:0/2990733478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859d83710 0x560859d83b30 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 -- 172.21.15.132:0/2990733478 >> 172.21.15.132:0/2990733478 conn(0x560859d777b0 msgr2=0x560859d77bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 -- 172.21.15.132:0/2990733478 shutdown_connections 2024-05-08T18:52:33.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 -- 172.21.15.132:0/2990733478 wait complete. 2024-05-08T18:52:33.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.358+0000 7f607f81f800 1 -- 172.21.15.132:0/1421537147 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x560859c6d3b0 msgr2=0x560859d6f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.359+0000 7f607f81f800 1 --2- 172.21.15.132:0/1421537147 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x560859c6d3b0 0x560859d6f4c0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.359+0000 7f607f81f800 1 -- 172.21.15.132:0/1421537147 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x560859d71cf0 msgr2=0x560859d740e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.359+0000 7f607f81f800 1 --2- 172.21.15.132:0/1421537147 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x560859d71cf0 0x560859d740e0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.359+0000 7f607f81f800 1 -- 172.21.15.132:0/1421537147 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5f6403bba0 msgr2=0x7f5f6403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.359+0000 7f607f81f800 1 --2- 172.21.15.132:0/1421537147 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5f6403bba0 0x7f5f6403e060 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6068000c00 tx=0x7f60680013b0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.359+0000 7f607f81f800 1 -- 172.21.15.132:0/1421537147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859c6c150 msgr2=0x560859d68280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.359+0000 7f607f81f800 1 --2- 172.21.15.132:0/1421537147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859c6c150 0x560859d68280 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f6070060040 tx=0x7f6070002fb0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.359+0000 7f607f81f800 1 -- 172.21.15.132:0/1421537147 shutdown_connections 2024-05-08T18:52:33.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.359+0000 7f607f81f800 1 --2- 172.21.15.132:0/1421537147 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x560859d71cf0 0x560859d740e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.359+0000 7f607f81f800 1 --2- 172.21.15.132:0/1421537147 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x560859c6d3b0 0x560859d6f4c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.359+0000 7f607f81f800 1 --2- 172.21.15.132:0/1421537147 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f5f6403bba0 0x7f5f6403e060 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.359+0000 7f607f81f800 1 --2- 172.21.15.132:0/1421537147 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x560859c6c150 0x560859d68280 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.359+0000 7f607f81f800 1 -- 172.21.15.132:0/1421537147 >> 172.21.15.132:0/1421537147 conn(0x560859c67730 msgr2=0x560859d57640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.359+0000 7f607f81f800 1 -- 172.21.15.132:0/1421537147 shutdown_connections 2024-05-08T18:52:33.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.359+0000 7f607f81f800 1 -- 172.21.15.132:0/1421537147 wait complete. 2024-05-08T18:52:33.376 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:52:31.994053Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:31.994040Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:33.376 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:52:31.994053Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:31.994040Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:33.376 ERROR:root:0 2024-05-08T18:52:33.376 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-08T18:52:33.376 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-08T18:52:33.377 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-05-08T18:52:33.429 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:33.429 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:33.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.424+0000 7f8ca472c800 1 Processor -- start 2024-05-08T18:52:33.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.424+0000 7f8ca472c800 1 -- start start 2024-05-08T18:52:33.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.424+0000 7f8ca472c800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x56344a36d7f0 0x56344a36fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.425+0000 7f8ca472c800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56344a370120 con 0x56344a369ce0 2024-05-08T18:52:33.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.425+0000 7f8ca472c800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x56344a209e20 con 0x56344a36d7f0 2024-05-08T18:52:33.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.425+0000 7f8c9fbea640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x56344a36d7f0 0x56344a36fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.425+0000 7f8ca03eb640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x56344a369ce0 0x56344a36c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48210/0 (socket says 172.21.15.132:48210) 2024-05-08T18:52:33.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.425+0000 7f8c9fbea640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x56344a36d7f0 0x56344a36fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53704/0 (socket says 172.21.15.132:53704) 2024-05-08T18:52:33.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.425+0000 7f8ca03eb640 1 -- 172.21.15.132:0/1825899091 learned_addr learned my addr 172.21.15.132:0/1825899091 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:52:33.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.425+0000 7f8c9fbea640 1 -- 172.21.15.132:0/1825899091 >> v1:172.21.15.42:6789/0 conn(0x56344a369ce0 legacy=0x56344a36c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.425+0000 7f8c9fbea640 1 -- 172.21.15.132:0/1825899091 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56344a371300 con 0x56344a36d7f0 2024-05-08T18:52:33.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.427+0000 7f8c9fbea640 1 --2- 172.21.15.132:0/1825899091 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a36d7f0 0x56344a36fbe0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800a470 tx=0x7f8c8801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef64bdcfc043d42c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.427+0000 7f8c9f3e9640 1 -- 172.21.15.132:0/1825899091 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c88057070 con 0x56344a36d7f0 2024-05-08T18:52:33.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.427+0000 7f8c9f3e9640 1 -- 172.21.15.132:0/1825899091 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c88052570 con 0x56344a36d7f0 2024-05-08T18:52:33.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.427+0000 7f8c9f3e9640 1 -- 172.21.15.132:0/1825899091 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c88052870 con 0x56344a36d7f0 2024-05-08T18:52:33.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.428+0000 7f8ca472c800 1 -- 172.21.15.132:0/1825899091 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a36d7f0 msgr2=0x56344a36fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.428+0000 7f8ca472c800 1 --2- 172.21.15.132:0/1825899091 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a36d7f0 0x56344a36fbe0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f8c8800a470 tx=0x7f8c8801ce90 comp rx=0 tx=0).stop 2024-05-08T18:52:33.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.428+0000 7f8ca472c800 1 -- 172.21.15.132:0/1825899091 shutdown_connections 2024-05-08T18:52:33.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.428+0000 7f8ca472c800 1 --2- 172.21.15.132:0/1825899091 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a36d7f0 0x56344a36fbe0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.428+0000 7f8ca472c800 1 -- 172.21.15.132:0/1825899091 >> 172.21.15.132:0/1825899091 conn(0x56344a363730 msgr2=0x56344a365b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.428+0000 7f8ca472c800 1 -- 172.21.15.132:0/1825899091 shutdown_connections 2024-05-08T18:52:33.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.428+0000 7f8ca472c800 1 -- 172.21.15.132:0/1825899091 wait complete. 2024-05-08T18:52:33.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.441+0000 7f8ca472c800 1 Processor -- start 2024-05-08T18:52:33.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.441+0000 7f8ca472c800 1 -- start start 2024-05-08T18:52:33.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.441+0000 7f8ca472c800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a369ce0 0x56344a45a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.441+0000 7f8ca472c800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56344a2b45c0 con 0x56344a369ce0 2024-05-08T18:52:33.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.442+0000 7f8ca03eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a369ce0 0x56344a45a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.442+0000 7f8ca03eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a369ce0 0x56344a45a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53710/0 (socket says 172.21.15.132:53710) 2024-05-08T18:52:33.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.442+0000 7f8ca03eb640 1 -- 172.21.15.132:0/3567906727 learned_addr learned my addr 172.21.15.132:0/3567906727 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.442+0000 7f8ca03eb640 1 -- 172.21.15.132:0/3567906727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56344a45aca0 con 0x56344a369ce0 2024-05-08T18:52:33.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.442+0000 7f8ca03eb640 1 --2- 172.21.15.132:0/3567906727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a369ce0 0x56344a45a6d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f8c98001de0 tx=0x7f8c9800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0bf949d20711577 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.442+0000 7f8b8e60c640 1 -- 172.21.15.132:0/3567906727 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c98012020 con 0x56344a369ce0 2024-05-08T18:52:33.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.442+0000 7f8b8e60c640 1 -- 172.21.15.132:0/3567906727 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c9800e5a0 con 0x56344a369ce0 2024-05-08T18:52:33.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.442+0000 7f8b8e60c640 1 -- 172.21.15.132:0/3567906727 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c9800e8c0 con 0x56344a369ce0 2024-05-08T18:52:33.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.443+0000 7f8ca472c800 1 -- 172.21.15.132:0/3567906727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a369ce0 msgr2=0x56344a45a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.443+0000 7f8ca472c800 1 --2- 172.21.15.132:0/3567906727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a369ce0 0x56344a45a6d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f8c98001de0 tx=0x7f8c9800b6c0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.443+0000 7f8ca472c800 1 -- 172.21.15.132:0/3567906727 shutdown_connections 2024-05-08T18:52:33.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.443+0000 7f8ca472c800 1 --2- 172.21.15.132:0/3567906727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a369ce0 0x56344a45a6d0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.443+0000 7f8ca472c800 1 -- 172.21.15.132:0/3567906727 >> 172.21.15.132:0/3567906727 conn(0x56344a363730 msgr2=0x56344a455ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.443+0000 7f8ca472c800 1 -- 172.21.15.132:0/3567906727 shutdown_connections 2024-05-08T18:52:33.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.443+0000 7f8ca472c800 1 -- 172.21.15.132:0/3567906727 wait complete. 2024-05-08T18:52:33.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.443+0000 7f8ca472c800 1 Processor -- start 2024-05-08T18:52:33.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.443+0000 7f8ca472c800 1 -- start start 2024-05-08T18:52:33.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.443+0000 7f8ca472c800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a369ce0 0x56344a462250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.443+0000 7f8ca472c800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56344a3705f0 con 0x56344a369ce0 2024-05-08T18:52:33.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.444+0000 7f8ca03eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a369ce0 0x56344a462250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.444+0000 7f8ca03eb640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a369ce0 0x56344a462250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53712/0 (socket says 172.21.15.132:53712) 2024-05-08T18:52:33.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.444+0000 7f8ca03eb640 1 -- 172.21.15.132:0/3757764579 learned_addr learned my addr 172.21.15.132:0/3757764579 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.444+0000 7f8ca03eb640 1 -- 172.21.15.132:0/3757764579 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56344a462790 con 0x56344a369ce0 2024-05-08T18:52:33.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.444+0000 7f8ca03eb640 1 --2- 172.21.15.132:0/3757764579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a369ce0 0x56344a462250 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800c010 tx=0x7f8c98000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.444+0000 7f8b8ce09640 1 -- 172.21.15.132:0/3757764579 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c98012070 con 0x56344a369ce0 2024-05-08T18:52:33.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.444+0000 7f8b8ce09640 1 -- 172.21.15.132:0/3757764579 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c9801a7a0 con 0x56344a369ce0 2024-05-08T18:52:33.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.444+0000 7f8ca472c800 1 -- 172.21.15.132:0/3757764579 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56344a462a20 con 0x56344a369ce0 2024-05-08T18:52:33.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.444+0000 7f8b8ce09640 1 -- 172.21.15.132:0/3757764579 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c9801aa80 con 0x56344a369ce0 2024-05-08T18:52:33.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.444+0000 7f8ca472c800 1 -- 172.21.15.132:0/3757764579 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56344a4656d0 con 0x56344a369ce0 2024-05-08T18:52:33.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.445+0000 7f8b8ce09640 1 -- 172.21.15.132:0/3757764579 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8c98015020 con 0x56344a369ce0 2024-05-08T18:52:33.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.445+0000 7f8b8ce09640 1 --2- 172.21.15.132:0/3757764579 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8b8803bba0 0x7f8b8803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.445+0000 7f8b8ce09640 1 -- 172.21.15.132:0/3757764579 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f8c98020070 con 0x56344a369ce0 2024-05-08T18:52:33.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.446+0000 7f8c9fbea640 1 --2- 172.21.15.132:0/3757764579 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8b8803bba0 0x7f8b8803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.446+0000 7f8ca472c800 1 --2- 172.21.15.132:0/3757764579 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56344a36d7f0 0x56344a469490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.446+0000 7f8ca472c800 1 -- 172.21.15.132:0/3757764579 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56344a4699d0 con 0x56344a36d7f0 2024-05-08T18:52:33.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.446+0000 7f8ca0bec640 1 --2- 172.21.15.132:0/3757764579 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56344a36d7f0 0x56344a469490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.446+0000 7f8c9fbea640 1 --2- 172.21.15.132:0/3757764579 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8b8803bba0 0x7f8b8803e060 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8c88054000 tx=0x7f8c8804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.446+0000 7f8ca0bec640 1 --2- 172.21.15.132:0/3757764579 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56344a36d7f0 0x56344a469490 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.446+0000 7f8ca0bec640 1 -- 172.21.15.132:0/3757764579 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c9000a4a0 con 0x56344a36d7f0 2024-05-08T18:52:33.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.446+0000 7f8ca472c800 1 -- 172.21.15.132:0/3757764579 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56344a466a60 con 0x56344a36d7f0 2024-05-08T18:52:33.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.447+0000 7f8ca0bec640 1 -- 172.21.15.132:0/3757764579 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c9000a4a0 con 0x56344a36d7f0 2024-05-08T18:52:33.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.447+0000 7f8ca472c800 1 --2- 172.21.15.132:0/3757764579 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56344a46bd20 0x56344a46e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.447+0000 7f8ca472c800 1 -- 172.21.15.132:0/3757764579 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56344a46e800 con 0x56344a46bd20 2024-05-08T18:52:33.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.447+0000 7f8ca03eb640 1 --2- 172.21.15.132:0/3757764579 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56344a46bd20 0x56344a46e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.447+0000 7f8ca03eb640 1 --2- 172.21.15.132:0/3757764579 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56344a46bd20 0x56344a46e110 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.447+0000 7f8ca03eb640 1 -- 172.21.15.132:0/3757764579 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8c9802b070 con 0x56344a46bd20 2024-05-08T18:52:33.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.447+0000 7f8ca472c800 1 -- 172.21.15.132:0/3757764579 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56344a46ab90 con 0x56344a36d7f0 2024-05-08T18:52:33.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.448+0000 7f8ca0bec640 1 -- 172.21.15.132:0/3757764579 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c9000a4a0 con 0x56344a36d7f0 2024-05-08T18:52:33.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.448+0000 7f8ca472c800 1 -- 172.21.15.132:0/3757764579 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56344a46b000 con 0x56344a36d7f0 2024-05-08T18:52:33.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.448+0000 7f8ca0bec640 1 -- 172.21.15.132:0/3757764579 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8c9000a4a0 con 0x56344a36d7f0 2024-05-08T18:52:33.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.448+0000 7f8ca472c800 1 Processor -- start 2024-05-08T18:52:33.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.448+0000 7f8ca472c800 1 -- start start 2024-05-08T18:52:33.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.448+0000 7f8ca472c800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a47d7a0 0x56344a47dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.448+0000 7f8ca472c800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56344a25afc0 con 0x56344a47d7a0 2024-05-08T18:52:33.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.449+0000 7f8ca0bec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a47d7a0 0x56344a47dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.449+0000 7f8ca0bec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a47d7a0 0x56344a47dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53724/0 (socket says 172.21.15.132:53724) 2024-05-08T18:52:33.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.449+0000 7f8ca0bec640 1 -- 172.21.15.132:0/2537385998 learned_addr learned my addr 172.21.15.132:0/2537385998 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.449+0000 7f8ca0bec640 1 -- 172.21.15.132:0/2537385998 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56344a47e100 con 0x56344a47d7a0 2024-05-08T18:52:33.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.449+0000 7f8ca0bec640 1 --2- 172.21.15.132:0/2537385998 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a47d7a0 0x56344a47dbc0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x56344a463650 tx=0x7f8c90018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.449+0000 7f8b85ffb640 1 -- 172.21.15.132:0/2537385998 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c90014450 con 0x56344a47d7a0 2024-05-08T18:52:33.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.449+0000 7f8b85ffb640 1 -- 172.21.15.132:0/2537385998 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c900145f0 con 0x56344a47d7a0 2024-05-08T18:52:33.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.449+0000 7f8ca472c800 1 -- 172.21.15.132:0/2537385998 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56344a47eb70 con 0x56344a47d7a0 2024-05-08T18:52:33.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.449+0000 7f8b85ffb640 1 -- 172.21.15.132:0/2537385998 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c900148f0 con 0x56344a47d7a0 2024-05-08T18:52:33.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.449+0000 7f8ca472c800 1 -- 172.21.15.132:0/2537385998 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56344a47f070 con 0x56344a47d7a0 2024-05-08T18:52:33.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.450+0000 7f8b85ffb640 1 -- 172.21.15.132:0/2537385998 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8c90011040 con 0x56344a47d7a0 2024-05-08T18:52:33.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.450+0000 7f8b85ffb640 1 --2- 172.21.15.132:0/2537385998 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8b7803bba0 0x7f8b7803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.450+0000 7f8b85ffb640 1 -- 172.21.15.132:0/2537385998 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f8c9001e070 con 0x56344a47d7a0 2024-05-08T18:52:33.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.450+0000 7f8ca03eb640 1 --2- 172.21.15.132:0/2537385998 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8b7803bba0 0x7f8b7803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.451+0000 7f8ca472c800 1 Processor -- start 2024-05-08T18:52:33.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.451+0000 7f8ca03eb640 1 --2- 172.21.15.132:0/2537385998 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8b7803bba0 0x7f8b7803e060 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8c98022b30 tx=0x7f8c98050ca0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.451+0000 7f8ca472c800 1 -- start start 2024-05-08T18:52:33.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.451+0000 7f8ca472c800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a48aa40 0x56344a48ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.451+0000 7f8ca472c800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56344a45b020 con 0x56344a48aa40 2024-05-08T18:52:33.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.451+0000 7f8ca0bec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a48aa40 0x56344a48ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.451+0000 7f8ca0bec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a48aa40 0x56344a48ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53736/0 (socket says 172.21.15.132:53736) 2024-05-08T18:52:33.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.451+0000 7f8ca0bec640 1 -- 172.21.15.132:0/4238019096 learned_addr learned my addr 172.21.15.132:0/4238019096 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.451+0000 7f8ca0bec640 1 -- 172.21.15.132:0/4238019096 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56344a48b430 con 0x56344a48aa40 2024-05-08T18:52:33.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.452+0000 7f8ca0bec640 1 --2- 172.21.15.132:0/4238019096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a48aa40 0x56344a48ae60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8c90052b90 tx=0x7f8c900118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8703f14a0c08dd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.452+0000 7f8b7f7fe640 1 -- 172.21.15.132:0/4238019096 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c90001310 con 0x56344a48aa40 2024-05-08T18:52:33.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.452+0000 7f8b7f7fe640 1 -- 172.21.15.132:0/4238019096 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c900167c0 con 0x56344a48aa40 2024-05-08T18:52:33.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.452+0000 7f8b7f7fe640 1 -- 172.21.15.132:0/4238019096 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c90022c70 con 0x56344a48aa40 2024-05-08T18:52:33.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.452+0000 7f8ca472c800 1 -- 172.21.15.132:0/4238019096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a48aa40 msgr2=0x56344a48ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.452+0000 7f8ca472c800 1 --2- 172.21.15.132:0/4238019096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a48aa40 0x56344a48ae60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8c90052b90 tx=0x7f8c900118e0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.452+0000 7f8ca472c800 1 -- 172.21.15.132:0/4238019096 shutdown_connections 2024-05-08T18:52:33.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.452+0000 7f8ca472c800 1 --2- 172.21.15.132:0/4238019096 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a48aa40 0x56344a48ae60 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.452+0000 7f8ca472c800 1 -- 172.21.15.132:0/4238019096 >> 172.21.15.132:0/4238019096 conn(0x56344a486d00 msgr2=0x56344a484db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.452+0000 7f8ca472c800 1 -- 172.21.15.132:0/4238019096 shutdown_connections 2024-05-08T18:52:33.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.452+0000 7f8ca472c800 1 -- 172.21.15.132:0/4238019096 wait complete. 2024-05-08T18:52:33.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.452+0000 7f8ca472c800 1 Processor -- start 2024-05-08T18:52:33.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.453+0000 7f8ca472c800 1 -- start start 2024-05-08T18:52:33.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.453+0000 7f8ca472c800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a48aa40 0x56344a369620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.453+0000 7f8ca472c800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56344a48bbb0 con 0x56344a48aa40 2024-05-08T18:52:33.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.453+0000 7f8ca0bec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a48aa40 0x56344a369620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.453+0000 7f8ca0bec640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a48aa40 0x56344a369620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53738/0 (socket says 172.21.15.132:53738) 2024-05-08T18:52:33.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.453+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 learned_addr learned my addr 172.21.15.132:0/981273072 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.453+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56344a367d10 con 0x56344a48aa40 2024-05-08T18:52:33.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.454+0000 7f8ca0bec640 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a48aa40 0x56344a369620 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f8c90051ab0 tx=0x7f8c90052b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.454+0000 7f8b7dffb640 1 -- 172.21.15.132:0/981273072 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c900542e0 con 0x56344a48aa40 2024-05-08T18:52:33.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.454+0000 7f8b7dffb640 1 -- 172.21.15.132:0/981273072 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c90031070 con 0x56344a48aa40 2024-05-08T18:52:33.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.454+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56344a367fa0 con 0x56344a48aa40 2024-05-08T18:52:33.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.454+0000 7f8b7dffb640 1 -- 172.21.15.132:0/981273072 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c9002b350 con 0x56344a48aa40 2024-05-08T18:52:33.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.454+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56344a3684a0 con 0x56344a48aa40 2024-05-08T18:52:33.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.454+0000 7f8b7dffb640 1 -- 172.21.15.132:0/981273072 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8c9002b4f0 con 0x56344a48aa40 2024-05-08T18:52:33.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.455+0000 7f8b7dffb640 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8b7003bba0 0x7f8b7003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.455+0000 7f8b7dffb640 1 -- 172.21.15.132:0/981273072 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f8c9000e040 con 0x56344a48aa40 2024-05-08T18:52:33.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.455+0000 7f8ca03eb640 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8b7003bba0 0x7f8b7003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.455+0000 7f8ca03eb640 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8b7003bba0 0x7f8b7003e060 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8c98017fd0 tx=0x7f8c9804d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.455+0000 7f8ca472c800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.455+0000 7f8ca472c800 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56344a49ff50 0x56344a4a2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.455+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a2b60 con 0x56344a49ff50 2024-05-08T18:52:33.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.455+0000 7f8c9fbea640 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56344a49ff50 0x56344a4a2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.456+0000 7f8c9fbea640 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56344a49ff50 0x56344a4a2410 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.456+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c8805a040 con 0x56344a49ff50 2024-05-08T18:52:33.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.456+0000 7f8ca472c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.456+0000 7f8ca472c800 20 realm 2024-05-08T18:52:33.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.456+0000 7f8ca472c800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.456+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a2f30 con 0x56344a49ff50 2024-05-08T18:52:33.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.456+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c8805a040 con 0x56344a49ff50 2024-05-08T18:52:33.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.456+0000 7f8ca472c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.456+0000 7f8ca472c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:52:33.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.456+0000 7f8ca472c800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.456+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a3800 con 0x56344a49ff50 2024-05-08T18:52:33.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.456+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c8805a040 con 0x56344a49ff50 2024-05-08T18:52:33.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.456+0000 7f8ca472c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.456+0000 7f8ca472c800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.456+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a3ba0 con 0x56344a49ff50 2024-05-08T18:52:33.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.457+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c8805a040 con 0x56344a49ff50 2024-05-08T18:52:33.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.457+0000 7f8ca472c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:33.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.457+0000 7f8ca472c800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.457+0000 7f8ca472c800 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56344a4a4900 0x56344a4a6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.457+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a72b0 con 0x56344a4a4900 2024-05-08T18:52:33.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.457+0000 7f8ca0bec640 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56344a4a4900 0x56344a4a6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.457+0000 7f8ca0bec640 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56344a4a4900 0x56344a4a6cf0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.457+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8c9003f030 con 0x56344a4a4900 2024-05-08T18:52:33.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.457+0000 7f8ca472c800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:52:33.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.457+0000 7f8ca472c800 20 searching for the correct realm 2024-05-08T18:52:33.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.457+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x56344a4a4900 2024-05-08T18:52:33.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.458+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c9003f030 con 0x56344a4a4900 2024-05-08T18:52:33.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.458+0000 7f8ca0bec640 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f8c90014070 0x7f8c900609d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.458+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x7f8c90014070 2024-05-08T18:52:33.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.458+0000 7f8ca03eb640 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f8c90014070 0x7f8c900609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.458+0000 7f8ca03eb640 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f8c90014070 0x7f8c900609d0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.459+0000 7f8ca03eb640 1 -- 172.21.15.132:0/981273072 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c9802b070 con 0x7f8c90014070 2024-05-08T18:52:33.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.459+0000 7f8ca03eb640 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f8c9803c040 0x7f8c980529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.459+0000 7f8ca03eb640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x7f8c9803c040 2024-05-08T18:52:33.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.459+0000 7f8c9fbea640 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f8c9803c040 0x7f8c980529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.459+0000 7f8c9fbea640 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f8c9803c040 0x7f8c980529d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.460+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8805a040 con 0x7f8c9803c040 2024-05-08T18:52:33.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.460+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x56344a49ff50 2024-05-08T18:52:33.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.460+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8805a040 con 0x56344a49ff50 2024-05-08T18:52:33.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.460+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x56344a49ff50 2024-05-08T18:52:33.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.460+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8805a040 con 0x56344a49ff50 2024-05-08T18:52:33.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.460+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x7f8c9803c040 2024-05-08T18:52:33.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.460+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8805a040 con 0x7f8c9803c040 2024-05-08T18:52:33.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.460+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x7f8c9803c040 2024-05-08T18:52:33.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.461+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8805a040 con 0x7f8c9803c040 2024-05-08T18:52:33.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.461+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x7f8c90014070 2024-05-08T18:52:33.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.461+0000 7f8ca03eb640 1 -- 172.21.15.132:0/981273072 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c9802b070 con 0x7f8c90014070 2024-05-08T18:52:33.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.461+0000 7f8ca03eb640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x56344a4a4900 2024-05-08T18:52:33.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.461+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c9003f030 con 0x56344a4a4900 2024-05-08T18:52:33.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.461+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x56344a49ff50 2024-05-08T18:52:33.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.461+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8805a040 con 0x56344a49ff50 2024-05-08T18:52:33.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.461+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x7f8c9803c040 2024-05-08T18:52:33.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.462+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8805a040 con 0x7f8c9803c040 2024-05-08T18:52:33.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.462+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x56344a49ff50 2024-05-08T18:52:33.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.462+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8c8805a040 con 0x56344a49ff50 2024-05-08T18:52:33.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.462+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x7f8c90014070 2024-05-08T18:52:33.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.462+0000 7f8ca03eb640 1 -- 172.21.15.132:0/981273072 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8c9802b070 con 0x7f8c90014070 2024-05-08T18:52:33.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.462+0000 7f8ca03eb640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x56344a4a4900 2024-05-08T18:52:33.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.462+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v27'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8c9003f030 con 0x56344a4a4900 2024-05-08T18:52:33.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.462+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x56344a4a4900 2024-05-08T18:52:33.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.463+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c9003f030 con 0x56344a4a4900 2024-05-08T18:52:33.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.463+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x7f8c9803c040 2024-05-08T18:52:33.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.463+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8805a040 con 0x7f8c9803c040 2024-05-08T18:52:33.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.463+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x56344a4a4900 2024-05-08T18:52:33.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.463+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c9003f030 con 0x56344a4a4900 2024-05-08T18:52:33.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.463+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x56344a4a4900 2024-05-08T18:52:33.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.464+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c9003f030 con 0x56344a4a4900 2024-05-08T18:52:33.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.464+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x56344a49ff50 2024-05-08T18:52:33.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.464+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8805a040 con 0x56344a49ff50 2024-05-08T18:52:33.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.464+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x56344a49ff50 2024-05-08T18:52:33.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.464+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v27'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8c8805a040 con 0x56344a49ff50 2024-05-08T18:52:33.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.464+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x7f8c9803c040 2024-05-08T18:52:33.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.464+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8807d040 con 0x7f8c9803c040 2024-05-08T18:52:33.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.464+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x56344a4a4900 2024-05-08T18:52:33.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.465+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c9003f030 con 0x56344a4a4900 2024-05-08T18:52:33.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.465+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x7f8c90014070 2024-05-08T18:52:33.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.465+0000 7f8ca03eb640 1 -- 172.21.15.132:0/981273072 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c9802b070 con 0x7f8c90014070 2024-05-08T18:52:33.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.465+0000 7f8ca03eb640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x56344a49ff50 2024-05-08T18:52:33.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.465+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8807d040 con 0x56344a49ff50 2024-05-08T18:52:33.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.465+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x7f8c90014070 2024-05-08T18:52:33.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.465+0000 7f8ca03eb640 1 -- 172.21.15.132:0/981273072 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c9802b070 con 0x7f8c90014070 2024-05-08T18:52:33.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.465+0000 7f8ca03eb640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x56344a4a4900 2024-05-08T18:52:33.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.466+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c9003f030 con 0x56344a4a4900 2024-05-08T18:52:33.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.466+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x7f8c9803c040 2024-05-08T18:52:33.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.466+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8807d040 con 0x7f8c9803c040 2024-05-08T18:52:33.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.466+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x7f8c90014070 2024-05-08T18:52:33.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.466+0000 7f8ca03eb640 1 -- 172.21.15.132:0/981273072 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c9802b070 con 0x7f8c90014070 2024-05-08T18:52:33.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.466+0000 7f8ca03eb640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x56344a4a4900 2024-05-08T18:52:33.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.466+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c9003f030 con 0x56344a4a4900 2024-05-08T18:52:33.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.466+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x7f8c9803c040 2024-05-08T18:52:33.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.467+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c8807d040 con 0x7f8c9803c040 2024-05-08T18:52:33.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.467+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x56344a49ff50 2024-05-08T18:52:33.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.467+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v27'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8c8807d040 con 0x56344a49ff50 2024-05-08T18:52:33.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.467+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8c00 con 0x7f8c90014070 2024-05-08T18:52:33.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.467+0000 7f8ca03eb640 1 -- 172.21.15.132:0/981273072 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c9802b070 con 0x7f8c90014070 2024-05-08T18:52:33.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.467+0000 7f8ca472c800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:52:33.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.467+0000 7f8ca472c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:52:33.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.467+0000 7f8ca472c800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:52:33.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.467+0000 7f8ca472c800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:52:33.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.467+0000 7f8ca472c800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:52:33.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.467+0000 7f8ca472c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:52:33.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.467+0000 7f8ca472c800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.467+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a7c70 con 0x56344a49ff50 2024-05-08T18:52:33.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.467+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c8807d040 con 0x56344a49ff50 2024-05-08T18:52:33.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.467+0000 7f8ca472c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.467+0000 7f8ca472c800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.467+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a8510 con 0x56344a49ff50 2024-05-08T18:52:33.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.468+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c8807d040 con 0x56344a49ff50 2024-05-08T18:52:33.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.468+0000 7f8ca472c800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:33.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.468+0000 7f8ca472c800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.468+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a9080 con 0x56344a49ff50 2024-05-08T18:52:33.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.468+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8c8807d040 con 0x56344a49ff50 2024-05-08T18:52:33.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.468+0000 7f8ca472c800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:52:33.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.468+0000 7f8ca472c800 20 zone default found 2024-05-08T18:52:33.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.468+0000 7f8ca472c800 4 Realm: () 2024-05-08T18:52:33.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.468+0000 7f8ca472c800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:52:33.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.468+0000 7f8ca472c800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:52:33.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.468+0000 7f8ca472c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:52:33.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.468+0000 7f8ca472c800 20 zonegroup default 2024-05-08T18:52:33.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.468+0000 7f8ca472c800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.468+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56344a4a9440 con 0x7f8c90014070 2024-05-08T18:52:33.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.468+0000 7f8ca03eb640 1 -- 172.21.15.132:0/981273072 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8c9802b070 con 0x7f8c90014070 2024-05-08T18:52:33.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.468+0000 7f8ca472c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.468+0000 7f8ca472c800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.468+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56344a4ab710 con 0x56344a4a4900 2024-05-08T18:52:33.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.468+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c9003f030 con 0x56344a4a4900 2024-05-08T18:52:33.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.469+0000 7f8ca472c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.469+0000 7f8ca472c800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.469+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56344a4abab0 con 0x56344a4a4900 2024-05-08T18:52:33.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.469+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c9003f030 con 0x56344a4a4900 2024-05-08T18:52:33.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.469+0000 7f8ca472c800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.469+0000 7f8ca472c800 20 started sync module instance, tier type = 2024-05-08T18:52:33.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.469+0000 7f8ca472c800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:52:33.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.469+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4aaba0 con 0x7f8c90014070 2024-05-08T18:52:33.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.470+0000 7f8ca03eb640 1 -- 172.21.15.132:0/981273072 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c9802b070 con 0x7f8c90014070 2024-05-08T18:52:33.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.470+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94782584696720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4ac350 con 0x7f8c90014070 2024-05-08T18:52:33.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.470+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4acba0 con 0x56344a49ff50 2024-05-08T18:52:33.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.471+0000 7f8ca03eb640 1 -- 172.21.15.132:0/981273072 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94782584696720] v27'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c9802b070 con 0x7f8c90014070 2024-05-08T18:52:33.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.471+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8807d040 con 0x56344a49ff50 2024-05-08T18:52:33.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.471+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94782584700576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4acba0 con 0x56344a49ff50 2024-05-08T18:52:33.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.471+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4ad6a0 con 0x56344a4a4900 2024-05-08T18:52:33.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.472+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94782584700576] v27'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8807d040 con 0x56344a49ff50 2024-05-08T18:52:33.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.472+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c9003f030 con 0x56344a4a4900 2024-05-08T18:52:33.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.472+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94782584705424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4acba0 con 0x56344a4a4900 2024-05-08T18:52:33.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.472+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4ae140 con 0x7f8c90014070 2024-05-08T18:52:33.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.473+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94782584705424] v27'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c9003f030 con 0x56344a4a4900 2024-05-08T18:52:33.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.473+0000 7f8ca03eb640 1 -- 172.21.15.132:0/981273072 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c9802b070 con 0x7f8c90014070 2024-05-08T18:52:33.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.473+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94782584702704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4acb10 con 0x7f8c90014070 2024-05-08T18:52:33.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.473+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4af000 con 0x56344a49ff50 2024-05-08T18:52:33.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.474+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8807d040 con 0x56344a49ff50 2024-05-08T18:52:33.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.474+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94782584712016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4af480 con 0x56344a49ff50 2024-05-08T18:52:33.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.474+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4aff90 con 0x7f8c9803c040 2024-05-08T18:52:33.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.475+0000 7f8ca03eb640 1 -- 172.21.15.132:0/981273072 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94782584702704] v27'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c9802b070 con 0x7f8c90014070 2024-05-08T18:52:33.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.475+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94782584712016] v27'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8807d040 con 0x56344a49ff50 2024-05-08T18:52:33.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.476+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8807d040 con 0x7f8c9803c040 2024-05-08T18:52:33.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.476+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94782584713072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4aff50 con 0x7f8c9803c040 2024-05-08T18:52:33.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.476+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4b0830 con 0x7f8c9803c040 2024-05-08T18:52:33.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.477+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94782584713072] v27'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8807d040 con 0x7f8c9803c040 2024-05-08T18:52:33.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.477+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8807d040 con 0x7f8c9803c040 2024-05-08T18:52:33.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.477+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94782584715840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4aff50 con 0x7f8c9803c040 2024-05-08T18:52:33.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.477+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4b0e50 con 0x7f8c9803c040 2024-05-08T18:52:33.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.478+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94782584715840] v27'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8807d040 con 0x7f8c9803c040 2024-05-08T18:52:33.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.478+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8807d040 con 0x7f8c9803c040 2024-05-08T18:52:33.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.478+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94782584718208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4b0e50 con 0x7f8c9803c040 2024-05-08T18:52:33.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.478+0000 7f8ca472c800 20 add_watcher() i=0 2024-05-08T18:52:33.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.478+0000 7f8ca472c800 20 add_watcher() i=1 2024-05-08T18:52:33.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.478+0000 7f8ca472c800 20 add_watcher() i=2 2024-05-08T18:52:33.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.478+0000 7f8ca472c800 20 add_watcher() i=3 2024-05-08T18:52:33.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.478+0000 7f8ca472c800 20 add_watcher() i=4 2024-05-08T18:52:33.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.478+0000 7f8ca472c800 20 add_watcher() i=5 2024-05-08T18:52:33.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.478+0000 7f8ca472c800 20 add_watcher() i=6 2024-05-08T18:52:33.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.479+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94782584718208] v27'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8807d040 con 0x7f8c9803c040 2024-05-08T18:52:33.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.479+0000 7f8ca472c800 20 add_watcher() i=7 2024-05-08T18:52:33.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.479+0000 7f8ca472c800 2 all 8 watchers are set, enabling cache 2024-05-08T18:52:33.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.479+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56344a4b4250 con 0x56344a49ff50 2024-05-08T18:52:33.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.480+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8c8807d040 con 0x56344a49ff50 2024-05-08T18:52:33.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.480+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94782584720240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4b1770 con 0x56344a49ff50 2024-05-08T18:52:33.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.481+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94782584720240] v27'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c8807d040 con 0x56344a49ff50 2024-05-08T18:52:33.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.481+0000 7f8b567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:33.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.481+0000 7f8ca472c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:33.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.481+0000 7f8ca472c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:33.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.481+0000 7f8ca472c800 5 note: GC not initialized 2024-05-08T18:52:33.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.481+0000 7f8b557e2640 20 reqs_thread_entry: start 2024-05-08T18:52:33.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.481+0000 7f8ca472c800 20 init_complete bucket index max shards: 11 2024-05-08T18:52:33.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.481+0000 7f8ca472c800 20 Filter name: none 2024-05-08T18:52:33.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.481+0000 7f8ac6ffd640 20 reqs_thread_entry: start 2024-05-08T18:52:33.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.482+0000 7f8ca472c800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:52:33.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.482+0000 7f8ca472c800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.482+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56344a4e7730 con 0x7f8c9803c040 2024-05-08T18:52:33.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.482+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f8c8807d040 con 0x7f8c9803c040 2024-05-08T18:52:33.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.482+0000 7f8ca472c800 20 rados_obj.operate() r=0 bl.length=460 2024-05-08T18:52:33.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.482+0000 7f8ca472c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:52:33.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.482+0000 7f8ca472c800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:33.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.482+0000 7f8ca472c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:52:33.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.482+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4edca0 con 0x7f8c9803c040 2024-05-08T18:52:33.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.484+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v27'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8c8807d040 con 0x7f8c9803c040 2024-05-08T18:52:33.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.484+0000 7f8ca472c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:52:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.484+0000 7f8ca472c800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.484+0000 7f8ca472c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:52:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.484+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94782584968800 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56344a4e92a0 con 0x56344a49ff50 2024-05-08T18:52:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.484+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== watch-notify(notify (1) cookie 94782584712016 notify 115964117020 ret 0) ==== 708+0+0 (crc 0 0 0) 0x56344a371300 con 0x56344a49ff50 2024-05-08T18:52:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.484+0000 7f8b7f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117020 cookie 94782584712016 notifier 4893 bl.length()=666 2024-05-08T18:52:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.484+0000 7f8b7f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:52:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.484+0000 7f8b7f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.484+0000 7f8b7f7fe640 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f8b64003ea0 con 0x56344a49ff50 2024-05-08T18:52:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.484+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 notify.4 [notify cookie 94782584968800 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8c8807d040 con 0x56344a49ff50 2024-05-08T18:52:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.485+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== watch-notify(notify_complete (2) cookie 94782584968800 notify 115964117020 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8c88086760 con 0x56344a49ff50 2024-05-08T18:52:33.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.485+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8807d040 con 0x56344a49ff50 2024-05-08T18:52:33.506 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:52:31.994053Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:52:31.994040Z","tags":[],"group_ids":[]} 2024-05-08T18:52:33.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.486+0000 7f8b567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:33.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.486+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94782584720240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4e95c0 con 0x56344a49ff50 2024-05-08T18:52:33.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.487+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94782584720240] v27'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c8807d040 con 0x56344a49ff50 2024-05-08T18:52:33.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.487+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94782584696720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4b0b40 con 0x7f8c90014070 2024-05-08T18:52:33.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.488+0000 7f8ca03eb640 1 -- 172.21.15.132:0/981273072 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94782584696720] v27'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c9802b070 con 0x7f8c90014070 2024-05-08T18:52:33.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.488+0000 7f8ca472c800 20 remove_watcher() i=0 2024-05-08T18:52:33.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.488+0000 7f8ca472c800 2 removed watcher, disabling cache 2024-05-08T18:52:33.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.488+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94782584700576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4aaf90 con 0x56344a49ff50 2024-05-08T18:52:33.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.489+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94782584700576] v27'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8807d040 con 0x56344a49ff50 2024-05-08T18:52:33.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.489+0000 7f8ca472c800 20 remove_watcher() i=1 2024-05-08T18:52:33.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.489+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94782584705424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4aaf90 con 0x56344a4a4900 2024-05-08T18:52:33.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.490+0000 7f8ca0bec640 1 -- 172.21.15.132:0/981273072 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94782584705424] v27'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c9003f030 con 0x56344a4a4900 2024-05-08T18:52:33.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.490+0000 7f8ca472c800 20 remove_watcher() i=2 2024-05-08T18:52:33.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.490+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94782584702704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4ad190 con 0x7f8c90014070 2024-05-08T18:52:33.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.491+0000 7f8ca03eb640 1 -- 172.21.15.132:0/981273072 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94782584702704] v27'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c9802b070 con 0x7f8c90014070 2024-05-08T18:52:33.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.491+0000 7f8ca472c800 20 remove_watcher() i=3 2024-05-08T18:52:33.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.491+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94782584712016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4aaf90 con 0x56344a49ff50 2024-05-08T18:52:33.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.492+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94782584712016] v27'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8807d040 con 0x56344a49ff50 2024-05-08T18:52:33.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.492+0000 7f8ca472c800 20 remove_watcher() i=4 2024-05-08T18:52:33.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.492+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94782584713072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4ac6f0 con 0x7f8c9803c040 2024-05-08T18:52:33.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.493+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94782584713072] v27'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8807d040 con 0x7f8c9803c040 2024-05-08T18:52:33.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.493+0000 7f8ca472c800 20 remove_watcher() i=5 2024-05-08T18:52:33.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.493+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94782584715840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4ad190 con 0x7f8c9803c040 2024-05-08T18:52:33.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.494+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94782584715840] v27'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8807d040 con 0x7f8c9803c040 2024-05-08T18:52:33.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.494+0000 7f8ca472c800 20 remove_watcher() i=6 2024-05-08T18:52:33.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.494+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94782584718208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56344a4aaf90 con 0x7f8c9803c040 2024-05-08T18:52:33.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.495+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94782584718208] v27'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c8807d040 con 0x7f8c9803c040 2024-05-08T18:52:33.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.495+0000 7f8ca472c800 20 remove_watcher() i=7 2024-05-08T18:52:33.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.495+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f8c9803c040 msgr2=0x7f8c980529d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.495+0000 7f8ca472c800 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f8c9803c040 0x7f8c980529d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.495+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56344a49ff50 msgr2=0x56344a4a2410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.495+0000 7f8ca472c800 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56344a49ff50 0x56344a4a2410 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.495+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f8c90014070 msgr2=0x7f8c900609d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.495+0000 7f8ca472c800 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f8c90014070 0x7f8c900609d0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.495+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56344a4a4900 msgr2=0x56344a4a6cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.495+0000 7f8ca472c800 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56344a4a4900 0x56344a4a6cf0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.495+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8b7003bba0 msgr2=0x7f8b7003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.495+0000 7f8ca472c800 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8b7003bba0 0x7f8b7003e060 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8c98017fd0 tx=0x7f8c9804d000 comp rx=0 tx=0).stop 2024-05-08T18:52:33.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.495+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a48aa40 msgr2=0x56344a369620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.495+0000 7f8c9fbea640 1 -- 172.21.15.132:0/981273072 reap_dead start 2024-05-08T18:52:33.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.495+0000 7f8ca472c800 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a48aa40 0x56344a369620 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f8c90051ab0 tx=0x7f8c90052b20 comp rx=0 tx=0).stop 2024-05-08T18:52:33.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.495+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 shutdown_connections 2024-05-08T18:52:33.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.495+0000 7f8ca472c800 1 --2- 172.21.15.132:0/981273072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a48aa40 0x56344a369620 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.495+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 >> 172.21.15.132:0/981273072 conn(0x56344a486d00 msgr2=0x56344a484d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.495+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 shutdown_connections 2024-05-08T18:52:33.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.495+0000 7f8ca472c800 1 -- 172.21.15.132:0/981273072 wait complete. 2024-05-08T18:52:33.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 -- 172.21.15.132:0/2537385998 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8b7803bba0 msgr2=0x7f8b7803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 --2- 172.21.15.132:0/2537385998 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8b7803bba0 0x7f8b7803e060 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8c98022b30 tx=0x7f8c98050ca0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 -- 172.21.15.132:0/2537385998 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a47d7a0 msgr2=0x56344a47dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 --2- 172.21.15.132:0/2537385998 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a47d7a0 0x56344a47dbc0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x56344a463650 tx=0x7f8c90018830 comp rx=0 tx=0).stop 2024-05-08T18:52:33.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 -- 172.21.15.132:0/2537385998 shutdown_connections 2024-05-08T18:52:33.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 --2- 172.21.15.132:0/2537385998 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8b7803bba0 0x7f8b7803e060 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 --2- 172.21.15.132:0/2537385998 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a47d7a0 0x56344a47dbc0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 -- 172.21.15.132:0/2537385998 >> 172.21.15.132:0/2537385998 conn(0x56344a471840 msgr2=0x56344a471c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 -- 172.21.15.132:0/2537385998 shutdown_connections 2024-05-08T18:52:33.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 -- 172.21.15.132:0/2537385998 wait complete. 2024-05-08T18:52:33.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 -- 172.21.15.132:0/3757764579 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56344a36d7f0 msgr2=0x56344a469490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 --2- 172.21.15.132:0/3757764579 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56344a36d7f0 0x56344a469490 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 -- 172.21.15.132:0/3757764579 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56344a46bd20 msgr2=0x56344a46e110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 --2- 172.21.15.132:0/3757764579 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56344a46bd20 0x56344a46e110 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 -- 172.21.15.132:0/3757764579 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8b8803bba0 msgr2=0x7f8b8803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 --2- 172.21.15.132:0/3757764579 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8b8803bba0 0x7f8b8803e060 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8c88054000 tx=0x7f8c8804e000 comp rx=0 tx=0).stop 2024-05-08T18:52:33.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 -- 172.21.15.132:0/3757764579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a369ce0 msgr2=0x56344a462250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 --2- 172.21.15.132:0/3757764579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a369ce0 0x56344a462250 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800c010 tx=0x7f8c98000ed0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 -- 172.21.15.132:0/3757764579 shutdown_connections 2024-05-08T18:52:33.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 --2- 172.21.15.132:0/3757764579 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56344a46bd20 0x56344a46e110 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 --2- 172.21.15.132:0/3757764579 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56344a36d7f0 0x56344a469490 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 --2- 172.21.15.132:0/3757764579 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f8b8803bba0 0x7f8b8803e060 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 --2- 172.21.15.132:0/3757764579 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56344a369ce0 0x56344a462250 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 -- 172.21.15.132:0/3757764579 >> 172.21.15.132:0/3757764579 conn(0x56344a363730 msgr2=0x56344a4547f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 -- 172.21.15.132:0/3757764579 shutdown_connections 2024-05-08T18:52:33.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.496+0000 7f8ca472c800 1 -- 172.21.15.132:0/3757764579 wait complete. 2024-05-08T18:52:33.520 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:52:31.994053Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:31.994040Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:33.520 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:52:31.994053Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:31.994040Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:33.520 ERROR:root:0 2024-05-08T18:52:33.520 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:52:33.525 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx0000016df6a116fdbf6ab-00663bc9f1-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:52:33.525 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-08T18:52:33.525 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-08T18:52:33.525 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-05-08T18:52:33.572 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:33.572 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:33.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.573+0000 7ffa25d35800 1 Processor -- start 2024-05-08T18:52:33.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.573+0000 7ffa25d35800 1 -- start start 2024-05-08T18:52:33.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.573+0000 7ffa25d35800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5568ae50d2c0 0x5568ae50d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.573+0000 7ffa25d35800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5568ae50dd60 con 0x5568ae50e480 2024-05-08T18:52:33.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.573+0000 7ffa25d35800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x5568ae3ade20 con 0x5568ae50d2c0 2024-05-08T18:52:33.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.574+0000 7ffa219ae640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5568ae50d2c0 0x5568ae50d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.574+0000 7ffa219ae640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5568ae50d2c0 0x5568ae50d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53742/0 (socket says 172.21.15.132:53742) 2024-05-08T18:52:33.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.574+0000 7ffa219ae640 1 -- 172.21.15.132:0/2659421504 learned_addr learned my addr 172.21.15.132:0/2659421504 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.574+0000 7ffa191ad640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x5568ae50e480 0x5568ae50e900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48212/0 (socket says 172.21.15.132:48212) 2024-05-08T18:52:33.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.574+0000 7ffa219ae640 1 -- 172.21.15.132:0/2659421504 >> v1:172.21.15.42:6789/0 conn(0x5568ae50e480 legacy=0x5568ae50e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.574+0000 7ffa219ae640 1 -- 172.21.15.132:0/2659421504 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ae50f040 con 0x5568ae50d2c0 2024-05-08T18:52:33.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.576+0000 7ffa219ae640 1 --2- 172.21.15.132:0/2659421504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae50d2c0 0x5568ae50d6e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400a520 tx=0x7ffa1401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c38472094abe825 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.576+0000 7ffa211ad640 1 -- 172.21.15.132:0/2659421504 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa14057070 con 0x5568ae50d2c0 2024-05-08T18:52:33.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.576+0000 7ffa211ad640 1 -- 172.21.15.132:0/2659421504 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa14052570 con 0x5568ae50d2c0 2024-05-08T18:52:33.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.576+0000 7ffa211ad640 1 -- 172.21.15.132:0/2659421504 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa14052870 con 0x5568ae50d2c0 2024-05-08T18:52:33.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.577+0000 7ffa25d35800 1 -- 172.21.15.132:0/2659421504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae50d2c0 msgr2=0x5568ae50d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.577+0000 7ffa25d35800 1 --2- 172.21.15.132:0/2659421504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae50d2c0 0x5568ae50d6e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400a520 tx=0x7ffa1401d010 comp rx=0 tx=0).stop 2024-05-08T18:52:33.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.577+0000 7ffa25d35800 1 -- 172.21.15.132:0/2659421504 shutdown_connections 2024-05-08T18:52:33.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.577+0000 7ffa25d35800 1 --2- 172.21.15.132:0/2659421504 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae50d2c0 0x5568ae50d6e0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.577+0000 7ffa25d35800 1 -- 172.21.15.132:0/2659421504 >> 172.21.15.132:0/2659421504 conn(0x5568ae508840 msgr2=0x5568ae50ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.577+0000 7ffa25d35800 1 -- 172.21.15.132:0/2659421504 shutdown_connections 2024-05-08T18:52:33.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.577+0000 7ffa25d35800 1 -- 172.21.15.132:0/2659421504 wait complete. 2024-05-08T18:52:33.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.590+0000 7ffa25d35800 1 Processor -- start 2024-05-08T18:52:33.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.591+0000 7ffa25d35800 1 -- start start 2024-05-08T18:52:33.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.591+0000 7ffa25d35800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae50d2c0 0x5568ae5fe7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.591+0000 7ffa25d35800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5568ae4585c0 con 0x5568ae50d2c0 2024-05-08T18:52:33.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.591+0000 7ffa219ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae50d2c0 0x5568ae5fe7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.591+0000 7ffa219ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae50d2c0 0x5568ae5fe7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53748/0 (socket says 172.21.15.132:53748) 2024-05-08T18:52:33.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.591+0000 7ffa219ae640 1 -- 172.21.15.132:0/199893344 learned_addr learned my addr 172.21.15.132:0/199893344 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.591+0000 7ffa219ae640 1 -- 172.21.15.132:0/199893344 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ae5fed90 con 0x5568ae50d2c0 2024-05-08T18:52:33.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.592+0000 7ffa219ae640 1 --2- 172.21.15.132:0/199893344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae50d2c0 0x5568ae5fe7c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7ffa14055040 tx=0x7ffa1404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f0f7c81473199a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.592+0000 7ff90fe07640 1 -- 172.21.15.132:0/199893344 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa14057040 con 0x5568ae50d2c0 2024-05-08T18:52:33.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.592+0000 7ff90fe07640 1 -- 172.21.15.132:0/199893344 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa14052850 con 0x5568ae50d2c0 2024-05-08T18:52:33.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.592+0000 7ff90fe07640 1 -- 172.21.15.132:0/199893344 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa14052b50 con 0x5568ae50d2c0 2024-05-08T18:52:33.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.593+0000 7ffa25d35800 1 -- 172.21.15.132:0/199893344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae50d2c0 msgr2=0x5568ae5fe7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.593+0000 7ffa25d35800 1 --2- 172.21.15.132:0/199893344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae50d2c0 0x5568ae5fe7c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7ffa14055040 tx=0x7ffa1404c000 comp rx=0 tx=0).stop 2024-05-08T18:52:33.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.593+0000 7ffa25d35800 1 -- 172.21.15.132:0/199893344 shutdown_connections 2024-05-08T18:52:33.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.593+0000 7ffa25d35800 1 --2- 172.21.15.132:0/199893344 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae50d2c0 0x5568ae5fe7c0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.593+0000 7ffa25d35800 1 -- 172.21.15.132:0/199893344 >> 172.21.15.132:0/199893344 conn(0x5568ae508840 msgr2=0x5568ae5fa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.593+0000 7ffa25d35800 1 -- 172.21.15.132:0/199893344 shutdown_connections 2024-05-08T18:52:33.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.593+0000 7ffa25d35800 1 -- 172.21.15.132:0/199893344 wait complete. 2024-05-08T18:52:33.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.593+0000 7ffa25d35800 1 Processor -- start 2024-05-08T18:52:33.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.593+0000 7ffa25d35800 1 -- start start 2024-05-08T18:52:33.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.593+0000 7ffa25d35800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae50d2c0 0x5568ae606270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.593+0000 7ffa25d35800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5568ae516950 con 0x5568ae50d2c0 2024-05-08T18:52:33.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.593+0000 7ffa219ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae50d2c0 0x5568ae606270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.593+0000 7ffa219ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae50d2c0 0x5568ae606270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53752/0 (socket says 172.21.15.132:53752) 2024-05-08T18:52:33.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.593+0000 7ffa219ae640 1 -- 172.21.15.132:0/185868944 learned_addr learned my addr 172.21.15.132:0/185868944 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.594+0000 7ffa219ae640 1 -- 172.21.15.132:0/185868944 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ae6067b0 con 0x5568ae50d2c0 2024-05-08T18:52:33.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.594+0000 7ffa219ae640 1 --2- 172.21.15.132:0/185868944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae50d2c0 0x5568ae606270 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400a520 tx=0x7ffa14003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.594+0000 7ff90e604640 1 -- 172.21.15.132:0/185868944 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa14073070 con 0x5568ae50d2c0 2024-05-08T18:52:33.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.594+0000 7ff90e604640 1 -- 172.21.15.132:0/185868944 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa1405d570 con 0x5568ae50d2c0 2024-05-08T18:52:33.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.594+0000 7ffa25d35800 1 -- 172.21.15.132:0/185868944 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568ae606a40 con 0x5568ae50d2c0 2024-05-08T18:52:33.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.594+0000 7ff90e604640 1 -- 172.21.15.132:0/185868944 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa14057070 con 0x5568ae50d2c0 2024-05-08T18:52:33.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.594+0000 7ffa25d35800 1 -- 172.21.15.132:0/185868944 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568ae6096f0 con 0x5568ae50d2c0 2024-05-08T18:52:33.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.595+0000 7ff90e604640 1 -- 172.21.15.132:0/185868944 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ffa14076070 con 0x5568ae50d2c0 2024-05-08T18:52:33.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.595+0000 7ff90e604640 1 --2- 172.21.15.132:0/185868944 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff90803bba0 0x7ff90803e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.595+0000 7ff90e604640 1 -- 172.21.15.132:0/185868944 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7ffa140940f0 con 0x5568ae50d2c0 2024-05-08T18:52:33.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.596+0000 7ffa191ad640 1 --2- 172.21.15.132:0/185868944 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff90803bba0 0x7ff90803e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.596+0000 7ffa25d35800 1 --2- 172.21.15.132:0/185868944 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5568ae50e480 0x5568ae60d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.596+0000 7ffa25d35800 1 -- 172.21.15.132:0/185868944 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568ae60d9f0 con 0x5568ae50e480 2024-05-08T18:52:33.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.596+0000 7ffa221af640 1 --2- 172.21.15.132:0/185868944 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5568ae50e480 0x5568ae60d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.596+0000 7ffa191ad640 1 --2- 172.21.15.132:0/185868944 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff90803bba0 0x7ff90803e060 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c000f60 tx=0x7ffa0c001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.596+0000 7ffa221af640 1 --2- 172.21.15.132:0/185868944 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5568ae50e480 0x5568ae60d4b0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.596+0000 7ffa221af640 1 -- 172.21.15.132:0/185868944 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa1c00a4a0 con 0x5568ae50e480 2024-05-08T18:52:33.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.596+0000 7ffa25d35800 1 -- 172.21.15.132:0/185868944 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568ae60aa60 con 0x5568ae50e480 2024-05-08T18:52:33.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.597+0000 7ffa221af640 1 -- 172.21.15.132:0/185868944 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa1c00a4a0 con 0x5568ae50e480 2024-05-08T18:52:33.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.597+0000 7ffa25d35800 1 --2- 172.21.15.132:0/185868944 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5568ae60fd10 0x5568ae612100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.597+0000 7ffa25d35800 1 -- 172.21.15.132:0/185868944 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568ae6127f0 con 0x5568ae60fd10 2024-05-08T18:52:33.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.597+0000 7ffa219ae640 1 --2- 172.21.15.132:0/185868944 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5568ae60fd10 0x5568ae612100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.597+0000 7ffa219ae640 1 --2- 172.21.15.132:0/185868944 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5568ae60fd10 0x5568ae612100 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.597+0000 7ffa219ae640 1 -- 172.21.15.132:0/185868944 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffa14075030 con 0x5568ae60fd10 2024-05-08T18:52:33.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.597+0000 7ffa25d35800 1 -- 172.21.15.132:0/185868944 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568ae60eb80 con 0x5568ae50e480 2024-05-08T18:52:33.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.597+0000 7ffa221af640 1 -- 172.21.15.132:0/185868944 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa1c00a4a0 con 0x5568ae50e480 2024-05-08T18:52:33.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.598+0000 7ffa25d35800 1 -- 172.21.15.132:0/185868944 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568ae60f060 con 0x5568ae50e480 2024-05-08T18:52:33.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.598+0000 7ffa221af640 1 -- 172.21.15.132:0/185868944 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffa1c00a4a0 con 0x5568ae50e480 2024-05-08T18:52:33.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.598+0000 7ffa25d35800 1 Processor -- start 2024-05-08T18:52:33.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.598+0000 7ffa25d35800 1 -- start start 2024-05-08T18:52:33.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.598+0000 7ffa25d35800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae621700 0x5568ae621b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.598+0000 7ffa25d35800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5568ae3fefc0 con 0x5568ae621700 2024-05-08T18:52:33.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.599+0000 7ffa221af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae621700 0x5568ae621b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.599+0000 7ffa221af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae621700 0x5568ae621b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53758/0 (socket says 172.21.15.132:53758) 2024-05-08T18:52:33.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.599+0000 7ffa221af640 1 -- 172.21.15.132:0/44435851 learned_addr learned my addr 172.21.15.132:0/44435851 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.599+0000 7ffa221af640 1 -- 172.21.15.132:0/44435851 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ae622060 con 0x5568ae621700 2024-05-08T18:52:33.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.599+0000 7ffa221af640 1 --2- 172.21.15.132:0/44435851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae621700 0x5568ae621b20 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x5568ae60dd90 tx=0x7ffa1c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.599+0000 7ff9077fe640 1 -- 172.21.15.132:0/44435851 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1c014450 con 0x5568ae621700 2024-05-08T18:52:33.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.599+0000 7ff9077fe640 1 -- 172.21.15.132:0/44435851 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa1c014610 con 0x5568ae621700 2024-05-08T18:52:33.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.599+0000 7ff9077fe640 1 -- 172.21.15.132:0/44435851 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1c014930 con 0x5568ae621700 2024-05-08T18:52:33.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.599+0000 7ffa25d35800 1 -- 172.21.15.132:0/44435851 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568ae622ad0 con 0x5568ae621700 2024-05-08T18:52:33.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.599+0000 7ffa25d35800 1 -- 172.21.15.132:0/44435851 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568ae622fd0 con 0x5568ae621700 2024-05-08T18:52:33.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.600+0000 7ff9077fe640 1 -- 172.21.15.132:0/44435851 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ffa1c011040 con 0x5568ae621700 2024-05-08T18:52:33.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.600+0000 7ff9077fe640 1 --2- 172.21.15.132:0/44435851 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8fc03bb50 0x7ff8fc03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.600+0000 7ff9077fe640 1 -- 172.21.15.132:0/44435851 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7ffa1c01e070 con 0x5568ae621700 2024-05-08T18:52:33.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.600+0000 7ffa219ae640 1 --2- 172.21.15.132:0/44435851 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8fc03bb50 0x7ff8fc03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.601+0000 7ffa25d35800 1 Processor -- start 2024-05-08T18:52:33.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.601+0000 7ffa25d35800 1 -- start start 2024-05-08T18:52:33.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.601+0000 7ffa219ae640 1 --2- 172.21.15.132:0/44435851 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8fc03bb50 0x7ff8fc03e010 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ffa14044830 tx=0x7ffa14066750 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.601+0000 7ffa25d35800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae482930 0x5568ae482d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.601+0000 7ffa25d35800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5568ae5ff050 con 0x5568ae482930 2024-05-08T18:52:33.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.601+0000 7ffa221af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae482930 0x5568ae482d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.601+0000 7ffa221af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae482930 0x5568ae482d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53768/0 (socket says 172.21.15.132:53768) 2024-05-08T18:52:33.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.601+0000 7ffa221af640 1 -- 172.21.15.132:0/4151925514 learned_addr learned my addr 172.21.15.132:0/4151925514 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.601+0000 7ffa221af640 1 -- 172.21.15.132:0/4151925514 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ae481130 con 0x5568ae482930 2024-05-08T18:52:33.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.602+0000 7ffa221af640 1 --2- 172.21.15.132:0/4151925514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae482930 0x5568ae482d50 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c013fd0 tx=0x7ffa1c0118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd635f53d8aa6e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.602+0000 7ff9057fa640 1 -- 172.21.15.132:0/4151925514 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1c011c00 con 0x5568ae482930 2024-05-08T18:52:33.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.602+0000 7ff9057fa640 1 -- 172.21.15.132:0/4151925514 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa1c050070 con 0x5568ae482930 2024-05-08T18:52:33.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.602+0000 7ff9057fa640 1 -- 172.21.15.132:0/4151925514 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1c014ad0 con 0x5568ae482930 2024-05-08T18:52:33.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.602+0000 7ffa25d35800 1 -- 172.21.15.132:0/4151925514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae482930 msgr2=0x5568ae482d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.602+0000 7ffa25d35800 1 --2- 172.21.15.132:0/4151925514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae482930 0x5568ae482d50 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c013fd0 tx=0x7ffa1c0118e0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.602+0000 7ffa25d35800 1 -- 172.21.15.132:0/4151925514 shutdown_connections 2024-05-08T18:52:33.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.602+0000 7ffa25d35800 1 --2- 172.21.15.132:0/4151925514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae482930 0x5568ae482d50 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.602+0000 7ffa25d35800 1 -- 172.21.15.132:0/4151925514 >> 172.21.15.132:0/4151925514 conn(0x5568ae62ad40 msgr2=0x5568ae628da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.602+0000 7ffa25d35800 1 -- 172.21.15.132:0/4151925514 shutdown_connections 2024-05-08T18:52:33.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.602+0000 7ffa25d35800 1 -- 172.21.15.132:0/4151925514 wait complete. 2024-05-08T18:52:33.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.603+0000 7ffa25d35800 1 Processor -- start 2024-05-08T18:52:33.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.603+0000 7ffa25d35800 1 -- start start 2024-05-08T18:52:33.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.603+0000 7ffa25d35800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae482930 0x5568ae638130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.603+0000 7ffa25d35800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5568ae481600 con 0x5568ae482930 2024-05-08T18:52:33.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.603+0000 7ffa221af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae482930 0x5568ae638130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.603+0000 7ffa221af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae482930 0x5568ae638130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53782/0 (socket says 172.21.15.132:53782) 2024-05-08T18:52:33.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.603+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 learned_addr learned my addr 172.21.15.132:0/1531859481 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.603+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ae638670 con 0x5568ae482930 2024-05-08T18:52:33.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.603+0000 7ffa221af640 1 --2- 172.21.15.132:0/1531859481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae482930 0x5568ae638130 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c022a80 tx=0x7ffa1c052d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.604+0000 7ff8f37fe640 1 -- 172.21.15.132:0/1531859481 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1c0543a0 con 0x5568ae482930 2024-05-08T18:52:33.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.604+0000 7ff8f37fe640 1 -- 172.21.15.132:0/1531859481 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa1c031030 con 0x5568ae482930 2024-05-08T18:52:33.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.604+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568ae638900 con 0x5568ae482930 2024-05-08T18:52:33.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.604+0000 7ff8f37fe640 1 -- 172.21.15.132:0/1531859481 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1c054690 con 0x5568ae482930 2024-05-08T18:52:33.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.604+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568ae63b5b0 con 0x5568ae482930 2024-05-08T18:52:33.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.604+0000 7ff8f37fe640 1 -- 172.21.15.132:0/1531859481 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7ffa1c051280 con 0x5568ae482930 2024-05-08T18:52:33.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.605+0000 7ff8f37fe640 1 --2- 172.21.15.132:0/1531859481 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8ec03bb50 0x7ff8ec03e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.605+0000 7ff8f37fe640 1 -- 172.21.15.132:0/1531859481 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7ffa1c054070 con 0x5568ae482930 2024-05-08T18:52:33.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.605+0000 7ffa219ae640 1 --2- 172.21.15.132:0/1531859481 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8ec03bb50 0x7ff8ec03e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.605+0000 7ffa219ae640 1 --2- 172.21.15.132:0/1531859481 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8ec03bb50 0x7ff8ec03e010 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ffa14094060 tx=0x7ffa1407f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.605+0000 7ffa25d35800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.605+0000 7ffa25d35800 1 --2- 172.21.15.132:0/1531859481 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5568ae643dd0 0x5568ae646290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.605+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568ae6469e0 con 0x5568ae643dd0 2024-05-08T18:52:33.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.605+0000 7ffa191ad640 1 --2- 172.21.15.132:0/1531859481 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5568ae643dd0 0x5568ae646290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.606+0000 7ffa191ad640 1 --2- 172.21.15.132:0/1531859481 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5568ae643dd0 0x5568ae646290 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.606+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa0c00f610 con 0x5568ae643dd0 2024-05-08T18:52:33.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.606+0000 7ffa25d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.606+0000 7ffa25d35800 20 realm 2024-05-08T18:52:33.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.606+0000 7ffa25d35800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.606+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568ae643220 con 0x5568ae643dd0 2024-05-08T18:52:33.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.606+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa0c00f610 con 0x5568ae643dd0 2024-05-08T18:52:33.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.606+0000 7ffa25d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.606+0000 7ffa25d35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:52:33.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.606+0000 7ffa25d35800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.606+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568ae6474d0 con 0x5568ae643dd0 2024-05-08T18:52:33.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.606+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa0c00f610 con 0x5568ae643dd0 2024-05-08T18:52:33.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.606+0000 7ffa25d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.606+0000 7ffa25d35800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.606+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568ae647da0 con 0x5568ae643dd0 2024-05-08T18:52:33.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.607+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa0c00f610 con 0x5568ae643dd0 2024-05-08T18:52:33.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.607+0000 7ffa25d35800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:33.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.607+0000 7ffa25d35800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.607+0000 7ffa25d35800 1 --2- 172.21.15.132:0/1531859481 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5568ae6487c0 0x5568ae64abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.607+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64b2a0 con 0x5568ae6487c0 2024-05-08T18:52:33.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.607+0000 7ffa221af640 1 --2- 172.21.15.132:0/1531859481 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5568ae6487c0 0x5568ae64abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.607+0000 7ffa221af640 1 --2- 172.21.15.132:0/1531859481 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5568ae6487c0 0x5568ae64abb0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.607+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffa1c03d070 con 0x5568ae6487c0 2024-05-08T18:52:33.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.607+0000 7ffa25d35800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:52:33.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.607+0000 7ffa25d35800 20 searching for the correct realm 2024-05-08T18:52:33.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.607+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x5568ae6487c0 2024-05-08T18:52:33.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.608+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c03d070 con 0x5568ae6487c0 2024-05-08T18:52:33.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.608+0000 7ffa221af640 1 --2- 172.21.15.132:0/1531859481 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7ffa1c014070 0x7ffa1c023a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.608+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x7ffa1c014070 2024-05-08T18:52:33.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.608+0000 7ffa219ae640 1 --2- 172.21.15.132:0/1531859481 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7ffa1c014070 0x7ffa1c023a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.608+0000 7ffa219ae640 1 --2- 172.21.15.132:0/1531859481 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7ffa1c014070 0x7ffa1c023a70 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.608+0000 7ffa219ae640 1 -- 172.21.15.132:0/1531859481 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa14075030 con 0x7ffa1c014070 2024-05-08T18:52:33.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.608+0000 7ffa219ae640 1 --2- 172.21.15.132:0/1531859481 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7ffa140a2040 0x7ffa14076360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.608+0000 7ffa219ae640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x7ffa140a2040 2024-05-08T18:52:33.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.609+0000 7ffa191ad640 1 --2- 172.21.15.132:0/1531859481 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7ffa140a2040 0x7ffa14076360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.609+0000 7ffa191ad640 1 --2- 172.21.15.132:0/1531859481 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7ffa140a2040 0x7ffa14076360 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.609+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa0c00f610 con 0x7ffa140a2040 2024-05-08T18:52:33.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.609+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x5568ae643dd0 2024-05-08T18:52:33.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.610+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa0c00f610 con 0x5568ae643dd0 2024-05-08T18:52:33.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.610+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x5568ae643dd0 2024-05-08T18:52:33.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.610+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa0c02b040 con 0x5568ae643dd0 2024-05-08T18:52:33.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.610+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x7ffa140a2040 2024-05-08T18:52:33.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.610+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa0c02b040 con 0x7ffa140a2040 2024-05-08T18:52:33.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.610+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x7ffa140a2040 2024-05-08T18:52:33.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.610+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa0c02b040 con 0x7ffa140a2040 2024-05-08T18:52:33.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.610+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x7ffa1c014070 2024-05-08T18:52:33.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.610+0000 7ffa219ae640 1 -- 172.21.15.132:0/1531859481 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa14075030 con 0x7ffa1c014070 2024-05-08T18:52:33.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.610+0000 7ffa219ae640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x5568ae6487c0 2024-05-08T18:52:33.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.611+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c03d070 con 0x5568ae6487c0 2024-05-08T18:52:33.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.611+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x5568ae643dd0 2024-05-08T18:52:33.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.611+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa0c02b040 con 0x5568ae643dd0 2024-05-08T18:52:33.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.611+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x7ffa140a2040 2024-05-08T18:52:33.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.611+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa0c02b040 con 0x7ffa140a2040 2024-05-08T18:52:33.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.611+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x5568ae643dd0 2024-05-08T18:52:33.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.611+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffa0c02b040 con 0x5568ae643dd0 2024-05-08T18:52:33.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.611+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x7ffa1c014070 2024-05-08T18:52:33.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.612+0000 7ffa219ae640 1 -- 172.21.15.132:0/1531859481 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffa14075030 con 0x7ffa1c014070 2024-05-08T18:52:33.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.612+0000 7ffa219ae640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x5568ae6487c0 2024-05-08T18:52:33.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.612+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v27'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffa1c03d070 con 0x5568ae6487c0 2024-05-08T18:52:33.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.612+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x5568ae6487c0 2024-05-08T18:52:33.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.612+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c03d070 con 0x5568ae6487c0 2024-05-08T18:52:33.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.612+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x7ffa140a2040 2024-05-08T18:52:33.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.612+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa0c02b040 con 0x7ffa140a2040 2024-05-08T18:52:33.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.612+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x5568ae6487c0 2024-05-08T18:52:33.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.613+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c03d070 con 0x5568ae6487c0 2024-05-08T18:52:33.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.613+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x5568ae6487c0 2024-05-08T18:52:33.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.613+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c03d070 con 0x5568ae6487c0 2024-05-08T18:52:33.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.613+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x5568ae643dd0 2024-05-08T18:52:33.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.613+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa0c02b040 con 0x5568ae643dd0 2024-05-08T18:52:33.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.613+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x5568ae643dd0 2024-05-08T18:52:33.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.613+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v27'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffa0c02b040 con 0x5568ae643dd0 2024-05-08T18:52:33.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.613+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x7ffa140a2040 2024-05-08T18:52:33.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.614+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa0c02b040 con 0x7ffa140a2040 2024-05-08T18:52:33.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.614+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x5568ae6487c0 2024-05-08T18:52:33.628 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.614+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c06a040 con 0x5568ae6487c0 2024-05-08T18:52:33.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.614+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x7ffa1c014070 2024-05-08T18:52:33.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.614+0000 7ffa219ae640 1 -- 172.21.15.132:0/1531859481 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa14075030 con 0x7ffa1c014070 2024-05-08T18:52:33.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.614+0000 7ffa219ae640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x5568ae643dd0 2024-05-08T18:52:33.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.614+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa0c02b040 con 0x5568ae643dd0 2024-05-08T18:52:33.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.614+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x7ffa1c014070 2024-05-08T18:52:33.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.615+0000 7ffa219ae640 1 -- 172.21.15.132:0/1531859481 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa14075030 con 0x7ffa1c014070 2024-05-08T18:52:33.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.615+0000 7ffa219ae640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x5568ae6487c0 2024-05-08T18:52:33.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.615+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c06a040 con 0x5568ae6487c0 2024-05-08T18:52:33.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.615+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x7ffa140a2040 2024-05-08T18:52:33.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.615+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa0c02b040 con 0x7ffa140a2040 2024-05-08T18:52:33.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.615+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x7ffa1c014070 2024-05-08T18:52:33.629 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.615+0000 7ffa219ae640 1 -- 172.21.15.132:0/1531859481 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa14075030 con 0x7ffa1c014070 2024-05-08T18:52:33.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.616+0000 7ffa219ae640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x5568ae6487c0 2024-05-08T18:52:33.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.616+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c06a040 con 0x5568ae6487c0 2024-05-08T18:52:33.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.616+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x7ffa140a2040 2024-05-08T18:52:33.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.616+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa0c02b040 con 0x7ffa140a2040 2024-05-08T18:52:33.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.616+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x5568ae643dd0 2024-05-08T18:52:33.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.616+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v27'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffa0c02b040 con 0x5568ae643dd0 2024-05-08T18:52:33.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.616+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64cbf0 con 0x7ffa1c014070 2024-05-08T18:52:33.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa219ae640 1 -- 172.21.15.132:0/1531859481 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa14075030 con 0x7ffa1c014070 2024-05-08T18:52:33.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:52:33.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:52:33.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:52:33.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:52:33.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:52:33.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:52:33.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64bc60 con 0x5568ae643dd0 2024-05-08T18:52:33.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa0c02b040 con 0x5568ae643dd0 2024-05-08T18:52:33.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64c500 con 0x5568ae643dd0 2024-05-08T18:52:33.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa0c02b040 con 0x5568ae643dd0 2024-05-08T18:52:33.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:33.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64d070 con 0x5568ae643dd0 2024-05-08T18:52:33.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffa0c02b040 con 0x5568ae643dd0 2024-05-08T18:52:33.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:52:33.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 20 zone default found 2024-05-08T18:52:33.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 4 Realm: () 2024-05-08T18:52:33.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:52:33.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:52:33.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:52:33.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 20 zonegroup default 2024-05-08T18:52:33.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.617+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64d430 con 0x7ffa1c014070 2024-05-08T18:52:33.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.618+0000 7ffa219ae640 1 -- 172.21.15.132:0/1531859481 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffa14075030 con 0x7ffa1c014070 2024-05-08T18:52:33.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.618+0000 7ffa25d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.618+0000 7ffa25d35800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.618+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64f700 con 0x5568ae6487c0 2024-05-08T18:52:33.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.618+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa1c06a040 con 0x5568ae6487c0 2024-05-08T18:52:33.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.618+0000 7ffa25d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.618+0000 7ffa25d35800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.618+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64faa0 con 0x5568ae6487c0 2024-05-08T18:52:33.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.618+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa1c06a040 con 0x5568ae6487c0 2024-05-08T18:52:33.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.618+0000 7ffa25d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.618+0000 7ffa25d35800 20 started sync module instance, tier type = 2024-05-08T18:52:33.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.618+0000 7ffa25d35800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:52:33.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.618+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae64eb90 con 0x7ffa1c014070 2024-05-08T18:52:33.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.619+0000 7ffa219ae640 1 -- 172.21.15.132:0/1531859481 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa14075030 con 0x7ffa1c014070 2024-05-08T18:52:33.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.619+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93908090810240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae6502f0 con 0x7ffa1c014070 2024-05-08T18:52:33.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.619+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae650b40 con 0x5568ae643dd0 2024-05-08T18:52:33.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.620+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa0c02b040 con 0x5568ae643dd0 2024-05-08T18:52:33.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.620+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93908090816144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae651100 con 0x5568ae643dd0 2024-05-08T18:52:33.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.620+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae651c20 con 0x5568ae6487c0 2024-05-08T18:52:33.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.620+0000 7ffa219ae640 1 -- 172.21.15.132:0/1531859481 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93908090810240] v27'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa14075030 con 0x7ffa1c014070 2024-05-08T18:52:33.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.621+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93908090816144] v27'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa0c02b040 con 0x5568ae643dd0 2024-05-08T18:52:33.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.621+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1c06a040 con 0x5568ae6487c0 2024-05-08T18:52:33.643 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.622+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93908090820336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae651be0 con 0x5568ae6487c0 2024-05-08T18:52:33.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.622+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae6524c0 con 0x7ffa1c014070 2024-05-08T18:52:33.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.622+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93908090820336] v27'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1c06a040 con 0x5568ae6487c0 2024-05-08T18:52:33.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.623+0000 7ffa219ae640 1 -- 172.21.15.132:0/1531859481 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa14075030 con 0x7ffa1c014070 2024-05-08T18:52:33.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.623+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93908090822672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae651c20 con 0x7ffa1c014070 2024-05-08T18:52:33.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.623+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae652fb0 con 0x5568ae643dd0 2024-05-08T18:52:33.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.624+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa0c02b040 con 0x5568ae643dd0 2024-05-08T18:52:33.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.624+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93908090825344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae653850 con 0x5568ae643dd0 2024-05-08T18:52:33.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.624+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae654330 con 0x7ffa140a2040 2024-05-08T18:52:33.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.624+0000 7ffa219ae640 1 -- 172.21.15.132:0/1531859481 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93908090822672] v27'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa14075030 con 0x7ffa1c014070 2024-05-08T18:52:33.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.625+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93908090825344] v27'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa0c02b040 con 0x5568ae643dd0 2024-05-08T18:52:33.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.625+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa0c02b040 con 0x7ffa140a2040 2024-05-08T18:52:33.644 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.625+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93908090830400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae6532d0 con 0x7ffa140a2040 2024-05-08T18:52:33.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.625+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae654bd0 con 0x7ffa140a2040 2024-05-08T18:52:33.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.626+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93908090830400] v27'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa0c02b040 con 0x7ffa140a2040 2024-05-08T18:52:33.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.626+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa0c02b040 con 0x7ffa140a2040 2024-05-08T18:52:33.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.626+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93908090814016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae6532d0 con 0x7ffa140a2040 2024-05-08T18:52:33.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.626+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae6551d0 con 0x7ffa140a2040 2024-05-08T18:52:33.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.627+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93908090814016] v27'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa0c02b040 con 0x7ffa140a2040 2024-05-08T18:52:33.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.627+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa0c02b040 con 0x7ffa140a2040 2024-05-08T18:52:33.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.627+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93908090834080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae655190 con 0x7ffa140a2040 2024-05-08T18:52:33.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.627+0000 7ffa25d35800 20 add_watcher() i=0 2024-05-08T18:52:33.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.627+0000 7ffa25d35800 20 add_watcher() i=1 2024-05-08T18:52:33.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.627+0000 7ffa25d35800 20 add_watcher() i=2 2024-05-08T18:52:33.645 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.627+0000 7ffa25d35800 20 add_watcher() i=3 2024-05-08T18:52:33.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.627+0000 7ffa25d35800 20 add_watcher() i=4 2024-05-08T18:52:33.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.627+0000 7ffa25d35800 20 add_watcher() i=5 2024-05-08T18:52:33.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.627+0000 7ffa25d35800 20 add_watcher() i=6 2024-05-08T18:52:33.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.628+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93908090834080] v27'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa0c02b040 con 0x7ffa140a2040 2024-05-08T18:52:33.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.628+0000 7ffa25d35800 20 add_watcher() i=7 2024-05-08T18:52:33.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.628+0000 7ffa25d35800 2 all 8 watchers are set, enabling cache 2024-05-08T18:52:33.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.628+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568ae658670 con 0x5568ae643dd0 2024-05-08T18:52:33.646 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.629+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffa0c02b040 con 0x5568ae643dd0 2024-05-08T18:52:33.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.629+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93908090832336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae655a40 con 0x5568ae643dd0 2024-05-08T18:52:33.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.630+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93908090832336] v27'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa0c02b040 con 0x5568ae643dd0 2024-05-08T18:52:33.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.630+0000 7ff8d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:33.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.630+0000 7ffa25d35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:33.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.630+0000 7ffa25d35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:33.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.630+0000 7ffa25d35800 5 note: GC not initialized 2024-05-08T18:52:33.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.630+0000 7ff8d27fc640 20 reqs_thread_entry: start 2024-05-08T18:52:33.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.630+0000 7ffa25d35800 20 init_complete bucket index max shards: 11 2024-05-08T18:52:33.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.630+0000 7ffa25d35800 20 Filter name: none 2024-05-08T18:52:33.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.630+0000 7ff843fff640 20 reqs_thread_entry: start 2024-05-08T18:52:33.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.630+0000 7ffa25d35800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:52:33.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.630+0000 7ffa25d35800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.630+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568ae68bb30 con 0x7ffa140a2040 2024-05-08T18:52:33.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.631+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7ffa0c02b040 con 0x7ffa140a2040 2024-05-08T18:52:33.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.631+0000 7ffa25d35800 20 rados_obj.operate() r=0 bl.length=490 2024-05-08T18:52:33.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.631+0000 7ffa25d35800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:52:33.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.631+0000 7ffa25d35800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:33.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.631+0000 7ffa25d35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:52:33.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.631+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae6923c0 con 0x7ffa140a2040 2024-05-08T18:52:33.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.633+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v27'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ffa0c02b040 con 0x7ffa140a2040 2024-05-08T18:52:33.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.633+0000 7ffa25d35800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:52:33.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.633+0000 7ffa25d35800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:33.648 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.633+0000 7ffa25d35800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:52:33.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.633+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93908091084160 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5568ae68d9c0 con 0x5568ae643dd0 2024-05-08T18:52:33.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.633+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== watch-notify(notify (1) cookie 93908090825344 notify 115964117021 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7ffa0c018040 con 0x5568ae643dd0 2024-05-08T18:52:33.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.633+0000 7ff9057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117021 cookie 93908090825344 notifier 4900 bl.length()=636 2024-05-08T18:52:33.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.633+0000 7ff9057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:52:33.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.633+0000 7ff9057fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:33.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.633+0000 7ff9057fa640 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7ff8e4003ea0 con 0x5568ae643dd0 2024-05-08T18:52:33.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.633+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 notify.4 [notify cookie 93908091084160 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffa0c02b040 con 0x5568ae643dd0 2024-05-08T18:52:33.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.633+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== watch-notify(notify_complete (2) cookie 93908091084160 notify 115964117021 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ffa0c009050 con 0x5568ae643dd0 2024-05-08T18:52:33.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.633+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa0c02b040 con 0x5568ae643dd0 2024-05-08T18:52:33.649 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:52:31.994053Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:52:31.994040Z","tags":[],"group_ids":[]} 2024-05-08T18:52:33.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.634+0000 7ff8d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:33.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.634+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93908090832336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae63faa0 con 0x5568ae643dd0 2024-05-08T18:52:33.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.635+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93908090832336] v27'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa0c02b040 con 0x5568ae643dd0 2024-05-08T18:52:33.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.635+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93908090810240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae6545d0 con 0x7ffa1c014070 2024-05-08T18:52:33.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.636+0000 7ffa219ae640 1 -- 172.21.15.132:0/1531859481 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93908090810240] v27'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa14075030 con 0x7ffa1c014070 2024-05-08T18:52:33.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.636+0000 7ffa25d35800 20 remove_watcher() i=0 2024-05-08T18:52:33.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.636+0000 7ffa25d35800 2 removed watcher, disabling cache 2024-05-08T18:52:33.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.636+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93908090816144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae6545d0 con 0x5568ae643dd0 2024-05-08T18:52:33.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.637+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93908090816144] v27'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa0c02b040 con 0x5568ae643dd0 2024-05-08T18:52:33.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.637+0000 7ffa25d35800 20 remove_watcher() i=1 2024-05-08T18:52:33.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.637+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93908090820336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae6545d0 con 0x5568ae6487c0 2024-05-08T18:52:33.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.638+0000 7ffa221af640 1 -- 172.21.15.132:0/1531859481 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93908090820336] v27'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1c06a040 con 0x5568ae6487c0 2024-05-08T18:52:33.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.638+0000 7ffa25d35800 20 remove_watcher() i=2 2024-05-08T18:52:33.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.638+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93908090822672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae6545d0 con 0x7ffa1c014070 2024-05-08T18:52:33.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.639+0000 7ffa219ae640 1 -- 172.21.15.132:0/1531859481 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93908090822672] v27'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa14075030 con 0x7ffa1c014070 2024-05-08T18:52:33.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.639+0000 7ffa25d35800 20 remove_watcher() i=3 2024-05-08T18:52:33.656 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.639+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93908090825344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae652010 con 0x5568ae643dd0 2024-05-08T18:52:33.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.640+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93908090825344] v27'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa0c02b040 con 0x5568ae643dd0 2024-05-08T18:52:33.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.640+0000 7ffa25d35800 20 remove_watcher() i=4 2024-05-08T18:52:33.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.640+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93908090830400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae6545d0 con 0x7ffa140a2040 2024-05-08T18:52:33.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.642+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93908090830400] v27'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa0c02b040 con 0x7ffa140a2040 2024-05-08T18:52:33.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.642+0000 7ffa25d35800 20 remove_watcher() i=5 2024-05-08T18:52:33.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.642+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93908090814016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae652010 con 0x7ffa140a2040 2024-05-08T18:52:33.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.643+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93908090814016] v27'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa0c02b040 con 0x7ffa140a2040 2024-05-08T18:52:33.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.643+0000 7ffa25d35800 20 remove_watcher() i=6 2024-05-08T18:52:33.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.643+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93908090834080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5568ae6545d0 con 0x7ffa140a2040 2024-05-08T18:52:33.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93908090834080] v27'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa0c02b040 con 0x7ffa140a2040 2024-05-08T18:52:33.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 20 remove_watcher() i=7 2024-05-08T18:52:33.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7ffa140a2040 msgr2=0x7ffa14076360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 --2- 172.21.15.132:0/1531859481 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7ffa140a2040 0x7ffa14076360 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5568ae643dd0 msgr2=0x5568ae646290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 --2- 172.21.15.132:0/1531859481 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5568ae643dd0 0x5568ae646290 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7ffa1c014070 msgr2=0x7ffa1c023a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 --2- 172.21.15.132:0/1531859481 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7ffa1c014070 0x7ffa1c023a70 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5568ae6487c0 msgr2=0x5568ae64abb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 --2- 172.21.15.132:0/1531859481 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5568ae6487c0 0x5568ae64abb0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8ec03bb50 msgr2=0x7ff8ec03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 --2- 172.21.15.132:0/1531859481 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8ec03bb50 0x7ff8ec03e010 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ffa14094060 tx=0x7ffa1407f000 comp rx=0 tx=0).stop 2024-05-08T18:52:33.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae482930 msgr2=0x5568ae638130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 --2- 172.21.15.132:0/1531859481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae482930 0x5568ae638130 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c022a80 tx=0x7ffa1c052d50 comp rx=0 tx=0).stop 2024-05-08T18:52:33.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 reap_dead start 2024-05-08T18:52:33.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa191ad640 1 -- 172.21.15.132:0/1531859481 reap_dead start 2024-05-08T18:52:33.658 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 shutdown_connections 2024-05-08T18:52:33.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 >> 172.21.15.132:0/1531859481 conn(0x5568ae62ad40 msgr2=0x5568ae6283a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 shutdown_connections 2024-05-08T18:52:33.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 -- 172.21.15.132:0/1531859481 wait complete. 2024-05-08T18:52:33.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 -- 172.21.15.132:0/44435851 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8fc03bb50 msgr2=0x7ff8fc03e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 --2- 172.21.15.132:0/44435851 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8fc03bb50 0x7ff8fc03e010 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ffa14044830 tx=0x7ffa14066750 comp rx=0 tx=0).stop 2024-05-08T18:52:33.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 -- 172.21.15.132:0/44435851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae621700 msgr2=0x5568ae621b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 --2- 172.21.15.132:0/44435851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae621700 0x5568ae621b20 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x5568ae60dd90 tx=0x7ffa1c018830 comp rx=0 tx=0).stop 2024-05-08T18:52:33.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 -- 172.21.15.132:0/44435851 shutdown_connections 2024-05-08T18:52:33.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 --2- 172.21.15.132:0/44435851 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff8fc03bb50 0x7ff8fc03e010 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 --2- 172.21.15.132:0/44435851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae621700 0x5568ae621b20 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.644+0000 7ffa25d35800 1 -- 172.21.15.132:0/44435851 >> 172.21.15.132:0/44435851 conn(0x5568ae6157a0 msgr2=0x5568ae615ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.645+0000 7ffa25d35800 1 -- 172.21.15.132:0/44435851 shutdown_connections 2024-05-08T18:52:33.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.645+0000 7ffa25d35800 1 -- 172.21.15.132:0/44435851 wait complete. 2024-05-08T18:52:33.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.645+0000 7ffa25d35800 1 -- 172.21.15.132:0/185868944 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5568ae50e480 msgr2=0x5568ae60d4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.645+0000 7ffa25d35800 1 --2- 172.21.15.132:0/185868944 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5568ae50e480 0x5568ae60d4b0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.645+0000 7ffa25d35800 1 -- 172.21.15.132:0/185868944 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5568ae60fd10 msgr2=0x5568ae612100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.645+0000 7ffa25d35800 1 --2- 172.21.15.132:0/185868944 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5568ae60fd10 0x5568ae612100 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.645+0000 7ffa25d35800 1 -- 172.21.15.132:0/185868944 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff90803bba0 msgr2=0x7ff90803e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.645+0000 7ffa25d35800 1 --2- 172.21.15.132:0/185868944 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff90803bba0 0x7ff90803e060 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c000f60 tx=0x7ffa0c001370 comp rx=0 tx=0).stop 2024-05-08T18:52:33.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.645+0000 7ffa25d35800 1 -- 172.21.15.132:0/185868944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae50d2c0 msgr2=0x5568ae606270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.645+0000 7ffa25d35800 1 --2- 172.21.15.132:0/185868944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae50d2c0 0x5568ae606270 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400a520 tx=0x7ffa14003020 comp rx=0 tx=0).stop 2024-05-08T18:52:33.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.645+0000 7ffa25d35800 1 -- 172.21.15.132:0/185868944 shutdown_connections 2024-05-08T18:52:33.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.645+0000 7ffa25d35800 1 --2- 172.21.15.132:0/185868944 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5568ae60fd10 0x5568ae612100 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.645+0000 7ffa25d35800 1 --2- 172.21.15.132:0/185868944 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5568ae50e480 0x5568ae60d4b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.645+0000 7ffa25d35800 1 --2- 172.21.15.132:0/185868944 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7ff90803bba0 0x7ff90803e060 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.645+0000 7ffa25d35800 1 --2- 172.21.15.132:0/185868944 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5568ae50d2c0 0x5568ae606270 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.645+0000 7ffa25d35800 1 -- 172.21.15.132:0/185868944 >> 172.21.15.132:0/185868944 conn(0x5568ae508840 msgr2=0x5568ae5f88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.645+0000 7ffa25d35800 1 -- 172.21.15.132:0/185868944 shutdown_connections 2024-05-08T18:52:33.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.645+0000 7ffa25d35800 1 -- 172.21.15.132:0/185868944 wait complete. 2024-05-08T18:52:33.661 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:52:31.994053Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:31.994040Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:33.661 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:52:31.994053Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:31.994040Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:33.661 ERROR:root:0 2024-05-08T18:52:33.661 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:52:33.661 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:52:33.662 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-05-08T18:52:33.707 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:33.708 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:33.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.709+0000 7f1f415af800 1 Processor -- start 2024-05-08T18:52:33.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.709+0000 7f1f415af800 1 -- start start 2024-05-08T18:52:33.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.709+0000 7f1f415af800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5562e9ca0600 0x5562e9ca29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.709+0000 7f1f415af800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5562e9ca2fc0 con 0x5562e9c9c650 2024-05-08T18:52:33.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.709+0000 7f1f415af800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x5562e9b3de20 con 0x5562e9ca0600 2024-05-08T18:52:33.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.709+0000 7f1f3e8ad640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5562e9ca0600 0x5562e9ca29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.709+0000 7f1f3f0ae640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x5562e9c9c650 0x5562e9c9ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48216/0 (socket says 172.21.15.132:48216) 2024-05-08T18:52:33.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.710+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/847825703 learned_addr learned my addr 172.21.15.132:0/847825703 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:52:33.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.710+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/847825703 >> v1:172.21.15.42:6789/0 conn(0x5562e9c9c650 legacy=0x5562e9c9ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.710+0000 7f1f3e0ac640 1 -- 172.21.15.132:0/847825703 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 831339945 0 0) 0x5562e9ca2fc0 con 0x5562e9c9c650 2024-05-08T18:52:33.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.710+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/847825703 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562e9ca41a0 con 0x5562e9ca0600 2024-05-08T18:52:33.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.712+0000 7f1f3e8ad640 1 --2- 172.21.15.132:0/847825703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9ca0600 0x5562e9ca29f0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400a470 tx=0x7f1f3401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba267f0b822cd13 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.712+0000 7f1f3e0ac640 1 -- 172.21.15.132:0/847825703 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f34057070 con 0x5562e9ca0600 2024-05-08T18:52:33.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.712+0000 7f1f3e0ac640 1 -- 172.21.15.132:0/847825703 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f34052570 con 0x5562e9ca0600 2024-05-08T18:52:33.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.712+0000 7f1f3e0ac640 1 -- 172.21.15.132:0/847825703 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f34052870 con 0x5562e9ca0600 2024-05-08T18:52:33.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.712+0000 7f1f415af800 1 -- 172.21.15.132:0/847825703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9ca0600 msgr2=0x5562e9ca29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.712+0000 7f1f415af800 1 --2- 172.21.15.132:0/847825703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9ca0600 0x5562e9ca29f0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400a470 tx=0x7f1f3401ce90 comp rx=0 tx=0).stop 2024-05-08T18:52:33.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.712+0000 7f1f415af800 1 -- 172.21.15.132:0/847825703 shutdown_connections 2024-05-08T18:52:33.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.712+0000 7f1f415af800 1 --2- 172.21.15.132:0/847825703 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9ca0600 0x5562e9ca29f0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.712+0000 7f1f415af800 1 -- 172.21.15.132:0/847825703 >> 172.21.15.132:0/847825703 conn(0x5562e9c96eb0 msgr2=0x5562e9c992d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.713+0000 7f1f415af800 1 -- 172.21.15.132:0/847825703 shutdown_connections 2024-05-08T18:52:33.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.713+0000 7f1f415af800 1 -- 172.21.15.132:0/847825703 wait complete. 2024-05-08T18:52:33.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.726+0000 7f1f415af800 1 Processor -- start 2024-05-08T18:52:33.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.726+0000 7f1f415af800 1 -- start start 2024-05-08T18:52:33.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.726+0000 7f1f415af800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9c9c650 0x5562e9d8d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.726+0000 7f1f415af800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5562e9be85c0 con 0x5562e9c9c650 2024-05-08T18:52:33.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.726+0000 7f1f3f0ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9c9c650 0x5562e9d8d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.726+0000 7f1f3f0ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9c9c650 0x5562e9d8d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53796/0 (socket says 172.21.15.132:53796) 2024-05-08T18:52:33.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.726+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/1937182810 learned_addr learned my addr 172.21.15.132:0/1937182810 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.727+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/1937182810 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562e9d8d9a0 con 0x5562e9c9c650 2024-05-08T18:52:33.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.727+0000 7f1f3f0ae640 1 --2- 172.21.15.132:0/1937182810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9c9c650 0x5562e9d8d3d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f1f3000b210 tx=0x7f1f3000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce22ffbf7f22ee6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.727+0000 7f1e2d60a640 1 -- 172.21.15.132:0/1937182810 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f30008070 con 0x5562e9c9c650 2024-05-08T18:52:33.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.727+0000 7f1e2d60a640 1 -- 172.21.15.132:0/1937182810 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3000d500 con 0x5562e9c9c650 2024-05-08T18:52:33.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.727+0000 7f1e2d60a640 1 -- 172.21.15.132:0/1937182810 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f3000d840 con 0x5562e9c9c650 2024-05-08T18:52:33.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.728+0000 7f1f415af800 1 -- 172.21.15.132:0/1937182810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9c9c650 msgr2=0x5562e9d8d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.728+0000 7f1f415af800 1 --2- 172.21.15.132:0/1937182810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9c9c650 0x5562e9d8d3d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f1f3000b210 tx=0x7f1f3000b6d0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.728+0000 7f1f415af800 1 -- 172.21.15.132:0/1937182810 shutdown_connections 2024-05-08T18:52:33.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.728+0000 7f1f415af800 1 --2- 172.21.15.132:0/1937182810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9c9c650 0x5562e9d8d3d0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.728+0000 7f1f415af800 1 -- 172.21.15.132:0/1937182810 >> 172.21.15.132:0/1937182810 conn(0x5562e9c96eb0 msgr2=0x5562e9d88cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.728+0000 7f1f415af800 1 -- 172.21.15.132:0/1937182810 shutdown_connections 2024-05-08T18:52:33.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.728+0000 7f1f415af800 1 -- 172.21.15.132:0/1937182810 wait complete. 2024-05-08T18:52:33.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.728+0000 7f1f415af800 1 Processor -- start 2024-05-08T18:52:33.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.728+0000 7f1f415af800 1 -- start start 2024-05-08T18:52:33.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.728+0000 7f1f415af800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9c9c650 0x5562e9c9bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.728+0000 7f1f415af800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5562e9ca3490 con 0x5562e9c9c650 2024-05-08T18:52:33.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.729+0000 7f1f3f0ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9c9c650 0x5562e9c9bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.729+0000 7f1f3f0ae640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9c9c650 0x5562e9c9bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53806/0 (socket says 172.21.15.132:53806) 2024-05-08T18:52:33.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.729+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/24680133 learned_addr learned my addr 172.21.15.132:0/24680133 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.729+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/24680133 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562e9d98ce0 con 0x5562e9c9c650 2024-05-08T18:52:33.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.729+0000 7f1f3f0ae640 1 --2- 172.21.15.132:0/24680133 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9c9c650 0x5562e9c9bd10 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f1f3000b210 tx=0x7f1f30000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.729+0000 7f1e2be07640 1 -- 172.21.15.132:0/24680133 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f3000f950 con 0x5562e9c9c650 2024-05-08T18:52:33.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.729+0000 7f1e2be07640 1 -- 172.21.15.132:0/24680133 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3000faf0 con 0x5562e9c9c650 2024-05-08T18:52:33.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.729+0000 7f1f415af800 1 -- 172.21.15.132:0/24680133 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562e9d98eb0 con 0x5562e9c9c650 2024-05-08T18:52:33.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.729+0000 7f1e2be07640 1 -- 172.21.15.132:0/24680133 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f3000fdd0 con 0x5562e9c9c650 2024-05-08T18:52:33.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.730+0000 7f1f415af800 1 -- 172.21.15.132:0/24680133 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562e9d99370 con 0x5562e9c9c650 2024-05-08T18:52:33.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.730+0000 7f1e2be07640 1 -- 172.21.15.132:0/24680133 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1f30017040 con 0x5562e9c9c650 2024-05-08T18:52:33.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.731+0000 7f1e2be07640 1 --2- 172.21.15.132:0/24680133 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1e2403bb50 0x7f1e2403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.731+0000 7f1e2be07640 1 -- 172.21.15.132:0/24680133 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f1f30015020 con 0x5562e9c9c650 2024-05-08T18:52:33.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.731+0000 7f1f3e8ad640 1 --2- 172.21.15.132:0/24680133 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1e2403bb50 0x7f1e2403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.731+0000 7f1f415af800 1 --2- 172.21.15.132:0/24680133 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5562e9ca0600 0x5562e9d9d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.731+0000 7f1f415af800 1 -- 172.21.15.132:0/24680133 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562e9d9d7b0 con 0x5562e9ca0600 2024-05-08T18:52:33.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.731+0000 7f1f3f8af640 1 --2- 172.21.15.132:0/24680133 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5562e9ca0600 0x5562e9d9d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.731+0000 7f1f3e8ad640 1 --2- 172.21.15.132:0/24680133 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1e2403bb50 0x7f1e2403e010 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1f34054000 tx=0x7f1f3404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.731+0000 7f1f3f8af640 1 --2- 172.21.15.132:0/24680133 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5562e9ca0600 0x5562e9d9d1e0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.731+0000 7f1f3f8af640 1 -- 172.21.15.132:0/24680133 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f3800a4a0 con 0x5562e9ca0600 2024-05-08T18:52:33.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.731+0000 7f1f415af800 1 -- 172.21.15.132:0/24680133 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562e9d9a7b0 con 0x5562e9ca0600 2024-05-08T18:52:33.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.732+0000 7f1f3f8af640 1 -- 172.21.15.132:0/24680133 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1f3800a4a0 con 0x5562e9ca0600 2024-05-08T18:52:33.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.732+0000 7f1f415af800 1 --2- 172.21.15.132:0/24680133 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5562e9d9fb00 0x5562e9da1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.732+0000 7f1f415af800 1 -- 172.21.15.132:0/24680133 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562e9da25e0 con 0x5562e9d9fb00 2024-05-08T18:52:33.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.732+0000 7f1f3f0ae640 1 --2- 172.21.15.132:0/24680133 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5562e9d9fb00 0x5562e9da1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.732+0000 7f1f3f0ae640 1 --2- 172.21.15.132:0/24680133 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5562e9d9fb00 0x5562e9da1ef0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.732+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/24680133 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1f3002d070 con 0x5562e9d9fb00 2024-05-08T18:52:33.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.732+0000 7f1f415af800 1 -- 172.21.15.132:0/24680133 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562e9d9e9a0 con 0x5562e9ca0600 2024-05-08T18:52:33.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.733+0000 7f1f3f8af640 1 -- 172.21.15.132:0/24680133 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1f3800a4a0 con 0x5562e9ca0600 2024-05-08T18:52:33.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.733+0000 7f1f415af800 1 -- 172.21.15.132:0/24680133 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562e9d9ee80 con 0x5562e9ca0600 2024-05-08T18:52:33.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.733+0000 7f1f3f8af640 1 -- 172.21.15.132:0/24680133 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1f3800a4a0 con 0x5562e9ca0600 2024-05-08T18:52:33.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.733+0000 7f1f415af800 1 Processor -- start 2024-05-08T18:52:33.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.733+0000 7f1f415af800 1 -- start start 2024-05-08T18:52:33.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.733+0000 7f1f415af800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9db1520 0x5562e9db1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.733+0000 7f1f415af800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5562e9b8efc0 con 0x5562e9db1520 2024-05-08T18:52:33.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.734+0000 7f1f3f8af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9db1520 0x5562e9db1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.734+0000 7f1f3f8af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9db1520 0x5562e9db1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53808/0 (socket says 172.21.15.132:53808) 2024-05-08T18:52:33.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.734+0000 7f1f3f8af640 1 -- 172.21.15.132:0/673556828 learned_addr learned my addr 172.21.15.132:0/673556828 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.734+0000 7f1f3f8af640 1 -- 172.21.15.132:0/673556828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562e9db1e80 con 0x5562e9db1520 2024-05-08T18:52:33.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.734+0000 7f1f3f8af640 1 --2- 172.21.15.132:0/673556828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9db1520 0x5562e9db1940 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x5562e9d9dbb0 tx=0x7f1f38018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.734+0000 7f1e29602640 1 -- 172.21.15.132:0/673556828 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f38014450 con 0x5562e9db1520 2024-05-08T18:52:33.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.734+0000 7f1e29602640 1 -- 172.21.15.132:0/673556828 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f38014610 con 0x5562e9db1520 2024-05-08T18:52:33.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.734+0000 7f1f415af800 1 -- 172.21.15.132:0/673556828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562e9db28f0 con 0x5562e9db1520 2024-05-08T18:52:33.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.734+0000 7f1e29602640 1 -- 172.21.15.132:0/673556828 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f38014930 con 0x5562e9db1520 2024-05-08T18:52:33.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.734+0000 7f1f415af800 1 -- 172.21.15.132:0/673556828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562e9db2df0 con 0x5562e9db1520 2024-05-08T18:52:33.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.735+0000 7f1e29602640 1 -- 172.21.15.132:0/673556828 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1f38011040 con 0x5562e9db1520 2024-05-08T18:52:33.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.735+0000 7f1e29602640 1 --2- 172.21.15.132:0/673556828 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1e1803bb50 0x7f1e1803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.735+0000 7f1e29602640 1 -- 172.21.15.132:0/673556828 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f1f3801e070 con 0x5562e9db1520 2024-05-08T18:52:33.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.736+0000 7f1f3f0ae640 1 --2- 172.21.15.132:0/673556828 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1e1803bb50 0x7f1e1803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.736+0000 7f1f415af800 1 Processor -- start 2024-05-08T18:52:33.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.736+0000 7f1f415af800 1 -- start start 2024-05-08T18:52:33.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.736+0000 7f1f3f0ae640 1 --2- 172.21.15.132:0/673556828 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1e1803bb50 0x7f1e1803e010 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x5562e9d9dc50 tx=0x7f1f30051710 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.736+0000 7f1f415af800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9dbe800 0x5562e9dbec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.736+0000 7f1f415af800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5562e9d8dd20 con 0x5562e9dbe800 2024-05-08T18:52:33.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.736+0000 7f1f3f8af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9dbe800 0x5562e9dbec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.736+0000 7f1f3f8af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9dbe800 0x5562e9dbec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53820/0 (socket says 172.21.15.132:53820) 2024-05-08T18:52:33.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.736+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3277906018 learned_addr learned my addr 172.21.15.132:0/3277906018 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.736+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3277906018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562e9dbf1f0 con 0x5562e9dbe800 2024-05-08T18:52:33.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.737+0000 7f1f3f8af640 1 --2- 172.21.15.132:0/3277906018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9dbe800 0x5562e9dbec20 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f1f38052cd0 tx=0x7f1f3802b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77d9692ae5d36d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.737+0000 7f1e22ffd640 1 -- 172.21.15.132:0/3277906018 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f38028070 con 0x5562e9dbe800 2024-05-08T18:52:33.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.737+0000 7f1e22ffd640 1 -- 172.21.15.132:0/3277906018 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f38016e00 con 0x5562e9dbe800 2024-05-08T18:52:33.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.737+0000 7f1e22ffd640 1 -- 172.21.15.132:0/3277906018 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f380165b0 con 0x5562e9dbe800 2024-05-08T18:52:33.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.737+0000 7f1f415af800 1 -- 172.21.15.132:0/3277906018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9dbe800 msgr2=0x5562e9dbec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.737+0000 7f1f415af800 1 --2- 172.21.15.132:0/3277906018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9dbe800 0x5562e9dbec20 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f1f38052cd0 tx=0x7f1f3802b720 comp rx=0 tx=0).stop 2024-05-08T18:52:33.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.737+0000 7f1f415af800 1 -- 172.21.15.132:0/3277906018 shutdown_connections 2024-05-08T18:52:33.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.737+0000 7f1f415af800 1 --2- 172.21.15.132:0/3277906018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9dbe800 0x5562e9dbec20 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.737+0000 7f1f415af800 1 -- 172.21.15.132:0/3277906018 >> 172.21.15.132:0/3277906018 conn(0x5562e9dbab60 msgr2=0x5562e9db8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.737+0000 7f1f415af800 1 -- 172.21.15.132:0/3277906018 shutdown_connections 2024-05-08T18:52:33.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.737+0000 7f1f415af800 1 -- 172.21.15.132:0/3277906018 wait complete. 2024-05-08T18:52:33.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.738+0000 7f1f415af800 1 Processor -- start 2024-05-08T18:52:33.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.738+0000 7f1f415af800 1 -- start start 2024-05-08T18:52:33.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.738+0000 7f1f415af800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9dbe800 0x5562e9dc5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.738+0000 7f1f415af800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5562e9dbf960 con 0x5562e9dbe800 2024-05-08T18:52:33.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.738+0000 7f1f3f8af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9dbe800 0x5562e9dc5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.738+0000 7f1f3f8af640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9dbe800 0x5562e9dc5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53826/0 (socket says 172.21.15.132:53826) 2024-05-08T18:52:33.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.738+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 learned_addr learned my addr 172.21.15.132:0/3364443597 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.738+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562e9dc6310 con 0x5562e9dbe800 2024-05-08T18:52:33.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.738+0000 7f1f3f8af640 1 --2- 172.21.15.132:0/3364443597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9dbe800 0x5562e9dc5dd0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1f38016fd0 tx=0x7f1f38052c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.738+0000 7f1e217fa640 1 -- 172.21.15.132:0/3364443597 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f38031070 con 0x5562e9dbe800 2024-05-08T18:52:33.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.738+0000 7f1e217fa640 1 -- 172.21.15.132:0/3364443597 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f380114f0 con 0x5562e9dbe800 2024-05-08T18:52:33.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.738+0000 7f1e217fa640 1 -- 172.21.15.132:0/3364443597 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f38011810 con 0x5562e9dbe800 2024-05-08T18:52:33.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.738+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562e9dc65a0 con 0x5562e9dbe800 2024-05-08T18:52:33.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.739+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562e9dc9250 con 0x5562e9dbe800 2024-05-08T18:52:33.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.739+0000 7f1e217fa640 1 -- 172.21.15.132:0/3364443597 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f1f38034070 con 0x5562e9dbe800 2024-05-08T18:52:33.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.740+0000 7f1e217fa640 1 --2- 172.21.15.132:0/3364443597 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1e0803bb50 0x7f1e0803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.740+0000 7f1e217fa640 1 -- 172.21.15.132:0/3364443597 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f1f3800e040 con 0x5562e9dbe800 2024-05-08T18:52:33.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.740+0000 7f1f3f0ae640 1 --2- 172.21.15.132:0/3364443597 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1e0803bb50 0x7f1e0803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.740+0000 7f1f3f0ae640 1 --2- 172.21.15.132:0/3364443597 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1e0803bb50 0x7f1e0803e010 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1f3000ed00 tx=0x7f1f30045000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.740+0000 7f1f415af800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.740+0000 7f1f415af800 1 --2- 172.21.15.132:0/3364443597 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5562e9dd18b0 0x5562e9dd3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.740+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dd44c0 con 0x5562e9dd18b0 2024-05-08T18:52:33.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.740+0000 7f1f3e8ad640 1 --2- 172.21.15.132:0/3364443597 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5562e9dd18b0 0x5562e9dd3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.741+0000 7f1f3e8ad640 1 --2- 172.21.15.132:0/3364443597 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5562e9dd18b0 0x5562e9dd3d70 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.741+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f3405a040 con 0x5562e9dd18b0 2024-05-08T18:52:33.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.741+0000 7f1f415af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.741+0000 7f1f415af800 20 realm 2024-05-08T18:52:33.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.741+0000 7f1f415af800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.741+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dd4890 con 0x5562e9dd18b0 2024-05-08T18:52:33.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.741+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f3405a040 con 0x5562e9dd18b0 2024-05-08T18:52:33.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.741+0000 7f1f415af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.741+0000 7f1f415af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:52:33.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.741+0000 7f1f415af800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.741+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dd5160 con 0x5562e9dd18b0 2024-05-08T18:52:33.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.741+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f3405a040 con 0x5562e9dd18b0 2024-05-08T18:52:33.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.741+0000 7f1f415af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.741+0000 7f1f415af800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.741+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dd5500 con 0x5562e9dd18b0 2024-05-08T18:52:33.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.741+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1f3405a040 con 0x5562e9dd18b0 2024-05-08T18:52:33.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.741+0000 7f1f415af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:33.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.742+0000 7f1f415af800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.742+0000 7f1f415af800 1 --2- 172.21.15.132:0/3364443597 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5562e9dd6260 0x5562e9dd8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.742+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dd8c60 con 0x5562e9dd6260 2024-05-08T18:52:33.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.742+0000 7f1f3f8af640 1 --2- 172.21.15.132:0/3364443597 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5562e9dd6260 0x5562e9dd8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.742+0000 7f1f3f8af640 1 --2- 172.21.15.132:0/3364443597 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5562e9dd6260 0x5562e9dd8650 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.742+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1f3803d070 con 0x5562e9dd6260 2024-05-08T18:52:33.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.742+0000 7f1f415af800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:52:33.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.742+0000 7f1f415af800 20 searching for the correct realm 2024-05-08T18:52:33.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.742+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x5562e9dd6260 2024-05-08T18:52:33.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.743+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3803d070 con 0x5562e9dd6260 2024-05-08T18:52:33.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.743+0000 7f1f3f8af640 1 --2- 172.21.15.132:0/3364443597 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1f38036070 0x7f1f38054a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.743+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x7f1f38036070 2024-05-08T18:52:33.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.743+0000 7f1f3f0ae640 1 --2- 172.21.15.132:0/3364443597 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1f38036070 0x7f1f38054a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.743+0000 7f1f3f0ae640 1 --2- 172.21.15.132:0/3364443597 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1f38036070 0x7f1f38054a10 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.743+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/3364443597 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3002d070 con 0x7f1f38036070 2024-05-08T18:52:33.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.743+0000 7f1f3f0ae640 1 --2- 172.21.15.132:0/3364443597 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1f3003d040 0x7f1f30043430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.743+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x7f1f3003d040 2024-05-08T18:52:33.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.744+0000 7f1f3e8ad640 1 --2- 172.21.15.132:0/3364443597 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1f3003d040 0x7f1f30043430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.744+0000 7f1f3e8ad640 1 --2- 172.21.15.132:0/3364443597 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1f3003d040 0x7f1f30043430 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.744+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3405a040 con 0x7f1f3003d040 2024-05-08T18:52:33.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.744+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x5562e9dd18b0 2024-05-08T18:52:33.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.744+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3405a040 con 0x5562e9dd18b0 2024-05-08T18:52:33.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.744+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x5562e9dd18b0 2024-05-08T18:52:33.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.745+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3405a040 con 0x5562e9dd18b0 2024-05-08T18:52:33.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.745+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x7f1f3003d040 2024-05-08T18:52:33.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.745+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3405a040 con 0x7f1f3003d040 2024-05-08T18:52:33.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.745+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x7f1f3003d040 2024-05-08T18:52:33.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.745+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3405a040 con 0x7f1f3003d040 2024-05-08T18:52:33.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.745+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x7f1f38036070 2024-05-08T18:52:33.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.746+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/3364443597 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3002d070 con 0x7f1f38036070 2024-05-08T18:52:33.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.746+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x5562e9dd6260 2024-05-08T18:52:33.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.746+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3803d070 con 0x5562e9dd6260 2024-05-08T18:52:33.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.746+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x5562e9dd18b0 2024-05-08T18:52:33.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.746+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3405a040 con 0x5562e9dd18b0 2024-05-08T18:52:33.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.746+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x7f1f3003d040 2024-05-08T18:52:33.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.746+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3405a040 con 0x7f1f3003d040 2024-05-08T18:52:33.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.746+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x5562e9dd18b0 2024-05-08T18:52:33.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.747+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1f3405a040 con 0x5562e9dd18b0 2024-05-08T18:52:33.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.747+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x7f1f38036070 2024-05-08T18:52:33.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.747+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/3364443597 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1f3002d070 con 0x7f1f38036070 2024-05-08T18:52:33.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.747+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x5562e9dd6260 2024-05-08T18:52:33.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.747+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v27'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1f3803d070 con 0x5562e9dd6260 2024-05-08T18:52:33.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.747+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x5562e9dd6260 2024-05-08T18:52:33.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.747+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3803d070 con 0x5562e9dd6260 2024-05-08T18:52:33.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.747+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x7f1f3003d040 2024-05-08T18:52:33.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.748+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3405a040 con 0x7f1f3003d040 2024-05-08T18:52:33.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.748+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x5562e9dd6260 2024-05-08T18:52:33.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.748+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3803d070 con 0x5562e9dd6260 2024-05-08T18:52:33.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.748+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x5562e9dd6260 2024-05-08T18:52:33.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.748+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3803d070 con 0x5562e9dd6260 2024-05-08T18:52:33.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.748+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x5562e9dd18b0 2024-05-08T18:52:33.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.748+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3405a040 con 0x5562e9dd18b0 2024-05-08T18:52:33.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.748+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x5562e9dd18b0 2024-05-08T18:52:33.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.748+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v27'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1f3405a040 con 0x5562e9dd18b0 2024-05-08T18:52:33.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.748+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x7f1f3003d040 2024-05-08T18:52:33.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.749+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3407d040 con 0x7f1f3003d040 2024-05-08T18:52:33.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.749+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x5562e9dd6260 2024-05-08T18:52:33.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.749+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3806a040 con 0x5562e9dd6260 2024-05-08T18:52:33.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.749+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x7f1f38036070 2024-05-08T18:52:33.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.749+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/3364443597 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3002d070 con 0x7f1f38036070 2024-05-08T18:52:33.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.749+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x5562e9dd18b0 2024-05-08T18:52:33.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.749+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3407d040 con 0x5562e9dd18b0 2024-05-08T18:52:33.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.749+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x7f1f38036070 2024-05-08T18:52:33.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.750+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/3364443597 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3002d070 con 0x7f1f38036070 2024-05-08T18:52:33.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.750+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x5562e9dd6260 2024-05-08T18:52:33.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.750+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3806a040 con 0x5562e9dd6260 2024-05-08T18:52:33.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.750+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x7f1f3003d040 2024-05-08T18:52:33.771 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.750+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3407d040 con 0x7f1f3003d040 2024-05-08T18:52:33.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.750+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x7f1f38036070 2024-05-08T18:52:33.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.751+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/3364443597 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3002d070 con 0x7f1f38036070 2024-05-08T18:52:33.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.751+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x5562e9dd6260 2024-05-08T18:52:33.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.751+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3806a040 con 0x5562e9dd6260 2024-05-08T18:52:33.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.751+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x7f1f3003d040 2024-05-08T18:52:33.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.751+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3407d040 con 0x7f1f3003d040 2024-05-08T18:52:33.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.751+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x5562e9dd18b0 2024-05-08T18:52:33.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.751+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v27'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1f3407d040 con 0x5562e9dd18b0 2024-05-08T18:52:33.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.751+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda570 con 0x7f1f38036070 2024-05-08T18:52:33.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/3364443597 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f3002d070 con 0x7f1f38036070 2024-05-08T18:52:33.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:52:33.772 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:52:33.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:52:33.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:52:33.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:52:33.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:52:33.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dd94b0 con 0x5562e9dd18b0 2024-05-08T18:52:33.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f3407d040 con 0x5562e9dd18b0 2024-05-08T18:52:33.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dd98a0 con 0x5562e9dd18b0 2024-05-08T18:52:33.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1f3407d040 con 0x5562e9dd18b0 2024-05-08T18:52:33.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:33.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dda9f0 con 0x5562e9dd18b0 2024-05-08T18:52:33.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1f3407d040 con 0x5562e9dd18b0 2024-05-08T18:52:33.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:52:33.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 20 zone default found 2024-05-08T18:52:33.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 4 Realm: () 2024-05-08T18:52:33.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:52:33.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:52:33.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:52:33.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 20 zonegroup default 2024-05-08T18:52:33.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.752+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562e9ddadf0 con 0x7f1f38036070 2024-05-08T18:52:33.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.753+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/3364443597 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1f3002d070 con 0x7f1f38036070 2024-05-08T18:52:33.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.753+0000 7f1f415af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.753+0000 7f1f415af800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.753+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562e9ddd0c0 con 0x5562e9dd6260 2024-05-08T18:52:33.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.753+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1f3806a040 con 0x5562e9dd6260 2024-05-08T18:52:33.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.753+0000 7f1f415af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.753+0000 7f1f415af800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.753+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562e9ddd460 con 0x5562e9dd6260 2024-05-08T18:52:33.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.753+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1f3806a040 con 0x5562e9dd6260 2024-05-08T18:52:33.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.753+0000 7f1f415af800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.753+0000 7f1f415af800 20 started sync module instance, tier type = 2024-05-08T18:52:33.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.753+0000 7f1f415af800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:52:33.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.753+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9ddc550 con 0x7f1f38036070 2024-05-08T18:52:33.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.754+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/3364443597 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3002d070 con 0x7f1f38036070 2024-05-08T18:52:33.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.754+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93883318782272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9ddc1b0 con 0x7f1f38036070 2024-05-08T18:52:33.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.754+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dde210 con 0x5562e9dd18b0 2024-05-08T18:52:33.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.755+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/3364443597 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93883318782272] v27'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3002d070 con 0x7f1f38036070 2024-05-08T18:52:33.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.755+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3407d040 con 0x5562e9dd18b0 2024-05-08T18:52:33.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.755+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93883318786128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9dde600 con 0x5562e9dd18b0 2024-05-08T18:52:33.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.755+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9ddf060 con 0x5562e9dd6260 2024-05-08T18:52:33.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.756+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93883318786128] v27'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3407d040 con 0x5562e9dd18b0 2024-05-08T18:52:33.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.757+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3806a040 con 0x5562e9dd6260 2024-05-08T18:52:33.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.757+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93883318790928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9ddf020 con 0x5562e9dd6260 2024-05-08T18:52:33.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.757+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9ddfb70 con 0x7f1f38036070 2024-05-08T18:52:33.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.758+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93883318790928] v27'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3806a040 con 0x5562e9dd6260 2024-05-08T18:52:33.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.758+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/3364443597 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3002d070 con 0x7f1f38036070 2024-05-08T18:52:33.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.758+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93883318793888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9ddff90 con 0x7f1f38036070 2024-05-08T18:52:33.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.758+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9de0990 con 0x5562e9dd18b0 2024-05-08T18:52:33.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.759+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3407d040 con 0x5562e9dd18b0 2024-05-08T18:52:33.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.759+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93883318797472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9de1230 con 0x5562e9dd18b0 2024-05-08T18:52:33.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.759+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9de1d30 con 0x7f1f3003d040 2024-05-08T18:52:33.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.759+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/3364443597 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93883318793888] v27'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3002d070 con 0x7f1f38036070 2024-05-08T18:52:33.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.760+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3407d040 con 0x7f1f3003d040 2024-05-08T18:52:33.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.760+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93883318797472] v27'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3407d040 con 0x5562e9dd18b0 2024-05-08T18:52:33.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.760+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93883318802464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9de1cf0 con 0x7f1f3003d040 2024-05-08T18:52:33.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.760+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9de0dc0 con 0x7f1f3003d040 2024-05-08T18:52:33.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.761+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93883318802464] v27'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3407d040 con 0x7f1f3003d040 2024-05-08T18:52:33.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.761+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3407d040 con 0x7f1f3003d040 2024-05-08T18:52:33.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.761+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93883318799808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9de2290 con 0x7f1f3003d040 2024-05-08T18:52:33.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.761+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9de2c50 con 0x7f1f3003d040 2024-05-08T18:52:33.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.762+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93883318799808] v27'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3407d040 con 0x7f1f3003d040 2024-05-08T18:52:33.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.762+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3407d040 con 0x7f1f3003d040 2024-05-08T18:52:33.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.762+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93883318787184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9de2c50 con 0x7f1f3003d040 2024-05-08T18:52:33.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.762+0000 7f1f415af800 20 add_watcher() i=0 2024-05-08T18:52:33.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.762+0000 7f1f415af800 20 add_watcher() i=1 2024-05-08T18:52:33.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.762+0000 7f1f415af800 20 add_watcher() i=2 2024-05-08T18:52:33.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.762+0000 7f1f415af800 20 add_watcher() i=3 2024-05-08T18:52:33.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.762+0000 7f1f415af800 20 add_watcher() i=4 2024-05-08T18:52:33.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.762+0000 7f1f415af800 20 add_watcher() i=5 2024-05-08T18:52:33.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.762+0000 7f1f415af800 20 add_watcher() i=6 2024-05-08T18:52:33.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.763+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93883318787184] v27'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3407d040 con 0x7f1f3003d040 2024-05-08T18:52:33.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.763+0000 7f1f415af800 20 add_watcher() i=7 2024-05-08T18:52:33.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.763+0000 7f1f415af800 2 all 8 watchers are set, enabling cache 2024-05-08T18:52:33.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.763+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562e9de5fb0 con 0x5562e9dd18b0 2024-05-08T18:52:33.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.763+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1f3407d040 con 0x5562e9dd18b0 2024-05-08T18:52:33.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.764+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93883318806800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9de31e0 con 0x5562e9dd18b0 2024-05-08T18:52:33.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.765+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93883318806800] v27'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1f3407d040 con 0x5562e9dd18b0 2024-05-08T18:52:33.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.765+0000 7f1df5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:33.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.765+0000 7f1f415af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:33.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.765+0000 7f1f415af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:33.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.765+0000 7f1f415af800 5 note: GC not initialized 2024-05-08T18:52:33.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.765+0000 7f1df4fe1640 20 reqs_thread_entry: start 2024-05-08T18:52:33.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.765+0000 7f1f415af800 20 init_complete bucket index max shards: 11 2024-05-08T18:52:33.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.765+0000 7f1f415af800 20 Filter name: none 2024-05-08T18:52:33.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.765+0000 7f1d6e7fc640 20 reqs_thread_entry: start 2024-05-08T18:52:33.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.765+0000 7f1f415af800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:52:33.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.765+0000 7f1f415af800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.765+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562e9e19520 con 0x7f1f3003d040 2024-05-08T18:52:33.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.766+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f1f3407d040 con 0x7f1f3003d040 2024-05-08T18:52:33.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.766+0000 7f1f415af800 20 rados_obj.operate() r=0 bl.length=460 2024-05-08T18:52:33.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.766+0000 7f1f415af800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:52:33.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.766+0000 7f1f415af800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:33.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.766+0000 7f1f415af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:52:33.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.766+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9e1fa70 con 0x7f1f3003d040 2024-05-08T18:52:33.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.767+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v27'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1f3407d040 con 0x7f1f3003d040 2024-05-08T18:52:33.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.767+0000 7f1f415af800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:52:33.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.768+0000 7f1f415af800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:33.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.768+0000 7f1f415af800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:52:33.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.768+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93883319055408 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562e9e1b090 con 0x5562e9dd18b0 2024-05-08T18:52:33.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.768+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== watch-notify(notify (1) cookie 93883318797472 notify 115964117022 ret 0) ==== 691+0+0 (crc 0 0 0) 0x5562e9ca41a0 con 0x5562e9dd18b0 2024-05-08T18:52:33.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.768+0000 7f1e22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117022 cookie 93883318797472 notifier 4907 bl.length()=649 2024-05-08T18:52:33.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.768+0000 7f1e22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:52:33.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.768+0000 7f1e22ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:33.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.768+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 notify.4 [notify cookie 93883319055408 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1f3407d040 con 0x5562e9dd18b0 2024-05-08T18:52:33.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.768+0000 7f1e22ffd640 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f1e04003ea0 con 0x5562e9dd18b0 2024-05-08T18:52:33.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.768+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3407d040 con 0x5562e9dd18b0 2024-05-08T18:52:33.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.768+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== watch-notify(notify_complete (2) cookie 93883319055408 notify 115964117022 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1f3405dbe0 con 0x5562e9dd18b0 2024-05-08T18:52:33.786 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:52:31.994053Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:52:31.994040Z","tags":[],"group_ids":[]} 2024-05-08T18:52:33.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.769+0000 7f1df5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:33.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.769+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93883318806800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9e1b850 con 0x5562e9dd18b0 2024-05-08T18:52:33.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.770+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93883318806800] v27'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1f3407d040 con 0x5562e9dd18b0 2024-05-08T18:52:33.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.770+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93883318782272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9e1b850 con 0x7f1f38036070 2024-05-08T18:52:33.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.771+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/3364443597 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93883318782272] v27'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3002d070 con 0x7f1f38036070 2024-05-08T18:52:33.792 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.771+0000 7f1f415af800 20 remove_watcher() i=0 2024-05-08T18:52:33.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.771+0000 7f1f415af800 2 removed watcher, disabling cache 2024-05-08T18:52:33.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.771+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93883318786128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9e1b850 con 0x5562e9dd18b0 2024-05-08T18:52:33.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.772+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93883318786128] v27'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3407d040 con 0x5562e9dd18b0 2024-05-08T18:52:33.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.772+0000 7f1f415af800 20 remove_watcher() i=1 2024-05-08T18:52:33.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.772+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93883318790928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9e1b850 con 0x5562e9dd6260 2024-05-08T18:52:33.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.773+0000 7f1f3f8af640 1 -- 172.21.15.132:0/3364443597 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93883318790928] v27'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3806a040 con 0x5562e9dd6260 2024-05-08T18:52:33.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.773+0000 7f1f415af800 20 remove_watcher() i=2 2024-05-08T18:52:33.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.773+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93883318793888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9e1b850 con 0x7f1f38036070 2024-05-08T18:52:33.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.774+0000 7f1f3f0ae640 1 -- 172.21.15.132:0/3364443597 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93883318793888] v27'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3002d070 con 0x7f1f38036070 2024-05-08T18:52:33.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.774+0000 7f1f415af800 20 remove_watcher() i=3 2024-05-08T18:52:33.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.774+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93883318797472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9ddc940 con 0x5562e9dd18b0 2024-05-08T18:52:33.793 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.776+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93883318797472] v27'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3407d040 con 0x5562e9dd18b0 2024-05-08T18:52:33.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.776+0000 7f1f415af800 20 remove_watcher() i=4 2024-05-08T18:52:33.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.776+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93883318802464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9ddd850 con 0x7f1f3003d040 2024-05-08T18:52:33.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.777+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93883318802464] v27'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3407d040 con 0x7f1f3003d040 2024-05-08T18:52:33.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.777+0000 7f1f415af800 20 remove_watcher() i=5 2024-05-08T18:52:33.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.777+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93883318799808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9ddeb10 con 0x7f1f3003d040 2024-05-08T18:52:33.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.778+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93883318799808] v27'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3407d040 con 0x7f1f3003d040 2024-05-08T18:52:33.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.778+0000 7f1f415af800 20 remove_watcher() i=6 2024-05-08T18:52:33.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.778+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93883318787184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562e9ddc940 con 0x7f1f3003d040 2024-05-08T18:52:33.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.779+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93883318787184] v27'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f3407d040 con 0x7f1f3003d040 2024-05-08T18:52:33.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.779+0000 7f1f415af800 20 remove_watcher() i=7 2024-05-08T18:52:33.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.779+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1f3003d040 msgr2=0x7f1f30043430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.779+0000 7f1f415af800 1 --2- 172.21.15.132:0/3364443597 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f1f3003d040 0x7f1f30043430 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.794 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.779+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5562e9dd18b0 msgr2=0x5562e9dd3d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.779+0000 7f1f415af800 1 --2- 172.21.15.132:0/3364443597 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5562e9dd18b0 0x5562e9dd3d70 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.779+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1f38036070 msgr2=0x7f1f38054a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.779+0000 7f1f415af800 1 --2- 172.21.15.132:0/3364443597 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f1f38036070 0x7f1f38054a10 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.779+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5562e9dd6260 msgr2=0x5562e9dd8650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.779+0000 7f1f415af800 1 --2- 172.21.15.132:0/3364443597 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5562e9dd6260 0x5562e9dd8650 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1e0803bb50 msgr2=0x7f1e0803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f415af800 1 --2- 172.21.15.132:0/3364443597 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1e0803bb50 0x7f1e0803e010 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1f3000ed00 tx=0x7f1f30045000 comp rx=0 tx=0).stop 2024-05-08T18:52:33.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9dbe800 msgr2=0x5562e9dc5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f415af800 1 --2- 172.21.15.132:0/3364443597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9dbe800 0x5562e9dc5dd0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1f38016fd0 tx=0x7f1f38052c60 comp rx=0 tx=0).stop 2024-05-08T18:52:33.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 reap_dead start 2024-05-08T18:52:33.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f3e8ad640 1 -- 172.21.15.132:0/3364443597 reap_dead start 2024-05-08T18:52:33.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 shutdown_connections 2024-05-08T18:52:33.795 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 >> 172.21.15.132:0/3364443597 conn(0x5562e9dbab60 msgr2=0x5562e9db81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 shutdown_connections 2024-05-08T18:52:33.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f415af800 1 -- 172.21.15.132:0/3364443597 wait complete. 2024-05-08T18:52:33.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f415af800 1 -- 172.21.15.132:0/673556828 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1e1803bb50 msgr2=0x7f1e1803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f415af800 1 --2- 172.21.15.132:0/673556828 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1e1803bb50 0x7f1e1803e010 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x5562e9d9dc50 tx=0x7f1f30051710 comp rx=0 tx=0).stop 2024-05-08T18:52:33.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f415af800 1 -- 172.21.15.132:0/673556828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9db1520 msgr2=0x5562e9db1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f415af800 1 --2- 172.21.15.132:0/673556828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9db1520 0x5562e9db1940 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x5562e9d9dbb0 tx=0x7f1f38018830 comp rx=0 tx=0).stop 2024-05-08T18:52:33.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f415af800 1 -- 172.21.15.132:0/673556828 shutdown_connections 2024-05-08T18:52:33.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f415af800 1 --2- 172.21.15.132:0/673556828 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1e1803bb50 0x7f1e1803e010 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f415af800 1 --2- 172.21.15.132:0/673556828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9db1520 0x5562e9db1940 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f415af800 1 -- 172.21.15.132:0/673556828 >> 172.21.15.132:0/673556828 conn(0x5562e9da55c0 msgr2=0x5562e9da59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f415af800 1 -- 172.21.15.132:0/673556828 shutdown_connections 2024-05-08T18:52:33.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f415af800 1 -- 172.21.15.132:0/673556828 wait complete. 2024-05-08T18:52:33.796 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f415af800 1 -- 172.21.15.132:0/24680133 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5562e9ca0600 msgr2=0x5562e9d9d1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f415af800 1 --2- 172.21.15.132:0/24680133 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5562e9ca0600 0x5562e9d9d1e0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f415af800 1 -- 172.21.15.132:0/24680133 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5562e9d9fb00 msgr2=0x5562e9da1ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.780+0000 7f1f415af800 1 --2- 172.21.15.132:0/24680133 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5562e9d9fb00 0x5562e9da1ef0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.781+0000 7f1f415af800 1 -- 172.21.15.132:0/24680133 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1e2403bb50 msgr2=0x7f1e2403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.781+0000 7f1f415af800 1 --2- 172.21.15.132:0/24680133 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1e2403bb50 0x7f1e2403e010 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1f34054000 tx=0x7f1f3404e000 comp rx=0 tx=0).stop 2024-05-08T18:52:33.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.781+0000 7f1f415af800 1 -- 172.21.15.132:0/24680133 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9c9c650 msgr2=0x5562e9c9bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.781+0000 7f1f415af800 1 --2- 172.21.15.132:0/24680133 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9c9c650 0x5562e9c9bd10 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f1f3000b210 tx=0x7f1f30000ed0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.781+0000 7f1f415af800 1 -- 172.21.15.132:0/24680133 shutdown_connections 2024-05-08T18:52:33.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.781+0000 7f1f415af800 1 --2- 172.21.15.132:0/24680133 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5562e9d9fb00 0x5562e9da1ef0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.781+0000 7f1f415af800 1 --2- 172.21.15.132:0/24680133 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5562e9ca0600 0x5562e9d9d1e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.781+0000 7f1f415af800 1 --2- 172.21.15.132:0/24680133 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f1e2403bb50 0x7f1e2403e010 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.781+0000 7f1f415af800 1 --2- 172.21.15.132:0/24680133 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5562e9c9c650 0x5562e9c9bd10 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.797 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.781+0000 7f1f415af800 1 -- 172.21.15.132:0/24680133 >> 172.21.15.132:0/24680133 conn(0x5562e9c96eb0 msgr2=0x5562e9d874f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.781+0000 7f1f415af800 1 -- 172.21.15.132:0/24680133 shutdown_connections 2024-05-08T18:52:33.798 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.781+0000 7f1f415af800 1 -- 172.21.15.132:0/24680133 wait complete. 2024-05-08T18:52:33.798 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:52:31.994053Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:31.994040Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:33.798 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:52:31.994053Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:31.994040Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:33.798 ERROR:root:0 2024-05-08T18:52:33.798 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:52:33.798 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:52:33.799 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-05-08T18:52:33.847 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:52:33.847 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:52:33.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.846+0000 7f9d4d72b800 1 Processor -- start 2024-05-08T18:52:33.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.846+0000 7f9d4d72b800 1 -- start start 2024-05-08T18:52:33.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.846+0000 7f9d4d72b800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5597eae3f870 0x5597eae41c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.846+0000 7f9d4d72b800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5597eae421a0 con 0x5597eae3bd60 2024-05-08T18:52:33.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.846+0000 7f9d4d72b800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x5597eacdbe20 con 0x5597eae3f870 2024-05-08T18:52:33.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.847+0000 7f9d40b4a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x5597eae3f870 0x5597eae41c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.847+0000 7f9d4934b640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x5597eae3bd60 0x5597eae3e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:48230/0 (socket says 172.21.15.132:48230) 2024-05-08T18:52:33.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.847+0000 7f9d4934b640 1 -- 172.21.15.132:0/1001740114 learned_addr learned my addr 172.21.15.132:0/1001740114 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-05-08T18:52:33.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.847+0000 7f9d40b4a640 1 -- 172.21.15.132:0/1001740114 >> v1:172.21.15.42:6789/0 conn(0x5597eae3bd60 legacy=0x5597eae3e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.847+0000 7f9d40b4a640 1 -- 172.21.15.132:0/1001740114 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597eae43380 con 0x5597eae3f870 2024-05-08T18:52:33.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.849+0000 7f9d40b4a640 1 --2- 172.21.15.132:0/1001740114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3f870 0x5597eae41c60 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400a470 tx=0x7f9d3401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa701aafc2254bb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.849+0000 7f9d48b4a640 1 -- 172.21.15.132:0/1001740114 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d34057070 con 0x5597eae3f870 2024-05-08T18:52:33.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.849+0000 7f9d48b4a640 1 -- 172.21.15.132:0/1001740114 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d34052570 con 0x5597eae3f870 2024-05-08T18:52:33.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.849+0000 7f9d48b4a640 1 -- 172.21.15.132:0/1001740114 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d34052870 con 0x5597eae3f870 2024-05-08T18:52:33.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.849+0000 7f9d4d72b800 1 -- 172.21.15.132:0/1001740114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3f870 msgr2=0x5597eae41c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.849+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/1001740114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3f870 0x5597eae41c60 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400a470 tx=0x7f9d3401ce90 comp rx=0 tx=0).stop 2024-05-08T18:52:33.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.849+0000 7f9d4d72b800 1 -- 172.21.15.132:0/1001740114 shutdown_connections 2024-05-08T18:52:33.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.849+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/1001740114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3f870 0x5597eae41c60 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.850+0000 7f9d4d72b800 1 -- 172.21.15.132:0/1001740114 >> 172.21.15.132:0/1001740114 conn(0x5597eae35730 msgr2=0x5597eae37b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.850+0000 7f9d4d72b800 1 -- 172.21.15.132:0/1001740114 shutdown_connections 2024-05-08T18:52:33.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.850+0000 7f9d4d72b800 1 -- 172.21.15.132:0/1001740114 wait complete. 2024-05-08T18:52:33.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.863+0000 7f9d4d72b800 1 Processor -- start 2024-05-08T18:52:33.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.863+0000 7f9d4d72b800 1 -- start start 2024-05-08T18:52:33.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.863+0000 7f9d4d72b800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3bd60 0x5597eaf2c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.863+0000 7f9d4d72b800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5597ead865c0 con 0x5597eae3bd60 2024-05-08T18:52:33.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.863+0000 7f9d4934b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3bd60 0x5597eaf2c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.863+0000 7f9d4934b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3bd60 0x5597eaf2c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53838/0 (socket says 172.21.15.132:53838) 2024-05-08T18:52:33.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.863+0000 7f9d4934b640 1 -- 172.21.15.132:0/4139313140 learned_addr learned my addr 172.21.15.132:0/4139313140 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.863+0000 7f9d4934b640 1 -- 172.21.15.132:0/4139313140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597eaf2ccb0 con 0x5597eae3bd60 2024-05-08T18:52:33.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.864+0000 7f9d4934b640 1 --2- 172.21.15.132:0/4139313140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3bd60 0x5597eaf2c6e0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c001de0 tx=0x7f9d3c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09f7f9cac6abb19 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.864+0000 7f9c37606640 1 -- 172.21.15.132:0/4139313140 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d3c012020 con 0x5597eae3bd60 2024-05-08T18:52:33.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.864+0000 7f9c37606640 1 -- 172.21.15.132:0/4139313140 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d3c00e5a0 con 0x5597eae3bd60 2024-05-08T18:52:33.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.864+0000 7f9c37606640 1 -- 172.21.15.132:0/4139313140 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d3c00e8c0 con 0x5597eae3bd60 2024-05-08T18:52:33.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.864+0000 7f9d4d72b800 1 -- 172.21.15.132:0/4139313140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3bd60 msgr2=0x5597eaf2c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.864+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/4139313140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3bd60 0x5597eaf2c6e0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c001de0 tx=0x7f9d3c00b6c0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.865+0000 7f9d4d72b800 1 -- 172.21.15.132:0/4139313140 shutdown_connections 2024-05-08T18:52:33.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.865+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/4139313140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3bd60 0x5597eaf2c6e0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.865+0000 7f9d4d72b800 1 -- 172.21.15.132:0/4139313140 >> 172.21.15.132:0/4139313140 conn(0x5597eae35730 msgr2=0x5597eaf28000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.865+0000 7f9d4d72b800 1 -- 172.21.15.132:0/4139313140 shutdown_connections 2024-05-08T18:52:33.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.865+0000 7f9d4d72b800 1 -- 172.21.15.132:0/4139313140 wait complete. 2024-05-08T18:52:33.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.865+0000 7f9d4d72b800 1 Processor -- start 2024-05-08T18:52:33.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.865+0000 7f9d4d72b800 1 -- start start 2024-05-08T18:52:33.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.865+0000 7f9d4d72b800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3bd60 0x5597eaf34260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.865+0000 7f9d4d72b800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5597eae42670 con 0x5597eae3bd60 2024-05-08T18:52:33.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.865+0000 7f9d4934b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3bd60 0x5597eaf34260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.865+0000 7f9d4934b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3bd60 0x5597eaf34260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53854/0 (socket says 172.21.15.132:53854) 2024-05-08T18:52:33.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.865+0000 7f9d4934b640 1 -- 172.21.15.132:0/3278343012 learned_addr learned my addr 172.21.15.132:0/3278343012 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.866+0000 7f9d4934b640 1 -- 172.21.15.132:0/3278343012 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597eaf347a0 con 0x5597eae3bd60 2024-05-08T18:52:33.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.866+0000 7f9d4934b640 1 --2- 172.21.15.132:0/3278343012 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3bd60 0x5597eaf34260 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c00c010 tx=0x7f9d3c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.866+0000 7f9c35e03640 1 -- 172.21.15.132:0/3278343012 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d3c012070 con 0x5597eae3bd60 2024-05-08T18:52:33.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.866+0000 7f9c35e03640 1 -- 172.21.15.132:0/3278343012 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d3c01a7a0 con 0x5597eae3bd60 2024-05-08T18:52:33.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.866+0000 7f9d4d72b800 1 -- 172.21.15.132:0/3278343012 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5597eaf34a30 con 0x5597eae3bd60 2024-05-08T18:52:33.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.866+0000 7f9c35e03640 1 -- 172.21.15.132:0/3278343012 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d3c01aa80 con 0x5597eae3bd60 2024-05-08T18:52:33.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.866+0000 7f9d4d72b800 1 -- 172.21.15.132:0/3278343012 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597eaf376e0 con 0x5597eae3bd60 2024-05-08T18:52:33.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.867+0000 7f9c35e03640 1 -- 172.21.15.132:0/3278343012 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9d3c015020 con 0x5597eae3bd60 2024-05-08T18:52:33.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.867+0000 7f9c35e03640 1 --2- 172.21.15.132:0/3278343012 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c3003bb50 0x7f9c3003e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.867+0000 7f9c35e03640 1 -- 172.21.15.132:0/3278343012 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f9d3c020070 con 0x5597eae3bd60 2024-05-08T18:52:33.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.867+0000 7f9d40b4a640 1 --2- 172.21.15.132:0/3278343012 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c3003bb50 0x7f9c3003e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.868+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/3278343012 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5597eae3f870 0x5597eaf3b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.868+0000 7f9d4d72b800 1 -- 172.21.15.132:0/3278343012 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf3b9e0 con 0x5597eae3f870 2024-05-08T18:52:33.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.868+0000 7f9d49b4c640 1 --2- 172.21.15.132:0/3278343012 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5597eae3f870 0x5597eaf3b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.868+0000 7f9d40b4a640 1 --2- 172.21.15.132:0/3278343012 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c3003bb50 0x7f9c3003e010 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9d34054000 tx=0x7f9d3404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.868+0000 7f9d49b4c640 1 --2- 172.21.15.132:0/3278343012 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5597eae3f870 0x5597eaf3b4a0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.868+0000 7f9d49b4c640 1 -- 172.21.15.132:0/3278343012 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d4400a4a0 con 0x5597eae3f870 2024-05-08T18:52:33.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.868+0000 7f9d4d72b800 1 -- 172.21.15.132:0/3278343012 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf38a70 con 0x5597eae3f870 2024-05-08T18:52:33.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.869+0000 7f9d49b4c640 1 -- 172.21.15.132:0/3278343012 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9d4400a4a0 con 0x5597eae3f870 2024-05-08T18:52:33.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.869+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/3278343012 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5597eaf3dd30 0x5597eaf40120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.869+0000 7f9d4d72b800 1 -- 172.21.15.132:0/3278343012 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf40810 con 0x5597eaf3dd30 2024-05-08T18:52:33.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.869+0000 7f9d4934b640 1 --2- 172.21.15.132:0/3278343012 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5597eaf3dd30 0x5597eaf40120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.869+0000 7f9d4934b640 1 --2- 172.21.15.132:0/3278343012 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5597eaf3dd30 0x5597eaf40120 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.869+0000 7f9d4934b640 1 -- 172.21.15.132:0/3278343012 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9d3c02b070 con 0x5597eaf3dd30 2024-05-08T18:52:33.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.869+0000 7f9d4d72b800 1 -- 172.21.15.132:0/3278343012 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf3cbd0 con 0x5597eae3f870 2024-05-08T18:52:33.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.869+0000 7f9d49b4c640 1 -- 172.21.15.132:0/3278343012 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9d4400a4a0 con 0x5597eae3f870 2024-05-08T18:52:33.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.869+0000 7f9d4d72b800 1 -- 172.21.15.132:0/3278343012 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf3d0b0 con 0x5597eae3f870 2024-05-08T18:52:33.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.870+0000 7f9d49b4c640 1 -- 172.21.15.132:0/3278343012 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9d4400a4a0 con 0x5597eae3f870 2024-05-08T18:52:33.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.870+0000 7f9d4d72b800 1 Processor -- start 2024-05-08T18:52:33.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.870+0000 7f9d4d72b800 1 -- start start 2024-05-08T18:52:33.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.870+0000 7f9d4d72b800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eaf4f790 0x5597eaf4fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.870+0000 7f9d4d72b800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5597ead2cfc0 con 0x5597eaf4f790 2024-05-08T18:52:33.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.870+0000 7f9d49b4c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eaf4f790 0x5597eaf4fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.870+0000 7f9d49b4c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eaf4f790 0x5597eaf4fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53866/0 (socket says 172.21.15.132:53866) 2024-05-08T18:52:33.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.870+0000 7f9d49b4c640 1 -- 172.21.15.132:0/1200139345 learned_addr learned my addr 172.21.15.132:0/1200139345 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.871+0000 7f9d49b4c640 1 -- 172.21.15.132:0/1200139345 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597eaf500f0 con 0x5597eaf4f790 2024-05-08T18:52:33.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.871+0000 7f9d49b4c640 1 --2- 172.21.15.132:0/1200139345 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eaf4f790 0x5597eaf4fbb0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x5597eaf3bde0 tx=0x7f9d44018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.871+0000 7f9c2effd640 1 -- 172.21.15.132:0/1200139345 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d44014450 con 0x5597eaf4f790 2024-05-08T18:52:33.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.871+0000 7f9c2effd640 1 -- 172.21.15.132:0/1200139345 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d44014610 con 0x5597eaf4f790 2024-05-08T18:52:33.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.871+0000 7f9d4d72b800 1 -- 172.21.15.132:0/1200139345 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5597eaf50b60 con 0x5597eaf4f790 2024-05-08T18:52:33.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.871+0000 7f9c2effd640 1 -- 172.21.15.132:0/1200139345 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d44014930 con 0x5597eaf4f790 2024-05-08T18:52:33.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.871+0000 7f9d4d72b800 1 -- 172.21.15.132:0/1200139345 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597eaf51060 con 0x5597eaf4f790 2024-05-08T18:52:33.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.872+0000 7f9c2effd640 1 -- 172.21.15.132:0/1200139345 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9d44011040 con 0x5597eaf4f790 2024-05-08T18:52:33.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.872+0000 7f9c2effd640 1 --2- 172.21.15.132:0/1200139345 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c2003bba0 0x7f9c2003e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.873+0000 7f9c2effd640 1 -- 172.21.15.132:0/1200139345 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f9d4401e070 con 0x5597eaf4f790 2024-05-08T18:52:33.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.873+0000 7f9d4934b640 1 --2- 172.21.15.132:0/1200139345 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c2003bba0 0x7f9c2003e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.873+0000 7f9d4d72b800 1 Processor -- start 2024-05-08T18:52:33.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.873+0000 7f9d4934b640 1 --2- 172.21.15.132:0/1200139345 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c2003bba0 0x7f9c2003e060 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x5597eaf3be80 tx=0x7f9d3c050ce0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.873+0000 7f9d4d72b800 1 -- start start 2024-05-08T18:52:33.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.873+0000 7f9d4d72b800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3b350 0x5597eae3b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.873+0000 7f9d4d72b800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5597eaf2d030 con 0x5597eae3b350 2024-05-08T18:52:33.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.873+0000 7f9d49b4c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3b350 0x5597eae3b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.873+0000 7f9d49b4c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3b350 0x5597eae3b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53880/0 (socket says 172.21.15.132:53880) 2024-05-08T18:52:33.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.873+0000 7f9d49b4c640 1 -- 172.21.15.132:0/4051354479 learned_addr learned my addr 172.21.15.132:0/4051354479 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.873+0000 7f9d49b4c640 1 -- 172.21.15.132:0/4051354479 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597eae39b50 con 0x5597eae3b350 2024-05-08T18:52:33.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.874+0000 7f9d49b4c640 1 --2- 172.21.15.132:0/4051354479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3b350 0x5597eae3b770 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f9d44052c50 tx=0x7f9d44011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3e1dcd933783c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.874+0000 7f9c2cff9640 1 -- 172.21.15.132:0/4051354479 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d44028030 con 0x5597eae3b350 2024-05-08T18:52:33.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.874+0000 7f9c2cff9640 1 -- 172.21.15.132:0/4051354479 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d4402b350 con 0x5597eae3b350 2024-05-08T18:52:33.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.874+0000 7f9c2cff9640 1 -- 172.21.15.132:0/4051354479 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d44016910 con 0x5597eae3b350 2024-05-08T18:52:33.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.874+0000 7f9d4d72b800 1 -- 172.21.15.132:0/4051354479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3b350 msgr2=0x5597eae3b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.874+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/4051354479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3b350 0x5597eae3b770 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f9d44052c50 tx=0x7f9d44011a80 comp rx=0 tx=0).stop 2024-05-08T18:52:33.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.874+0000 7f9d4d72b800 1 -- 172.21.15.132:0/4051354479 shutdown_connections 2024-05-08T18:52:33.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.874+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/4051354479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3b350 0x5597eae3b770 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.874+0000 7f9d4d72b800 1 -- 172.21.15.132:0/4051354479 >> 172.21.15.132:0/4051354479 conn(0x5597eaf58d20 msgr2=0x5597eaf56d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.874+0000 7f9d4d72b800 1 -- 172.21.15.132:0/4051354479 shutdown_connections 2024-05-08T18:52:33.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.874+0000 7f9d4d72b800 1 -- 172.21.15.132:0/4051354479 wait complete. 2024-05-08T18:52:33.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.875+0000 7f9d4d72b800 1 Processor -- start 2024-05-08T18:52:33.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.875+0000 7f9d4d72b800 1 -- start start 2024-05-08T18:52:33.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.875+0000 7f9d4d72b800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3b350 0x5597eaf66180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.875+0000 7f9d4d72b800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x5597eae3a020 con 0x5597eae3b350 2024-05-08T18:52:33.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.875+0000 7f9d49b4c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3b350 0x5597eaf66180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.875+0000 7f9d49b4c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3b350 0x5597eaf66180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:53894/0 (socket says 172.21.15.132:53894) 2024-05-08T18:52:33.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.875+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 learned_addr learned my addr 172.21.15.132:0/2452101458 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:52:33.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.875+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597eaf666c0 con 0x5597eae3b350 2024-05-08T18:52:33.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.875+0000 7f9d49b4c640 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3b350 0x5597eaf66180 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f9d44051b20 tx=0x7f9d44052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.876+0000 7f9c1effd640 1 -- 172.21.15.132:0/2452101458 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d440542e0 con 0x5597eae3b350 2024-05-08T18:52:33.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.876+0000 7f9c1effd640 1 -- 172.21.15.132:0/2452101458 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d44032020 con 0x5597eae3b350 2024-05-08T18:52:33.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.876+0000 7f9c1effd640 1 -- 172.21.15.132:0/2452101458 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d44001770 con 0x5597eae3b350 2024-05-08T18:52:33.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.876+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5597eaf66950 con 0x5597eae3b350 2024-05-08T18:52:33.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.876+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597eaf69600 con 0x5597eae3b350 2024-05-08T18:52:33.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.876+0000 7f9c1effd640 1 -- 172.21.15.132:0/2452101458 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f9d4404b050 con 0x5597eae3b350 2024-05-08T18:52:33.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.877+0000 7f9c1effd640 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c1403bba0 0x7f9c1403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.877+0000 7f9c1effd640 1 -- 172.21.15.132:0/2452101458 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f9d44033030 con 0x5597eae3b350 2024-05-08T18:52:33.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.877+0000 7f9d4934b640 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c1403bba0 0x7f9c1403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.877+0000 7f9d4934b640 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c1403bba0 0x7f9c1403e060 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c00b6e0 tx=0x7f9d3c04d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.877+0000 7f9d4d72b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.877+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5597eaf71cd0 0x5597eaf74190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.877+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf748e0 con 0x5597eaf71cd0 2024-05-08T18:52:33.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.877+0000 7f9d40b4a640 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5597eaf71cd0 0x5597eaf74190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.878+0000 7f9d40b4a640 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5597eaf71cd0 0x5597eaf74190 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.878+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d3405a040 con 0x5597eaf71cd0 2024-05-08T18:52:33.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.878+0000 7f9d4d72b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.878+0000 7f9d4d72b800 20 realm 2024-05-08T18:52:33.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.878+0000 7f9d4d72b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.878+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf74cb0 con 0x5597eaf71cd0 2024-05-08T18:52:33.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.878+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d3405a040 con 0x5597eaf71cd0 2024-05-08T18:52:33.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.878+0000 7f9d4d72b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.878+0000 7f9d4d72b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:52:33.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.878+0000 7f9d4d72b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.878+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf75580 con 0x5597eaf71cd0 2024-05-08T18:52:33.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.878+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d3405a040 con 0x5597eaf71cd0 2024-05-08T18:52:33.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.878+0000 7f9d4d72b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.878+0000 7f9d4d72b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.878+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf75920 con 0x5597eaf71cd0 2024-05-08T18:52:33.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.879+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9d3405a040 con 0x5597eaf71cd0 2024-05-08T18:52:33.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.879+0000 7f9d4d72b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:33.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.879+0000 7f9d4d72b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.879+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5597eaf76680 0x5597eaf78a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.879+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf79030 con 0x5597eaf76680 2024-05-08T18:52:33.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.879+0000 7f9d49b4c640 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5597eaf76680 0x5597eaf78a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.879+0000 7f9d49b4c640 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5597eaf76680 0x5597eaf78a70 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.879+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9d4402a070 con 0x5597eaf76680 2024-05-08T18:52:33.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.879+0000 7f9d4d72b800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:52:33.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.879+0000 7f9d4d72b800 20 searching for the correct realm 2024-05-08T18:52:33.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.879+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x5597eaf76680 2024-05-08T18:52:33.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.880+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d4402a070 con 0x5597eaf76680 2024-05-08T18:52:33.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.880+0000 7f9d49b4c640 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9d44014070 0x7f9d4402ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.880+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x7f9d44014070 2024-05-08T18:52:33.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.880+0000 7f9d4934b640 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9d44014070 0x7f9d4402ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.880+0000 7f9d4934b640 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9d44014070 0x7f9d4402ca00 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.880+0000 7f9d4934b640 1 -- 172.21.15.132:0/2452101458 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3c02b070 con 0x7f9d44014070 2024-05-08T18:52:33.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.880+0000 7f9d4934b640 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f9d3c017050 0x7f9d3c052190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:52:33.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.880+0000 7f9d4934b640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x7f9d3c017050 2024-05-08T18:52:33.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.881+0000 7f9d40b4a640 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f9d3c017050 0x7f9d3c052190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:52:33.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.881+0000 7f9d40b4a640 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f9d3c017050 0x7f9d3c052190 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:52:33.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.881+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3405a040 con 0x7f9d3c017050 2024-05-08T18:52:33.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.881+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x5597eaf71cd0 2024-05-08T18:52:33.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.881+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3405a040 con 0x5597eaf71cd0 2024-05-08T18:52:33.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.881+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x5597eaf71cd0 2024-05-08T18:52:33.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.882+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3405a040 con 0x5597eaf71cd0 2024-05-08T18:52:33.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.882+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x7f9d3c017050 2024-05-08T18:52:33.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.882+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3405a040 con 0x7f9d3c017050 2024-05-08T18:52:33.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.882+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x7f9d3c017050 2024-05-08T18:52:33.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.882+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3405a040 con 0x7f9d3c017050 2024-05-08T18:52:33.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.882+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x7f9d44014070 2024-05-08T18:52:33.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.882+0000 7f9d4934b640 1 -- 172.21.15.132:0/2452101458 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3c02b070 con 0x7f9d44014070 2024-05-08T18:52:33.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.882+0000 7f9d4934b640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x5597eaf76680 2024-05-08T18:52:33.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.883+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d44061040 con 0x5597eaf76680 2024-05-08T18:52:33.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.883+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x5597eaf71cd0 2024-05-08T18:52:33.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.883+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3405a040 con 0x5597eaf71cd0 2024-05-08T18:52:33.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.883+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x7f9d3c017050 2024-05-08T18:52:33.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.883+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3405a040 con 0x7f9d3c017050 2024-05-08T18:52:33.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.883+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x5597eaf71cd0 2024-05-08T18:52:33.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.883+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9d3405a040 con 0x5597eaf71cd0 2024-05-08T18:52:33.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.883+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x7f9d44014070 2024-05-08T18:52:33.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.884+0000 7f9d4934b640 1 -- 172.21.15.132:0/2452101458 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9d3c02b070 con 0x7f9d44014070 2024-05-08T18:52:33.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.884+0000 7f9d4934b640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x5597eaf76680 2024-05-08T18:52:33.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.884+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v27'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9d44061040 con 0x5597eaf76680 2024-05-08T18:52:33.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.884+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x5597eaf76680 2024-05-08T18:52:33.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.884+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d44061040 con 0x5597eaf76680 2024-05-08T18:52:33.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.884+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x7f9d3c017050 2024-05-08T18:52:33.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.884+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3405a040 con 0x7f9d3c017050 2024-05-08T18:52:33.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.884+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x5597eaf76680 2024-05-08T18:52:33.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.885+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d44061040 con 0x5597eaf76680 2024-05-08T18:52:33.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.885+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x5597eaf76680 2024-05-08T18:52:33.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.885+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d44061040 con 0x5597eaf76680 2024-05-08T18:52:33.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.885+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x5597eaf71cd0 2024-05-08T18:52:33.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.885+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3405a040 con 0x5597eaf71cd0 2024-05-08T18:52:33.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.885+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x5597eaf71cd0 2024-05-08T18:52:33.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.885+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v27'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9d3405a040 con 0x5597eaf71cd0 2024-05-08T18:52:33.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.885+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x7f9d3c017050 2024-05-08T18:52:33.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.885+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3407d040 con 0x7f9d3c017050 2024-05-08T18:52:33.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.885+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x5597eaf76680 2024-05-08T18:52:33.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.886+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d44061040 con 0x5597eaf76680 2024-05-08T18:52:33.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.886+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x7f9d44014070 2024-05-08T18:52:33.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.886+0000 7f9d4934b640 1 -- 172.21.15.132:0/2452101458 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3c02b070 con 0x7f9d44014070 2024-05-08T18:52:33.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.886+0000 7f9d4934b640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x5597eaf71cd0 2024-05-08T18:52:33.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.886+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3407d040 con 0x5597eaf71cd0 2024-05-08T18:52:33.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.886+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x7f9d44014070 2024-05-08T18:52:33.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.886+0000 7f9d4934b640 1 -- 172.21.15.132:0/2452101458 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3c02b070 con 0x7f9d44014070 2024-05-08T18:52:33.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.886+0000 7f9d4934b640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x5597eaf76680 2024-05-08T18:52:33.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.887+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d44061040 con 0x5597eaf76680 2024-05-08T18:52:33.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.887+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x7f9d3c017050 2024-05-08T18:52:33.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.887+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3407d040 con 0x7f9d3c017050 2024-05-08T18:52:33.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.887+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x7f9d44014070 2024-05-08T18:52:33.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.887+0000 7f9d4934b640 1 -- 172.21.15.132:0/2452101458 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3c02b070 con 0x7f9d44014070 2024-05-08T18:52:33.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.887+0000 7f9d4934b640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x5597eaf76680 2024-05-08T18:52:33.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.887+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d44061040 con 0x5597eaf76680 2024-05-08T18:52:33.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.887+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x7f9d3c017050 2024-05-08T18:52:33.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.888+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3407d040 con 0x7f9d3c017050 2024-05-08T18:52:33.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.888+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x5597eaf71cd0 2024-05-08T18:52:33.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.888+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v27'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9d3407d040 con 0x5597eaf71cd0 2024-05-08T18:52:33.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.888+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7a980 con 0x7f9d44014070 2024-05-08T18:52:33.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.888+0000 7f9d4934b640 1 -- 172.21.15.132:0/2452101458 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9d3c02b070 con 0x7f9d44014070 2024-05-08T18:52:33.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.888+0000 7f9d4d72b800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:52:33.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.888+0000 7f9d4d72b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:52:33.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.888+0000 7f9d4d72b800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:52:33.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.888+0000 7f9d4d72b800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:52:33.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.888+0000 7f9d4d72b800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:52:33.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.888+0000 7f9d4d72b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:52:33.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.888+0000 7f9d4d72b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.888+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf799f0 con 0x5597eaf71cd0 2024-05-08T18:52:33.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.888+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9d3407d040 con 0x5597eaf71cd0 2024-05-08T18:52:33.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.888+0000 7f9d4d72b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.888+0000 7f9d4d72b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.888+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf79630 con 0x5597eaf71cd0 2024-05-08T18:52:33.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.889+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9d3407d040 con 0x5597eaf71cd0 2024-05-08T18:52:33.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.889+0000 7f9d4d72b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:52:33.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.889+0000 7f9d4d72b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.889+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf79e30 con 0x5597eaf71cd0 2024-05-08T18:52:33.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.889+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9d3407d040 con 0x5597eaf71cd0 2024-05-08T18:52:33.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.889+0000 7f9d4d72b800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:52:33.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.889+0000 7f9d4d72b800 20 zone default found 2024-05-08T18:52:33.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.889+0000 7f9d4d72b800 4 Realm: () 2024-05-08T18:52:33.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.889+0000 7f9d4d72b800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:52:33.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.889+0000 7f9d4d72b800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:52:33.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.889+0000 7f9d4d72b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:52:33.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.889+0000 7f9d4d72b800 20 zonegroup default 2024-05-08T18:52:33.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.889+0000 7f9d4d72b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.889+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7b2b0 con 0x7f9d44014070 2024-05-08T18:52:33.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.889+0000 7f9d4934b640 1 -- 172.21.15.132:0/2452101458 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9d3c02b070 con 0x7f9d44014070 2024-05-08T18:52:33.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.889+0000 7f9d4d72b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.889+0000 7f9d4d72b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.889+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7d4e0 con 0x5597eaf76680 2024-05-08T18:52:33.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.889+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9d44061040 con 0x5597eaf76680 2024-05-08T18:52:33.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.890+0000 7f9d4d72b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.890+0000 7f9d4d72b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.890+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7d880 con 0x5597eaf76680 2024-05-08T18:52:33.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.890+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9d44061040 con 0x5597eaf76680 2024-05-08T18:52:33.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.890+0000 7f9d4d72b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:52:33.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.890+0000 7f9d4d72b800 20 started sync module instance, tier type = 2024-05-08T18:52:33.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.890+0000 7f9d4d72b800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:52:33.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.890+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7c920 con 0x7f9d44014070 2024-05-08T18:52:33.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.891+0000 7f9d4934b640 1 -- 172.21.15.132:0/2452101458 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3c02b070 con 0x7f9d44014070 2024-05-08T18:52:33.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.891+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94110970531136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7c580 con 0x7f9d44014070 2024-05-08T18:52:33.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.891+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7e220 con 0x5597eaf71cd0 2024-05-08T18:52:33.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.892+0000 7f9d4934b640 1 -- 172.21.15.132:0/2452101458 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94110970531136] v27'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3c02b070 con 0x7f9d44014070 2024-05-08T18:52:33.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.892+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3407d040 con 0x5597eaf71cd0 2024-05-08T18:52:33.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.892+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94110970534016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7e610 con 0x5597eaf71cd0 2024-05-08T18:52:33.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.892+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7f060 con 0x5597eaf76680 2024-05-08T18:52:33.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.893+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94110970534016] v27'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3407d040 con 0x5597eaf71cd0 2024-05-08T18:52:33.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.893+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d44061040 con 0x5597eaf76680 2024-05-08T18:52:33.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.893+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94110970538832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7f020 con 0x5597eaf76680 2024-05-08T18:52:33.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.893+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7fac0 con 0x7f9d44014070 2024-05-08T18:52:33.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.894+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94110970538832] v27'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d44061040 con 0x5597eaf76680 2024-05-08T18:52:33.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.895+0000 7f9d4934b640 1 -- 172.21.15.132:0/2452101458 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3c02b070 con 0x7f9d44014070 2024-05-08T18:52:33.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.895+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94110970535072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7feb0 con 0x7f9d44014070 2024-05-08T18:52:33.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.895+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf808d0 con 0x5597eaf71cd0 2024-05-08T18:52:33.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.896+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3407d040 con 0x5597eaf71cd0 2024-05-08T18:52:33.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.896+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94110970545088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf808d0 con 0x5597eaf71cd0 2024-05-08T18:52:33.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.896+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf818a0 con 0x7f9d3c017050 2024-05-08T18:52:33.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.896+0000 7f9d4934b640 1 -- 172.21.15.132:0/2452101458 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94110970535072] v27'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3c02b070 con 0x7f9d44014070 2024-05-08T18:52:33.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.897+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3407d040 con 0x7f9d3c017050 2024-05-08T18:52:33.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.897+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94110970549136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf81860 con 0x7f9d3c017050 2024-05-08T18:52:33.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.897+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf82310 con 0x7f9d3c017050 2024-05-08T18:52:33.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.897+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94110970545088] v27'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3407d040 con 0x5597eaf71cd0 2024-05-08T18:52:33.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.898+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94110970549136] v27'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3407d040 con 0x7f9d3c017050 2024-05-08T18:52:33.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.898+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3407d040 con 0x7f9d3c017050 2024-05-08T18:52:33.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.898+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94110970541504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf80c10 con 0x7f9d3c017050 2024-05-08T18:52:33.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.898+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf82930 con 0x7f9d3c017050 2024-05-08T18:52:33.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.899+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94110970541504] v27'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3407d040 con 0x7f9d3c017050 2024-05-08T18:52:33.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.899+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3407d040 con 0x7f9d3c017050 2024-05-08T18:52:33.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.899+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94110970551792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf82930 con 0x7f9d3c017050 2024-05-08T18:52:33.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.899+0000 7f9d4d72b800 20 add_watcher() i=0 2024-05-08T18:52:33.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.899+0000 7f9d4d72b800 20 add_watcher() i=1 2024-05-08T18:52:33.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.899+0000 7f9d4d72b800 20 add_watcher() i=2 2024-05-08T18:52:33.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.899+0000 7f9d4d72b800 20 add_watcher() i=3 2024-05-08T18:52:33.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.899+0000 7f9d4d72b800 20 add_watcher() i=4 2024-05-08T18:52:33.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.899+0000 7f9d4d72b800 20 add_watcher() i=5 2024-05-08T18:52:33.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.899+0000 7f9d4d72b800 20 add_watcher() i=6 2024-05-08T18:52:33.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.900+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94110970551792] v27'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3407d040 con 0x7f9d3c017050 2024-05-08T18:52:33.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.900+0000 7f9d4d72b800 20 add_watcher() i=7 2024-05-08T18:52:33.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.900+0000 7f9d4d72b800 2 all 8 watchers are set, enabling cache 2024-05-08T18:52:33.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.900+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf85bd0 con 0x5597eaf71cd0 2024-05-08T18:52:33.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.900+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9d3407d040 con 0x5597eaf71cd0 2024-05-08T18:52:33.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.900+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94110970553840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf82ec0 con 0x5597eaf71cd0 2024-05-08T18:52:33.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.901+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94110970553840] v27'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9d3407d040 con 0x5597eaf71cd0 2024-05-08T18:52:33.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.901+0000 7f9bff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:33.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.902+0000 7f9d4d72b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:52:33.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.902+0000 7f9d4d72b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:52:33.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.902+0000 7f9d4d72b800 5 note: GC not initialized 2024-05-08T18:52:33.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.902+0000 7f9bfe7e4640 20 reqs_thread_entry: start 2024-05-08T18:52:33.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.902+0000 7f9d4d72b800 20 init_complete bucket index max shards: 11 2024-05-08T18:52:33.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.902+0000 7f9d4d72b800 20 Filter name: none 2024-05-08T18:52:33.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.902+0000 7f9b6ffff640 20 reqs_thread_entry: start 2024-05-08T18:52:33.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.902+0000 7f9d4d72b800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:52:33.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.902+0000 7f9d4d72b800 20 rados->read ofs=0 len=0 2024-05-08T18:52:33.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.902+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597eafb9150 con 0x7f9d3c017050 2024-05-08T18:52:33.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.903+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f9d3407d040 con 0x7f9d3c017050 2024-05-08T18:52:33.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.903+0000 7f9d4d72b800 20 rados_obj.operate() r=0 bl.length=473 2024-05-08T18:52:33.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.903+0000 7f9d4d72b800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:52:33.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.903+0000 7f9d4d72b800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:33.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.903+0000 7f9d4d72b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:52:33.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.903+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eafbf9c0 con 0x7f9d3c017050 2024-05-08T18:52:33.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.904+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v27'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9d3407d040 con 0x7f9d3c017050 2024-05-08T18:52:33.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.904+0000 7f9d4d72b800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:52:33.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.904+0000 7f9d4d72b800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:33.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.904+0000 7f9d4d72b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:52:33.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.904+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94110970803072 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5597eafbafa0 con 0x5597eaf71cd0 2024-05-08T18:52:33.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.904+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== watch-notify(notify (1) cookie 94110970545088 notify 115964117023 ret 0) ==== 691+0+0 (crc 0 0 0) 0x5597eae43380 con 0x5597eaf71cd0 2024-05-08T18:52:33.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.904+0000 7f9c2cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117023 cookie 94110970545088 notifier 4914 bl.length()=649 2024-05-08T18:52:33.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.904+0000 7f9c2cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:52:33.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.904+0000 7f9c2cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:52:33.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.904+0000 7f9c2cff9640 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f9c0c003ea0 con 0x5597eaf71cd0 2024-05-08T18:52:33.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.904+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(64 notify.4 [notify cookie 94110970803072 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9d3407d040 con 0x5597eaf71cd0 2024-05-08T18:52:33.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.904+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3407d040 con 0x5597eaf71cd0 2024-05-08T18:52:33.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.905+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== watch-notify(notify_complete (2) cookie 94110970803072 notify 115964117023 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9d3405dcf0 con 0x5597eaf71cd0 2024-05-08T18:52:33.923 INFO:teuthology.orchestra.run.smithi132.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:52:31.994053Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:52:31.994040Z","tags":[],"group_ids":[]} 2024-05-08T18:52:33.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.905+0000 7f9bff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:52:33.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.905+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94110970553840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eafbb760 con 0x5597eaf71cd0 2024-05-08T18:52:33.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.906+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94110970553840] v27'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9d3407d040 con 0x5597eaf71cd0 2024-05-08T18:52:33.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.906+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94110970531136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eafbb760 con 0x7f9d44014070 2024-05-08T18:52:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.907+0000 7f9d4934b640 1 -- 172.21.15.132:0/2452101458 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94110970531136] v27'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3c02b070 con 0x7f9d44014070 2024-05-08T18:52:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.907+0000 7f9d4d72b800 20 remove_watcher() i=0 2024-05-08T18:52:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.907+0000 7f9d4d72b800 2 removed watcher, disabling cache 2024-05-08T18:52:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.907+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94110970534016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eafbb760 con 0x5597eaf71cd0 2024-05-08T18:52:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.909+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94110970534016] v27'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3407d040 con 0x5597eaf71cd0 2024-05-08T18:52:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.909+0000 7f9d4d72b800 20 remove_watcher() i=1 2024-05-08T18:52:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.909+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94110970538832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eafbb760 con 0x5597eaf76680 2024-05-08T18:52:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.910+0000 7f9d49b4c640 1 -- 172.21.15.132:0/2452101458 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94110970538832] v27'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d44061040 con 0x5597eaf76680 2024-05-08T18:52:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.910+0000 7f9d4d72b800 20 remove_watcher() i=2 2024-05-08T18:52:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.910+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94110970535072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eafbb760 con 0x7f9d44014070 2024-05-08T18:52:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.911+0000 7f9d4934b640 1 -- 172.21.15.132:0/2452101458 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94110970535072] v27'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3c02b070 con 0x7f9d44014070 2024-05-08T18:52:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.911+0000 7f9d4d72b800 20 remove_watcher() i=3 2024-05-08T18:52:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.911+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94110970545088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7eb50 con 0x5597eaf71cd0 2024-05-08T18:52:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.912+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94110970545088] v27'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3407d040 con 0x5597eaf71cd0 2024-05-08T18:52:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.912+0000 7f9d4d72b800 20 remove_watcher() i=4 2024-05-08T18:52:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.912+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94110970549136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7eb50 con 0x7f9d3c017050 2024-05-08T18:52:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.913+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94110970549136] v27'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3407d040 con 0x7f9d3c017050 2024-05-08T18:52:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.913+0000 7f9d4d72b800 20 remove_watcher() i=5 2024-05-08T18:52:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.913+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94110970541504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7eb50 con 0x7f9d3c017050 2024-05-08T18:52:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.914+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94110970541504] v27'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3407d040 con 0x7f9d3c017050 2024-05-08T18:52:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.914+0000 7f9d4d72b800 20 remove_watcher() i=6 2024-05-08T18:52:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.914+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94110970551792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5597eaf7eb50 con 0x7f9d3c017050 2024-05-08T18:52:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94110970551792] v27'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9d3407d040 con 0x7f9d3c017050 2024-05-08T18:52:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d4d72b800 20 remove_watcher() i=7 2024-05-08T18:52:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f9d3c017050 msgr2=0x7f9d3c052190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f9d3c017050 0x7f9d3c052190 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5597eaf71cd0 msgr2=0x5597eaf74190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5597eaf71cd0 0x5597eaf74190 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9d44014070 msgr2=0x7f9d4402ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f9d44014070 0x7f9d4402ca00 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5597eaf76680 msgr2=0x5597eaf78a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5597eaf76680 0x5597eaf78a70 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c1403bba0 msgr2=0x7f9c1403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c1403bba0 0x7f9c1403e060 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c00b6e0 tx=0x7f9d3c04d000 comp rx=0 tx=0).stop 2024-05-08T18:52:33.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d40b4a640 1 -- 172.21.15.132:0/2452101458 reap_dead start 2024-05-08T18:52:33.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3b350 msgr2=0x5597eaf66180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3b350 0x5597eaf66180 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f9d44051b20 tx=0x7f9d44052be0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 shutdown_connections 2024-05-08T18:52:33.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/2452101458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3b350 0x5597eaf66180 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 >> 172.21.15.132:0/2452101458 conn(0x5597eaf58d20 msgr2=0x5597eaf56380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 shutdown_connections 2024-05-08T18:52:33.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d4d72b800 1 -- 172.21.15.132:0/2452101458 wait complete. 2024-05-08T18:52:33.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d4d72b800 1 -- 172.21.15.132:0/1200139345 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c2003bba0 msgr2=0x7f9c2003e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/1200139345 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c2003bba0 0x7f9c2003e060 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x5597eaf3be80 tx=0x7f9d3c050ce0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d4d72b800 1 -- 172.21.15.132:0/1200139345 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eaf4f790 msgr2=0x5597eaf4fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.915+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/1200139345 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eaf4f790 0x5597eaf4fbb0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x5597eaf3bde0 tx=0x7f9d44018830 comp rx=0 tx=0).stop 2024-05-08T18:52:33.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.916+0000 7f9d4d72b800 1 -- 172.21.15.132:0/1200139345 shutdown_connections 2024-05-08T18:52:33.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.916+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/1200139345 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c2003bba0 0x7f9c2003e060 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.916+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/1200139345 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eaf4f790 0x5597eaf4fbb0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.916+0000 7f9d4d72b800 1 -- 172.21.15.132:0/1200139345 >> 172.21.15.132:0/1200139345 conn(0x5597eaf43830 msgr2=0x5597eaf43c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.916+0000 7f9d4d72b800 1 -- 172.21.15.132:0/1200139345 shutdown_connections 2024-05-08T18:52:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.916+0000 7f9d4d72b800 1 -- 172.21.15.132:0/1200139345 wait complete. 2024-05-08T18:52:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.916+0000 7f9d4d72b800 1 -- 172.21.15.132:0/3278343012 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5597eae3f870 msgr2=0x5597eaf3b4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.916+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/3278343012 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5597eae3f870 0x5597eaf3b4a0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.916+0000 7f9d4d72b800 1 -- 172.21.15.132:0/3278343012 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5597eaf3dd30 msgr2=0x5597eaf40120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.916+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/3278343012 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5597eaf3dd30 0x5597eaf40120 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.916+0000 7f9d4d72b800 1 -- 172.21.15.132:0/3278343012 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c3003bb50 msgr2=0x7f9c3003e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.916+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/3278343012 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c3003bb50 0x7f9c3003e010 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9d34054000 tx=0x7f9d3404e000 comp rx=0 tx=0).stop 2024-05-08T18:52:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.916+0000 7f9d4d72b800 1 -- 172.21.15.132:0/3278343012 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3bd60 msgr2=0x5597eaf34260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:52:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.916+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/3278343012 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3bd60 0x5597eaf34260 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c00c010 tx=0x7f9d3c000ed0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.916+0000 7f9d4d72b800 1 -- 172.21.15.132:0/3278343012 shutdown_connections 2024-05-08T18:52:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.916+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/3278343012 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x5597eaf3dd30 0x5597eaf40120 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.916+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/3278343012 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x5597eae3f870 0x5597eaf3b4a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.916+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/3278343012 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f9c3003bb50 0x7f9c3003e010 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.916+0000 7f9d4d72b800 1 --2- 172.21.15.132:0/3278343012 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x5597eae3bd60 0x5597eaf34260 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:52:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.916+0000 7f9d4d72b800 1 -- 172.21.15.132:0/3278343012 >> 172.21.15.132:0/3278343012 conn(0x5597eae35730 msgr2=0x5597eaf26800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:52:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.916+0000 7f9d4d72b800 1 -- 172.21.15.132:0/3278343012 shutdown_connections 2024-05-08T18:52:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:52:33.916+0000 7f9d4d72b800 1 -- 172.21.15.132:0/3278343012 wait complete. 2024-05-08T18:52:33.935 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:52:31.994053Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:31.994040Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:33.935 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:52:31.994053Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:52:31.994040Z', 'tags': [], 'group_ids': []} 2024-05-08T18:52:33.935 ERROR:root:0 2024-05-08T18:52:33.935 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-05-08T18:52:33.942 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:52:33.943 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:52:33.946 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:52:33.947 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-05-08T18:52:33.952 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:52:33.952 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:52:33.955 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:52:33.955 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-05-08T18:52:33.963 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-05-08T18:52:33.963 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:52:33.966 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:52:33.967 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-05-08T18:52:33.974 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:52:33.974 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:52:33.977 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:52:33.978 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-05-08T18:52:33.985 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-05-08T18:52:33.985 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:52:33.989 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:52:33.989 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-05-08T18:52:33.997 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-05-08T18:52:33.997 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:52:34.001 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:52:34.001 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-05-08T18:52:34.007 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:52:34.008 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:52:34.011 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:52:34.011 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-05-08T18:52:34.016 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:52:34.016 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:52:34.019 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:52:34.020 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-05-08T18:52:34.027 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:52:34.027 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:52:34.030 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:52:34.031 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-05-08T18:52:34.035 INFO:tasks.radosgw_admin_rest: json result: [] 2024-05-08T18:52:34.036 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-05-08T18:52:34.040 INFO:tasks.radosgw_admin_rest: json result: [] 2024-05-08T18:52:34.055 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-05-08T18:52:34.058 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-05-08T18:52:34.059 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-05-08T18:52:34.063 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '23dcc2a0-b283-45fd-8c01-831457a34b43', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11', 'marker': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:52:34.052431Z', 'creation_time': '2024-05-08T18:52:34.045367Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T18:52:34.064 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-05-08T18:52:34.068 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '23dcc2a0-b283-45fd-8c01-831457a34b43', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11', 'marker': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:52:34.052431Z', 'creation_time': '2024-05-08T18:52:34.045367Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-05-08T18:52:34.072 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-05-08T18:52:34.077 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '23dcc2a0-b283-45fd-8c01-831457a34b43', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11', 'marker': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:52:34.052431Z', 'creation_time': '2024-05-08T18:52:34.045367Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T18:52:34.078 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-05-08T18:52:34.082 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx00000560ac4596197ed39-00663bc9f2-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:52:34.087 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-05-08T18:52:34.093 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:52:34.093 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-05-08T18:52:34.102 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'fud', 'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:52:34.150 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11'} 2024-05-08T18:52:34.160 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:52:34.162 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11'} 2024-05-08T18:52:34.172 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:52:34.172 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-05-08T18:52:34.181 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:52:34.187 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-05-08T18:52:34.193 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:52:34.193 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-05-08T18:52:34.198 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '23dcc2a0-b283-45fd-8c01-831457a34b43', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11', 'marker': 'bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:52:34.169412Z', 'creation_time': '2024-05-08T18:52:34.045367Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T18:53:34.246 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-05-08T18:53:34.264 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'bar', 'categories': [], 's3select': {}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'bud', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'fud', 'categories': [], 's3select': {}}, {'bucket': 'myfoo7', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'fud', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:53:34.264 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-05-08T18:53:34.279 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo7', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:53:34.279 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-05-08T18:53:34.284 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:53:34.284 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-05-08T18:53:34.288 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:53:34.289 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-05-08T18:53:34.293 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:53:34.293 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-05-08T18:53:34.298 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:53:34.298 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-05-08T18:53:34.302 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:53:34.303 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-05-08T18:53:34.309 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:53:34.310 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-05-08T18:53:34.314 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-05-08T18:53:34.314 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-05-08T18:53:34.323 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:53:34.327 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-05-08T18:53:34.335 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:53:34.573 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-05-08T18:53:34.578 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000b99acd045dab5c5f-00663bca2e-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:53:34.671 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-05-08T18:53:34.675 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-05-08T18:53:34.680 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-05-08T18:53:34.684 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-05-08T18:53:34.798 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-05-08T18:53:34.831 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:53:34.831 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-05-08T18:53:34.836 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-05-08T18:53:34.836 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-05-08T18:53:34.842 INFO:tasks.radosgw_admin_rest: json result: [] 2024-05-08T18:53:34.851 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-05-08T18:53:34.855 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000be389f2ef5d5e0e4-00663bca2e-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:53:34.873 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-05-08T18:53:34.901 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:53:34.901 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:53:34.905 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000e9d5e7d50d7ac48f-00663bca2e-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:53:34.905 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-05-08T18:53:34.908 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '772ec65a-301b-4446-89ae-86d9bcfb0a5c'}]}} 2024-05-08T18:53:34.909 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-05-08T18:53:34.919 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'ratelimit_user', 'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:53:34.919 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-05-08T18:53:34.922 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-05-08T18:53:34.923 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-05-08T18:53:34.927 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000b00674d3afa8c161-00663bca2e-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:53:34.927 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-05-08T18:53:34.930 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000a69ffd6708edace0-00663bca2e-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:53:34.941 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-05-08T18:53:34.945 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-05-08T18:53:34.945 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-05-08T18:53:34.949 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000d0f5431f6841ec6e-00663bca2e-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:53:34.949 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-05-08T18:53:34.952 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000037a295e047b1f0c2-00663bca2e-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:53:34.953 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-05-08T18:53:34.956 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-05-08T18:53:34.957 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-05-08T18:53:34.960 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000bbb33126f3f5f7fe-00663bca2e-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:53:34.961 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-05-08T18:53:34.964 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000adbc1a1879bcd3fa-00663bca2e-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:53:34.964 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-05-08T18:53:34.968 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000009afd042446444a92-00663bca2e-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:53:34.968 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-05-08T18:53:34.971 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000073c70eda5425d9a9-00663bca2e-4221-default', 'HostId': '4221-default-default'} 2024-05-08T18:53:34.971 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-05-08T18:53:34.980 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:53:34.981 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-05-08T18:53:34.984 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-05-08T18:53:34.984 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-05-08T18:53:34.989 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:53:34.990 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-05-08T18:53:34.993 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-05-08T18:53:34.993 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-05-08T18:53:34.998 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:53:35.002 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-05-08T18:53:35.012 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-05-08T18:53:35.012 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:53:35.013 INFO:tasks.rgw.client.0.smithi132.stdout:2024-05-08T18:53:35.014+0000 7fb8bf4ed640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 35166) UID: 0 2024-05-08T18:53:35.013 INFO:tasks.rgw.client.0.smithi132.stdout:2024-05-08T18:53:35.014+0000 7fb8c2d46880 -1 shutting down 2024-05-08T18:53:39.865 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-05-08T18:53:41.115 INFO:tasks.rgw.client.0:Stopped 2024-05-08T18:53:41.115 DEBUG:teuthology.orchestra.run.smithi132:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-05-08T18:53:41.134 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f /etc/ceph/vault-root-token 2024-05-08T18:53:41.204 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-05-08T18:53:41.272 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-05-08T18:53:41.272 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-05-08T18:53:41.273 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-05-08T18:53:41.360 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:53:41.360 INFO:teuthology.orchestra.run.smithi132.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:53:41.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.361+0000 7f857f3a2800 1 Processor -- start 2024-05-08T18:53:41.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.361+0000 7f857f3a2800 1 -- start start 2024-05-08T18:53:41.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.361+0000 7f857f3a2800 1 --2- >> v2:172.21.15.42:3300/0 conn(0x56000c607140 0x56000c607560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:41.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.362+0000 7f857f3a2800 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56000c607be0 con 0x56000c6083a0 2024-05-08T18:53:41.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.362+0000 7f857f3a2800 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x56000c4a8e20 con 0x56000c607140 2024-05-08T18:53:41.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.362+0000 7f857ce9a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x56000c607140 0x56000c607560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:41.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.362+0000 7f857ce9a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x56000c607140 0x56000c607560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:37000/0 (socket says 172.21.15.132:37000) 2024-05-08T18:53:41.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.362+0000 7f8574699640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x56000c6083a0 0x56000c608820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.132:44460/0 (socket says 172.21.15.132:44460) 2024-05-08T18:53:41.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.362+0000 7f857ce9a640 1 -- 172.21.15.132:0/3787258060 learned_addr learned my addr 172.21.15.132:0/3787258060 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:53:41.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.362+0000 7f857ce9a640 1 -- 172.21.15.132:0/3787258060 >> v1:172.21.15.42:6789/0 conn(0x56000c6083a0 legacy=0x56000c608820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:41.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.362+0000 7f857ce9a640 1 -- 172.21.15.132:0/3787258060 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56000c608f60 con 0x56000c607140 2024-05-08T18:53:41.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.364+0000 7f857ce9a640 1 --2- 172.21.15.132:0/3787258060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c607140 0x56000c607560 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f856c00a520 tx=0x7f856c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c75178b64ecdeb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:41.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.364+0000 7f8577fff640 1 -- 172.21.15.132:0/3787258060 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f856c057070 con 0x56000c607140 2024-05-08T18:53:41.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.364+0000 7f8577fff640 1 -- 172.21.15.132:0/3787258060 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f856c052570 con 0x56000c607140 2024-05-08T18:53:41.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.364+0000 7f8577fff640 1 -- 172.21.15.132:0/3787258060 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f856c052870 con 0x56000c607140 2024-05-08T18:53:41.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.365+0000 7f857f3a2800 1 -- 172.21.15.132:0/3787258060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c607140 msgr2=0x56000c607560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:41.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.365+0000 7f857f3a2800 1 --2- 172.21.15.132:0/3787258060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c607140 0x56000c607560 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f856c00a520 tx=0x7f856c01d010 comp rx=0 tx=0).stop 2024-05-08T18:53:41.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.365+0000 7f857f3a2800 1 -- 172.21.15.132:0/3787258060 shutdown_connections 2024-05-08T18:53:41.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.365+0000 7f857f3a2800 1 --2- 172.21.15.132:0/3787258060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c607140 0x56000c607560 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:41.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.365+0000 7f857f3a2800 1 -- 172.21.15.132:0/3787258060 >> 172.21.15.132:0/3787258060 conn(0x56000c602720 msgr2=0x56000c604b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:41.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.365+0000 7f857f3a2800 1 -- 172.21.15.132:0/3787258060 shutdown_connections 2024-05-08T18:53:41.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.365+0000 7f857f3a2800 1 -- 172.21.15.132:0/3787258060 wait complete. 2024-05-08T18:53:41.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.380+0000 7f857f3a2800 1 Processor -- start 2024-05-08T18:53:41.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.380+0000 7f857f3a2800 1 -- start start 2024-05-08T18:53:41.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.380+0000 7f857f3a2800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c607140 0x56000c57b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:41.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.380+0000 7f857f3a2800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56000c5535b0 con 0x56000c607140 2024-05-08T18:53:41.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.380+0000 7f857ce9a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c607140 0x56000c57b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:41.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.380+0000 7f857ce9a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c607140 0x56000c57b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:37016/0 (socket says 172.21.15.132:37016) 2024-05-08T18:53:41.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.380+0000 7f857ce9a640 1 -- 172.21.15.132:0/179447968 learned_addr learned my addr 172.21.15.132:0/179447968 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:53:41.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.381+0000 7f857ce9a640 1 -- 172.21.15.132:0/179447968 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56000c6fc4b0 con 0x56000c607140 2024-05-08T18:53:41.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.381+0000 7f857ce9a640 1 --2- 172.21.15.132:0/179447968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c607140 0x56000c57b2c0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f856c055040 tx=0x7f856c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1bceae6ecd393d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:41.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.381+0000 7f846ae0d640 1 -- 172.21.15.132:0/179447968 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f856c057040 con 0x56000c607140 2024-05-08T18:53:41.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.381+0000 7f846ae0d640 1 -- 172.21.15.132:0/179447968 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f856c052850 con 0x56000c607140 2024-05-08T18:53:41.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.381+0000 7f846ae0d640 1 -- 172.21.15.132:0/179447968 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f856c052b50 con 0x56000c607140 2024-05-08T18:53:41.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.382+0000 7f857f3a2800 1 -- 172.21.15.132:0/179447968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c607140 msgr2=0x56000c57b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:41.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.382+0000 7f857f3a2800 1 --2- 172.21.15.132:0/179447968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c607140 0x56000c57b2c0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f856c055040 tx=0x7f856c04c000 comp rx=0 tx=0).stop 2024-05-08T18:53:41.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.382+0000 7f857f3a2800 1 -- 172.21.15.132:0/179447968 shutdown_connections 2024-05-08T18:53:41.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.382+0000 7f857f3a2800 1 --2- 172.21.15.132:0/179447968 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c607140 0x56000c57b2c0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:41.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.382+0000 7f857f3a2800 1 -- 172.21.15.132:0/179447968 >> 172.21.15.132:0/179447968 conn(0x56000c602720 msgr2=0x56000c6f3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:41.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.382+0000 7f857f3a2800 1 -- 172.21.15.132:0/179447968 shutdown_connections 2024-05-08T18:53:41.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.382+0000 7f857f3a2800 1 -- 172.21.15.132:0/179447968 wait complete. 2024-05-08T18:53:41.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.382+0000 7f857f3a2800 1 Processor -- start 2024-05-08T18:53:41.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.382+0000 7f857f3a2800 1 -- start start 2024-05-08T18:53:41.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.383+0000 7f857f3a2800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c607140 0x56000c7011a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:41.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.383+0000 7f857f3a2800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56000c610870 con 0x56000c607140 2024-05-08T18:53:41.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.383+0000 7f857ce9a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c607140 0x56000c7011a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:41.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.383+0000 7f857ce9a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c607140 0x56000c7011a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:37030/0 (socket says 172.21.15.132:37030) 2024-05-08T18:53:41.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.383+0000 7f857ce9a640 1 -- 172.21.15.132:0/1483782695 learned_addr learned my addr 172.21.15.132:0/1483782695 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:53:41.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.383+0000 7f857ce9a640 1 -- 172.21.15.132:0/1483782695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56000c7016e0 con 0x56000c607140 2024-05-08T18:53:41.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.383+0000 7f857ce9a640 1 --2- 172.21.15.132:0/1483782695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c607140 0x56000c7011a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f856c00a520 tx=0x7f856c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:41.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.384+0000 7f846960a640 1 -- 172.21.15.132:0/1483782695 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f856c073070 con 0x56000c607140 2024-05-08T18:53:41.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.384+0000 7f846960a640 1 -- 172.21.15.132:0/1483782695 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f856c05d650 con 0x56000c607140 2024-05-08T18:53:41.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.384+0000 7f857f3a2800 1 -- 172.21.15.132:0/1483782695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56000c701970 con 0x56000c607140 2024-05-08T18:53:41.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.384+0000 7f846960a640 1 -- 172.21.15.132:0/1483782695 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f856c057070 con 0x56000c607140 2024-05-08T18:53:41.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.384+0000 7f857f3a2800 1 -- 172.21.15.132:0/1483782695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56000c704620 con 0x56000c607140 2024-05-08T18:53:41.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.385+0000 7f846960a640 1 -- 172.21.15.132:0/1483782695 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f856c076070 con 0x56000c607140 2024-05-08T18:53:41.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.385+0000 7f846960a640 1 --2- 172.21.15.132:0/1483782695 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f846403bb50 0x7f846403e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:41.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.385+0000 7f846960a640 1 -- 172.21.15.132:0/1483782695 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f856c094160 con 0x56000c607140 2024-05-08T18:53:41.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.385+0000 7f8574699640 1 --2- 172.21.15.132:0/1483782695 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f846403bb50 0x7f846403e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:41.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.385+0000 7f857f3a2800 1 --2- 172.21.15.132:0/1483782695 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56000c6083a0 0x56000c7083e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:41.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.385+0000 7f857f3a2800 1 -- 172.21.15.132:0/1483782695 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c708960 con 0x56000c6083a0 2024-05-08T18:53:41.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.385+0000 7f857d69b640 1 --2- 172.21.15.132:0/1483782695 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56000c6083a0 0x56000c7083e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:41.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.386+0000 7f8574699640 1 --2- 172.21.15.132:0/1483782695 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f846403bb50 0x7f846403e010 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8564000f60 tx=0x7f8564001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:41.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.386+0000 7f857d69b640 1 --2- 172.21.15.132:0/1483782695 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56000c6083a0 0x56000c7083e0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:41.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.386+0000 7f857d69b640 1 -- 172.21.15.132:0/1483782695 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f857800a4a0 con 0x56000c6083a0 2024-05-08T18:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.386+0000 7f857f3a2800 1 -- 172.21.15.132:0/1483782695 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c7059b0 con 0x56000c6083a0 2024-05-08T18:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.386+0000 7f857d69b640 1 -- 172.21.15.132:0/1483782695 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f857800a4a0 con 0x56000c6083a0 2024-05-08T18:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.386+0000 7f857f3a2800 1 --2- 172.21.15.132:0/1483782695 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56000c70ac90 0x56000c70d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.386+0000 7f857f3a2800 1 -- 172.21.15.132:0/1483782695 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:3 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c70d770 con 0x56000c70ac90 2024-05-08T18:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.386+0000 7f857ce9a640 1 --2- 172.21.15.132:0/1483782695 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56000c70ac90 0x56000c70d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.387+0000 7f857ce9a640 1 --2- 172.21.15.132:0/1483782695 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56000c70ac90 0x56000c70d080 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.387+0000 7f857ce9a640 1 -- 172.21.15.132:0/1483782695 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(3 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f856c075030 con 0x56000c70ac90 2024-05-08T18:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.387+0000 7f857f3a2800 1 -- 172.21.15.132:0/1483782695 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c709b30 con 0x56000c6083a0 2024-05-08T18:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.387+0000 7f857d69b640 1 -- 172.21.15.132:0/1483782695 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f857800a4a0 con 0x56000c6083a0 2024-05-08T18:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.387+0000 7f857f3a2800 1 -- 172.21.15.132:0/1483782695 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:5 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c70a010 con 0x56000c6083a0 2024-05-08T18:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.387+0000 7f857d69b640 1 -- 172.21.15.132:0/1483782695 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(5 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f857800a4a0 con 0x56000c6083a0 2024-05-08T18:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.388+0000 7f857f3a2800 1 Processor -- start 2024-05-08T18:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.388+0000 7f857f3a2800 1 -- start start 2024-05-08T18:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.388+0000 7f857f3a2800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c71c6b0 0x56000c71cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:41.390 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.388+0000 7f857f3a2800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56000c4f9fc0 con 0x56000c71c6b0 2024-05-08T18:53:41.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.388+0000 7f857d69b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c71c6b0 0x56000c71cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:41.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.388+0000 7f857d69b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c71c6b0 0x56000c71cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:37032/0 (socket says 172.21.15.132:37032) 2024-05-08T18:53:41.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.388+0000 7f857d69b640 1 -- 172.21.15.132:0/24118763 learned_addr learned my addr 172.21.15.132:0/24118763 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:53:41.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.389+0000 7f857d69b640 1 -- 172.21.15.132:0/24118763 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56000c71d010 con 0x56000c71c6b0 2024-05-08T18:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.389+0000 7f857d69b640 1 --2- 172.21.15.132:0/24118763 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c71c6b0 0x56000c71cad0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x56000c708d40 tx=0x7f8578018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.389+0000 7f84627fc640 1 -- 172.21.15.132:0/24118763 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8578014450 con 0x56000c71c6b0 2024-05-08T18:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.389+0000 7f84627fc640 1 -- 172.21.15.132:0/24118763 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8578014610 con 0x56000c71c6b0 2024-05-08T18:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.389+0000 7f857f3a2800 1 -- 172.21.15.132:0/24118763 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56000c71da80 con 0x56000c71c6b0 2024-05-08T18:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.389+0000 7f84627fc640 1 -- 172.21.15.132:0/24118763 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8578014930 con 0x56000c71c6b0 2024-05-08T18:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.389+0000 7f857f3a2800 1 -- 172.21.15.132:0/24118763 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56000c71df80 con 0x56000c71c6b0 2024-05-08T18:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.390+0000 7f84627fc640 1 -- 172.21.15.132:0/24118763 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8578011040 con 0x56000c71c6b0 2024-05-08T18:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.390+0000 7f84627fc640 1 --2- 172.21.15.132:0/24118763 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f845403bba0 0x7f845403e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.391+0000 7f84627fc640 1 -- 172.21.15.132:0/24118763 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f857801e070 con 0x56000c71c6b0 2024-05-08T18:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.391+0000 7f857ce9a640 1 --2- 172.21.15.132:0/24118763 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f845403bba0 0x7f845403e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.391+0000 7f857f3a2800 1 Processor -- start 2024-05-08T18:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.391+0000 7f857f3a2800 1 -- start start 2024-05-08T18:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.391+0000 7f857ce9a640 1 --2- 172.21.15.132:0/24118763 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f845403bba0 0x7f845403e060 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x56000c708de0 tx=0x7f856c005330 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.391+0000 7f857f3a2800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c729930 0x56000c729d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:41.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.391+0000 7f857f3a2800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56000c6fc740 con 0x56000c729930 2024-05-08T18:53:41.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.391+0000 7f857d69b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c729930 0x56000c729d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:41.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.391+0000 7f857d69b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c729930 0x56000c729d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:37040/0 (socket says 172.21.15.132:37040) 2024-05-08T18:53:41.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.391+0000 7f857d69b640 1 -- 172.21.15.132:0/378708752 learned_addr learned my addr 172.21.15.132:0/378708752 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:53:41.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.392+0000 7f857d69b640 1 -- 172.21.15.132:0/378708752 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56000c72a320 con 0x56000c729930 2024-05-08T18:53:41.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.392+0000 7f857d69b640 1 --2- 172.21.15.132:0/378708752 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c729930 0x56000c729d50 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f8578052c50 tx=0x7f85780118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a33732fc6f71c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:41.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.392+0000 7f8453fff640 1 -- 172.21.15.132:0/378708752 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8578001310 con 0x56000c729930 2024-05-08T18:53:41.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.392+0000 7f8453fff640 1 -- 172.21.15.132:0/378708752 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8578047070 con 0x56000c729930 2024-05-08T18:53:41.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.392+0000 7f8453fff640 1 -- 172.21.15.132:0/378708752 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85780168f0 con 0x56000c729930 2024-05-08T18:53:41.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.393+0000 7f857f3a2800 1 -- 172.21.15.132:0/378708752 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c729930 msgr2=0x56000c729d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:41.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.393+0000 7f857f3a2800 1 --2- 172.21.15.132:0/378708752 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c729930 0x56000c729d50 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f8578052c50 tx=0x7f85780118e0 comp rx=0 tx=0).stop 2024-05-08T18:53:41.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.393+0000 7f857f3a2800 1 -- 172.21.15.132:0/378708752 shutdown_connections 2024-05-08T18:53:41.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.393+0000 7f857f3a2800 1 --2- 172.21.15.132:0/378708752 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c729930 0x56000c729d50 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:41.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.393+0000 7f857f3a2800 1 -- 172.21.15.132:0/378708752 >> 172.21.15.132:0/378708752 conn(0x56000c725c90 msgr2=0x56000c723cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:41.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.393+0000 7f857f3a2800 1 -- 172.21.15.132:0/378708752 shutdown_connections 2024-05-08T18:53:41.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.393+0000 7f857f3a2800 1 -- 172.21.15.132:0/378708752 wait complete. 2024-05-08T18:53:41.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.393+0000 7f857f3a2800 1 Processor -- start 2024-05-08T18:53:41.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.393+0000 7f857f3a2800 1 -- start start 2024-05-08T18:53:41.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.393+0000 7f857f3a2800 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c729930 0x56000c730ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:41.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.393+0000 7f857f3a2800 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x56000c72aa90 con 0x56000c729930 2024-05-08T18:53:41.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.393+0000 7f857d69b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c729930 0x56000c730ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:41.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.393+0000 7f857d69b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c729930 0x56000c730ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.132:37054/0 (socket says 172.21.15.132:37054) 2024-05-08T18:53:41.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.393+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 learned_addr learned my addr 172.21.15.132:0/2756943113 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T18:53:41.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.394+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56000c731430 con 0x56000c729930 2024-05-08T18:53:41.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.394+0000 7f857d69b640 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c729930 0x56000c730ef0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f8578011fb0 tx=0x7f8578052be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:41.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.394+0000 7f84527fc640 1 -- 172.21.15.132:0/2756943113 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f857804b660 con 0x56000c729930 2024-05-08T18:53:41.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.394+0000 7f84527fc640 1 -- 172.21.15.132:0/2756943113 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f857804b800 con 0x56000c729930 2024-05-08T18:53:41.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.394+0000 7f84527fc640 1 -- 172.21.15.132:0/2756943113 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8578054070 con 0x56000c729930 2024-05-08T18:53:41.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.394+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56000c7316c0 con 0x56000c729930 2024-05-08T18:53:41.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.394+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56000c734370 con 0x56000c729930 2024-05-08T18:53:41.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.395+0000 7f84527fc640 1 -- 172.21.15.132:0/2756943113 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f8578054210 con 0x56000c729930 2024-05-08T18:53:41.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.395+0000 7f84527fc640 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f844803bb50 0x7f844803e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:41.410 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.395+0000 7f84527fc640 1 -- 172.21.15.132:0/2756943113 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f857800e040 con 0x56000c729930 2024-05-08T18:53:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.395+0000 7f857ce9a640 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f844803bb50 0x7f844803e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.396+0000 7f857f3a2800 20 rados->read ofs=0 len=0 2024-05-08T18:53:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.396+0000 7f857ce9a640 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f844803bb50 0x7f844803e010 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f856c0926c0 tx=0x7f856c08b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.396+0000 7f857f3a2800 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56000c73cba0 0x56000c73f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.396+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c73f7b0 con 0x56000c73cba0 2024-05-08T18:53:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.396+0000 7f8574699640 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56000c73cba0 0x56000c73f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.396+0000 7f8574699640 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56000c73cba0 0x56000c73f060 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.397+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f856400f610 con 0x56000c73cba0 2024-05-08T18:53:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.397+0000 7f857f3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:53:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.397+0000 7f857f3a2800 20 realm 2024-05-08T18:53:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.397+0000 7f857f3a2800 20 rados->read ofs=0 len=0 2024-05-08T18:53:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.397+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c73bff0 con 0x56000c73cba0 2024-05-08T18:53:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.397+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f856400f610 con 0x56000c73cba0 2024-05-08T18:53:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.397+0000 7f857f3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:53:41.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.397+0000 7f857f3a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:53:41.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.397+0000 7f857f3a2800 20 rados->read ofs=0 len=0 2024-05-08T18:53:41.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.397+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c7402a0 con 0x56000c73cba0 2024-05-08T18:53:41.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.397+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f856400f610 con 0x56000c73cba0 2024-05-08T18:53:41.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.397+0000 7f857f3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:53:41.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.397+0000 7f857f3a2800 20 rados->read ofs=0 len=0 2024-05-08T18:53:41.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.397+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c740b70 con 0x56000c73cba0 2024-05-08T18:53:41.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.397+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f856400f610 con 0x56000c73cba0 2024-05-08T18:53:41.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.397+0000 7f857f3a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:53:41.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.397+0000 7f857f3a2800 20 rados->read ofs=0 len=0 2024-05-08T18:53:41.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.397+0000 7f857f3a2800 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56000c741590 0x56000c743980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:41.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.397+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:5 5.16 5:6a82308b:::zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c744070 con 0x56000c741590 2024-05-08T18:53:41.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.397+0000 7f857d69b640 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56000c741590 0x56000c743980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:41.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.398+0000 7f857d69b640 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56000c741590 0x56000c743980 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:41.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.398+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== osd_op_reply(5 zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.398+0000 7f857f3a2800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:53:41.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.398+0000 7f857f3a2800 20 searching for the correct realm 2024-05-08T18:53:41.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.398+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x56000c741590 2024-05-08T18:53:41.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.398+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.398+0000 7f857d69b640 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f857804b070 0x7f85780133b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:41.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.399+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x7f857804b070 2024-05-08T18:53:41.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.399+0000 7f857ce9a640 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f857804b070 0x7f85780133b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:41.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.399+0000 7f857ce9a640 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f857804b070 0x7f85780133b0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:41.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.399+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.399+0000 7f857ce9a640 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f856c0a1040 0x7f856c092740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:41.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.399+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x7f856c0a1040 2024-05-08T18:53:41.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.399+0000 7f8574699640 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f856c0a1040 0x7f856c092740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:41.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.400+0000 7f8574699640 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f856c0a1040 0x7f856c092740 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:41.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.400+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856400f610 con 0x7f856c0a1040 2024-05-08T18:53:41.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.400+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x56000c73cba0 2024-05-08T18:53:41.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.401+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856400f610 con 0x56000c73cba0 2024-05-08T18:53:41.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.401+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x56000c73cba0 2024-05-08T18:53:41.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.401+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.401+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x7f856c0a1040 2024-05-08T18:53:41.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.401+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.401+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x7f856c0a1040 2024-05-08T18:53:41.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.401+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 3 ==== osd_op_reply(12 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.401+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x7f857804b070 2024-05-08T18:53:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.402+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.402+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x56000c741590 2024-05-08T18:53:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.402+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 3 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.402+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x56000c73cba0 2024-05-08T18:53:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.402+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.402+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x7f856c0a1040 2024-05-08T18:53:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.402+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 4 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.402+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x56000c73cba0 2024-05-08T18:53:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.403+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v18'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.403+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x7f857804b070 2024-05-08T18:53:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.403+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v18'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.403+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x56000c741590 2024-05-08T18:53:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.403+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 4 ==== osd_op_reply(19 [pgnls start_epoch 27 out=107b] v27'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.403+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x56000c741590 2024-05-08T18:53:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.403+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 5 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.403+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x7f856c0a1040 2024-05-08T18:53:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.404+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 5 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.404+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x56000c741590 2024-05-08T18:53:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.404+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 6 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.404+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x56000c741590 2024-05-08T18:53:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.404+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 7 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.404+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x56000c73cba0 2024-05-08T18:53:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.404+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.405+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x56000c73cba0 2024-05-08T18:53:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.405+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v27'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.405+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x7f856c0a1040 2024-05-08T18:53:41.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.405+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 6 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.405+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x56000c741590 2024-05-08T18:53:41.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.405+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 8 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.405+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x7f857804b070 2024-05-08T18:53:41.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.406+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.406+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x56000c73cba0 2024-05-08T18:53:41.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.406+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.406+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x7f857804b070 2024-05-08T18:53:41.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.406+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 5 ==== osd_op_reply(30 [pgnls start_epoch 27 out=82b] v27'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.406+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x56000c741590 2024-05-08T18:53:41.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.406+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 9 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.406+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x7f856c0a1040 2024-05-08T18:53:41.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.407+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 7 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.407+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x7f857804b070 2024-05-08T18:53:41.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.407+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 6 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.407+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x56000c741590 2024-05-08T18:53:41.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.407+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 10 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.407+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x7f856c0a1040 2024-05-08T18:53:41.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.408+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 8 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.408+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x56000c73cba0 2024-05-08T18:53:41.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.408+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v27'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.408+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56000c7459c0 con 0x7f857804b070 2024-05-08T18:53:41.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.408+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 7 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.408+0000 7f857f3a2800 20 RGWRados::pool_iterate: got zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 2024-05-08T18:53:41.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.408+0000 7f857f3a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:53:41.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.408+0000 7f857f3a2800 20 RGWRados::pool_iterate: got zone_info.bda7b4b2-a5a7-480e-b283-597f208ae0d4 2024-05-08T18:53:41.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.408+0000 7f857f3a2800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:53:41.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.408+0000 7f857f3a2800 20 RGWRados::pool_iterate: got period_config.default 2024-05-08T18:53:41.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.408+0000 7f857f3a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:53:41.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.408+0000 7f857f3a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:53:41.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.408+0000 7f857f3a2800 20 rados->read ofs=0 len=0 2024-05-08T18:53:41.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.408+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c744a30 con 0x56000c73cba0 2024-05-08T18:53:41.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.408+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.408+0000 7f857f3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:53:41.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.408+0000 7f857f3a2800 20 rados->read ofs=0 len=0 2024-05-08T18:53:41.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.408+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c7452d0 con 0x56000c73cba0 2024-05-08T18:53:41.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.409+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.409+0000 7f857f3a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:53:41.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.409+0000 7f857f3a2800 20 rados->read ofs=0 len=0 2024-05-08T18:53:41.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.409+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:40 5.1a 5:58d0a685:::zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c745e40 con 0x56000c73cba0 2024-05-08T18:53:41.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.409+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 15 ==== osd_op_reply(40 zonegroup_info.23dcc2a0-b283-45fd-8c01-831457a34b43 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.409+0000 7f857f3a2800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:53:41.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.409+0000 7f857f3a2800 20 zone default found 2024-05-08T18:53:41.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.409+0000 7f857f3a2800 4 Realm: () 2024-05-08T18:53:41.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.409+0000 7f857f3a2800 4 ZoneGroup: default (23dcc2a0-b283-45fd-8c01-831457a34b43) 2024-05-08T18:53:41.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.409+0000 7f857f3a2800 4 Zone: default (bda7b4b2-a5a7-480e-b283-597f208ae0d4) 2024-05-08T18:53:41.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.409+0000 7f857f3a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:53:41.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.409+0000 7f857f3a2800 20 zonegroup default 2024-05-08T18:53:41.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.409+0000 7f857f3a2800 20 rados->read ofs=0 len=0 2024-05-08T18:53:41.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.409+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c746200 con 0x7f857804b070 2024-05-08T18:53:41.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.409+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 8 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.409+0000 7f857f3a2800 20 rados_obj.operate() r=0 bl.length=187 2024-05-08T18:53:41.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.409+0000 7f857f3a2800 20 rados->read ofs=0 len=0 2024-05-08T18:53:41.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.409+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c7484d0 con 0x56000c741590 2024-05-08T18:53:41.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.410+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.410+0000 7f857f3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:53:41.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.410+0000 7f857f3a2800 20 rados->read ofs=0 len=0 2024-05-08T18:53:41.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.410+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c748870 con 0x56000c741590 2024-05-08T18:53:41.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.410+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.410+0000 7f857f3a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:53:41.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.410+0000 7f857f3a2800 20 started sync module instance, tier type = 2024-05-08T18:53:41.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.410+0000 7f857f3a2800 20 started zone id=bda7b4b2-a5a7-480e-b283-597f208ae0d4 (name=default) with tier type = 2024-05-08T18:53:41.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.410+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c747960 con 0x7f857804b070 2024-05-08T18:53:41.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.411+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 9 ==== osd_op_reply(44 notify.0 [create] v27'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.411+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94558208949632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c7475c0 con 0x7f857804b070 2024-05-08T18:53:41.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.411+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c749690 con 0x56000c73cba0 2024-05-08T18:53:41.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.412+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94558208949632] v27'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.413+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 16 ==== osd_op_reply(46 notify.1 [create] v27'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.413+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94558208953552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c749ab0 con 0x56000c73cba0 2024-05-08T18:53:41.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.413+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c74a470 con 0x56000c741590 2024-05-08T18:53:41.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.414+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94558208953552] v27'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.414+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 13 ==== osd_op_reply(48 notify.2 [create] v27'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.414+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94558208954608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c74a470 con 0x56000c741590 2024-05-08T18:53:41.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.414+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c74aee0 con 0x7f857804b070 2024-05-08T18:53:41.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.415+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 11 ==== osd_op_reply(50 notify.3 [create] v27'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.415+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94558208960944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c74b780 con 0x7f857804b070 2024-05-08T18:53:41.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.415+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c74c260 con 0x56000c73cba0 2024-05-08T18:53:41.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.415+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94558208954608] v27'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.416+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94558208960944] v27'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.417+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 18 ==== osd_op_reply(52 notify.4 [create] v27'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.417+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94558208963280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c749fc0 con 0x56000c73cba0 2024-05-08T18:53:41.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.417+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c74cc70 con 0x7f856c0a1040 2024-05-08T18:53:41.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.418+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94558208963280] v27'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.418+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 9 ==== osd_op_reply(54 notify.5 [create] v27'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.418+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94558208966000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c74cc70 con 0x7f856c0a1040 2024-05-08T18:53:41.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.418+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c74d630 con 0x7f856c0a1040 2024-05-08T18:53:41.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.419+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94558208966000] v27'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.419+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 11 ==== osd_op_reply(56 notify.6 [create] v27'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.419+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94558208969120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c74d630 con 0x7f856c0a1040 2024-05-08T18:53:41.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.419+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c74dff0 con 0x7f856c0a1040 2024-05-08T18:53:41.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.420+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94558208969120] v27'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.420+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 13 ==== osd_op_reply(58 notify.7 [create] v27'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.420+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94558208971616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c74dff0 con 0x7f856c0a1040 2024-05-08T18:53:41.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.420+0000 7f857f3a2800 20 add_watcher() i=0 2024-05-08T18:53:41.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.420+0000 7f857f3a2800 20 add_watcher() i=1 2024-05-08T18:53:41.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.420+0000 7f857f3a2800 20 add_watcher() i=2 2024-05-08T18:53:41.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.420+0000 7f857f3a2800 20 add_watcher() i=3 2024-05-08T18:53:41.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.420+0000 7f857f3a2800 20 add_watcher() i=4 2024-05-08T18:53:41.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.420+0000 7f857f3a2800 20 add_watcher() i=5 2024-05-08T18:53:41.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.420+0000 7f857f3a2800 20 add_watcher() i=6 2024-05-08T18:53:41.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.422+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94558208971616] v27'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.428 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.422+0000 7f857f3a2800 20 add_watcher() i=7 2024-05-08T18:53:41.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.422+0000 7f857f3a2800 2 all 8 watchers are set, enabling cache 2024-05-08T18:53:41.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.422+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c751300 con 0x56000c73cba0 2024-05-08T18:53:41.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.422+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.422+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94558208974000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c74e580 con 0x56000c73cba0 2024-05-08T18:53:41.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.423+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94558208974000] v27'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.423+0000 7f84337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:53:41.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.423+0000 7f857f3a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:53:41.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.423+0000 7f857f3a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:53:41.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.423+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c7509f0 con 0x56000c73cba0 2024-05-08T18:53:41.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.424+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.424+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75a3c0 con 0x7f856c0a1040 2024-05-08T18:53:41.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.426+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.426+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75a870 con 0x56000c741590 2024-05-08T18:53:41.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.426+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.426+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75a870 con 0x56000c73cba0 2024-05-08T18:53:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.427+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'275 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.427+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75a870 con 0x7f857804b070 2024-05-08T18:53:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.428+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'83 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.428+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75ae30 con 0x56000c741590 2024-05-08T18:53:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.429+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'56 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.429+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75ae30 con 0x56000c73cba0 2024-05-08T18:53:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.431+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.431+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b2e0 con 0x7f856c0a1040 2024-05-08T18:53:41.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.432+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'57 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.432+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b2e0 con 0x7f857804b070 2024-05-08T18:53:41.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.433+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.433+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b110 con 0x56000c741590 2024-05-08T18:53:41.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.434+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.434+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b1a0 con 0x7f857804b070 2024-05-08T18:53:41.434 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.435+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'84 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.435+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b230 con 0x7f856c0a1040 2024-05-08T18:53:41.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.436+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'41 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.436+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b230 con 0x7f857804b070 2024-05-08T18:53:41.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.437+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.437+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b7e0 con 0x7f856c0a1040 2024-05-08T18:53:41.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.438+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'62 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.438+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b7e0 con 0x56000c73cba0 2024-05-08T18:53:41.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.439+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'276 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.439+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b7e0 con 0x56000c741590 2024-05-08T18:53:41.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.441+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'77 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.441+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b7e0 con 0x7f857804b070 2024-05-08T18:53:41.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.442+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'85 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.442+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b7e0 con 0x56000c741590 2024-05-08T18:53:41.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.443+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.442 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.443+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b7e0 con 0x56000c73cba0 2024-05-08T18:53:41.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.444+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.444+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b7e0 con 0x56000c73cba0 2024-05-08T18:53:41.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.445+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'277 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.445+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b7e0 con 0x56000c741590 2024-05-08T18:53:41.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.446+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'78 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.446+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b7e0 con 0x7f857804b070 2024-05-08T18:53:41.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.447+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'42 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.447+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b7e0 con 0x56000c741590 2024-05-08T18:53:41.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.448+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.448+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b7e0 con 0x56000c741590 2024-05-08T18:53:41.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.449+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'38 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.449+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b7e0 con 0x56000c741590 2024-05-08T18:53:41.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.450+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.450+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b7e0 con 0x56000c741590 2024-05-08T18:53:41.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.451+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'57 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.451+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b7e0 con 0x7f856c0a1040 2024-05-08T18:53:41.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.452+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.452+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b7e0 con 0x56000c741590 2024-05-08T18:53:41.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.453+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.453+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b7e0 con 0x7f856c0a1040 2024-05-08T18:53:41.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.454+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'58 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.454+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b7e0 con 0x56000c741590 2024-05-08T18:53:41.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.455+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'79 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.455+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b7e0 con 0x7f856c0a1040 2024-05-08T18:53:41.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.456+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'63 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.456+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c75b7e0 con 0x7f857804b070 2024-05-08T18:53:41.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.457+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.457+0000 7f84327e4640 20 reqs_thread_entry: start 2024-05-08T18:53:41.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.458+0000 7f857f3a2800 20 init_complete bucket index max shards: 11 2024-05-08T18:53:41.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.458+0000 7f857f3a2800 20 Filter name: none 2024-05-08T18:53:41.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.458+0000 7f842b7fe640 20 reqs_thread_entry: start 2024-05-08T18:53:41.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.458+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-05-08T18:53:41.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.458+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:94 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c73cba0 2024-05-08T18:53:41.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.459+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 28 ==== osd_op_reply(94 gc.18 [call] v27'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.459+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:95 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c73cba0 2024-05-08T18:53:41.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.459+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 29 ==== osd_op_reply(95 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.459+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.459+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:96 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c786b80 con 0x56000c73cba0 2024-05-08T18:53:41.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.459+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 30 ==== osd_op_reply(96 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.459+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:97 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c73cba0 2024-05-08T18:53:41.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.460+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 31 ==== osd_op_reply(97 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.460+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.460+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:98 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c73cba0 2024-05-08T18:53:41.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.460+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 32 ==== osd_op_reply(98 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.460+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.460+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:99 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c73cba0 2024-05-08T18:53:41.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.461+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 33 ==== osd_op_reply(99 gc.18 [call] v27'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.461+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-05-08T18:53:41.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.461+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:100 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c73cba0 2024-05-08T18:53:41.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.462+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 34 ==== osd_op_reply(100 gc.19 [call] v27'278 uv278 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.462+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:101 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c73cba0 2024-05-08T18:53:41.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.462+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 35 ==== osd_op_reply(101 gc.19 [call out=15b] v0'0 uv278 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.462+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.462+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:102 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c786b80 con 0x56000c73cba0 2024-05-08T18:53:41.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.463+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 36 ==== osd_op_reply(102 gc.19 [call out=24b] v0'0 uv278 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.463+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:103 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c73cba0 2024-05-08T18:53:41.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.463+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 37 ==== osd_op_reply(103 gc.19 [call out=15b] v0'0 uv278 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.463+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.463+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:104 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c73cba0 2024-05-08T18:53:41.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.463+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 38 ==== osd_op_reply(104 gc.19 [call out=15b] v0'0 uv278 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.463+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.463+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:105 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c73cba0 2024-05-08T18:53:41.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.464+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 39 ==== osd_op_reply(105 gc.19 [call] v27'279 uv279 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f856402b040 con 0x56000c73cba0 2024-05-08T18:53:41.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.464+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-05-08T18:53:41.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.464+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:106 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.465+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 27 ==== osd_op_reply(106 gc.20 [call] v27'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.465+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:107 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.465+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 28 ==== osd_op_reply(107 gc.20 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.465+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.465+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:108 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c786b80 con 0x56000c741590 2024-05-08T18:53:41.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.465+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 29 ==== osd_op_reply(108 gc.20 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.465+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:109 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.466+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 30 ==== osd_op_reply(109 gc.20 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.466+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.466+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:110 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.466+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 31 ==== osd_op_reply(110 gc.20 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.466+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.466+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:111 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.467+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 32 ==== osd_op_reply(111 gc.20 [call] v27'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.467+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-05-08T18:53:41.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.467+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:112 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x7f857804b070 2024-05-08T18:53:41.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.468+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 20 ==== osd_op_reply(112 gc.21 [call] v27'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.468+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:113 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x7f857804b070 2024-05-08T18:53:41.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.468+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 21 ==== osd_op_reply(113 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.468+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.468+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:114 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c786b80 con 0x7f857804b070 2024-05-08T18:53:41.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.468+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 22 ==== osd_op_reply(114 gc.21 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.468+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:115 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x7f857804b070 2024-05-08T18:53:41.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.469+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 23 ==== osd_op_reply(115 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.469+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.469+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:116 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x7f857804b070 2024-05-08T18:53:41.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.469+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 24 ==== osd_op_reply(116 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.469+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.469+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:117 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x7f857804b070 2024-05-08T18:53:41.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.470+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 25 ==== osd_op_reply(117 gc.21 [call] v27'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.470+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-05-08T18:53:41.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.470+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:118 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.471+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 33 ==== osd_op_reply(118 gc.22 [call] v27'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.471+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:119 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.471+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 34 ==== osd_op_reply(119 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.471+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.471+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:120 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c786b80 con 0x56000c741590 2024-05-08T18:53:41.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.471+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 35 ==== osd_op_reply(120 gc.22 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.471+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:121 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.471+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 36 ==== osd_op_reply(121 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.471+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.471+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:122 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.472+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 37 ==== osd_op_reply(122 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.472+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.472+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:123 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.472+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 38 ==== osd_op_reply(123 gc.22 [call] v27'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.472+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-05-08T18:53:41.473 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.472+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:124 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.474+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 39 ==== osd_op_reply(124 gc.23 [call] v27'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.474+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:125 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.474+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 40 ==== osd_op_reply(125 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.474+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.474+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:126 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c786b80 con 0x56000c741590 2024-05-08T18:53:41.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.474+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 41 ==== osd_op_reply(126 gc.23 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.474+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:127 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.474+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 42 ==== osd_op_reply(127 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.474+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.474+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:128 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.475+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 43 ==== osd_op_reply(128 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.475+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.475+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:129 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.476+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 44 ==== osd_op_reply(129 gc.23 [call] v27'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.476+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-05-08T18:53:41.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.476+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:130 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.477+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 45 ==== osd_op_reply(130 gc.24 [call] v27'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.477+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:131 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.477+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 46 ==== osd_op_reply(131 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.477+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.477+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:132 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c786b80 con 0x56000c741590 2024-05-08T18:53:41.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.477+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 47 ==== osd_op_reply(132 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.477+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:133 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.477+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 48 ==== osd_op_reply(133 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.477+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.477+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:134 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.478+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 49 ==== osd_op_reply(134 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.478+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.478+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:135 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.478+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 50 ==== osd_op_reply(135 gc.24 [call] v27'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.478+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-05-08T18:53:41.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.478+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:136 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.479+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 51 ==== osd_op_reply(136 gc.25 [call] v27'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.479+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:137 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.480+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 52 ==== osd_op_reply(137 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.480+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.480+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:138 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c786b80 con 0x56000c741590 2024-05-08T18:53:41.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.480+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 53 ==== osd_op_reply(138 gc.25 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.480+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:139 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.480+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 54 ==== osd_op_reply(139 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.480+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.480+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:140 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.480+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 55 ==== osd_op_reply(140 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.480+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.480+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:141 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.481+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 56 ==== osd_op_reply(141 gc.25 [call] v27'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.481+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-05-08T18:53:41.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.481+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:142 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x7f856c0a1040 2024-05-08T18:53:41.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.482+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 22 ==== osd_op_reply(142 gc.26 [call] v27'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.482+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:143 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x7f856c0a1040 2024-05-08T18:53:41.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.483+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 23 ==== osd_op_reply(143 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.483+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.483+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:144 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c786b80 con 0x7f856c0a1040 2024-05-08T18:53:41.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.483+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 24 ==== osd_op_reply(144 gc.26 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.483+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:145 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x7f856c0a1040 2024-05-08T18:53:41.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.483+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 25 ==== osd_op_reply(145 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856402b040 con 0x7f856c0a1040 2024-05-08T18:53:41.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.483+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.483+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:146 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x7f856c0a1040 2024-05-08T18:53:41.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.483+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 26 ==== osd_op_reply(146 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.484+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.484+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:147 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x7f856c0a1040 2024-05-08T18:53:41.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.484+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 27 ==== osd_op_reply(147 gc.26 [call] v27'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.485+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-05-08T18:53:41.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.485+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:148 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.485+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 57 ==== osd_op_reply(148 gc.27 [call] v27'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.485+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:149 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.486+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 58 ==== osd_op_reply(149 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.486+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.486+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:150 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c786b80 con 0x56000c741590 2024-05-08T18:53:41.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.486+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 59 ==== osd_op_reply(150 gc.27 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.486+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:151 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.486+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 60 ==== osd_op_reply(151 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.486+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.486+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:152 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c787b90 con 0x56000c741590 2024-05-08T18:53:41.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.486+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 61 ==== osd_op_reply(152 gc.27 [call out=1716b] v0'0 uv35 ondisk = 0) ==== 149+0+1716 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.486+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-05-08T18:53:41.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.486+0000 7f857f3a2800 20 garbage collection: RGWGC::process iterating over entry tag='bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.15360630364069472662', time=2024-05-08T18:53:49.574634+0000, chain.objs.size()=7 2024-05-08T18:53:41.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.486+0000 7f857f3a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11__shadow_.C8IJCbFwGGflvHstEvjULR8-fAZnlnt_1 2024-05-08T18:53:41.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.486+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:153 3.12 3:4a654654:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11__shadow_.C8IJCbFwGGflvHstEvjULR8-fAZnlnt_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c785e70 con 0x7f857804b070 2024-05-08T18:53:41.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.486+0000 7f857f3a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11__shadow_.C8IJCbFwGGflvHstEvjULR8-fAZnlnt_2 2024-05-08T18:53:41.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.486+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:154 3.39 3:9f5d8dbe:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11__shadow_.C8IJCbFwGGflvHstEvjULR8-fAZnlnt_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78acc0 con 0x56000c741590 2024-05-08T18:53:41.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.486+0000 7f857f3a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11__shadow_.C8IJCbFwGGflvHstEvjULR8-fAZnlnt_3 2024-05-08T18:53:41.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.486+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:155 3.11 3:8ba10489:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11__shadow_.C8IJCbFwGGflvHstEvjULR8-fAZnlnt_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d7c0 con 0x56000c741590 2024-05-08T18:53:41.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.486+0000 7f857f3a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11__shadow_.C8IJCbFwGGflvHstEvjULR8-fAZnlnt_4 2024-05-08T18:53:41.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.487+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:156 3.32 3:4deec259:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11__shadow_.C8IJCbFwGGflvHstEvjULR8-fAZnlnt_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c7900d0 con 0x56000c741590 2024-05-08T18:53:41.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.487+0000 7f857f3a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11__shadow_.C8IJCbFwGGflvHstEvjULR8-fAZnlnt_5 2024-05-08T18:53:41.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.487+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:157 3.31 3:8c1ee7b1:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11__shadow_.C8IJCbFwGGflvHstEvjULR8-fAZnlnt_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c792940 con 0x7f856c0a1040 2024-05-08T18:53:41.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.487+0000 7f857f3a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11__shadow_.C8IJCbFwGGflvHstEvjULR8-fAZnlnt_6 2024-05-08T18:53:41.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.487+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:158 3.28 3:17e7ad85:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11__shadow_.C8IJCbFwGGflvHstEvjULR8-fAZnlnt_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c7900d0 con 0x56000c741590 2024-05-08T18:53:41.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.487+0000 7f857f3a2800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11__shadow_.C8IJCbFwGGflvHstEvjULR8-fAZnlnt_7 2024-05-08T18:53:41.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.487+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:159 3.24 3:24f266f1:::bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11__shadow_.C8IJCbFwGGflvHstEvjULR8-fAZnlnt_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f856c0a1040 2024-05-08T18:53:41.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.488+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 28 ==== osd_op_reply(159 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11__shadow_.C8IJCbFwGGflvHstEvjULR8-fAZnlnt_7 [call] v27'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.489+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 62 ==== osd_op_reply(155 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11__shadow_.C8IJCbFwGGflvHstEvjULR8-fAZnlnt_3 [call] v27'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.490+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 63 ==== osd_op_reply(154 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11__shadow_.C8IJCbFwGGflvHstEvjULR8-fAZnlnt_2 [call] v27'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.492+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 64 ==== osd_op_reply(156 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11__shadow_.C8IJCbFwGGflvHstEvjULR8-fAZnlnt_4 [call] v27'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.492+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 29 ==== osd_op_reply(157 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11__shadow_.C8IJCbFwGGflvHstEvjULR8-fAZnlnt_5 [call] v27'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.495+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 65 ==== osd_op_reply(158 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11__shadow_.C8IJCbFwGGflvHstEvjULR8-fAZnlnt_6 [call] v27'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.495+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 26 ==== osd_op_reply(153 bda7b4b2-a5a7-480e-b283-597f208ae0d4.4221.11__shadow_.C8IJCbFwGGflvHstEvjULR8-fAZnlnt_1 [call] v27'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.495+0000 7f857f3a2800 5 garbage collection: RGWGC::process removing entries, marker: 2024-05-08T18:53:41.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.495+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:160 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x56000c741590 2024-05-08T18:53:41.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.496+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 66 ==== osd_op_reply(160 gc.27 [call] v27'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.496+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:161 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x56000c741590 2024-05-08T18:53:41.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.497+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 67 ==== osd_op_reply(161 gc.27 [call] v27'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.497+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-05-08T18:53:41.496 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.497+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:162 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f856c0a1040 2024-05-08T18:53:41.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.498+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 30 ==== osd_op_reply(162 gc.28 [call] v27'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.498+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:163 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f856c0a1040 2024-05-08T18:53:41.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.498+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 31 ==== osd_op_reply(163 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.498+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.499+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:164 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f856c0a1040 2024-05-08T18:53:41.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.499+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 32 ==== osd_op_reply(164 gc.28 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.499+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:165 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f856c0a1040 2024-05-08T18:53:41.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.499+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 33 ==== osd_op_reply(165 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.499+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.499+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:166 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f856c0a1040 2024-05-08T18:53:41.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.499+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 34 ==== osd_op_reply(166 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.499+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.499+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:167 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f856c0a1040 2024-05-08T18:53:41.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.501+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 35 ==== osd_op_reply(167 gc.28 [call] v27'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.501+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-05-08T18:53:41.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.501+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:168 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x56000c741590 2024-05-08T18:53:41.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.502+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 68 ==== osd_op_reply(168 gc.29 [call] v27'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.502+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:169 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x56000c741590 2024-05-08T18:53:41.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.502+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 69 ==== osd_op_reply(169 gc.29 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.502+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.502+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:170 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x56000c741590 2024-05-08T18:53:41.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.502+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 70 ==== osd_op_reply(170 gc.29 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.502+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:171 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x56000c741590 2024-05-08T18:53:41.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.502+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 71 ==== osd_op_reply(171 gc.29 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.502+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.502+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:172 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x56000c741590 2024-05-08T18:53:41.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.503+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 72 ==== osd_op_reply(172 gc.29 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.503+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.503+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:173 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x56000c741590 2024-05-08T18:53:41.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.504+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 73 ==== osd_op_reply(173 gc.29 [call] v27'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.504+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-05-08T18:53:41.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.504+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:174 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f856c0a1040 2024-05-08T18:53:41.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.505+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 36 ==== osd_op_reply(174 gc.30 [call] v27'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.505+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:175 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f856c0a1040 2024-05-08T18:53:41.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.505+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 37 ==== osd_op_reply(175 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.505+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.505+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:176 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f856c0a1040 2024-05-08T18:53:41.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.505+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 38 ==== osd_op_reply(176 gc.30 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.505+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:177 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f856c0a1040 2024-05-08T18:53:41.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.506+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 39 ==== osd_op_reply(177 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.506+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.506+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:178 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f856c0a1040 2024-05-08T18:53:41.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.506+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 40 ==== osd_op_reply(178 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.506+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.506+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:179 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f856c0a1040 2024-05-08T18:53:41.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.507+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 41 ==== osd_op_reply(179 gc.30 [call] v27'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.507+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-05-08T18:53:41.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.507+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:180 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f857804b070 2024-05-08T18:53:41.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.508+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 27 ==== osd_op_reply(180 gc.31 [call] v27'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.508+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:181 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f857804b070 2024-05-08T18:53:41.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.508+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 28 ==== osd_op_reply(181 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.508+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.508+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:182 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f857804b070 2024-05-08T18:53:41.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.508+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 29 ==== osd_op_reply(182 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.508+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:183 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f857804b070 2024-05-08T18:53:41.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.509+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 30 ==== osd_op_reply(183 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.509+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.509+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:184 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f857804b070 2024-05-08T18:53:41.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.509+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 31 ==== osd_op_reply(184 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.509+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.509+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:185 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f857804b070 2024-05-08T18:53:41.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.510+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 32 ==== osd_op_reply(185 gc.31 [call] v27'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.510+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-05-08T18:53:41.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.510+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:186 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x56000c73cba0 2024-05-08T18:53:41.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.511+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 40 ==== osd_op_reply(186 gc.0 [call] v27'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.511+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:187 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x56000c73cba0 2024-05-08T18:53:41.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.511+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 41 ==== osd_op_reply(187 gc.0 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.511+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.511+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:188 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x56000c73cba0 2024-05-08T18:53:41.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.512+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 42 ==== osd_op_reply(188 gc.0 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.512+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:189 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x56000c73cba0 2024-05-08T18:53:41.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.512+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 43 ==== osd_op_reply(189 gc.0 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.512+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.512+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:190 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x56000c73cba0 2024-05-08T18:53:41.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.512+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 44 ==== osd_op_reply(190 gc.0 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.512+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.512+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:191 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x56000c73cba0 2024-05-08T18:53:41.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.513+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 45 ==== osd_op_reply(191 gc.0 [call] v27'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.513+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-05-08T18:53:41.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.513+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:192 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f856c0a1040 2024-05-08T18:53:41.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.514+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 42 ==== osd_op_reply(192 gc.1 [call] v27'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.514+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:193 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f856c0a1040 2024-05-08T18:53:41.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.514+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 43 ==== osd_op_reply(193 gc.1 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.514+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.514+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:194 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f856c0a1040 2024-05-08T18:53:41.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.515+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 44 ==== osd_op_reply(194 gc.1 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.515+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:195 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f856c0a1040 2024-05-08T18:53:41.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.515+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 45 ==== osd_op_reply(195 gc.1 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.515+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.515+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:196 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f856c0a1040 2024-05-08T18:53:41.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.515+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 46 ==== osd_op_reply(196 gc.1 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.515+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.515+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:197 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x7f856c0a1040 2024-05-08T18:53:41.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.516+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 47 ==== osd_op_reply(197 gc.1 [call] v27'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.516+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-05-08T18:53:41.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.516+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:198 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c797740 con 0x56000c741590 2024-05-08T18:53:41.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.517+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 74 ==== osd_op_reply(198 gc.2 [call] v27'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.517+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:199 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.517+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 75 ==== osd_op_reply(199 gc.2 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.517+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.517+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:200 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78c050 con 0x56000c741590 2024-05-08T18:53:41.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.518+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 76 ==== osd_op_reply(200 gc.2 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.518+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:201 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.518+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 77 ==== osd_op_reply(201 gc.2 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.518+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.518+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:202 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.518+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 78 ==== osd_op_reply(202 gc.2 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.518+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.518+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:203 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.519+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 79 ==== osd_op_reply(203 gc.2 [call] v27'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.519+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-05-08T18:53:41.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.519+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:204 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c73cba0 2024-05-08T18:53:41.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.520+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 46 ==== osd_op_reply(204 gc.3 [call] v27'280 uv280 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.520+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:205 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c73cba0 2024-05-08T18:53:41.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.520+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 47 ==== osd_op_reply(205 gc.3 [call out=15b] v0'0 uv280 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.520+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.520+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:206 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78c050 con 0x56000c73cba0 2024-05-08T18:53:41.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.520+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 48 ==== osd_op_reply(206 gc.3 [call out=24b] v0'0 uv280 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.520+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:207 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c73cba0 2024-05-08T18:53:41.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.521+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 49 ==== osd_op_reply(207 gc.3 [call out=15b] v0'0 uv280 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.521+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.521+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:208 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c73cba0 2024-05-08T18:53:41.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.521+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 50 ==== osd_op_reply(208 gc.3 [call out=15b] v0'0 uv280 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.521+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.521+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:209 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c73cba0 2024-05-08T18:53:41.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.522+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 51 ==== osd_op_reply(209 gc.3 [call] v27'281 uv281 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.522+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-05-08T18:53:41.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.522+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:210 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.523+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 33 ==== osd_op_reply(210 gc.4 [call] v27'86 uv86 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.523+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:211 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.523+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 34 ==== osd_op_reply(211 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.523+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.523+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:212 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78c050 con 0x7f857804b070 2024-05-08T18:53:41.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.523+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 35 ==== osd_op_reply(212 gc.4 [call out=24b] v0'0 uv86 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.523+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:213 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.523+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 36 ==== osd_op_reply(213 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.523+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.523+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:214 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.524+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 37 ==== osd_op_reply(214 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.524+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.524+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:215 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.525+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 38 ==== osd_op_reply(215 gc.4 [call] v27'87 uv87 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.525+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-05-08T18:53:41.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.525+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:216 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.526+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 80 ==== osd_op_reply(216 gc.5 [call] v27'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.526+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:217 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.526+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 81 ==== osd_op_reply(217 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.526+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.526+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:218 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78c050 con 0x56000c741590 2024-05-08T18:53:41.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.526+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 82 ==== osd_op_reply(218 gc.5 [call out=24b] v0'0 uv60 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.526+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:219 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.526+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 83 ==== osd_op_reply(219 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.526+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.526+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:220 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.527+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 84 ==== osd_op_reply(220 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.527+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.527+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:221 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.527+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 85 ==== osd_op_reply(221 gc.5 [call] v27'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.527+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-05-08T18:53:41.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.527+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:222 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c73cba0 2024-05-08T18:53:41.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.529+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 52 ==== osd_op_reply(222 gc.6 [call] v27'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.529+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:223 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c73cba0 2024-05-08T18:53:41.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.529+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 53 ==== osd_op_reply(223 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.529+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.529+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:224 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78c050 con 0x56000c73cba0 2024-05-08T18:53:41.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.529+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 54 ==== osd_op_reply(224 gc.6 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.529+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:225 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c73cba0 2024-05-08T18:53:41.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.529+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 55 ==== osd_op_reply(225 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.530+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.530+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:226 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c73cba0 2024-05-08T18:53:41.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.530+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 56 ==== osd_op_reply(226 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.530+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.530+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:227 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c73cba0 2024-05-08T18:53:41.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.531+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 57 ==== osd_op_reply(227 gc.6 [call] v27'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.531+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-05-08T18:53:41.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.531+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:228 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f856c0a1040 2024-05-08T18:53:41.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.532+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 48 ==== osd_op_reply(228 gc.7 [call] v27'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.532+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:229 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f856c0a1040 2024-05-08T18:53:41.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.533+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 49 ==== osd_op_reply(229 gc.7 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.533+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.533+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:230 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78c050 con 0x7f856c0a1040 2024-05-08T18:53:41.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.533+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 50 ==== osd_op_reply(230 gc.7 [call out=24b] v0'0 uv61 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.533+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:231 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f856c0a1040 2024-05-08T18:53:41.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.533+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 51 ==== osd_op_reply(231 gc.7 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.533+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.533+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:232 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f856c0a1040 2024-05-08T18:53:41.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.534+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 52 ==== osd_op_reply(232 gc.7 [call out=15b] v0'0 uv61 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.534+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.534+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:233 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f856c0a1040 2024-05-08T18:53:41.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.535+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 53 ==== osd_op_reply(233 gc.7 [call] v27'62 uv62 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.535+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-05-08T18:53:41.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.535+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:234 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.536+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 39 ==== osd_op_reply(234 gc.8 [call] v27'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.536+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:235 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.536+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 40 ==== osd_op_reply(235 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.536+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.536+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:236 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78c050 con 0x7f857804b070 2024-05-08T18:53:41.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.536+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 41 ==== osd_op_reply(236 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.536+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:237 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.536+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 42 ==== osd_op_reply(237 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.537+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.537+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:238 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.537+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 43 ==== osd_op_reply(238 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.537+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.537+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:239 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.538+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 44 ==== osd_op_reply(239 gc.8 [call] v27'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.538+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-05-08T18:53:41.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.538+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:240 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.539+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 86 ==== osd_op_reply(240 gc.9 [call] v27'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.539+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:241 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.539+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 87 ==== osd_op_reply(241 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.539+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.539+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:242 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78c050 con 0x56000c741590 2024-05-08T18:53:41.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.539+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 88 ==== osd_op_reply(242 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.539+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:243 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.540+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 89 ==== osd_op_reply(243 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.540+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.540+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:244 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.540+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 90 ==== osd_op_reply(244 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.540+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.540+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:245 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.541+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 91 ==== osd_op_reply(245 gc.9 [call] v27'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.541+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-05-08T18:53:41.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.541+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:246 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.544+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 45 ==== osd_op_reply(246 gc.10 [call] v27'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.544+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:247 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.544+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 46 ==== osd_op_reply(247 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.544+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.544+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:248 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78c050 con 0x7f857804b070 2024-05-08T18:53:41.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.544+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 47 ==== osd_op_reply(248 gc.10 [call out=24b] v0'0 uv88 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.544+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:249 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.544+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 48 ==== osd_op_reply(249 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.544+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.544+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:250 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.545+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 49 ==== osd_op_reply(250 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.545+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.545+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:251 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.545+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 50 ==== osd_op_reply(251 gc.10 [call] v27'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.545+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-05-08T18:53:41.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.545+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:252 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f856c0a1040 2024-05-08T18:53:41.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.547+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 54 ==== osd_op_reply(252 gc.11 [call] v27'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.547+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:253 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f856c0a1040 2024-05-08T18:53:41.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.547+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 55 ==== osd_op_reply(253 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.547+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.547+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:254 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78c050 con 0x7f856c0a1040 2024-05-08T18:53:41.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.547+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 56 ==== osd_op_reply(254 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.547+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:255 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f856c0a1040 2024-05-08T18:53:41.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.547+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 57 ==== osd_op_reply(255 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.547+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.547+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:256 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f856c0a1040 2024-05-08T18:53:41.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.548+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 58 ==== osd_op_reply(256 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.548+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.548+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:257 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f856c0a1040 2024-05-08T18:53:41.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.549+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 59 ==== osd_op_reply(257 gc.11 [call] v27'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.549+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-05-08T18:53:41.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.549+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:258 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.550+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 51 ==== osd_op_reply(258 gc.12 [call] v27'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.550+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:259 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.550+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 52 ==== osd_op_reply(259 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.550+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.550+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:260 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78c050 con 0x7f857804b070 2024-05-08T18:53:41.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.550+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 53 ==== osd_op_reply(260 gc.12 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.550+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:261 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.550+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 54 ==== osd_op_reply(261 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.550+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.550+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:262 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.551+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 55 ==== osd_op_reply(262 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.551+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.551+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:263 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.552+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 56 ==== osd_op_reply(263 gc.12 [call] v27'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.552+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-05-08T18:53:41.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.552+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:264 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f856c0a1040 2024-05-08T18:53:41.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.553+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 60 ==== osd_op_reply(264 gc.13 [call] v27'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.553+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:265 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f856c0a1040 2024-05-08T18:53:41.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.553+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 61 ==== osd_op_reply(265 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.553+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.553+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:266 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78c050 con 0x7f856c0a1040 2024-05-08T18:53:41.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.553+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 62 ==== osd_op_reply(266 gc.13 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.553+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:267 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f856c0a1040 2024-05-08T18:53:41.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.554+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 63 ==== osd_op_reply(267 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.554+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.554+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:268 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f856c0a1040 2024-05-08T18:53:41.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.554+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 64 ==== osd_op_reply(268 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.554+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.554+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:269 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f856c0a1040 2024-05-08T18:53:41.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.555+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 65 ==== osd_op_reply(269 gc.13 [call] v27'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.555+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-05-08T18:53:41.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.555+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:270 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c73cba0 2024-05-08T18:53:41.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.556+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 58 ==== osd_op_reply(270 gc.14 [call] v27'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.556+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:271 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c73cba0 2024-05-08T18:53:41.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.556+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 59 ==== osd_op_reply(271 gc.14 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.556+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.556+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:272 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78c050 con 0x56000c73cba0 2024-05-08T18:53:41.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.557+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 60 ==== osd_op_reply(272 gc.14 [call out=24b] v0'0 uv282 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.557+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:273 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c73cba0 2024-05-08T18:53:41.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.557+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 61 ==== osd_op_reply(273 gc.14 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.557+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.557+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:274 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c73cba0 2024-05-08T18:53:41.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.557+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 62 ==== osd_op_reply(274 gc.14 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.557+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.557+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:275 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c73cba0 2024-05-08T18:53:41.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.558+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 63 ==== osd_op_reply(275 gc.14 [call] v27'283 uv283 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.558+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-05-08T18:53:41.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.558+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:276 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.559+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 92 ==== osd_op_reply(276 gc.15 [call] v27'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.559+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:277 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.559+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 93 ==== osd_op_reply(277 gc.15 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.559+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.559+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:278 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78c050 con 0x56000c741590 2024-05-08T18:53:41.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.560+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 94 ==== osd_op_reply(278 gc.15 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.560+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:279 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.560+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 95 ==== osd_op_reply(279 gc.15 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.560+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.560+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:280 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.560+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 96 ==== osd_op_reply(280 gc.15 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.560+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.560+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:281 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.561+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 97 ==== osd_op_reply(281 gc.15 [call] v27'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.561+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-05-08T18:53:41.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.561+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:282 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.562+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 57 ==== osd_op_reply(282 gc.16 [call] v27'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.562+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:283 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.562+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 58 ==== osd_op_reply(283 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.562+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.562+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:284 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78c050 con 0x7f857804b070 2024-05-08T18:53:41.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.563+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 59 ==== osd_op_reply(284 gc.16 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.563+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:285 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.563+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 60 ==== osd_op_reply(285 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.563+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.563+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:286 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.563+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 61 ==== osd_op_reply(286 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.563+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.563+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:287 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x7f857804b070 2024-05-08T18:53:41.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.565+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 62 ==== osd_op_reply(287 gc.16 [call] v27'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.565+0000 7f857f3a2800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-05-08T18:53:41.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.565+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:288 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.566+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 98 ==== osd_op_reply(288 gc.17 [call] v27'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.566+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:289 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.566+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 99 ==== osd_op_reply(289 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.566+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.566+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:290 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78c050 con 0x56000c741590 2024-05-08T18:53:41.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.566+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 100 ==== osd_op_reply(290 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.566+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:291 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.566+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 101 ==== osd_op_reply(291 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.566+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:53:41.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.566+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:292 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.567+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 102 ==== osd_op_reply(292 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.567+0000 7f857f3a2800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:53:41.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.567+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:293 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c78d060 con 0x56000c741590 2024-05-08T18:53:41.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.568+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 103 ==== osd_op_reply(293 gc.17 [call] v27'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.568+0000 7f84337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:53:41.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.568+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94558208974000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c785860 con 0x56000c73cba0 2024-05-08T18:53:41.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.569+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 64 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94558208974000] v27'284 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.569+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94558208949632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c7566f0 con 0x7f857804b070 2024-05-08T18:53:41.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.570+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 63 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94558208949632] v27'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.570+0000 7f857f3a2800 20 remove_watcher() i=0 2024-05-08T18:53:41.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.570+0000 7f857f3a2800 2 removed watcher, disabling cache 2024-05-08T18:53:41.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.570+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94558208953552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c747d80 con 0x56000c73cba0 2024-05-08T18:53:41.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.571+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 65 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94558208953552] v27'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.572+0000 7f857f3a2800 20 remove_watcher() i=1 2024-05-08T18:53:41.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.572+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94558208954608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c747d80 con 0x56000c741590 2024-05-08T18:53:41.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.573+0000 7f857d69b640 1 -- 172.21.15.132:0/2756943113 <== osd.3 v2:172.21.15.132:6816/17827703 104 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94558208954608] v27'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f857803f070 con 0x56000c741590 2024-05-08T18:53:41.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.573+0000 7f857f3a2800 20 remove_watcher() i=2 2024-05-08T18:53:41.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.573+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94558208960944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c747d80 con 0x7f857804b070 2024-05-08T18:53:41.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.574+0000 7f857ce9a640 1 -- 172.21.15.132:0/2756943113 <== osd.2 v2:172.21.15.132:6808/1108348591 64 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94558208960944] v27'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f856c075030 con 0x7f857804b070 2024-05-08T18:53:41.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.574+0000 7f857f3a2800 20 remove_watcher() i=3 2024-05-08T18:53:41.573 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.574+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94558208963280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c747d80 con 0x56000c73cba0 2024-05-08T18:53:41.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.575+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.1 v2:172.21.15.132:6800/3697320277 66 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94558208963280] v27'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8564048020 con 0x56000c73cba0 2024-05-08T18:53:41.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.575+0000 7f857f3a2800 20 remove_watcher() i=4 2024-05-08T18:53:41.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.575+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94558208966000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c747d80 con 0x7f856c0a1040 2024-05-08T18:53:41.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.576+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 66 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94558208966000] v27'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.576+0000 7f857f3a2800 20 remove_watcher() i=5 2024-05-08T18:53:41.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.576+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94558208969120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c74bd70 con 0x7f856c0a1040 2024-05-08T18:53:41.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.577+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 67 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94558208969120] v27'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.577+0000 7f857f3a2800 20 remove_watcher() i=6 2024-05-08T18:53:41.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.577+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94558208971616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56000c747d80 con 0x7f856c0a1040 2024-05-08T18:53:41.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.578+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 <== osd.0 v2:172.21.15.42:6800/1521799280 68 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94558208971616] v27'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8564048020 con 0x7f856c0a1040 2024-05-08T18:53:41.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.578+0000 7f857f3a2800 20 remove_watcher() i=7 2024-05-08T18:53:41.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.578+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f856c0a1040 msgr2=0x7f856c092740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:41.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.578+0000 7f857f3a2800 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7f856c0a1040 0x7f856c092740 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:41.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.578+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56000c73cba0 msgr2=0x56000c73f060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:41.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.578+0000 7f857f3a2800 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56000c73cba0 0x56000c73f060 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:41.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.578+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f857804b070 msgr2=0x7f85780133b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:41.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.578+0000 7f857f3a2800 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7f857804b070 0x7f85780133b0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:41.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.578+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56000c741590 msgr2=0x56000c743980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:41.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.578+0000 7f857f3a2800 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56000c741590 0x56000c743980 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:41.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.578+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f844803bb50 msgr2=0x7f844803e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:41.580 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.578+0000 7f857f3a2800 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f844803bb50 0x7f844803e010 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f856c0926c0 tx=0x7f856c08b000 comp rx=0 tx=0).stop 2024-05-08T18:53:41.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.578+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c729930 msgr2=0x56000c730ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:41.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.578+0000 7f8574699640 1 -- 172.21.15.132:0/2756943113 reap_dead start 2024-05-08T18:53:41.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.578+0000 7f857f3a2800 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c729930 0x56000c730ef0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f8578011fb0 tx=0x7f8578052be0 comp rx=0 tx=0).stop 2024-05-08T18:53:41.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.578+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 shutdown_connections 2024-05-08T18:53:41.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.578+0000 7f857f3a2800 1 --2- 172.21.15.132:0/2756943113 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c729930 0x56000c730ef0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:41.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.578+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 >> 172.21.15.132:0/2756943113 conn(0x56000c725c90 msgr2=0x56000c7232f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:41.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.578+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 shutdown_connections 2024-05-08T18:53:41.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.578+0000 7f857f3a2800 1 -- 172.21.15.132:0/2756943113 wait complete. 2024-05-08T18:53:41.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 -- 172.21.15.132:0/24118763 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f845403bba0 msgr2=0x7f845403e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:41.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 --2- 172.21.15.132:0/24118763 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f845403bba0 0x7f845403e060 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x56000c708de0 tx=0x7f856c005330 comp rx=0 tx=0).stop 2024-05-08T18:53:41.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 -- 172.21.15.132:0/24118763 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c71c6b0 msgr2=0x56000c71cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:41.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 --2- 172.21.15.132:0/24118763 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c71c6b0 0x56000c71cad0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x56000c708d40 tx=0x7f8578018830 comp rx=0 tx=0).stop 2024-05-08T18:53:41.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 -- 172.21.15.132:0/24118763 shutdown_connections 2024-05-08T18:53:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 --2- 172.21.15.132:0/24118763 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f845403bba0 0x7f845403e060 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 --2- 172.21.15.132:0/24118763 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c71c6b0 0x56000c71cad0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 -- 172.21.15.132:0/24118763 >> 172.21.15.132:0/24118763 conn(0x56000c710750 msgr2=0x56000c710b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 -- 172.21.15.132:0/24118763 shutdown_connections 2024-05-08T18:53:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 -- 172.21.15.132:0/24118763 wait complete. 2024-05-08T18:53:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 -- 172.21.15.132:0/1483782695 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56000c6083a0 msgr2=0x56000c7083e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 --2- 172.21.15.132:0/1483782695 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56000c6083a0 0x56000c7083e0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 -- 172.21.15.132:0/1483782695 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56000c70ac90 msgr2=0x56000c70d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 --2- 172.21.15.132:0/1483782695 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56000c70ac90 0x56000c70d080 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 -- 172.21.15.132:0/1483782695 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f846403bb50 msgr2=0x7f846403e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 --2- 172.21.15.132:0/1483782695 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f846403bb50 0x7f846403e010 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8564000f60 tx=0x7f8564001370 comp rx=0 tx=0).stop 2024-05-08T18:53:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 -- 172.21.15.132:0/1483782695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c607140 msgr2=0x56000c7011a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 --2- 172.21.15.132:0/1483782695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c607140 0x56000c7011a0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f856c00a520 tx=0x7f856c003020 comp rx=0 tx=0).stop 2024-05-08T18:53:41.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 -- 172.21.15.132:0/1483782695 shutdown_connections 2024-05-08T18:53:41.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 --2- 172.21.15.132:0/1483782695 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x56000c70ac90 0x56000c70d080 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:41.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 --2- 172.21.15.132:0/1483782695 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x56000c6083a0 0x56000c7083e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:41.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 --2- 172.21.15.132:0/1483782695 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f846403bb50 0x7f846403e010 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:41.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 --2- 172.21.15.132:0/1483782695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x56000c607140 0x56000c7011a0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:41.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 -- 172.21.15.132:0/1483782695 >> 172.21.15.132:0/1483782695 conn(0x56000c602720 msgr2=0x56000c6f27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:41.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 -- 172.21.15.132:0/1483782695 shutdown_connections 2024-05-08T18:53:41.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T18:53:41.579+0000 7f857f3a2800 1 -- 172.21.15.132:0/1483782695 wait complete. 2024-05-08T18:53:41.588 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-08T18:53:41.597 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T18:53:41.597 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:53:41.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.704+0000 7f6ed9fc7640 1 Processor -- start 2024-05-08T18:53:41.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.705+0000 7f6ed9fc7640 1 -- start start 2024-05-08T18:53:41.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.705+0000 7f6ed9fc7640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6ed41326d0 0x7f6ed4134ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:41.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.705+0000 7f6ed9fc7640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ed4072860 con 0x7f6ed412c640 2024-05-08T18:53:41.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.705+0000 7f6ed9fc7640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f6ed4072fb0 con 0x7f6ed41326d0 2024-05-08T18:53:41.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.705+0000 7f6ed2ffd640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6ed41326d0 0x7f6ed4134ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:41.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.705+0000 7f6ed37fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f6ed412c640 0x7f6ed412ca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:47160/0 (socket says 172.21.15.42:47160) 2024-05-08T18:53:41.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.705+0000 7f6ed37fe640 1 -- 172.21.15.42:0/1084398651 learned_addr learned my addr 172.21.15.42:0/1084398651 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:53:41.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.705+0000 7f6ed2ffd640 1 -- 172.21.15.42:0/1084398651 >> v1:172.21.15.42:6789/0 conn(0x7f6ed412c640 legacy=0x7f6ed412ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:41.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.705+0000 7f6ed2ffd640 1 -- 172.21.15.42:0/1084398651 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed4072ca0 con 0x7f6ed41326d0 2024-05-08T18:53:41.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.706+0000 7f6ed2ffd640 1 --2- 172.21.15.42:0/1084398651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ed41326d0 0x7f6ed4134ac0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8009720 tx=0x7f6ec802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f65682017992d2a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:41.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.706+0000 7f6ed27fc640 1 -- 172.21.15.42:0/1084398651 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ec80316d0 con 0x7f6ed41326d0 2024-05-08T18:53:41.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.706+0000 7f6ed27fc640 1 -- 172.21.15.42:0/1084398651 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec8037070 con 0x7f6ed41326d0 2024-05-08T18:53:41.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.706+0000 7f6ed27fc640 1 -- 172.21.15.42:0/1084398651 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ec80319c0 con 0x7f6ed41326d0 2024-05-08T18:53:41.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.707+0000 7f6ed9fc7640 1 -- 172.21.15.42:0/1084398651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ed41326d0 msgr2=0x7f6ed4134ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:41.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.707+0000 7f6ed9fc7640 1 --2- 172.21.15.42:0/1084398651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ed41326d0 0x7f6ed4134ac0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8009720 tx=0x7f6ec802b840 comp rx=0 tx=0).stop 2024-05-08T18:53:41.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.707+0000 7f6ed9fc7640 1 -- 172.21.15.42:0/1084398651 shutdown_connections 2024-05-08T18:53:41.707 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.707+0000 7f6ed9fc7640 1 --2- 172.21.15.42:0/1084398651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ed41326d0 0x7f6ed4134ac0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:41.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.707+0000 7f6ed9fc7640 1 -- 172.21.15.42:0/1084398651 >> 172.21.15.42:0/1084398651 conn(0x7f6ed40a1bd0 msgr2=0x7f6ed40a1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:41.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.707+0000 7f6ed9fc7640 1 -- 172.21.15.42:0/1084398651 shutdown_connections 2024-05-08T18:53:41.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.707+0000 7f6ed9fc7640 1 -- 172.21.15.42:0/1084398651 wait complete. 2024-05-08T18:53:41.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.708+0000 7f6ed9fc7640 1 Processor -- start 2024-05-08T18:53:41.708 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.708+0000 7f6ed9fc7640 1 -- start start 2024-05-08T18:53:41.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.708+0000 7f6ed9fc7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ed412c640 0x7f6ed4128ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:41.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.708+0000 7f6ed9fc7640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed4135000 con 0x7f6ed412c640 2024-05-08T18:53:41.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.708+0000 7f6ed37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ed412c640 0x7f6ed4128ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:41.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.708+0000 7f6ed37fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ed412c640 0x7f6ed4128ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45736/0 (socket says 172.21.15.42:45736) 2024-05-08T18:53:41.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.708+0000 7f6ed37fe640 1 -- 172.21.15.42:0/1739243631 learned_addr learned my addr 172.21.15.42:0/1739243631 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:53:41.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.709+0000 7f6ed37fe640 1 -- 172.21.15.42:0/1739243631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed411b3d0 con 0x7f6ed412c640 2024-05-08T18:53:41.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.709+0000 7f6ed37fe640 1 --2- 172.21.15.42:0/1739243631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ed412c640 0x7f6ed4128ba0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f6ec400c480 tx=0x7f6ec400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:41.710 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.709+0000 7f6ebbfff640 1 -- 172.21.15.42:0/1739243631 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ec4017070 con 0x7f6ed412c640 2024-05-08T18:53:41.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.709+0000 7f6ebbfff640 1 -- 172.21.15.42:0/1739243631 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec4005c10 con 0x7f6ed412c640 2024-05-08T18:53:41.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.709+0000 7f6ed9fc7640 1 -- 172.21.15.42:0/1739243631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ed411b890 con 0x7f6ed412c640 2024-05-08T18:53:41.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.709+0000 7f6ebbfff640 1 -- 172.21.15.42:0/1739243631 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ec40070d0 con 0x7f6ed412c640 2024-05-08T18:53:41.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.709+0000 7f6ed9fc7640 1 -- 172.21.15.42:0/1739243631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ed41290e0 con 0x7f6ed412c640 2024-05-08T18:53:41.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.710+0000 7f6ebbfff640 1 -- 172.21.15.42:0/1739243631 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f6ec401a070 con 0x7f6ed412c640 2024-05-08T18:53:41.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.710+0000 7f6ed9fc7640 1 -- 172.21.15.42:0/1739243631 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ed4064010 con 0x7f6ed412c640 2024-05-08T18:53:41.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.710+0000 7f6ebbfff640 1 --2- 172.21.15.42:0/1739243631 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6ec003d2b0 0x7f6ec003f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:41.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.710+0000 7f6ebbfff640 1 -- 172.21.15.42:0/1739243631 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f6ec4050fb0 con 0x7f6ed412c640 2024-05-08T18:53:41.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.711+0000 7f6ed2ffd640 1 --2- 172.21.15.42:0/1739243631 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6ec003d2b0 0x7f6ec003f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:41.711 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.711+0000 7f6ed2ffd640 1 --2- 172.21.15.42:0/1739243631 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6ec003d2b0 0x7f6ec003f770 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8036000 tx=0x7f6ec8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:41.714 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.715+0000 7f6ebbfff640 1 -- 172.21.15.42:0/1739243631 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f6ec4007270 con 0x7f6ed412c640 2024-05-08T18:53:41.899 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.900+0000 7f6ed9fc7640 1 -- 172.21.15.42:0/1739243631 --> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ed41344e0 con 0x7f6ec003d2b0 2024-05-08T18:53:41.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.917+0000 7f6ebbfff640 1 -- 172.21.15.42:0/1739243631 <== mgr.4102 v2:172.21.15.132:6824/2104266563 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665399 (secure 0 0 0) 0x7f6ec8037040 con 0x7f6ec003d2b0 2024-05-08T18:53:41.924 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:53:41.930 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-08T18:53:41.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.921+0000 7f6ed9fc7640 1 -- 172.21.15.42:0/1739243631 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6ec003d2b0 msgr2=0x7f6ec003f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:41.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.921+0000 7f6ed9fc7640 1 --2- 172.21.15.42:0/1739243631 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6ec003d2b0 0x7f6ec003f770 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8036000 tx=0x7f6ec8008030 comp rx=0 tx=0).stop 2024-05-08T18:53:41.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.922+0000 7f6ed9fc7640 1 -- 172.21.15.42:0/1739243631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ed412c640 msgr2=0x7f6ed4128ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:41.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.922+0000 7f6ed9fc7640 1 --2- 172.21.15.42:0/1739243631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ed412c640 0x7f6ed4128ba0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f6ec400c480 tx=0x7f6ec400c940 comp rx=0 tx=0).stop 2024-05-08T18:53:41.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.922+0000 7f6ed9fc7640 1 -- 172.21.15.42:0/1739243631 shutdown_connections 2024-05-08T18:53:41.933 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.922+0000 7f6ed9fc7640 1 --2- 172.21.15.42:0/1739243631 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f6ec003d2b0 0x7f6ec003f770 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:41.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.922+0000 7f6ed9fc7640 1 --2- 172.21.15.42:0/1739243631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ed412c640 0x7f6ed4128ba0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:41.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.922+0000 7f6ed9fc7640 1 -- 172.21.15.42:0/1739243631 >> 172.21.15.42:0/1739243631 conn(0x7f6ed40a1bd0 msgr2=0x7f6ed412b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:41.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.922+0000 7f6ed9fc7640 1 -- 172.21.15.42:0/1739243631 shutdown_connections 2024-05-08T18:53:41.934 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:41.922+0000 7f6ed9fc7640 1 -- 172.21.15.42:0/1739243631 wait complete. 2024-05-08T18:53:41.935 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2024-05-08T18:53:39.986176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412790,"num_objects":227,"num_object_clones":0,"num_object_copies":454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4815,"num_read_kb":4401,"num_write":2046,"num_write_kb":60584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4431,"ondisk_log_size":4431,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190248,"kb_used_data":53064,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377297112,"statfs":{"total":386547056640,"available":386352242688,"internally_reserved":0,"allocated":54337536,"data_stored":53272580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003537"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079566+0000","last_change":"2024-05-08T18:50:26.031610+0000","last_active":"2024-05-08T18:51:15.079566+0000","last_peered":"2024-05-08T18:51:15.079566+0000","last_clean":"2024-05-08T18:51:15.079566+0000","last_became_active":"2024-05-08T18:50:26.031359+0000","last_became_peered":"2024-05-08T18:50:26.031359+0000","last_unstale":"2024-05-08T18:51:15.079566+0000","last_undegraded":"2024-05-08T18:51:15.079566+0000","last_fullsized":"2024-05-08T18:51:15.079566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:47.912064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.861653+0000","last_change":"2024-05-08T18:50:28.028609+0000","last_active":"2024-05-08T18:53:34.861653+0000","last_peered":"2024-05-08T18:53:34.861653+0000","last_clean":"2024-05-08T18:53:34.861653+0000","last_became_active":"2024-05-08T18:50:28.028352+0000","last_became_peered":"2024-05-08T18:50:28.028352+0000","last_unstale":"2024-05-08T18:53:34.861653+0000","last_undegraded":"2024-05-08T18:53:34.861653+0000","last_fullsized":"2024-05-08T18:53:34.861653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:01.592206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.086736+0000","last_change":"2024-05-08T18:50:26.029183+0000","last_active":"2024-05-08T18:52:34.086736+0000","last_peered":"2024-05-08T18:52:34.086736+0000","last_clean":"2024-05-08T18:52:34.086736+0000","last_became_active":"2024-05-08T18:50:26.028799+0000","last_became_peered":"2024-05-08T18:50:26.028799+0000","last_unstale":"2024-05-08T18:52:34.086736+0000","last_undegraded":"2024-05-08T18:52:34.086736+0000","last_fullsized":"2024-05-08T18:52:34.086736+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:51.140557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"27'6","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887526+0000","last_change":"2024-05-08T18:50:28.034919+0000","last_active":"2024-05-08T18:53:34.887526+0000","last_peered":"2024-05-08T18:53:34.887526+0000","last_clean":"2024-05-08T18:53:34.887526+0000","last_became_active":"2024-05-08T18:50:28.033466+0000","last_became_peered":"2024-05-08T18:50:28.033466+0000","last_unstale":"2024-05-08T18:53:34.887526+0000","last_undegraded":"2024-05-08T18:53:34.887526+0000","last_fullsized":"2024-05-08T18:53:34.887526+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:01:07.458436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:17.995039+0000","last_change":"2024-05-08T18:51:15.084166+0000","last_active":"2024-05-08T18:51:17.995039+0000","last_peered":"2024-05-08T18:51:17.995039+0000","last_clean":"2024-05-08T18:51:17.995039+0000","last_became_active":"2024-05-08T18:51:15.083809+0000","last_became_peered":"2024-05-08T18:51:15.083809+0000","last_unstale":"2024-05-08T18:51:17.995039+0000","last_undegraded":"2024-05-08T18:51:17.995039+0000","last_fullsized":"2024-05-08T18:51:17.995039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:21.925661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"25'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.084345+0000","last_change":"2024-05-08T18:51:15.083978+0000","last_active":"2024-05-08T18:51:15.084345+0000","last_peered":"2024-05-08T18:51:15.084345+0000","last_clean":"2024-05-08T18:51:15.084345+0000","last_became_active":"2024-05-08T18:51:15.080716+0000","last_became_peered":"2024-05-08T18:51:15.080716+0000","last_unstale":"2024-05-08T18:51:15.084345+0000","last_undegraded":"2024-05-08T18:51:15.084345+0000","last_fullsized":"2024-05-08T18:51:15.084345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:08.301578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076692+0000","last_change":"2024-05-08T18:50:26.024545+0000","last_active":"2024-05-08T18:51:15.076692+0000","last_peered":"2024-05-08T18:51:15.076692+0000","last_clean":"2024-05-08T18:51:15.076692+0000","last_became_active":"2024-05-08T18:50:26.024243+0000","last_became_peered":"2024-05-08T18:50:26.024243+0000","last_unstale":"2024-05-08T18:51:15.076692+0000","last_undegraded":"2024-05-08T18:51:15.076692+0000","last_fullsized":"2024-05-08T18:51:15.076692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:59.917414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"27'4","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.690261+0000","last_change":"2024-05-08T18:50:28.026931+0000","last_active":"2024-05-08T18:53:34.690261+0000","last_peered":"2024-05-08T18:53:34.690261+0000","last_clean":"2024-05-08T18:53:34.690261+0000","last_became_active":"2024-05-08T18:50:28.026380+0000","last_became_peered":"2024-05-08T18:50:28.026380+0000","last_unstale":"2024-05-08T18:53:34.690261+0000","last_undegraded":"2024-05-08T18:53:34.690261+0000","last_fullsized":"2024-05-08T18:53:34.690261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:06:48.544087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079861+0000","last_change":"2024-05-08T18:50:26.023188+0000","last_active":"2024-05-08T18:51:15.079861+0000","last_peered":"2024-05-08T18:51:15.079861+0000","last_clean":"2024-05-08T18:51:15.079861+0000","last_became_active":"2024-05-08T18:50:26.022914+0000","last_became_peered":"2024-05-08T18:50:26.022914+0000","last_unstale":"2024-05-08T18:51:15.079861+0000","last_undegraded":"2024-05-08T18:51:15.079861+0000","last_fullsized":"2024-05-08T18:51:15.079861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:22.501461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'6","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887773+0000","last_change":"2024-05-08T18:50:28.023780+0000","last_active":"2024-05-08T18:53:34.887773+0000","last_peered":"2024-05-08T18:53:34.887773+0000","last_clean":"2024-05-08T18:53:34.887773+0000","last_became_active":"2024-05-08T18:50:28.023506+0000","last_became_peered":"2024-05-08T18:50:28.023506+0000","last_unstale":"2024-05-08T18:53:34.887773+0000","last_undegraded":"2024-05-08T18:53:34.887773+0000","last_fullsized":"2024-05-08T18:53:34.887773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:07.047413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074268+0000","last_change":"2024-05-08T18:50:26.024901+0000","last_active":"2024-05-08T18:51:15.074268+0000","last_peered":"2024-05-08T18:51:15.074268+0000","last_clean":"2024-05-08T18:51:15.074268+0000","last_became_active":"2024-05-08T18:50:26.024493+0000","last_became_peered":"2024-05-08T18:50:26.024493+0000","last_unstale":"2024-05-08T18:51:15.074268+0000","last_undegraded":"2024-05-08T18:51:15.074268+0000","last_fullsized":"2024-05-08T18:51:15.074268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:45.479269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"27'10","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.607900+0000","last_change":"2024-05-08T18:50:28.037839+0000","last_active":"2024-05-08T18:53:34.607900+0000","last_peered":"2024-05-08T18:53:34.607900+0000","last_clean":"2024-05-08T18:53:34.607900+0000","last_became_active":"2024-05-08T18:50:28.037266+0000","last_became_peered":"2024-05-08T18:50:28.037266+0000","last_unstale":"2024-05-08T18:53:34.607900+0000","last_undegraded":"2024-05-08T18:53:34.607900+0000","last_fullsized":"2024-05-08T18:53:34.607900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:55.169436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.009293+0000","last_change":"2024-05-08T18:50:26.011072+0000","last_active":"2024-05-08T18:52:58.009293+0000","last_peered":"2024-05-08T18:52:58.009293+0000","last_clean":"2024-05-08T18:52:58.009293+0000","last_became_active":"2024-05-08T18:50:26.010734+0000","last_became_peered":"2024-05-08T18:50:26.010734+0000","last_unstale":"2024-05-08T18:52:58.009293+0000","last_undegraded":"2024-05-08T18:52:58.009293+0000","last_fullsized":"2024-05-08T18:52:58.009293+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:34.544725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076550+0000","last_change":"2024-05-08T18:50:28.026695+0000","last_active":"2024-05-08T18:51:15.076550+0000","last_peered":"2024-05-08T18:51:15.076550+0000","last_clean":"2024-05-08T18:51:15.076550+0000","last_became_active":"2024-05-08T18:50:28.026028+0000","last_became_peered":"2024-05-08T18:50:28.026028+0000","last_unstale":"2024-05-08T18:51:15.076550+0000","last_undegraded":"2024-05-08T18:51:15.076550+0000","last_fullsized":"2024-05-08T18:51:15.076550+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:08:56.748370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"25'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072030+0000","last_change":"2024-05-08T18:50:26.029712+0000","last_active":"2024-05-08T18:51:15.072030+0000","last_peered":"2024-05-08T18:51:15.072030+0000","last_clean":"2024-05-08T18:51:15.072030+0000","last_became_active":"2024-05-08T18:50:26.029435+0000","last_became_peered":"2024-05-08T18:50:26.029435+0000","last_unstale":"2024-05-08T18:51:15.072030+0000","last_undegraded":"2024-05-08T18:51:15.072030+0000","last_fullsized":"2024-05-08T18:51:15.072030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:07.271771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"27'6","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887632+0000","last_change":"2024-05-08T18:50:28.033720+0000","last_active":"2024-05-08T18:53:34.887632+0000","last_peered":"2024-05-08T18:53:34.887632+0000","last_clean":"2024-05-08T18:53:34.887632+0000","last_became_active":"2024-05-08T18:50:28.033311+0000","last_became_peered":"2024-05-08T18:50:28.033311+0000","last_unstale":"2024-05-08T18:53:34.887632+0000","last_undegraded":"2024-05-08T18:53:34.887632+0000","last_fullsized":"2024-05-08T18:53:34.887632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:53:28.343769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"27'10","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.243057+0000","last_change":"2024-05-08T18:50:28.033240+0000","last_active":"2024-05-08T18:52:34.243057+0000","last_peered":"2024-05-08T18:52:34.243057+0000","last_clean":"2024-05-08T18:52:34.243057+0000","last_became_active":"2024-05-08T18:50:28.032951+0000","last_became_peered":"2024-05-08T18:50:28.032951+0000","last_unstale":"2024-05-08T18:52:34.243057+0000","last_undegraded":"2024-05-08T18:52:34.243057+0000","last_fullsized":"2024-05-08T18:52:34.243057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:33:40.152329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'4","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.082075+0000","last_change":"2024-05-08T18:50:26.030698+0000","last_active":"2024-05-08T18:51:15.082075+0000","last_peered":"2024-05-08T18:51:15.082075+0000","last_clean":"2024-05-08T18:51:15.082075+0000","last_became_active":"2024-05-08T18:50:26.030437+0000","last_became_peered":"2024-05-08T18:50:26.030437+0000","last_unstale":"2024-05-08T18:51:15.082075+0000","last_undegraded":"2024-05-08T18:51:15.082075+0000","last_fullsized":"2024-05-08T18:51:15.082075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:07.534900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'21","reported_seq":106,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.613463+0000","last_change":"2024-05-08T18:50:28.028447+0000","last_active":"2024-05-08T18:53:34.613463+0000","last_peered":"2024-05-08T18:53:34.613463+0000","last_clean":"2024-05-08T18:53:34.613463+0000","last_became_active":"2024-05-08T18:50:28.028184+0000","last_became_peered":"2024-05-08T18:50:28.028184+0000","last_unstale":"2024-05-08T18:53:34.613463+0000","last_undegraded":"2024-05-08T18:53:34.613463+0000","last_fullsized":"2024-05-08T18:53:34.613463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:08:56.748370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":94,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.816663+0000","last_change":"2024-05-08T18:50:26.032028+0000","last_active":"2024-05-08T18:53:34.816663+0000","last_peered":"2024-05-08T18:53:34.816663+0000","last_clean":"2024-05-08T18:53:34.816663+0000","last_became_active":"2024-05-08T18:50:26.031768+0000","last_became_peered":"2024-05-08T18:50:26.031768+0000","last_unstale":"2024-05-08T18:53:34.816663+0000","last_undegraded":"2024-05-08T18:53:34.816663+0000","last_fullsized":"2024-05-08T18:53:34.816663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:09.253705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'8","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887843+0000","last_change":"2024-05-08T18:50:28.029440+0000","last_active":"2024-05-08T18:53:34.887843+0000","last_peered":"2024-05-08T18:53:34.887843+0000","last_clean":"2024-05-08T18:53:34.887843+0000","last_became_active":"2024-05-08T18:50:28.029145+0000","last_became_peered":"2024-05-08T18:50:28.029145+0000","last_unstale":"2024-05-08T18:53:34.887843+0000","last_undegraded":"2024-05-08T18:53:34.887843+0000","last_fullsized":"2024-05-08T18:53:34.887843+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:23.929950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.809112+0000","last_change":"2024-05-08T18:50:26.031782+0000","last_active":"2024-05-08T18:53:34.809112+0000","last_peered":"2024-05-08T18:53:34.809112+0000","last_clean":"2024-05-08T18:53:34.809112+0000","last_became_active":"2024-05-08T18:50:26.031545+0000","last_became_peered":"2024-05-08T18:50:26.031545+0000","last_unstale":"2024-05-08T18:53:34.809112+0000","last_undegraded":"2024-05-08T18:53:34.809112+0000","last_fullsized":"2024-05-08T18:53:34.809112+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:59.917414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"27'16","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887608+0000","last_change":"2024-05-08T18:50:28.023032+0000","last_active":"2024-05-08T18:53:34.887608+0000","last_peered":"2024-05-08T18:53:34.887608+0000","last_clean":"2024-05-08T18:53:34.887608+0000","last_became_active":"2024-05-08T18:50:28.022683+0000","last_became_peered":"2024-05-08T18:50:28.022683+0000","last_unstale":"2024-05-08T18:53:34.887608+0000","last_undegraded":"2024-05-08T18:53:34.887608+0000","last_fullsized":"2024-05-08T18:53:34.887608+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:53:28.343769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.570317+0000","last_change":"2024-05-08T18:50:26.013216+0000","last_active":"2024-05-08T18:53:34.570317+0000","last_peered":"2024-05-08T18:53:34.570317+0000","last_clean":"2024-05-08T18:53:34.570317+0000","last_became_active":"2024-05-08T18:50:26.011512+0000","last_became_peered":"2024-05-08T18:50:26.011512+0000","last_unstale":"2024-05-08T18:53:34.570317+0000","last_undegraded":"2024-05-08T18:53:34.570317+0000","last_fullsized":"2024-05-08T18:53:34.570317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:10.080123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078245+0000","last_change":"2024-05-08T18:50:28.033091+0000","last_active":"2024-05-08T18:51:15.078245+0000","last_peered":"2024-05-08T18:51:15.078245+0000","last_clean":"2024-05-08T18:51:15.078245+0000","last_became_active":"2024-05-08T18:50:28.032768+0000","last_became_peered":"2024-05-08T18:50:28.032768+0000","last_unstale":"2024-05-08T18:51:15.078245+0000","last_undegraded":"2024-05-08T18:51:15.078245+0000","last_fullsized":"2024-05-08T18:51:15.078245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:14.472478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073068+0000","last_change":"2024-05-08T18:50:26.029400+0000","last_active":"2024-05-08T18:51:15.073068+0000","last_peered":"2024-05-08T18:51:15.073068+0000","last_clean":"2024-05-08T18:51:15.073068+0000","last_became_active":"2024-05-08T18:50:26.029015+0000","last_became_peered":"2024-05-08T18:50:26.029015+0000","last_unstale":"2024-05-08T18:51:15.073068+0000","last_undegraded":"2024-05-08T18:51:15.073068+0000","last_fullsized":"2024-05-08T18:51:15.073068+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:10.080123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"27'14","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.861465+0000","last_change":"2024-05-08T18:50:28.022984+0000","last_active":"2024-05-08T18:53:34.861465+0000","last_peered":"2024-05-08T18:53:34.861465+0000","last_clean":"2024-05-08T18:53:34.861465+0000","last_became_active":"2024-05-08T18:50:28.022359+0000","last_became_peered":"2024-05-08T18:50:28.022359+0000","last_unstale":"2024-05-08T18:53:34.861465+0000","last_undegraded":"2024-05-08T18:53:34.861465+0000","last_fullsized":"2024-05-08T18:53:34.861465+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:53.851136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007611+0000","last_change":"2024-05-08T18:50:26.017214+0000","last_active":"2024-05-08T18:52:48.007611+0000","last_peered":"2024-05-08T18:52:48.007611+0000","last_clean":"2024-05-08T18:52:48.007611+0000","last_became_active":"2024-05-08T18:50:26.016932+0000","last_became_peered":"2024-05-08T18:50:26.016932+0000","last_unstale":"2024-05-08T18:52:48.007611+0000","last_undegraded":"2024-05-08T18:52:48.007611+0000","last_fullsized":"2024-05-08T18:52:48.007611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:36.779493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"27'41","reported_seq":107,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.843008+0000","last_change":"2024-05-08T18:50:36.055719+0000","last_active":"2024-05-08T18:53:34.843008+0000","last_peered":"2024-05-08T18:53:34.843008+0000","last_clean":"2024-05-08T18:53:34.843008+0000","last_became_active":"2024-05-08T18:50:36.055045+0000","last_became_peered":"2024-05-08T18:50:36.055045+0000","last_unstale":"2024-05-08T18:53:34.843008+0000","last_undegraded":"2024-05-08T18:53:34.843008+0000","last_fullsized":"2024-05-08T18:53:34.843008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:51.311129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":182,"num_write":115,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'10","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.823446+0000","last_change":"2024-05-08T18:50:28.025676+0000","last_active":"2024-05-08T18:53:34.823446+0000","last_peered":"2024-05-08T18:53:34.823446+0000","last_clean":"2024-05-08T18:53:34.823446+0000","last_became_active":"2024-05-08T18:50:28.025239+0000","last_became_peered":"2024-05-08T18:50:28.025239+0000","last_unstale":"2024-05-08T18:53:34.823446+0000","last_undegraded":"2024-05-08T18:53:34.823446+0000","last_fullsized":"2024-05-08T18:53:34.823446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:43.734077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077683+0000","last_change":"2024-05-08T18:50:26.026659+0000","last_active":"2024-05-08T18:51:15.077683+0000","last_peered":"2024-05-08T18:51:15.077683+0000","last_clean":"2024-05-08T18:51:15.077683+0000","last_became_active":"2024-05-08T18:50:26.026400+0000","last_became_peered":"2024-05-08T18:50:26.026400+0000","last_unstale":"2024-05-08T18:51:15.077683+0000","last_undegraded":"2024-05-08T18:51:15.077683+0000","last_fullsized":"2024-05-08T18:51:15.077683+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:42.961279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079375+0000","last_change":"2024-05-08T18:50:30.036048+0000","last_active":"2024-05-08T18:51:15.079375+0000","last_peered":"2024-05-08T18:51:15.079375+0000","last_clean":"2024-05-08T18:51:15.079375+0000","last_became_active":"2024-05-08T18:50:30.034832+0000","last_became_peered":"2024-05-08T18:50:30.034832+0000","last_unstale":"2024-05-08T18:51:15.079375+0000","last_undegraded":"2024-05-08T18:51:15.079375+0000","last_fullsized":"2024-05-08T18:51:15.079375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:46.416875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"27'30","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.784944+0000","last_change":"2024-05-08T18:50:32.044302+0000","last_active":"2024-05-08T18:52:32.784944+0000","last_peered":"2024-05-08T18:52:32.784944+0000","last_clean":"2024-05-08T18:52:32.784944+0000","last_became_active":"2024-05-08T18:50:32.042432+0000","last_became_peered":"2024-05-08T18:50:32.042432+0000","last_unstale":"2024-05-08T18:52:32.784944+0000","last_undegraded":"2024-05-08T18:52:32.784944+0000","last_fullsized":"2024-05-08T18:52:32.784944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:10.539618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081525+0000","last_change":"2024-05-08T18:50:34.048749+0000","last_active":"2024-05-08T18:51:15.081525+0000","last_peered":"2024-05-08T18:51:15.081525+0000","last_clean":"2024-05-08T18:51:15.081525+0000","last_became_active":"2024-05-08T18:50:34.048339+0000","last_became_peered":"2024-05-08T18:50:34.048339+0000","last_unstale":"2024-05-08T18:51:15.081525+0000","last_undegraded":"2024-05-08T18:51:15.081525+0000","last_fullsized":"2024-05-08T18:51:15.081525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:11.762112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"27'7","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.481284+0000","last_change":"2024-05-08T18:50:36.055618+0000","last_active":"2024-05-08T18:51:50.481284+0000","last_peered":"2024-05-08T18:51:50.481284+0000","last_clean":"2024-05-08T18:51:50.481284+0000","last_became_active":"2024-05-08T18:50:36.055220+0000","last_became_peered":"2024-05-08T18:50:36.055220+0000","last_unstale":"2024-05-08T18:51:50.481284+0000","last_undegraded":"2024-05-08T18:51:50.481284+0000","last_fullsized":"2024-05-08T18:51:50.481284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:17.604372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"25'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.080146+0000","last_change":"2024-05-08T18:50:28.038524+0000","last_active":"2024-05-08T18:51:15.080146+0000","last_peered":"2024-05-08T18:51:15.080146+0000","last_clean":"2024-05-08T18:51:15.080146+0000","last_became_active":"2024-05-08T18:50:28.038232+0000","last_became_peered":"2024-05-08T18:50:28.038232+0000","last_unstale":"2024-05-08T18:51:15.080146+0000","last_undegraded":"2024-05-08T18:51:15.080146+0000","last_fullsized":"2024-05-08T18:51:15.080146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:25.476484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.006963+0000","last_change":"2024-05-08T18:50:26.031250+0000","last_active":"2024-05-08T18:52:48.006963+0000","last_peered":"2024-05-08T18:52:48.006963+0000","last_clean":"2024-05-08T18:52:48.006963+0000","last_became_active":"2024-05-08T18:50:26.030986+0000","last_became_peered":"2024-05-08T18:50:26.030986+0000","last_unstale":"2024-05-08T18:52:48.006963+0000","last_undegraded":"2024-05-08T18:52:48.006963+0000","last_fullsized":"2024-05-08T18:52:48.006963+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:47.462940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073251+0000","last_change":"2024-05-08T18:50:30.026937+0000","last_active":"2024-05-08T18:51:15.073251+0000","last_peered":"2024-05-08T18:51:15.073251+0000","last_clean":"2024-05-08T18:51:15.073251+0000","last_became_active":"2024-05-08T18:50:30.026538+0000","last_became_peered":"2024-05-08T18:50:30.026538+0000","last_unstale":"2024-05-08T18:51:15.073251+0000","last_undegraded":"2024-05-08T18:51:15.073251+0000","last_fullsized":"2024-05-08T18:51:15.073251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:07.500017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"25'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081630+0000","last_change":"2024-05-08T18:50:32.039340+0000","last_active":"2024-05-08T18:51:15.081630+0000","last_peered":"2024-05-08T18:51:15.081630+0000","last_clean":"2024-05-08T18:51:15.081630+0000","last_became_active":"2024-05-08T18:50:32.039031+0000","last_became_peered":"2024-05-08T18:50:32.039031+0000","last_unstale":"2024-05-08T18:51:15.081630+0000","last_undegraded":"2024-05-08T18:51:15.081630+0000","last_fullsized":"2024-05-08T18:51:15.081630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:40.432123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.080159+0000","last_change":"2024-05-08T18:50:34.050921+0000","last_active":"2024-05-08T18:51:15.080159+0000","last_peered":"2024-05-08T18:51:15.080159+0000","last_clean":"2024-05-08T18:51:15.080159+0000","last_became_active":"2024-05-08T18:50:34.050512+0000","last_became_peered":"2024-05-08T18:50:34.050512+0000","last_unstale":"2024-05-08T18:51:15.080159+0000","last_undegraded":"2024-05-08T18:51:15.080159+0000","last_fullsized":"2024-05-08T18:51:15.080159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:12.079998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"25'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072106+0000","last_change":"2024-05-08T18:50:36.048388+0000","last_active":"2024-05-08T18:51:15.072106+0000","last_peered":"2024-05-08T18:51:15.072106+0000","last_clean":"2024-05-08T18:51:15.072106+0000","last_became_active":"2024-05-08T18:50:36.048075+0000","last_became_peered":"2024-05-08T18:50:36.048075+0000","last_unstale":"2024-05-08T18:51:15.072106+0000","last_undegraded":"2024-05-08T18:51:15.072106+0000","last_fullsized":"2024-05-08T18:51:15.072106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:35.422216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'10","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.861231+0000","last_change":"2024-05-08T18:50:28.026321+0000","last_active":"2024-05-08T18:53:34.861231+0000","last_peered":"2024-05-08T18:53:34.861231+0000","last_clean":"2024-05-08T18:53:34.861231+0000","last_became_active":"2024-05-08T18:50:28.025867+0000","last_became_peered":"2024-05-08T18:50:28.025867+0000","last_unstale":"2024-05-08T18:53:34.861231+0000","last_undegraded":"2024-05-08T18:53:34.861231+0000","last_fullsized":"2024-05-08T18:53:34.861231+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:58.219100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"27'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007580+0000","last_change":"2024-05-08T18:50:26.025750+0000","last_active":"2024-05-08T18:52:48.007580+0000","last_peered":"2024-05-08T18:52:48.007580+0000","last_clean":"2024-05-08T18:52:48.007580+0000","last_became_active":"2024-05-08T18:50:26.025410+0000","last_became_peered":"2024-05-08T18:50:26.025410+0000","last_unstale":"2024-05-08T18:52:48.007580+0000","last_undegraded":"2024-05-08T18:52:48.007580+0000","last_fullsized":"2024-05-08T18:52:48.007580+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:50:43.198256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075129+0000","last_change":"2024-05-08T18:50:30.029531+0000","last_active":"2024-05-08T18:51:15.075129+0000","last_peered":"2024-05-08T18:51:15.075129+0000","last_clean":"2024-05-08T18:51:15.075129+0000","last_became_active":"2024-05-08T18:50:30.029196+0000","last_became_peered":"2024-05-08T18:50:30.029196+0000","last_unstale":"2024-05-08T18:51:15.075129+0000","last_undegraded":"2024-05-08T18:51:15.075129+0000","last_fullsized":"2024-05-08T18:51:15.075129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:03.285378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"25'10","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078489+0000","last_change":"2024-05-08T18:50:32.044406+0000","last_active":"2024-05-08T18:51:15.078489+0000","last_peered":"2024-05-08T18:51:15.078489+0000","last_clean":"2024-05-08T18:51:15.078489+0000","last_became_active":"2024-05-08T18:50:32.044056+0000","last_became_peered":"2024-05-08T18:50:32.044056+0000","last_unstale":"2024-05-08T18:51:15.078489+0000","last_undegraded":"2024-05-08T18:51:15.078489+0000","last_fullsized":"2024-05-08T18:51:15.078489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:24.002892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"27'282","reported_seq":390,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111612+0000","last_change":"2024-05-08T18:50:34.042149+0000","last_active":"2024-05-08T18:53:35.111612+0000","last_peered":"2024-05-08T18:53:35.111612+0000","last_clean":"2024-05-08T18:53:35.111612+0000","last_became_active":"2024-05-08T18:50:34.041872+0000","last_became_peered":"2024-05-08T18:50:34.041872+0000","last_unstale":"2024-05-08T18:53:35.111612+0000","last_undegraded":"2024-05-08T18:53:35.111612+0000","last_fullsized":"2024-05-08T18:53:35.111612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:51.976316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075671+0000","last_change":"2024-05-08T18:50:36.049616+0000","last_active":"2024-05-08T18:51:15.075671+0000","last_peered":"2024-05-08T18:51:15.075671+0000","last_clean":"2024-05-08T18:51:15.075671+0000","last_became_active":"2024-05-08T18:50:36.049346+0000","last_became_peered":"2024-05-08T18:50:36.049346+0000","last_unstale":"2024-05-08T18:51:15.075671+0000","last_undegraded":"2024-05-08T18:51:15.075671+0000","last_fullsized":"2024-05-08T18:51:15.075671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:30:50.522610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'6","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:31.121826+0000","last_change":"2024-05-08T18:50:28.031653+0000","last_active":"2024-05-08T18:52:31.121826+0000","last_peered":"2024-05-08T18:52:31.121826+0000","last_clean":"2024-05-08T18:52:31.121826+0000","last_became_active":"2024-05-08T18:50:28.031332+0000","last_became_peered":"2024-05-08T18:50:28.031332+0000","last_unstale":"2024-05-08T18:52:31.121826+0000","last_undegraded":"2024-05-08T18:52:31.121826+0000","last_fullsized":"2024-05-08T18:52:31.121826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:30.052454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076511+0000","last_change":"2024-05-08T18:50:26.032415+0000","last_active":"2024-05-08T18:51:15.076511+0000","last_peered":"2024-05-08T18:51:15.076511+0000","last_clean":"2024-05-08T18:51:15.076511+0000","last_became_active":"2024-05-08T18:50:26.032155+0000","last_became_peered":"2024-05-08T18:50:26.032155+0000","last_unstale":"2024-05-08T18:51:15.076511+0000","last_undegraded":"2024-05-08T18:51:15.076511+0000","last_fullsized":"2024-05-08T18:51:15.076511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:45.479269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"27'4","reported_seq":226,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.880720+0000","last_change":"2024-05-08T18:50:30.035403+0000","last_active":"2024-05-08T18:52:33.880720+0000","last_peered":"2024-05-08T18:52:33.880720+0000","last_clean":"2024-05-08T18:52:33.880720+0000","last_became_active":"2024-05-08T18:50:30.034798+0000","last_became_peered":"2024-05-08T18:50:30.034798+0000","last_unstale":"2024-05-08T18:52:33.880720+0000","last_undegraded":"2024-05-08T18:52:33.880720+0000","last_fullsized":"2024-05-08T18:52:33.880720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:08:03.148182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"27'30","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.779909+0000","last_change":"2024-05-08T18:50:32.043871+0000","last_active":"2024-05-08T18:52:32.779909+0000","last_peered":"2024-05-08T18:52:32.779909+0000","last_clean":"2024-05-08T18:52:32.779909+0000","last_became_active":"2024-05-08T18:50:32.043573+0000","last_became_peered":"2024-05-08T18:50:32.043573+0000","last_unstale":"2024-05-08T18:52:32.779909+0000","last_undegraded":"2024-05-08T18:52:32.779909+0000","last_fullsized":"2024-05-08T18:52:32.779909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:33:44.166474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"27'282","reported_seq":401,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111691+0000","last_change":"2024-05-08T18:50:34.050464+0000","last_active":"2024-05-08T18:53:35.111691+0000","last_peered":"2024-05-08T18:53:35.111691+0000","last_clean":"2024-05-08T18:53:35.111691+0000","last_became_active":"2024-05-08T18:50:34.050122+0000","last_became_peered":"2024-05-08T18:50:34.050122+0000","last_unstale":"2024-05-08T18:53:35.111691+0000","last_undegraded":"2024-05-08T18:53:35.111691+0000","last_fullsized":"2024-05-08T18:53:35.111691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:11.762112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"27'6","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.691043+0000","last_change":"2024-05-08T18:50:28.035510+0000","last_active":"2024-05-08T18:53:34.691043+0000","last_peered":"2024-05-08T18:53:34.691043+0000","last_clean":"2024-05-08T18:53:34.691043+0000","last_became_active":"2024-05-08T18:50:28.034992+0000","last_became_peered":"2024-05-08T18:50:28.034992+0000","last_unstale":"2024-05-08T18:53:34.691043+0000","last_undegraded":"2024-05-08T18:53:34.691043+0000","last_fullsized":"2024-05-08T18:53:34.691043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:18.934758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079658+0000","last_change":"2024-05-08T18:50:26.023445+0000","last_active":"2024-05-08T18:51:15.079658+0000","last_peered":"2024-05-08T18:51:15.079658+0000","last_clean":"2024-05-08T18:51:15.079658+0000","last_became_active":"2024-05-08T18:50:26.023141+0000","last_became_peered":"2024-05-08T18:50:26.023141+0000","last_unstale":"2024-05-08T18:51:15.079658+0000","last_undegraded":"2024-05-08T18:51:15.079658+0000","last_fullsized":"2024-05-08T18:51:15.079658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:07.534900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075851+0000","last_change":"2024-05-08T18:50:30.030136+0000","last_active":"2024-05-08T18:51:15.075851+0000","last_peered":"2024-05-08T18:51:15.075851+0000","last_clean":"2024-05-08T18:51:15.075851+0000","last_became_active":"2024-05-08T18:50:30.029482+0000","last_became_peered":"2024-05-08T18:50:30.029482+0000","last_unstale":"2024-05-08T18:51:15.075851+0000","last_undegraded":"2024-05-08T18:51:15.075851+0000","last_fullsized":"2024-05-08T18:51:15.075851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:13:46.352309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"27'41","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.789074+0000","last_change":"2024-05-08T18:50:32.038383+0000","last_active":"2024-05-08T18:52:32.789074+0000","last_peered":"2024-05-08T18:52:32.789074+0000","last_clean":"2024-05-08T18:52:32.789074+0000","last_became_active":"2024-05-08T18:50:32.038121+0000","last_became_peered":"2024-05-08T18:50:32.038121+0000","last_unstale":"2024-05-08T18:52:32.789074+0000","last_undegraded":"2024-05-08T18:52:32.789074+0000","last_fullsized":"2024-05-08T18:52:32.789074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:18.512526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072455+0000","last_change":"2024-05-08T18:50:34.047709+0000","last_active":"2024-05-08T18:51:15.072455+0000","last_peered":"2024-05-08T18:51:15.072455+0000","last_clean":"2024-05-08T18:51:15.072455+0000","last_became_active":"2024-05-08T18:50:34.047404+0000","last_became_peered":"2024-05-08T18:50:34.047404+0000","last_unstale":"2024-05-08T18:51:15.072455+0000","last_undegraded":"2024-05-08T18:51:15.072455+0000","last_fullsized":"2024-05-08T18:51:15.072455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:54.419559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"27'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.483004+0000","last_change":"2024-05-08T18:50:36.052192+0000","last_active":"2024-05-08T18:51:50.483004+0000","last_peered":"2024-05-08T18:51:50.483004+0000","last_clean":"2024-05-08T18:51:50.483004+0000","last_became_active":"2024-05-08T18:50:36.051055+0000","last_became_peered":"2024-05-08T18:50:36.051055+0000","last_unstale":"2024-05-08T18:51:50.483004+0000","last_undegraded":"2024-05-08T18:51:50.483004+0000","last_fullsized":"2024-05-08T18:51:50.483004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:38.752303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"27'7","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.868063+0000","last_change":"2024-05-08T18:50:28.018783+0000","last_active":"2024-05-08T18:53:34.868063+0000","last_peered":"2024-05-08T18:53:34.868063+0000","last_clean":"2024-05-08T18:53:34.868063+0000","last_became_active":"2024-05-08T18:50:28.018022+0000","last_became_peered":"2024-05-08T18:50:28.018022+0000","last_unstale":"2024-05-08T18:53:34.868063+0000","last_undegraded":"2024-05-08T18:53:34.868063+0000","last_fullsized":"2024-05-08T18:53:34.868063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:23.858287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076642+0000","last_change":"2024-05-08T18:50:26.025311+0000","last_active":"2024-05-08T18:51:15.076642+0000","last_peered":"2024-05-08T18:51:15.076642+0000","last_clean":"2024-05-08T18:51:15.076642+0000","last_became_active":"2024-05-08T18:50:26.025028+0000","last_became_peered":"2024-05-08T18:50:26.025028+0000","last_unstale":"2024-05-08T18:51:15.076642+0000","last_undegraded":"2024-05-08T18:51:15.076642+0000","last_fullsized":"2024-05-08T18:51:15.076642+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:08:13.942735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072580+0000","last_change":"2024-05-08T18:50:30.032000+0000","last_active":"2024-05-08T18:51:15.072580+0000","last_peered":"2024-05-08T18:51:15.072580+0000","last_clean":"2024-05-08T18:51:15.072580+0000","last_became_active":"2024-05-08T18:50:30.031574+0000","last_became_peered":"2024-05-08T18:50:30.031574+0000","last_unstale":"2024-05-08T18:51:15.072580+0000","last_undegraded":"2024-05-08T18:51:15.072580+0000","last_fullsized":"2024-05-08T18:51:15.072580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:05.406989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"27'32","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.768717+0000","last_change":"2024-05-08T18:50:32.042012+0000","last_active":"2024-05-08T18:52:32.768717+0000","last_peered":"2024-05-08T18:52:32.768717+0000","last_clean":"2024-05-08T18:52:32.768717+0000","last_became_active":"2024-05-08T18:50:32.041239+0000","last_became_peered":"2024-05-08T18:50:32.041239+0000","last_unstale":"2024-05-08T18:52:32.768717+0000","last_undegraded":"2024-05-08T18:52:32.768717+0000","last_fullsized":"2024-05-08T18:52:32.768717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:21.232439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072331+0000","last_change":"2024-05-08T18:50:34.044867+0000","last_active":"2024-05-08T18:51:15.072331+0000","last_peered":"2024-05-08T18:51:15.072331+0000","last_clean":"2024-05-08T18:51:15.072331+0000","last_became_active":"2024-05-08T18:50:34.044487+0000","last_became_peered":"2024-05-08T18:50:34.044487+0000","last_unstale":"2024-05-08T18:51:15.072331+0000","last_undegraded":"2024-05-08T18:51:15.072331+0000","last_fullsized":"2024-05-08T18:51:15.072331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:26:22.790796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"27'7","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.864198+0000","last_change":"2024-05-08T18:50:36.051009+0000","last_active":"2024-05-08T18:53:34.864198+0000","last_peered":"2024-05-08T18:53:34.864198+0000","last_clean":"2024-05-08T18:53:34.864198+0000","last_became_active":"2024-05-08T18:50:36.050379+0000","last_became_peered":"2024-05-08T18:50:36.050379+0000","last_unstale":"2024-05-08T18:53:34.864198+0000","last_undegraded":"2024-05-08T18:53:34.864198+0000","last_fullsized":"2024-05-08T18:53:34.864198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:50.929055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:31.119400+0000","last_change":"2024-05-08T18:50:28.037118+0000","last_active":"2024-05-08T18:52:31.119400+0000","last_peered":"2024-05-08T18:52:31.119400+0000","last_clean":"2024-05-08T18:52:31.119400+0000","last_became_active":"2024-05-08T18:50:28.036821+0000","last_became_peered":"2024-05-08T18:50:28.036821+0000","last_unstale":"2024-05-08T18:52:31.119400+0000","last_undegraded":"2024-05-08T18:52:31.119400+0000","last_fullsized":"2024-05-08T18:52:31.119400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:32.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079688+0000","last_change":"2024-05-08T18:50:26.023248+0000","last_active":"2024-05-08T18:51:15.079688+0000","last_peered":"2024-05-08T18:51:15.079688+0000","last_clean":"2024-05-08T18:51:15.079688+0000","last_became_active":"2024-05-08T18:50:26.022938+0000","last_became_peered":"2024-05-08T18:50:26.022938+0000","last_unstale":"2024-05-08T18:51:15.079688+0000","last_undegraded":"2024-05-08T18:51:15.079688+0000","last_fullsized":"2024-05-08T18:51:15.079688+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:53.195171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073993+0000","last_change":"2024-05-08T18:50:30.029421+0000","last_active":"2024-05-08T18:51:15.073993+0000","last_peered":"2024-05-08T18:51:15.073993+0000","last_clean":"2024-05-08T18:51:15.073993+0000","last_became_active":"2024-05-08T18:50:30.029134+0000","last_became_peered":"2024-05-08T18:50:30.029134+0000","last_unstale":"2024-05-08T18:51:15.073993+0000","last_undegraded":"2024-05-08T18:51:15.073993+0000","last_fullsized":"2024-05-08T18:51:15.073993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:46.684447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"27'37","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.790970+0000","last_change":"2024-05-08T18:50:32.035457+0000","last_active":"2024-05-08T18:52:32.790970+0000","last_peered":"2024-05-08T18:52:32.790970+0000","last_clean":"2024-05-08T18:52:32.790970+0000","last_became_active":"2024-05-08T18:50:32.035189+0000","last_became_peered":"2024-05-08T18:50:32.035189+0000","last_unstale":"2024-05-08T18:52:32.790970+0000","last_undegraded":"2024-05-08T18:52:32.790970+0000","last_fullsized":"2024-05-08T18:52:32.790970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:02.364503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"27'282","reported_seq":354,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111702+0000","last_change":"2024-05-08T18:50:34.048274+0000","last_active":"2024-05-08T18:53:35.111702+0000","last_peered":"2024-05-08T18:53:35.111702+0000","last_clean":"2024-05-08T18:53:35.111702+0000","last_became_active":"2024-05-08T18:50:34.047999+0000","last_became_peered":"2024-05-08T18:50:34.047999+0000","last_unstale":"2024-05-08T18:53:35.111702+0000","last_undegraded":"2024-05-08T18:53:35.111702+0000","last_fullsized":"2024-05-08T18:53:35.111702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:36.744889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073643+0000","last_change":"2024-05-08T18:50:36.048278+0000","last_active":"2024-05-08T18:51:15.073643+0000","last_peered":"2024-05-08T18:51:15.073643+0000","last_clean":"2024-05-08T18:51:15.073643+0000","last_became_active":"2024-05-08T18:50:36.047981+0000","last_became_peered":"2024-05-08T18:50:36.047981+0000","last_unstale":"2024-05-08T18:51:15.073643+0000","last_undegraded":"2024-05-08T18:51:15.073643+0000","last_fullsized":"2024-05-08T18:51:15.073643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:39.176315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"27'8","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.474560+0000","last_change":"2024-05-08T18:50:28.020443+0000","last_active":"2024-05-08T18:51:50.474560+0000","last_peered":"2024-05-08T18:51:50.474560+0000","last_clean":"2024-05-08T18:51:50.474560+0000","last_became_active":"2024-05-08T18:50:28.020004+0000","last_became_peered":"2024-05-08T18:50:28.020004+0000","last_unstale":"2024-05-08T18:51:50.474560+0000","last_undegraded":"2024-05-08T18:51:50.474560+0000","last_fullsized":"2024-05-08T18:51:50.474560+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:26.670671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079070+0000","last_change":"2024-05-08T18:50:26.017413+0000","last_active":"2024-05-08T18:51:15.079070+0000","last_peered":"2024-05-08T18:51:15.079070+0000","last_clean":"2024-05-08T18:51:15.079070+0000","last_became_active":"2024-05-08T18:50:26.015955+0000","last_became_peered":"2024-05-08T18:50:26.015955+0000","last_unstale":"2024-05-08T18:51:15.079070+0000","last_undegraded":"2024-05-08T18:51:15.079070+0000","last_fullsized":"2024-05-08T18:51:15.079070+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:59.585275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073289+0000","last_change":"2024-05-08T18:50:30.030443+0000","last_active":"2024-05-08T18:51:15.073289+0000","last_peered":"2024-05-08T18:51:15.073289+0000","last_clean":"2024-05-08T18:51:15.073289+0000","last_became_active":"2024-05-08T18:50:30.030140+0000","last_became_peered":"2024-05-08T18:50:30.030140+0000","last_unstale":"2024-05-08T18:51:15.073289+0000","last_undegraded":"2024-05-08T18:51:15.073289+0000","last_fullsized":"2024-05-08T18:51:15.073289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:27.912865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"27'55","reported_seq":111,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.793380+0000","last_change":"2024-05-08T18:50:32.041420+0000","last_active":"2024-05-08T18:52:32.793380+0000","last_peered":"2024-05-08T18:52:32.793380+0000","last_clean":"2024-05-08T18:52:32.793380+0000","last_became_active":"2024-05-08T18:50:32.040633+0000","last_became_peered":"2024-05-08T18:50:32.040633+0000","last_unstale":"2024-05-08T18:52:32.793380+0000","last_undegraded":"2024-05-08T18:52:32.793380+0000","last_fullsized":"2024-05-08T18:52:32.793380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.162116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072394+0000","last_change":"2024-05-08T18:50:34.044110+0000","last_active":"2024-05-08T18:51:15.072394+0000","last_peered":"2024-05-08T18:51:15.072394+0000","last_clean":"2024-05-08T18:51:15.072394+0000","last_became_active":"2024-05-08T18:50:34.043817+0000","last_became_peered":"2024-05-08T18:50:34.043817+0000","last_unstale":"2024-05-08T18:51:15.072394+0000","last_undegraded":"2024-05-08T18:51:15.072394+0000","last_fullsized":"2024-05-08T18:51:15.072394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:52.535624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"27'18","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.978577+0000","last_change":"2024-05-08T18:50:36.054529+0000","last_active":"2024-05-08T18:53:34.978577+0000","last_peered":"2024-05-08T18:53:34.978577+0000","last_clean":"2024-05-08T18:53:34.978577+0000","last_became_active":"2024-05-08T18:50:36.054237+0000","last_became_peered":"2024-05-08T18:50:36.054237+0000","last_unstale":"2024-05-08T18:53:34.978577+0000","last_undegraded":"2024-05-08T18:53:34.978577+0000","last_fullsized":"2024-05-08T18:53:34.978577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:06.378701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"27'10","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.862996+0000","last_change":"2024-05-08T18:51:15.097690+0000","last_active":"2024-05-08T18:53:34.862996+0000","last_peered":"2024-05-08T18:53:34.862996+0000","last_clean":"2024-05-08T18:53:34.862996+0000","last_became_active":"2024-05-08T18:51:15.085560+0000","last_became_peered":"2024-05-08T18:51:15.085560+0000","last_unstale":"2024-05-08T18:53:34.862996+0000","last_undegraded":"2024-05-08T18:53:34.862996+0000","last_fullsized":"2024-05-08T18:53:34.862996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:42.900712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.080760+0000","last_change":"2024-05-08T18:51:15.080314+0000","last_active":"2024-05-08T18:51:15.080760+0000","last_peered":"2024-05-08T18:51:15.080760+0000","last_clean":"2024-05-08T18:51:15.080760+0000","last_became_active":"2024-05-08T18:51:15.080071+0000","last_became_peered":"2024-05-08T18:51:15.080071+0000","last_unstale":"2024-05-08T18:51:15.080760+0000","last_undegraded":"2024-05-08T18:51:15.080760+0000","last_fullsized":"2024-05-08T18:51:15.080760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:41.372462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075379+0000","last_change":"2024-05-08T18:50:30.033626+0000","last_active":"2024-05-08T18:51:15.075379+0000","last_peered":"2024-05-08T18:51:15.075379+0000","last_clean":"2024-05-08T18:51:15.075379+0000","last_became_active":"2024-05-08T18:50:30.033318+0000","last_became_peered":"2024-05-08T18:50:30.033318+0000","last_unstale":"2024-05-08T18:51:15.075379+0000","last_undegraded":"2024-05-08T18:51:15.075379+0000","last_fullsized":"2024-05-08T18:51:15.075379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:25.936937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"27'33","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007320+0000","last_change":"2024-05-08T18:50:32.035227+0000","last_active":"2024-05-08T18:52:48.007320+0000","last_peered":"2024-05-08T18:52:48.007320+0000","last_clean":"2024-05-08T18:52:48.007320+0000","last_became_active":"2024-05-08T18:50:32.034914+0000","last_became_peered":"2024-05-08T18:50:32.034914+0000","last_unstale":"2024-05-08T18:52:48.007320+0000","last_undegraded":"2024-05-08T18:52:48.007320+0000","last_fullsized":"2024-05-08T18:52:48.007320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:42:57.344797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.082244+0000","last_change":"2024-05-08T18:50:34.047372+0000","last_active":"2024-05-08T18:51:15.082244+0000","last_peered":"2024-05-08T18:51:15.082244+0000","last_clean":"2024-05-08T18:51:15.082244+0000","last_became_active":"2024-05-08T18:50:34.047075+0000","last_became_peered":"2024-05-08T18:50:34.047075+0000","last_unstale":"2024-05-08T18:51:15.082244+0000","last_undegraded":"2024-05-08T18:51:15.082244+0000","last_fullsized":"2024-05-08T18:51:15.082244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:39.931353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"27'3","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.005911+0000","last_change":"2024-05-08T18:50:36.055688+0000","last_active":"2024-05-08T18:52:38.005911+0000","last_peered":"2024-05-08T18:52:38.005911+0000","last_clean":"2024-05-08T18:52:38.005911+0000","last_became_active":"2024-05-08T18:50:36.055385+0000","last_became_peered":"2024-05-08T18:50:36.055385+0000","last_unstale":"2024-05-08T18:52:38.005911+0000","last_undegraded":"2024-05-08T18:52:38.005911+0000","last_fullsized":"2024-05-08T18:52:38.005911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:06.579528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'4","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.243668+0000","last_change":"2024-05-08T18:50:28.039067+0000","last_active":"2024-05-08T18:52:34.243668+0000","last_peered":"2024-05-08T18:52:34.243668+0000","last_clean":"2024-05-08T18:52:34.243668+0000","last_became_active":"2024-05-08T18:50:28.038633+0000","last_became_peered":"2024-05-08T18:50:28.038633+0000","last_unstale":"2024-05-08T18:52:34.243668+0000","last_undegraded":"2024-05-08T18:52:34.243668+0000","last_fullsized":"2024-05-08T18:52:34.243668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:06.211199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077754+0000","last_change":"2024-05-08T18:50:26.016599+0000","last_active":"2024-05-08T18:51:15.077754+0000","last_peered":"2024-05-08T18:51:15.077754+0000","last_clean":"2024-05-08T18:51:15.077754+0000","last_became_active":"2024-05-08T18:50:26.016308+0000","last_became_peered":"2024-05-08T18:50:26.016308+0000","last_unstale":"2024-05-08T18:51:15.077754+0000","last_undegraded":"2024-05-08T18:51:15.077754+0000","last_fullsized":"2024-05-08T18:51:15.077754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:04.583010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074792+0000","last_change":"2024-05-08T18:50:30.032199+0000","last_active":"2024-05-08T18:51:15.074792+0000","last_peered":"2024-05-08T18:51:15.074792+0000","last_clean":"2024-05-08T18:51:15.074792+0000","last_became_active":"2024-05-08T18:50:30.031765+0000","last_became_peered":"2024-05-08T18:50:30.031765+0000","last_unstale":"2024-05-08T18:51:15.074792+0000","last_undegraded":"2024-05-08T18:51:15.074792+0000","last_fullsized":"2024-05-08T18:51:15.074792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:33:42.159316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"27'36","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.800005+0000","last_change":"2024-05-08T18:50:32.035413+0000","last_active":"2024-05-08T18:52:32.800005+0000","last_peered":"2024-05-08T18:52:32.800005+0000","last_clean":"2024-05-08T18:52:32.800005+0000","last_became_active":"2024-05-08T18:50:32.035131+0000","last_became_peered":"2024-05-08T18:50:32.035131+0000","last_unstale":"2024-05-08T18:52:32.800005+0000","last_undegraded":"2024-05-08T18:52:32.800005+0000","last_fullsized":"2024-05-08T18:52:32.800005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:01:11.472580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"27'282","reported_seq":430,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111592+0000","last_change":"2024-05-08T18:50:34.047467+0000","last_active":"2024-05-08T18:53:35.111592+0000","last_peered":"2024-05-08T18:53:35.111592+0000","last_clean":"2024-05-08T18:53:35.111592+0000","last_became_active":"2024-05-08T18:50:34.047184+0000","last_became_peered":"2024-05-08T18:50:34.047184+0000","last_unstale":"2024-05-08T18:53:35.111592+0000","last_undegraded":"2024-05-08T18:53:35.111592+0000","last_fullsized":"2024-05-08T18:53:35.111592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:17.134805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"27'12","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.001806+0000","last_change":"2024-05-08T18:50:36.046523+0000","last_active":"2024-05-08T18:52:43.001806+0000","last_peered":"2024-05-08T18:52:43.001806+0000","last_clean":"2024-05-08T18:52:43.001806+0000","last_became_active":"2024-05-08T18:50:36.046209+0000","last_became_peered":"2024-05-08T18:50:36.046209+0000","last_unstale":"2024-05-08T18:52:43.001806+0000","last_undegraded":"2024-05-08T18:52:43.001806+0000","last_fullsized":"2024-05-08T18:52:43.001806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:18.424066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'6","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.661317+0000","last_change":"2024-05-08T18:50:28.037293+0000","last_active":"2024-05-08T18:51:50.661317+0000","last_peered":"2024-05-08T18:51:50.661317+0000","last_clean":"2024-05-08T18:51:50.661317+0000","last_became_active":"2024-05-08T18:50:28.036946+0000","last_became_peered":"2024-05-08T18:50:28.036946+0000","last_unstale":"2024-05-08T18:51:50.661317+0000","last_undegraded":"2024-05-08T18:51:50.661317+0000","last_fullsized":"2024-05-08T18:51:50.661317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:01.592206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076372+0000","last_change":"2024-05-08T18:50:26.027911+0000","last_active":"2024-05-08T18:51:15.076372+0000","last_peered":"2024-05-08T18:51:15.076372+0000","last_clean":"2024-05-08T18:51:15.076372+0000","last_became_active":"2024-05-08T18:50:26.027657+0000","last_became_peered":"2024-05-08T18:50:26.027657+0000","last_unstale":"2024-05-08T18:51:15.076372+0000","last_undegraded":"2024-05-08T18:51:15.076372+0000","last_fullsized":"2024-05-08T18:51:15.076372+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:36.094238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"27'3","reported_seq":413,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.890204+0000","last_change":"2024-05-08T18:50:30.027736+0000","last_active":"2024-05-08T18:52:33.890204+0000","last_peered":"2024-05-08T18:52:33.890204+0000","last_clean":"2024-05-08T18:52:33.890204+0000","last_became_active":"2024-05-08T18:50:30.027420+0000","last_became_peered":"2024-05-08T18:50:30.027420+0000","last_unstale":"2024-05-08T18:52:33.890204+0000","last_undegraded":"2024-05-08T18:52:33.890204+0000","last_fullsized":"2024-05-08T18:52:33.890204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:18.447327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'11","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007718+0000","last_change":"2024-05-08T18:50:32.041941+0000","last_active":"2024-05-08T18:52:48.007718+0000","last_peered":"2024-05-08T18:52:48.007718+0000","last_clean":"2024-05-08T18:52:48.007718+0000","last_became_active":"2024-05-08T18:50:32.040988+0000","last_became_peered":"2024-05-08T18:50:32.040988+0000","last_unstale":"2024-05-08T18:52:48.007718+0000","last_undegraded":"2024-05-08T18:52:48.007718+0000","last_fullsized":"2024-05-08T18:52:48.007718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:07.623019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"27'282","reported_seq":459,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111667+0000","last_change":"2024-05-08T18:50:34.040798+0000","last_active":"2024-05-08T18:53:35.111667+0000","last_peered":"2024-05-08T18:53:35.111667+0000","last_clean":"2024-05-08T18:53:35.111667+0000","last_became_active":"2024-05-08T18:50:34.040477+0000","last_became_peered":"2024-05-08T18:50:34.040477+0000","last_unstale":"2024-05-08T18:53:35.111667+0000","last_undegraded":"2024-05-08T18:53:35.111667+0000","last_fullsized":"2024-05-08T18:53:35.111667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:35.940316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.028319+0000","last_change":"2024-05-08T18:50:36.047258+0000","last_active":"2024-05-08T18:52:34.028319+0000","last_peered":"2024-05-08T18:52:34.028319+0000","last_clean":"2024-05-08T18:52:34.028319+0000","last_became_active":"2024-05-08T18:50:36.045976+0000","last_became_peered":"2024-05-08T18:50:36.045976+0000","last_unstale":"2024-05-08T18:52:34.028319+0000","last_undegraded":"2024-05-08T18:52:34.028319+0000","last_fullsized":"2024-05-08T18:52:34.028319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:00.262083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.823223+0000","last_change":"2024-05-08T18:50:28.039262+0000","last_active":"2024-05-08T18:53:34.823223+0000","last_peered":"2024-05-08T18:53:34.823223+0000","last_clean":"2024-05-08T18:53:34.823223+0000","last_became_active":"2024-05-08T18:50:28.038871+0000","last_became_peered":"2024-05-08T18:50:28.038871+0000","last_unstale":"2024-05-08T18:53:34.823223+0000","last_undegraded":"2024-05-08T18:53:34.823223+0000","last_fullsized":"2024-05-08T18:53:34.823223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:03.400002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073931+0000","last_change":"2024-05-08T18:50:26.025766+0000","last_active":"2024-05-08T18:51:15.073931+0000","last_peered":"2024-05-08T18:51:15.073931+0000","last_clean":"2024-05-08T18:51:15.073931+0000","last_became_active":"2024-05-08T18:50:26.025547+0000","last_became_peered":"2024-05-08T18:50:26.025547+0000","last_unstale":"2024-05-08T18:51:15.073931+0000","last_undegraded":"2024-05-08T18:51:15.073931+0000","last_fullsized":"2024-05-08T18:51:15.073931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:51:35.439520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079352+0000","last_change":"2024-05-08T18:50:30.036033+0000","last_active":"2024-05-08T18:51:15.079352+0000","last_peered":"2024-05-08T18:51:15.079352+0000","last_clean":"2024-05-08T18:51:15.079352+0000","last_became_active":"2024-05-08T18:50:30.035734+0000","last_became_peered":"2024-05-08T18:50:30.035734+0000","last_unstale":"2024-05-08T18:51:15.079352+0000","last_undegraded":"2024-05-08T18:51:15.079352+0000","last_fullsized":"2024-05-08T18:51:15.079352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:58.722929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"27'38","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.786197+0000","last_change":"2024-05-08T18:50:32.035183+0000","last_active":"2024-05-08T18:52:32.786197+0000","last_peered":"2024-05-08T18:52:32.786197+0000","last_clean":"2024-05-08T18:52:32.786197+0000","last_became_active":"2024-05-08T18:50:32.034769+0000","last_became_peered":"2024-05-08T18:50:32.034769+0000","last_unstale":"2024-05-08T18:52:32.786197+0000","last_undegraded":"2024-05-08T18:52:32.786197+0000","last_fullsized":"2024-05-08T18:52:32.786197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:53.194472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076855+0000","last_change":"2024-05-08T18:50:34.050327+0000","last_active":"2024-05-08T18:51:15.076855+0000","last_peered":"2024-05-08T18:51:15.076855+0000","last_clean":"2024-05-08T18:51:15.076855+0000","last_became_active":"2024-05-08T18:50:34.050018+0000","last_became_peered":"2024-05-08T18:50:34.050018+0000","last_unstale":"2024-05-08T18:51:15.076855+0000","last_undegraded":"2024-05-08T18:51:15.076855+0000","last_fullsized":"2024-05-08T18:51:15.076855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:38.228671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"27'8","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.918767+0000","last_change":"2024-05-08T18:50:36.049559+0000","last_active":"2024-05-08T18:53:34.918767+0000","last_peered":"2024-05-08T18:53:34.918767+0000","last_clean":"2024-05-08T18:53:34.918767+0000","last_became_active":"2024-05-08T18:50:36.049274+0000","last_became_peered":"2024-05-08T18:50:36.049274+0000","last_unstale":"2024-05-08T18:53:34.918767+0000","last_undegraded":"2024-05-08T18:53:34.918767+0000","last_fullsized":"2024-05-08T18:53:34.918767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:35.422216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'8","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887656+0000","last_change":"2024-05-08T18:50:28.037991+0000","last_active":"2024-05-08T18:53:34.887656+0000","last_peered":"2024-05-08T18:53:34.887656+0000","last_clean":"2024-05-08T18:53:34.887656+0000","last_became_active":"2024-05-08T18:50:28.037545+0000","last_became_peered":"2024-05-08T18:50:28.037545+0000","last_unstale":"2024-05-08T18:53:34.887656+0000","last_undegraded":"2024-05-08T18:53:34.887656+0000","last_fullsized":"2024-05-08T18:53:34.887656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:00.327493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":133,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073990+0000","last_change":"2024-05-08T18:50:19.740594+0000","last_active":"2024-05-08T18:51:15.073990+0000","last_peered":"2024-05-08T18:51:15.073990+0000","last_clean":"2024-05-08T18:51:15.073990+0000","last_became_active":"2024-05-08T18:50:19.739986+0000","last_became_peered":"2024-05-08T18:50:19.739986+0000","last_unstale":"2024-05-08T18:51:15.073990+0000","last_undegraded":"2024-05-08T18:51:15.073990+0000","last_fullsized":"2024-05-08T18:51:15.073990+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:57.647604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077812+0000","last_change":"2024-05-08T18:50:19.740266+0000","last_active":"2024-05-08T18:51:15.077812+0000","last_peered":"2024-05-08T18:51:15.077812+0000","last_clean":"2024-05-08T18:51:15.077812+0000","last_became_active":"2024-05-08T18:50:19.739403+0000","last_became_peered":"2024-05-08T18:50:19.739403+0000","last_unstale":"2024-05-08T18:51:15.077812+0000","last_undegraded":"2024-05-08T18:51:15.077812+0000","last_fullsized":"2024-05-08T18:51:15.077812+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:59:48.671095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076533+0000","last_change":"2024-05-08T18:50:26.026328+0000","last_active":"2024-05-08T18:51:15.076533+0000","last_peered":"2024-05-08T18:51:15.076533+0000","last_clean":"2024-05-08T18:51:15.076533+0000","last_became_active":"2024-05-08T18:50:26.024249+0000","last_became_peered":"2024-05-08T18:50:26.024249+0000","last_unstale":"2024-05-08T18:51:15.076533+0000","last_undegraded":"2024-05-08T18:51:15.076533+0000","last_fullsized":"2024-05-08T18:51:15.076533+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:04.180310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078700+0000","last_change":"2024-05-08T18:50:30.030654+0000","last_active":"2024-05-08T18:51:15.078700+0000","last_peered":"2024-05-08T18:51:15.078700+0000","last_clean":"2024-05-08T18:51:15.078700+0000","last_became_active":"2024-05-08T18:50:30.029744+0000","last_became_peered":"2024-05-08T18:50:30.029744+0000","last_unstale":"2024-05-08T18:51:15.078700+0000","last_undegraded":"2024-05-08T18:51:15.078700+0000","last_fullsized":"2024-05-08T18:51:15.078700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:45.741064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"27'76","reported_seq":145,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.797996+0000","last_change":"2024-05-08T18:50:32.043836+0000","last_active":"2024-05-08T18:52:32.797996+0000","last_peered":"2024-05-08T18:52:32.797996+0000","last_clean":"2024-05-08T18:52:32.797996+0000","last_became_active":"2024-05-08T18:50:32.043533+0000","last_became_peered":"2024-05-08T18:50:32.043533+0000","last_unstale":"2024-05-08T18:52:32.797996+0000","last_undegraded":"2024-05-08T18:52:32.797996+0000","last_fullsized":"2024-05-08T18:52:32.797996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:19.800626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074939+0000","last_change":"2024-05-08T18:50:34.049133+0000","last_active":"2024-05-08T18:51:15.074939+0000","last_peered":"2024-05-08T18:51:15.074939+0000","last_clean":"2024-05-08T18:51:15.074939+0000","last_became_active":"2024-05-08T18:50:34.048859+0000","last_became_peered":"2024-05-08T18:50:34.048859+0000","last_unstale":"2024-05-08T18:51:15.074939+0000","last_undegraded":"2024-05-08T18:51:15.074939+0000","last_fullsized":"2024-05-08T18:51:15.074939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:08:07.162123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"27'81","reported_seq":162,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.897033+0000","last_change":"2024-05-08T18:50:36.045215+0000","last_active":"2024-05-08T18:53:34.897033+0000","last_peered":"2024-05-08T18:53:34.897033+0000","last_clean":"2024-05-08T18:53:34.897033+0000","last_became_active":"2024-05-08T18:50:36.044928+0000","last_became_peered":"2024-05-08T18:50:36.044928+0000","last_unstale":"2024-05-08T18:53:34.897033+0000","last_undegraded":"2024-05-08T18:53:34.897033+0000","last_fullsized":"2024-05-08T18:53:34.897033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:21.101455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"27'4","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.475111+0000","last_change":"2024-05-08T18:50:28.032137+0000","last_active":"2024-05-08T18:51:50.475111+0000","last_peered":"2024-05-08T18:51:50.475111+0000","last_clean":"2024-05-08T18:51:50.475111+0000","last_became_active":"2024-05-08T18:50:28.030761+0000","last_became_peered":"2024-05-08T18:50:28.030761+0000","last_unstale":"2024-05-08T18:51:50.475111+0000","last_undegraded":"2024-05-08T18:51:50.475111+0000","last_fullsized":"2024-05-08T18:51:50.475111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:32.207743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073767+0000","last_change":"2024-05-08T18:50:19.739194+0000","last_active":"2024-05-08T18:51:15.073767+0000","last_peered":"2024-05-08T18:51:15.073767+0000","last_clean":"2024-05-08T18:51:15.073767+0000","last_became_active":"2024-05-08T18:50:19.738872+0000","last_became_peered":"2024-05-08T18:50:19.738872+0000","last_unstale":"2024-05-08T18:51:15.073767+0000","last_undegraded":"2024-05-08T18:51:15.073767+0000","last_fullsized":"2024-05-08T18:51:15.073767+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:28:20.859312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072516+0000","last_change":"2024-05-08T18:50:26.024886+0000","last_active":"2024-05-08T18:51:15.072516+0000","last_peered":"2024-05-08T18:51:15.072516+0000","last_clean":"2024-05-08T18:51:15.072516+0000","last_became_active":"2024-05-08T18:50:26.024549+0000","last_became_peered":"2024-05-08T18:50:26.024549+0000","last_unstale":"2024-05-08T18:51:15.072516+0000","last_undegraded":"2024-05-08T18:51:15.072516+0000","last_fullsized":"2024-05-08T18:51:15.072516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:47.912064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.089720+0000","last_change":"2024-05-08T18:51:15.084930+0000","last_active":"2024-05-08T18:51:15.089720+0000","last_peered":"2024-05-08T18:51:15.089720+0000","last_clean":"2024-05-08T18:51:15.089720+0000","last_became_active":"2024-05-08T18:51:15.084599+0000","last_became_peered":"2024-05-08T18:51:15.084599+0000","last_unstale":"2024-05-08T18:51:15.089720+0000","last_undegraded":"2024-05-08T18:51:15.089720+0000","last_fullsized":"2024-05-08T18:51:15.089720+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:34.404707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"27'273","reported_seq":476,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111615+0000","last_change":"2024-05-08T18:50:32.044834+0000","last_active":"2024-05-08T18:53:35.111615+0000","last_peered":"2024-05-08T18:53:35.111615+0000","last_clean":"2024-05-08T18:53:35.111615+0000","last_became_active":"2024-05-08T18:50:32.044539+0000","last_became_peered":"2024-05-08T18:50:32.044539+0000","last_unstale":"2024-05-08T18:53:35.111615+0000","last_undegraded":"2024-05-08T18:53:35.111615+0000","last_fullsized":"2024-05-08T18:53:35.111615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:10.225343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077927+0000","last_change":"2024-05-08T18:50:34.044400+0000","last_active":"2024-05-08T18:51:15.077927+0000","last_peered":"2024-05-08T18:51:15.077927+0000","last_clean":"2024-05-08T18:51:15.077927+0000","last_became_active":"2024-05-08T18:50:34.043966+0000","last_became_peered":"2024-05-08T18:50:34.043966+0000","last_unstale":"2024-05-08T18:51:15.077927+0000","last_undegraded":"2024-05-08T18:51:15.077927+0000","last_fullsized":"2024-05-08T18:51:15.077927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:35.369229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"27'3","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.479087+0000","last_change":"2024-05-08T18:50:36.050905+0000","last_active":"2024-05-08T18:51:50.479087+0000","last_peered":"2024-05-08T18:51:50.479087+0000","last_clean":"2024-05-08T18:51:50.479087+0000","last_became_active":"2024-05-08T18:50:36.050573+0000","last_became_peered":"2024-05-08T18:50:36.050573+0000","last_unstale":"2024-05-08T18:51:50.479087+0000","last_undegraded":"2024-05-08T18:51:50.479087+0000","last_fullsized":"2024-05-08T18:51:50.479087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:54:56.963493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:31.121841+0000","last_change":"2024-05-08T18:50:28.027882+0000","last_active":"2024-05-08T18:52:31.121841+0000","last_peered":"2024-05-08T18:52:31.121841+0000","last_clean":"2024-05-08T18:52:31.121841+0000","last_became_active":"2024-05-08T18:50:28.027492+0000","last_became_peered":"2024-05-08T18:50:28.027492+0000","last_unstale":"2024-05-08T18:52:31.121841+0000","last_undegraded":"2024-05-08T18:52:31.121841+0000","last_fullsized":"2024-05-08T18:52:31.121841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:13.501403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074929+0000","last_change":"2024-05-08T18:50:19.739149+0000","last_active":"2024-05-08T18:51:15.074929+0000","last_peered":"2024-05-08T18:51:15.074929+0000","last_clean":"2024-05-08T18:51:15.074929+0000","last_became_active":"2024-05-08T18:50:19.738788+0000","last_became_peered":"2024-05-08T18:50:19.738788+0000","last_unstale":"2024-05-08T18:51:15.074929+0000","last_undegraded":"2024-05-08T18:51:15.074929+0000","last_fullsized":"2024-05-08T18:51:15.074929+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:29:46.772075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.071890+0000","last_change":"2024-05-08T18:50:26.029767+0000","last_active":"2024-05-08T18:51:15.071890+0000","last_peered":"2024-05-08T18:51:15.071890+0000","last_clean":"2024-05-08T18:51:15.071890+0000","last_became_active":"2024-05-08T18:50:26.029197+0000","last_became_peered":"2024-05-08T18:50:26.029197+0000","last_unstale":"2024-05-08T18:51:15.071890+0000","last_undegraded":"2024-05-08T18:51:15.071890+0000","last_fullsized":"2024-05-08T18:51:15.071890+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:59.917414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"18'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076801+0000","last_change":"2024-05-08T18:50:30.028419+0000","last_active":"2024-05-08T18:51:15.076801+0000","last_peered":"2024-05-08T18:51:15.076801+0000","last_clean":"2024-05-08T18:51:15.076801+0000","last_became_active":"2024-05-08T18:50:30.028028+0000","last_became_peered":"2024-05-08T18:50:30.028028+0000","last_unstale":"2024-05-08T18:51:15.076801+0000","last_undegraded":"2024-05-08T18:51:15.076801+0000","last_fullsized":"2024-05-08T18:51:15.076801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:34.893503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"27'16","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:30.110915+0000","last_change":"2024-05-08T18:50:32.036344+0000","last_active":"2024-05-08T18:53:30.110915+0000","last_peered":"2024-05-08T18:53:30.110915+0000","last_clean":"2024-05-08T18:53:30.110915+0000","last_became_active":"2024-05-08T18:50:32.036051+0000","last_became_peered":"2024-05-08T18:50:32.036051+0000","last_unstale":"2024-05-08T18:53:30.110915+0000","last_undegraded":"2024-05-08T18:53:30.110915+0000","last_fullsized":"2024-05-08T18:53:30.110915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:48.691605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073226+0000","last_change":"2024-05-08T18:50:34.045839+0000","last_active":"2024-05-08T18:51:15.073226+0000","last_peered":"2024-05-08T18:51:15.073226+0000","last_clean":"2024-05-08T18:51:15.073226+0000","last_became_active":"2024-05-08T18:50:34.045541+0000","last_became_peered":"2024-05-08T18:50:34.045541+0000","last_unstale":"2024-05-08T18:51:15.073226+0000","last_undegraded":"2024-05-08T18:51:15.073226+0000","last_fullsized":"2024-05-08T18:51:15.073226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:02.736870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077233+0000","last_change":"2024-05-08T18:50:36.058086+0000","last_active":"2024-05-08T18:51:15.077233+0000","last_peered":"2024-05-08T18:51:15.077233+0000","last_clean":"2024-05-08T18:51:15.077233+0000","last_became_active":"2024-05-08T18:50:36.057093+0000","last_became_peered":"2024-05-08T18:50:36.057093+0000","last_unstale":"2024-05-08T18:51:15.077233+0000","last_undegraded":"2024-05-08T18:51:15.077233+0000","last_fullsized":"2024-05-08T18:51:15.077233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:29:55.363199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'22","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887602+0000","last_change":"2024-05-08T18:50:28.026195+0000","last_active":"2024-05-08T18:53:34.887602+0000","last_peered":"2024-05-08T18:53:34.887602+0000","last_clean":"2024-05-08T18:53:34.887602+0000","last_became_active":"2024-05-08T18:50:28.025645+0000","last_became_peered":"2024-05-08T18:50:28.025645+0000","last_unstale":"2024-05-08T18:53:34.887602+0000","last_undegraded":"2024-05-08T18:53:34.887602+0000","last_fullsized":"2024-05-08T18:53:34.887602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:24.508392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076436+0000","last_change":"2024-05-08T18:50:19.739898+0000","last_active":"2024-05-08T18:51:15.076436+0000","last_peered":"2024-05-08T18:51:15.076436+0000","last_clean":"2024-05-08T18:51:15.076436+0000","last_became_active":"2024-05-08T18:50:19.739620+0000","last_became_peered":"2024-05-08T18:50:19.739620+0000","last_unstale":"2024-05-08T18:51:15.076436+0000","last_undegraded":"2024-05-08T18:51:15.076436+0000","last_fullsized":"2024-05-08T18:51:15.076436+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:58.286521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.651104+0000","last_change":"2024-05-08T18:50:26.023831+0000","last_active":"2024-05-08T18:51:50.651104+0000","last_peered":"2024-05-08T18:51:50.651104+0000","last_clean":"2024-05-08T18:51:50.651104+0000","last_became_active":"2024-05-08T18:50:26.023522+0000","last_became_peered":"2024-05-08T18:50:26.023522+0000","last_unstale":"2024-05-08T18:51:50.651104+0000","last_undegraded":"2024-05-08T18:51:50.651104+0000","last_fullsized":"2024-05-08T18:51:50.651104+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:07.271771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075093+0000","last_change":"2024-05-08T18:50:30.035182+0000","last_active":"2024-05-08T18:51:15.075093+0000","last_peered":"2024-05-08T18:51:15.075093+0000","last_clean":"2024-05-08T18:51:15.075093+0000","last_became_active":"2024-05-08T18:50:30.034806+0000","last_became_peered":"2024-05-08T18:50:30.034806+0000","last_unstale":"2024-05-08T18:51:15.075093+0000","last_undegraded":"2024-05-08T18:51:15.075093+0000","last_fullsized":"2024-05-08T18:51:15.075093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:21.995734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"27'13","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.256028+0000","last_change":"2024-05-08T18:50:32.042494+0000","last_active":"2024-05-08T18:53:34.256028+0000","last_peered":"2024-05-08T18:53:34.256028+0000","last_clean":"2024-05-08T18:53:34.256028+0000","last_became_active":"2024-05-08T18:50:32.042183+0000","last_became_peered":"2024-05-08T18:50:32.042183+0000","last_unstale":"2024-05-08T18:53:34.256028+0000","last_undegraded":"2024-05-08T18:53:34.256028+0000","last_fullsized":"2024-05-08T18:53:34.256028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:21.537487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.082328+0000","last_change":"2024-05-08T18:50:34.045641+0000","last_active":"2024-05-08T18:51:15.082328+0000","last_peered":"2024-05-08T18:51:15.082328+0000","last_clean":"2024-05-08T18:51:15.082328+0000","last_became_active":"2024-05-08T18:50:34.044358+0000","last_became_peered":"2024-05-08T18:50:34.044358+0000","last_unstale":"2024-05-08T18:51:15.082328+0000","last_undegraded":"2024-05-08T18:51:15.082328+0000","last_fullsized":"2024-05-08T18:51:15.082328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:30:35.167490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.008973+0000","last_change":"2024-05-08T18:50:36.058516+0000","last_active":"2024-05-08T18:52:34.008973+0000","last_peered":"2024-05-08T18:52:34.008973+0000","last_clean":"2024-05-08T18:52:34.008973+0000","last_became_active":"2024-05-08T18:50:36.058267+0000","last_became_peered":"2024-05-08T18:50:36.058267+0000","last_unstale":"2024-05-08T18:52:34.008973+0000","last_undegraded":"2024-05-08T18:52:34.008973+0000","last_fullsized":"2024-05-08T18:52:34.008973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:30.137484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'12","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.607240+0000","last_change":"2024-05-08T18:50:28.039245+0000","last_active":"2024-05-08T18:53:34.607240+0000","last_peered":"2024-05-08T18:53:34.607240+0000","last_clean":"2024-05-08T18:53:34.607240+0000","last_became_active":"2024-05-08T18:50:28.038935+0000","last_became_peered":"2024-05-08T18:50:28.038935+0000","last_unstale":"2024-05-08T18:53:34.607240+0000","last_undegraded":"2024-05-08T18:53:34.607240+0000","last_fullsized":"2024-05-08T18:53:34.607240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:44.968210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075852+0000","last_change":"2024-05-08T18:50:26.019026+0000","last_active":"2024-05-08T18:51:15.075852+0000","last_peered":"2024-05-08T18:51:15.075852+0000","last_clean":"2024-05-08T18:51:15.075852+0000","last_became_active":"2024-05-08T18:50:26.018739+0000","last_became_peered":"2024-05-08T18:50:26.018739+0000","last_unstale":"2024-05-08T18:51:15.075852+0000","last_undegraded":"2024-05-08T18:51:15.075852+0000","last_fullsized":"2024-05-08T18:51:15.075852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:13.215678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073107+0000","last_change":"2024-05-08T18:50:19.741144+0000","last_active":"2024-05-08T18:51:15.073107+0000","last_peered":"2024-05-08T18:51:15.073107+0000","last_clean":"2024-05-08T18:51:15.073107+0000","last_became_active":"2024-05-08T18:50:19.740835+0000","last_became_peered":"2024-05-08T18:50:19.740835+0000","last_unstale":"2024-05-08T18:51:15.073107+0000","last_undegraded":"2024-05-08T18:51:15.073107+0000","last_fullsized":"2024-05-08T18:51:15.073107+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:30.349801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"27'1","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:23.012864+0000","last_change":"2024-05-08T18:51:15.083500+0000","last_active":"2024-05-08T18:53:23.012864+0000","last_peered":"2024-05-08T18:53:23.012864+0000","last_clean":"2024-05-08T18:53:23.012864+0000","last_became_active":"2024-05-08T18:51:15.083141+0000","last_became_peered":"2024-05-08T18:51:15.083141+0000","last_unstale":"2024-05-08T18:53:23.012864+0000","last_undegraded":"2024-05-08T18:53:23.012864+0000","last_fullsized":"2024-05-08T18:53:23.012864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:11.583016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"27'61","reported_seq":120,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.000350+0000","last_change":"2024-05-08T18:50:32.042368+0000","last_active":"2024-05-08T18:52:33.000350+0000","last_peered":"2024-05-08T18:52:33.000350+0000","last_clean":"2024-05-08T18:52:33.000350+0000","last_became_active":"2024-05-08T18:50:32.042046+0000","last_became_peered":"2024-05-08T18:50:32.042046+0000","last_unstale":"2024-05-08T18:52:33.000350+0000","last_undegraded":"2024-05-08T18:52:33.000350+0000","last_fullsized":"2024-05-08T18:52:33.000350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:02.233245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076297+0000","last_change":"2024-05-08T18:50:34.044814+0000","last_active":"2024-05-08T18:51:15.076297+0000","last_peered":"2024-05-08T18:51:15.076297+0000","last_clean":"2024-05-08T18:51:15.076297+0000","last_became_active":"2024-05-08T18:50:34.044520+0000","last_became_peered":"2024-05-08T18:50:34.044520+0000","last_unstale":"2024-05-08T18:51:15.076297+0000","last_undegraded":"2024-05-08T18:51:15.076297+0000","last_fullsized":"2024-05-08T18:51:15.076297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:02.505892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.182379+0000","last_change":"2024-05-08T18:50:36.047417+0000","last_active":"2024-05-08T18:52:34.182379+0000","last_peered":"2024-05-08T18:52:34.182379+0000","last_clean":"2024-05-08T18:52:34.182379+0000","last_became_active":"2024-05-08T18:50:36.046757+0000","last_became_peered":"2024-05-08T18:50:36.046757+0000","last_unstale":"2024-05-08T18:52:34.182379+0000","last_undegraded":"2024-05-08T18:52:34.182379+0000","last_fullsized":"2024-05-08T18:52:34.182379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.465327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"27'10","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.823507+0000","last_change":"2024-05-08T18:51:15.095543+0000","last_active":"2024-05-08T18:53:34.823507+0000","last_peered":"2024-05-08T18:53:34.823507+0000","last_clean":"2024-05-08T18:53:34.823507+0000","last_became_active":"2024-05-08T18:51:15.084151+0000","last_became_peered":"2024-05-08T18:51:15.084151+0000","last_unstale":"2024-05-08T18:53:34.823507+0000","last_undegraded":"2024-05-08T18:53:34.823507+0000","last_fullsized":"2024-05-08T18:53:34.823507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:15.066531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074090+0000","last_change":"2024-05-08T18:50:26.025460+0000","last_active":"2024-05-08T18:51:15.074090+0000","last_peered":"2024-05-08T18:51:15.074090+0000","last_clean":"2024-05-08T18:51:15.074090+0000","last_became_active":"2024-05-08T18:50:26.024894+0000","last_became_peered":"2024-05-08T18:50:26.024894+0000","last_unstale":"2024-05-08T18:51:15.074090+0000","last_undegraded":"2024-05-08T18:51:15.074090+0000","last_fullsized":"2024-05-08T18:51:15.074090+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:40.472317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079603+0000","last_change":"2024-05-08T18:50:19.739473+0000","last_active":"2024-05-08T18:51:15.079603+0000","last_peered":"2024-05-08T18:51:15.079603+0000","last_clean":"2024-05-08T18:51:15.079603+0000","last_became_active":"2024-05-08T18:50:19.739124+0000","last_became_peered":"2024-05-08T18:50:19.739124+0000","last_unstale":"2024-05-08T18:51:15.079603+0000","last_undegraded":"2024-05-08T18:51:15.079603+0000","last_fullsized":"2024-05-08T18:51:15.079603+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:22.202213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076770+0000","last_change":"2024-05-08T18:50:30.033607+0000","last_active":"2024-05-08T18:51:15.076770+0000","last_peered":"2024-05-08T18:51:15.076770+0000","last_clean":"2024-05-08T18:51:15.076770+0000","last_became_active":"2024-05-08T18:50:30.032546+0000","last_became_peered":"2024-05-08T18:50:30.032546+0000","last_unstale":"2024-05-08T18:51:15.076770+0000","last_undegraded":"2024-05-08T18:51:15.076770+0000","last_fullsized":"2024-05-08T18:51:15.076770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:48.521683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"25'14","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076154+0000","last_change":"2024-05-08T18:50:32.040984+0000","last_active":"2024-05-08T18:51:15.076154+0000","last_peered":"2024-05-08T18:51:15.076154+0000","last_clean":"2024-05-08T18:51:15.076154+0000","last_became_active":"2024-05-08T18:50:32.040767+0000","last_became_peered":"2024-05-08T18:50:32.040767+0000","last_unstale":"2024-05-08T18:51:15.076154+0000","last_undegraded":"2024-05-08T18:51:15.076154+0000","last_fullsized":"2024-05-08T18:51:15.076154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:26.346126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"27'282","reported_seq":374,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111761+0000","last_change":"2024-05-08T18:50:34.043559+0000","last_active":"2024-05-08T18:53:35.111761+0000","last_peered":"2024-05-08T18:53:35.111761+0000","last_clean":"2024-05-08T18:53:35.111761+0000","last_became_active":"2024-05-08T18:50:34.043167+0000","last_became_peered":"2024-05-08T18:50:34.043167+0000","last_unstale":"2024-05-08T18:53:35.111761+0000","last_undegraded":"2024-05-08T18:53:35.111761+0000","last_fullsized":"2024-05-08T18:53:35.111761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:50.430816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.849637+0000","last_change":"2024-05-08T18:50:36.061014+0000","last_active":"2024-05-08T18:53:34.849637+0000","last_peered":"2024-05-08T18:53:34.849637+0000","last_clean":"2024-05-08T18:53:34.849637+0000","last_became_active":"2024-05-08T18:50:36.060727+0000","last_became_peered":"2024-05-08T18:50:36.060727+0000","last_unstale":"2024-05-08T18:53:34.849637+0000","last_undegraded":"2024-05-08T18:53:34.849637+0000","last_fullsized":"2024-05-08T18:53:34.849637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:01.420579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"27'22","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.690982+0000","last_change":"2024-05-08T18:51:15.092701+0000","last_active":"2024-05-08T18:53:34.690982+0000","last_peered":"2024-05-08T18:53:34.690982+0000","last_clean":"2024-05-08T18:53:34.690982+0000","last_became_active":"2024-05-08T18:51:15.083568+0000","last_became_peered":"2024-05-08T18:51:15.083568+0000","last_unstale":"2024-05-08T18:53:34.690982+0000","last_undegraded":"2024-05-08T18:53:34.690982+0000","last_fullsized":"2024-05-08T18:53:34.690982+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:43.282786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":68,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.883437+0000","last_change":"2024-05-08T18:50:26.016666+0000","last_active":"2024-05-08T18:53:34.883437+0000","last_peered":"2024-05-08T18:53:34.883437+0000","last_clean":"2024-05-08T18:53:34.883437+0000","last_became_active":"2024-05-08T18:50:26.016210+0000","last_became_peered":"2024-05-08T18:50:26.016210+0000","last_unstale":"2024-05-08T18:53:34.883437+0000","last_undegraded":"2024-05-08T18:53:34.883437+0000","last_fullsized":"2024-05-08T18:53:34.883437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:11.494472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074021+0000","last_change":"2024-05-08T18:50:19.740832+0000","last_active":"2024-05-08T18:51:15.074021+0000","last_peered":"2024-05-08T18:51:15.074021+0000","last_clean":"2024-05-08T18:51:15.074021+0000","last_became_active":"2024-05-08T18:50:19.740355+0000","last_became_peered":"2024-05-08T18:50:19.740355+0000","last_unstale":"2024-05-08T18:51:15.074021+0000","last_undegraded":"2024-05-08T18:51:15.074021+0000","last_fullsized":"2024-05-08T18:51:15.074021+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:57.647604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077142+0000","last_change":"2024-05-08T18:50:30.033678+0000","last_active":"2024-05-08T18:51:15.077142+0000","last_peered":"2024-05-08T18:51:15.077142+0000","last_clean":"2024-05-08T18:51:15.077142+0000","last_became_active":"2024-05-08T18:50:30.031351+0000","last_became_peered":"2024-05-08T18:50:30.031351+0000","last_unstale":"2024-05-08T18:51:15.077142+0000","last_undegraded":"2024-05-08T18:51:15.077142+0000","last_fullsized":"2024-05-08T18:51:15.077142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:08.066057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"25'10","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077487+0000","last_change":"2024-05-08T18:50:32.042333+0000","last_active":"2024-05-08T18:51:15.077487+0000","last_peered":"2024-05-08T18:51:15.077487+0000","last_clean":"2024-05-08T18:51:15.077487+0000","last_became_active":"2024-05-08T18:50:32.041231+0000","last_became_peered":"2024-05-08T18:50:32.041231+0000","last_unstale":"2024-05-08T18:51:15.077487+0000","last_undegraded":"2024-05-08T18:51:15.077487+0000","last_fullsized":"2024-05-08T18:51:15.077487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:21.403251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"27'282","reported_seq":389,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111732+0000","last_change":"2024-05-08T18:50:34.048062+0000","last_active":"2024-05-08T18:53:35.111732+0000","last_peered":"2024-05-08T18:53:35.111732+0000","last_clean":"2024-05-08T18:53:35.111732+0000","last_became_active":"2024-05-08T18:50:34.047608+0000","last_became_peered":"2024-05-08T18:50:34.047608+0000","last_unstale":"2024-05-08T18:53:35.111732+0000","last_undegraded":"2024-05-08T18:53:35.111732+0000","last_fullsized":"2024-05-08T18:53:35.111732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:50.430816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"25'5","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076053+0000","last_change":"2024-05-08T18:50:36.055086+0000","last_active":"2024-05-08T18:51:15.076053+0000","last_peered":"2024-05-08T18:51:15.076053+0000","last_clean":"2024-05-08T18:51:15.076053+0000","last_became_active":"2024-05-08T18:50:36.054747+0000","last_became_peered":"2024-05-08T18:50:36.054747+0000","last_unstale":"2024-05-08T18:51:15.076053+0000","last_undegraded":"2024-05-08T18:51:15.076053+0000","last_fullsized":"2024-05-08T18:51:15.076053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:23.094874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887634+0000","last_change":"2024-05-08T18:50:28.033530+0000","last_active":"2024-05-08T18:53:34.887634+0000","last_peered":"2024-05-08T18:53:34.887634+0000","last_clean":"2024-05-08T18:53:34.887634+0000","last_became_active":"2024-05-08T18:50:28.033163+0000","last_became_peered":"2024-05-08T18:50:28.033163+0000","last_unstale":"2024-05-08T18:53:34.887634+0000","last_undegraded":"2024-05-08T18:53:34.887634+0000","last_fullsized":"2024-05-08T18:53:34.887634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:06.589941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081490+0000","last_change":"2024-05-08T18:50:26.027003+0000","last_active":"2024-05-08T18:51:15.081490+0000","last_peered":"2024-05-08T18:51:15.081490+0000","last_clean":"2024-05-08T18:51:15.081490+0000","last_became_active":"2024-05-08T18:50:26.026719+0000","last_became_peered":"2024-05-08T18:50:26.026719+0000","last_unstale":"2024-05-08T18:51:15.081490+0000","last_undegraded":"2024-05-08T18:51:15.081490+0000","last_fullsized":"2024-05-08T18:51:15.081490+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:47.462940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.082412+0000","last_change":"2024-05-08T18:50:19.739345+0000","last_active":"2024-05-08T18:51:15.082412+0000","last_peered":"2024-05-08T18:51:15.082412+0000","last_clean":"2024-05-08T18:51:15.082412+0000","last_became_active":"2024-05-08T18:50:19.738971+0000","last_became_peered":"2024-05-08T18:50:19.738971+0000","last_unstale":"2024-05-08T18:51:15.082412+0000","last_undegraded":"2024-05-08T18:51:15.082412+0000","last_fullsized":"2024-05-08T18:51:15.082412+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:52:49.278410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075321+0000","last_change":"2024-05-08T18:50:30.033620+0000","last_active":"2024-05-08T18:51:15.075321+0000","last_peered":"2024-05-08T18:51:15.075321+0000","last_clean":"2024-05-08T18:51:15.075321+0000","last_became_active":"2024-05-08T18:50:30.032197+0000","last_became_peered":"2024-05-08T18:50:30.032197+0000","last_unstale":"2024-05-08T18:51:15.075321+0000","last_undegraded":"2024-05-08T18:51:15.075321+0000","last_fullsized":"2024-05-08T18:51:15.075321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:31.926375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"27'82","reported_seq":154,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.784016+0000","last_change":"2024-05-08T18:50:32.043393+0000","last_active":"2024-05-08T18:52:32.784016+0000","last_peered":"2024-05-08T18:52:32.784016+0000","last_clean":"2024-05-08T18:52:32.784016+0000","last_became_active":"2024-05-08T18:50:32.043109+0000","last_became_peered":"2024-05-08T18:50:32.043109+0000","last_unstale":"2024-05-08T18:52:32.784016+0000","last_undegraded":"2024-05-08T18:52:32.784016+0000","last_fullsized":"2024-05-08T18:52:32.784016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:05.292535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073040+0000","last_change":"2024-05-08T18:50:34.043856+0000","last_active":"2024-05-08T18:51:15.073040+0000","last_peered":"2024-05-08T18:51:15.073040+0000","last_clean":"2024-05-08T18:51:15.073040+0000","last_became_active":"2024-05-08T18:50:34.043495+0000","last_became_peered":"2024-05-08T18:50:34.043495+0000","last_unstale":"2024-05-08T18:51:15.073040+0000","last_undegraded":"2024-05-08T18:51:15.073040+0000","last_fullsized":"2024-05-08T18:51:15.073040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:35.940316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"25'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073950+0000","last_change":"2024-05-08T18:50:36.044755+0000","last_active":"2024-05-08T18:51:15.073950+0000","last_peered":"2024-05-08T18:51:15.073950+0000","last_clean":"2024-05-08T18:51:15.073950+0000","last_became_active":"2024-05-08T18:50:36.044491+0000","last_became_peered":"2024-05-08T18:50:36.044491+0000","last_unstale":"2024-05-08T18:51:15.073950+0000","last_undegraded":"2024-05-08T18:51:15.073950+0000","last_fullsized":"2024-05-08T18:51:15.073950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:26:24.798211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078569+0000","last_change":"2024-05-08T18:50:36.050995+0000","last_active":"2024-05-08T18:51:15.078569+0000","last_peered":"2024-05-08T18:51:15.078569+0000","last_clean":"2024-05-08T18:51:15.078569+0000","last_became_active":"2024-05-08T18:50:36.050722+0000","last_became_peered":"2024-05-08T18:50:36.050722+0000","last_unstale":"2024-05-08T18:51:15.078569+0000","last_undegraded":"2024-05-08T18:51:15.078569+0000","last_fullsized":"2024-05-08T18:51:15.078569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:14.087413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"27'9","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.868849+0000","last_change":"2024-05-08T18:50:28.033284+0000","last_active":"2024-05-08T18:53:34.868849+0000","last_peered":"2024-05-08T18:53:34.868849+0000","last_clean":"2024-05-08T18:53:34.868849+0000","last_became_active":"2024-05-08T18:50:28.033010+0000","last_became_peered":"2024-05-08T18:50:28.033010+0000","last_unstale":"2024-05-08T18:53:34.868849+0000","last_undegraded":"2024-05-08T18:53:34.868849+0000","last_fullsized":"2024-05-08T18:53:34.868849+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:06.187241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077875+0000","last_change":"2024-05-08T18:50:26.027008+0000","last_active":"2024-05-08T18:51:15.077875+0000","last_peered":"2024-05-08T18:51:15.077875+0000","last_clean":"2024-05-08T18:51:15.077875+0000","last_became_active":"2024-05-08T18:50:26.025828+0000","last_became_peered":"2024-05-08T18:50:26.025828+0000","last_unstale":"2024-05-08T18:51:15.077875+0000","last_undegraded":"2024-05-08T18:51:15.077875+0000","last_fullsized":"2024-05-08T18:51:15.077875+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:08:54.741439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.083669+0000","last_change":"2024-05-08T18:51:15.082912+0000","last_active":"2024-05-08T18:51:15.083669+0000","last_peered":"2024-05-08T18:51:15.083669+0000","last_clean":"2024-05-08T18:51:15.083669+0000","last_became_active":"2024-05-08T18:51:15.082590+0000","last_became_peered":"2024-05-08T18:51:15.082590+0000","last_unstale":"2024-05-08T18:51:15.083669+0000","last_undegraded":"2024-05-08T18:51:15.083669+0000","last_fullsized":"2024-05-08T18:51:15.083669+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:19.530329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"27'33","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.790036+0000","last_change":"2024-05-08T18:50:32.038887+0000","last_active":"2024-05-08T18:52:32.790036+0000","last_peered":"2024-05-08T18:52:32.790036+0000","last_clean":"2024-05-08T18:52:32.790036+0000","last_became_active":"2024-05-08T18:50:32.038591+0000","last_became_peered":"2024-05-08T18:50:32.038591+0000","last_unstale":"2024-05-08T18:52:32.790036+0000","last_undegraded":"2024-05-08T18:52:32.790036+0000","last_fullsized":"2024-05-08T18:52:32.790036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:52.451129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075130+0000","last_change":"2024-05-08T18:50:34.051041+0000","last_active":"2024-05-08T18:51:15.075130+0000","last_peered":"2024-05-08T18:51:15.075130+0000","last_clean":"2024-05-08T18:51:15.075130+0000","last_became_active":"2024-05-08T18:50:34.050749+0000","last_became_peered":"2024-05-08T18:50:34.050749+0000","last_unstale":"2024-05-08T18:51:15.075130+0000","last_undegraded":"2024-05-08T18:51:15.075130+0000","last_fullsized":"2024-05-08T18:51:15.075130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:34.776407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"27'15","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.692332+0000","last_change":"2024-05-08T18:50:36.054332+0000","last_active":"2024-05-08T18:53:34.692332+0000","last_peered":"2024-05-08T18:53:34.692332+0000","last_clean":"2024-05-08T18:53:34.692332+0000","last_became_active":"2024-05-08T18:50:36.054102+0000","last_became_peered":"2024-05-08T18:50:36.054102+0000","last_unstale":"2024-05-08T18:53:34.692332+0000","last_undegraded":"2024-05-08T18:53:34.692332+0000","last_fullsized":"2024-05-08T18:53:34.692332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:40.601584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"27'6","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.691151+0000","last_change":"2024-05-08T18:50:28.038986+0000","last_active":"2024-05-08T18:53:34.691151+0000","last_peered":"2024-05-08T18:53:34.691151+0000","last_clean":"2024-05-08T18:53:34.691151+0000","last_became_active":"2024-05-08T18:50:28.038587+0000","last_became_peered":"2024-05-08T18:50:28.038587+0000","last_unstale":"2024-05-08T18:53:34.691151+0000","last_undegraded":"2024-05-08T18:53:34.691151+0000","last_fullsized":"2024-05-08T18:53:34.691151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:55.994310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075642+0000","last_change":"2024-05-08T18:50:26.031798+0000","last_active":"2024-05-08T18:51:15.075642+0000","last_peered":"2024-05-08T18:51:15.075642+0000","last_clean":"2024-05-08T18:51:15.075642+0000","last_became_active":"2024-05-08T18:50:26.031509+0000","last_became_peered":"2024-05-08T18:50:26.031509+0000","last_unstale":"2024-05-08T18:51:15.075642+0000","last_undegraded":"2024-05-08T18:51:15.075642+0000","last_fullsized":"2024-05-08T18:51:15.075642+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:13:25.895646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.082399+0000","last_change":"2024-05-08T18:50:30.035310+0000","last_active":"2024-05-08T18:51:15.082399+0000","last_peered":"2024-05-08T18:51:15.082399+0000","last_clean":"2024-05-08T18:51:15.082399+0000","last_became_active":"2024-05-08T18:50:30.034178+0000","last_became_peered":"2024-05-08T18:50:30.034178+0000","last_unstale":"2024-05-08T18:51:15.082399+0000","last_undegraded":"2024-05-08T18:51:15.082399+0000","last_fullsized":"2024-05-08T18:51:15.082399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:07.748171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.260326+0000","last_change":"2024-05-08T18:50:32.036694+0000","last_active":"2024-05-08T18:53:34.260326+0000","last_peered":"2024-05-08T18:53:34.260326+0000","last_clean":"2024-05-08T18:53:34.260326+0000","last_became_active":"2024-05-08T18:50:32.036371+0000","last_became_peered":"2024-05-08T18:50:32.036371+0000","last_unstale":"2024-05-08T18:53:34.260326+0000","last_undegraded":"2024-05-08T18:53:34.260326+0000","last_fullsized":"2024-05-08T18:53:34.260326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:24:34.246835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076167+0000","last_change":"2024-05-08T18:50:34.049216+0000","last_active":"2024-05-08T18:51:15.076167+0000","last_peered":"2024-05-08T18:51:15.076167+0000","last_clean":"2024-05-08T18:51:15.076167+0000","last_became_active":"2024-05-08T18:50:34.048434+0000","last_became_peered":"2024-05-08T18:50:34.048434+0000","last_unstale":"2024-05-08T18:51:15.076167+0000","last_undegraded":"2024-05-08T18:51:15.076167+0000","last_fullsized":"2024-05-08T18:51:15.076167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:04.240028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"25'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073391+0000","last_change":"2024-05-08T18:50:36.047682+0000","last_active":"2024-05-08T18:51:15.073391+0000","last_peered":"2024-05-08T18:51:15.073391+0000","last_clean":"2024-05-08T18:51:15.073391+0000","last_became_active":"2024-05-08T18:50:36.047379+0000","last_became_peered":"2024-05-08T18:50:36.047379+0000","last_unstale":"2024-05-08T18:51:15.073391+0000","last_undegraded":"2024-05-08T18:51:15.073391+0000","last_fullsized":"2024-05-08T18:51:15.073391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:54:56.963493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"27'6","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887519+0000","last_change":"2024-05-08T18:50:28.022958+0000","last_active":"2024-05-08T18:53:34.887519+0000","last_peered":"2024-05-08T18:53:34.887519+0000","last_clean":"2024-05-08T18:53:34.887519+0000","last_became_active":"2024-05-08T18:50:28.022636+0000","last_became_peered":"2024-05-08T18:50:28.022636+0000","last_unstale":"2024-05-08T18:53:34.887519+0000","last_undegraded":"2024-05-08T18:53:34.887519+0000","last_fullsized":"2024-05-08T18:53:34.887519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:26.670671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075046+0000","last_change":"2024-05-08T18:50:26.031227+0000","last_active":"2024-05-08T18:51:15.075046+0000","last_peered":"2024-05-08T18:51:15.075046+0000","last_clean":"2024-05-08T18:51:15.075046+0000","last_became_active":"2024-05-08T18:50:26.030884+0000","last_became_peered":"2024-05-08T18:50:26.030884+0000","last_unstale":"2024-05-08T18:51:15.075046+0000","last_undegraded":"2024-05-08T18:51:15.075046+0000","last_fullsized":"2024-05-08T18:51:15.075046+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:37.913831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073198+0000","last_change":"2024-05-08T18:50:30.031104+0000","last_active":"2024-05-08T18:51:15.073198+0000","last_peered":"2024-05-08T18:51:15.073198+0000","last_clean":"2024-05-08T18:51:15.073198+0000","last_became_active":"2024-05-08T18:50:30.030773+0000","last_became_peered":"2024-05-08T18:50:30.030773+0000","last_unstale":"2024-05-08T18:51:15.073198+0000","last_undegraded":"2024-05-08T18:51:15.073198+0000","last_fullsized":"2024-05-08T18:51:15.073198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:44.977393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"27'40","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.315951+0000","last_change":"2024-05-08T18:50:32.032531+0000","last_active":"2024-05-08T18:53:34.315951+0000","last_peered":"2024-05-08T18:53:34.315951+0000","last_clean":"2024-05-08T18:53:34.315951+0000","last_became_active":"2024-05-08T18:50:32.032289+0000","last_became_peered":"2024-05-08T18:50:32.032289+0000","last_unstale":"2024-05-08T18:53:34.315951+0000","last_undegraded":"2024-05-08T18:53:34.315951+0000","last_fullsized":"2024-05-08T18:53:34.315951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:00.499108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073965+0000","last_change":"2024-05-08T18:50:34.043178+0000","last_active":"2024-05-08T18:51:15.073965+0000","last_peered":"2024-05-08T18:51:15.073965+0000","last_clean":"2024-05-08T18:51:15.073965+0000","last_became_active":"2024-05-08T18:50:34.042903+0000","last_became_peered":"2024-05-08T18:50:34.042903+0000","last_unstale":"2024-05-08T18:51:15.073965+0000","last_undegraded":"2024-05-08T18:51:15.073965+0000","last_fullsized":"2024-05-08T18:51:15.073965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:54.419559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077587+0000","last_change":"2024-05-08T18:50:36.056236+0000","last_active":"2024-05-08T18:51:15.077587+0000","last_peered":"2024-05-08T18:51:15.077587+0000","last_clean":"2024-05-08T18:51:15.077587+0000","last_became_active":"2024-05-08T18:50:36.055855+0000","last_became_peered":"2024-05-08T18:50:36.055855+0000","last_unstale":"2024-05-08T18:51:15.077587+0000","last_undegraded":"2024-05-08T18:51:15.077587+0000","last_fullsized":"2024-05-08T18:51:15.077587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:37.833469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"27'11","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007535+0000","last_change":"2024-05-08T18:50:28.035297+0000","last_active":"2024-05-08T18:52:48.007535+0000","last_peered":"2024-05-08T18:52:48.007535+0000","last_clean":"2024-05-08T18:52:48.007535+0000","last_became_active":"2024-05-08T18:50:28.034819+0000","last_became_peered":"2024-05-08T18:50:28.034819+0000","last_unstale":"2024-05-08T18:52:48.007535+0000","last_undegraded":"2024-05-08T18:52:48.007535+0000","last_fullsized":"2024-05-08T18:52:48.007535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:13:44.345322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081828+0000","last_change":"2024-05-08T18:50:26.029507+0000","last_active":"2024-05-08T18:51:15.081828+0000","last_peered":"2024-05-08T18:51:15.081828+0000","last_clean":"2024-05-08T18:51:15.081828+0000","last_became_active":"2024-05-08T18:50:26.029211+0000","last_became_peered":"2024-05-08T18:50:26.029211+0000","last_unstale":"2024-05-08T18:51:15.081828+0000","last_undegraded":"2024-05-08T18:51:15.081828+0000","last_fullsized":"2024-05-08T18:51:15.081828+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:08:13.942735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077144+0000","last_change":"2024-05-08T18:50:30.031830+0000","last_active":"2024-05-08T18:51:15.077144+0000","last_peered":"2024-05-08T18:51:15.077144+0000","last_clean":"2024-05-08T18:51:15.077144+0000","last_became_active":"2024-05-08T18:50:30.031588+0000","last_became_peered":"2024-05-08T18:50:30.031588+0000","last_unstale":"2024-05-08T18:51:15.077144+0000","last_undegraded":"2024-05-08T18:51:15.077144+0000","last_fullsized":"2024-05-08T18:51:15.077144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:50.405618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"27'30","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.775836+0000","last_change":"2024-05-08T18:50:32.035464+0000","last_active":"2024-05-08T18:52:32.775836+0000","last_peered":"2024-05-08T18:52:32.775836+0000","last_clean":"2024-05-08T18:52:32.775836+0000","last_became_active":"2024-05-08T18:50:32.035181+0000","last_became_peered":"2024-05-08T18:50:32.035181+0000","last_unstale":"2024-05-08T18:52:32.775836+0000","last_undegraded":"2024-05-08T18:52:32.775836+0000","last_fullsized":"2024-05-08T18:52:32.775836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:09.507174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078453+0000","last_change":"2024-05-08T18:50:34.042398+0000","last_active":"2024-05-08T18:51:15.078453+0000","last_peered":"2024-05-08T18:51:15.078453+0000","last_clean":"2024-05-08T18:51:15.078453+0000","last_became_active":"2024-05-08T18:50:34.039668+0000","last_became_peered":"2024-05-08T18:50:34.039668+0000","last_unstale":"2024-05-08T18:51:15.078453+0000","last_undegraded":"2024-05-08T18:51:15.078453+0000","last_fullsized":"2024-05-08T18:51:15.078453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:06.348421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.083199+0000","last_change":"2024-05-08T18:50:28.026330+0000","last_active":"2024-05-08T18:51:15.083199+0000","last_peered":"2024-05-08T18:51:15.083199+0000","last_clean":"2024-05-08T18:51:15.083199+0000","last_became_active":"2024-05-08T18:50:28.025862+0000","last_became_peered":"2024-05-08T18:50:28.025862+0000","last_unstale":"2024-05-08T18:51:15.083199+0000","last_undegraded":"2024-05-08T18:51:15.083199+0000","last_fullsized":"2024-05-08T18:51:15.083199+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:14.186696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074050+0000","last_change":"2024-05-08T18:50:26.023167+0000","last_active":"2024-05-08T18:51:15.074050+0000","last_peered":"2024-05-08T18:51:15.074050+0000","last_clean":"2024-05-08T18:51:15.074050+0000","last_became_active":"2024-05-08T18:50:26.022874+0000","last_became_peered":"2024-05-08T18:50:26.022874+0000","last_unstale":"2024-05-08T18:51:15.074050+0000","last_undegraded":"2024-05-08T18:51:15.074050+0000","last_fullsized":"2024-05-08T18:51:15.074050+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:06.231586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074887+0000","last_change":"2024-05-08T18:50:30.029972+0000","last_active":"2024-05-08T18:51:15.074887+0000","last_peered":"2024-05-08T18:51:15.074887+0000","last_clean":"2024-05-08T18:51:15.074887+0000","last_became_active":"2024-05-08T18:50:30.029570+0000","last_became_peered":"2024-05-08T18:50:30.029570+0000","last_unstale":"2024-05-08T18:51:15.074887+0000","last_undegraded":"2024-05-08T18:51:15.074887+0000","last_fullsized":"2024-05-08T18:51:15.074887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:16.505368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"27'56","reported_seq":112,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.796965+0000","last_change":"2024-05-08T18:50:32.039614+0000","last_active":"2024-05-08T18:52:32.796965+0000","last_peered":"2024-05-08T18:52:32.796965+0000","last_clean":"2024-05-08T18:52:32.796965+0000","last_became_active":"2024-05-08T18:50:32.039293+0000","last_became_peered":"2024-05-08T18:50:32.039293+0000","last_unstale":"2024-05-08T18:52:32.796965+0000","last_undegraded":"2024-05-08T18:52:32.796965+0000","last_fullsized":"2024-05-08T18:52:32.796965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:36.221887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078524+0000","last_change":"2024-05-08T18:50:34.047399+0000","last_active":"2024-05-08T18:51:15.078524+0000","last_peered":"2024-05-08T18:51:15.078524+0000","last_clean":"2024-05-08T18:51:15.078524+0000","last_became_active":"2024-05-08T18:50:34.047111+0000","last_became_peered":"2024-05-08T18:50:34.047111+0000","last_unstale":"2024-05-08T18:51:15.078524+0000","last_undegraded":"2024-05-08T18:51:15.078524+0000","last_fullsized":"2024-05-08T18:51:15.078524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:20.207624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"27'14","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.179268+0000","last_change":"2024-05-08T18:50:36.047518+0000","last_active":"2024-05-08T18:52:34.179268+0000","last_peered":"2024-05-08T18:52:34.179268+0000","last_clean":"2024-05-08T18:52:34.179268+0000","last_became_active":"2024-05-08T18:50:36.046834+0000","last_became_peered":"2024-05-08T18:50:36.046834+0000","last_unstale":"2024-05-08T18:52:34.179268+0000","last_undegraded":"2024-05-08T18:52:34.179268+0000","last_fullsized":"2024-05-08T18:52:34.179268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:30.137484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'6","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.690403+0000","last_change":"2024-05-08T18:50:28.023338+0000","last_active":"2024-05-08T18:53:34.690403+0000","last_peered":"2024-05-08T18:53:34.690403+0000","last_clean":"2024-05-08T18:53:34.690403+0000","last_became_active":"2024-05-08T18:50:28.023049+0000","last_became_peered":"2024-05-08T18:50:28.023049+0000","last_unstale":"2024-05-08T18:53:34.690403+0000","last_undegraded":"2024-05-08T18:53:34.690403+0000","last_fullsized":"2024-05-08T18:53:34.690403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:29:28.977842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.811771+0000","last_change":"2024-05-08T18:50:26.030145+0000","last_active":"2024-05-08T18:53:34.811771+0000","last_peered":"2024-05-08T18:53:34.811771+0000","last_clean":"2024-05-08T18:53:34.811771+0000","last_became_active":"2024-05-08T18:50:26.029008+0000","last_became_peered":"2024-05-08T18:50:26.029008+0000","last_unstale":"2024-05-08T18:53:34.811771+0000","last_undegraded":"2024-05-08T18:53:34.811771+0000","last_fullsized":"2024-05-08T18:53:34.811771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:47.912064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078862+0000","last_change":"2024-05-08T18:50:30.027158+0000","last_active":"2024-05-08T18:51:15.078862+0000","last_peered":"2024-05-08T18:51:15.078862+0000","last_clean":"2024-05-08T18:51:15.078862+0000","last_became_active":"2024-05-08T18:50:30.026853+0000","last_became_peered":"2024-05-08T18:50:30.026853+0000","last_unstale":"2024-05-08T18:51:15.078862+0000","last_undegraded":"2024-05-08T18:51:15.078862+0000","last_fullsized":"2024-05-08T18:51:15.078862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:25.865274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"27'36","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.776794+0000","last_change":"2024-05-08T18:50:32.041607+0000","last_active":"2024-05-08T18:52:32.776794+0000","last_peered":"2024-05-08T18:52:32.776794+0000","last_clean":"2024-05-08T18:52:32.776794+0000","last_became_active":"2024-05-08T18:50:32.041208+0000","last_became_peered":"2024-05-08T18:50:32.041208+0000","last_unstale":"2024-05-08T18:52:32.776794+0000","last_undegraded":"2024-05-08T18:52:32.776794+0000","last_fullsized":"2024-05-08T18:52:32.776794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:00.288699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081778+0000","last_change":"2024-05-08T18:50:34.049030+0000","last_active":"2024-05-08T18:51:15.081778+0000","last_peered":"2024-05-08T18:51:15.081778+0000","last_clean":"2024-05-08T18:51:15.081778+0000","last_became_active":"2024-05-08T18:50:34.048749+0000","last_became_peered":"2024-05-08T18:50:34.048749+0000","last_unstale":"2024-05-08T18:51:15.081778+0000","last_undegraded":"2024-05-08T18:51:15.081778+0000","last_fullsized":"2024-05-08T18:51:15.081778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:52.535624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076062+0000","last_change":"2024-05-08T18:50:36.057323+0000","last_active":"2024-05-08T18:51:15.076062+0000","last_peered":"2024-05-08T18:51:15.076062+0000","last_clean":"2024-05-08T18:51:15.076062+0000","last_became_active":"2024-05-08T18:50:36.056960+0000","last_became_peered":"2024-05-08T18:50:36.056960+0000","last_unstale":"2024-05-08T18:51:15.076062+0000","last_undegraded":"2024-05-08T18:51:15.076062+0000","last_fullsized":"2024-05-08T18:51:15.076062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:33.422610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"27'8","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.243573+0000","last_change":"2024-05-08T18:50:28.038865+0000","last_active":"2024-05-08T18:52:34.243573+0000","last_peered":"2024-05-08T18:52:34.243573+0000","last_clean":"2024-05-08T18:52:34.243573+0000","last_became_active":"2024-05-08T18:50:28.038364+0000","last_became_peered":"2024-05-08T18:50:28.038364+0000","last_unstale":"2024-05-08T18:52:34.243573+0000","last_undegraded":"2024-05-08T18:52:34.243573+0000","last_fullsized":"2024-05-08T18:52:34.243573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:22.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.819164+0000","last_change":"2024-05-08T18:50:26.012760+0000","last_active":"2024-05-08T18:53:34.819164+0000","last_peered":"2024-05-08T18:53:34.819164+0000","last_clean":"2024-05-08T18:53:34.819164+0000","last_became_active":"2024-05-08T18:50:26.012506+0000","last_became_peered":"2024-05-08T18:50:26.012506+0000","last_unstale":"2024-05-08T18:53:34.819164+0000","last_undegraded":"2024-05-08T18:53:34.819164+0000","last_fullsized":"2024-05-08T18:53:34.819164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:13.215678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078388+0000","last_change":"2024-05-08T18:50:30.026843+0000","last_active":"2024-05-08T18:51:15.078388+0000","last_peered":"2024-05-08T18:51:15.078388+0000","last_clean":"2024-05-08T18:51:15.078388+0000","last_became_active":"2024-05-08T18:50:30.026445+0000","last_became_peered":"2024-05-08T18:50:30.026445+0000","last_unstale":"2024-05-08T18:51:15.078388+0000","last_undegraded":"2024-05-08T18:51:15.078388+0000","last_fullsized":"2024-05-08T18:51:15.078388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:57.129506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"27'32","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.794556+0000","last_change":"2024-05-08T18:50:32.041022+0000","last_active":"2024-05-08T18:52:32.794556+0000","last_peered":"2024-05-08T18:52:32.794556+0000","last_clean":"2024-05-08T18:52:32.794556+0000","last_became_active":"2024-05-08T18:50:32.040745+0000","last_became_peered":"2024-05-08T18:50:32.040745+0000","last_unstale":"2024-05-08T18:52:32.794556+0000","last_undegraded":"2024-05-08T18:52:32.794556+0000","last_fullsized":"2024-05-08T18:52:32.794556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:18.200841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073810+0000","last_change":"2024-05-08T18:50:34.047857+0000","last_active":"2024-05-08T18:51:15.073810+0000","last_peered":"2024-05-08T18:51:15.073810+0000","last_clean":"2024-05-08T18:51:15.073810+0000","last_became_active":"2024-05-08T18:50:34.047508+0000","last_became_peered":"2024-05-08T18:50:34.047508+0000","last_unstale":"2024-05-08T18:51:15.073810+0000","last_undegraded":"2024-05-08T18:51:15.073810+0000","last_fullsized":"2024-05-08T18:51:15.073810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:42:03.694060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"27'9","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.334554+0000","last_change":"2024-05-08T18:50:36.058170+0000","last_active":"2024-05-08T18:53:34.334554+0000","last_peered":"2024-05-08T18:53:34.334554+0000","last_clean":"2024-05-08T18:53:34.334554+0000","last_became_active":"2024-05-08T18:50:36.057863+0000","last_became_peered":"2024-05-08T18:50:36.057863+0000","last_unstale":"2024-05-08T18:53:34.334554+0000","last_undegraded":"2024-05-08T18:53:34.334554+0000","last_fullsized":"2024-05-08T18:53:34.334554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:47.312916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"25'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074376+0000","last_change":"2024-05-08T18:50:28.021697+0000","last_active":"2024-05-08T18:51:15.074376+0000","last_peered":"2024-05-08T18:51:15.074376+0000","last_clean":"2024-05-08T18:51:15.074376+0000","last_became_active":"2024-05-08T18:50:28.020441+0000","last_became_peered":"2024-05-08T18:50:28.020441+0000","last_unstale":"2024-05-08T18:51:15.074376+0000","last_undegraded":"2024-05-08T18:51:15.074376+0000","last_fullsized":"2024-05-08T18:51:15.074376+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:42.970406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"25'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077959+0000","last_change":"2024-05-08T18:50:26.025468+0000","last_active":"2024-05-08T18:51:15.077959+0000","last_peered":"2024-05-08T18:51:15.077959+0000","last_clean":"2024-05-08T18:51:15.077959+0000","last_became_active":"2024-05-08T18:50:26.024274+0000","last_became_peered":"2024-05-08T18:50:26.024274+0000","last_unstale":"2024-05-08T18:51:15.077959+0000","last_undegraded":"2024-05-08T18:51:15.077959+0000","last_fullsized":"2024-05-08T18:51:15.077959+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:27.236646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081882+0000","last_change":"2024-05-08T18:50:30.029259+0000","last_active":"2024-05-08T18:51:15.081882+0000","last_peered":"2024-05-08T18:51:15.081882+0000","last_clean":"2024-05-08T18:51:15.081882+0000","last_became_active":"2024-05-08T18:50:30.028877+0000","last_became_peered":"2024-05-08T18:50:30.028877+0000","last_unstale":"2024-05-08T18:51:15.081882+0000","last_undegraded":"2024-05-08T18:51:15.081882+0000","last_fullsized":"2024-05-08T18:51:15.081882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:57.176423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"25'10","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079404+0000","last_change":"2024-05-08T18:50:32.042114+0000","last_active":"2024-05-08T18:51:15.079404+0000","last_peered":"2024-05-08T18:51:15.079404+0000","last_clean":"2024-05-08T18:51:15.079404+0000","last_became_active":"2024-05-08T18:50:32.041539+0000","last_became_peered":"2024-05-08T18:50:32.041539+0000","last_unstale":"2024-05-08T18:51:15.079404+0000","last_undegraded":"2024-05-08T18:51:15.079404+0000","last_fullsized":"2024-05-08T18:51:15.079404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:42.799113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"27'282","reported_seq":406,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111598+0000","last_change":"2024-05-08T18:50:34.048713+0000","last_active":"2024-05-08T18:53:35.111598+0000","last_peered":"2024-05-08T18:53:35.111598+0000","last_clean":"2024-05-08T18:53:35.111598+0000","last_became_active":"2024-05-08T18:50:34.048421+0000","last_became_peered":"2024-05-08T18:50:34.048421+0000","last_unstale":"2024-05-08T18:53:35.111598+0000","last_undegraded":"2024-05-08T18:53:35.111598+0000","last_fullsized":"2024-05-08T18:53:35.111598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:31.497412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"27'6","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.940415+0000","last_change":"2024-05-08T18:50:36.055738+0000","last_active":"2024-05-08T18:53:34.940415+0000","last_peered":"2024-05-08T18:53:34.940415+0000","last_clean":"2024-05-08T18:53:34.940415+0000","last_became_active":"2024-05-08T18:50:36.055184+0000","last_became_peered":"2024-05-08T18:50:36.055184+0000","last_unstale":"2024-05-08T18:53:34.940415+0000","last_undegraded":"2024-05-08T18:53:34.940415+0000","last_fullsized":"2024-05-08T18:53:34.940415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:08:53.899906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.868347+0000","last_change":"2024-05-08T18:50:28.025621+0000","last_active":"2024-05-08T18:53:34.868347+0000","last_peered":"2024-05-08T18:53:34.868347+0000","last_clean":"2024-05-08T18:53:34.868347+0000","last_became_active":"2024-05-08T18:50:28.025313+0000","last_became_peered":"2024-05-08T18:50:28.025313+0000","last_unstale":"2024-05-08T18:53:34.868347+0000","last_undegraded":"2024-05-08T18:53:34.868347+0000","last_fullsized":"2024-05-08T18:53:34.868347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:55.202102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079286+0000","last_change":"2024-05-08T18:50:26.030334+0000","last_active":"2024-05-08T18:51:15.079286+0000","last_peered":"2024-05-08T18:51:15.079286+0000","last_clean":"2024-05-08T18:51:15.079286+0000","last_became_active":"2024-05-08T18:50:26.030058+0000","last_became_peered":"2024-05-08T18:50:26.030058+0000","last_unstale":"2024-05-08T18:51:15.079286+0000","last_undegraded":"2024-05-08T18:51:15.079286+0000","last_fullsized":"2024-05-08T18:51:15.079286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:40.472317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"18'1","reported_seq":218,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.890531+0000","last_change":"2024-05-08T18:50:30.024313+0000","last_active":"2024-05-08T18:52:33.890531+0000","last_peered":"2024-05-08T18:52:33.890531+0000","last_clean":"2024-05-08T18:52:33.890531+0000","last_became_active":"2024-05-08T18:50:30.024032+0000","last_became_peered":"2024-05-08T18:50:30.024032+0000","last_unstale":"2024-05-08T18:52:33.890531+0000","last_undegraded":"2024-05-08T18:52:33.890531+0000","last_fullsized":"2024-05-08T18:52:33.890531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:43.500296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"27'37","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.008888+0000","last_change":"2024-05-08T18:50:32.036101+0000","last_active":"2024-05-08T18:52:58.008888+0000","last_peered":"2024-05-08T18:52:58.008888+0000","last_clean":"2024-05-08T18:52:58.008888+0000","last_became_active":"2024-05-08T18:50:32.035792+0000","last_became_peered":"2024-05-08T18:50:32.035792+0000","last_unstale":"2024-05-08T18:52:58.008888+0000","last_undegraded":"2024-05-08T18:52:58.008888+0000","last_fullsized":"2024-05-08T18:52:58.008888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:06:52.558231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.071790+0000","last_change":"2024-05-08T18:50:34.045008+0000","last_active":"2024-05-08T18:51:15.071790+0000","last_peered":"2024-05-08T18:51:15.071790+0000","last_clean":"2024-05-08T18:51:15.071790+0000","last_became_active":"2024-05-08T18:50:34.044586+0000","last_became_peered":"2024-05-08T18:50:34.044586+0000","last_unstale":"2024-05-08T18:51:15.071790+0000","last_undegraded":"2024-05-08T18:51:15.071790+0000","last_fullsized":"2024-05-08T18:51:15.071790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:19.094040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"27'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.240649+0000","last_change":"2024-05-08T18:50:36.053212+0000","last_active":"2024-05-08T18:52:34.240649+0000","last_peered":"2024-05-08T18:52:34.240649+0000","last_clean":"2024-05-08T18:52:34.240649+0000","last_became_active":"2024-05-08T18:50:36.052885+0000","last_became_peered":"2024-05-08T18:50:36.052885+0000","last_unstale":"2024-05-08T18:52:34.240649+0000","last_undegraded":"2024-05-08T18:52:34.240649+0000","last_fullsized":"2024-05-08T18:52:34.240649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:18.424066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"27'28","reported_seq":114,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887556+0000","last_change":"2024-05-08T18:50:28.025900+0000","last_active":"2024-05-08T18:53:34.887556+0000","last_peered":"2024-05-08T18:53:34.887556+0000","last_clean":"2024-05-08T18:53:34.887556+0000","last_became_active":"2024-05-08T18:50:28.025162+0000","last_became_peered":"2024-05-08T18:50:28.025162+0000","last_unstale":"2024-05-08T18:53:34.887556+0000","last_undegraded":"2024-05-08T18:53:34.887556+0000","last_fullsized":"2024-05-08T18:53:34.887556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:38:05.876708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":112,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079886+0000","last_change":"2024-05-08T18:50:26.027367+0000","last_active":"2024-05-08T18:51:15.079886+0000","last_peered":"2024-05-08T18:51:15.079886+0000","last_clean":"2024-05-08T18:51:15.079886+0000","last_became_active":"2024-05-08T18:50:26.027067+0000","last_became_peered":"2024-05-08T18:50:26.027067+0000","last_unstale":"2024-05-08T18:51:15.079886+0000","last_undegraded":"2024-05-08T18:51:15.079886+0000","last_fullsized":"2024-05-08T18:51:15.079886+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:30.486245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078349+0000","last_change":"2024-05-08T18:50:30.034913+0000","last_active":"2024-05-08T18:51:15.078349+0000","last_peered":"2024-05-08T18:51:15.078349+0000","last_clean":"2024-05-08T18:51:15.078349+0000","last_became_active":"2024-05-08T18:50:30.034616+0000","last_became_peered":"2024-05-08T18:50:30.034616+0000","last_unstale":"2024-05-08T18:51:15.078349+0000","last_undegraded":"2024-05-08T18:51:15.078349+0000","last_fullsized":"2024-05-08T18:51:15.078349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:58.001297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"27'32","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.246102+0000","last_change":"2024-05-08T18:50:32.042047+0000","last_active":"2024-05-08T18:52:34.246102+0000","last_peered":"2024-05-08T18:52:34.246102+0000","last_clean":"2024-05-08T18:52:34.246102+0000","last_became_active":"2024-05-08T18:50:32.041806+0000","last_became_peered":"2024-05-08T18:50:32.041806+0000","last_unstale":"2024-05-08T18:52:34.246102+0000","last_undegraded":"2024-05-08T18:52:34.246102+0000","last_fullsized":"2024-05-08T18:52:34.246102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:20.454485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075987+0000","last_change":"2024-05-08T18:50:34.050795+0000","last_active":"2024-05-08T18:51:15.075987+0000","last_peered":"2024-05-08T18:51:15.075987+0000","last_clean":"2024-05-08T18:51:15.075987+0000","last_became_active":"2024-05-08T18:50:34.050445+0000","last_became_peered":"2024-05-08T18:50:34.050445+0000","last_unstale":"2024-05-08T18:51:15.075987+0000","last_undegraded":"2024-05-08T18:51:15.075987+0000","last_fullsized":"2024-05-08T18:51:15.075987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:03.912574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079231+0000","last_change":"2024-05-08T18:50:36.060634+0000","last_active":"2024-05-08T18:51:15.079231+0000","last_peered":"2024-05-08T18:51:15.079231+0000","last_clean":"2024-05-08T18:51:15.079231+0000","last_became_active":"2024-05-08T18:50:36.060318+0000","last_became_peered":"2024-05-08T18:50:36.060318+0000","last_unstale":"2024-05-08T18:51:15.079231+0000","last_undegraded":"2024-05-08T18:51:15.079231+0000","last_fullsized":"2024-05-08T18:51:15.079231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:22:59.024364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.823408+0000","last_change":"2024-05-08T18:50:28.029928+0000","last_active":"2024-05-08T18:53:34.823408+0000","last_peered":"2024-05-08T18:53:34.823408+0000","last_clean":"2024-05-08T18:53:34.823408+0000","last_became_active":"2024-05-08T18:50:28.029624+0000","last_became_peered":"2024-05-08T18:50:28.029624+0000","last_unstale":"2024-05-08T18:53:34.823408+0000","last_undegraded":"2024-05-08T18:53:34.823408+0000","last_fullsized":"2024-05-08T18:53:34.823408+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:41.493309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.589006+0000","last_change":"2024-05-08T18:50:26.029045+0000","last_active":"2024-05-08T18:53:34.589006+0000","last_peered":"2024-05-08T18:53:34.589006+0000","last_clean":"2024-05-08T18:53:34.589006+0000","last_became_active":"2024-05-08T18:50:26.028615+0000","last_became_peered":"2024-05-08T18:50:26.028615+0000","last_unstale":"2024-05-08T18:53:34.589006+0000","last_undegraded":"2024-05-08T18:53:34.589006+0000","last_fullsized":"2024-05-08T18:53:34.589006+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:52:05.955423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079116+0000","last_change":"2024-05-08T18:50:30.030595+0000","last_active":"2024-05-08T18:51:15.079116+0000","last_peered":"2024-05-08T18:51:15.079116+0000","last_clean":"2024-05-08T18:51:15.079116+0000","last_became_active":"2024-05-08T18:50:30.030295+0000","last_became_peered":"2024-05-08T18:50:30.030295+0000","last_unstale":"2024-05-08T18:51:15.079116+0000","last_undegraded":"2024-05-08T18:51:15.079116+0000","last_fullsized":"2024-05-08T18:51:15.079116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:39.211003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"27'26","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.792030+0000","last_change":"2024-05-08T18:50:32.040967+0000","last_active":"2024-05-08T18:52:32.792030+0000","last_peered":"2024-05-08T18:52:32.792030+0000","last_clean":"2024-05-08T18:52:32.792030+0000","last_became_active":"2024-05-08T18:50:32.040661+0000","last_became_peered":"2024-05-08T18:50:32.040661+0000","last_unstale":"2024-05-08T18:52:32.792030+0000","last_undegraded":"2024-05-08T18:52:32.792030+0000","last_fullsized":"2024-05-08T18:52:32.792030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:17.855961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076341+0000","last_change":"2024-05-08T18:50:34.045449+0000","last_active":"2024-05-08T18:51:15.076341+0000","last_peered":"2024-05-08T18:51:15.076341+0000","last_clean":"2024-05-08T18:51:15.076341+0000","last_became_active":"2024-05-08T18:50:34.045040+0000","last_became_peered":"2024-05-08T18:50:34.045040+0000","last_unstale":"2024-05-08T18:51:15.076341+0000","last_undegraded":"2024-05-08T18:51:15.076341+0000","last_fullsized":"2024-05-08T18:51:15.076341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:24.033430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.802348+0000","last_change":"2024-05-08T18:50:36.060675+0000","last_active":"2024-05-08T18:52:32.802348+0000","last_peered":"2024-05-08T18:52:32.802348+0000","last_clean":"2024-05-08T18:52:32.802348+0000","last_became_active":"2024-05-08T18:50:36.060382+0000","last_became_peered":"2024-05-08T18:50:36.060382+0000","last_unstale":"2024-05-08T18:52:32.802348+0000","last_undegraded":"2024-05-08T18:52:32.802348+0000","last_fullsized":"2024-05-08T18:52:32.802348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:13.860024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'11","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.612979+0000","last_change":"2024-05-08T18:50:28.020688+0000","last_active":"2024-05-08T18:53:34.612979+0000","last_peered":"2024-05-08T18:53:34.612979+0000","last_clean":"2024-05-08T18:53:34.612979+0000","last_became_active":"2024-05-08T18:50:28.020421+0000","last_became_peered":"2024-05-08T18:50:28.020421+0000","last_unstale":"2024-05-08T18:53:34.612979+0000","last_undegraded":"2024-05-08T18:53:34.612979+0000","last_fullsized":"2024-05-08T18:53:34.612979+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:38.101169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.814081+0000","last_change":"2024-05-08T18:50:26.012375+0000","last_active":"2024-05-08T18:53:34.814081+0000","last_peered":"2024-05-08T18:53:34.814081+0000","last_clean":"2024-05-08T18:53:34.814081+0000","last_became_active":"2024-05-08T18:50:26.011299+0000","last_became_peered":"2024-05-08T18:50:26.011299+0000","last_unstale":"2024-05-08T18:53:34.814081+0000","last_undegraded":"2024-05-08T18:53:34.814081+0000","last_fullsized":"2024-05-08T18:53:34.814081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:37.913831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"27'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:31.488124+0000","last_change":"2024-05-08T18:50:30.032861+0000","last_active":"2024-05-08T18:52:31.488124+0000","last_peered":"2024-05-08T18:52:31.488124+0000","last_clean":"2024-05-08T18:52:31.488124+0000","last_became_active":"2024-05-08T18:50:30.032578+0000","last_became_peered":"2024-05-08T18:50:30.032578+0000","last_unstale":"2024-05-08T18:52:31.488124+0000","last_undegraded":"2024-05-08T18:52:31.488124+0000","last_fullsized":"2024-05-08T18:52:31.488124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:01:09.465423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"27'33","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.276328+0000","last_change":"2024-05-08T18:50:32.042986+0000","last_active":"2024-05-08T18:53:34.276328+0000","last_peered":"2024-05-08T18:53:34.276328+0000","last_clean":"2024-05-08T18:53:34.276328+0000","last_became_active":"2024-05-08T18:50:32.042700+0000","last_became_peered":"2024-05-08T18:50:32.042700+0000","last_unstale":"2024-05-08T18:53:34.276328+0000","last_undegraded":"2024-05-08T18:53:34.276328+0000","last_fullsized":"2024-05-08T18:53:34.276328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:17.682080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072389+0000","last_change":"2024-05-08T18:50:34.045188+0000","last_active":"2024-05-08T18:51:15.072389+0000","last_peered":"2024-05-08T18:51:15.072389+0000","last_clean":"2024-05-08T18:51:15.072389+0000","last_became_active":"2024-05-08T18:50:34.044872+0000","last_became_peered":"2024-05-08T18:50:34.044872+0000","last_unstale":"2024-05-08T18:51:15.072389+0000","last_undegraded":"2024-05-08T18:51:15.072389+0000","last_fullsized":"2024-05-08T18:51:15.072389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:12.079998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.805125+0000","last_change":"2024-05-08T18:50:36.055685+0000","last_active":"2024-05-08T18:52:32.805125+0000","last_peered":"2024-05-08T18:52:32.805125+0000","last_clean":"2024-05-08T18:52:32.805125+0000","last_became_active":"2024-05-08T18:50:36.055188+0000","last_became_peered":"2024-05-08T18:50:36.055188+0000","last_unstale":"2024-05-08T18:52:32.805125+0000","last_undegraded":"2024-05-08T18:52:32.805125+0000","last_fullsized":"2024-05-08T18:52:32.805125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:29:30.352392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"27'12","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.613503+0000","last_change":"2024-05-08T18:50:28.039552+0000","last_active":"2024-05-08T18:53:34.613503+0000","last_peered":"2024-05-08T18:53:34.613503+0000","last_clean":"2024-05-08T18:53:34.613503+0000","last_became_active":"2024-05-08T18:50:28.039290+0000","last_became_peered":"2024-05-08T18:50:28.039290+0000","last_unstale":"2024-05-08T18:53:34.613503+0000","last_undegraded":"2024-05-08T18:53:34.613503+0000","last_fullsized":"2024-05-08T18:53:34.613503+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:14.876681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"27'3","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.465227+0000","last_change":"2024-05-08T18:50:26.019000+0000","last_active":"2024-05-08T18:51:50.465227+0000","last_peered":"2024-05-08T18:51:50.465227+0000","last_clean":"2024-05-08T18:51:50.465227+0000","last_became_active":"2024-05-08T18:50:26.018713+0000","last_became_peered":"2024-05-08T18:50:26.018713+0000","last_unstale":"2024-05-08T18:51:50.465227+0000","last_undegraded":"2024-05-08T18:51:50.465227+0000","last_fullsized":"2024-05-08T18:51:50.465227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:00:06.975161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"27'5","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.001130+0000","last_change":"2024-05-08T18:50:28.026675+0000","last_active":"2024-05-08T18:52:38.001130+0000","last_peered":"2024-05-08T18:52:38.001130+0000","last_clean":"2024-05-08T18:52:38.001130+0000","last_became_active":"2024-05-08T18:50:28.026292+0000","last_became_peered":"2024-05-08T18:50:28.026292+0000","last_unstale":"2024-05-08T18:52:38.001130+0000","last_undegraded":"2024-05-08T18:52:38.001130+0000","last_fullsized":"2024-05-08T18:52:38.001130+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:07.047413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072010+0000","last_change":"2024-05-08T18:50:26.013052+0000","last_active":"2024-05-08T18:51:15.072010+0000","last_peered":"2024-05-08T18:51:15.072010+0000","last_clean":"2024-05-08T18:51:15.072010+0000","last_became_active":"2024-05-08T18:50:26.012760+0000","last_became_peered":"2024-05-08T18:50:26.012760+0000","last_unstale":"2024-05-08T18:51:15.072010+0000","last_undegraded":"2024-05-08T18:51:15.072010+0000","last_fullsized":"2024-05-08T18:51:15.072010+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:13.215678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'4","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.605684+0000","last_change":"2024-05-08T18:50:28.039172+0000","last_active":"2024-05-08T18:53:34.605684+0000","last_peered":"2024-05-08T18:53:34.605684+0000","last_clean":"2024-05-08T18:53:34.605684+0000","last_became_active":"2024-05-08T18:50:28.038785+0000","last_became_peered":"2024-05-08T18:50:28.038785+0000","last_unstale":"2024-05-08T18:53:34.605684+0000","last_undegraded":"2024-05-08T18:53:34.605684+0000","last_fullsized":"2024-05-08T18:53:34.605684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:11.113877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077113+0000","last_change":"2024-05-08T18:50:26.026716+0000","last_active":"2024-05-08T18:51:15.077113+0000","last_peered":"2024-05-08T18:51:15.077113+0000","last_clean":"2024-05-08T18:51:15.077113+0000","last_became_active":"2024-05-08T18:50:26.025958+0000","last_became_peered":"2024-05-08T18:50:26.025958+0000","last_unstale":"2024-05-08T18:51:15.077113+0000","last_undegraded":"2024-05-08T18:51:15.077113+0000","last_fullsized":"2024-05-08T18:51:15.077113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:53:26.336839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.861403+0000","last_change":"2024-05-08T18:50:28.026318+0000","last_active":"2024-05-08T18:53:34.861403+0000","last_peered":"2024-05-08T18:53:34.861403+0000","last_clean":"2024-05-08T18:53:34.861403+0000","last_became_active":"2024-05-08T18:50:28.025866+0000","last_became_peered":"2024-05-08T18:50:28.025866+0000","last_unstale":"2024-05-08T18:53:34.861403+0000","last_undegraded":"2024-05-08T18:53:34.861403+0000","last_fullsized":"2024-05-08T18:53:34.861403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:01.592206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072761+0000","last_change":"2024-05-08T18:50:26.025390+0000","last_active":"2024-05-08T18:51:15.072761+0000","last_peered":"2024-05-08T18:51:15.072761+0000","last_clean":"2024-05-08T18:51:15.072761+0000","last_became_active":"2024-05-08T18:50:26.025120+0000","last_became_peered":"2024-05-08T18:50:26.025120+0000","last_unstale":"2024-05-08T18:51:15.072761+0000","last_undegraded":"2024-05-08T18:51:15.072761+0000","last_fullsized":"2024-05-08T18:51:15.072761+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:07.534900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"27'8","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.690848+0000","last_change":"2024-05-08T18:50:28.025392+0000","last_active":"2024-05-08T18:53:34.690848+0000","last_peered":"2024-05-08T18:53:34.690848+0000","last_clean":"2024-05-08T18:53:34.690848+0000","last_became_active":"2024-05-08T18:50:28.025098+0000","last_became_peered":"2024-05-08T18:50:28.025098+0000","last_unstale":"2024-05-08T18:53:34.690848+0000","last_undegraded":"2024-05-08T18:53:34.690848+0000","last_fullsized":"2024-05-08T18:53:34.690848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:08:56.748370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.001075+0000","last_change":"2024-05-08T18:50:26.014734+0000","last_active":"2024-05-08T18:52:38.001075+0000","last_peered":"2024-05-08T18:52:38.001075+0000","last_clean":"2024-05-08T18:52:38.001075+0000","last_became_active":"2024-05-08T18:50:26.014434+0000","last_became_peered":"2024-05-08T18:50:26.014434+0000","last_unstale":"2024-05-08T18:52:38.001075+0000","last_undegraded":"2024-05-08T18:52:38.001075+0000","last_fullsized":"2024-05-08T18:52:38.001075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:08:13.942735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"27'10","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.860680+0000","last_change":"2024-05-08T18:50:28.037769+0000","last_active":"2024-05-08T18:53:34.860680+0000","last_peered":"2024-05-08T18:53:34.860680+0000","last_clean":"2024-05-08T18:53:34.860680+0000","last_became_active":"2024-05-08T18:50:28.037400+0000","last_became_peered":"2024-05-08T18:50:28.037400+0000","last_unstale":"2024-05-08T18:53:34.860680+0000","last_undegraded":"2024-05-08T18:53:34.860680+0000","last_fullsized":"2024-05-08T18:53:34.860680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:32.886516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"25'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081132+0000","last_change":"2024-05-08T18:50:26.029481+0000","last_active":"2024-05-08T18:51:15.081132+0000","last_peered":"2024-05-08T18:51:15.081132+0000","last_clean":"2024-05-08T18:51:15.081132+0000","last_became_active":"2024-05-08T18:50:26.029047+0000","last_became_peered":"2024-05-08T18:50:26.029047+0000","last_unstale":"2024-05-08T18:51:15.081132+0000","last_undegraded":"2024-05-08T18:51:15.081132+0000","last_fullsized":"2024-05-08T18:51:15.081132+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:13:25.895646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.690549+0000","last_change":"2024-05-08T18:50:28.021411+0000","last_active":"2024-05-08T18:53:34.690549+0000","last_peered":"2024-05-08T18:53:34.690549+0000","last_clean":"2024-05-08T18:53:34.690549+0000","last_became_active":"2024-05-08T18:50:28.021140+0000","last_became_peered":"2024-05-08T18:50:28.021140+0000","last_unstale":"2024-05-08T18:53:34.690549+0000","last_undegraded":"2024-05-08T18:53:34.690549+0000","last_fullsized":"2024-05-08T18:53:34.690549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:14.472478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076427+0000","last_change":"2024-05-08T18:50:26.031998+0000","last_active":"2024-05-08T18:51:15.076427+0000","last_peered":"2024-05-08T18:51:15.076427+0000","last_clean":"2024-05-08T18:51:15.076427+0000","last_became_active":"2024-05-08T18:50:26.031680+0000","last_became_peered":"2024-05-08T18:50:26.031680+0000","last_unstale":"2024-05-08T18:51:15.076427+0000","last_undegraded":"2024-05-08T18:51:15.076427+0000","last_fullsized":"2024-05-08T18:51:15.076427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:40.472317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"27'11","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.004738+0000","last_change":"2024-05-08T18:50:28.023037+0000","last_active":"2024-05-08T18:52:33.004738+0000","last_peered":"2024-05-08T18:52:33.004738+0000","last_clean":"2024-05-08T18:52:33.004738+0000","last_became_active":"2024-05-08T18:50:28.021588+0000","last_became_peered":"2024-05-08T18:50:28.021588+0000","last_unstale":"2024-05-08T18:52:33.004738+0000","last_undegraded":"2024-05-08T18:52:33.004738+0000","last_fullsized":"2024-05-08T18:52:33.004738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.433020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074638+0000","last_change":"2024-05-08T18:50:26.014622+0000","last_active":"2024-05-08T18:51:15.074638+0000","last_peered":"2024-05-08T18:51:15.074638+0000","last_clean":"2024-05-08T18:51:15.074638+0000","last_became_active":"2024-05-08T18:50:26.014383+0000","last_became_peered":"2024-05-08T18:50:26.014383+0000","last_unstale":"2024-05-08T18:51:15.074638+0000","last_undegraded":"2024-05-08T18:51:15.074638+0000","last_fullsized":"2024-05-08T18:51:15.074638+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:31:52.859857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"27'5","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007384+0000","last_change":"2024-05-08T18:50:28.032443+0000","last_active":"2024-05-08T18:52:48.007384+0000","last_peered":"2024-05-08T18:52:48.007384+0000","last_clean":"2024-05-08T18:52:48.007384+0000","last_became_active":"2024-05-08T18:50:28.032181+0000","last_became_peered":"2024-05-08T18:50:28.032181+0000","last_unstale":"2024-05-08T18:52:48.007384+0000","last_undegraded":"2024-05-08T18:52:48.007384+0000","last_fullsized":"2024-05-08T18:52:48.007384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:14.122243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"27'3","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.005971+0000","last_change":"2024-05-08T18:50:26.025793+0000","last_active":"2024-05-08T18:52:38.005971+0000","last_peered":"2024-05-08T18:52:38.005971+0000","last_clean":"2024-05-08T18:52:38.005971+0000","last_became_active":"2024-05-08T18:50:26.025473+0000","last_became_peered":"2024-05-08T18:50:26.025473+0000","last_unstale":"2024-05-08T18:52:38.005971+0000","last_undegraded":"2024-05-08T18:52:38.005971+0000","last_fullsized":"2024-05-08T18:52:38.005971+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:54.988707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.860972+0000","last_change":"2024-05-08T18:50:28.032744+0000","last_active":"2024-05-08T18:53:34.860972+0000","last_peered":"2024-05-08T18:53:34.860972+0000","last_clean":"2024-05-08T18:53:34.860972+0000","last_became_active":"2024-05-08T18:50:28.032462+0000","last_became_peered":"2024-05-08T18:50:28.032462+0000","last_unstale":"2024-05-08T18:53:34.860972+0000","last_undegraded":"2024-05-08T18:53:34.860972+0000","last_fullsized":"2024-05-08T18:53:34.860972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:56.484964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072300+0000","last_change":"2024-05-08T18:50:26.019960+0000","last_active":"2024-05-08T18:51:15.072300+0000","last_peered":"2024-05-08T18:51:15.072300+0000","last_clean":"2024-05-08T18:51:15.072300+0000","last_became_active":"2024-05-08T18:50:26.019706+0000","last_became_peered":"2024-05-08T18:50:26.019706+0000","last_unstale":"2024-05-08T18:51:15.072300+0000","last_undegraded":"2024-05-08T18:51:15.072300+0000","last_fullsized":"2024-05-08T18:51:15.072300+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:09.253705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"27'1","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.001897+0000","last_change":"2024-05-08T18:50:28.031514+0000","last_active":"2024-05-08T18:52:43.001897+0000","last_peered":"2024-05-08T18:52:43.001897+0000","last_clean":"2024-05-08T18:52:43.001897+0000","last_became_active":"2024-05-08T18:50:28.031188+0000","last_became_peered":"2024-05-08T18:50:28.031188+0000","last_unstale":"2024-05-08T18:52:43.001897+0000","last_undegraded":"2024-05-08T18:52:43.001897+0000","last_fullsized":"2024-05-08T18:52:43.001897+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:29.243577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075633+0000","last_change":"2024-05-08T18:50:26.025601+0000","last_active":"2024-05-08T18:51:15.075633+0000","last_peered":"2024-05-08T18:51:15.075633+0000","last_clean":"2024-05-08T18:51:15.075633+0000","last_became_active":"2024-05-08T18:50:26.024808+0000","last_became_peered":"2024-05-08T18:50:26.024808+0000","last_unstale":"2024-05-08T18:51:15.075633+0000","last_undegraded":"2024-05-08T18:51:15.075633+0000","last_fullsized":"2024-05-08T18:51:15.075633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:09.253705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887561+0000","last_change":"2024-05-08T18:50:28.023364+0000","last_active":"2024-05-08T18:53:34.887561+0000","last_peered":"2024-05-08T18:53:34.887561+0000","last_clean":"2024-05-08T18:53:34.887561+0000","last_became_active":"2024-05-08T18:50:28.022905+0000","last_became_peered":"2024-05-08T18:50:28.022905+0000","last_unstale":"2024-05-08T18:53:34.887561+0000","last_undegraded":"2024-05-08T18:53:34.887561+0000","last_fullsized":"2024-05-08T18:53:34.887561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:29:28.977842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078754+0000","last_change":"2024-05-08T18:50:26.025267+0000","last_active":"2024-05-08T18:51:15.078754+0000","last_peered":"2024-05-08T18:51:15.078754+0000","last_clean":"2024-05-08T18:51:15.078754+0000","last_became_active":"2024-05-08T18:50:26.024977+0000","last_became_peered":"2024-05-08T18:50:26.024977+0000","last_unstale":"2024-05-08T18:51:15.078754+0000","last_undegraded":"2024-05-08T18:51:15.078754+0000","last_fullsized":"2024-05-08T18:51:15.078754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:07.271771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076314+0000","last_change":"2024-05-08T18:50:28.037398+0000","last_active":"2024-05-08T18:51:15.076314+0000","last_peered":"2024-05-08T18:51:15.076314+0000","last_clean":"2024-05-08T18:51:15.076314+0000","last_became_active":"2024-05-08T18:50:28.037153+0000","last_became_peered":"2024-05-08T18:50:28.037153+0000","last_unstale":"2024-05-08T18:51:15.076314+0000","last_undegraded":"2024-05-08T18:51:15.076314+0000","last_fullsized":"2024-05-08T18:51:15.076314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:24.508392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079754+0000","last_change":"2024-05-08T18:50:26.012280+0000","last_active":"2024-05-08T18:51:15.079754+0000","last_peered":"2024-05-08T18:51:15.079754+0000","last_clean":"2024-05-08T18:51:15.079754+0000","last_became_active":"2024-05-08T18:50:26.011982+0000","last_became_peered":"2024-05-08T18:50:26.011982+0000","last_unstale":"2024-05-08T18:51:15.079754+0000","last_undegraded":"2024-05-08T18:51:15.079754+0000","last_fullsized":"2024-05-08T18:51:15.079754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:12.465547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"27'8","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.475728+0000","last_change":"2024-05-08T18:50:28.028689+0000","last_active":"2024-05-08T18:51:50.475728+0000","last_peered":"2024-05-08T18:51:50.475728+0000","last_clean":"2024-05-08T18:51:50.475728+0000","last_became_active":"2024-05-08T18:50:28.028405+0000","last_became_peered":"2024-05-08T18:50:28.028405+0000","last_unstale":"2024-05-08T18:51:50.475728+0000","last_undegraded":"2024-05-08T18:51:50.475728+0000","last_fullsized":"2024-05-08T18:51:50.475728+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:29.243577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:31.110738+0000","last_change":"2024-05-08T18:50:26.023917+0000","last_active":"2024-05-08T18:52:31.110738+0000","last_peered":"2024-05-08T18:52:31.110738+0000","last_clean":"2024-05-08T18:52:31.110738+0000","last_became_active":"2024-05-08T18:50:26.023658+0000","last_became_peered":"2024-05-08T18:50:26.023658+0000","last_unstale":"2024-05-08T18:52:31.110738+0000","last_undegraded":"2024-05-08T18:52:31.110738+0000","last_fullsized":"2024-05-08T18:52:31.110738+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:38:03.869777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"25'4","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076645+0000","last_change":"2024-05-08T18:50:28.032840+0000","last_active":"2024-05-08T18:51:15.076645+0000","last_peered":"2024-05-08T18:51:15.076645+0000","last_clean":"2024-05-08T18:51:15.076645+0000","last_became_active":"2024-05-08T18:50:28.032552+0000","last_became_peered":"2024-05-08T18:50:28.032552+0000","last_unstale":"2024-05-08T18:51:15.076645+0000","last_undegraded":"2024-05-08T18:51:15.076645+0000","last_fullsized":"2024-05-08T18:51:15.076645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:37.204016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075410+0000","last_change":"2024-05-08T18:50:26.032685+0000","last_active":"2024-05-08T18:51:15.075410+0000","last_peered":"2024-05-08T18:51:15.075410+0000","last_clean":"2024-05-08T18:51:15.075410+0000","last_became_active":"2024-05-08T18:50:26.032385+0000","last_became_peered":"2024-05-08T18:50:26.032385+0000","last_unstale":"2024-05-08T18:51:15.075410+0000","last_undegraded":"2024-05-08T18:51:15.075410+0000","last_fullsized":"2024-05-08T18:51:15.075410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:10.080123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"27'6","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.242807+0000","last_change":"2024-05-08T18:50:28.024068+0000","last_active":"2024-05-08T18:52:34.242807+0000","last_peered":"2024-05-08T18:52:34.242807+0000","last_clean":"2024-05-08T18:52:34.242807+0000","last_became_active":"2024-05-08T18:50:28.023807+0000","last_became_peered":"2024-05-08T18:50:28.023807+0000","last_unstale":"2024-05-08T18:52:34.242807+0000","last_undegraded":"2024-05-08T18:52:34.242807+0000","last_fullsized":"2024-05-08T18:52:34.242807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:13.501403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.221151+0000","last_change":"2024-05-08T18:50:26.026065+0000","last_active":"2024-05-08T18:52:34.221151+0000","last_peered":"2024-05-08T18:52:34.221151+0000","last_clean":"2024-05-08T18:52:34.221151+0000","last_became_active":"2024-05-08T18:50:26.025023+0000","last_became_peered":"2024-05-08T18:50:26.025023+0000","last_unstale":"2024-05-08T18:52:34.221151+0000","last_undegraded":"2024-05-08T18:52:34.221151+0000","last_fullsized":"2024-05-08T18:52:34.221151+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:28.045523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'6","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.152460+0000","last_change":"2024-05-08T18:50:26.026599+0000","last_active":"2024-05-08T18:52:34.152460+0000","last_peered":"2024-05-08T18:52:34.152460+0000","last_clean":"2024-05-08T18:52:34.152460+0000","last_became_active":"2024-05-08T18:50:26.026333+0000","last_became_peered":"2024-05-08T18:50:26.026333+0000","last_unstale":"2024-05-08T18:52:34.152460+0000","last_undegraded":"2024-05-08T18:52:34.152460+0000","last_fullsized":"2024-05-08T18:52:34.152460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:05.498928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"25'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075022+0000","last_change":"2024-05-08T18:50:28.024946+0000","last_active":"2024-05-08T18:51:15.075022+0000","last_peered":"2024-05-08T18:51:15.075022+0000","last_clean":"2024-05-08T18:51:15.075022+0000","last_became_active":"2024-05-08T18:50:28.024627+0000","last_became_peered":"2024-05-08T18:50:28.024627+0000","last_unstale":"2024-05-08T18:51:15.075022+0000","last_undegraded":"2024-05-08T18:51:15.075022+0000","last_fullsized":"2024-05-08T18:51:15.075022+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:44.968210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.002479+0000","last_change":"2024-05-08T18:50:26.025142+0000","last_active":"2024-05-08T18:52:48.002479+0000","last_peered":"2024-05-08T18:52:48.002479+0000","last_clean":"2024-05-08T18:52:48.002479+0000","last_became_active":"2024-05-08T18:50:26.024839+0000","last_became_peered":"2024-05-08T18:50:26.024839+0000","last_unstale":"2024-05-08T18:52:48.002479+0000","last_undegraded":"2024-05-08T18:52:48.002479+0000","last_fullsized":"2024-05-08T18:52:48.002479+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:13:25.895646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'7","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.008084+0000","last_change":"2024-05-08T18:50:28.038943+0000","last_active":"2024-05-08T18:52:53.008084+0000","last_peered":"2024-05-08T18:52:53.008084+0000","last_clean":"2024-05-08T18:52:53.008084+0000","last_became_active":"2024-05-08T18:50:28.038677+0000","last_became_peered":"2024-05-08T18:50:28.038677+0000","last_unstale":"2024-05-08T18:52:53.008084+0000","last_undegraded":"2024-05-08T18:52:53.008084+0000","last_fullsized":"2024-05-08T18:52:53.008084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:55.122520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1601,"num_read_kb":1491,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705707,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56228,"kb_used_data":20892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94315612,"statfs":{"total":96636764160,"available":96579186688,"internally_reserved":0,"allocated":21393408,"data_stored":21094274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705708,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48548,"kb_used_data":13212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323292,"statfs":{"total":96636764160,"available":96587051008,"internally_reserved":0,"allocated":13529088,"data_stored":13292544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705707,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45104,"kb_used_data":9768,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326736,"statfs":{"total":96636764160,"available":96590577664,"internally_reserved":0,"allocated":10002432,"data_stored":9737407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705707,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40368,"kb_used_data":9192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331472,"statfs":{"total":96636764160,"available":96595427328,"internally_reserved":0,"allocated":9412608,"data_stored":9148355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9031680,"data_stored":9028480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9031680,"data_stored":9028480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:53:41.946 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:53:42.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.075+0000 7f78e7066640 1 Processor -- start 2024-05-08T18:53:42.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.075+0000 7f78e7066640 1 -- start start 2024-05-08T18:53:42.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.075+0000 7f78e7066640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f78e006fe20 0x7f78e012bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:42.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.075+0000 7f78e7066640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e00719e0 con 0x7f78e0070200 2024-05-08T18:53:42.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.075+0000 7f78e7066640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f78e012b9a0 con 0x7f78e006fe20 2024-05-08T18:53:42.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.075+0000 7f78dffff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f78e0070200 0x7f78e01282e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:47170/0 (socket says 172.21.15.42:47170) 2024-05-08T18:53:42.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.075+0000 7f78dffff640 1 -- 172.21.15.42:0/1677343258 learned_addr learned my addr 172.21.15.42:0/1677343258 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:53:42.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.076+0000 7f78e4e02640 1 --2- 172.21.15.42:0/1677343258 >> v2:172.21.15.42:3300/0 conn(0x7f78e006fe20 0x7f78e012bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:42.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.076+0000 7f78df7fe640 1 -- 172.21.15.42:0/1677343258 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 56678110 0 0) 0x7f78e00719e0 con 0x7f78e0070200 2024-05-08T18:53:42.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.076+0000 7f78df7fe640 1 -- 172.21.15.42:0/1677343258 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78cc003520 con 0x7f78e0070200 2024-05-08T18:53:42.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.076+0000 7f78e4e02640 1 -- 172.21.15.42:0/1677343258 >> v1:172.21.15.42:6789/0 conn(0x7f78e0070200 legacy=0x7f78e01282e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:42.076 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.076+0000 7f78e4e02640 1 -- 172.21.15.42:0/1677343258 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e0072330 con 0x7f78e006fe20 2024-05-08T18:53:42.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.077+0000 7f78e4e02640 1 --2- 172.21.15.42:0/1677343258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78e006fe20 0x7f78e012bdd0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009720 tx=0x7f78d802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6069ef80146aa2f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:42.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.077+0000 7f78df7fe640 1 -- 172.21.15.42:0/1677343258 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78d80316d0 con 0x7f78e006fe20 2024-05-08T18:53:42.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.077+0000 7f78df7fe640 1 -- 172.21.15.42:0/1677343258 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d8037070 con 0x7f78e006fe20 2024-05-08T18:53:42.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.077+0000 7f78df7fe640 1 -- 172.21.15.42:0/1677343258 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78d80319c0 con 0x7f78e006fe20 2024-05-08T18:53:42.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.077+0000 7f78e7066640 1 -- 172.21.15.42:0/1677343258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78e006fe20 msgr2=0x7f78e012bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:42.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.077+0000 7f78e7066640 1 --2- 172.21.15.42:0/1677343258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78e006fe20 0x7f78e012bdd0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009720 tx=0x7f78d802b840 comp rx=0 tx=0).stop 2024-05-08T18:53:42.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.077+0000 7f78e7066640 1 -- 172.21.15.42:0/1677343258 shutdown_connections 2024-05-08T18:53:42.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.077+0000 7f78e7066640 1 --2- 172.21.15.42:0/1677343258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78e006fe20 0x7f78e012bdd0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:42.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.077+0000 7f78e7066640 1 -- 172.21.15.42:0/1677343258 >> 172.21.15.42:0/1677343258 conn(0x7f78e009a910 msgr2=0x7f78e006e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:42.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.077+0000 7f78e7066640 1 -- 172.21.15.42:0/1677343258 shutdown_connections 2024-05-08T18:53:42.079 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.077+0000 7f78e7066640 1 -- 172.21.15.42:0/1677343258 wait complete. 2024-05-08T18:53:42.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.078+0000 7f78e7066640 1 Processor -- start 2024-05-08T18:53:42.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.078+0000 7f78e7066640 1 -- start start 2024-05-08T18:53:42.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.079+0000 7f78e7066640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78e006fe20 0x7f78e0116900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:42.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.079+0000 7f78e7066640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f78e0073290 con 0x7f78e006fe20 2024-05-08T18:53:42.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.079+0000 7f78e4e02640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78e006fe20 0x7f78e0116900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:42.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.079+0000 7f78e4e02640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78e006fe20 0x7f78e0116900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45764/0 (socket says 172.21.15.42:45764) 2024-05-08T18:53:42.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.079+0000 7f78e4e02640 1 -- 172.21.15.42:0/2966847660 learned_addr learned my addr 172.21.15.42:0/2966847660 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:53:42.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.079+0000 7f78e4e02640 1 -- 172.21.15.42:0/2966847660 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e01188a0 con 0x7f78e006fe20 2024-05-08T18:53:42.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.079+0000 7f78e4e02640 1 --2- 172.21.15.42:0/2966847660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78e006fe20 0x7f78e0116900 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f78d8000c00 tx=0x7f78d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:42.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.080+0000 7f78dd7fa640 1 -- 172.21.15.42:0/2966847660 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78d8032560 con 0x7f78e006fe20 2024-05-08T18:53:42.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.080+0000 7f78dd7fa640 1 -- 172.21.15.42:0/2966847660 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d8032700 con 0x7f78e006fe20 2024-05-08T18:53:42.080 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.080+0000 7f78e7066640 1 -- 172.21.15.42:0/2966847660 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e009cbe0 con 0x7f78e006fe20 2024-05-08T18:53:42.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.080+0000 7f78dd7fa640 1 -- 172.21.15.42:0/2966847660 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78d8032a00 con 0x7f78e006fe20 2024-05-08T18:53:42.081 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.080+0000 7f78e7066640 1 -- 172.21.15.42:0/2966847660 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e0116e40 con 0x7f78e006fe20 2024-05-08T18:53:42.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.080+0000 7f78dd7fa640 1 -- 172.21.15.42:0/2966847660 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f78d804c060 con 0x7f78e006fe20 2024-05-08T18:53:42.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.081+0000 7f78e7066640 1 -- 172.21.15.42:0/2966847660 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78e0064010 con 0x7f78e006fe20 2024-05-08T18:53:42.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.081+0000 7f78dd7fa640 1 --2- 172.21.15.42:0/2966847660 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f78c003d2b0 0x7f78c003f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:42.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.081+0000 7f78dd7fa640 1 -- 172.21.15.42:0/2966847660 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f78d802f050 con 0x7f78e006fe20 2024-05-08T18:53:42.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.081+0000 7f78dffff640 1 --2- 172.21.15.42:0/2966847660 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f78c003d2b0 0x7f78c003f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:42.082 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.082+0000 7f78dffff640 1 --2- 172.21.15.42:0/2966847660 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f78c003d2b0 0x7f78c003f770 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f78c80020a0 tx=0x7f78c80016d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:42.084 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.085+0000 7f78dd7fa640 1 -- 172.21.15.42:0/2966847660 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f78d8040070 con 0x7f78e006fe20 2024-05-08T18:53:42.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.273+0000 7f78e7066640 1 -- 172.21.15.42:0/2966847660 --> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78e00008d0 con 0x7f78c003d2b0 2024-05-08T18:53:42.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.287+0000 7f78dd7fa640 1 -- 172.21.15.42:0/2966847660 <== mgr.4102 v2:172.21.15.132:6824/2104266563 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665399 (secure 0 0 0) 0x7f78e00008d0 con 0x7f78c003d2b0 2024-05-08T18:53:42.294 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:53:42.300 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-08T18:53:42.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.292+0000 7f78e7066640 1 -- 172.21.15.42:0/2966847660 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f78c003d2b0 msgr2=0x7f78c003f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:42.302 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.292+0000 7f78e7066640 1 --2- 172.21.15.42:0/2966847660 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f78c003d2b0 0x7f78c003f770 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f78c80020a0 tx=0x7f78c80016d0 comp rx=0 tx=0).stop 2024-05-08T18:53:42.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.292+0000 7f78e7066640 1 -- 172.21.15.42:0/2966847660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78e006fe20 msgr2=0x7f78e0116900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:42.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.292+0000 7f78e7066640 1 --2- 172.21.15.42:0/2966847660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78e006fe20 0x7f78e0116900 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f78d8000c00 tx=0x7f78d80046c0 comp rx=0 tx=0).stop 2024-05-08T18:53:42.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.292+0000 7f78e7066640 1 -- 172.21.15.42:0/2966847660 shutdown_connections 2024-05-08T18:53:42.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.292+0000 7f78e7066640 1 --2- 172.21.15.42:0/2966847660 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f78c003d2b0 0x7f78c003f770 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:42.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.292+0000 7f78e7066640 1 --2- 172.21.15.42:0/2966847660 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f78e006fe20 0x7f78e0116900 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:42.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.292+0000 7f78e7066640 1 -- 172.21.15.42:0/2966847660 >> 172.21.15.42:0/2966847660 conn(0x7f78e009a910 msgr2=0x7f78e0124f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:42.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.292+0000 7f78e7066640 1 -- 172.21.15.42:0/2966847660 shutdown_connections 2024-05-08T18:53:42.303 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.292+0000 7f78e7066640 1 -- 172.21.15.42:0/2966847660 wait complete. 2024-05-08T18:53:42.304 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2024-05-08T18:53:41.987156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412790,"num_objects":227,"num_object_clones":0,"num_object_copies":454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4815,"num_read_kb":4401,"num_write":2046,"num_write_kb":60584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4431,"ondisk_log_size":4431,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190248,"kb_used_data":53064,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377297112,"statfs":{"total":386547056640,"available":386352242688,"internally_reserved":0,"allocated":54337536,"data_stored":53272580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004121"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079566+0000","last_change":"2024-05-08T18:50:26.031610+0000","last_active":"2024-05-08T18:51:15.079566+0000","last_peered":"2024-05-08T18:51:15.079566+0000","last_clean":"2024-05-08T18:51:15.079566+0000","last_became_active":"2024-05-08T18:50:26.031359+0000","last_became_peered":"2024-05-08T18:50:26.031359+0000","last_unstale":"2024-05-08T18:51:15.079566+0000","last_undegraded":"2024-05-08T18:51:15.079566+0000","last_fullsized":"2024-05-08T18:51:15.079566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:47.912064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.861653+0000","last_change":"2024-05-08T18:50:28.028609+0000","last_active":"2024-05-08T18:53:34.861653+0000","last_peered":"2024-05-08T18:53:34.861653+0000","last_clean":"2024-05-08T18:53:34.861653+0000","last_became_active":"2024-05-08T18:50:28.028352+0000","last_became_peered":"2024-05-08T18:50:28.028352+0000","last_unstale":"2024-05-08T18:53:34.861653+0000","last_undegraded":"2024-05-08T18:53:34.861653+0000","last_fullsized":"2024-05-08T18:53:34.861653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:01.592206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.086736+0000","last_change":"2024-05-08T18:50:26.029183+0000","last_active":"2024-05-08T18:52:34.086736+0000","last_peered":"2024-05-08T18:52:34.086736+0000","last_clean":"2024-05-08T18:52:34.086736+0000","last_became_active":"2024-05-08T18:50:26.028799+0000","last_became_peered":"2024-05-08T18:50:26.028799+0000","last_unstale":"2024-05-08T18:52:34.086736+0000","last_undegraded":"2024-05-08T18:52:34.086736+0000","last_fullsized":"2024-05-08T18:52:34.086736+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:51.140557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"27'6","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887526+0000","last_change":"2024-05-08T18:50:28.034919+0000","last_active":"2024-05-08T18:53:34.887526+0000","last_peered":"2024-05-08T18:53:34.887526+0000","last_clean":"2024-05-08T18:53:34.887526+0000","last_became_active":"2024-05-08T18:50:28.033466+0000","last_became_peered":"2024-05-08T18:50:28.033466+0000","last_unstale":"2024-05-08T18:53:34.887526+0000","last_undegraded":"2024-05-08T18:53:34.887526+0000","last_fullsized":"2024-05-08T18:53:34.887526+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:01:07.458436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:17.995039+0000","last_change":"2024-05-08T18:51:15.084166+0000","last_active":"2024-05-08T18:51:17.995039+0000","last_peered":"2024-05-08T18:51:17.995039+0000","last_clean":"2024-05-08T18:51:17.995039+0000","last_became_active":"2024-05-08T18:51:15.083809+0000","last_became_peered":"2024-05-08T18:51:15.083809+0000","last_unstale":"2024-05-08T18:51:17.995039+0000","last_undegraded":"2024-05-08T18:51:17.995039+0000","last_fullsized":"2024-05-08T18:51:17.995039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:21.925661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"25'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.084345+0000","last_change":"2024-05-08T18:51:15.083978+0000","last_active":"2024-05-08T18:51:15.084345+0000","last_peered":"2024-05-08T18:51:15.084345+0000","last_clean":"2024-05-08T18:51:15.084345+0000","last_became_active":"2024-05-08T18:51:15.080716+0000","last_became_peered":"2024-05-08T18:51:15.080716+0000","last_unstale":"2024-05-08T18:51:15.084345+0000","last_undegraded":"2024-05-08T18:51:15.084345+0000","last_fullsized":"2024-05-08T18:51:15.084345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:08.301578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076692+0000","last_change":"2024-05-08T18:50:26.024545+0000","last_active":"2024-05-08T18:51:15.076692+0000","last_peered":"2024-05-08T18:51:15.076692+0000","last_clean":"2024-05-08T18:51:15.076692+0000","last_became_active":"2024-05-08T18:50:26.024243+0000","last_became_peered":"2024-05-08T18:50:26.024243+0000","last_unstale":"2024-05-08T18:51:15.076692+0000","last_undegraded":"2024-05-08T18:51:15.076692+0000","last_fullsized":"2024-05-08T18:51:15.076692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:59.917414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"27'4","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.690261+0000","last_change":"2024-05-08T18:50:28.026931+0000","last_active":"2024-05-08T18:53:34.690261+0000","last_peered":"2024-05-08T18:53:34.690261+0000","last_clean":"2024-05-08T18:53:34.690261+0000","last_became_active":"2024-05-08T18:50:28.026380+0000","last_became_peered":"2024-05-08T18:50:28.026380+0000","last_unstale":"2024-05-08T18:53:34.690261+0000","last_undegraded":"2024-05-08T18:53:34.690261+0000","last_fullsized":"2024-05-08T18:53:34.690261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:06:48.544087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079861+0000","last_change":"2024-05-08T18:50:26.023188+0000","last_active":"2024-05-08T18:51:15.079861+0000","last_peered":"2024-05-08T18:51:15.079861+0000","last_clean":"2024-05-08T18:51:15.079861+0000","last_became_active":"2024-05-08T18:50:26.022914+0000","last_became_peered":"2024-05-08T18:50:26.022914+0000","last_unstale":"2024-05-08T18:51:15.079861+0000","last_undegraded":"2024-05-08T18:51:15.079861+0000","last_fullsized":"2024-05-08T18:51:15.079861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:22.501461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'6","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887773+0000","last_change":"2024-05-08T18:50:28.023780+0000","last_active":"2024-05-08T18:53:34.887773+0000","last_peered":"2024-05-08T18:53:34.887773+0000","last_clean":"2024-05-08T18:53:34.887773+0000","last_became_active":"2024-05-08T18:50:28.023506+0000","last_became_peered":"2024-05-08T18:50:28.023506+0000","last_unstale":"2024-05-08T18:53:34.887773+0000","last_undegraded":"2024-05-08T18:53:34.887773+0000","last_fullsized":"2024-05-08T18:53:34.887773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:07.047413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074268+0000","last_change":"2024-05-08T18:50:26.024901+0000","last_active":"2024-05-08T18:51:15.074268+0000","last_peered":"2024-05-08T18:51:15.074268+0000","last_clean":"2024-05-08T18:51:15.074268+0000","last_became_active":"2024-05-08T18:50:26.024493+0000","last_became_peered":"2024-05-08T18:50:26.024493+0000","last_unstale":"2024-05-08T18:51:15.074268+0000","last_undegraded":"2024-05-08T18:51:15.074268+0000","last_fullsized":"2024-05-08T18:51:15.074268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:45.479269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"27'10","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.607900+0000","last_change":"2024-05-08T18:50:28.037839+0000","last_active":"2024-05-08T18:53:34.607900+0000","last_peered":"2024-05-08T18:53:34.607900+0000","last_clean":"2024-05-08T18:53:34.607900+0000","last_became_active":"2024-05-08T18:50:28.037266+0000","last_became_peered":"2024-05-08T18:50:28.037266+0000","last_unstale":"2024-05-08T18:53:34.607900+0000","last_undegraded":"2024-05-08T18:53:34.607900+0000","last_fullsized":"2024-05-08T18:53:34.607900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:55.169436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.009293+0000","last_change":"2024-05-08T18:50:26.011072+0000","last_active":"2024-05-08T18:52:58.009293+0000","last_peered":"2024-05-08T18:52:58.009293+0000","last_clean":"2024-05-08T18:52:58.009293+0000","last_became_active":"2024-05-08T18:50:26.010734+0000","last_became_peered":"2024-05-08T18:50:26.010734+0000","last_unstale":"2024-05-08T18:52:58.009293+0000","last_undegraded":"2024-05-08T18:52:58.009293+0000","last_fullsized":"2024-05-08T18:52:58.009293+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:34.544725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076550+0000","last_change":"2024-05-08T18:50:28.026695+0000","last_active":"2024-05-08T18:51:15.076550+0000","last_peered":"2024-05-08T18:51:15.076550+0000","last_clean":"2024-05-08T18:51:15.076550+0000","last_became_active":"2024-05-08T18:50:28.026028+0000","last_became_peered":"2024-05-08T18:50:28.026028+0000","last_unstale":"2024-05-08T18:51:15.076550+0000","last_undegraded":"2024-05-08T18:51:15.076550+0000","last_fullsized":"2024-05-08T18:51:15.076550+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:08:56.748370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"25'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072030+0000","last_change":"2024-05-08T18:50:26.029712+0000","last_active":"2024-05-08T18:51:15.072030+0000","last_peered":"2024-05-08T18:51:15.072030+0000","last_clean":"2024-05-08T18:51:15.072030+0000","last_became_active":"2024-05-08T18:50:26.029435+0000","last_became_peered":"2024-05-08T18:50:26.029435+0000","last_unstale":"2024-05-08T18:51:15.072030+0000","last_undegraded":"2024-05-08T18:51:15.072030+0000","last_fullsized":"2024-05-08T18:51:15.072030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:07.271771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"27'6","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887632+0000","last_change":"2024-05-08T18:50:28.033720+0000","last_active":"2024-05-08T18:53:34.887632+0000","last_peered":"2024-05-08T18:53:34.887632+0000","last_clean":"2024-05-08T18:53:34.887632+0000","last_became_active":"2024-05-08T18:50:28.033311+0000","last_became_peered":"2024-05-08T18:50:28.033311+0000","last_unstale":"2024-05-08T18:53:34.887632+0000","last_undegraded":"2024-05-08T18:53:34.887632+0000","last_fullsized":"2024-05-08T18:53:34.887632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:53:28.343769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"27'10","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.243057+0000","last_change":"2024-05-08T18:50:28.033240+0000","last_active":"2024-05-08T18:52:34.243057+0000","last_peered":"2024-05-08T18:52:34.243057+0000","last_clean":"2024-05-08T18:52:34.243057+0000","last_became_active":"2024-05-08T18:50:28.032951+0000","last_became_peered":"2024-05-08T18:50:28.032951+0000","last_unstale":"2024-05-08T18:52:34.243057+0000","last_undegraded":"2024-05-08T18:52:34.243057+0000","last_fullsized":"2024-05-08T18:52:34.243057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:33:40.152329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'4","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.082075+0000","last_change":"2024-05-08T18:50:26.030698+0000","last_active":"2024-05-08T18:51:15.082075+0000","last_peered":"2024-05-08T18:51:15.082075+0000","last_clean":"2024-05-08T18:51:15.082075+0000","last_became_active":"2024-05-08T18:50:26.030437+0000","last_became_peered":"2024-05-08T18:50:26.030437+0000","last_unstale":"2024-05-08T18:51:15.082075+0000","last_undegraded":"2024-05-08T18:51:15.082075+0000","last_fullsized":"2024-05-08T18:51:15.082075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:07.534900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'21","reported_seq":106,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.613463+0000","last_change":"2024-05-08T18:50:28.028447+0000","last_active":"2024-05-08T18:53:34.613463+0000","last_peered":"2024-05-08T18:53:34.613463+0000","last_clean":"2024-05-08T18:53:34.613463+0000","last_became_active":"2024-05-08T18:50:28.028184+0000","last_became_peered":"2024-05-08T18:50:28.028184+0000","last_unstale":"2024-05-08T18:53:34.613463+0000","last_undegraded":"2024-05-08T18:53:34.613463+0000","last_fullsized":"2024-05-08T18:53:34.613463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:08:56.748370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":94,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.816663+0000","last_change":"2024-05-08T18:50:26.032028+0000","last_active":"2024-05-08T18:53:34.816663+0000","last_peered":"2024-05-08T18:53:34.816663+0000","last_clean":"2024-05-08T18:53:34.816663+0000","last_became_active":"2024-05-08T18:50:26.031768+0000","last_became_peered":"2024-05-08T18:50:26.031768+0000","last_unstale":"2024-05-08T18:53:34.816663+0000","last_undegraded":"2024-05-08T18:53:34.816663+0000","last_fullsized":"2024-05-08T18:53:34.816663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:09.253705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'8","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887843+0000","last_change":"2024-05-08T18:50:28.029440+0000","last_active":"2024-05-08T18:53:34.887843+0000","last_peered":"2024-05-08T18:53:34.887843+0000","last_clean":"2024-05-08T18:53:34.887843+0000","last_became_active":"2024-05-08T18:50:28.029145+0000","last_became_peered":"2024-05-08T18:50:28.029145+0000","last_unstale":"2024-05-08T18:53:34.887843+0000","last_undegraded":"2024-05-08T18:53:34.887843+0000","last_fullsized":"2024-05-08T18:53:34.887843+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:23.929950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.809112+0000","last_change":"2024-05-08T18:50:26.031782+0000","last_active":"2024-05-08T18:53:34.809112+0000","last_peered":"2024-05-08T18:53:34.809112+0000","last_clean":"2024-05-08T18:53:34.809112+0000","last_became_active":"2024-05-08T18:50:26.031545+0000","last_became_peered":"2024-05-08T18:50:26.031545+0000","last_unstale":"2024-05-08T18:53:34.809112+0000","last_undegraded":"2024-05-08T18:53:34.809112+0000","last_fullsized":"2024-05-08T18:53:34.809112+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:59.917414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"27'16","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887608+0000","last_change":"2024-05-08T18:50:28.023032+0000","last_active":"2024-05-08T18:53:34.887608+0000","last_peered":"2024-05-08T18:53:34.887608+0000","last_clean":"2024-05-08T18:53:34.887608+0000","last_became_active":"2024-05-08T18:50:28.022683+0000","last_became_peered":"2024-05-08T18:50:28.022683+0000","last_unstale":"2024-05-08T18:53:34.887608+0000","last_undegraded":"2024-05-08T18:53:34.887608+0000","last_fullsized":"2024-05-08T18:53:34.887608+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:53:28.343769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.570317+0000","last_change":"2024-05-08T18:50:26.013216+0000","last_active":"2024-05-08T18:53:34.570317+0000","last_peered":"2024-05-08T18:53:34.570317+0000","last_clean":"2024-05-08T18:53:34.570317+0000","last_became_active":"2024-05-08T18:50:26.011512+0000","last_became_peered":"2024-05-08T18:50:26.011512+0000","last_unstale":"2024-05-08T18:53:34.570317+0000","last_undegraded":"2024-05-08T18:53:34.570317+0000","last_fullsized":"2024-05-08T18:53:34.570317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:10.080123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078245+0000","last_change":"2024-05-08T18:50:28.033091+0000","last_active":"2024-05-08T18:51:15.078245+0000","last_peered":"2024-05-08T18:51:15.078245+0000","last_clean":"2024-05-08T18:51:15.078245+0000","last_became_active":"2024-05-08T18:50:28.032768+0000","last_became_peered":"2024-05-08T18:50:28.032768+0000","last_unstale":"2024-05-08T18:51:15.078245+0000","last_undegraded":"2024-05-08T18:51:15.078245+0000","last_fullsized":"2024-05-08T18:51:15.078245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:14.472478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073068+0000","last_change":"2024-05-08T18:50:26.029400+0000","last_active":"2024-05-08T18:51:15.073068+0000","last_peered":"2024-05-08T18:51:15.073068+0000","last_clean":"2024-05-08T18:51:15.073068+0000","last_became_active":"2024-05-08T18:50:26.029015+0000","last_became_peered":"2024-05-08T18:50:26.029015+0000","last_unstale":"2024-05-08T18:51:15.073068+0000","last_undegraded":"2024-05-08T18:51:15.073068+0000","last_fullsized":"2024-05-08T18:51:15.073068+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:10.080123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"27'14","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.861465+0000","last_change":"2024-05-08T18:50:28.022984+0000","last_active":"2024-05-08T18:53:34.861465+0000","last_peered":"2024-05-08T18:53:34.861465+0000","last_clean":"2024-05-08T18:53:34.861465+0000","last_became_active":"2024-05-08T18:50:28.022359+0000","last_became_peered":"2024-05-08T18:50:28.022359+0000","last_unstale":"2024-05-08T18:53:34.861465+0000","last_undegraded":"2024-05-08T18:53:34.861465+0000","last_fullsized":"2024-05-08T18:53:34.861465+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:53.851136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007611+0000","last_change":"2024-05-08T18:50:26.017214+0000","last_active":"2024-05-08T18:52:48.007611+0000","last_peered":"2024-05-08T18:52:48.007611+0000","last_clean":"2024-05-08T18:52:48.007611+0000","last_became_active":"2024-05-08T18:50:26.016932+0000","last_became_peered":"2024-05-08T18:50:26.016932+0000","last_unstale":"2024-05-08T18:52:48.007611+0000","last_undegraded":"2024-05-08T18:52:48.007611+0000","last_fullsized":"2024-05-08T18:52:48.007611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:36.779493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"27'41","reported_seq":107,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.843008+0000","last_change":"2024-05-08T18:50:36.055719+0000","last_active":"2024-05-08T18:53:34.843008+0000","last_peered":"2024-05-08T18:53:34.843008+0000","last_clean":"2024-05-08T18:53:34.843008+0000","last_became_active":"2024-05-08T18:50:36.055045+0000","last_became_peered":"2024-05-08T18:50:36.055045+0000","last_unstale":"2024-05-08T18:53:34.843008+0000","last_undegraded":"2024-05-08T18:53:34.843008+0000","last_fullsized":"2024-05-08T18:53:34.843008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:51.311129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":182,"num_write":115,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'10","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.823446+0000","last_change":"2024-05-08T18:50:28.025676+0000","last_active":"2024-05-08T18:53:34.823446+0000","last_peered":"2024-05-08T18:53:34.823446+0000","last_clean":"2024-05-08T18:53:34.823446+0000","last_became_active":"2024-05-08T18:50:28.025239+0000","last_became_peered":"2024-05-08T18:50:28.025239+0000","last_unstale":"2024-05-08T18:53:34.823446+0000","last_undegraded":"2024-05-08T18:53:34.823446+0000","last_fullsized":"2024-05-08T18:53:34.823446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:43.734077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077683+0000","last_change":"2024-05-08T18:50:26.026659+0000","last_active":"2024-05-08T18:51:15.077683+0000","last_peered":"2024-05-08T18:51:15.077683+0000","last_clean":"2024-05-08T18:51:15.077683+0000","last_became_active":"2024-05-08T18:50:26.026400+0000","last_became_peered":"2024-05-08T18:50:26.026400+0000","last_unstale":"2024-05-08T18:51:15.077683+0000","last_undegraded":"2024-05-08T18:51:15.077683+0000","last_fullsized":"2024-05-08T18:51:15.077683+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:42.961279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079375+0000","last_change":"2024-05-08T18:50:30.036048+0000","last_active":"2024-05-08T18:51:15.079375+0000","last_peered":"2024-05-08T18:51:15.079375+0000","last_clean":"2024-05-08T18:51:15.079375+0000","last_became_active":"2024-05-08T18:50:30.034832+0000","last_became_peered":"2024-05-08T18:50:30.034832+0000","last_unstale":"2024-05-08T18:51:15.079375+0000","last_undegraded":"2024-05-08T18:51:15.079375+0000","last_fullsized":"2024-05-08T18:51:15.079375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:46.416875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"27'30","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.784944+0000","last_change":"2024-05-08T18:50:32.044302+0000","last_active":"2024-05-08T18:52:32.784944+0000","last_peered":"2024-05-08T18:52:32.784944+0000","last_clean":"2024-05-08T18:52:32.784944+0000","last_became_active":"2024-05-08T18:50:32.042432+0000","last_became_peered":"2024-05-08T18:50:32.042432+0000","last_unstale":"2024-05-08T18:52:32.784944+0000","last_undegraded":"2024-05-08T18:52:32.784944+0000","last_fullsized":"2024-05-08T18:52:32.784944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:10.539618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081525+0000","last_change":"2024-05-08T18:50:34.048749+0000","last_active":"2024-05-08T18:51:15.081525+0000","last_peered":"2024-05-08T18:51:15.081525+0000","last_clean":"2024-05-08T18:51:15.081525+0000","last_became_active":"2024-05-08T18:50:34.048339+0000","last_became_peered":"2024-05-08T18:50:34.048339+0000","last_unstale":"2024-05-08T18:51:15.081525+0000","last_undegraded":"2024-05-08T18:51:15.081525+0000","last_fullsized":"2024-05-08T18:51:15.081525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:11.762112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"27'7","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.481284+0000","last_change":"2024-05-08T18:50:36.055618+0000","last_active":"2024-05-08T18:51:50.481284+0000","last_peered":"2024-05-08T18:51:50.481284+0000","last_clean":"2024-05-08T18:51:50.481284+0000","last_became_active":"2024-05-08T18:50:36.055220+0000","last_became_peered":"2024-05-08T18:50:36.055220+0000","last_unstale":"2024-05-08T18:51:50.481284+0000","last_undegraded":"2024-05-08T18:51:50.481284+0000","last_fullsized":"2024-05-08T18:51:50.481284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:17.604372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"25'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.080146+0000","last_change":"2024-05-08T18:50:28.038524+0000","last_active":"2024-05-08T18:51:15.080146+0000","last_peered":"2024-05-08T18:51:15.080146+0000","last_clean":"2024-05-08T18:51:15.080146+0000","last_became_active":"2024-05-08T18:50:28.038232+0000","last_became_peered":"2024-05-08T18:50:28.038232+0000","last_unstale":"2024-05-08T18:51:15.080146+0000","last_undegraded":"2024-05-08T18:51:15.080146+0000","last_fullsized":"2024-05-08T18:51:15.080146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:25.476484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.006963+0000","last_change":"2024-05-08T18:50:26.031250+0000","last_active":"2024-05-08T18:52:48.006963+0000","last_peered":"2024-05-08T18:52:48.006963+0000","last_clean":"2024-05-08T18:52:48.006963+0000","last_became_active":"2024-05-08T18:50:26.030986+0000","last_became_peered":"2024-05-08T18:50:26.030986+0000","last_unstale":"2024-05-08T18:52:48.006963+0000","last_undegraded":"2024-05-08T18:52:48.006963+0000","last_fullsized":"2024-05-08T18:52:48.006963+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:47.462940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073251+0000","last_change":"2024-05-08T18:50:30.026937+0000","last_active":"2024-05-08T18:51:15.073251+0000","last_peered":"2024-05-08T18:51:15.073251+0000","last_clean":"2024-05-08T18:51:15.073251+0000","last_became_active":"2024-05-08T18:50:30.026538+0000","last_became_peered":"2024-05-08T18:50:30.026538+0000","last_unstale":"2024-05-08T18:51:15.073251+0000","last_undegraded":"2024-05-08T18:51:15.073251+0000","last_fullsized":"2024-05-08T18:51:15.073251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:07.500017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"25'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081630+0000","last_change":"2024-05-08T18:50:32.039340+0000","last_active":"2024-05-08T18:51:15.081630+0000","last_peered":"2024-05-08T18:51:15.081630+0000","last_clean":"2024-05-08T18:51:15.081630+0000","last_became_active":"2024-05-08T18:50:32.039031+0000","last_became_peered":"2024-05-08T18:50:32.039031+0000","last_unstale":"2024-05-08T18:51:15.081630+0000","last_undegraded":"2024-05-08T18:51:15.081630+0000","last_fullsized":"2024-05-08T18:51:15.081630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:40.432123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.080159+0000","last_change":"2024-05-08T18:50:34.050921+0000","last_active":"2024-05-08T18:51:15.080159+0000","last_peered":"2024-05-08T18:51:15.080159+0000","last_clean":"2024-05-08T18:51:15.080159+0000","last_became_active":"2024-05-08T18:50:34.050512+0000","last_became_peered":"2024-05-08T18:50:34.050512+0000","last_unstale":"2024-05-08T18:51:15.080159+0000","last_undegraded":"2024-05-08T18:51:15.080159+0000","last_fullsized":"2024-05-08T18:51:15.080159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:12.079998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"25'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072106+0000","last_change":"2024-05-08T18:50:36.048388+0000","last_active":"2024-05-08T18:51:15.072106+0000","last_peered":"2024-05-08T18:51:15.072106+0000","last_clean":"2024-05-08T18:51:15.072106+0000","last_became_active":"2024-05-08T18:50:36.048075+0000","last_became_peered":"2024-05-08T18:50:36.048075+0000","last_unstale":"2024-05-08T18:51:15.072106+0000","last_undegraded":"2024-05-08T18:51:15.072106+0000","last_fullsized":"2024-05-08T18:51:15.072106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:35.422216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'10","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.861231+0000","last_change":"2024-05-08T18:50:28.026321+0000","last_active":"2024-05-08T18:53:34.861231+0000","last_peered":"2024-05-08T18:53:34.861231+0000","last_clean":"2024-05-08T18:53:34.861231+0000","last_became_active":"2024-05-08T18:50:28.025867+0000","last_became_peered":"2024-05-08T18:50:28.025867+0000","last_unstale":"2024-05-08T18:53:34.861231+0000","last_undegraded":"2024-05-08T18:53:34.861231+0000","last_fullsized":"2024-05-08T18:53:34.861231+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:58.219100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"27'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007580+0000","last_change":"2024-05-08T18:50:26.025750+0000","last_active":"2024-05-08T18:52:48.007580+0000","last_peered":"2024-05-08T18:52:48.007580+0000","last_clean":"2024-05-08T18:52:48.007580+0000","last_became_active":"2024-05-08T18:50:26.025410+0000","last_became_peered":"2024-05-08T18:50:26.025410+0000","last_unstale":"2024-05-08T18:52:48.007580+0000","last_undegraded":"2024-05-08T18:52:48.007580+0000","last_fullsized":"2024-05-08T18:52:48.007580+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:50:43.198256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075129+0000","last_change":"2024-05-08T18:50:30.029531+0000","last_active":"2024-05-08T18:51:15.075129+0000","last_peered":"2024-05-08T18:51:15.075129+0000","last_clean":"2024-05-08T18:51:15.075129+0000","last_became_active":"2024-05-08T18:50:30.029196+0000","last_became_peered":"2024-05-08T18:50:30.029196+0000","last_unstale":"2024-05-08T18:51:15.075129+0000","last_undegraded":"2024-05-08T18:51:15.075129+0000","last_fullsized":"2024-05-08T18:51:15.075129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:03.285378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"25'10","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078489+0000","last_change":"2024-05-08T18:50:32.044406+0000","last_active":"2024-05-08T18:51:15.078489+0000","last_peered":"2024-05-08T18:51:15.078489+0000","last_clean":"2024-05-08T18:51:15.078489+0000","last_became_active":"2024-05-08T18:50:32.044056+0000","last_became_peered":"2024-05-08T18:50:32.044056+0000","last_unstale":"2024-05-08T18:51:15.078489+0000","last_undegraded":"2024-05-08T18:51:15.078489+0000","last_fullsized":"2024-05-08T18:51:15.078489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:24.002892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"27'282","reported_seq":390,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111612+0000","last_change":"2024-05-08T18:50:34.042149+0000","last_active":"2024-05-08T18:53:35.111612+0000","last_peered":"2024-05-08T18:53:35.111612+0000","last_clean":"2024-05-08T18:53:35.111612+0000","last_became_active":"2024-05-08T18:50:34.041872+0000","last_became_peered":"2024-05-08T18:50:34.041872+0000","last_unstale":"2024-05-08T18:53:35.111612+0000","last_undegraded":"2024-05-08T18:53:35.111612+0000","last_fullsized":"2024-05-08T18:53:35.111612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:51.976316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075671+0000","last_change":"2024-05-08T18:50:36.049616+0000","last_active":"2024-05-08T18:51:15.075671+0000","last_peered":"2024-05-08T18:51:15.075671+0000","last_clean":"2024-05-08T18:51:15.075671+0000","last_became_active":"2024-05-08T18:50:36.049346+0000","last_became_peered":"2024-05-08T18:50:36.049346+0000","last_unstale":"2024-05-08T18:51:15.075671+0000","last_undegraded":"2024-05-08T18:51:15.075671+0000","last_fullsized":"2024-05-08T18:51:15.075671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:30:50.522610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'6","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:31.121826+0000","last_change":"2024-05-08T18:50:28.031653+0000","last_active":"2024-05-08T18:52:31.121826+0000","last_peered":"2024-05-08T18:52:31.121826+0000","last_clean":"2024-05-08T18:52:31.121826+0000","last_became_active":"2024-05-08T18:50:28.031332+0000","last_became_peered":"2024-05-08T18:50:28.031332+0000","last_unstale":"2024-05-08T18:52:31.121826+0000","last_undegraded":"2024-05-08T18:52:31.121826+0000","last_fullsized":"2024-05-08T18:52:31.121826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:30.052454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076511+0000","last_change":"2024-05-08T18:50:26.032415+0000","last_active":"2024-05-08T18:51:15.076511+0000","last_peered":"2024-05-08T18:51:15.076511+0000","last_clean":"2024-05-08T18:51:15.076511+0000","last_became_active":"2024-05-08T18:50:26.032155+0000","last_became_peered":"2024-05-08T18:50:26.032155+0000","last_unstale":"2024-05-08T18:51:15.076511+0000","last_undegraded":"2024-05-08T18:51:15.076511+0000","last_fullsized":"2024-05-08T18:51:15.076511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:45.479269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"27'4","reported_seq":226,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.880720+0000","last_change":"2024-05-08T18:50:30.035403+0000","last_active":"2024-05-08T18:52:33.880720+0000","last_peered":"2024-05-08T18:52:33.880720+0000","last_clean":"2024-05-08T18:52:33.880720+0000","last_became_active":"2024-05-08T18:50:30.034798+0000","last_became_peered":"2024-05-08T18:50:30.034798+0000","last_unstale":"2024-05-08T18:52:33.880720+0000","last_undegraded":"2024-05-08T18:52:33.880720+0000","last_fullsized":"2024-05-08T18:52:33.880720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:08:03.148182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"27'30","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.779909+0000","last_change":"2024-05-08T18:50:32.043871+0000","last_active":"2024-05-08T18:52:32.779909+0000","last_peered":"2024-05-08T18:52:32.779909+0000","last_clean":"2024-05-08T18:52:32.779909+0000","last_became_active":"2024-05-08T18:50:32.043573+0000","last_became_peered":"2024-05-08T18:50:32.043573+0000","last_unstale":"2024-05-08T18:52:32.779909+0000","last_undegraded":"2024-05-08T18:52:32.779909+0000","last_fullsized":"2024-05-08T18:52:32.779909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:33:44.166474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"27'282","reported_seq":401,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111691+0000","last_change":"2024-05-08T18:50:34.050464+0000","last_active":"2024-05-08T18:53:35.111691+0000","last_peered":"2024-05-08T18:53:35.111691+0000","last_clean":"2024-05-08T18:53:35.111691+0000","last_became_active":"2024-05-08T18:50:34.050122+0000","last_became_peered":"2024-05-08T18:50:34.050122+0000","last_unstale":"2024-05-08T18:53:35.111691+0000","last_undegraded":"2024-05-08T18:53:35.111691+0000","last_fullsized":"2024-05-08T18:53:35.111691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:11.762112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"27'6","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.691043+0000","last_change":"2024-05-08T18:50:28.035510+0000","last_active":"2024-05-08T18:53:34.691043+0000","last_peered":"2024-05-08T18:53:34.691043+0000","last_clean":"2024-05-08T18:53:34.691043+0000","last_became_active":"2024-05-08T18:50:28.034992+0000","last_became_peered":"2024-05-08T18:50:28.034992+0000","last_unstale":"2024-05-08T18:53:34.691043+0000","last_undegraded":"2024-05-08T18:53:34.691043+0000","last_fullsized":"2024-05-08T18:53:34.691043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:18.934758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079658+0000","last_change":"2024-05-08T18:50:26.023445+0000","last_active":"2024-05-08T18:51:15.079658+0000","last_peered":"2024-05-08T18:51:15.079658+0000","last_clean":"2024-05-08T18:51:15.079658+0000","last_became_active":"2024-05-08T18:50:26.023141+0000","last_became_peered":"2024-05-08T18:50:26.023141+0000","last_unstale":"2024-05-08T18:51:15.079658+0000","last_undegraded":"2024-05-08T18:51:15.079658+0000","last_fullsized":"2024-05-08T18:51:15.079658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:07.534900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075851+0000","last_change":"2024-05-08T18:50:30.030136+0000","last_active":"2024-05-08T18:51:15.075851+0000","last_peered":"2024-05-08T18:51:15.075851+0000","last_clean":"2024-05-08T18:51:15.075851+0000","last_became_active":"2024-05-08T18:50:30.029482+0000","last_became_peered":"2024-05-08T18:50:30.029482+0000","last_unstale":"2024-05-08T18:51:15.075851+0000","last_undegraded":"2024-05-08T18:51:15.075851+0000","last_fullsized":"2024-05-08T18:51:15.075851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:13:46.352309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"27'41","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.789074+0000","last_change":"2024-05-08T18:50:32.038383+0000","last_active":"2024-05-08T18:52:32.789074+0000","last_peered":"2024-05-08T18:52:32.789074+0000","last_clean":"2024-05-08T18:52:32.789074+0000","last_became_active":"2024-05-08T18:50:32.038121+0000","last_became_peered":"2024-05-08T18:50:32.038121+0000","last_unstale":"2024-05-08T18:52:32.789074+0000","last_undegraded":"2024-05-08T18:52:32.789074+0000","last_fullsized":"2024-05-08T18:52:32.789074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:18.512526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072455+0000","last_change":"2024-05-08T18:50:34.047709+0000","last_active":"2024-05-08T18:51:15.072455+0000","last_peered":"2024-05-08T18:51:15.072455+0000","last_clean":"2024-05-08T18:51:15.072455+0000","last_became_active":"2024-05-08T18:50:34.047404+0000","last_became_peered":"2024-05-08T18:50:34.047404+0000","last_unstale":"2024-05-08T18:51:15.072455+0000","last_undegraded":"2024-05-08T18:51:15.072455+0000","last_fullsized":"2024-05-08T18:51:15.072455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:54.419559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"27'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.483004+0000","last_change":"2024-05-08T18:50:36.052192+0000","last_active":"2024-05-08T18:51:50.483004+0000","last_peered":"2024-05-08T18:51:50.483004+0000","last_clean":"2024-05-08T18:51:50.483004+0000","last_became_active":"2024-05-08T18:50:36.051055+0000","last_became_peered":"2024-05-08T18:50:36.051055+0000","last_unstale":"2024-05-08T18:51:50.483004+0000","last_undegraded":"2024-05-08T18:51:50.483004+0000","last_fullsized":"2024-05-08T18:51:50.483004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:38.752303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"27'7","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.868063+0000","last_change":"2024-05-08T18:50:28.018783+0000","last_active":"2024-05-08T18:53:34.868063+0000","last_peered":"2024-05-08T18:53:34.868063+0000","last_clean":"2024-05-08T18:53:34.868063+0000","last_became_active":"2024-05-08T18:50:28.018022+0000","last_became_peered":"2024-05-08T18:50:28.018022+0000","last_unstale":"2024-05-08T18:53:34.868063+0000","last_undegraded":"2024-05-08T18:53:34.868063+0000","last_fullsized":"2024-05-08T18:53:34.868063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:23.858287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076642+0000","last_change":"2024-05-08T18:50:26.025311+0000","last_active":"2024-05-08T18:51:15.076642+0000","last_peered":"2024-05-08T18:51:15.076642+0000","last_clean":"2024-05-08T18:51:15.076642+0000","last_became_active":"2024-05-08T18:50:26.025028+0000","last_became_peered":"2024-05-08T18:50:26.025028+0000","last_unstale":"2024-05-08T18:51:15.076642+0000","last_undegraded":"2024-05-08T18:51:15.076642+0000","last_fullsized":"2024-05-08T18:51:15.076642+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:08:13.942735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072580+0000","last_change":"2024-05-08T18:50:30.032000+0000","last_active":"2024-05-08T18:51:15.072580+0000","last_peered":"2024-05-08T18:51:15.072580+0000","last_clean":"2024-05-08T18:51:15.072580+0000","last_became_active":"2024-05-08T18:50:30.031574+0000","last_became_peered":"2024-05-08T18:50:30.031574+0000","last_unstale":"2024-05-08T18:51:15.072580+0000","last_undegraded":"2024-05-08T18:51:15.072580+0000","last_fullsized":"2024-05-08T18:51:15.072580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:05.406989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"27'32","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.768717+0000","last_change":"2024-05-08T18:50:32.042012+0000","last_active":"2024-05-08T18:52:32.768717+0000","last_peered":"2024-05-08T18:52:32.768717+0000","last_clean":"2024-05-08T18:52:32.768717+0000","last_became_active":"2024-05-08T18:50:32.041239+0000","last_became_peered":"2024-05-08T18:50:32.041239+0000","last_unstale":"2024-05-08T18:52:32.768717+0000","last_undegraded":"2024-05-08T18:52:32.768717+0000","last_fullsized":"2024-05-08T18:52:32.768717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:21.232439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072331+0000","last_change":"2024-05-08T18:50:34.044867+0000","last_active":"2024-05-08T18:51:15.072331+0000","last_peered":"2024-05-08T18:51:15.072331+0000","last_clean":"2024-05-08T18:51:15.072331+0000","last_became_active":"2024-05-08T18:50:34.044487+0000","last_became_peered":"2024-05-08T18:50:34.044487+0000","last_unstale":"2024-05-08T18:51:15.072331+0000","last_undegraded":"2024-05-08T18:51:15.072331+0000","last_fullsized":"2024-05-08T18:51:15.072331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:26:22.790796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"27'7","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.864198+0000","last_change":"2024-05-08T18:50:36.051009+0000","last_active":"2024-05-08T18:53:34.864198+0000","last_peered":"2024-05-08T18:53:34.864198+0000","last_clean":"2024-05-08T18:53:34.864198+0000","last_became_active":"2024-05-08T18:50:36.050379+0000","last_became_peered":"2024-05-08T18:50:36.050379+0000","last_unstale":"2024-05-08T18:53:34.864198+0000","last_undegraded":"2024-05-08T18:53:34.864198+0000","last_fullsized":"2024-05-08T18:53:34.864198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:50.929055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:31.119400+0000","last_change":"2024-05-08T18:50:28.037118+0000","last_active":"2024-05-08T18:52:31.119400+0000","last_peered":"2024-05-08T18:52:31.119400+0000","last_clean":"2024-05-08T18:52:31.119400+0000","last_became_active":"2024-05-08T18:50:28.036821+0000","last_became_peered":"2024-05-08T18:50:28.036821+0000","last_unstale":"2024-05-08T18:52:31.119400+0000","last_undegraded":"2024-05-08T18:52:31.119400+0000","last_fullsized":"2024-05-08T18:52:31.119400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:32.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079688+0000","last_change":"2024-05-08T18:50:26.023248+0000","last_active":"2024-05-08T18:51:15.079688+0000","last_peered":"2024-05-08T18:51:15.079688+0000","last_clean":"2024-05-08T18:51:15.079688+0000","last_became_active":"2024-05-08T18:50:26.022938+0000","last_became_peered":"2024-05-08T18:50:26.022938+0000","last_unstale":"2024-05-08T18:51:15.079688+0000","last_undegraded":"2024-05-08T18:51:15.079688+0000","last_fullsized":"2024-05-08T18:51:15.079688+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:53.195171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073993+0000","last_change":"2024-05-08T18:50:30.029421+0000","last_active":"2024-05-08T18:51:15.073993+0000","last_peered":"2024-05-08T18:51:15.073993+0000","last_clean":"2024-05-08T18:51:15.073993+0000","last_became_active":"2024-05-08T18:50:30.029134+0000","last_became_peered":"2024-05-08T18:50:30.029134+0000","last_unstale":"2024-05-08T18:51:15.073993+0000","last_undegraded":"2024-05-08T18:51:15.073993+0000","last_fullsized":"2024-05-08T18:51:15.073993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:46.684447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"27'37","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.790970+0000","last_change":"2024-05-08T18:50:32.035457+0000","last_active":"2024-05-08T18:52:32.790970+0000","last_peered":"2024-05-08T18:52:32.790970+0000","last_clean":"2024-05-08T18:52:32.790970+0000","last_became_active":"2024-05-08T18:50:32.035189+0000","last_became_peered":"2024-05-08T18:50:32.035189+0000","last_unstale":"2024-05-08T18:52:32.790970+0000","last_undegraded":"2024-05-08T18:52:32.790970+0000","last_fullsized":"2024-05-08T18:52:32.790970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:02.364503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"27'282","reported_seq":354,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111702+0000","last_change":"2024-05-08T18:50:34.048274+0000","last_active":"2024-05-08T18:53:35.111702+0000","last_peered":"2024-05-08T18:53:35.111702+0000","last_clean":"2024-05-08T18:53:35.111702+0000","last_became_active":"2024-05-08T18:50:34.047999+0000","last_became_peered":"2024-05-08T18:50:34.047999+0000","last_unstale":"2024-05-08T18:53:35.111702+0000","last_undegraded":"2024-05-08T18:53:35.111702+0000","last_fullsized":"2024-05-08T18:53:35.111702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:36.744889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073643+0000","last_change":"2024-05-08T18:50:36.048278+0000","last_active":"2024-05-08T18:51:15.073643+0000","last_peered":"2024-05-08T18:51:15.073643+0000","last_clean":"2024-05-08T18:51:15.073643+0000","last_became_active":"2024-05-08T18:50:36.047981+0000","last_became_peered":"2024-05-08T18:50:36.047981+0000","last_unstale":"2024-05-08T18:51:15.073643+0000","last_undegraded":"2024-05-08T18:51:15.073643+0000","last_fullsized":"2024-05-08T18:51:15.073643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:39.176315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"27'8","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.474560+0000","last_change":"2024-05-08T18:50:28.020443+0000","last_active":"2024-05-08T18:51:50.474560+0000","last_peered":"2024-05-08T18:51:50.474560+0000","last_clean":"2024-05-08T18:51:50.474560+0000","last_became_active":"2024-05-08T18:50:28.020004+0000","last_became_peered":"2024-05-08T18:50:28.020004+0000","last_unstale":"2024-05-08T18:51:50.474560+0000","last_undegraded":"2024-05-08T18:51:50.474560+0000","last_fullsized":"2024-05-08T18:51:50.474560+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:26.670671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079070+0000","last_change":"2024-05-08T18:50:26.017413+0000","last_active":"2024-05-08T18:51:15.079070+0000","last_peered":"2024-05-08T18:51:15.079070+0000","last_clean":"2024-05-08T18:51:15.079070+0000","last_became_active":"2024-05-08T18:50:26.015955+0000","last_became_peered":"2024-05-08T18:50:26.015955+0000","last_unstale":"2024-05-08T18:51:15.079070+0000","last_undegraded":"2024-05-08T18:51:15.079070+0000","last_fullsized":"2024-05-08T18:51:15.079070+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:59.585275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073289+0000","last_change":"2024-05-08T18:50:30.030443+0000","last_active":"2024-05-08T18:51:15.073289+0000","last_peered":"2024-05-08T18:51:15.073289+0000","last_clean":"2024-05-08T18:51:15.073289+0000","last_became_active":"2024-05-08T18:50:30.030140+0000","last_became_peered":"2024-05-08T18:50:30.030140+0000","last_unstale":"2024-05-08T18:51:15.073289+0000","last_undegraded":"2024-05-08T18:51:15.073289+0000","last_fullsized":"2024-05-08T18:51:15.073289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:27.912865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"27'55","reported_seq":111,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.793380+0000","last_change":"2024-05-08T18:50:32.041420+0000","last_active":"2024-05-08T18:52:32.793380+0000","last_peered":"2024-05-08T18:52:32.793380+0000","last_clean":"2024-05-08T18:52:32.793380+0000","last_became_active":"2024-05-08T18:50:32.040633+0000","last_became_peered":"2024-05-08T18:50:32.040633+0000","last_unstale":"2024-05-08T18:52:32.793380+0000","last_undegraded":"2024-05-08T18:52:32.793380+0000","last_fullsized":"2024-05-08T18:52:32.793380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.162116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072394+0000","last_change":"2024-05-08T18:50:34.044110+0000","last_active":"2024-05-08T18:51:15.072394+0000","last_peered":"2024-05-08T18:51:15.072394+0000","last_clean":"2024-05-08T18:51:15.072394+0000","last_became_active":"2024-05-08T18:50:34.043817+0000","last_became_peered":"2024-05-08T18:50:34.043817+0000","last_unstale":"2024-05-08T18:51:15.072394+0000","last_undegraded":"2024-05-08T18:51:15.072394+0000","last_fullsized":"2024-05-08T18:51:15.072394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:52.535624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"27'18","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.978577+0000","last_change":"2024-05-08T18:50:36.054529+0000","last_active":"2024-05-08T18:53:34.978577+0000","last_peered":"2024-05-08T18:53:34.978577+0000","last_clean":"2024-05-08T18:53:34.978577+0000","last_became_active":"2024-05-08T18:50:36.054237+0000","last_became_peered":"2024-05-08T18:50:36.054237+0000","last_unstale":"2024-05-08T18:53:34.978577+0000","last_undegraded":"2024-05-08T18:53:34.978577+0000","last_fullsized":"2024-05-08T18:53:34.978577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:06.378701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"27'10","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.862996+0000","last_change":"2024-05-08T18:51:15.097690+0000","last_active":"2024-05-08T18:53:34.862996+0000","last_peered":"2024-05-08T18:53:34.862996+0000","last_clean":"2024-05-08T18:53:34.862996+0000","last_became_active":"2024-05-08T18:51:15.085560+0000","last_became_peered":"2024-05-08T18:51:15.085560+0000","last_unstale":"2024-05-08T18:53:34.862996+0000","last_undegraded":"2024-05-08T18:53:34.862996+0000","last_fullsized":"2024-05-08T18:53:34.862996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:42.900712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.080760+0000","last_change":"2024-05-08T18:51:15.080314+0000","last_active":"2024-05-08T18:51:15.080760+0000","last_peered":"2024-05-08T18:51:15.080760+0000","last_clean":"2024-05-08T18:51:15.080760+0000","last_became_active":"2024-05-08T18:51:15.080071+0000","last_became_peered":"2024-05-08T18:51:15.080071+0000","last_unstale":"2024-05-08T18:51:15.080760+0000","last_undegraded":"2024-05-08T18:51:15.080760+0000","last_fullsized":"2024-05-08T18:51:15.080760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:41.372462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075379+0000","last_change":"2024-05-08T18:50:30.033626+0000","last_active":"2024-05-08T18:51:15.075379+0000","last_peered":"2024-05-08T18:51:15.075379+0000","last_clean":"2024-05-08T18:51:15.075379+0000","last_became_active":"2024-05-08T18:50:30.033318+0000","last_became_peered":"2024-05-08T18:50:30.033318+0000","last_unstale":"2024-05-08T18:51:15.075379+0000","last_undegraded":"2024-05-08T18:51:15.075379+0000","last_fullsized":"2024-05-08T18:51:15.075379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:25.936937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"27'33","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007320+0000","last_change":"2024-05-08T18:50:32.035227+0000","last_active":"2024-05-08T18:52:48.007320+0000","last_peered":"2024-05-08T18:52:48.007320+0000","last_clean":"2024-05-08T18:52:48.007320+0000","last_became_active":"2024-05-08T18:50:32.034914+0000","last_became_peered":"2024-05-08T18:50:32.034914+0000","last_unstale":"2024-05-08T18:52:48.007320+0000","last_undegraded":"2024-05-08T18:52:48.007320+0000","last_fullsized":"2024-05-08T18:52:48.007320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:42:57.344797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.082244+0000","last_change":"2024-05-08T18:50:34.047372+0000","last_active":"2024-05-08T18:51:15.082244+0000","last_peered":"2024-05-08T18:51:15.082244+0000","last_clean":"2024-05-08T18:51:15.082244+0000","last_became_active":"2024-05-08T18:50:34.047075+0000","last_became_peered":"2024-05-08T18:50:34.047075+0000","last_unstale":"2024-05-08T18:51:15.082244+0000","last_undegraded":"2024-05-08T18:51:15.082244+0000","last_fullsized":"2024-05-08T18:51:15.082244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:39.931353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"27'3","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.005911+0000","last_change":"2024-05-08T18:50:36.055688+0000","last_active":"2024-05-08T18:52:38.005911+0000","last_peered":"2024-05-08T18:52:38.005911+0000","last_clean":"2024-05-08T18:52:38.005911+0000","last_became_active":"2024-05-08T18:50:36.055385+0000","last_became_peered":"2024-05-08T18:50:36.055385+0000","last_unstale":"2024-05-08T18:52:38.005911+0000","last_undegraded":"2024-05-08T18:52:38.005911+0000","last_fullsized":"2024-05-08T18:52:38.005911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:06.579528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'4","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.243668+0000","last_change":"2024-05-08T18:50:28.039067+0000","last_active":"2024-05-08T18:52:34.243668+0000","last_peered":"2024-05-08T18:52:34.243668+0000","last_clean":"2024-05-08T18:52:34.243668+0000","last_became_active":"2024-05-08T18:50:28.038633+0000","last_became_peered":"2024-05-08T18:50:28.038633+0000","last_unstale":"2024-05-08T18:52:34.243668+0000","last_undegraded":"2024-05-08T18:52:34.243668+0000","last_fullsized":"2024-05-08T18:52:34.243668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:06.211199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077754+0000","last_change":"2024-05-08T18:50:26.016599+0000","last_active":"2024-05-08T18:51:15.077754+0000","last_peered":"2024-05-08T18:51:15.077754+0000","last_clean":"2024-05-08T18:51:15.077754+0000","last_became_active":"2024-05-08T18:50:26.016308+0000","last_became_peered":"2024-05-08T18:50:26.016308+0000","last_unstale":"2024-05-08T18:51:15.077754+0000","last_undegraded":"2024-05-08T18:51:15.077754+0000","last_fullsized":"2024-05-08T18:51:15.077754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:04.583010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074792+0000","last_change":"2024-05-08T18:50:30.032199+0000","last_active":"2024-05-08T18:51:15.074792+0000","last_peered":"2024-05-08T18:51:15.074792+0000","last_clean":"2024-05-08T18:51:15.074792+0000","last_became_active":"2024-05-08T18:50:30.031765+0000","last_became_peered":"2024-05-08T18:50:30.031765+0000","last_unstale":"2024-05-08T18:51:15.074792+0000","last_undegraded":"2024-05-08T18:51:15.074792+0000","last_fullsized":"2024-05-08T18:51:15.074792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:33:42.159316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"27'36","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.800005+0000","last_change":"2024-05-08T18:50:32.035413+0000","last_active":"2024-05-08T18:52:32.800005+0000","last_peered":"2024-05-08T18:52:32.800005+0000","last_clean":"2024-05-08T18:52:32.800005+0000","last_became_active":"2024-05-08T18:50:32.035131+0000","last_became_peered":"2024-05-08T18:50:32.035131+0000","last_unstale":"2024-05-08T18:52:32.800005+0000","last_undegraded":"2024-05-08T18:52:32.800005+0000","last_fullsized":"2024-05-08T18:52:32.800005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:01:11.472580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"27'282","reported_seq":430,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111592+0000","last_change":"2024-05-08T18:50:34.047467+0000","last_active":"2024-05-08T18:53:35.111592+0000","last_peered":"2024-05-08T18:53:35.111592+0000","last_clean":"2024-05-08T18:53:35.111592+0000","last_became_active":"2024-05-08T18:50:34.047184+0000","last_became_peered":"2024-05-08T18:50:34.047184+0000","last_unstale":"2024-05-08T18:53:35.111592+0000","last_undegraded":"2024-05-08T18:53:35.111592+0000","last_fullsized":"2024-05-08T18:53:35.111592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:17.134805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"27'12","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.001806+0000","last_change":"2024-05-08T18:50:36.046523+0000","last_active":"2024-05-08T18:52:43.001806+0000","last_peered":"2024-05-08T18:52:43.001806+0000","last_clean":"2024-05-08T18:52:43.001806+0000","last_became_active":"2024-05-08T18:50:36.046209+0000","last_became_peered":"2024-05-08T18:50:36.046209+0000","last_unstale":"2024-05-08T18:52:43.001806+0000","last_undegraded":"2024-05-08T18:52:43.001806+0000","last_fullsized":"2024-05-08T18:52:43.001806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:18.424066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'6","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.661317+0000","last_change":"2024-05-08T18:50:28.037293+0000","last_active":"2024-05-08T18:51:50.661317+0000","last_peered":"2024-05-08T18:51:50.661317+0000","last_clean":"2024-05-08T18:51:50.661317+0000","last_became_active":"2024-05-08T18:50:28.036946+0000","last_became_peered":"2024-05-08T18:50:28.036946+0000","last_unstale":"2024-05-08T18:51:50.661317+0000","last_undegraded":"2024-05-08T18:51:50.661317+0000","last_fullsized":"2024-05-08T18:51:50.661317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:01.592206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076372+0000","last_change":"2024-05-08T18:50:26.027911+0000","last_active":"2024-05-08T18:51:15.076372+0000","last_peered":"2024-05-08T18:51:15.076372+0000","last_clean":"2024-05-08T18:51:15.076372+0000","last_became_active":"2024-05-08T18:50:26.027657+0000","last_became_peered":"2024-05-08T18:50:26.027657+0000","last_unstale":"2024-05-08T18:51:15.076372+0000","last_undegraded":"2024-05-08T18:51:15.076372+0000","last_fullsized":"2024-05-08T18:51:15.076372+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:36.094238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"27'3","reported_seq":413,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.890204+0000","last_change":"2024-05-08T18:50:30.027736+0000","last_active":"2024-05-08T18:52:33.890204+0000","last_peered":"2024-05-08T18:52:33.890204+0000","last_clean":"2024-05-08T18:52:33.890204+0000","last_became_active":"2024-05-08T18:50:30.027420+0000","last_became_peered":"2024-05-08T18:50:30.027420+0000","last_unstale":"2024-05-08T18:52:33.890204+0000","last_undegraded":"2024-05-08T18:52:33.890204+0000","last_fullsized":"2024-05-08T18:52:33.890204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:18.447327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'11","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007718+0000","last_change":"2024-05-08T18:50:32.041941+0000","last_active":"2024-05-08T18:52:48.007718+0000","last_peered":"2024-05-08T18:52:48.007718+0000","last_clean":"2024-05-08T18:52:48.007718+0000","last_became_active":"2024-05-08T18:50:32.040988+0000","last_became_peered":"2024-05-08T18:50:32.040988+0000","last_unstale":"2024-05-08T18:52:48.007718+0000","last_undegraded":"2024-05-08T18:52:48.007718+0000","last_fullsized":"2024-05-08T18:52:48.007718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:07.623019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"27'282","reported_seq":459,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111667+0000","last_change":"2024-05-08T18:50:34.040798+0000","last_active":"2024-05-08T18:53:35.111667+0000","last_peered":"2024-05-08T18:53:35.111667+0000","last_clean":"2024-05-08T18:53:35.111667+0000","last_became_active":"2024-05-08T18:50:34.040477+0000","last_became_peered":"2024-05-08T18:50:34.040477+0000","last_unstale":"2024-05-08T18:53:35.111667+0000","last_undegraded":"2024-05-08T18:53:35.111667+0000","last_fullsized":"2024-05-08T18:53:35.111667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:35.940316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.028319+0000","last_change":"2024-05-08T18:50:36.047258+0000","last_active":"2024-05-08T18:52:34.028319+0000","last_peered":"2024-05-08T18:52:34.028319+0000","last_clean":"2024-05-08T18:52:34.028319+0000","last_became_active":"2024-05-08T18:50:36.045976+0000","last_became_peered":"2024-05-08T18:50:36.045976+0000","last_unstale":"2024-05-08T18:52:34.028319+0000","last_undegraded":"2024-05-08T18:52:34.028319+0000","last_fullsized":"2024-05-08T18:52:34.028319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:00.262083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.823223+0000","last_change":"2024-05-08T18:50:28.039262+0000","last_active":"2024-05-08T18:53:34.823223+0000","last_peered":"2024-05-08T18:53:34.823223+0000","last_clean":"2024-05-08T18:53:34.823223+0000","last_became_active":"2024-05-08T18:50:28.038871+0000","last_became_peered":"2024-05-08T18:50:28.038871+0000","last_unstale":"2024-05-08T18:53:34.823223+0000","last_undegraded":"2024-05-08T18:53:34.823223+0000","last_fullsized":"2024-05-08T18:53:34.823223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:03.400002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073931+0000","last_change":"2024-05-08T18:50:26.025766+0000","last_active":"2024-05-08T18:51:15.073931+0000","last_peered":"2024-05-08T18:51:15.073931+0000","last_clean":"2024-05-08T18:51:15.073931+0000","last_became_active":"2024-05-08T18:50:26.025547+0000","last_became_peered":"2024-05-08T18:50:26.025547+0000","last_unstale":"2024-05-08T18:51:15.073931+0000","last_undegraded":"2024-05-08T18:51:15.073931+0000","last_fullsized":"2024-05-08T18:51:15.073931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:51:35.439520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079352+0000","last_change":"2024-05-08T18:50:30.036033+0000","last_active":"2024-05-08T18:51:15.079352+0000","last_peered":"2024-05-08T18:51:15.079352+0000","last_clean":"2024-05-08T18:51:15.079352+0000","last_became_active":"2024-05-08T18:50:30.035734+0000","last_became_peered":"2024-05-08T18:50:30.035734+0000","last_unstale":"2024-05-08T18:51:15.079352+0000","last_undegraded":"2024-05-08T18:51:15.079352+0000","last_fullsized":"2024-05-08T18:51:15.079352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:58.722929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"27'38","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.786197+0000","last_change":"2024-05-08T18:50:32.035183+0000","last_active":"2024-05-08T18:52:32.786197+0000","last_peered":"2024-05-08T18:52:32.786197+0000","last_clean":"2024-05-08T18:52:32.786197+0000","last_became_active":"2024-05-08T18:50:32.034769+0000","last_became_peered":"2024-05-08T18:50:32.034769+0000","last_unstale":"2024-05-08T18:52:32.786197+0000","last_undegraded":"2024-05-08T18:52:32.786197+0000","last_fullsized":"2024-05-08T18:52:32.786197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:53.194472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076855+0000","last_change":"2024-05-08T18:50:34.050327+0000","last_active":"2024-05-08T18:51:15.076855+0000","last_peered":"2024-05-08T18:51:15.076855+0000","last_clean":"2024-05-08T18:51:15.076855+0000","last_became_active":"2024-05-08T18:50:34.050018+0000","last_became_peered":"2024-05-08T18:50:34.050018+0000","last_unstale":"2024-05-08T18:51:15.076855+0000","last_undegraded":"2024-05-08T18:51:15.076855+0000","last_fullsized":"2024-05-08T18:51:15.076855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:38.228671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"27'8","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.918767+0000","last_change":"2024-05-08T18:50:36.049559+0000","last_active":"2024-05-08T18:53:34.918767+0000","last_peered":"2024-05-08T18:53:34.918767+0000","last_clean":"2024-05-08T18:53:34.918767+0000","last_became_active":"2024-05-08T18:50:36.049274+0000","last_became_peered":"2024-05-08T18:50:36.049274+0000","last_unstale":"2024-05-08T18:53:34.918767+0000","last_undegraded":"2024-05-08T18:53:34.918767+0000","last_fullsized":"2024-05-08T18:53:34.918767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:35.422216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'8","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887656+0000","last_change":"2024-05-08T18:50:28.037991+0000","last_active":"2024-05-08T18:53:34.887656+0000","last_peered":"2024-05-08T18:53:34.887656+0000","last_clean":"2024-05-08T18:53:34.887656+0000","last_became_active":"2024-05-08T18:50:28.037545+0000","last_became_peered":"2024-05-08T18:50:28.037545+0000","last_unstale":"2024-05-08T18:53:34.887656+0000","last_undegraded":"2024-05-08T18:53:34.887656+0000","last_fullsized":"2024-05-08T18:53:34.887656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:00.327493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":133,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073990+0000","last_change":"2024-05-08T18:50:19.740594+0000","last_active":"2024-05-08T18:51:15.073990+0000","last_peered":"2024-05-08T18:51:15.073990+0000","last_clean":"2024-05-08T18:51:15.073990+0000","last_became_active":"2024-05-08T18:50:19.739986+0000","last_became_peered":"2024-05-08T18:50:19.739986+0000","last_unstale":"2024-05-08T18:51:15.073990+0000","last_undegraded":"2024-05-08T18:51:15.073990+0000","last_fullsized":"2024-05-08T18:51:15.073990+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:57.647604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077812+0000","last_change":"2024-05-08T18:50:19.740266+0000","last_active":"2024-05-08T18:51:15.077812+0000","last_peered":"2024-05-08T18:51:15.077812+0000","last_clean":"2024-05-08T18:51:15.077812+0000","last_became_active":"2024-05-08T18:50:19.739403+0000","last_became_peered":"2024-05-08T18:50:19.739403+0000","last_unstale":"2024-05-08T18:51:15.077812+0000","last_undegraded":"2024-05-08T18:51:15.077812+0000","last_fullsized":"2024-05-08T18:51:15.077812+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:59:48.671095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076533+0000","last_change":"2024-05-08T18:50:26.026328+0000","last_active":"2024-05-08T18:51:15.076533+0000","last_peered":"2024-05-08T18:51:15.076533+0000","last_clean":"2024-05-08T18:51:15.076533+0000","last_became_active":"2024-05-08T18:50:26.024249+0000","last_became_peered":"2024-05-08T18:50:26.024249+0000","last_unstale":"2024-05-08T18:51:15.076533+0000","last_undegraded":"2024-05-08T18:51:15.076533+0000","last_fullsized":"2024-05-08T18:51:15.076533+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:04.180310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078700+0000","last_change":"2024-05-08T18:50:30.030654+0000","last_active":"2024-05-08T18:51:15.078700+0000","last_peered":"2024-05-08T18:51:15.078700+0000","last_clean":"2024-05-08T18:51:15.078700+0000","last_became_active":"2024-05-08T18:50:30.029744+0000","last_became_peered":"2024-05-08T18:50:30.029744+0000","last_unstale":"2024-05-08T18:51:15.078700+0000","last_undegraded":"2024-05-08T18:51:15.078700+0000","last_fullsized":"2024-05-08T18:51:15.078700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:45.741064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"27'76","reported_seq":145,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.797996+0000","last_change":"2024-05-08T18:50:32.043836+0000","last_active":"2024-05-08T18:52:32.797996+0000","last_peered":"2024-05-08T18:52:32.797996+0000","last_clean":"2024-05-08T18:52:32.797996+0000","last_became_active":"2024-05-08T18:50:32.043533+0000","last_became_peered":"2024-05-08T18:50:32.043533+0000","last_unstale":"2024-05-08T18:52:32.797996+0000","last_undegraded":"2024-05-08T18:52:32.797996+0000","last_fullsized":"2024-05-08T18:52:32.797996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:19.800626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074939+0000","last_change":"2024-05-08T18:50:34.049133+0000","last_active":"2024-05-08T18:51:15.074939+0000","last_peered":"2024-05-08T18:51:15.074939+0000","last_clean":"2024-05-08T18:51:15.074939+0000","last_became_active":"2024-05-08T18:50:34.048859+0000","last_became_peered":"2024-05-08T18:50:34.048859+0000","last_unstale":"2024-05-08T18:51:15.074939+0000","last_undegraded":"2024-05-08T18:51:15.074939+0000","last_fullsized":"2024-05-08T18:51:15.074939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:08:07.162123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"27'81","reported_seq":162,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.897033+0000","last_change":"2024-05-08T18:50:36.045215+0000","last_active":"2024-05-08T18:53:34.897033+0000","last_peered":"2024-05-08T18:53:34.897033+0000","last_clean":"2024-05-08T18:53:34.897033+0000","last_became_active":"2024-05-08T18:50:36.044928+0000","last_became_peered":"2024-05-08T18:50:36.044928+0000","last_unstale":"2024-05-08T18:53:34.897033+0000","last_undegraded":"2024-05-08T18:53:34.897033+0000","last_fullsized":"2024-05-08T18:53:34.897033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:21.101455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"27'4","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.475111+0000","last_change":"2024-05-08T18:50:28.032137+0000","last_active":"2024-05-08T18:51:50.475111+0000","last_peered":"2024-05-08T18:51:50.475111+0000","last_clean":"2024-05-08T18:51:50.475111+0000","last_became_active":"2024-05-08T18:50:28.030761+0000","last_became_peered":"2024-05-08T18:50:28.030761+0000","last_unstale":"2024-05-08T18:51:50.475111+0000","last_undegraded":"2024-05-08T18:51:50.475111+0000","last_fullsized":"2024-05-08T18:51:50.475111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:32.207743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073767+0000","last_change":"2024-05-08T18:50:19.739194+0000","last_active":"2024-05-08T18:51:15.073767+0000","last_peered":"2024-05-08T18:51:15.073767+0000","last_clean":"2024-05-08T18:51:15.073767+0000","last_became_active":"2024-05-08T18:50:19.738872+0000","last_became_peered":"2024-05-08T18:50:19.738872+0000","last_unstale":"2024-05-08T18:51:15.073767+0000","last_undegraded":"2024-05-08T18:51:15.073767+0000","last_fullsized":"2024-05-08T18:51:15.073767+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:28:20.859312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072516+0000","last_change":"2024-05-08T18:50:26.024886+0000","last_active":"2024-05-08T18:51:15.072516+0000","last_peered":"2024-05-08T18:51:15.072516+0000","last_clean":"2024-05-08T18:51:15.072516+0000","last_became_active":"2024-05-08T18:50:26.024549+0000","last_became_peered":"2024-05-08T18:50:26.024549+0000","last_unstale":"2024-05-08T18:51:15.072516+0000","last_undegraded":"2024-05-08T18:51:15.072516+0000","last_fullsized":"2024-05-08T18:51:15.072516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:47.912064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.089720+0000","last_change":"2024-05-08T18:51:15.084930+0000","last_active":"2024-05-08T18:51:15.089720+0000","last_peered":"2024-05-08T18:51:15.089720+0000","last_clean":"2024-05-08T18:51:15.089720+0000","last_became_active":"2024-05-08T18:51:15.084599+0000","last_became_peered":"2024-05-08T18:51:15.084599+0000","last_unstale":"2024-05-08T18:51:15.089720+0000","last_undegraded":"2024-05-08T18:51:15.089720+0000","last_fullsized":"2024-05-08T18:51:15.089720+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:34.404707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"27'273","reported_seq":476,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111615+0000","last_change":"2024-05-08T18:50:32.044834+0000","last_active":"2024-05-08T18:53:35.111615+0000","last_peered":"2024-05-08T18:53:35.111615+0000","last_clean":"2024-05-08T18:53:35.111615+0000","last_became_active":"2024-05-08T18:50:32.044539+0000","last_became_peered":"2024-05-08T18:50:32.044539+0000","last_unstale":"2024-05-08T18:53:35.111615+0000","last_undegraded":"2024-05-08T18:53:35.111615+0000","last_fullsized":"2024-05-08T18:53:35.111615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:10.225343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077927+0000","last_change":"2024-05-08T18:50:34.044400+0000","last_active":"2024-05-08T18:51:15.077927+0000","last_peered":"2024-05-08T18:51:15.077927+0000","last_clean":"2024-05-08T18:51:15.077927+0000","last_became_active":"2024-05-08T18:50:34.043966+0000","last_became_peered":"2024-05-08T18:50:34.043966+0000","last_unstale":"2024-05-08T18:51:15.077927+0000","last_undegraded":"2024-05-08T18:51:15.077927+0000","last_fullsized":"2024-05-08T18:51:15.077927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:35.369229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"27'3","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.479087+0000","last_change":"2024-05-08T18:50:36.050905+0000","last_active":"2024-05-08T18:51:50.479087+0000","last_peered":"2024-05-08T18:51:50.479087+0000","last_clean":"2024-05-08T18:51:50.479087+0000","last_became_active":"2024-05-08T18:50:36.050573+0000","last_became_peered":"2024-05-08T18:50:36.050573+0000","last_unstale":"2024-05-08T18:51:50.479087+0000","last_undegraded":"2024-05-08T18:51:50.479087+0000","last_fullsized":"2024-05-08T18:51:50.479087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:54:56.963493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:31.121841+0000","last_change":"2024-05-08T18:50:28.027882+0000","last_active":"2024-05-08T18:52:31.121841+0000","last_peered":"2024-05-08T18:52:31.121841+0000","last_clean":"2024-05-08T18:52:31.121841+0000","last_became_active":"2024-05-08T18:50:28.027492+0000","last_became_peered":"2024-05-08T18:50:28.027492+0000","last_unstale":"2024-05-08T18:52:31.121841+0000","last_undegraded":"2024-05-08T18:52:31.121841+0000","last_fullsized":"2024-05-08T18:52:31.121841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:13.501403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074929+0000","last_change":"2024-05-08T18:50:19.739149+0000","last_active":"2024-05-08T18:51:15.074929+0000","last_peered":"2024-05-08T18:51:15.074929+0000","last_clean":"2024-05-08T18:51:15.074929+0000","last_became_active":"2024-05-08T18:50:19.738788+0000","last_became_peered":"2024-05-08T18:50:19.738788+0000","last_unstale":"2024-05-08T18:51:15.074929+0000","last_undegraded":"2024-05-08T18:51:15.074929+0000","last_fullsized":"2024-05-08T18:51:15.074929+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:29:46.772075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.071890+0000","last_change":"2024-05-08T18:50:26.029767+0000","last_active":"2024-05-08T18:51:15.071890+0000","last_peered":"2024-05-08T18:51:15.071890+0000","last_clean":"2024-05-08T18:51:15.071890+0000","last_became_active":"2024-05-08T18:50:26.029197+0000","last_became_peered":"2024-05-08T18:50:26.029197+0000","last_unstale":"2024-05-08T18:51:15.071890+0000","last_undegraded":"2024-05-08T18:51:15.071890+0000","last_fullsized":"2024-05-08T18:51:15.071890+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:59.917414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"18'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076801+0000","last_change":"2024-05-08T18:50:30.028419+0000","last_active":"2024-05-08T18:51:15.076801+0000","last_peered":"2024-05-08T18:51:15.076801+0000","last_clean":"2024-05-08T18:51:15.076801+0000","last_became_active":"2024-05-08T18:50:30.028028+0000","last_became_peered":"2024-05-08T18:50:30.028028+0000","last_unstale":"2024-05-08T18:51:15.076801+0000","last_undegraded":"2024-05-08T18:51:15.076801+0000","last_fullsized":"2024-05-08T18:51:15.076801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:34.893503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"27'16","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:30.110915+0000","last_change":"2024-05-08T18:50:32.036344+0000","last_active":"2024-05-08T18:53:30.110915+0000","last_peered":"2024-05-08T18:53:30.110915+0000","last_clean":"2024-05-08T18:53:30.110915+0000","last_became_active":"2024-05-08T18:50:32.036051+0000","last_became_peered":"2024-05-08T18:50:32.036051+0000","last_unstale":"2024-05-08T18:53:30.110915+0000","last_undegraded":"2024-05-08T18:53:30.110915+0000","last_fullsized":"2024-05-08T18:53:30.110915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:48.691605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073226+0000","last_change":"2024-05-08T18:50:34.045839+0000","last_active":"2024-05-08T18:51:15.073226+0000","last_peered":"2024-05-08T18:51:15.073226+0000","last_clean":"2024-05-08T18:51:15.073226+0000","last_became_active":"2024-05-08T18:50:34.045541+0000","last_became_peered":"2024-05-08T18:50:34.045541+0000","last_unstale":"2024-05-08T18:51:15.073226+0000","last_undegraded":"2024-05-08T18:51:15.073226+0000","last_fullsized":"2024-05-08T18:51:15.073226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:02.736870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077233+0000","last_change":"2024-05-08T18:50:36.058086+0000","last_active":"2024-05-08T18:51:15.077233+0000","last_peered":"2024-05-08T18:51:15.077233+0000","last_clean":"2024-05-08T18:51:15.077233+0000","last_became_active":"2024-05-08T18:50:36.057093+0000","last_became_peered":"2024-05-08T18:50:36.057093+0000","last_unstale":"2024-05-08T18:51:15.077233+0000","last_undegraded":"2024-05-08T18:51:15.077233+0000","last_fullsized":"2024-05-08T18:51:15.077233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:29:55.363199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'22","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887602+0000","last_change":"2024-05-08T18:50:28.026195+0000","last_active":"2024-05-08T18:53:34.887602+0000","last_peered":"2024-05-08T18:53:34.887602+0000","last_clean":"2024-05-08T18:53:34.887602+0000","last_became_active":"2024-05-08T18:50:28.025645+0000","last_became_peered":"2024-05-08T18:50:28.025645+0000","last_unstale":"2024-05-08T18:53:34.887602+0000","last_undegraded":"2024-05-08T18:53:34.887602+0000","last_fullsized":"2024-05-08T18:53:34.887602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:24.508392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076436+0000","last_change":"2024-05-08T18:50:19.739898+0000","last_active":"2024-05-08T18:51:15.076436+0000","last_peered":"2024-05-08T18:51:15.076436+0000","last_clean":"2024-05-08T18:51:15.076436+0000","last_became_active":"2024-05-08T18:50:19.739620+0000","last_became_peered":"2024-05-08T18:50:19.739620+0000","last_unstale":"2024-05-08T18:51:15.076436+0000","last_undegraded":"2024-05-08T18:51:15.076436+0000","last_fullsized":"2024-05-08T18:51:15.076436+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:58.286521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.651104+0000","last_change":"2024-05-08T18:50:26.023831+0000","last_active":"2024-05-08T18:51:50.651104+0000","last_peered":"2024-05-08T18:51:50.651104+0000","last_clean":"2024-05-08T18:51:50.651104+0000","last_became_active":"2024-05-08T18:50:26.023522+0000","last_became_peered":"2024-05-08T18:50:26.023522+0000","last_unstale":"2024-05-08T18:51:50.651104+0000","last_undegraded":"2024-05-08T18:51:50.651104+0000","last_fullsized":"2024-05-08T18:51:50.651104+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:07.271771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075093+0000","last_change":"2024-05-08T18:50:30.035182+0000","last_active":"2024-05-08T18:51:15.075093+0000","last_peered":"2024-05-08T18:51:15.075093+0000","last_clean":"2024-05-08T18:51:15.075093+0000","last_became_active":"2024-05-08T18:50:30.034806+0000","last_became_peered":"2024-05-08T18:50:30.034806+0000","last_unstale":"2024-05-08T18:51:15.075093+0000","last_undegraded":"2024-05-08T18:51:15.075093+0000","last_fullsized":"2024-05-08T18:51:15.075093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:21.995734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"27'13","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.256028+0000","last_change":"2024-05-08T18:50:32.042494+0000","last_active":"2024-05-08T18:53:34.256028+0000","last_peered":"2024-05-08T18:53:34.256028+0000","last_clean":"2024-05-08T18:53:34.256028+0000","last_became_active":"2024-05-08T18:50:32.042183+0000","last_became_peered":"2024-05-08T18:50:32.042183+0000","last_unstale":"2024-05-08T18:53:34.256028+0000","last_undegraded":"2024-05-08T18:53:34.256028+0000","last_fullsized":"2024-05-08T18:53:34.256028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:21.537487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.082328+0000","last_change":"2024-05-08T18:50:34.045641+0000","last_active":"2024-05-08T18:51:15.082328+0000","last_peered":"2024-05-08T18:51:15.082328+0000","last_clean":"2024-05-08T18:51:15.082328+0000","last_became_active":"2024-05-08T18:50:34.044358+0000","last_became_peered":"2024-05-08T18:50:34.044358+0000","last_unstale":"2024-05-08T18:51:15.082328+0000","last_undegraded":"2024-05-08T18:51:15.082328+0000","last_fullsized":"2024-05-08T18:51:15.082328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:30:35.167490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.008973+0000","last_change":"2024-05-08T18:50:36.058516+0000","last_active":"2024-05-08T18:52:34.008973+0000","last_peered":"2024-05-08T18:52:34.008973+0000","last_clean":"2024-05-08T18:52:34.008973+0000","last_became_active":"2024-05-08T18:50:36.058267+0000","last_became_peered":"2024-05-08T18:50:36.058267+0000","last_unstale":"2024-05-08T18:52:34.008973+0000","last_undegraded":"2024-05-08T18:52:34.008973+0000","last_fullsized":"2024-05-08T18:52:34.008973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:30.137484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'12","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.607240+0000","last_change":"2024-05-08T18:50:28.039245+0000","last_active":"2024-05-08T18:53:34.607240+0000","last_peered":"2024-05-08T18:53:34.607240+0000","last_clean":"2024-05-08T18:53:34.607240+0000","last_became_active":"2024-05-08T18:50:28.038935+0000","last_became_peered":"2024-05-08T18:50:28.038935+0000","last_unstale":"2024-05-08T18:53:34.607240+0000","last_undegraded":"2024-05-08T18:53:34.607240+0000","last_fullsized":"2024-05-08T18:53:34.607240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:44.968210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075852+0000","last_change":"2024-05-08T18:50:26.019026+0000","last_active":"2024-05-08T18:51:15.075852+0000","last_peered":"2024-05-08T18:51:15.075852+0000","last_clean":"2024-05-08T18:51:15.075852+0000","last_became_active":"2024-05-08T18:50:26.018739+0000","last_became_peered":"2024-05-08T18:50:26.018739+0000","last_unstale":"2024-05-08T18:51:15.075852+0000","last_undegraded":"2024-05-08T18:51:15.075852+0000","last_fullsized":"2024-05-08T18:51:15.075852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:13.215678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073107+0000","last_change":"2024-05-08T18:50:19.741144+0000","last_active":"2024-05-08T18:51:15.073107+0000","last_peered":"2024-05-08T18:51:15.073107+0000","last_clean":"2024-05-08T18:51:15.073107+0000","last_became_active":"2024-05-08T18:50:19.740835+0000","last_became_peered":"2024-05-08T18:50:19.740835+0000","last_unstale":"2024-05-08T18:51:15.073107+0000","last_undegraded":"2024-05-08T18:51:15.073107+0000","last_fullsized":"2024-05-08T18:51:15.073107+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:30.349801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"27'1","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:23.012864+0000","last_change":"2024-05-08T18:51:15.083500+0000","last_active":"2024-05-08T18:53:23.012864+0000","last_peered":"2024-05-08T18:53:23.012864+0000","last_clean":"2024-05-08T18:53:23.012864+0000","last_became_active":"2024-05-08T18:51:15.083141+0000","last_became_peered":"2024-05-08T18:51:15.083141+0000","last_unstale":"2024-05-08T18:53:23.012864+0000","last_undegraded":"2024-05-08T18:53:23.012864+0000","last_fullsized":"2024-05-08T18:53:23.012864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:11.583016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"27'61","reported_seq":120,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.000350+0000","last_change":"2024-05-08T18:50:32.042368+0000","last_active":"2024-05-08T18:52:33.000350+0000","last_peered":"2024-05-08T18:52:33.000350+0000","last_clean":"2024-05-08T18:52:33.000350+0000","last_became_active":"2024-05-08T18:50:32.042046+0000","last_became_peered":"2024-05-08T18:50:32.042046+0000","last_unstale":"2024-05-08T18:52:33.000350+0000","last_undegraded":"2024-05-08T18:52:33.000350+0000","last_fullsized":"2024-05-08T18:52:33.000350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:02.233245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076297+0000","last_change":"2024-05-08T18:50:34.044814+0000","last_active":"2024-05-08T18:51:15.076297+0000","last_peered":"2024-05-08T18:51:15.076297+0000","last_clean":"2024-05-08T18:51:15.076297+0000","last_became_active":"2024-05-08T18:50:34.044520+0000","last_became_peered":"2024-05-08T18:50:34.044520+0000","last_unstale":"2024-05-08T18:51:15.076297+0000","last_undegraded":"2024-05-08T18:51:15.076297+0000","last_fullsized":"2024-05-08T18:51:15.076297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:02.505892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.182379+0000","last_change":"2024-05-08T18:50:36.047417+0000","last_active":"2024-05-08T18:52:34.182379+0000","last_peered":"2024-05-08T18:52:34.182379+0000","last_clean":"2024-05-08T18:52:34.182379+0000","last_became_active":"2024-05-08T18:50:36.046757+0000","last_became_peered":"2024-05-08T18:50:36.046757+0000","last_unstale":"2024-05-08T18:52:34.182379+0000","last_undegraded":"2024-05-08T18:52:34.182379+0000","last_fullsized":"2024-05-08T18:52:34.182379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.465327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"27'10","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.823507+0000","last_change":"2024-05-08T18:51:15.095543+0000","last_active":"2024-05-08T18:53:34.823507+0000","last_peered":"2024-05-08T18:53:34.823507+0000","last_clean":"2024-05-08T18:53:34.823507+0000","last_became_active":"2024-05-08T18:51:15.084151+0000","last_became_peered":"2024-05-08T18:51:15.084151+0000","last_unstale":"2024-05-08T18:53:34.823507+0000","last_undegraded":"2024-05-08T18:53:34.823507+0000","last_fullsized":"2024-05-08T18:53:34.823507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:15.066531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074090+0000","last_change":"2024-05-08T18:50:26.025460+0000","last_active":"2024-05-08T18:51:15.074090+0000","last_peered":"2024-05-08T18:51:15.074090+0000","last_clean":"2024-05-08T18:51:15.074090+0000","last_became_active":"2024-05-08T18:50:26.024894+0000","last_became_peered":"2024-05-08T18:50:26.024894+0000","last_unstale":"2024-05-08T18:51:15.074090+0000","last_undegraded":"2024-05-08T18:51:15.074090+0000","last_fullsized":"2024-05-08T18:51:15.074090+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:40.472317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079603+0000","last_change":"2024-05-08T18:50:19.739473+0000","last_active":"2024-05-08T18:51:15.079603+0000","last_peered":"2024-05-08T18:51:15.079603+0000","last_clean":"2024-05-08T18:51:15.079603+0000","last_became_active":"2024-05-08T18:50:19.739124+0000","last_became_peered":"2024-05-08T18:50:19.739124+0000","last_unstale":"2024-05-08T18:51:15.079603+0000","last_undegraded":"2024-05-08T18:51:15.079603+0000","last_fullsized":"2024-05-08T18:51:15.079603+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:22.202213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076770+0000","last_change":"2024-05-08T18:50:30.033607+0000","last_active":"2024-05-08T18:51:15.076770+0000","last_peered":"2024-05-08T18:51:15.076770+0000","last_clean":"2024-05-08T18:51:15.076770+0000","last_became_active":"2024-05-08T18:50:30.032546+0000","last_became_peered":"2024-05-08T18:50:30.032546+0000","last_unstale":"2024-05-08T18:51:15.076770+0000","last_undegraded":"2024-05-08T18:51:15.076770+0000","last_fullsized":"2024-05-08T18:51:15.076770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:48.521683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"25'14","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076154+0000","last_change":"2024-05-08T18:50:32.040984+0000","last_active":"2024-05-08T18:51:15.076154+0000","last_peered":"2024-05-08T18:51:15.076154+0000","last_clean":"2024-05-08T18:51:15.076154+0000","last_became_active":"2024-05-08T18:50:32.040767+0000","last_became_peered":"2024-05-08T18:50:32.040767+0000","last_unstale":"2024-05-08T18:51:15.076154+0000","last_undegraded":"2024-05-08T18:51:15.076154+0000","last_fullsized":"2024-05-08T18:51:15.076154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:26.346126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"27'282","reported_seq":374,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111761+0000","last_change":"2024-05-08T18:50:34.043559+0000","last_active":"2024-05-08T18:53:35.111761+0000","last_peered":"2024-05-08T18:53:35.111761+0000","last_clean":"2024-05-08T18:53:35.111761+0000","last_became_active":"2024-05-08T18:50:34.043167+0000","last_became_peered":"2024-05-08T18:50:34.043167+0000","last_unstale":"2024-05-08T18:53:35.111761+0000","last_undegraded":"2024-05-08T18:53:35.111761+0000","last_fullsized":"2024-05-08T18:53:35.111761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:50.430816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.849637+0000","last_change":"2024-05-08T18:50:36.061014+0000","last_active":"2024-05-08T18:53:34.849637+0000","last_peered":"2024-05-08T18:53:34.849637+0000","last_clean":"2024-05-08T18:53:34.849637+0000","last_became_active":"2024-05-08T18:50:36.060727+0000","last_became_peered":"2024-05-08T18:50:36.060727+0000","last_unstale":"2024-05-08T18:53:34.849637+0000","last_undegraded":"2024-05-08T18:53:34.849637+0000","last_fullsized":"2024-05-08T18:53:34.849637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:01.420579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"27'22","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.690982+0000","last_change":"2024-05-08T18:51:15.092701+0000","last_active":"2024-05-08T18:53:34.690982+0000","last_peered":"2024-05-08T18:53:34.690982+0000","last_clean":"2024-05-08T18:53:34.690982+0000","last_became_active":"2024-05-08T18:51:15.083568+0000","last_became_peered":"2024-05-08T18:51:15.083568+0000","last_unstale":"2024-05-08T18:53:34.690982+0000","last_undegraded":"2024-05-08T18:53:34.690982+0000","last_fullsized":"2024-05-08T18:53:34.690982+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:43.282786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":68,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.883437+0000","last_change":"2024-05-08T18:50:26.016666+0000","last_active":"2024-05-08T18:53:34.883437+0000","last_peered":"2024-05-08T18:53:34.883437+0000","last_clean":"2024-05-08T18:53:34.883437+0000","last_became_active":"2024-05-08T18:50:26.016210+0000","last_became_peered":"2024-05-08T18:50:26.016210+0000","last_unstale":"2024-05-08T18:53:34.883437+0000","last_undegraded":"2024-05-08T18:53:34.883437+0000","last_fullsized":"2024-05-08T18:53:34.883437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:11.494472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074021+0000","last_change":"2024-05-08T18:50:19.740832+0000","last_active":"2024-05-08T18:51:15.074021+0000","last_peered":"2024-05-08T18:51:15.074021+0000","last_clean":"2024-05-08T18:51:15.074021+0000","last_became_active":"2024-05-08T18:50:19.740355+0000","last_became_peered":"2024-05-08T18:50:19.740355+0000","last_unstale":"2024-05-08T18:51:15.074021+0000","last_undegraded":"2024-05-08T18:51:15.074021+0000","last_fullsized":"2024-05-08T18:51:15.074021+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:57.647604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077142+0000","last_change":"2024-05-08T18:50:30.033678+0000","last_active":"2024-05-08T18:51:15.077142+0000","last_peered":"2024-05-08T18:51:15.077142+0000","last_clean":"2024-05-08T18:51:15.077142+0000","last_became_active":"2024-05-08T18:50:30.031351+0000","last_became_peered":"2024-05-08T18:50:30.031351+0000","last_unstale":"2024-05-08T18:51:15.077142+0000","last_undegraded":"2024-05-08T18:51:15.077142+0000","last_fullsized":"2024-05-08T18:51:15.077142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:08.066057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"25'10","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077487+0000","last_change":"2024-05-08T18:50:32.042333+0000","last_active":"2024-05-08T18:51:15.077487+0000","last_peered":"2024-05-08T18:51:15.077487+0000","last_clean":"2024-05-08T18:51:15.077487+0000","last_became_active":"2024-05-08T18:50:32.041231+0000","last_became_peered":"2024-05-08T18:50:32.041231+0000","last_unstale":"2024-05-08T18:51:15.077487+0000","last_undegraded":"2024-05-08T18:51:15.077487+0000","last_fullsized":"2024-05-08T18:51:15.077487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:21.403251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"27'282","reported_seq":389,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111732+0000","last_change":"2024-05-08T18:50:34.048062+0000","last_active":"2024-05-08T18:53:35.111732+0000","last_peered":"2024-05-08T18:53:35.111732+0000","last_clean":"2024-05-08T18:53:35.111732+0000","last_became_active":"2024-05-08T18:50:34.047608+0000","last_became_peered":"2024-05-08T18:50:34.047608+0000","last_unstale":"2024-05-08T18:53:35.111732+0000","last_undegraded":"2024-05-08T18:53:35.111732+0000","last_fullsized":"2024-05-08T18:53:35.111732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:50.430816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"25'5","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076053+0000","last_change":"2024-05-08T18:50:36.055086+0000","last_active":"2024-05-08T18:51:15.076053+0000","last_peered":"2024-05-08T18:51:15.076053+0000","last_clean":"2024-05-08T18:51:15.076053+0000","last_became_active":"2024-05-08T18:50:36.054747+0000","last_became_peered":"2024-05-08T18:50:36.054747+0000","last_unstale":"2024-05-08T18:51:15.076053+0000","last_undegraded":"2024-05-08T18:51:15.076053+0000","last_fullsized":"2024-05-08T18:51:15.076053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:23.094874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887634+0000","last_change":"2024-05-08T18:50:28.033530+0000","last_active":"2024-05-08T18:53:34.887634+0000","last_peered":"2024-05-08T18:53:34.887634+0000","last_clean":"2024-05-08T18:53:34.887634+0000","last_became_active":"2024-05-08T18:50:28.033163+0000","last_became_peered":"2024-05-08T18:50:28.033163+0000","last_unstale":"2024-05-08T18:53:34.887634+0000","last_undegraded":"2024-05-08T18:53:34.887634+0000","last_fullsized":"2024-05-08T18:53:34.887634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:06.589941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081490+0000","last_change":"2024-05-08T18:50:26.027003+0000","last_active":"2024-05-08T18:51:15.081490+0000","last_peered":"2024-05-08T18:51:15.081490+0000","last_clean":"2024-05-08T18:51:15.081490+0000","last_became_active":"2024-05-08T18:50:26.026719+0000","last_became_peered":"2024-05-08T18:50:26.026719+0000","last_unstale":"2024-05-08T18:51:15.081490+0000","last_undegraded":"2024-05-08T18:51:15.081490+0000","last_fullsized":"2024-05-08T18:51:15.081490+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:47.462940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.082412+0000","last_change":"2024-05-08T18:50:19.739345+0000","last_active":"2024-05-08T18:51:15.082412+0000","last_peered":"2024-05-08T18:51:15.082412+0000","last_clean":"2024-05-08T18:51:15.082412+0000","last_became_active":"2024-05-08T18:50:19.738971+0000","last_became_peered":"2024-05-08T18:50:19.738971+0000","last_unstale":"2024-05-08T18:51:15.082412+0000","last_undegraded":"2024-05-08T18:51:15.082412+0000","last_fullsized":"2024-05-08T18:51:15.082412+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:52:49.278410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075321+0000","last_change":"2024-05-08T18:50:30.033620+0000","last_active":"2024-05-08T18:51:15.075321+0000","last_peered":"2024-05-08T18:51:15.075321+0000","last_clean":"2024-05-08T18:51:15.075321+0000","last_became_active":"2024-05-08T18:50:30.032197+0000","last_became_peered":"2024-05-08T18:50:30.032197+0000","last_unstale":"2024-05-08T18:51:15.075321+0000","last_undegraded":"2024-05-08T18:51:15.075321+0000","last_fullsized":"2024-05-08T18:51:15.075321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:31.926375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"27'82","reported_seq":154,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.784016+0000","last_change":"2024-05-08T18:50:32.043393+0000","last_active":"2024-05-08T18:52:32.784016+0000","last_peered":"2024-05-08T18:52:32.784016+0000","last_clean":"2024-05-08T18:52:32.784016+0000","last_became_active":"2024-05-08T18:50:32.043109+0000","last_became_peered":"2024-05-08T18:50:32.043109+0000","last_unstale":"2024-05-08T18:52:32.784016+0000","last_undegraded":"2024-05-08T18:52:32.784016+0000","last_fullsized":"2024-05-08T18:52:32.784016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:05.292535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073040+0000","last_change":"2024-05-08T18:50:34.043856+0000","last_active":"2024-05-08T18:51:15.073040+0000","last_peered":"2024-05-08T18:51:15.073040+0000","last_clean":"2024-05-08T18:51:15.073040+0000","last_became_active":"2024-05-08T18:50:34.043495+0000","last_became_peered":"2024-05-08T18:50:34.043495+0000","last_unstale":"2024-05-08T18:51:15.073040+0000","last_undegraded":"2024-05-08T18:51:15.073040+0000","last_fullsized":"2024-05-08T18:51:15.073040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:35.940316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"25'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073950+0000","last_change":"2024-05-08T18:50:36.044755+0000","last_active":"2024-05-08T18:51:15.073950+0000","last_peered":"2024-05-08T18:51:15.073950+0000","last_clean":"2024-05-08T18:51:15.073950+0000","last_became_active":"2024-05-08T18:50:36.044491+0000","last_became_peered":"2024-05-08T18:50:36.044491+0000","last_unstale":"2024-05-08T18:51:15.073950+0000","last_undegraded":"2024-05-08T18:51:15.073950+0000","last_fullsized":"2024-05-08T18:51:15.073950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:26:24.798211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078569+0000","last_change":"2024-05-08T18:50:36.050995+0000","last_active":"2024-05-08T18:51:15.078569+0000","last_peered":"2024-05-08T18:51:15.078569+0000","last_clean":"2024-05-08T18:51:15.078569+0000","last_became_active":"2024-05-08T18:50:36.050722+0000","last_became_peered":"2024-05-08T18:50:36.050722+0000","last_unstale":"2024-05-08T18:51:15.078569+0000","last_undegraded":"2024-05-08T18:51:15.078569+0000","last_fullsized":"2024-05-08T18:51:15.078569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:14.087413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"27'9","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.868849+0000","last_change":"2024-05-08T18:50:28.033284+0000","last_active":"2024-05-08T18:53:34.868849+0000","last_peered":"2024-05-08T18:53:34.868849+0000","last_clean":"2024-05-08T18:53:34.868849+0000","last_became_active":"2024-05-08T18:50:28.033010+0000","last_became_peered":"2024-05-08T18:50:28.033010+0000","last_unstale":"2024-05-08T18:53:34.868849+0000","last_undegraded":"2024-05-08T18:53:34.868849+0000","last_fullsized":"2024-05-08T18:53:34.868849+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:06.187241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077875+0000","last_change":"2024-05-08T18:50:26.027008+0000","last_active":"2024-05-08T18:51:15.077875+0000","last_peered":"2024-05-08T18:51:15.077875+0000","last_clean":"2024-05-08T18:51:15.077875+0000","last_became_active":"2024-05-08T18:50:26.025828+0000","last_became_peered":"2024-05-08T18:50:26.025828+0000","last_unstale":"2024-05-08T18:51:15.077875+0000","last_undegraded":"2024-05-08T18:51:15.077875+0000","last_fullsized":"2024-05-08T18:51:15.077875+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:08:54.741439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.083669+0000","last_change":"2024-05-08T18:51:15.082912+0000","last_active":"2024-05-08T18:51:15.083669+0000","last_peered":"2024-05-08T18:51:15.083669+0000","last_clean":"2024-05-08T18:51:15.083669+0000","last_became_active":"2024-05-08T18:51:15.082590+0000","last_became_peered":"2024-05-08T18:51:15.082590+0000","last_unstale":"2024-05-08T18:51:15.083669+0000","last_undegraded":"2024-05-08T18:51:15.083669+0000","last_fullsized":"2024-05-08T18:51:15.083669+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:19.530329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"27'33","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.790036+0000","last_change":"2024-05-08T18:50:32.038887+0000","last_active":"2024-05-08T18:52:32.790036+0000","last_peered":"2024-05-08T18:52:32.790036+0000","last_clean":"2024-05-08T18:52:32.790036+0000","last_became_active":"2024-05-08T18:50:32.038591+0000","last_became_peered":"2024-05-08T18:50:32.038591+0000","last_unstale":"2024-05-08T18:52:32.790036+0000","last_undegraded":"2024-05-08T18:52:32.790036+0000","last_fullsized":"2024-05-08T18:52:32.790036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:52.451129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075130+0000","last_change":"2024-05-08T18:50:34.051041+0000","last_active":"2024-05-08T18:51:15.075130+0000","last_peered":"2024-05-08T18:51:15.075130+0000","last_clean":"2024-05-08T18:51:15.075130+0000","last_became_active":"2024-05-08T18:50:34.050749+0000","last_became_peered":"2024-05-08T18:50:34.050749+0000","last_unstale":"2024-05-08T18:51:15.075130+0000","last_undegraded":"2024-05-08T18:51:15.075130+0000","last_fullsized":"2024-05-08T18:51:15.075130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:34.776407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"27'15","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.692332+0000","last_change":"2024-05-08T18:50:36.054332+0000","last_active":"2024-05-08T18:53:34.692332+0000","last_peered":"2024-05-08T18:53:34.692332+0000","last_clean":"2024-05-08T18:53:34.692332+0000","last_became_active":"2024-05-08T18:50:36.054102+0000","last_became_peered":"2024-05-08T18:50:36.054102+0000","last_unstale":"2024-05-08T18:53:34.692332+0000","last_undegraded":"2024-05-08T18:53:34.692332+0000","last_fullsized":"2024-05-08T18:53:34.692332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:40.601584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"27'6","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.691151+0000","last_change":"2024-05-08T18:50:28.038986+0000","last_active":"2024-05-08T18:53:34.691151+0000","last_peered":"2024-05-08T18:53:34.691151+0000","last_clean":"2024-05-08T18:53:34.691151+0000","last_became_active":"2024-05-08T18:50:28.038587+0000","last_became_peered":"2024-05-08T18:50:28.038587+0000","last_unstale":"2024-05-08T18:53:34.691151+0000","last_undegraded":"2024-05-08T18:53:34.691151+0000","last_fullsized":"2024-05-08T18:53:34.691151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:55.994310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075642+0000","last_change":"2024-05-08T18:50:26.031798+0000","last_active":"2024-05-08T18:51:15.075642+0000","last_peered":"2024-05-08T18:51:15.075642+0000","last_clean":"2024-05-08T18:51:15.075642+0000","last_became_active":"2024-05-08T18:50:26.031509+0000","last_became_peered":"2024-05-08T18:50:26.031509+0000","last_unstale":"2024-05-08T18:51:15.075642+0000","last_undegraded":"2024-05-08T18:51:15.075642+0000","last_fullsized":"2024-05-08T18:51:15.075642+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:13:25.895646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.082399+0000","last_change":"2024-05-08T18:50:30.035310+0000","last_active":"2024-05-08T18:51:15.082399+0000","last_peered":"2024-05-08T18:51:15.082399+0000","last_clean":"2024-05-08T18:51:15.082399+0000","last_became_active":"2024-05-08T18:50:30.034178+0000","last_became_peered":"2024-05-08T18:50:30.034178+0000","last_unstale":"2024-05-08T18:51:15.082399+0000","last_undegraded":"2024-05-08T18:51:15.082399+0000","last_fullsized":"2024-05-08T18:51:15.082399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:07.748171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.260326+0000","last_change":"2024-05-08T18:50:32.036694+0000","last_active":"2024-05-08T18:53:34.260326+0000","last_peered":"2024-05-08T18:53:34.260326+0000","last_clean":"2024-05-08T18:53:34.260326+0000","last_became_active":"2024-05-08T18:50:32.036371+0000","last_became_peered":"2024-05-08T18:50:32.036371+0000","last_unstale":"2024-05-08T18:53:34.260326+0000","last_undegraded":"2024-05-08T18:53:34.260326+0000","last_fullsized":"2024-05-08T18:53:34.260326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:24:34.246835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076167+0000","last_change":"2024-05-08T18:50:34.049216+0000","last_active":"2024-05-08T18:51:15.076167+0000","last_peered":"2024-05-08T18:51:15.076167+0000","last_clean":"2024-05-08T18:51:15.076167+0000","last_became_active":"2024-05-08T18:50:34.048434+0000","last_became_peered":"2024-05-08T18:50:34.048434+0000","last_unstale":"2024-05-08T18:51:15.076167+0000","last_undegraded":"2024-05-08T18:51:15.076167+0000","last_fullsized":"2024-05-08T18:51:15.076167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:04.240028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"25'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073391+0000","last_change":"2024-05-08T18:50:36.047682+0000","last_active":"2024-05-08T18:51:15.073391+0000","last_peered":"2024-05-08T18:51:15.073391+0000","last_clean":"2024-05-08T18:51:15.073391+0000","last_became_active":"2024-05-08T18:50:36.047379+0000","last_became_peered":"2024-05-08T18:50:36.047379+0000","last_unstale":"2024-05-08T18:51:15.073391+0000","last_undegraded":"2024-05-08T18:51:15.073391+0000","last_fullsized":"2024-05-08T18:51:15.073391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:54:56.963493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"27'6","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887519+0000","last_change":"2024-05-08T18:50:28.022958+0000","last_active":"2024-05-08T18:53:34.887519+0000","last_peered":"2024-05-08T18:53:34.887519+0000","last_clean":"2024-05-08T18:53:34.887519+0000","last_became_active":"2024-05-08T18:50:28.022636+0000","last_became_peered":"2024-05-08T18:50:28.022636+0000","last_unstale":"2024-05-08T18:53:34.887519+0000","last_undegraded":"2024-05-08T18:53:34.887519+0000","last_fullsized":"2024-05-08T18:53:34.887519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:26.670671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075046+0000","last_change":"2024-05-08T18:50:26.031227+0000","last_active":"2024-05-08T18:51:15.075046+0000","last_peered":"2024-05-08T18:51:15.075046+0000","last_clean":"2024-05-08T18:51:15.075046+0000","last_became_active":"2024-05-08T18:50:26.030884+0000","last_became_peered":"2024-05-08T18:50:26.030884+0000","last_unstale":"2024-05-08T18:51:15.075046+0000","last_undegraded":"2024-05-08T18:51:15.075046+0000","last_fullsized":"2024-05-08T18:51:15.075046+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:37.913831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073198+0000","last_change":"2024-05-08T18:50:30.031104+0000","last_active":"2024-05-08T18:51:15.073198+0000","last_peered":"2024-05-08T18:51:15.073198+0000","last_clean":"2024-05-08T18:51:15.073198+0000","last_became_active":"2024-05-08T18:50:30.030773+0000","last_became_peered":"2024-05-08T18:50:30.030773+0000","last_unstale":"2024-05-08T18:51:15.073198+0000","last_undegraded":"2024-05-08T18:51:15.073198+0000","last_fullsized":"2024-05-08T18:51:15.073198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:44.977393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"27'40","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.315951+0000","last_change":"2024-05-08T18:50:32.032531+0000","last_active":"2024-05-08T18:53:34.315951+0000","last_peered":"2024-05-08T18:53:34.315951+0000","last_clean":"2024-05-08T18:53:34.315951+0000","last_became_active":"2024-05-08T18:50:32.032289+0000","last_became_peered":"2024-05-08T18:50:32.032289+0000","last_unstale":"2024-05-08T18:53:34.315951+0000","last_undegraded":"2024-05-08T18:53:34.315951+0000","last_fullsized":"2024-05-08T18:53:34.315951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:00.499108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073965+0000","last_change":"2024-05-08T18:50:34.043178+0000","last_active":"2024-05-08T18:51:15.073965+0000","last_peered":"2024-05-08T18:51:15.073965+0000","last_clean":"2024-05-08T18:51:15.073965+0000","last_became_active":"2024-05-08T18:50:34.042903+0000","last_became_peered":"2024-05-08T18:50:34.042903+0000","last_unstale":"2024-05-08T18:51:15.073965+0000","last_undegraded":"2024-05-08T18:51:15.073965+0000","last_fullsized":"2024-05-08T18:51:15.073965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:54.419559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077587+0000","last_change":"2024-05-08T18:50:36.056236+0000","last_active":"2024-05-08T18:51:15.077587+0000","last_peered":"2024-05-08T18:51:15.077587+0000","last_clean":"2024-05-08T18:51:15.077587+0000","last_became_active":"2024-05-08T18:50:36.055855+0000","last_became_peered":"2024-05-08T18:50:36.055855+0000","last_unstale":"2024-05-08T18:51:15.077587+0000","last_undegraded":"2024-05-08T18:51:15.077587+0000","last_fullsized":"2024-05-08T18:51:15.077587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:37.833469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"27'11","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007535+0000","last_change":"2024-05-08T18:50:28.035297+0000","last_active":"2024-05-08T18:52:48.007535+0000","last_peered":"2024-05-08T18:52:48.007535+0000","last_clean":"2024-05-08T18:52:48.007535+0000","last_became_active":"2024-05-08T18:50:28.034819+0000","last_became_peered":"2024-05-08T18:50:28.034819+0000","last_unstale":"2024-05-08T18:52:48.007535+0000","last_undegraded":"2024-05-08T18:52:48.007535+0000","last_fullsized":"2024-05-08T18:52:48.007535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:13:44.345322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081828+0000","last_change":"2024-05-08T18:50:26.029507+0000","last_active":"2024-05-08T18:51:15.081828+0000","last_peered":"2024-05-08T18:51:15.081828+0000","last_clean":"2024-05-08T18:51:15.081828+0000","last_became_active":"2024-05-08T18:50:26.029211+0000","last_became_peered":"2024-05-08T18:50:26.029211+0000","last_unstale":"2024-05-08T18:51:15.081828+0000","last_undegraded":"2024-05-08T18:51:15.081828+0000","last_fullsized":"2024-05-08T18:51:15.081828+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:08:13.942735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077144+0000","last_change":"2024-05-08T18:50:30.031830+0000","last_active":"2024-05-08T18:51:15.077144+0000","last_peered":"2024-05-08T18:51:15.077144+0000","last_clean":"2024-05-08T18:51:15.077144+0000","last_became_active":"2024-05-08T18:50:30.031588+0000","last_became_peered":"2024-05-08T18:50:30.031588+0000","last_unstale":"2024-05-08T18:51:15.077144+0000","last_undegraded":"2024-05-08T18:51:15.077144+0000","last_fullsized":"2024-05-08T18:51:15.077144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:50.405618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"27'30","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.775836+0000","last_change":"2024-05-08T18:50:32.035464+0000","last_active":"2024-05-08T18:52:32.775836+0000","last_peered":"2024-05-08T18:52:32.775836+0000","last_clean":"2024-05-08T18:52:32.775836+0000","last_became_active":"2024-05-08T18:50:32.035181+0000","last_became_peered":"2024-05-08T18:50:32.035181+0000","last_unstale":"2024-05-08T18:52:32.775836+0000","last_undegraded":"2024-05-08T18:52:32.775836+0000","last_fullsized":"2024-05-08T18:52:32.775836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:09.507174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078453+0000","last_change":"2024-05-08T18:50:34.042398+0000","last_active":"2024-05-08T18:51:15.078453+0000","last_peered":"2024-05-08T18:51:15.078453+0000","last_clean":"2024-05-08T18:51:15.078453+0000","last_became_active":"2024-05-08T18:50:34.039668+0000","last_became_peered":"2024-05-08T18:50:34.039668+0000","last_unstale":"2024-05-08T18:51:15.078453+0000","last_undegraded":"2024-05-08T18:51:15.078453+0000","last_fullsized":"2024-05-08T18:51:15.078453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:06.348421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.083199+0000","last_change":"2024-05-08T18:50:28.026330+0000","last_active":"2024-05-08T18:51:15.083199+0000","last_peered":"2024-05-08T18:51:15.083199+0000","last_clean":"2024-05-08T18:51:15.083199+0000","last_became_active":"2024-05-08T18:50:28.025862+0000","last_became_peered":"2024-05-08T18:50:28.025862+0000","last_unstale":"2024-05-08T18:51:15.083199+0000","last_undegraded":"2024-05-08T18:51:15.083199+0000","last_fullsized":"2024-05-08T18:51:15.083199+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:14.186696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074050+0000","last_change":"2024-05-08T18:50:26.023167+0000","last_active":"2024-05-08T18:51:15.074050+0000","last_peered":"2024-05-08T18:51:15.074050+0000","last_clean":"2024-05-08T18:51:15.074050+0000","last_became_active":"2024-05-08T18:50:26.022874+0000","last_became_peered":"2024-05-08T18:50:26.022874+0000","last_unstale":"2024-05-08T18:51:15.074050+0000","last_undegraded":"2024-05-08T18:51:15.074050+0000","last_fullsized":"2024-05-08T18:51:15.074050+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:06.231586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074887+0000","last_change":"2024-05-08T18:50:30.029972+0000","last_active":"2024-05-08T18:51:15.074887+0000","last_peered":"2024-05-08T18:51:15.074887+0000","last_clean":"2024-05-08T18:51:15.074887+0000","last_became_active":"2024-05-08T18:50:30.029570+0000","last_became_peered":"2024-05-08T18:50:30.029570+0000","last_unstale":"2024-05-08T18:51:15.074887+0000","last_undegraded":"2024-05-08T18:51:15.074887+0000","last_fullsized":"2024-05-08T18:51:15.074887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:16.505368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"27'56","reported_seq":112,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.796965+0000","last_change":"2024-05-08T18:50:32.039614+0000","last_active":"2024-05-08T18:52:32.796965+0000","last_peered":"2024-05-08T18:52:32.796965+0000","last_clean":"2024-05-08T18:52:32.796965+0000","last_became_active":"2024-05-08T18:50:32.039293+0000","last_became_peered":"2024-05-08T18:50:32.039293+0000","last_unstale":"2024-05-08T18:52:32.796965+0000","last_undegraded":"2024-05-08T18:52:32.796965+0000","last_fullsized":"2024-05-08T18:52:32.796965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:36.221887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078524+0000","last_change":"2024-05-08T18:50:34.047399+0000","last_active":"2024-05-08T18:51:15.078524+0000","last_peered":"2024-05-08T18:51:15.078524+0000","last_clean":"2024-05-08T18:51:15.078524+0000","last_became_active":"2024-05-08T18:50:34.047111+0000","last_became_peered":"2024-05-08T18:50:34.047111+0000","last_unstale":"2024-05-08T18:51:15.078524+0000","last_undegraded":"2024-05-08T18:51:15.078524+0000","last_fullsized":"2024-05-08T18:51:15.078524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:20.207624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"27'14","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.179268+0000","last_change":"2024-05-08T18:50:36.047518+0000","last_active":"2024-05-08T18:52:34.179268+0000","last_peered":"2024-05-08T18:52:34.179268+0000","last_clean":"2024-05-08T18:52:34.179268+0000","last_became_active":"2024-05-08T18:50:36.046834+0000","last_became_peered":"2024-05-08T18:50:36.046834+0000","last_unstale":"2024-05-08T18:52:34.179268+0000","last_undegraded":"2024-05-08T18:52:34.179268+0000","last_fullsized":"2024-05-08T18:52:34.179268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:30.137484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'6","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.690403+0000","last_change":"2024-05-08T18:50:28.023338+0000","last_active":"2024-05-08T18:53:34.690403+0000","last_peered":"2024-05-08T18:53:34.690403+0000","last_clean":"2024-05-08T18:53:34.690403+0000","last_became_active":"2024-05-08T18:50:28.023049+0000","last_became_peered":"2024-05-08T18:50:28.023049+0000","last_unstale":"2024-05-08T18:53:34.690403+0000","last_undegraded":"2024-05-08T18:53:34.690403+0000","last_fullsized":"2024-05-08T18:53:34.690403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:29:28.977842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.811771+0000","last_change":"2024-05-08T18:50:26.030145+0000","last_active":"2024-05-08T18:53:34.811771+0000","last_peered":"2024-05-08T18:53:34.811771+0000","last_clean":"2024-05-08T18:53:34.811771+0000","last_became_active":"2024-05-08T18:50:26.029008+0000","last_became_peered":"2024-05-08T18:50:26.029008+0000","last_unstale":"2024-05-08T18:53:34.811771+0000","last_undegraded":"2024-05-08T18:53:34.811771+0000","last_fullsized":"2024-05-08T18:53:34.811771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:47.912064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078862+0000","last_change":"2024-05-08T18:50:30.027158+0000","last_active":"2024-05-08T18:51:15.078862+0000","last_peered":"2024-05-08T18:51:15.078862+0000","last_clean":"2024-05-08T18:51:15.078862+0000","last_became_active":"2024-05-08T18:50:30.026853+0000","last_became_peered":"2024-05-08T18:50:30.026853+0000","last_unstale":"2024-05-08T18:51:15.078862+0000","last_undegraded":"2024-05-08T18:51:15.078862+0000","last_fullsized":"2024-05-08T18:51:15.078862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:25.865274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"27'36","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.776794+0000","last_change":"2024-05-08T18:50:32.041607+0000","last_active":"2024-05-08T18:52:32.776794+0000","last_peered":"2024-05-08T18:52:32.776794+0000","last_clean":"2024-05-08T18:52:32.776794+0000","last_became_active":"2024-05-08T18:50:32.041208+0000","last_became_peered":"2024-05-08T18:50:32.041208+0000","last_unstale":"2024-05-08T18:52:32.776794+0000","last_undegraded":"2024-05-08T18:52:32.776794+0000","last_fullsized":"2024-05-08T18:52:32.776794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:00.288699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081778+0000","last_change":"2024-05-08T18:50:34.049030+0000","last_active":"2024-05-08T18:51:15.081778+0000","last_peered":"2024-05-08T18:51:15.081778+0000","last_clean":"2024-05-08T18:51:15.081778+0000","last_became_active":"2024-05-08T18:50:34.048749+0000","last_became_peered":"2024-05-08T18:50:34.048749+0000","last_unstale":"2024-05-08T18:51:15.081778+0000","last_undegraded":"2024-05-08T18:51:15.081778+0000","last_fullsized":"2024-05-08T18:51:15.081778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:52.535624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076062+0000","last_change":"2024-05-08T18:50:36.057323+0000","last_active":"2024-05-08T18:51:15.076062+0000","last_peered":"2024-05-08T18:51:15.076062+0000","last_clean":"2024-05-08T18:51:15.076062+0000","last_became_active":"2024-05-08T18:50:36.056960+0000","last_became_peered":"2024-05-08T18:50:36.056960+0000","last_unstale":"2024-05-08T18:51:15.076062+0000","last_undegraded":"2024-05-08T18:51:15.076062+0000","last_fullsized":"2024-05-08T18:51:15.076062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:33.422610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"27'8","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.243573+0000","last_change":"2024-05-08T18:50:28.038865+0000","last_active":"2024-05-08T18:52:34.243573+0000","last_peered":"2024-05-08T18:52:34.243573+0000","last_clean":"2024-05-08T18:52:34.243573+0000","last_became_active":"2024-05-08T18:50:28.038364+0000","last_became_peered":"2024-05-08T18:50:28.038364+0000","last_unstale":"2024-05-08T18:52:34.243573+0000","last_undegraded":"2024-05-08T18:52:34.243573+0000","last_fullsized":"2024-05-08T18:52:34.243573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:22.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.819164+0000","last_change":"2024-05-08T18:50:26.012760+0000","last_active":"2024-05-08T18:53:34.819164+0000","last_peered":"2024-05-08T18:53:34.819164+0000","last_clean":"2024-05-08T18:53:34.819164+0000","last_became_active":"2024-05-08T18:50:26.012506+0000","last_became_peered":"2024-05-08T18:50:26.012506+0000","last_unstale":"2024-05-08T18:53:34.819164+0000","last_undegraded":"2024-05-08T18:53:34.819164+0000","last_fullsized":"2024-05-08T18:53:34.819164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:13.215678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078388+0000","last_change":"2024-05-08T18:50:30.026843+0000","last_active":"2024-05-08T18:51:15.078388+0000","last_peered":"2024-05-08T18:51:15.078388+0000","last_clean":"2024-05-08T18:51:15.078388+0000","last_became_active":"2024-05-08T18:50:30.026445+0000","last_became_peered":"2024-05-08T18:50:30.026445+0000","last_unstale":"2024-05-08T18:51:15.078388+0000","last_undegraded":"2024-05-08T18:51:15.078388+0000","last_fullsized":"2024-05-08T18:51:15.078388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:57.129506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"27'32","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.794556+0000","last_change":"2024-05-08T18:50:32.041022+0000","last_active":"2024-05-08T18:52:32.794556+0000","last_peered":"2024-05-08T18:52:32.794556+0000","last_clean":"2024-05-08T18:52:32.794556+0000","last_became_active":"2024-05-08T18:50:32.040745+0000","last_became_peered":"2024-05-08T18:50:32.040745+0000","last_unstale":"2024-05-08T18:52:32.794556+0000","last_undegraded":"2024-05-08T18:52:32.794556+0000","last_fullsized":"2024-05-08T18:52:32.794556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:18.200841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073810+0000","last_change":"2024-05-08T18:50:34.047857+0000","last_active":"2024-05-08T18:51:15.073810+0000","last_peered":"2024-05-08T18:51:15.073810+0000","last_clean":"2024-05-08T18:51:15.073810+0000","last_became_active":"2024-05-08T18:50:34.047508+0000","last_became_peered":"2024-05-08T18:50:34.047508+0000","last_unstale":"2024-05-08T18:51:15.073810+0000","last_undegraded":"2024-05-08T18:51:15.073810+0000","last_fullsized":"2024-05-08T18:51:15.073810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:42:03.694060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"27'9","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.334554+0000","last_change":"2024-05-08T18:50:36.058170+0000","last_active":"2024-05-08T18:53:34.334554+0000","last_peered":"2024-05-08T18:53:34.334554+0000","last_clean":"2024-05-08T18:53:34.334554+0000","last_became_active":"2024-05-08T18:50:36.057863+0000","last_became_peered":"2024-05-08T18:50:36.057863+0000","last_unstale":"2024-05-08T18:53:34.334554+0000","last_undegraded":"2024-05-08T18:53:34.334554+0000","last_fullsized":"2024-05-08T18:53:34.334554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:47.312916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"25'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074376+0000","last_change":"2024-05-08T18:50:28.021697+0000","last_active":"2024-05-08T18:51:15.074376+0000","last_peered":"2024-05-08T18:51:15.074376+0000","last_clean":"2024-05-08T18:51:15.074376+0000","last_became_active":"2024-05-08T18:50:28.020441+0000","last_became_peered":"2024-05-08T18:50:28.020441+0000","last_unstale":"2024-05-08T18:51:15.074376+0000","last_undegraded":"2024-05-08T18:51:15.074376+0000","last_fullsized":"2024-05-08T18:51:15.074376+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:42.970406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"25'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077959+0000","last_change":"2024-05-08T18:50:26.025468+0000","last_active":"2024-05-08T18:51:15.077959+0000","last_peered":"2024-05-08T18:51:15.077959+0000","last_clean":"2024-05-08T18:51:15.077959+0000","last_became_active":"2024-05-08T18:50:26.024274+0000","last_became_peered":"2024-05-08T18:50:26.024274+0000","last_unstale":"2024-05-08T18:51:15.077959+0000","last_undegraded":"2024-05-08T18:51:15.077959+0000","last_fullsized":"2024-05-08T18:51:15.077959+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:27.236646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081882+0000","last_change":"2024-05-08T18:50:30.029259+0000","last_active":"2024-05-08T18:51:15.081882+0000","last_peered":"2024-05-08T18:51:15.081882+0000","last_clean":"2024-05-08T18:51:15.081882+0000","last_became_active":"2024-05-08T18:50:30.028877+0000","last_became_peered":"2024-05-08T18:50:30.028877+0000","last_unstale":"2024-05-08T18:51:15.081882+0000","last_undegraded":"2024-05-08T18:51:15.081882+0000","last_fullsized":"2024-05-08T18:51:15.081882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:57.176423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"25'10","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079404+0000","last_change":"2024-05-08T18:50:32.042114+0000","last_active":"2024-05-08T18:51:15.079404+0000","last_peered":"2024-05-08T18:51:15.079404+0000","last_clean":"2024-05-08T18:51:15.079404+0000","last_became_active":"2024-05-08T18:50:32.041539+0000","last_became_peered":"2024-05-08T18:50:32.041539+0000","last_unstale":"2024-05-08T18:51:15.079404+0000","last_undegraded":"2024-05-08T18:51:15.079404+0000","last_fullsized":"2024-05-08T18:51:15.079404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:42.799113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"27'282","reported_seq":406,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111598+0000","last_change":"2024-05-08T18:50:34.048713+0000","last_active":"2024-05-08T18:53:35.111598+0000","last_peered":"2024-05-08T18:53:35.111598+0000","last_clean":"2024-05-08T18:53:35.111598+0000","last_became_active":"2024-05-08T18:50:34.048421+0000","last_became_peered":"2024-05-08T18:50:34.048421+0000","last_unstale":"2024-05-08T18:53:35.111598+0000","last_undegraded":"2024-05-08T18:53:35.111598+0000","last_fullsized":"2024-05-08T18:53:35.111598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:31.497412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"27'6","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.940415+0000","last_change":"2024-05-08T18:50:36.055738+0000","last_active":"2024-05-08T18:53:34.940415+0000","last_peered":"2024-05-08T18:53:34.940415+0000","last_clean":"2024-05-08T18:53:34.940415+0000","last_became_active":"2024-05-08T18:50:36.055184+0000","last_became_peered":"2024-05-08T18:50:36.055184+0000","last_unstale":"2024-05-08T18:53:34.940415+0000","last_undegraded":"2024-05-08T18:53:34.940415+0000","last_fullsized":"2024-05-08T18:53:34.940415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:08:53.899906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.868347+0000","last_change":"2024-05-08T18:50:28.025621+0000","last_active":"2024-05-08T18:53:34.868347+0000","last_peered":"2024-05-08T18:53:34.868347+0000","last_clean":"2024-05-08T18:53:34.868347+0000","last_became_active":"2024-05-08T18:50:28.025313+0000","last_became_peered":"2024-05-08T18:50:28.025313+0000","last_unstale":"2024-05-08T18:53:34.868347+0000","last_undegraded":"2024-05-08T18:53:34.868347+0000","last_fullsized":"2024-05-08T18:53:34.868347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:55.202102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079286+0000","last_change":"2024-05-08T18:50:26.030334+0000","last_active":"2024-05-08T18:51:15.079286+0000","last_peered":"2024-05-08T18:51:15.079286+0000","last_clean":"2024-05-08T18:51:15.079286+0000","last_became_active":"2024-05-08T18:50:26.030058+0000","last_became_peered":"2024-05-08T18:50:26.030058+0000","last_unstale":"2024-05-08T18:51:15.079286+0000","last_undegraded":"2024-05-08T18:51:15.079286+0000","last_fullsized":"2024-05-08T18:51:15.079286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:40.472317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"18'1","reported_seq":218,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.890531+0000","last_change":"2024-05-08T18:50:30.024313+0000","last_active":"2024-05-08T18:52:33.890531+0000","last_peered":"2024-05-08T18:52:33.890531+0000","last_clean":"2024-05-08T18:52:33.890531+0000","last_became_active":"2024-05-08T18:50:30.024032+0000","last_became_peered":"2024-05-08T18:50:30.024032+0000","last_unstale":"2024-05-08T18:52:33.890531+0000","last_undegraded":"2024-05-08T18:52:33.890531+0000","last_fullsized":"2024-05-08T18:52:33.890531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:43.500296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"27'37","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.008888+0000","last_change":"2024-05-08T18:50:32.036101+0000","last_active":"2024-05-08T18:52:58.008888+0000","last_peered":"2024-05-08T18:52:58.008888+0000","last_clean":"2024-05-08T18:52:58.008888+0000","last_became_active":"2024-05-08T18:50:32.035792+0000","last_became_peered":"2024-05-08T18:50:32.035792+0000","last_unstale":"2024-05-08T18:52:58.008888+0000","last_undegraded":"2024-05-08T18:52:58.008888+0000","last_fullsized":"2024-05-08T18:52:58.008888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:06:52.558231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.071790+0000","last_change":"2024-05-08T18:50:34.045008+0000","last_active":"2024-05-08T18:51:15.071790+0000","last_peered":"2024-05-08T18:51:15.071790+0000","last_clean":"2024-05-08T18:51:15.071790+0000","last_became_active":"2024-05-08T18:50:34.044586+0000","last_became_peered":"2024-05-08T18:50:34.044586+0000","last_unstale":"2024-05-08T18:51:15.071790+0000","last_undegraded":"2024-05-08T18:51:15.071790+0000","last_fullsized":"2024-05-08T18:51:15.071790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:19.094040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"27'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.240649+0000","last_change":"2024-05-08T18:50:36.053212+0000","last_active":"2024-05-08T18:52:34.240649+0000","last_peered":"2024-05-08T18:52:34.240649+0000","last_clean":"2024-05-08T18:52:34.240649+0000","last_became_active":"2024-05-08T18:50:36.052885+0000","last_became_peered":"2024-05-08T18:50:36.052885+0000","last_unstale":"2024-05-08T18:52:34.240649+0000","last_undegraded":"2024-05-08T18:52:34.240649+0000","last_fullsized":"2024-05-08T18:52:34.240649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:18.424066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"27'28","reported_seq":114,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887556+0000","last_change":"2024-05-08T18:50:28.025900+0000","last_active":"2024-05-08T18:53:34.887556+0000","last_peered":"2024-05-08T18:53:34.887556+0000","last_clean":"2024-05-08T18:53:34.887556+0000","last_became_active":"2024-05-08T18:50:28.025162+0000","last_became_peered":"2024-05-08T18:50:28.025162+0000","last_unstale":"2024-05-08T18:53:34.887556+0000","last_undegraded":"2024-05-08T18:53:34.887556+0000","last_fullsized":"2024-05-08T18:53:34.887556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:38:05.876708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":112,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079886+0000","last_change":"2024-05-08T18:50:26.027367+0000","last_active":"2024-05-08T18:51:15.079886+0000","last_peered":"2024-05-08T18:51:15.079886+0000","last_clean":"2024-05-08T18:51:15.079886+0000","last_became_active":"2024-05-08T18:50:26.027067+0000","last_became_peered":"2024-05-08T18:50:26.027067+0000","last_unstale":"2024-05-08T18:51:15.079886+0000","last_undegraded":"2024-05-08T18:51:15.079886+0000","last_fullsized":"2024-05-08T18:51:15.079886+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:30.486245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078349+0000","last_change":"2024-05-08T18:50:30.034913+0000","last_active":"2024-05-08T18:51:15.078349+0000","last_peered":"2024-05-08T18:51:15.078349+0000","last_clean":"2024-05-08T18:51:15.078349+0000","last_became_active":"2024-05-08T18:50:30.034616+0000","last_became_peered":"2024-05-08T18:50:30.034616+0000","last_unstale":"2024-05-08T18:51:15.078349+0000","last_undegraded":"2024-05-08T18:51:15.078349+0000","last_fullsized":"2024-05-08T18:51:15.078349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:58.001297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"27'32","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.246102+0000","last_change":"2024-05-08T18:50:32.042047+0000","last_active":"2024-05-08T18:52:34.246102+0000","last_peered":"2024-05-08T18:52:34.246102+0000","last_clean":"2024-05-08T18:52:34.246102+0000","last_became_active":"2024-05-08T18:50:32.041806+0000","last_became_peered":"2024-05-08T18:50:32.041806+0000","last_unstale":"2024-05-08T18:52:34.246102+0000","last_undegraded":"2024-05-08T18:52:34.246102+0000","last_fullsized":"2024-05-08T18:52:34.246102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:20.454485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075987+0000","last_change":"2024-05-08T18:50:34.050795+0000","last_active":"2024-05-08T18:51:15.075987+0000","last_peered":"2024-05-08T18:51:15.075987+0000","last_clean":"2024-05-08T18:51:15.075987+0000","last_became_active":"2024-05-08T18:50:34.050445+0000","last_became_peered":"2024-05-08T18:50:34.050445+0000","last_unstale":"2024-05-08T18:51:15.075987+0000","last_undegraded":"2024-05-08T18:51:15.075987+0000","last_fullsized":"2024-05-08T18:51:15.075987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:03.912574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079231+0000","last_change":"2024-05-08T18:50:36.060634+0000","last_active":"2024-05-08T18:51:15.079231+0000","last_peered":"2024-05-08T18:51:15.079231+0000","last_clean":"2024-05-08T18:51:15.079231+0000","last_became_active":"2024-05-08T18:50:36.060318+0000","last_became_peered":"2024-05-08T18:50:36.060318+0000","last_unstale":"2024-05-08T18:51:15.079231+0000","last_undegraded":"2024-05-08T18:51:15.079231+0000","last_fullsized":"2024-05-08T18:51:15.079231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:22:59.024364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.823408+0000","last_change":"2024-05-08T18:50:28.029928+0000","last_active":"2024-05-08T18:53:34.823408+0000","last_peered":"2024-05-08T18:53:34.823408+0000","last_clean":"2024-05-08T18:53:34.823408+0000","last_became_active":"2024-05-08T18:50:28.029624+0000","last_became_peered":"2024-05-08T18:50:28.029624+0000","last_unstale":"2024-05-08T18:53:34.823408+0000","last_undegraded":"2024-05-08T18:53:34.823408+0000","last_fullsized":"2024-05-08T18:53:34.823408+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:41.493309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.589006+0000","last_change":"2024-05-08T18:50:26.029045+0000","last_active":"2024-05-08T18:53:34.589006+0000","last_peered":"2024-05-08T18:53:34.589006+0000","last_clean":"2024-05-08T18:53:34.589006+0000","last_became_active":"2024-05-08T18:50:26.028615+0000","last_became_peered":"2024-05-08T18:50:26.028615+0000","last_unstale":"2024-05-08T18:53:34.589006+0000","last_undegraded":"2024-05-08T18:53:34.589006+0000","last_fullsized":"2024-05-08T18:53:34.589006+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:52:05.955423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079116+0000","last_change":"2024-05-08T18:50:30.030595+0000","last_active":"2024-05-08T18:51:15.079116+0000","last_peered":"2024-05-08T18:51:15.079116+0000","last_clean":"2024-05-08T18:51:15.079116+0000","last_became_active":"2024-05-08T18:50:30.030295+0000","last_became_peered":"2024-05-08T18:50:30.030295+0000","last_unstale":"2024-05-08T18:51:15.079116+0000","last_undegraded":"2024-05-08T18:51:15.079116+0000","last_fullsized":"2024-05-08T18:51:15.079116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:39.211003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"27'26","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.792030+0000","last_change":"2024-05-08T18:50:32.040967+0000","last_active":"2024-05-08T18:52:32.792030+0000","last_peered":"2024-05-08T18:52:32.792030+0000","last_clean":"2024-05-08T18:52:32.792030+0000","last_became_active":"2024-05-08T18:50:32.040661+0000","last_became_peered":"2024-05-08T18:50:32.040661+0000","last_unstale":"2024-05-08T18:52:32.792030+0000","last_undegraded":"2024-05-08T18:52:32.792030+0000","last_fullsized":"2024-05-08T18:52:32.792030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:17.855961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076341+0000","last_change":"2024-05-08T18:50:34.045449+0000","last_active":"2024-05-08T18:51:15.076341+0000","last_peered":"2024-05-08T18:51:15.076341+0000","last_clean":"2024-05-08T18:51:15.076341+0000","last_became_active":"2024-05-08T18:50:34.045040+0000","last_became_peered":"2024-05-08T18:50:34.045040+0000","last_unstale":"2024-05-08T18:51:15.076341+0000","last_undegraded":"2024-05-08T18:51:15.076341+0000","last_fullsized":"2024-05-08T18:51:15.076341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:24.033430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.802348+0000","last_change":"2024-05-08T18:50:36.060675+0000","last_active":"2024-05-08T18:52:32.802348+0000","last_peered":"2024-05-08T18:52:32.802348+0000","last_clean":"2024-05-08T18:52:32.802348+0000","last_became_active":"2024-05-08T18:50:36.060382+0000","last_became_peered":"2024-05-08T18:50:36.060382+0000","last_unstale":"2024-05-08T18:52:32.802348+0000","last_undegraded":"2024-05-08T18:52:32.802348+0000","last_fullsized":"2024-05-08T18:52:32.802348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:13.860024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'11","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.612979+0000","last_change":"2024-05-08T18:50:28.020688+0000","last_active":"2024-05-08T18:53:34.612979+0000","last_peered":"2024-05-08T18:53:34.612979+0000","last_clean":"2024-05-08T18:53:34.612979+0000","last_became_active":"2024-05-08T18:50:28.020421+0000","last_became_peered":"2024-05-08T18:50:28.020421+0000","last_unstale":"2024-05-08T18:53:34.612979+0000","last_undegraded":"2024-05-08T18:53:34.612979+0000","last_fullsized":"2024-05-08T18:53:34.612979+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:38.101169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.814081+0000","last_change":"2024-05-08T18:50:26.012375+0000","last_active":"2024-05-08T18:53:34.814081+0000","last_peered":"2024-05-08T18:53:34.814081+0000","last_clean":"2024-05-08T18:53:34.814081+0000","last_became_active":"2024-05-08T18:50:26.011299+0000","last_became_peered":"2024-05-08T18:50:26.011299+0000","last_unstale":"2024-05-08T18:53:34.814081+0000","last_undegraded":"2024-05-08T18:53:34.814081+0000","last_fullsized":"2024-05-08T18:53:34.814081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:37.913831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"27'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:31.488124+0000","last_change":"2024-05-08T18:50:30.032861+0000","last_active":"2024-05-08T18:52:31.488124+0000","last_peered":"2024-05-08T18:52:31.488124+0000","last_clean":"2024-05-08T18:52:31.488124+0000","last_became_active":"2024-05-08T18:50:30.032578+0000","last_became_peered":"2024-05-08T18:50:30.032578+0000","last_unstale":"2024-05-08T18:52:31.488124+0000","last_undegraded":"2024-05-08T18:52:31.488124+0000","last_fullsized":"2024-05-08T18:52:31.488124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:01:09.465423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"27'33","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.276328+0000","last_change":"2024-05-08T18:50:32.042986+0000","last_active":"2024-05-08T18:53:34.276328+0000","last_peered":"2024-05-08T18:53:34.276328+0000","last_clean":"2024-05-08T18:53:34.276328+0000","last_became_active":"2024-05-08T18:50:32.042700+0000","last_became_peered":"2024-05-08T18:50:32.042700+0000","last_unstale":"2024-05-08T18:53:34.276328+0000","last_undegraded":"2024-05-08T18:53:34.276328+0000","last_fullsized":"2024-05-08T18:53:34.276328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:17.682080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072389+0000","last_change":"2024-05-08T18:50:34.045188+0000","last_active":"2024-05-08T18:51:15.072389+0000","last_peered":"2024-05-08T18:51:15.072389+0000","last_clean":"2024-05-08T18:51:15.072389+0000","last_became_active":"2024-05-08T18:50:34.044872+0000","last_became_peered":"2024-05-08T18:50:34.044872+0000","last_unstale":"2024-05-08T18:51:15.072389+0000","last_undegraded":"2024-05-08T18:51:15.072389+0000","last_fullsized":"2024-05-08T18:51:15.072389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:12.079998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.805125+0000","last_change":"2024-05-08T18:50:36.055685+0000","last_active":"2024-05-08T18:52:32.805125+0000","last_peered":"2024-05-08T18:52:32.805125+0000","last_clean":"2024-05-08T18:52:32.805125+0000","last_became_active":"2024-05-08T18:50:36.055188+0000","last_became_peered":"2024-05-08T18:50:36.055188+0000","last_unstale":"2024-05-08T18:52:32.805125+0000","last_undegraded":"2024-05-08T18:52:32.805125+0000","last_fullsized":"2024-05-08T18:52:32.805125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:29:30.352392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"27'12","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.613503+0000","last_change":"2024-05-08T18:50:28.039552+0000","last_active":"2024-05-08T18:53:34.613503+0000","last_peered":"2024-05-08T18:53:34.613503+0000","last_clean":"2024-05-08T18:53:34.613503+0000","last_became_active":"2024-05-08T18:50:28.039290+0000","last_became_peered":"2024-05-08T18:50:28.039290+0000","last_unstale":"2024-05-08T18:53:34.613503+0000","last_undegraded":"2024-05-08T18:53:34.613503+0000","last_fullsized":"2024-05-08T18:53:34.613503+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:14.876681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"27'3","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.465227+0000","last_change":"2024-05-08T18:50:26.019000+0000","last_active":"2024-05-08T18:51:50.465227+0000","last_peered":"2024-05-08T18:51:50.465227+0000","last_clean":"2024-05-08T18:51:50.465227+0000","last_became_active":"2024-05-08T18:50:26.018713+0000","last_became_peered":"2024-05-08T18:50:26.018713+0000","last_unstale":"2024-05-08T18:51:50.465227+0000","last_undegraded":"2024-05-08T18:51:50.465227+0000","last_fullsized":"2024-05-08T18:51:50.465227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:00:06.975161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"27'5","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.001130+0000","last_change":"2024-05-08T18:50:28.026675+0000","last_active":"2024-05-08T18:52:38.001130+0000","last_peered":"2024-05-08T18:52:38.001130+0000","last_clean":"2024-05-08T18:52:38.001130+0000","last_became_active":"2024-05-08T18:50:28.026292+0000","last_became_peered":"2024-05-08T18:50:28.026292+0000","last_unstale":"2024-05-08T18:52:38.001130+0000","last_undegraded":"2024-05-08T18:52:38.001130+0000","last_fullsized":"2024-05-08T18:52:38.001130+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:07.047413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072010+0000","last_change":"2024-05-08T18:50:26.013052+0000","last_active":"2024-05-08T18:51:15.072010+0000","last_peered":"2024-05-08T18:51:15.072010+0000","last_clean":"2024-05-08T18:51:15.072010+0000","last_became_active":"2024-05-08T18:50:26.012760+0000","last_became_peered":"2024-05-08T18:50:26.012760+0000","last_unstale":"2024-05-08T18:51:15.072010+0000","last_undegraded":"2024-05-08T18:51:15.072010+0000","last_fullsized":"2024-05-08T18:51:15.072010+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:13.215678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'4","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.605684+0000","last_change":"2024-05-08T18:50:28.039172+0000","last_active":"2024-05-08T18:53:34.605684+0000","last_peered":"2024-05-08T18:53:34.605684+0000","last_clean":"2024-05-08T18:53:34.605684+0000","last_became_active":"2024-05-08T18:50:28.038785+0000","last_became_peered":"2024-05-08T18:50:28.038785+0000","last_unstale":"2024-05-08T18:53:34.605684+0000","last_undegraded":"2024-05-08T18:53:34.605684+0000","last_fullsized":"2024-05-08T18:53:34.605684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:11.113877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077113+0000","last_change":"2024-05-08T18:50:26.026716+0000","last_active":"2024-05-08T18:51:15.077113+0000","last_peered":"2024-05-08T18:51:15.077113+0000","last_clean":"2024-05-08T18:51:15.077113+0000","last_became_active":"2024-05-08T18:50:26.025958+0000","last_became_peered":"2024-05-08T18:50:26.025958+0000","last_unstale":"2024-05-08T18:51:15.077113+0000","last_undegraded":"2024-05-08T18:51:15.077113+0000","last_fullsized":"2024-05-08T18:51:15.077113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:53:26.336839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.861403+0000","last_change":"2024-05-08T18:50:28.026318+0000","last_active":"2024-05-08T18:53:34.861403+0000","last_peered":"2024-05-08T18:53:34.861403+0000","last_clean":"2024-05-08T18:53:34.861403+0000","last_became_active":"2024-05-08T18:50:28.025866+0000","last_became_peered":"2024-05-08T18:50:28.025866+0000","last_unstale":"2024-05-08T18:53:34.861403+0000","last_undegraded":"2024-05-08T18:53:34.861403+0000","last_fullsized":"2024-05-08T18:53:34.861403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:01.592206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072761+0000","last_change":"2024-05-08T18:50:26.025390+0000","last_active":"2024-05-08T18:51:15.072761+0000","last_peered":"2024-05-08T18:51:15.072761+0000","last_clean":"2024-05-08T18:51:15.072761+0000","last_became_active":"2024-05-08T18:50:26.025120+0000","last_became_peered":"2024-05-08T18:50:26.025120+0000","last_unstale":"2024-05-08T18:51:15.072761+0000","last_undegraded":"2024-05-08T18:51:15.072761+0000","last_fullsized":"2024-05-08T18:51:15.072761+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:07.534900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"27'8","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.690848+0000","last_change":"2024-05-08T18:50:28.025392+0000","last_active":"2024-05-08T18:53:34.690848+0000","last_peered":"2024-05-08T18:53:34.690848+0000","last_clean":"2024-05-08T18:53:34.690848+0000","last_became_active":"2024-05-08T18:50:28.025098+0000","last_became_peered":"2024-05-08T18:50:28.025098+0000","last_unstale":"2024-05-08T18:53:34.690848+0000","last_undegraded":"2024-05-08T18:53:34.690848+0000","last_fullsized":"2024-05-08T18:53:34.690848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:08:56.748370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.001075+0000","last_change":"2024-05-08T18:50:26.014734+0000","last_active":"2024-05-08T18:52:38.001075+0000","last_peered":"2024-05-08T18:52:38.001075+0000","last_clean":"2024-05-08T18:52:38.001075+0000","last_became_active":"2024-05-08T18:50:26.014434+0000","last_became_peered":"2024-05-08T18:50:26.014434+0000","last_unstale":"2024-05-08T18:52:38.001075+0000","last_undegraded":"2024-05-08T18:52:38.001075+0000","last_fullsized":"2024-05-08T18:52:38.001075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:08:13.942735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"27'10","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.860680+0000","last_change":"2024-05-08T18:50:28.037769+0000","last_active":"2024-05-08T18:53:34.860680+0000","last_peered":"2024-05-08T18:53:34.860680+0000","last_clean":"2024-05-08T18:53:34.860680+0000","last_became_active":"2024-05-08T18:50:28.037400+0000","last_became_peered":"2024-05-08T18:50:28.037400+0000","last_unstale":"2024-05-08T18:53:34.860680+0000","last_undegraded":"2024-05-08T18:53:34.860680+0000","last_fullsized":"2024-05-08T18:53:34.860680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:32.886516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"25'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081132+0000","last_change":"2024-05-08T18:50:26.029481+0000","last_active":"2024-05-08T18:51:15.081132+0000","last_peered":"2024-05-08T18:51:15.081132+0000","last_clean":"2024-05-08T18:51:15.081132+0000","last_became_active":"2024-05-08T18:50:26.029047+0000","last_became_peered":"2024-05-08T18:50:26.029047+0000","last_unstale":"2024-05-08T18:51:15.081132+0000","last_undegraded":"2024-05-08T18:51:15.081132+0000","last_fullsized":"2024-05-08T18:51:15.081132+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:13:25.895646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.690549+0000","last_change":"2024-05-08T18:50:28.021411+0000","last_active":"2024-05-08T18:53:34.690549+0000","last_peered":"2024-05-08T18:53:34.690549+0000","last_clean":"2024-05-08T18:53:34.690549+0000","last_became_active":"2024-05-08T18:50:28.021140+0000","last_became_peered":"2024-05-08T18:50:28.021140+0000","last_unstale":"2024-05-08T18:53:34.690549+0000","last_undegraded":"2024-05-08T18:53:34.690549+0000","last_fullsized":"2024-05-08T18:53:34.690549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:14.472478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076427+0000","last_change":"2024-05-08T18:50:26.031998+0000","last_active":"2024-05-08T18:51:15.076427+0000","last_peered":"2024-05-08T18:51:15.076427+0000","last_clean":"2024-05-08T18:51:15.076427+0000","last_became_active":"2024-05-08T18:50:26.031680+0000","last_became_peered":"2024-05-08T18:50:26.031680+0000","last_unstale":"2024-05-08T18:51:15.076427+0000","last_undegraded":"2024-05-08T18:51:15.076427+0000","last_fullsized":"2024-05-08T18:51:15.076427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:40.472317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"27'11","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.004738+0000","last_change":"2024-05-08T18:50:28.023037+0000","last_active":"2024-05-08T18:52:33.004738+0000","last_peered":"2024-05-08T18:52:33.004738+0000","last_clean":"2024-05-08T18:52:33.004738+0000","last_became_active":"2024-05-08T18:50:28.021588+0000","last_became_peered":"2024-05-08T18:50:28.021588+0000","last_unstale":"2024-05-08T18:52:33.004738+0000","last_undegraded":"2024-05-08T18:52:33.004738+0000","last_fullsized":"2024-05-08T18:52:33.004738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.433020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074638+0000","last_change":"2024-05-08T18:50:26.014622+0000","last_active":"2024-05-08T18:51:15.074638+0000","last_peered":"2024-05-08T18:51:15.074638+0000","last_clean":"2024-05-08T18:51:15.074638+0000","last_became_active":"2024-05-08T18:50:26.014383+0000","last_became_peered":"2024-05-08T18:50:26.014383+0000","last_unstale":"2024-05-08T18:51:15.074638+0000","last_undegraded":"2024-05-08T18:51:15.074638+0000","last_fullsized":"2024-05-08T18:51:15.074638+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:31:52.859857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"27'5","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007384+0000","last_change":"2024-05-08T18:50:28.032443+0000","last_active":"2024-05-08T18:52:48.007384+0000","last_peered":"2024-05-08T18:52:48.007384+0000","last_clean":"2024-05-08T18:52:48.007384+0000","last_became_active":"2024-05-08T18:50:28.032181+0000","last_became_peered":"2024-05-08T18:50:28.032181+0000","last_unstale":"2024-05-08T18:52:48.007384+0000","last_undegraded":"2024-05-08T18:52:48.007384+0000","last_fullsized":"2024-05-08T18:52:48.007384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:14.122243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"27'3","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.005971+0000","last_change":"2024-05-08T18:50:26.025793+0000","last_active":"2024-05-08T18:52:38.005971+0000","last_peered":"2024-05-08T18:52:38.005971+0000","last_clean":"2024-05-08T18:52:38.005971+0000","last_became_active":"2024-05-08T18:50:26.025473+0000","last_became_peered":"2024-05-08T18:50:26.025473+0000","last_unstale":"2024-05-08T18:52:38.005971+0000","last_undegraded":"2024-05-08T18:52:38.005971+0000","last_fullsized":"2024-05-08T18:52:38.005971+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:54.988707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.860972+0000","last_change":"2024-05-08T18:50:28.032744+0000","last_active":"2024-05-08T18:53:34.860972+0000","last_peered":"2024-05-08T18:53:34.860972+0000","last_clean":"2024-05-08T18:53:34.860972+0000","last_became_active":"2024-05-08T18:50:28.032462+0000","last_became_peered":"2024-05-08T18:50:28.032462+0000","last_unstale":"2024-05-08T18:53:34.860972+0000","last_undegraded":"2024-05-08T18:53:34.860972+0000","last_fullsized":"2024-05-08T18:53:34.860972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:56.484964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072300+0000","last_change":"2024-05-08T18:50:26.019960+0000","last_active":"2024-05-08T18:51:15.072300+0000","last_peered":"2024-05-08T18:51:15.072300+0000","last_clean":"2024-05-08T18:51:15.072300+0000","last_became_active":"2024-05-08T18:50:26.019706+0000","last_became_peered":"2024-05-08T18:50:26.019706+0000","last_unstale":"2024-05-08T18:51:15.072300+0000","last_undegraded":"2024-05-08T18:51:15.072300+0000","last_fullsized":"2024-05-08T18:51:15.072300+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:09.253705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"27'1","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.001897+0000","last_change":"2024-05-08T18:50:28.031514+0000","last_active":"2024-05-08T18:52:43.001897+0000","last_peered":"2024-05-08T18:52:43.001897+0000","last_clean":"2024-05-08T18:52:43.001897+0000","last_became_active":"2024-05-08T18:50:28.031188+0000","last_became_peered":"2024-05-08T18:50:28.031188+0000","last_unstale":"2024-05-08T18:52:43.001897+0000","last_undegraded":"2024-05-08T18:52:43.001897+0000","last_fullsized":"2024-05-08T18:52:43.001897+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:29.243577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075633+0000","last_change":"2024-05-08T18:50:26.025601+0000","last_active":"2024-05-08T18:51:15.075633+0000","last_peered":"2024-05-08T18:51:15.075633+0000","last_clean":"2024-05-08T18:51:15.075633+0000","last_became_active":"2024-05-08T18:50:26.024808+0000","last_became_peered":"2024-05-08T18:50:26.024808+0000","last_unstale":"2024-05-08T18:51:15.075633+0000","last_undegraded":"2024-05-08T18:51:15.075633+0000","last_fullsized":"2024-05-08T18:51:15.075633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:09.253705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887561+0000","last_change":"2024-05-08T18:50:28.023364+0000","last_active":"2024-05-08T18:53:34.887561+0000","last_peered":"2024-05-08T18:53:34.887561+0000","last_clean":"2024-05-08T18:53:34.887561+0000","last_became_active":"2024-05-08T18:50:28.022905+0000","last_became_peered":"2024-05-08T18:50:28.022905+0000","last_unstale":"2024-05-08T18:53:34.887561+0000","last_undegraded":"2024-05-08T18:53:34.887561+0000","last_fullsized":"2024-05-08T18:53:34.887561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:29:28.977842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078754+0000","last_change":"2024-05-08T18:50:26.025267+0000","last_active":"2024-05-08T18:51:15.078754+0000","last_peered":"2024-05-08T18:51:15.078754+0000","last_clean":"2024-05-08T18:51:15.078754+0000","last_became_active":"2024-05-08T18:50:26.024977+0000","last_became_peered":"2024-05-08T18:50:26.024977+0000","last_unstale":"2024-05-08T18:51:15.078754+0000","last_undegraded":"2024-05-08T18:51:15.078754+0000","last_fullsized":"2024-05-08T18:51:15.078754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:07.271771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076314+0000","last_change":"2024-05-08T18:50:28.037398+0000","last_active":"2024-05-08T18:51:15.076314+0000","last_peered":"2024-05-08T18:51:15.076314+0000","last_clean":"2024-05-08T18:51:15.076314+0000","last_became_active":"2024-05-08T18:50:28.037153+0000","last_became_peered":"2024-05-08T18:50:28.037153+0000","last_unstale":"2024-05-08T18:51:15.076314+0000","last_undegraded":"2024-05-08T18:51:15.076314+0000","last_fullsized":"2024-05-08T18:51:15.076314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:24.508392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079754+0000","last_change":"2024-05-08T18:50:26.012280+0000","last_active":"2024-05-08T18:51:15.079754+0000","last_peered":"2024-05-08T18:51:15.079754+0000","last_clean":"2024-05-08T18:51:15.079754+0000","last_became_active":"2024-05-08T18:50:26.011982+0000","last_became_peered":"2024-05-08T18:50:26.011982+0000","last_unstale":"2024-05-08T18:51:15.079754+0000","last_undegraded":"2024-05-08T18:51:15.079754+0000","last_fullsized":"2024-05-08T18:51:15.079754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:12.465547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"27'8","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.475728+0000","last_change":"2024-05-08T18:50:28.028689+0000","last_active":"2024-05-08T18:51:50.475728+0000","last_peered":"2024-05-08T18:51:50.475728+0000","last_clean":"2024-05-08T18:51:50.475728+0000","last_became_active":"2024-05-08T18:50:28.028405+0000","last_became_peered":"2024-05-08T18:50:28.028405+0000","last_unstale":"2024-05-08T18:51:50.475728+0000","last_undegraded":"2024-05-08T18:51:50.475728+0000","last_fullsized":"2024-05-08T18:51:50.475728+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:29.243577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:31.110738+0000","last_change":"2024-05-08T18:50:26.023917+0000","last_active":"2024-05-08T18:52:31.110738+0000","last_peered":"2024-05-08T18:52:31.110738+0000","last_clean":"2024-05-08T18:52:31.110738+0000","last_became_active":"2024-05-08T18:50:26.023658+0000","last_became_peered":"2024-05-08T18:50:26.023658+0000","last_unstale":"2024-05-08T18:52:31.110738+0000","last_undegraded":"2024-05-08T18:52:31.110738+0000","last_fullsized":"2024-05-08T18:52:31.110738+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:38:03.869777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"25'4","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076645+0000","last_change":"2024-05-08T18:50:28.032840+0000","last_active":"2024-05-08T18:51:15.076645+0000","last_peered":"2024-05-08T18:51:15.076645+0000","last_clean":"2024-05-08T18:51:15.076645+0000","last_became_active":"2024-05-08T18:50:28.032552+0000","last_became_peered":"2024-05-08T18:50:28.032552+0000","last_unstale":"2024-05-08T18:51:15.076645+0000","last_undegraded":"2024-05-08T18:51:15.076645+0000","last_fullsized":"2024-05-08T18:51:15.076645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:37.204016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075410+0000","last_change":"2024-05-08T18:50:26.032685+0000","last_active":"2024-05-08T18:51:15.075410+0000","last_peered":"2024-05-08T18:51:15.075410+0000","last_clean":"2024-05-08T18:51:15.075410+0000","last_became_active":"2024-05-08T18:50:26.032385+0000","last_became_peered":"2024-05-08T18:50:26.032385+0000","last_unstale":"2024-05-08T18:51:15.075410+0000","last_undegraded":"2024-05-08T18:51:15.075410+0000","last_fullsized":"2024-05-08T18:51:15.075410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:10.080123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"27'6","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.242807+0000","last_change":"2024-05-08T18:50:28.024068+0000","last_active":"2024-05-08T18:52:34.242807+0000","last_peered":"2024-05-08T18:52:34.242807+0000","last_clean":"2024-05-08T18:52:34.242807+0000","last_became_active":"2024-05-08T18:50:28.023807+0000","last_became_peered":"2024-05-08T18:50:28.023807+0000","last_unstale":"2024-05-08T18:52:34.242807+0000","last_undegraded":"2024-05-08T18:52:34.242807+0000","last_fullsized":"2024-05-08T18:52:34.242807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:13.501403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.221151+0000","last_change":"2024-05-08T18:50:26.026065+0000","last_active":"2024-05-08T18:52:34.221151+0000","last_peered":"2024-05-08T18:52:34.221151+0000","last_clean":"2024-05-08T18:52:34.221151+0000","last_became_active":"2024-05-08T18:50:26.025023+0000","last_became_peered":"2024-05-08T18:50:26.025023+0000","last_unstale":"2024-05-08T18:52:34.221151+0000","last_undegraded":"2024-05-08T18:52:34.221151+0000","last_fullsized":"2024-05-08T18:52:34.221151+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:28.045523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'6","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.152460+0000","last_change":"2024-05-08T18:50:26.026599+0000","last_active":"2024-05-08T18:52:34.152460+0000","last_peered":"2024-05-08T18:52:34.152460+0000","last_clean":"2024-05-08T18:52:34.152460+0000","last_became_active":"2024-05-08T18:50:26.026333+0000","last_became_peered":"2024-05-08T18:50:26.026333+0000","last_unstale":"2024-05-08T18:52:34.152460+0000","last_undegraded":"2024-05-08T18:52:34.152460+0000","last_fullsized":"2024-05-08T18:52:34.152460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:05.498928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"25'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075022+0000","last_change":"2024-05-08T18:50:28.024946+0000","last_active":"2024-05-08T18:51:15.075022+0000","last_peered":"2024-05-08T18:51:15.075022+0000","last_clean":"2024-05-08T18:51:15.075022+0000","last_became_active":"2024-05-08T18:50:28.024627+0000","last_became_peered":"2024-05-08T18:50:28.024627+0000","last_unstale":"2024-05-08T18:51:15.075022+0000","last_undegraded":"2024-05-08T18:51:15.075022+0000","last_fullsized":"2024-05-08T18:51:15.075022+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:44.968210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.002479+0000","last_change":"2024-05-08T18:50:26.025142+0000","last_active":"2024-05-08T18:52:48.002479+0000","last_peered":"2024-05-08T18:52:48.002479+0000","last_clean":"2024-05-08T18:52:48.002479+0000","last_became_active":"2024-05-08T18:50:26.024839+0000","last_became_peered":"2024-05-08T18:50:26.024839+0000","last_unstale":"2024-05-08T18:52:48.002479+0000","last_undegraded":"2024-05-08T18:52:48.002479+0000","last_fullsized":"2024-05-08T18:52:48.002479+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:13:25.895646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'7","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.008084+0000","last_change":"2024-05-08T18:50:28.038943+0000","last_active":"2024-05-08T18:52:53.008084+0000","last_peered":"2024-05-08T18:52:53.008084+0000","last_clean":"2024-05-08T18:52:53.008084+0000","last_became_active":"2024-05-08T18:50:28.038677+0000","last_became_peered":"2024-05-08T18:50:28.038677+0000","last_unstale":"2024-05-08T18:52:53.008084+0000","last_undegraded":"2024-05-08T18:52:53.008084+0000","last_fullsized":"2024-05-08T18:52:53.008084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:55.122520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1601,"num_read_kb":1491,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705707,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56228,"kb_used_data":20892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94315612,"statfs":{"total":96636764160,"available":96579186688,"internally_reserved":0,"allocated":21393408,"data_stored":21094274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705708,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48548,"kb_used_data":13212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323292,"statfs":{"total":96636764160,"available":96587051008,"internally_reserved":0,"allocated":13529088,"data_stored":13292544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705707,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45104,"kb_used_data":9768,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326736,"statfs":{"total":96636764160,"available":96590577664,"internally_reserved":0,"allocated":10002432,"data_stored":9737407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705707,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40368,"kb_used_data":9192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331472,"statfs":{"total":96636764160,"available":96595427328,"internally_reserved":0,"allocated":9412608,"data_stored":9148355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9031680,"data_stored":9028480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9031680,"data_stored":9028480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:53:42.313 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T18:53:42.313 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:53:42.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.446+0000 7f31502d4640 1 Processor -- start 2024-05-08T18:53:42.445 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.446+0000 7f31502d4640 1 -- start start 2024-05-08T18:53:42.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.446+0000 7f31502d4640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3148129560 0x7f31481313d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:42.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.446+0000 7f31502d4640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3148072dc0 con 0x7f314806fe20 2024-05-08T18:53:42.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.446+0000 7f31502d4640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f31481299f0 con 0x7f3148129560 2024-05-08T18:53:42.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.447+0000 7f314d86f640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3148129560 0x7f31481313d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:42.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.447+0000 7f314e070640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f314806fe20 0x7f3148128e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:47174/0 (socket says 172.21.15.42:47174) 2024-05-08T18:53:42.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.447+0000 7f314e070640 1 -- 172.21.15.42:0/4030959056 learned_addr learned my addr 172.21.15.42:0/4030959056 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:53:42.446 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.447+0000 7f314d86f640 1 -- 172.21.15.42:0/4030959056 >> v1:172.21.15.42:6789/0 conn(0x7f314806fe20 legacy=0x7f3148128e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:42.447 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.447+0000 7f314d86f640 1 -- 172.21.15.42:0/4030959056 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3148128ad0 con 0x7f3148129560 2024-05-08T18:53:42.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.448+0000 7f314d86f640 1 --2- 172.21.15.42:0/4030959056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3148129560 0x7f31481313d0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f3138009720 tx=0x7f313802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d8d16d65d7e723 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:42.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.448+0000 7f314d06e640 1 -- 172.21.15.42:0/4030959056 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31380316d0 con 0x7f3148129560 2024-05-08T18:53:42.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.448+0000 7f314d06e640 1 -- 172.21.15.42:0/4030959056 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3138037070 con 0x7f3148129560 2024-05-08T18:53:42.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.448+0000 7f314d06e640 1 -- 172.21.15.42:0/4030959056 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31380319c0 con 0x7f3148129560 2024-05-08T18:53:42.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.448+0000 7f31502d4640 1 -- 172.21.15.42:0/4030959056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3148129560 msgr2=0x7f31481313d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:42.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.448+0000 7f31502d4640 1 --2- 172.21.15.42:0/4030959056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3148129560 0x7f31481313d0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f3138009720 tx=0x7f313802b840 comp rx=0 tx=0).stop 2024-05-08T18:53:42.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.448+0000 7f31502d4640 1 -- 172.21.15.42:0/4030959056 shutdown_connections 2024-05-08T18:53:42.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.448+0000 7f31502d4640 1 --2- 172.21.15.42:0/4030959056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3148129560 0x7f31481313d0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:42.448 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.448+0000 7f31502d4640 1 -- 172.21.15.42:0/4030959056 >> 172.21.15.42:0/4030959056 conn(0x7f314809a910 msgr2=0x7f314806e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:42.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.448+0000 7f31502d4640 1 -- 172.21.15.42:0/4030959056 shutdown_connections 2024-05-08T18:53:42.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.448+0000 7f31502d4640 1 -- 172.21.15.42:0/4030959056 wait complete. 2024-05-08T18:53:42.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.449+0000 7f31502d4640 1 Processor -- start 2024-05-08T18:53:42.449 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.449+0000 7f31502d4640 1 -- start start 2024-05-08T18:53:42.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.449+0000 7f31502d4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f314806fe20 0x7f31481c0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:42.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.450+0000 7f31502d4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f3148131910 con 0x7f314806fe20 2024-05-08T18:53:42.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.450+0000 7f314e070640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f314806fe20 0x7f31481c0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:42.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.450+0000 7f314e070640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f314806fe20 0x7f31481c0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45788/0 (socket says 172.21.15.42:45788) 2024-05-08T18:53:42.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.450+0000 7f314e070640 1 -- 172.21.15.42:0/4288634408 learned_addr learned my addr 172.21.15.42:0/4288634408 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:53:42.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.450+0000 7f314e070640 1 -- 172.21.15.42:0/4288634408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3148130410 con 0x7f314806fe20 2024-05-08T18:53:42.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.450+0000 7f314e070640 1 --2- 172.21.15.42:0/4288634408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f314806fe20 0x7f31481c0f80 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f314400c4a0 tx=0x7f314400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:42.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.450+0000 7f313effd640 1 -- 172.21.15.42:0/4288634408 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3144017070 con 0x7f314806fe20 2024-05-08T18:53:42.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.450+0000 7f313effd640 1 -- 172.21.15.42:0/4288634408 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3144005c10 con 0x7f314806fe20 2024-05-08T18:53:42.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.450+0000 7f313effd640 1 -- 172.21.15.42:0/4288634408 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3144007070 con 0x7f314806fe20 2024-05-08T18:53:42.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.450+0000 7f31502d4640 1 -- 172.21.15.42:0/4288634408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3148130c70 con 0x7f314806fe20 2024-05-08T18:53:42.451 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.450+0000 7f31502d4640 1 -- 172.21.15.42:0/4288634408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31481253f0 con 0x7f314806fe20 2024-05-08T18:53:42.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.451+0000 7f313effd640 1 -- 172.21.15.42:0/4288634408 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f314401a070 con 0x7f314806fe20 2024-05-08T18:53:42.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.451+0000 7f31502d4640 1 -- 172.21.15.42:0/4288634408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3148064010 con 0x7f314806fe20 2024-05-08T18:53:42.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.451+0000 7f313effd640 1 --2- 172.21.15.42:0/4288634408 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f312c03d2b0 0x7f312c03f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:42.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.451+0000 7f313effd640 1 -- 172.21.15.42:0/4288634408 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f3144050f90 con 0x7f314806fe20 2024-05-08T18:53:42.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.452+0000 7f314d86f640 1 --2- 172.21.15.42:0/4288634408 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f312c03d2b0 0x7f312c03f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:42.452 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.452+0000 7f314d86f640 1 --2- 172.21.15.42:0/4288634408 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f312c03d2b0 0x7f312c03f770 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3138036000 tx=0x7f3138008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:42.455 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.456+0000 7f313effd640 1 -- 172.21.15.42:0/4288634408 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f3144019cd0 con 0x7f314806fe20 2024-05-08T18:53:42.643 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.644+0000 7f31502d4640 1 -- 172.21.15.42:0/4288634408 --> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3148073aa0 con 0x7f312c03d2b0 2024-05-08T18:53:42.658 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.659+0000 7f313effd640 1 -- 172.21.15.42:0/4288634408 <== mgr.4102 v2:172.21.15.132:6824/2104266563 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665399 (secure 0 0 0) 0x7f3148073aa0 con 0x7f312c03d2b0 2024-05-08T18:53:42.665 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:53:42.670 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-08T18:53:42.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.664+0000 7f31502d4640 1 -- 172.21.15.42:0/4288634408 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f312c03d2b0 msgr2=0x7f312c03f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:42.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.664+0000 7f31502d4640 1 --2- 172.21.15.42:0/4288634408 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f312c03d2b0 0x7f312c03f770 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3138036000 tx=0x7f3138008030 comp rx=0 tx=0).stop 2024-05-08T18:53:42.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.664+0000 7f31502d4640 1 -- 172.21.15.42:0/4288634408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f314806fe20 msgr2=0x7f31481c0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:42.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.664+0000 7f31502d4640 1 --2- 172.21.15.42:0/4288634408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f314806fe20 0x7f31481c0f80 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f314400c4a0 tx=0x7f314400c960 comp rx=0 tx=0).stop 2024-05-08T18:53:42.672 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.664+0000 7f31502d4640 1 -- 172.21.15.42:0/4288634408 shutdown_connections 2024-05-08T18:53:42.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.664+0000 7f31502d4640 1 --2- 172.21.15.42:0/4288634408 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f312c03d2b0 0x7f312c03f770 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:42.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.664+0000 7f31502d4640 1 --2- 172.21.15.42:0/4288634408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f314806fe20 0x7f31481c0f80 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:42.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.664+0000 7f31502d4640 1 -- 172.21.15.42:0/4288634408 >> 172.21.15.42:0/4288634408 conn(0x7f314809a910 msgr2=0x7f3148125760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:42.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.664+0000 7f31502d4640 1 -- 172.21.15.42:0/4288634408 shutdown_connections 2024-05-08T18:53:42.673 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.664+0000 7f31502d4640 1 -- 172.21.15.42:0/4288634408 wait complete. 2024-05-08T18:53:42.674 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2024-05-08T18:53:41.987156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412790,"num_objects":227,"num_object_clones":0,"num_object_copies":454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4815,"num_read_kb":4401,"num_write":2046,"num_write_kb":60584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4431,"ondisk_log_size":4431,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190248,"kb_used_data":53064,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377297112,"statfs":{"total":386547056640,"available":386352242688,"internally_reserved":0,"allocated":54337536,"data_stored":53272580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811688,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004121"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079566+0000","last_change":"2024-05-08T18:50:26.031610+0000","last_active":"2024-05-08T18:51:15.079566+0000","last_peered":"2024-05-08T18:51:15.079566+0000","last_clean":"2024-05-08T18:51:15.079566+0000","last_became_active":"2024-05-08T18:50:26.031359+0000","last_became_peered":"2024-05-08T18:50:26.031359+0000","last_unstale":"2024-05-08T18:51:15.079566+0000","last_undegraded":"2024-05-08T18:51:15.079566+0000","last_fullsized":"2024-05-08T18:51:15.079566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:47.912064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.861653+0000","last_change":"2024-05-08T18:50:28.028609+0000","last_active":"2024-05-08T18:53:34.861653+0000","last_peered":"2024-05-08T18:53:34.861653+0000","last_clean":"2024-05-08T18:53:34.861653+0000","last_became_active":"2024-05-08T18:50:28.028352+0000","last_became_peered":"2024-05-08T18:50:28.028352+0000","last_unstale":"2024-05-08T18:53:34.861653+0000","last_undegraded":"2024-05-08T18:53:34.861653+0000","last_fullsized":"2024-05-08T18:53:34.861653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:01.592206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.086736+0000","last_change":"2024-05-08T18:50:26.029183+0000","last_active":"2024-05-08T18:52:34.086736+0000","last_peered":"2024-05-08T18:52:34.086736+0000","last_clean":"2024-05-08T18:52:34.086736+0000","last_became_active":"2024-05-08T18:50:26.028799+0000","last_became_peered":"2024-05-08T18:50:26.028799+0000","last_unstale":"2024-05-08T18:52:34.086736+0000","last_undegraded":"2024-05-08T18:52:34.086736+0000","last_fullsized":"2024-05-08T18:52:34.086736+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:51.140557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"27'6","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887526+0000","last_change":"2024-05-08T18:50:28.034919+0000","last_active":"2024-05-08T18:53:34.887526+0000","last_peered":"2024-05-08T18:53:34.887526+0000","last_clean":"2024-05-08T18:53:34.887526+0000","last_became_active":"2024-05-08T18:50:28.033466+0000","last_became_peered":"2024-05-08T18:50:28.033466+0000","last_unstale":"2024-05-08T18:53:34.887526+0000","last_undegraded":"2024-05-08T18:53:34.887526+0000","last_fullsized":"2024-05-08T18:53:34.887526+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:01:07.458436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:17.995039+0000","last_change":"2024-05-08T18:51:15.084166+0000","last_active":"2024-05-08T18:51:17.995039+0000","last_peered":"2024-05-08T18:51:17.995039+0000","last_clean":"2024-05-08T18:51:17.995039+0000","last_became_active":"2024-05-08T18:51:15.083809+0000","last_became_peered":"2024-05-08T18:51:15.083809+0000","last_unstale":"2024-05-08T18:51:17.995039+0000","last_undegraded":"2024-05-08T18:51:17.995039+0000","last_fullsized":"2024-05-08T18:51:17.995039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:21.925661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"25'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.084345+0000","last_change":"2024-05-08T18:51:15.083978+0000","last_active":"2024-05-08T18:51:15.084345+0000","last_peered":"2024-05-08T18:51:15.084345+0000","last_clean":"2024-05-08T18:51:15.084345+0000","last_became_active":"2024-05-08T18:51:15.080716+0000","last_became_peered":"2024-05-08T18:51:15.080716+0000","last_unstale":"2024-05-08T18:51:15.084345+0000","last_undegraded":"2024-05-08T18:51:15.084345+0000","last_fullsized":"2024-05-08T18:51:15.084345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:08.301578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076692+0000","last_change":"2024-05-08T18:50:26.024545+0000","last_active":"2024-05-08T18:51:15.076692+0000","last_peered":"2024-05-08T18:51:15.076692+0000","last_clean":"2024-05-08T18:51:15.076692+0000","last_became_active":"2024-05-08T18:50:26.024243+0000","last_became_peered":"2024-05-08T18:50:26.024243+0000","last_unstale":"2024-05-08T18:51:15.076692+0000","last_undegraded":"2024-05-08T18:51:15.076692+0000","last_fullsized":"2024-05-08T18:51:15.076692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:59.917414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"27'4","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.690261+0000","last_change":"2024-05-08T18:50:28.026931+0000","last_active":"2024-05-08T18:53:34.690261+0000","last_peered":"2024-05-08T18:53:34.690261+0000","last_clean":"2024-05-08T18:53:34.690261+0000","last_became_active":"2024-05-08T18:50:28.026380+0000","last_became_peered":"2024-05-08T18:50:28.026380+0000","last_unstale":"2024-05-08T18:53:34.690261+0000","last_undegraded":"2024-05-08T18:53:34.690261+0000","last_fullsized":"2024-05-08T18:53:34.690261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:06:48.544087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079861+0000","last_change":"2024-05-08T18:50:26.023188+0000","last_active":"2024-05-08T18:51:15.079861+0000","last_peered":"2024-05-08T18:51:15.079861+0000","last_clean":"2024-05-08T18:51:15.079861+0000","last_became_active":"2024-05-08T18:50:26.022914+0000","last_became_peered":"2024-05-08T18:50:26.022914+0000","last_unstale":"2024-05-08T18:51:15.079861+0000","last_undegraded":"2024-05-08T18:51:15.079861+0000","last_fullsized":"2024-05-08T18:51:15.079861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:22.501461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'6","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887773+0000","last_change":"2024-05-08T18:50:28.023780+0000","last_active":"2024-05-08T18:53:34.887773+0000","last_peered":"2024-05-08T18:53:34.887773+0000","last_clean":"2024-05-08T18:53:34.887773+0000","last_became_active":"2024-05-08T18:50:28.023506+0000","last_became_peered":"2024-05-08T18:50:28.023506+0000","last_unstale":"2024-05-08T18:53:34.887773+0000","last_undegraded":"2024-05-08T18:53:34.887773+0000","last_fullsized":"2024-05-08T18:53:34.887773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:07.047413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074268+0000","last_change":"2024-05-08T18:50:26.024901+0000","last_active":"2024-05-08T18:51:15.074268+0000","last_peered":"2024-05-08T18:51:15.074268+0000","last_clean":"2024-05-08T18:51:15.074268+0000","last_became_active":"2024-05-08T18:50:26.024493+0000","last_became_peered":"2024-05-08T18:50:26.024493+0000","last_unstale":"2024-05-08T18:51:15.074268+0000","last_undegraded":"2024-05-08T18:51:15.074268+0000","last_fullsized":"2024-05-08T18:51:15.074268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:45.479269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"27'10","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.607900+0000","last_change":"2024-05-08T18:50:28.037839+0000","last_active":"2024-05-08T18:53:34.607900+0000","last_peered":"2024-05-08T18:53:34.607900+0000","last_clean":"2024-05-08T18:53:34.607900+0000","last_became_active":"2024-05-08T18:50:28.037266+0000","last_became_peered":"2024-05-08T18:50:28.037266+0000","last_unstale":"2024-05-08T18:53:34.607900+0000","last_undegraded":"2024-05-08T18:53:34.607900+0000","last_fullsized":"2024-05-08T18:53:34.607900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:55.169436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.009293+0000","last_change":"2024-05-08T18:50:26.011072+0000","last_active":"2024-05-08T18:52:58.009293+0000","last_peered":"2024-05-08T18:52:58.009293+0000","last_clean":"2024-05-08T18:52:58.009293+0000","last_became_active":"2024-05-08T18:50:26.010734+0000","last_became_peered":"2024-05-08T18:50:26.010734+0000","last_unstale":"2024-05-08T18:52:58.009293+0000","last_undegraded":"2024-05-08T18:52:58.009293+0000","last_fullsized":"2024-05-08T18:52:58.009293+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:34.544725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076550+0000","last_change":"2024-05-08T18:50:28.026695+0000","last_active":"2024-05-08T18:51:15.076550+0000","last_peered":"2024-05-08T18:51:15.076550+0000","last_clean":"2024-05-08T18:51:15.076550+0000","last_became_active":"2024-05-08T18:50:28.026028+0000","last_became_peered":"2024-05-08T18:50:28.026028+0000","last_unstale":"2024-05-08T18:51:15.076550+0000","last_undegraded":"2024-05-08T18:51:15.076550+0000","last_fullsized":"2024-05-08T18:51:15.076550+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:08:56.748370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"25'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072030+0000","last_change":"2024-05-08T18:50:26.029712+0000","last_active":"2024-05-08T18:51:15.072030+0000","last_peered":"2024-05-08T18:51:15.072030+0000","last_clean":"2024-05-08T18:51:15.072030+0000","last_became_active":"2024-05-08T18:50:26.029435+0000","last_became_peered":"2024-05-08T18:50:26.029435+0000","last_unstale":"2024-05-08T18:51:15.072030+0000","last_undegraded":"2024-05-08T18:51:15.072030+0000","last_fullsized":"2024-05-08T18:51:15.072030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:07.271771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"27'6","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887632+0000","last_change":"2024-05-08T18:50:28.033720+0000","last_active":"2024-05-08T18:53:34.887632+0000","last_peered":"2024-05-08T18:53:34.887632+0000","last_clean":"2024-05-08T18:53:34.887632+0000","last_became_active":"2024-05-08T18:50:28.033311+0000","last_became_peered":"2024-05-08T18:50:28.033311+0000","last_unstale":"2024-05-08T18:53:34.887632+0000","last_undegraded":"2024-05-08T18:53:34.887632+0000","last_fullsized":"2024-05-08T18:53:34.887632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:53:28.343769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"27'10","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.243057+0000","last_change":"2024-05-08T18:50:28.033240+0000","last_active":"2024-05-08T18:52:34.243057+0000","last_peered":"2024-05-08T18:52:34.243057+0000","last_clean":"2024-05-08T18:52:34.243057+0000","last_became_active":"2024-05-08T18:50:28.032951+0000","last_became_peered":"2024-05-08T18:50:28.032951+0000","last_unstale":"2024-05-08T18:52:34.243057+0000","last_undegraded":"2024-05-08T18:52:34.243057+0000","last_fullsized":"2024-05-08T18:52:34.243057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:33:40.152329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'4","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.082075+0000","last_change":"2024-05-08T18:50:26.030698+0000","last_active":"2024-05-08T18:51:15.082075+0000","last_peered":"2024-05-08T18:51:15.082075+0000","last_clean":"2024-05-08T18:51:15.082075+0000","last_became_active":"2024-05-08T18:50:26.030437+0000","last_became_peered":"2024-05-08T18:50:26.030437+0000","last_unstale":"2024-05-08T18:51:15.082075+0000","last_undegraded":"2024-05-08T18:51:15.082075+0000","last_fullsized":"2024-05-08T18:51:15.082075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:07.534900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'21","reported_seq":106,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.613463+0000","last_change":"2024-05-08T18:50:28.028447+0000","last_active":"2024-05-08T18:53:34.613463+0000","last_peered":"2024-05-08T18:53:34.613463+0000","last_clean":"2024-05-08T18:53:34.613463+0000","last_became_active":"2024-05-08T18:50:28.028184+0000","last_became_peered":"2024-05-08T18:50:28.028184+0000","last_unstale":"2024-05-08T18:53:34.613463+0000","last_undegraded":"2024-05-08T18:53:34.613463+0000","last_fullsized":"2024-05-08T18:53:34.613463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:08:56.748370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":94,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.816663+0000","last_change":"2024-05-08T18:50:26.032028+0000","last_active":"2024-05-08T18:53:34.816663+0000","last_peered":"2024-05-08T18:53:34.816663+0000","last_clean":"2024-05-08T18:53:34.816663+0000","last_became_active":"2024-05-08T18:50:26.031768+0000","last_became_peered":"2024-05-08T18:50:26.031768+0000","last_unstale":"2024-05-08T18:53:34.816663+0000","last_undegraded":"2024-05-08T18:53:34.816663+0000","last_fullsized":"2024-05-08T18:53:34.816663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:09.253705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'8","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887843+0000","last_change":"2024-05-08T18:50:28.029440+0000","last_active":"2024-05-08T18:53:34.887843+0000","last_peered":"2024-05-08T18:53:34.887843+0000","last_clean":"2024-05-08T18:53:34.887843+0000","last_became_active":"2024-05-08T18:50:28.029145+0000","last_became_peered":"2024-05-08T18:50:28.029145+0000","last_unstale":"2024-05-08T18:53:34.887843+0000","last_undegraded":"2024-05-08T18:53:34.887843+0000","last_fullsized":"2024-05-08T18:53:34.887843+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:23.929950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.809112+0000","last_change":"2024-05-08T18:50:26.031782+0000","last_active":"2024-05-08T18:53:34.809112+0000","last_peered":"2024-05-08T18:53:34.809112+0000","last_clean":"2024-05-08T18:53:34.809112+0000","last_became_active":"2024-05-08T18:50:26.031545+0000","last_became_peered":"2024-05-08T18:50:26.031545+0000","last_unstale":"2024-05-08T18:53:34.809112+0000","last_undegraded":"2024-05-08T18:53:34.809112+0000","last_fullsized":"2024-05-08T18:53:34.809112+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:59.917414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"27'16","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887608+0000","last_change":"2024-05-08T18:50:28.023032+0000","last_active":"2024-05-08T18:53:34.887608+0000","last_peered":"2024-05-08T18:53:34.887608+0000","last_clean":"2024-05-08T18:53:34.887608+0000","last_became_active":"2024-05-08T18:50:28.022683+0000","last_became_peered":"2024-05-08T18:50:28.022683+0000","last_unstale":"2024-05-08T18:53:34.887608+0000","last_undegraded":"2024-05-08T18:53:34.887608+0000","last_fullsized":"2024-05-08T18:53:34.887608+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:53:28.343769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.570317+0000","last_change":"2024-05-08T18:50:26.013216+0000","last_active":"2024-05-08T18:53:34.570317+0000","last_peered":"2024-05-08T18:53:34.570317+0000","last_clean":"2024-05-08T18:53:34.570317+0000","last_became_active":"2024-05-08T18:50:26.011512+0000","last_became_peered":"2024-05-08T18:50:26.011512+0000","last_unstale":"2024-05-08T18:53:34.570317+0000","last_undegraded":"2024-05-08T18:53:34.570317+0000","last_fullsized":"2024-05-08T18:53:34.570317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:10.080123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078245+0000","last_change":"2024-05-08T18:50:28.033091+0000","last_active":"2024-05-08T18:51:15.078245+0000","last_peered":"2024-05-08T18:51:15.078245+0000","last_clean":"2024-05-08T18:51:15.078245+0000","last_became_active":"2024-05-08T18:50:28.032768+0000","last_became_peered":"2024-05-08T18:50:28.032768+0000","last_unstale":"2024-05-08T18:51:15.078245+0000","last_undegraded":"2024-05-08T18:51:15.078245+0000","last_fullsized":"2024-05-08T18:51:15.078245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:14.472478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073068+0000","last_change":"2024-05-08T18:50:26.029400+0000","last_active":"2024-05-08T18:51:15.073068+0000","last_peered":"2024-05-08T18:51:15.073068+0000","last_clean":"2024-05-08T18:51:15.073068+0000","last_became_active":"2024-05-08T18:50:26.029015+0000","last_became_peered":"2024-05-08T18:50:26.029015+0000","last_unstale":"2024-05-08T18:51:15.073068+0000","last_undegraded":"2024-05-08T18:51:15.073068+0000","last_fullsized":"2024-05-08T18:51:15.073068+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:10.080123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"27'14","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.861465+0000","last_change":"2024-05-08T18:50:28.022984+0000","last_active":"2024-05-08T18:53:34.861465+0000","last_peered":"2024-05-08T18:53:34.861465+0000","last_clean":"2024-05-08T18:53:34.861465+0000","last_became_active":"2024-05-08T18:50:28.022359+0000","last_became_peered":"2024-05-08T18:50:28.022359+0000","last_unstale":"2024-05-08T18:53:34.861465+0000","last_undegraded":"2024-05-08T18:53:34.861465+0000","last_fullsized":"2024-05-08T18:53:34.861465+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:53.851136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007611+0000","last_change":"2024-05-08T18:50:26.017214+0000","last_active":"2024-05-08T18:52:48.007611+0000","last_peered":"2024-05-08T18:52:48.007611+0000","last_clean":"2024-05-08T18:52:48.007611+0000","last_became_active":"2024-05-08T18:50:26.016932+0000","last_became_peered":"2024-05-08T18:50:26.016932+0000","last_unstale":"2024-05-08T18:52:48.007611+0000","last_undegraded":"2024-05-08T18:52:48.007611+0000","last_fullsized":"2024-05-08T18:52:48.007611+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:36.779493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"27'41","reported_seq":107,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.843008+0000","last_change":"2024-05-08T18:50:36.055719+0000","last_active":"2024-05-08T18:53:34.843008+0000","last_peered":"2024-05-08T18:53:34.843008+0000","last_clean":"2024-05-08T18:53:34.843008+0000","last_became_active":"2024-05-08T18:50:36.055045+0000","last_became_peered":"2024-05-08T18:50:36.055045+0000","last_unstale":"2024-05-08T18:53:34.843008+0000","last_undegraded":"2024-05-08T18:53:34.843008+0000","last_fullsized":"2024-05-08T18:53:34.843008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:51.311129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":182,"num_write":115,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'10","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.823446+0000","last_change":"2024-05-08T18:50:28.025676+0000","last_active":"2024-05-08T18:53:34.823446+0000","last_peered":"2024-05-08T18:53:34.823446+0000","last_clean":"2024-05-08T18:53:34.823446+0000","last_became_active":"2024-05-08T18:50:28.025239+0000","last_became_peered":"2024-05-08T18:50:28.025239+0000","last_unstale":"2024-05-08T18:53:34.823446+0000","last_undegraded":"2024-05-08T18:53:34.823446+0000","last_fullsized":"2024-05-08T18:53:34.823446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:43.734077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077683+0000","last_change":"2024-05-08T18:50:26.026659+0000","last_active":"2024-05-08T18:51:15.077683+0000","last_peered":"2024-05-08T18:51:15.077683+0000","last_clean":"2024-05-08T18:51:15.077683+0000","last_became_active":"2024-05-08T18:50:26.026400+0000","last_became_peered":"2024-05-08T18:50:26.026400+0000","last_unstale":"2024-05-08T18:51:15.077683+0000","last_undegraded":"2024-05-08T18:51:15.077683+0000","last_fullsized":"2024-05-08T18:51:15.077683+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:42.961279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079375+0000","last_change":"2024-05-08T18:50:30.036048+0000","last_active":"2024-05-08T18:51:15.079375+0000","last_peered":"2024-05-08T18:51:15.079375+0000","last_clean":"2024-05-08T18:51:15.079375+0000","last_became_active":"2024-05-08T18:50:30.034832+0000","last_became_peered":"2024-05-08T18:50:30.034832+0000","last_unstale":"2024-05-08T18:51:15.079375+0000","last_undegraded":"2024-05-08T18:51:15.079375+0000","last_fullsized":"2024-05-08T18:51:15.079375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:46.416875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"27'30","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.784944+0000","last_change":"2024-05-08T18:50:32.044302+0000","last_active":"2024-05-08T18:52:32.784944+0000","last_peered":"2024-05-08T18:52:32.784944+0000","last_clean":"2024-05-08T18:52:32.784944+0000","last_became_active":"2024-05-08T18:50:32.042432+0000","last_became_peered":"2024-05-08T18:50:32.042432+0000","last_unstale":"2024-05-08T18:52:32.784944+0000","last_undegraded":"2024-05-08T18:52:32.784944+0000","last_fullsized":"2024-05-08T18:52:32.784944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:10.539618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081525+0000","last_change":"2024-05-08T18:50:34.048749+0000","last_active":"2024-05-08T18:51:15.081525+0000","last_peered":"2024-05-08T18:51:15.081525+0000","last_clean":"2024-05-08T18:51:15.081525+0000","last_became_active":"2024-05-08T18:50:34.048339+0000","last_became_peered":"2024-05-08T18:50:34.048339+0000","last_unstale":"2024-05-08T18:51:15.081525+0000","last_undegraded":"2024-05-08T18:51:15.081525+0000","last_fullsized":"2024-05-08T18:51:15.081525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:11.762112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"27'7","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.481284+0000","last_change":"2024-05-08T18:50:36.055618+0000","last_active":"2024-05-08T18:51:50.481284+0000","last_peered":"2024-05-08T18:51:50.481284+0000","last_clean":"2024-05-08T18:51:50.481284+0000","last_became_active":"2024-05-08T18:50:36.055220+0000","last_became_peered":"2024-05-08T18:50:36.055220+0000","last_unstale":"2024-05-08T18:51:50.481284+0000","last_undegraded":"2024-05-08T18:51:50.481284+0000","last_fullsized":"2024-05-08T18:51:50.481284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:17.604372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"25'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.080146+0000","last_change":"2024-05-08T18:50:28.038524+0000","last_active":"2024-05-08T18:51:15.080146+0000","last_peered":"2024-05-08T18:51:15.080146+0000","last_clean":"2024-05-08T18:51:15.080146+0000","last_became_active":"2024-05-08T18:50:28.038232+0000","last_became_peered":"2024-05-08T18:50:28.038232+0000","last_unstale":"2024-05-08T18:51:15.080146+0000","last_undegraded":"2024-05-08T18:51:15.080146+0000","last_fullsized":"2024-05-08T18:51:15.080146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:25.476484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.006963+0000","last_change":"2024-05-08T18:50:26.031250+0000","last_active":"2024-05-08T18:52:48.006963+0000","last_peered":"2024-05-08T18:52:48.006963+0000","last_clean":"2024-05-08T18:52:48.006963+0000","last_became_active":"2024-05-08T18:50:26.030986+0000","last_became_peered":"2024-05-08T18:50:26.030986+0000","last_unstale":"2024-05-08T18:52:48.006963+0000","last_undegraded":"2024-05-08T18:52:48.006963+0000","last_fullsized":"2024-05-08T18:52:48.006963+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:47.462940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073251+0000","last_change":"2024-05-08T18:50:30.026937+0000","last_active":"2024-05-08T18:51:15.073251+0000","last_peered":"2024-05-08T18:51:15.073251+0000","last_clean":"2024-05-08T18:51:15.073251+0000","last_became_active":"2024-05-08T18:50:30.026538+0000","last_became_peered":"2024-05-08T18:50:30.026538+0000","last_unstale":"2024-05-08T18:51:15.073251+0000","last_undegraded":"2024-05-08T18:51:15.073251+0000","last_fullsized":"2024-05-08T18:51:15.073251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:07.500017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"25'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081630+0000","last_change":"2024-05-08T18:50:32.039340+0000","last_active":"2024-05-08T18:51:15.081630+0000","last_peered":"2024-05-08T18:51:15.081630+0000","last_clean":"2024-05-08T18:51:15.081630+0000","last_became_active":"2024-05-08T18:50:32.039031+0000","last_became_peered":"2024-05-08T18:50:32.039031+0000","last_unstale":"2024-05-08T18:51:15.081630+0000","last_undegraded":"2024-05-08T18:51:15.081630+0000","last_fullsized":"2024-05-08T18:51:15.081630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:40.432123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.080159+0000","last_change":"2024-05-08T18:50:34.050921+0000","last_active":"2024-05-08T18:51:15.080159+0000","last_peered":"2024-05-08T18:51:15.080159+0000","last_clean":"2024-05-08T18:51:15.080159+0000","last_became_active":"2024-05-08T18:50:34.050512+0000","last_became_peered":"2024-05-08T18:50:34.050512+0000","last_unstale":"2024-05-08T18:51:15.080159+0000","last_undegraded":"2024-05-08T18:51:15.080159+0000","last_fullsized":"2024-05-08T18:51:15.080159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:12.079998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"25'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072106+0000","last_change":"2024-05-08T18:50:36.048388+0000","last_active":"2024-05-08T18:51:15.072106+0000","last_peered":"2024-05-08T18:51:15.072106+0000","last_clean":"2024-05-08T18:51:15.072106+0000","last_became_active":"2024-05-08T18:50:36.048075+0000","last_became_peered":"2024-05-08T18:50:36.048075+0000","last_unstale":"2024-05-08T18:51:15.072106+0000","last_undegraded":"2024-05-08T18:51:15.072106+0000","last_fullsized":"2024-05-08T18:51:15.072106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:35.422216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'10","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.861231+0000","last_change":"2024-05-08T18:50:28.026321+0000","last_active":"2024-05-08T18:53:34.861231+0000","last_peered":"2024-05-08T18:53:34.861231+0000","last_clean":"2024-05-08T18:53:34.861231+0000","last_became_active":"2024-05-08T18:50:28.025867+0000","last_became_peered":"2024-05-08T18:50:28.025867+0000","last_unstale":"2024-05-08T18:53:34.861231+0000","last_undegraded":"2024-05-08T18:53:34.861231+0000","last_fullsized":"2024-05-08T18:53:34.861231+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:58.219100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"27'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007580+0000","last_change":"2024-05-08T18:50:26.025750+0000","last_active":"2024-05-08T18:52:48.007580+0000","last_peered":"2024-05-08T18:52:48.007580+0000","last_clean":"2024-05-08T18:52:48.007580+0000","last_became_active":"2024-05-08T18:50:26.025410+0000","last_became_peered":"2024-05-08T18:50:26.025410+0000","last_unstale":"2024-05-08T18:52:48.007580+0000","last_undegraded":"2024-05-08T18:52:48.007580+0000","last_fullsized":"2024-05-08T18:52:48.007580+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:50:43.198256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075129+0000","last_change":"2024-05-08T18:50:30.029531+0000","last_active":"2024-05-08T18:51:15.075129+0000","last_peered":"2024-05-08T18:51:15.075129+0000","last_clean":"2024-05-08T18:51:15.075129+0000","last_became_active":"2024-05-08T18:50:30.029196+0000","last_became_peered":"2024-05-08T18:50:30.029196+0000","last_unstale":"2024-05-08T18:51:15.075129+0000","last_undegraded":"2024-05-08T18:51:15.075129+0000","last_fullsized":"2024-05-08T18:51:15.075129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:03.285378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"25'10","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078489+0000","last_change":"2024-05-08T18:50:32.044406+0000","last_active":"2024-05-08T18:51:15.078489+0000","last_peered":"2024-05-08T18:51:15.078489+0000","last_clean":"2024-05-08T18:51:15.078489+0000","last_became_active":"2024-05-08T18:50:32.044056+0000","last_became_peered":"2024-05-08T18:50:32.044056+0000","last_unstale":"2024-05-08T18:51:15.078489+0000","last_undegraded":"2024-05-08T18:51:15.078489+0000","last_fullsized":"2024-05-08T18:51:15.078489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:24.002892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"27'282","reported_seq":390,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111612+0000","last_change":"2024-05-08T18:50:34.042149+0000","last_active":"2024-05-08T18:53:35.111612+0000","last_peered":"2024-05-08T18:53:35.111612+0000","last_clean":"2024-05-08T18:53:35.111612+0000","last_became_active":"2024-05-08T18:50:34.041872+0000","last_became_peered":"2024-05-08T18:50:34.041872+0000","last_unstale":"2024-05-08T18:53:35.111612+0000","last_undegraded":"2024-05-08T18:53:35.111612+0000","last_fullsized":"2024-05-08T18:53:35.111612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:51.976316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075671+0000","last_change":"2024-05-08T18:50:36.049616+0000","last_active":"2024-05-08T18:51:15.075671+0000","last_peered":"2024-05-08T18:51:15.075671+0000","last_clean":"2024-05-08T18:51:15.075671+0000","last_became_active":"2024-05-08T18:50:36.049346+0000","last_became_peered":"2024-05-08T18:50:36.049346+0000","last_unstale":"2024-05-08T18:51:15.075671+0000","last_undegraded":"2024-05-08T18:51:15.075671+0000","last_fullsized":"2024-05-08T18:51:15.075671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:30:50.522610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'6","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:31.121826+0000","last_change":"2024-05-08T18:50:28.031653+0000","last_active":"2024-05-08T18:52:31.121826+0000","last_peered":"2024-05-08T18:52:31.121826+0000","last_clean":"2024-05-08T18:52:31.121826+0000","last_became_active":"2024-05-08T18:50:28.031332+0000","last_became_peered":"2024-05-08T18:50:28.031332+0000","last_unstale":"2024-05-08T18:52:31.121826+0000","last_undegraded":"2024-05-08T18:52:31.121826+0000","last_fullsized":"2024-05-08T18:52:31.121826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:30.052454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076511+0000","last_change":"2024-05-08T18:50:26.032415+0000","last_active":"2024-05-08T18:51:15.076511+0000","last_peered":"2024-05-08T18:51:15.076511+0000","last_clean":"2024-05-08T18:51:15.076511+0000","last_became_active":"2024-05-08T18:50:26.032155+0000","last_became_peered":"2024-05-08T18:50:26.032155+0000","last_unstale":"2024-05-08T18:51:15.076511+0000","last_undegraded":"2024-05-08T18:51:15.076511+0000","last_fullsized":"2024-05-08T18:51:15.076511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:45.479269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"27'4","reported_seq":226,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.880720+0000","last_change":"2024-05-08T18:50:30.035403+0000","last_active":"2024-05-08T18:52:33.880720+0000","last_peered":"2024-05-08T18:52:33.880720+0000","last_clean":"2024-05-08T18:52:33.880720+0000","last_became_active":"2024-05-08T18:50:30.034798+0000","last_became_peered":"2024-05-08T18:50:30.034798+0000","last_unstale":"2024-05-08T18:52:33.880720+0000","last_undegraded":"2024-05-08T18:52:33.880720+0000","last_fullsized":"2024-05-08T18:52:33.880720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:08:03.148182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"27'30","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.779909+0000","last_change":"2024-05-08T18:50:32.043871+0000","last_active":"2024-05-08T18:52:32.779909+0000","last_peered":"2024-05-08T18:52:32.779909+0000","last_clean":"2024-05-08T18:52:32.779909+0000","last_became_active":"2024-05-08T18:50:32.043573+0000","last_became_peered":"2024-05-08T18:50:32.043573+0000","last_unstale":"2024-05-08T18:52:32.779909+0000","last_undegraded":"2024-05-08T18:52:32.779909+0000","last_fullsized":"2024-05-08T18:52:32.779909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:33:44.166474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"27'282","reported_seq":401,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111691+0000","last_change":"2024-05-08T18:50:34.050464+0000","last_active":"2024-05-08T18:53:35.111691+0000","last_peered":"2024-05-08T18:53:35.111691+0000","last_clean":"2024-05-08T18:53:35.111691+0000","last_became_active":"2024-05-08T18:50:34.050122+0000","last_became_peered":"2024-05-08T18:50:34.050122+0000","last_unstale":"2024-05-08T18:53:35.111691+0000","last_undegraded":"2024-05-08T18:53:35.111691+0000","last_fullsized":"2024-05-08T18:53:35.111691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:11.762112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"27'6","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.691043+0000","last_change":"2024-05-08T18:50:28.035510+0000","last_active":"2024-05-08T18:53:34.691043+0000","last_peered":"2024-05-08T18:53:34.691043+0000","last_clean":"2024-05-08T18:53:34.691043+0000","last_became_active":"2024-05-08T18:50:28.034992+0000","last_became_peered":"2024-05-08T18:50:28.034992+0000","last_unstale":"2024-05-08T18:53:34.691043+0000","last_undegraded":"2024-05-08T18:53:34.691043+0000","last_fullsized":"2024-05-08T18:53:34.691043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:18.934758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079658+0000","last_change":"2024-05-08T18:50:26.023445+0000","last_active":"2024-05-08T18:51:15.079658+0000","last_peered":"2024-05-08T18:51:15.079658+0000","last_clean":"2024-05-08T18:51:15.079658+0000","last_became_active":"2024-05-08T18:50:26.023141+0000","last_became_peered":"2024-05-08T18:50:26.023141+0000","last_unstale":"2024-05-08T18:51:15.079658+0000","last_undegraded":"2024-05-08T18:51:15.079658+0000","last_fullsized":"2024-05-08T18:51:15.079658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:07.534900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075851+0000","last_change":"2024-05-08T18:50:30.030136+0000","last_active":"2024-05-08T18:51:15.075851+0000","last_peered":"2024-05-08T18:51:15.075851+0000","last_clean":"2024-05-08T18:51:15.075851+0000","last_became_active":"2024-05-08T18:50:30.029482+0000","last_became_peered":"2024-05-08T18:50:30.029482+0000","last_unstale":"2024-05-08T18:51:15.075851+0000","last_undegraded":"2024-05-08T18:51:15.075851+0000","last_fullsized":"2024-05-08T18:51:15.075851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:13:46.352309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"27'41","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.789074+0000","last_change":"2024-05-08T18:50:32.038383+0000","last_active":"2024-05-08T18:52:32.789074+0000","last_peered":"2024-05-08T18:52:32.789074+0000","last_clean":"2024-05-08T18:52:32.789074+0000","last_became_active":"2024-05-08T18:50:32.038121+0000","last_became_peered":"2024-05-08T18:50:32.038121+0000","last_unstale":"2024-05-08T18:52:32.789074+0000","last_undegraded":"2024-05-08T18:52:32.789074+0000","last_fullsized":"2024-05-08T18:52:32.789074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:18.512526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072455+0000","last_change":"2024-05-08T18:50:34.047709+0000","last_active":"2024-05-08T18:51:15.072455+0000","last_peered":"2024-05-08T18:51:15.072455+0000","last_clean":"2024-05-08T18:51:15.072455+0000","last_became_active":"2024-05-08T18:50:34.047404+0000","last_became_peered":"2024-05-08T18:50:34.047404+0000","last_unstale":"2024-05-08T18:51:15.072455+0000","last_undegraded":"2024-05-08T18:51:15.072455+0000","last_fullsized":"2024-05-08T18:51:15.072455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:54.419559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"27'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.483004+0000","last_change":"2024-05-08T18:50:36.052192+0000","last_active":"2024-05-08T18:51:50.483004+0000","last_peered":"2024-05-08T18:51:50.483004+0000","last_clean":"2024-05-08T18:51:50.483004+0000","last_became_active":"2024-05-08T18:50:36.051055+0000","last_became_peered":"2024-05-08T18:50:36.051055+0000","last_unstale":"2024-05-08T18:51:50.483004+0000","last_undegraded":"2024-05-08T18:51:50.483004+0000","last_fullsized":"2024-05-08T18:51:50.483004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:38.752303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"27'7","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.868063+0000","last_change":"2024-05-08T18:50:28.018783+0000","last_active":"2024-05-08T18:53:34.868063+0000","last_peered":"2024-05-08T18:53:34.868063+0000","last_clean":"2024-05-08T18:53:34.868063+0000","last_became_active":"2024-05-08T18:50:28.018022+0000","last_became_peered":"2024-05-08T18:50:28.018022+0000","last_unstale":"2024-05-08T18:53:34.868063+0000","last_undegraded":"2024-05-08T18:53:34.868063+0000","last_fullsized":"2024-05-08T18:53:34.868063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:23.858287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076642+0000","last_change":"2024-05-08T18:50:26.025311+0000","last_active":"2024-05-08T18:51:15.076642+0000","last_peered":"2024-05-08T18:51:15.076642+0000","last_clean":"2024-05-08T18:51:15.076642+0000","last_became_active":"2024-05-08T18:50:26.025028+0000","last_became_peered":"2024-05-08T18:50:26.025028+0000","last_unstale":"2024-05-08T18:51:15.076642+0000","last_undegraded":"2024-05-08T18:51:15.076642+0000","last_fullsized":"2024-05-08T18:51:15.076642+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:08:13.942735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072580+0000","last_change":"2024-05-08T18:50:30.032000+0000","last_active":"2024-05-08T18:51:15.072580+0000","last_peered":"2024-05-08T18:51:15.072580+0000","last_clean":"2024-05-08T18:51:15.072580+0000","last_became_active":"2024-05-08T18:50:30.031574+0000","last_became_peered":"2024-05-08T18:50:30.031574+0000","last_unstale":"2024-05-08T18:51:15.072580+0000","last_undegraded":"2024-05-08T18:51:15.072580+0000","last_fullsized":"2024-05-08T18:51:15.072580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:05.406989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"27'32","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.768717+0000","last_change":"2024-05-08T18:50:32.042012+0000","last_active":"2024-05-08T18:52:32.768717+0000","last_peered":"2024-05-08T18:52:32.768717+0000","last_clean":"2024-05-08T18:52:32.768717+0000","last_became_active":"2024-05-08T18:50:32.041239+0000","last_became_peered":"2024-05-08T18:50:32.041239+0000","last_unstale":"2024-05-08T18:52:32.768717+0000","last_undegraded":"2024-05-08T18:52:32.768717+0000","last_fullsized":"2024-05-08T18:52:32.768717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:21.232439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072331+0000","last_change":"2024-05-08T18:50:34.044867+0000","last_active":"2024-05-08T18:51:15.072331+0000","last_peered":"2024-05-08T18:51:15.072331+0000","last_clean":"2024-05-08T18:51:15.072331+0000","last_became_active":"2024-05-08T18:50:34.044487+0000","last_became_peered":"2024-05-08T18:50:34.044487+0000","last_unstale":"2024-05-08T18:51:15.072331+0000","last_undegraded":"2024-05-08T18:51:15.072331+0000","last_fullsized":"2024-05-08T18:51:15.072331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:26:22.790796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"27'7","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.864198+0000","last_change":"2024-05-08T18:50:36.051009+0000","last_active":"2024-05-08T18:53:34.864198+0000","last_peered":"2024-05-08T18:53:34.864198+0000","last_clean":"2024-05-08T18:53:34.864198+0000","last_became_active":"2024-05-08T18:50:36.050379+0000","last_became_peered":"2024-05-08T18:50:36.050379+0000","last_unstale":"2024-05-08T18:53:34.864198+0000","last_undegraded":"2024-05-08T18:53:34.864198+0000","last_fullsized":"2024-05-08T18:53:34.864198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:50.929055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:31.119400+0000","last_change":"2024-05-08T18:50:28.037118+0000","last_active":"2024-05-08T18:52:31.119400+0000","last_peered":"2024-05-08T18:52:31.119400+0000","last_clean":"2024-05-08T18:52:31.119400+0000","last_became_active":"2024-05-08T18:50:28.036821+0000","last_became_peered":"2024-05-08T18:50:28.036821+0000","last_unstale":"2024-05-08T18:52:31.119400+0000","last_undegraded":"2024-05-08T18:52:31.119400+0000","last_fullsized":"2024-05-08T18:52:31.119400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:32.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079688+0000","last_change":"2024-05-08T18:50:26.023248+0000","last_active":"2024-05-08T18:51:15.079688+0000","last_peered":"2024-05-08T18:51:15.079688+0000","last_clean":"2024-05-08T18:51:15.079688+0000","last_became_active":"2024-05-08T18:50:26.022938+0000","last_became_peered":"2024-05-08T18:50:26.022938+0000","last_unstale":"2024-05-08T18:51:15.079688+0000","last_undegraded":"2024-05-08T18:51:15.079688+0000","last_fullsized":"2024-05-08T18:51:15.079688+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:53.195171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073993+0000","last_change":"2024-05-08T18:50:30.029421+0000","last_active":"2024-05-08T18:51:15.073993+0000","last_peered":"2024-05-08T18:51:15.073993+0000","last_clean":"2024-05-08T18:51:15.073993+0000","last_became_active":"2024-05-08T18:50:30.029134+0000","last_became_peered":"2024-05-08T18:50:30.029134+0000","last_unstale":"2024-05-08T18:51:15.073993+0000","last_undegraded":"2024-05-08T18:51:15.073993+0000","last_fullsized":"2024-05-08T18:51:15.073993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:46.684447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"27'37","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.790970+0000","last_change":"2024-05-08T18:50:32.035457+0000","last_active":"2024-05-08T18:52:32.790970+0000","last_peered":"2024-05-08T18:52:32.790970+0000","last_clean":"2024-05-08T18:52:32.790970+0000","last_became_active":"2024-05-08T18:50:32.035189+0000","last_became_peered":"2024-05-08T18:50:32.035189+0000","last_unstale":"2024-05-08T18:52:32.790970+0000","last_undegraded":"2024-05-08T18:52:32.790970+0000","last_fullsized":"2024-05-08T18:52:32.790970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:02.364503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"27'282","reported_seq":354,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111702+0000","last_change":"2024-05-08T18:50:34.048274+0000","last_active":"2024-05-08T18:53:35.111702+0000","last_peered":"2024-05-08T18:53:35.111702+0000","last_clean":"2024-05-08T18:53:35.111702+0000","last_became_active":"2024-05-08T18:50:34.047999+0000","last_became_peered":"2024-05-08T18:50:34.047999+0000","last_unstale":"2024-05-08T18:53:35.111702+0000","last_undegraded":"2024-05-08T18:53:35.111702+0000","last_fullsized":"2024-05-08T18:53:35.111702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:36.744889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073643+0000","last_change":"2024-05-08T18:50:36.048278+0000","last_active":"2024-05-08T18:51:15.073643+0000","last_peered":"2024-05-08T18:51:15.073643+0000","last_clean":"2024-05-08T18:51:15.073643+0000","last_became_active":"2024-05-08T18:50:36.047981+0000","last_became_peered":"2024-05-08T18:50:36.047981+0000","last_unstale":"2024-05-08T18:51:15.073643+0000","last_undegraded":"2024-05-08T18:51:15.073643+0000","last_fullsized":"2024-05-08T18:51:15.073643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:39.176315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"27'8","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.474560+0000","last_change":"2024-05-08T18:50:28.020443+0000","last_active":"2024-05-08T18:51:50.474560+0000","last_peered":"2024-05-08T18:51:50.474560+0000","last_clean":"2024-05-08T18:51:50.474560+0000","last_became_active":"2024-05-08T18:50:28.020004+0000","last_became_peered":"2024-05-08T18:50:28.020004+0000","last_unstale":"2024-05-08T18:51:50.474560+0000","last_undegraded":"2024-05-08T18:51:50.474560+0000","last_fullsized":"2024-05-08T18:51:50.474560+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:26.670671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079070+0000","last_change":"2024-05-08T18:50:26.017413+0000","last_active":"2024-05-08T18:51:15.079070+0000","last_peered":"2024-05-08T18:51:15.079070+0000","last_clean":"2024-05-08T18:51:15.079070+0000","last_became_active":"2024-05-08T18:50:26.015955+0000","last_became_peered":"2024-05-08T18:50:26.015955+0000","last_unstale":"2024-05-08T18:51:15.079070+0000","last_undegraded":"2024-05-08T18:51:15.079070+0000","last_fullsized":"2024-05-08T18:51:15.079070+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:59.585275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073289+0000","last_change":"2024-05-08T18:50:30.030443+0000","last_active":"2024-05-08T18:51:15.073289+0000","last_peered":"2024-05-08T18:51:15.073289+0000","last_clean":"2024-05-08T18:51:15.073289+0000","last_became_active":"2024-05-08T18:50:30.030140+0000","last_became_peered":"2024-05-08T18:50:30.030140+0000","last_unstale":"2024-05-08T18:51:15.073289+0000","last_undegraded":"2024-05-08T18:51:15.073289+0000","last_fullsized":"2024-05-08T18:51:15.073289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:27.912865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"27'55","reported_seq":111,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.793380+0000","last_change":"2024-05-08T18:50:32.041420+0000","last_active":"2024-05-08T18:52:32.793380+0000","last_peered":"2024-05-08T18:52:32.793380+0000","last_clean":"2024-05-08T18:52:32.793380+0000","last_became_active":"2024-05-08T18:50:32.040633+0000","last_became_peered":"2024-05-08T18:50:32.040633+0000","last_unstale":"2024-05-08T18:52:32.793380+0000","last_undegraded":"2024-05-08T18:52:32.793380+0000","last_fullsized":"2024-05-08T18:52:32.793380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.162116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072394+0000","last_change":"2024-05-08T18:50:34.044110+0000","last_active":"2024-05-08T18:51:15.072394+0000","last_peered":"2024-05-08T18:51:15.072394+0000","last_clean":"2024-05-08T18:51:15.072394+0000","last_became_active":"2024-05-08T18:50:34.043817+0000","last_became_peered":"2024-05-08T18:50:34.043817+0000","last_unstale":"2024-05-08T18:51:15.072394+0000","last_undegraded":"2024-05-08T18:51:15.072394+0000","last_fullsized":"2024-05-08T18:51:15.072394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:52.535624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"27'18","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.978577+0000","last_change":"2024-05-08T18:50:36.054529+0000","last_active":"2024-05-08T18:53:34.978577+0000","last_peered":"2024-05-08T18:53:34.978577+0000","last_clean":"2024-05-08T18:53:34.978577+0000","last_became_active":"2024-05-08T18:50:36.054237+0000","last_became_peered":"2024-05-08T18:50:36.054237+0000","last_unstale":"2024-05-08T18:53:34.978577+0000","last_undegraded":"2024-05-08T18:53:34.978577+0000","last_fullsized":"2024-05-08T18:53:34.978577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:06.378701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"27'10","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.862996+0000","last_change":"2024-05-08T18:51:15.097690+0000","last_active":"2024-05-08T18:53:34.862996+0000","last_peered":"2024-05-08T18:53:34.862996+0000","last_clean":"2024-05-08T18:53:34.862996+0000","last_became_active":"2024-05-08T18:51:15.085560+0000","last_became_peered":"2024-05-08T18:51:15.085560+0000","last_unstale":"2024-05-08T18:53:34.862996+0000","last_undegraded":"2024-05-08T18:53:34.862996+0000","last_fullsized":"2024-05-08T18:53:34.862996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:42.900712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.080760+0000","last_change":"2024-05-08T18:51:15.080314+0000","last_active":"2024-05-08T18:51:15.080760+0000","last_peered":"2024-05-08T18:51:15.080760+0000","last_clean":"2024-05-08T18:51:15.080760+0000","last_became_active":"2024-05-08T18:51:15.080071+0000","last_became_peered":"2024-05-08T18:51:15.080071+0000","last_unstale":"2024-05-08T18:51:15.080760+0000","last_undegraded":"2024-05-08T18:51:15.080760+0000","last_fullsized":"2024-05-08T18:51:15.080760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:41.372462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075379+0000","last_change":"2024-05-08T18:50:30.033626+0000","last_active":"2024-05-08T18:51:15.075379+0000","last_peered":"2024-05-08T18:51:15.075379+0000","last_clean":"2024-05-08T18:51:15.075379+0000","last_became_active":"2024-05-08T18:50:30.033318+0000","last_became_peered":"2024-05-08T18:50:30.033318+0000","last_unstale":"2024-05-08T18:51:15.075379+0000","last_undegraded":"2024-05-08T18:51:15.075379+0000","last_fullsized":"2024-05-08T18:51:15.075379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:25.936937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"27'33","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007320+0000","last_change":"2024-05-08T18:50:32.035227+0000","last_active":"2024-05-08T18:52:48.007320+0000","last_peered":"2024-05-08T18:52:48.007320+0000","last_clean":"2024-05-08T18:52:48.007320+0000","last_became_active":"2024-05-08T18:50:32.034914+0000","last_became_peered":"2024-05-08T18:50:32.034914+0000","last_unstale":"2024-05-08T18:52:48.007320+0000","last_undegraded":"2024-05-08T18:52:48.007320+0000","last_fullsized":"2024-05-08T18:52:48.007320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:42:57.344797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.082244+0000","last_change":"2024-05-08T18:50:34.047372+0000","last_active":"2024-05-08T18:51:15.082244+0000","last_peered":"2024-05-08T18:51:15.082244+0000","last_clean":"2024-05-08T18:51:15.082244+0000","last_became_active":"2024-05-08T18:50:34.047075+0000","last_became_peered":"2024-05-08T18:50:34.047075+0000","last_unstale":"2024-05-08T18:51:15.082244+0000","last_undegraded":"2024-05-08T18:51:15.082244+0000","last_fullsized":"2024-05-08T18:51:15.082244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:39.931353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"27'3","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.005911+0000","last_change":"2024-05-08T18:50:36.055688+0000","last_active":"2024-05-08T18:52:38.005911+0000","last_peered":"2024-05-08T18:52:38.005911+0000","last_clean":"2024-05-08T18:52:38.005911+0000","last_became_active":"2024-05-08T18:50:36.055385+0000","last_became_peered":"2024-05-08T18:50:36.055385+0000","last_unstale":"2024-05-08T18:52:38.005911+0000","last_undegraded":"2024-05-08T18:52:38.005911+0000","last_fullsized":"2024-05-08T18:52:38.005911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:06.579528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'4","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.243668+0000","last_change":"2024-05-08T18:50:28.039067+0000","last_active":"2024-05-08T18:52:34.243668+0000","last_peered":"2024-05-08T18:52:34.243668+0000","last_clean":"2024-05-08T18:52:34.243668+0000","last_became_active":"2024-05-08T18:50:28.038633+0000","last_became_peered":"2024-05-08T18:50:28.038633+0000","last_unstale":"2024-05-08T18:52:34.243668+0000","last_undegraded":"2024-05-08T18:52:34.243668+0000","last_fullsized":"2024-05-08T18:52:34.243668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:06.211199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077754+0000","last_change":"2024-05-08T18:50:26.016599+0000","last_active":"2024-05-08T18:51:15.077754+0000","last_peered":"2024-05-08T18:51:15.077754+0000","last_clean":"2024-05-08T18:51:15.077754+0000","last_became_active":"2024-05-08T18:50:26.016308+0000","last_became_peered":"2024-05-08T18:50:26.016308+0000","last_unstale":"2024-05-08T18:51:15.077754+0000","last_undegraded":"2024-05-08T18:51:15.077754+0000","last_fullsized":"2024-05-08T18:51:15.077754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:04.583010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074792+0000","last_change":"2024-05-08T18:50:30.032199+0000","last_active":"2024-05-08T18:51:15.074792+0000","last_peered":"2024-05-08T18:51:15.074792+0000","last_clean":"2024-05-08T18:51:15.074792+0000","last_became_active":"2024-05-08T18:50:30.031765+0000","last_became_peered":"2024-05-08T18:50:30.031765+0000","last_unstale":"2024-05-08T18:51:15.074792+0000","last_undegraded":"2024-05-08T18:51:15.074792+0000","last_fullsized":"2024-05-08T18:51:15.074792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:33:42.159316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"27'36","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.800005+0000","last_change":"2024-05-08T18:50:32.035413+0000","last_active":"2024-05-08T18:52:32.800005+0000","last_peered":"2024-05-08T18:52:32.800005+0000","last_clean":"2024-05-08T18:52:32.800005+0000","last_became_active":"2024-05-08T18:50:32.035131+0000","last_became_peered":"2024-05-08T18:50:32.035131+0000","last_unstale":"2024-05-08T18:52:32.800005+0000","last_undegraded":"2024-05-08T18:52:32.800005+0000","last_fullsized":"2024-05-08T18:52:32.800005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:01:11.472580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"27'282","reported_seq":430,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111592+0000","last_change":"2024-05-08T18:50:34.047467+0000","last_active":"2024-05-08T18:53:35.111592+0000","last_peered":"2024-05-08T18:53:35.111592+0000","last_clean":"2024-05-08T18:53:35.111592+0000","last_became_active":"2024-05-08T18:50:34.047184+0000","last_became_peered":"2024-05-08T18:50:34.047184+0000","last_unstale":"2024-05-08T18:53:35.111592+0000","last_undegraded":"2024-05-08T18:53:35.111592+0000","last_fullsized":"2024-05-08T18:53:35.111592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:17.134805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"27'12","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.001806+0000","last_change":"2024-05-08T18:50:36.046523+0000","last_active":"2024-05-08T18:52:43.001806+0000","last_peered":"2024-05-08T18:52:43.001806+0000","last_clean":"2024-05-08T18:52:43.001806+0000","last_became_active":"2024-05-08T18:50:36.046209+0000","last_became_peered":"2024-05-08T18:50:36.046209+0000","last_unstale":"2024-05-08T18:52:43.001806+0000","last_undegraded":"2024-05-08T18:52:43.001806+0000","last_fullsized":"2024-05-08T18:52:43.001806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:18.424066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'6","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.661317+0000","last_change":"2024-05-08T18:50:28.037293+0000","last_active":"2024-05-08T18:51:50.661317+0000","last_peered":"2024-05-08T18:51:50.661317+0000","last_clean":"2024-05-08T18:51:50.661317+0000","last_became_active":"2024-05-08T18:50:28.036946+0000","last_became_peered":"2024-05-08T18:50:28.036946+0000","last_unstale":"2024-05-08T18:51:50.661317+0000","last_undegraded":"2024-05-08T18:51:50.661317+0000","last_fullsized":"2024-05-08T18:51:50.661317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:01.592206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076372+0000","last_change":"2024-05-08T18:50:26.027911+0000","last_active":"2024-05-08T18:51:15.076372+0000","last_peered":"2024-05-08T18:51:15.076372+0000","last_clean":"2024-05-08T18:51:15.076372+0000","last_became_active":"2024-05-08T18:50:26.027657+0000","last_became_peered":"2024-05-08T18:50:26.027657+0000","last_unstale":"2024-05-08T18:51:15.076372+0000","last_undegraded":"2024-05-08T18:51:15.076372+0000","last_fullsized":"2024-05-08T18:51:15.076372+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:36.094238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"27'3","reported_seq":413,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.890204+0000","last_change":"2024-05-08T18:50:30.027736+0000","last_active":"2024-05-08T18:52:33.890204+0000","last_peered":"2024-05-08T18:52:33.890204+0000","last_clean":"2024-05-08T18:52:33.890204+0000","last_became_active":"2024-05-08T18:50:30.027420+0000","last_became_peered":"2024-05-08T18:50:30.027420+0000","last_unstale":"2024-05-08T18:52:33.890204+0000","last_undegraded":"2024-05-08T18:52:33.890204+0000","last_fullsized":"2024-05-08T18:52:33.890204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:18.447327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'11","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007718+0000","last_change":"2024-05-08T18:50:32.041941+0000","last_active":"2024-05-08T18:52:48.007718+0000","last_peered":"2024-05-08T18:52:48.007718+0000","last_clean":"2024-05-08T18:52:48.007718+0000","last_became_active":"2024-05-08T18:50:32.040988+0000","last_became_peered":"2024-05-08T18:50:32.040988+0000","last_unstale":"2024-05-08T18:52:48.007718+0000","last_undegraded":"2024-05-08T18:52:48.007718+0000","last_fullsized":"2024-05-08T18:52:48.007718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:07.623019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"27'282","reported_seq":459,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111667+0000","last_change":"2024-05-08T18:50:34.040798+0000","last_active":"2024-05-08T18:53:35.111667+0000","last_peered":"2024-05-08T18:53:35.111667+0000","last_clean":"2024-05-08T18:53:35.111667+0000","last_became_active":"2024-05-08T18:50:34.040477+0000","last_became_peered":"2024-05-08T18:50:34.040477+0000","last_unstale":"2024-05-08T18:53:35.111667+0000","last_undegraded":"2024-05-08T18:53:35.111667+0000","last_fullsized":"2024-05-08T18:53:35.111667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:35.940316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.028319+0000","last_change":"2024-05-08T18:50:36.047258+0000","last_active":"2024-05-08T18:52:34.028319+0000","last_peered":"2024-05-08T18:52:34.028319+0000","last_clean":"2024-05-08T18:52:34.028319+0000","last_became_active":"2024-05-08T18:50:36.045976+0000","last_became_peered":"2024-05-08T18:50:36.045976+0000","last_unstale":"2024-05-08T18:52:34.028319+0000","last_undegraded":"2024-05-08T18:52:34.028319+0000","last_fullsized":"2024-05-08T18:52:34.028319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:00.262083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.823223+0000","last_change":"2024-05-08T18:50:28.039262+0000","last_active":"2024-05-08T18:53:34.823223+0000","last_peered":"2024-05-08T18:53:34.823223+0000","last_clean":"2024-05-08T18:53:34.823223+0000","last_became_active":"2024-05-08T18:50:28.038871+0000","last_became_peered":"2024-05-08T18:50:28.038871+0000","last_unstale":"2024-05-08T18:53:34.823223+0000","last_undegraded":"2024-05-08T18:53:34.823223+0000","last_fullsized":"2024-05-08T18:53:34.823223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:03.400002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073931+0000","last_change":"2024-05-08T18:50:26.025766+0000","last_active":"2024-05-08T18:51:15.073931+0000","last_peered":"2024-05-08T18:51:15.073931+0000","last_clean":"2024-05-08T18:51:15.073931+0000","last_became_active":"2024-05-08T18:50:26.025547+0000","last_became_peered":"2024-05-08T18:50:26.025547+0000","last_unstale":"2024-05-08T18:51:15.073931+0000","last_undegraded":"2024-05-08T18:51:15.073931+0000","last_fullsized":"2024-05-08T18:51:15.073931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:51:35.439520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079352+0000","last_change":"2024-05-08T18:50:30.036033+0000","last_active":"2024-05-08T18:51:15.079352+0000","last_peered":"2024-05-08T18:51:15.079352+0000","last_clean":"2024-05-08T18:51:15.079352+0000","last_became_active":"2024-05-08T18:50:30.035734+0000","last_became_peered":"2024-05-08T18:50:30.035734+0000","last_unstale":"2024-05-08T18:51:15.079352+0000","last_undegraded":"2024-05-08T18:51:15.079352+0000","last_fullsized":"2024-05-08T18:51:15.079352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:58.722929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"27'38","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.786197+0000","last_change":"2024-05-08T18:50:32.035183+0000","last_active":"2024-05-08T18:52:32.786197+0000","last_peered":"2024-05-08T18:52:32.786197+0000","last_clean":"2024-05-08T18:52:32.786197+0000","last_became_active":"2024-05-08T18:50:32.034769+0000","last_became_peered":"2024-05-08T18:50:32.034769+0000","last_unstale":"2024-05-08T18:52:32.786197+0000","last_undegraded":"2024-05-08T18:52:32.786197+0000","last_fullsized":"2024-05-08T18:52:32.786197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:53.194472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076855+0000","last_change":"2024-05-08T18:50:34.050327+0000","last_active":"2024-05-08T18:51:15.076855+0000","last_peered":"2024-05-08T18:51:15.076855+0000","last_clean":"2024-05-08T18:51:15.076855+0000","last_became_active":"2024-05-08T18:50:34.050018+0000","last_became_peered":"2024-05-08T18:50:34.050018+0000","last_unstale":"2024-05-08T18:51:15.076855+0000","last_undegraded":"2024-05-08T18:51:15.076855+0000","last_fullsized":"2024-05-08T18:51:15.076855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:38.228671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"27'8","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.918767+0000","last_change":"2024-05-08T18:50:36.049559+0000","last_active":"2024-05-08T18:53:34.918767+0000","last_peered":"2024-05-08T18:53:34.918767+0000","last_clean":"2024-05-08T18:53:34.918767+0000","last_became_active":"2024-05-08T18:50:36.049274+0000","last_became_peered":"2024-05-08T18:50:36.049274+0000","last_unstale":"2024-05-08T18:53:34.918767+0000","last_undegraded":"2024-05-08T18:53:34.918767+0000","last_fullsized":"2024-05-08T18:53:34.918767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:35.422216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'8","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887656+0000","last_change":"2024-05-08T18:50:28.037991+0000","last_active":"2024-05-08T18:53:34.887656+0000","last_peered":"2024-05-08T18:53:34.887656+0000","last_clean":"2024-05-08T18:53:34.887656+0000","last_became_active":"2024-05-08T18:50:28.037545+0000","last_became_peered":"2024-05-08T18:50:28.037545+0000","last_unstale":"2024-05-08T18:53:34.887656+0000","last_undegraded":"2024-05-08T18:53:34.887656+0000","last_fullsized":"2024-05-08T18:53:34.887656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:00.327493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":133,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073990+0000","last_change":"2024-05-08T18:50:19.740594+0000","last_active":"2024-05-08T18:51:15.073990+0000","last_peered":"2024-05-08T18:51:15.073990+0000","last_clean":"2024-05-08T18:51:15.073990+0000","last_became_active":"2024-05-08T18:50:19.739986+0000","last_became_peered":"2024-05-08T18:50:19.739986+0000","last_unstale":"2024-05-08T18:51:15.073990+0000","last_undegraded":"2024-05-08T18:51:15.073990+0000","last_fullsized":"2024-05-08T18:51:15.073990+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:57.647604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077812+0000","last_change":"2024-05-08T18:50:19.740266+0000","last_active":"2024-05-08T18:51:15.077812+0000","last_peered":"2024-05-08T18:51:15.077812+0000","last_clean":"2024-05-08T18:51:15.077812+0000","last_became_active":"2024-05-08T18:50:19.739403+0000","last_became_peered":"2024-05-08T18:50:19.739403+0000","last_unstale":"2024-05-08T18:51:15.077812+0000","last_undegraded":"2024-05-08T18:51:15.077812+0000","last_fullsized":"2024-05-08T18:51:15.077812+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:59:48.671095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076533+0000","last_change":"2024-05-08T18:50:26.026328+0000","last_active":"2024-05-08T18:51:15.076533+0000","last_peered":"2024-05-08T18:51:15.076533+0000","last_clean":"2024-05-08T18:51:15.076533+0000","last_became_active":"2024-05-08T18:50:26.024249+0000","last_became_peered":"2024-05-08T18:50:26.024249+0000","last_unstale":"2024-05-08T18:51:15.076533+0000","last_undegraded":"2024-05-08T18:51:15.076533+0000","last_fullsized":"2024-05-08T18:51:15.076533+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:04.180310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078700+0000","last_change":"2024-05-08T18:50:30.030654+0000","last_active":"2024-05-08T18:51:15.078700+0000","last_peered":"2024-05-08T18:51:15.078700+0000","last_clean":"2024-05-08T18:51:15.078700+0000","last_became_active":"2024-05-08T18:50:30.029744+0000","last_became_peered":"2024-05-08T18:50:30.029744+0000","last_unstale":"2024-05-08T18:51:15.078700+0000","last_undegraded":"2024-05-08T18:51:15.078700+0000","last_fullsized":"2024-05-08T18:51:15.078700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:45.741064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"27'76","reported_seq":145,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.797996+0000","last_change":"2024-05-08T18:50:32.043836+0000","last_active":"2024-05-08T18:52:32.797996+0000","last_peered":"2024-05-08T18:52:32.797996+0000","last_clean":"2024-05-08T18:52:32.797996+0000","last_became_active":"2024-05-08T18:50:32.043533+0000","last_became_peered":"2024-05-08T18:50:32.043533+0000","last_unstale":"2024-05-08T18:52:32.797996+0000","last_undegraded":"2024-05-08T18:52:32.797996+0000","last_fullsized":"2024-05-08T18:52:32.797996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:19.800626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074939+0000","last_change":"2024-05-08T18:50:34.049133+0000","last_active":"2024-05-08T18:51:15.074939+0000","last_peered":"2024-05-08T18:51:15.074939+0000","last_clean":"2024-05-08T18:51:15.074939+0000","last_became_active":"2024-05-08T18:50:34.048859+0000","last_became_peered":"2024-05-08T18:50:34.048859+0000","last_unstale":"2024-05-08T18:51:15.074939+0000","last_undegraded":"2024-05-08T18:51:15.074939+0000","last_fullsized":"2024-05-08T18:51:15.074939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:08:07.162123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"27'81","reported_seq":162,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.897033+0000","last_change":"2024-05-08T18:50:36.045215+0000","last_active":"2024-05-08T18:53:34.897033+0000","last_peered":"2024-05-08T18:53:34.897033+0000","last_clean":"2024-05-08T18:53:34.897033+0000","last_became_active":"2024-05-08T18:50:36.044928+0000","last_became_peered":"2024-05-08T18:50:36.044928+0000","last_unstale":"2024-05-08T18:53:34.897033+0000","last_undegraded":"2024-05-08T18:53:34.897033+0000","last_fullsized":"2024-05-08T18:53:34.897033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:21.101455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"27'4","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.475111+0000","last_change":"2024-05-08T18:50:28.032137+0000","last_active":"2024-05-08T18:51:50.475111+0000","last_peered":"2024-05-08T18:51:50.475111+0000","last_clean":"2024-05-08T18:51:50.475111+0000","last_became_active":"2024-05-08T18:50:28.030761+0000","last_became_peered":"2024-05-08T18:50:28.030761+0000","last_unstale":"2024-05-08T18:51:50.475111+0000","last_undegraded":"2024-05-08T18:51:50.475111+0000","last_fullsized":"2024-05-08T18:51:50.475111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:32.207743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073767+0000","last_change":"2024-05-08T18:50:19.739194+0000","last_active":"2024-05-08T18:51:15.073767+0000","last_peered":"2024-05-08T18:51:15.073767+0000","last_clean":"2024-05-08T18:51:15.073767+0000","last_became_active":"2024-05-08T18:50:19.738872+0000","last_became_peered":"2024-05-08T18:50:19.738872+0000","last_unstale":"2024-05-08T18:51:15.073767+0000","last_undegraded":"2024-05-08T18:51:15.073767+0000","last_fullsized":"2024-05-08T18:51:15.073767+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:28:20.859312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072516+0000","last_change":"2024-05-08T18:50:26.024886+0000","last_active":"2024-05-08T18:51:15.072516+0000","last_peered":"2024-05-08T18:51:15.072516+0000","last_clean":"2024-05-08T18:51:15.072516+0000","last_became_active":"2024-05-08T18:50:26.024549+0000","last_became_peered":"2024-05-08T18:50:26.024549+0000","last_unstale":"2024-05-08T18:51:15.072516+0000","last_undegraded":"2024-05-08T18:51:15.072516+0000","last_fullsized":"2024-05-08T18:51:15.072516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:47.912064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.089720+0000","last_change":"2024-05-08T18:51:15.084930+0000","last_active":"2024-05-08T18:51:15.089720+0000","last_peered":"2024-05-08T18:51:15.089720+0000","last_clean":"2024-05-08T18:51:15.089720+0000","last_became_active":"2024-05-08T18:51:15.084599+0000","last_became_peered":"2024-05-08T18:51:15.084599+0000","last_unstale":"2024-05-08T18:51:15.089720+0000","last_undegraded":"2024-05-08T18:51:15.089720+0000","last_fullsized":"2024-05-08T18:51:15.089720+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:34.404707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"27'273","reported_seq":476,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111615+0000","last_change":"2024-05-08T18:50:32.044834+0000","last_active":"2024-05-08T18:53:35.111615+0000","last_peered":"2024-05-08T18:53:35.111615+0000","last_clean":"2024-05-08T18:53:35.111615+0000","last_became_active":"2024-05-08T18:50:32.044539+0000","last_became_peered":"2024-05-08T18:50:32.044539+0000","last_unstale":"2024-05-08T18:53:35.111615+0000","last_undegraded":"2024-05-08T18:53:35.111615+0000","last_fullsized":"2024-05-08T18:53:35.111615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:10.225343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077927+0000","last_change":"2024-05-08T18:50:34.044400+0000","last_active":"2024-05-08T18:51:15.077927+0000","last_peered":"2024-05-08T18:51:15.077927+0000","last_clean":"2024-05-08T18:51:15.077927+0000","last_became_active":"2024-05-08T18:50:34.043966+0000","last_became_peered":"2024-05-08T18:50:34.043966+0000","last_unstale":"2024-05-08T18:51:15.077927+0000","last_undegraded":"2024-05-08T18:51:15.077927+0000","last_fullsized":"2024-05-08T18:51:15.077927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:35.369229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"27'3","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.479087+0000","last_change":"2024-05-08T18:50:36.050905+0000","last_active":"2024-05-08T18:51:50.479087+0000","last_peered":"2024-05-08T18:51:50.479087+0000","last_clean":"2024-05-08T18:51:50.479087+0000","last_became_active":"2024-05-08T18:50:36.050573+0000","last_became_peered":"2024-05-08T18:50:36.050573+0000","last_unstale":"2024-05-08T18:51:50.479087+0000","last_undegraded":"2024-05-08T18:51:50.479087+0000","last_fullsized":"2024-05-08T18:51:50.479087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:54:56.963493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:31.121841+0000","last_change":"2024-05-08T18:50:28.027882+0000","last_active":"2024-05-08T18:52:31.121841+0000","last_peered":"2024-05-08T18:52:31.121841+0000","last_clean":"2024-05-08T18:52:31.121841+0000","last_became_active":"2024-05-08T18:50:28.027492+0000","last_became_peered":"2024-05-08T18:50:28.027492+0000","last_unstale":"2024-05-08T18:52:31.121841+0000","last_undegraded":"2024-05-08T18:52:31.121841+0000","last_fullsized":"2024-05-08T18:52:31.121841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:13.501403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074929+0000","last_change":"2024-05-08T18:50:19.739149+0000","last_active":"2024-05-08T18:51:15.074929+0000","last_peered":"2024-05-08T18:51:15.074929+0000","last_clean":"2024-05-08T18:51:15.074929+0000","last_became_active":"2024-05-08T18:50:19.738788+0000","last_became_peered":"2024-05-08T18:50:19.738788+0000","last_unstale":"2024-05-08T18:51:15.074929+0000","last_undegraded":"2024-05-08T18:51:15.074929+0000","last_fullsized":"2024-05-08T18:51:15.074929+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:29:46.772075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.071890+0000","last_change":"2024-05-08T18:50:26.029767+0000","last_active":"2024-05-08T18:51:15.071890+0000","last_peered":"2024-05-08T18:51:15.071890+0000","last_clean":"2024-05-08T18:51:15.071890+0000","last_became_active":"2024-05-08T18:50:26.029197+0000","last_became_peered":"2024-05-08T18:50:26.029197+0000","last_unstale":"2024-05-08T18:51:15.071890+0000","last_undegraded":"2024-05-08T18:51:15.071890+0000","last_fullsized":"2024-05-08T18:51:15.071890+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:59.917414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"18'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076801+0000","last_change":"2024-05-08T18:50:30.028419+0000","last_active":"2024-05-08T18:51:15.076801+0000","last_peered":"2024-05-08T18:51:15.076801+0000","last_clean":"2024-05-08T18:51:15.076801+0000","last_became_active":"2024-05-08T18:50:30.028028+0000","last_became_peered":"2024-05-08T18:50:30.028028+0000","last_unstale":"2024-05-08T18:51:15.076801+0000","last_undegraded":"2024-05-08T18:51:15.076801+0000","last_fullsized":"2024-05-08T18:51:15.076801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:34.893503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"27'16","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:30.110915+0000","last_change":"2024-05-08T18:50:32.036344+0000","last_active":"2024-05-08T18:53:30.110915+0000","last_peered":"2024-05-08T18:53:30.110915+0000","last_clean":"2024-05-08T18:53:30.110915+0000","last_became_active":"2024-05-08T18:50:32.036051+0000","last_became_peered":"2024-05-08T18:50:32.036051+0000","last_unstale":"2024-05-08T18:53:30.110915+0000","last_undegraded":"2024-05-08T18:53:30.110915+0000","last_fullsized":"2024-05-08T18:53:30.110915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:48.691605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073226+0000","last_change":"2024-05-08T18:50:34.045839+0000","last_active":"2024-05-08T18:51:15.073226+0000","last_peered":"2024-05-08T18:51:15.073226+0000","last_clean":"2024-05-08T18:51:15.073226+0000","last_became_active":"2024-05-08T18:50:34.045541+0000","last_became_peered":"2024-05-08T18:50:34.045541+0000","last_unstale":"2024-05-08T18:51:15.073226+0000","last_undegraded":"2024-05-08T18:51:15.073226+0000","last_fullsized":"2024-05-08T18:51:15.073226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:02.736870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077233+0000","last_change":"2024-05-08T18:50:36.058086+0000","last_active":"2024-05-08T18:51:15.077233+0000","last_peered":"2024-05-08T18:51:15.077233+0000","last_clean":"2024-05-08T18:51:15.077233+0000","last_became_active":"2024-05-08T18:50:36.057093+0000","last_became_peered":"2024-05-08T18:50:36.057093+0000","last_unstale":"2024-05-08T18:51:15.077233+0000","last_undegraded":"2024-05-08T18:51:15.077233+0000","last_fullsized":"2024-05-08T18:51:15.077233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:29:55.363199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'22","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887602+0000","last_change":"2024-05-08T18:50:28.026195+0000","last_active":"2024-05-08T18:53:34.887602+0000","last_peered":"2024-05-08T18:53:34.887602+0000","last_clean":"2024-05-08T18:53:34.887602+0000","last_became_active":"2024-05-08T18:50:28.025645+0000","last_became_peered":"2024-05-08T18:50:28.025645+0000","last_unstale":"2024-05-08T18:53:34.887602+0000","last_undegraded":"2024-05-08T18:53:34.887602+0000","last_fullsized":"2024-05-08T18:53:34.887602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:24.508392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076436+0000","last_change":"2024-05-08T18:50:19.739898+0000","last_active":"2024-05-08T18:51:15.076436+0000","last_peered":"2024-05-08T18:51:15.076436+0000","last_clean":"2024-05-08T18:51:15.076436+0000","last_became_active":"2024-05-08T18:50:19.739620+0000","last_became_peered":"2024-05-08T18:50:19.739620+0000","last_unstale":"2024-05-08T18:51:15.076436+0000","last_undegraded":"2024-05-08T18:51:15.076436+0000","last_fullsized":"2024-05-08T18:51:15.076436+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:58.286521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.651104+0000","last_change":"2024-05-08T18:50:26.023831+0000","last_active":"2024-05-08T18:51:50.651104+0000","last_peered":"2024-05-08T18:51:50.651104+0000","last_clean":"2024-05-08T18:51:50.651104+0000","last_became_active":"2024-05-08T18:50:26.023522+0000","last_became_peered":"2024-05-08T18:50:26.023522+0000","last_unstale":"2024-05-08T18:51:50.651104+0000","last_undegraded":"2024-05-08T18:51:50.651104+0000","last_fullsized":"2024-05-08T18:51:50.651104+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:07.271771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075093+0000","last_change":"2024-05-08T18:50:30.035182+0000","last_active":"2024-05-08T18:51:15.075093+0000","last_peered":"2024-05-08T18:51:15.075093+0000","last_clean":"2024-05-08T18:51:15.075093+0000","last_became_active":"2024-05-08T18:50:30.034806+0000","last_became_peered":"2024-05-08T18:50:30.034806+0000","last_unstale":"2024-05-08T18:51:15.075093+0000","last_undegraded":"2024-05-08T18:51:15.075093+0000","last_fullsized":"2024-05-08T18:51:15.075093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:21.995734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"27'13","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.256028+0000","last_change":"2024-05-08T18:50:32.042494+0000","last_active":"2024-05-08T18:53:34.256028+0000","last_peered":"2024-05-08T18:53:34.256028+0000","last_clean":"2024-05-08T18:53:34.256028+0000","last_became_active":"2024-05-08T18:50:32.042183+0000","last_became_peered":"2024-05-08T18:50:32.042183+0000","last_unstale":"2024-05-08T18:53:34.256028+0000","last_undegraded":"2024-05-08T18:53:34.256028+0000","last_fullsized":"2024-05-08T18:53:34.256028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:21.537487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.082328+0000","last_change":"2024-05-08T18:50:34.045641+0000","last_active":"2024-05-08T18:51:15.082328+0000","last_peered":"2024-05-08T18:51:15.082328+0000","last_clean":"2024-05-08T18:51:15.082328+0000","last_became_active":"2024-05-08T18:50:34.044358+0000","last_became_peered":"2024-05-08T18:50:34.044358+0000","last_unstale":"2024-05-08T18:51:15.082328+0000","last_undegraded":"2024-05-08T18:51:15.082328+0000","last_fullsized":"2024-05-08T18:51:15.082328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:30:35.167490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.008973+0000","last_change":"2024-05-08T18:50:36.058516+0000","last_active":"2024-05-08T18:52:34.008973+0000","last_peered":"2024-05-08T18:52:34.008973+0000","last_clean":"2024-05-08T18:52:34.008973+0000","last_became_active":"2024-05-08T18:50:36.058267+0000","last_became_peered":"2024-05-08T18:50:36.058267+0000","last_unstale":"2024-05-08T18:52:34.008973+0000","last_undegraded":"2024-05-08T18:52:34.008973+0000","last_fullsized":"2024-05-08T18:52:34.008973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:30.137484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'12","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.607240+0000","last_change":"2024-05-08T18:50:28.039245+0000","last_active":"2024-05-08T18:53:34.607240+0000","last_peered":"2024-05-08T18:53:34.607240+0000","last_clean":"2024-05-08T18:53:34.607240+0000","last_became_active":"2024-05-08T18:50:28.038935+0000","last_became_peered":"2024-05-08T18:50:28.038935+0000","last_unstale":"2024-05-08T18:53:34.607240+0000","last_undegraded":"2024-05-08T18:53:34.607240+0000","last_fullsized":"2024-05-08T18:53:34.607240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:44.968210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075852+0000","last_change":"2024-05-08T18:50:26.019026+0000","last_active":"2024-05-08T18:51:15.075852+0000","last_peered":"2024-05-08T18:51:15.075852+0000","last_clean":"2024-05-08T18:51:15.075852+0000","last_became_active":"2024-05-08T18:50:26.018739+0000","last_became_peered":"2024-05-08T18:50:26.018739+0000","last_unstale":"2024-05-08T18:51:15.075852+0000","last_undegraded":"2024-05-08T18:51:15.075852+0000","last_fullsized":"2024-05-08T18:51:15.075852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:13.215678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073107+0000","last_change":"2024-05-08T18:50:19.741144+0000","last_active":"2024-05-08T18:51:15.073107+0000","last_peered":"2024-05-08T18:51:15.073107+0000","last_clean":"2024-05-08T18:51:15.073107+0000","last_became_active":"2024-05-08T18:50:19.740835+0000","last_became_peered":"2024-05-08T18:50:19.740835+0000","last_unstale":"2024-05-08T18:51:15.073107+0000","last_undegraded":"2024-05-08T18:51:15.073107+0000","last_fullsized":"2024-05-08T18:51:15.073107+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:30.349801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"27'1","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:23.012864+0000","last_change":"2024-05-08T18:51:15.083500+0000","last_active":"2024-05-08T18:53:23.012864+0000","last_peered":"2024-05-08T18:53:23.012864+0000","last_clean":"2024-05-08T18:53:23.012864+0000","last_became_active":"2024-05-08T18:51:15.083141+0000","last_became_peered":"2024-05-08T18:51:15.083141+0000","last_unstale":"2024-05-08T18:53:23.012864+0000","last_undegraded":"2024-05-08T18:53:23.012864+0000","last_fullsized":"2024-05-08T18:53:23.012864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:11.583016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"27'61","reported_seq":120,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.000350+0000","last_change":"2024-05-08T18:50:32.042368+0000","last_active":"2024-05-08T18:52:33.000350+0000","last_peered":"2024-05-08T18:52:33.000350+0000","last_clean":"2024-05-08T18:52:33.000350+0000","last_became_active":"2024-05-08T18:50:32.042046+0000","last_became_peered":"2024-05-08T18:50:32.042046+0000","last_unstale":"2024-05-08T18:52:33.000350+0000","last_undegraded":"2024-05-08T18:52:33.000350+0000","last_fullsized":"2024-05-08T18:52:33.000350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:02.233245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076297+0000","last_change":"2024-05-08T18:50:34.044814+0000","last_active":"2024-05-08T18:51:15.076297+0000","last_peered":"2024-05-08T18:51:15.076297+0000","last_clean":"2024-05-08T18:51:15.076297+0000","last_became_active":"2024-05-08T18:50:34.044520+0000","last_became_peered":"2024-05-08T18:50:34.044520+0000","last_unstale":"2024-05-08T18:51:15.076297+0000","last_undegraded":"2024-05-08T18:51:15.076297+0000","last_fullsized":"2024-05-08T18:51:15.076297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:02.505892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.182379+0000","last_change":"2024-05-08T18:50:36.047417+0000","last_active":"2024-05-08T18:52:34.182379+0000","last_peered":"2024-05-08T18:52:34.182379+0000","last_clean":"2024-05-08T18:52:34.182379+0000","last_became_active":"2024-05-08T18:50:36.046757+0000","last_became_peered":"2024-05-08T18:50:36.046757+0000","last_unstale":"2024-05-08T18:52:34.182379+0000","last_undegraded":"2024-05-08T18:52:34.182379+0000","last_fullsized":"2024-05-08T18:52:34.182379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.465327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"27'10","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.823507+0000","last_change":"2024-05-08T18:51:15.095543+0000","last_active":"2024-05-08T18:53:34.823507+0000","last_peered":"2024-05-08T18:53:34.823507+0000","last_clean":"2024-05-08T18:53:34.823507+0000","last_became_active":"2024-05-08T18:51:15.084151+0000","last_became_peered":"2024-05-08T18:51:15.084151+0000","last_unstale":"2024-05-08T18:53:34.823507+0000","last_undegraded":"2024-05-08T18:53:34.823507+0000","last_fullsized":"2024-05-08T18:53:34.823507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:15.066531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074090+0000","last_change":"2024-05-08T18:50:26.025460+0000","last_active":"2024-05-08T18:51:15.074090+0000","last_peered":"2024-05-08T18:51:15.074090+0000","last_clean":"2024-05-08T18:51:15.074090+0000","last_became_active":"2024-05-08T18:50:26.024894+0000","last_became_peered":"2024-05-08T18:50:26.024894+0000","last_unstale":"2024-05-08T18:51:15.074090+0000","last_undegraded":"2024-05-08T18:51:15.074090+0000","last_fullsized":"2024-05-08T18:51:15.074090+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:40.472317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079603+0000","last_change":"2024-05-08T18:50:19.739473+0000","last_active":"2024-05-08T18:51:15.079603+0000","last_peered":"2024-05-08T18:51:15.079603+0000","last_clean":"2024-05-08T18:51:15.079603+0000","last_became_active":"2024-05-08T18:50:19.739124+0000","last_became_peered":"2024-05-08T18:50:19.739124+0000","last_unstale":"2024-05-08T18:51:15.079603+0000","last_undegraded":"2024-05-08T18:51:15.079603+0000","last_fullsized":"2024-05-08T18:51:15.079603+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:22.202213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076770+0000","last_change":"2024-05-08T18:50:30.033607+0000","last_active":"2024-05-08T18:51:15.076770+0000","last_peered":"2024-05-08T18:51:15.076770+0000","last_clean":"2024-05-08T18:51:15.076770+0000","last_became_active":"2024-05-08T18:50:30.032546+0000","last_became_peered":"2024-05-08T18:50:30.032546+0000","last_unstale":"2024-05-08T18:51:15.076770+0000","last_undegraded":"2024-05-08T18:51:15.076770+0000","last_fullsized":"2024-05-08T18:51:15.076770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:48.521683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"25'14","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076154+0000","last_change":"2024-05-08T18:50:32.040984+0000","last_active":"2024-05-08T18:51:15.076154+0000","last_peered":"2024-05-08T18:51:15.076154+0000","last_clean":"2024-05-08T18:51:15.076154+0000","last_became_active":"2024-05-08T18:50:32.040767+0000","last_became_peered":"2024-05-08T18:50:32.040767+0000","last_unstale":"2024-05-08T18:51:15.076154+0000","last_undegraded":"2024-05-08T18:51:15.076154+0000","last_fullsized":"2024-05-08T18:51:15.076154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:26.346126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"27'282","reported_seq":374,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111761+0000","last_change":"2024-05-08T18:50:34.043559+0000","last_active":"2024-05-08T18:53:35.111761+0000","last_peered":"2024-05-08T18:53:35.111761+0000","last_clean":"2024-05-08T18:53:35.111761+0000","last_became_active":"2024-05-08T18:50:34.043167+0000","last_became_peered":"2024-05-08T18:50:34.043167+0000","last_unstale":"2024-05-08T18:53:35.111761+0000","last_undegraded":"2024-05-08T18:53:35.111761+0000","last_fullsized":"2024-05-08T18:53:35.111761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:50.430816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.849637+0000","last_change":"2024-05-08T18:50:36.061014+0000","last_active":"2024-05-08T18:53:34.849637+0000","last_peered":"2024-05-08T18:53:34.849637+0000","last_clean":"2024-05-08T18:53:34.849637+0000","last_became_active":"2024-05-08T18:50:36.060727+0000","last_became_peered":"2024-05-08T18:50:36.060727+0000","last_unstale":"2024-05-08T18:53:34.849637+0000","last_undegraded":"2024-05-08T18:53:34.849637+0000","last_fullsized":"2024-05-08T18:53:34.849637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:01.420579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"27'22","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.690982+0000","last_change":"2024-05-08T18:51:15.092701+0000","last_active":"2024-05-08T18:53:34.690982+0000","last_peered":"2024-05-08T18:53:34.690982+0000","last_clean":"2024-05-08T18:53:34.690982+0000","last_became_active":"2024-05-08T18:51:15.083568+0000","last_became_peered":"2024-05-08T18:51:15.083568+0000","last_unstale":"2024-05-08T18:53:34.690982+0000","last_undegraded":"2024-05-08T18:53:34.690982+0000","last_fullsized":"2024-05-08T18:53:34.690982+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:43.282786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":68,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.883437+0000","last_change":"2024-05-08T18:50:26.016666+0000","last_active":"2024-05-08T18:53:34.883437+0000","last_peered":"2024-05-08T18:53:34.883437+0000","last_clean":"2024-05-08T18:53:34.883437+0000","last_became_active":"2024-05-08T18:50:26.016210+0000","last_became_peered":"2024-05-08T18:50:26.016210+0000","last_unstale":"2024-05-08T18:53:34.883437+0000","last_undegraded":"2024-05-08T18:53:34.883437+0000","last_fullsized":"2024-05-08T18:53:34.883437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:11.494472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074021+0000","last_change":"2024-05-08T18:50:19.740832+0000","last_active":"2024-05-08T18:51:15.074021+0000","last_peered":"2024-05-08T18:51:15.074021+0000","last_clean":"2024-05-08T18:51:15.074021+0000","last_became_active":"2024-05-08T18:50:19.740355+0000","last_became_peered":"2024-05-08T18:50:19.740355+0000","last_unstale":"2024-05-08T18:51:15.074021+0000","last_undegraded":"2024-05-08T18:51:15.074021+0000","last_fullsized":"2024-05-08T18:51:15.074021+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:57.647604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077142+0000","last_change":"2024-05-08T18:50:30.033678+0000","last_active":"2024-05-08T18:51:15.077142+0000","last_peered":"2024-05-08T18:51:15.077142+0000","last_clean":"2024-05-08T18:51:15.077142+0000","last_became_active":"2024-05-08T18:50:30.031351+0000","last_became_peered":"2024-05-08T18:50:30.031351+0000","last_unstale":"2024-05-08T18:51:15.077142+0000","last_undegraded":"2024-05-08T18:51:15.077142+0000","last_fullsized":"2024-05-08T18:51:15.077142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:08.066057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"25'10","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077487+0000","last_change":"2024-05-08T18:50:32.042333+0000","last_active":"2024-05-08T18:51:15.077487+0000","last_peered":"2024-05-08T18:51:15.077487+0000","last_clean":"2024-05-08T18:51:15.077487+0000","last_became_active":"2024-05-08T18:50:32.041231+0000","last_became_peered":"2024-05-08T18:50:32.041231+0000","last_unstale":"2024-05-08T18:51:15.077487+0000","last_undegraded":"2024-05-08T18:51:15.077487+0000","last_fullsized":"2024-05-08T18:51:15.077487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:21.403251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"27'282","reported_seq":389,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111732+0000","last_change":"2024-05-08T18:50:34.048062+0000","last_active":"2024-05-08T18:53:35.111732+0000","last_peered":"2024-05-08T18:53:35.111732+0000","last_clean":"2024-05-08T18:53:35.111732+0000","last_became_active":"2024-05-08T18:50:34.047608+0000","last_became_peered":"2024-05-08T18:50:34.047608+0000","last_unstale":"2024-05-08T18:53:35.111732+0000","last_undegraded":"2024-05-08T18:53:35.111732+0000","last_fullsized":"2024-05-08T18:53:35.111732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:50.430816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"25'5","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076053+0000","last_change":"2024-05-08T18:50:36.055086+0000","last_active":"2024-05-08T18:51:15.076053+0000","last_peered":"2024-05-08T18:51:15.076053+0000","last_clean":"2024-05-08T18:51:15.076053+0000","last_became_active":"2024-05-08T18:50:36.054747+0000","last_became_peered":"2024-05-08T18:50:36.054747+0000","last_unstale":"2024-05-08T18:51:15.076053+0000","last_undegraded":"2024-05-08T18:51:15.076053+0000","last_fullsized":"2024-05-08T18:51:15.076053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:23.094874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887634+0000","last_change":"2024-05-08T18:50:28.033530+0000","last_active":"2024-05-08T18:53:34.887634+0000","last_peered":"2024-05-08T18:53:34.887634+0000","last_clean":"2024-05-08T18:53:34.887634+0000","last_became_active":"2024-05-08T18:50:28.033163+0000","last_became_peered":"2024-05-08T18:50:28.033163+0000","last_unstale":"2024-05-08T18:53:34.887634+0000","last_undegraded":"2024-05-08T18:53:34.887634+0000","last_fullsized":"2024-05-08T18:53:34.887634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:06.589941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081490+0000","last_change":"2024-05-08T18:50:26.027003+0000","last_active":"2024-05-08T18:51:15.081490+0000","last_peered":"2024-05-08T18:51:15.081490+0000","last_clean":"2024-05-08T18:51:15.081490+0000","last_became_active":"2024-05-08T18:50:26.026719+0000","last_became_peered":"2024-05-08T18:50:26.026719+0000","last_unstale":"2024-05-08T18:51:15.081490+0000","last_undegraded":"2024-05-08T18:51:15.081490+0000","last_fullsized":"2024-05-08T18:51:15.081490+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:47.462940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.082412+0000","last_change":"2024-05-08T18:50:19.739345+0000","last_active":"2024-05-08T18:51:15.082412+0000","last_peered":"2024-05-08T18:51:15.082412+0000","last_clean":"2024-05-08T18:51:15.082412+0000","last_became_active":"2024-05-08T18:50:19.738971+0000","last_became_peered":"2024-05-08T18:50:19.738971+0000","last_unstale":"2024-05-08T18:51:15.082412+0000","last_undegraded":"2024-05-08T18:51:15.082412+0000","last_fullsized":"2024-05-08T18:51:15.082412+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:52:49.278410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075321+0000","last_change":"2024-05-08T18:50:30.033620+0000","last_active":"2024-05-08T18:51:15.075321+0000","last_peered":"2024-05-08T18:51:15.075321+0000","last_clean":"2024-05-08T18:51:15.075321+0000","last_became_active":"2024-05-08T18:50:30.032197+0000","last_became_peered":"2024-05-08T18:50:30.032197+0000","last_unstale":"2024-05-08T18:51:15.075321+0000","last_undegraded":"2024-05-08T18:51:15.075321+0000","last_fullsized":"2024-05-08T18:51:15.075321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:31.926375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"27'82","reported_seq":154,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.784016+0000","last_change":"2024-05-08T18:50:32.043393+0000","last_active":"2024-05-08T18:52:32.784016+0000","last_peered":"2024-05-08T18:52:32.784016+0000","last_clean":"2024-05-08T18:52:32.784016+0000","last_became_active":"2024-05-08T18:50:32.043109+0000","last_became_peered":"2024-05-08T18:50:32.043109+0000","last_unstale":"2024-05-08T18:52:32.784016+0000","last_undegraded":"2024-05-08T18:52:32.784016+0000","last_fullsized":"2024-05-08T18:52:32.784016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:05.292535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073040+0000","last_change":"2024-05-08T18:50:34.043856+0000","last_active":"2024-05-08T18:51:15.073040+0000","last_peered":"2024-05-08T18:51:15.073040+0000","last_clean":"2024-05-08T18:51:15.073040+0000","last_became_active":"2024-05-08T18:50:34.043495+0000","last_became_peered":"2024-05-08T18:50:34.043495+0000","last_unstale":"2024-05-08T18:51:15.073040+0000","last_undegraded":"2024-05-08T18:51:15.073040+0000","last_fullsized":"2024-05-08T18:51:15.073040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:35.940316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"25'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073950+0000","last_change":"2024-05-08T18:50:36.044755+0000","last_active":"2024-05-08T18:51:15.073950+0000","last_peered":"2024-05-08T18:51:15.073950+0000","last_clean":"2024-05-08T18:51:15.073950+0000","last_became_active":"2024-05-08T18:50:36.044491+0000","last_became_peered":"2024-05-08T18:50:36.044491+0000","last_unstale":"2024-05-08T18:51:15.073950+0000","last_undegraded":"2024-05-08T18:51:15.073950+0000","last_fullsized":"2024-05-08T18:51:15.073950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:26:24.798211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078569+0000","last_change":"2024-05-08T18:50:36.050995+0000","last_active":"2024-05-08T18:51:15.078569+0000","last_peered":"2024-05-08T18:51:15.078569+0000","last_clean":"2024-05-08T18:51:15.078569+0000","last_became_active":"2024-05-08T18:50:36.050722+0000","last_became_peered":"2024-05-08T18:50:36.050722+0000","last_unstale":"2024-05-08T18:51:15.078569+0000","last_undegraded":"2024-05-08T18:51:15.078569+0000","last_fullsized":"2024-05-08T18:51:15.078569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:14.087413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"27'9","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.868849+0000","last_change":"2024-05-08T18:50:28.033284+0000","last_active":"2024-05-08T18:53:34.868849+0000","last_peered":"2024-05-08T18:53:34.868849+0000","last_clean":"2024-05-08T18:53:34.868849+0000","last_became_active":"2024-05-08T18:50:28.033010+0000","last_became_peered":"2024-05-08T18:50:28.033010+0000","last_unstale":"2024-05-08T18:53:34.868849+0000","last_undegraded":"2024-05-08T18:53:34.868849+0000","last_fullsized":"2024-05-08T18:53:34.868849+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:06.187241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077875+0000","last_change":"2024-05-08T18:50:26.027008+0000","last_active":"2024-05-08T18:51:15.077875+0000","last_peered":"2024-05-08T18:51:15.077875+0000","last_clean":"2024-05-08T18:51:15.077875+0000","last_became_active":"2024-05-08T18:50:26.025828+0000","last_became_peered":"2024-05-08T18:50:26.025828+0000","last_unstale":"2024-05-08T18:51:15.077875+0000","last_undegraded":"2024-05-08T18:51:15.077875+0000","last_fullsized":"2024-05-08T18:51:15.077875+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:08:54.741439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.083669+0000","last_change":"2024-05-08T18:51:15.082912+0000","last_active":"2024-05-08T18:51:15.083669+0000","last_peered":"2024-05-08T18:51:15.083669+0000","last_clean":"2024-05-08T18:51:15.083669+0000","last_became_active":"2024-05-08T18:51:15.082590+0000","last_became_peered":"2024-05-08T18:51:15.082590+0000","last_unstale":"2024-05-08T18:51:15.083669+0000","last_undegraded":"2024-05-08T18:51:15.083669+0000","last_fullsized":"2024-05-08T18:51:15.083669+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:19.530329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"27'33","reported_seq":76,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.790036+0000","last_change":"2024-05-08T18:50:32.038887+0000","last_active":"2024-05-08T18:52:32.790036+0000","last_peered":"2024-05-08T18:52:32.790036+0000","last_clean":"2024-05-08T18:52:32.790036+0000","last_became_active":"2024-05-08T18:50:32.038591+0000","last_became_peered":"2024-05-08T18:50:32.038591+0000","last_unstale":"2024-05-08T18:52:32.790036+0000","last_undegraded":"2024-05-08T18:52:32.790036+0000","last_fullsized":"2024-05-08T18:52:32.790036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:52.451129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075130+0000","last_change":"2024-05-08T18:50:34.051041+0000","last_active":"2024-05-08T18:51:15.075130+0000","last_peered":"2024-05-08T18:51:15.075130+0000","last_clean":"2024-05-08T18:51:15.075130+0000","last_became_active":"2024-05-08T18:50:34.050749+0000","last_became_peered":"2024-05-08T18:50:34.050749+0000","last_unstale":"2024-05-08T18:51:15.075130+0000","last_undegraded":"2024-05-08T18:51:15.075130+0000","last_fullsized":"2024-05-08T18:51:15.075130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:34.776407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"27'15","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.692332+0000","last_change":"2024-05-08T18:50:36.054332+0000","last_active":"2024-05-08T18:53:34.692332+0000","last_peered":"2024-05-08T18:53:34.692332+0000","last_clean":"2024-05-08T18:53:34.692332+0000","last_became_active":"2024-05-08T18:50:36.054102+0000","last_became_peered":"2024-05-08T18:50:36.054102+0000","last_unstale":"2024-05-08T18:53:34.692332+0000","last_undegraded":"2024-05-08T18:53:34.692332+0000","last_fullsized":"2024-05-08T18:53:34.692332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:40.601584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"27'6","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.691151+0000","last_change":"2024-05-08T18:50:28.038986+0000","last_active":"2024-05-08T18:53:34.691151+0000","last_peered":"2024-05-08T18:53:34.691151+0000","last_clean":"2024-05-08T18:53:34.691151+0000","last_became_active":"2024-05-08T18:50:28.038587+0000","last_became_peered":"2024-05-08T18:50:28.038587+0000","last_unstale":"2024-05-08T18:53:34.691151+0000","last_undegraded":"2024-05-08T18:53:34.691151+0000","last_fullsized":"2024-05-08T18:53:34.691151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:55.994310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075642+0000","last_change":"2024-05-08T18:50:26.031798+0000","last_active":"2024-05-08T18:51:15.075642+0000","last_peered":"2024-05-08T18:51:15.075642+0000","last_clean":"2024-05-08T18:51:15.075642+0000","last_became_active":"2024-05-08T18:50:26.031509+0000","last_became_peered":"2024-05-08T18:50:26.031509+0000","last_unstale":"2024-05-08T18:51:15.075642+0000","last_undegraded":"2024-05-08T18:51:15.075642+0000","last_fullsized":"2024-05-08T18:51:15.075642+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:13:25.895646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.082399+0000","last_change":"2024-05-08T18:50:30.035310+0000","last_active":"2024-05-08T18:51:15.082399+0000","last_peered":"2024-05-08T18:51:15.082399+0000","last_clean":"2024-05-08T18:51:15.082399+0000","last_became_active":"2024-05-08T18:50:30.034178+0000","last_became_peered":"2024-05-08T18:50:30.034178+0000","last_unstale":"2024-05-08T18:51:15.082399+0000","last_undegraded":"2024-05-08T18:51:15.082399+0000","last_fullsized":"2024-05-08T18:51:15.082399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:07.748171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.260326+0000","last_change":"2024-05-08T18:50:32.036694+0000","last_active":"2024-05-08T18:53:34.260326+0000","last_peered":"2024-05-08T18:53:34.260326+0000","last_clean":"2024-05-08T18:53:34.260326+0000","last_became_active":"2024-05-08T18:50:32.036371+0000","last_became_peered":"2024-05-08T18:50:32.036371+0000","last_unstale":"2024-05-08T18:53:34.260326+0000","last_undegraded":"2024-05-08T18:53:34.260326+0000","last_fullsized":"2024-05-08T18:53:34.260326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:24:34.246835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076167+0000","last_change":"2024-05-08T18:50:34.049216+0000","last_active":"2024-05-08T18:51:15.076167+0000","last_peered":"2024-05-08T18:51:15.076167+0000","last_clean":"2024-05-08T18:51:15.076167+0000","last_became_active":"2024-05-08T18:50:34.048434+0000","last_became_peered":"2024-05-08T18:50:34.048434+0000","last_unstale":"2024-05-08T18:51:15.076167+0000","last_undegraded":"2024-05-08T18:51:15.076167+0000","last_fullsized":"2024-05-08T18:51:15.076167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:04.240028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"25'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073391+0000","last_change":"2024-05-08T18:50:36.047682+0000","last_active":"2024-05-08T18:51:15.073391+0000","last_peered":"2024-05-08T18:51:15.073391+0000","last_clean":"2024-05-08T18:51:15.073391+0000","last_became_active":"2024-05-08T18:50:36.047379+0000","last_became_peered":"2024-05-08T18:50:36.047379+0000","last_unstale":"2024-05-08T18:51:15.073391+0000","last_undegraded":"2024-05-08T18:51:15.073391+0000","last_fullsized":"2024-05-08T18:51:15.073391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:54:56.963493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"27'6","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887519+0000","last_change":"2024-05-08T18:50:28.022958+0000","last_active":"2024-05-08T18:53:34.887519+0000","last_peered":"2024-05-08T18:53:34.887519+0000","last_clean":"2024-05-08T18:53:34.887519+0000","last_became_active":"2024-05-08T18:50:28.022636+0000","last_became_peered":"2024-05-08T18:50:28.022636+0000","last_unstale":"2024-05-08T18:53:34.887519+0000","last_undegraded":"2024-05-08T18:53:34.887519+0000","last_fullsized":"2024-05-08T18:53:34.887519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:26.670671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075046+0000","last_change":"2024-05-08T18:50:26.031227+0000","last_active":"2024-05-08T18:51:15.075046+0000","last_peered":"2024-05-08T18:51:15.075046+0000","last_clean":"2024-05-08T18:51:15.075046+0000","last_became_active":"2024-05-08T18:50:26.030884+0000","last_became_peered":"2024-05-08T18:50:26.030884+0000","last_unstale":"2024-05-08T18:51:15.075046+0000","last_undegraded":"2024-05-08T18:51:15.075046+0000","last_fullsized":"2024-05-08T18:51:15.075046+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:37.913831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073198+0000","last_change":"2024-05-08T18:50:30.031104+0000","last_active":"2024-05-08T18:51:15.073198+0000","last_peered":"2024-05-08T18:51:15.073198+0000","last_clean":"2024-05-08T18:51:15.073198+0000","last_became_active":"2024-05-08T18:50:30.030773+0000","last_became_peered":"2024-05-08T18:50:30.030773+0000","last_unstale":"2024-05-08T18:51:15.073198+0000","last_undegraded":"2024-05-08T18:51:15.073198+0000","last_fullsized":"2024-05-08T18:51:15.073198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:44.977393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"27'40","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.315951+0000","last_change":"2024-05-08T18:50:32.032531+0000","last_active":"2024-05-08T18:53:34.315951+0000","last_peered":"2024-05-08T18:53:34.315951+0000","last_clean":"2024-05-08T18:53:34.315951+0000","last_became_active":"2024-05-08T18:50:32.032289+0000","last_became_peered":"2024-05-08T18:50:32.032289+0000","last_unstale":"2024-05-08T18:53:34.315951+0000","last_undegraded":"2024-05-08T18:53:34.315951+0000","last_fullsized":"2024-05-08T18:53:34.315951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:00.499108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073965+0000","last_change":"2024-05-08T18:50:34.043178+0000","last_active":"2024-05-08T18:51:15.073965+0000","last_peered":"2024-05-08T18:51:15.073965+0000","last_clean":"2024-05-08T18:51:15.073965+0000","last_became_active":"2024-05-08T18:50:34.042903+0000","last_became_peered":"2024-05-08T18:50:34.042903+0000","last_unstale":"2024-05-08T18:51:15.073965+0000","last_undegraded":"2024-05-08T18:51:15.073965+0000","last_fullsized":"2024-05-08T18:51:15.073965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:54.419559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077587+0000","last_change":"2024-05-08T18:50:36.056236+0000","last_active":"2024-05-08T18:51:15.077587+0000","last_peered":"2024-05-08T18:51:15.077587+0000","last_clean":"2024-05-08T18:51:15.077587+0000","last_became_active":"2024-05-08T18:50:36.055855+0000","last_became_peered":"2024-05-08T18:50:36.055855+0000","last_unstale":"2024-05-08T18:51:15.077587+0000","last_undegraded":"2024-05-08T18:51:15.077587+0000","last_fullsized":"2024-05-08T18:51:15.077587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:37.833469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"27'11","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007535+0000","last_change":"2024-05-08T18:50:28.035297+0000","last_active":"2024-05-08T18:52:48.007535+0000","last_peered":"2024-05-08T18:52:48.007535+0000","last_clean":"2024-05-08T18:52:48.007535+0000","last_became_active":"2024-05-08T18:50:28.034819+0000","last_became_peered":"2024-05-08T18:50:28.034819+0000","last_unstale":"2024-05-08T18:52:48.007535+0000","last_undegraded":"2024-05-08T18:52:48.007535+0000","last_fullsized":"2024-05-08T18:52:48.007535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:13:44.345322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081828+0000","last_change":"2024-05-08T18:50:26.029507+0000","last_active":"2024-05-08T18:51:15.081828+0000","last_peered":"2024-05-08T18:51:15.081828+0000","last_clean":"2024-05-08T18:51:15.081828+0000","last_became_active":"2024-05-08T18:50:26.029211+0000","last_became_peered":"2024-05-08T18:50:26.029211+0000","last_unstale":"2024-05-08T18:51:15.081828+0000","last_undegraded":"2024-05-08T18:51:15.081828+0000","last_fullsized":"2024-05-08T18:51:15.081828+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:08:13.942735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077144+0000","last_change":"2024-05-08T18:50:30.031830+0000","last_active":"2024-05-08T18:51:15.077144+0000","last_peered":"2024-05-08T18:51:15.077144+0000","last_clean":"2024-05-08T18:51:15.077144+0000","last_became_active":"2024-05-08T18:50:30.031588+0000","last_became_peered":"2024-05-08T18:50:30.031588+0000","last_unstale":"2024-05-08T18:51:15.077144+0000","last_undegraded":"2024-05-08T18:51:15.077144+0000","last_fullsized":"2024-05-08T18:51:15.077144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:50.405618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"27'30","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.775836+0000","last_change":"2024-05-08T18:50:32.035464+0000","last_active":"2024-05-08T18:52:32.775836+0000","last_peered":"2024-05-08T18:52:32.775836+0000","last_clean":"2024-05-08T18:52:32.775836+0000","last_became_active":"2024-05-08T18:50:32.035181+0000","last_became_peered":"2024-05-08T18:50:32.035181+0000","last_unstale":"2024-05-08T18:52:32.775836+0000","last_undegraded":"2024-05-08T18:52:32.775836+0000","last_fullsized":"2024-05-08T18:52:32.775836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:09.507174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078453+0000","last_change":"2024-05-08T18:50:34.042398+0000","last_active":"2024-05-08T18:51:15.078453+0000","last_peered":"2024-05-08T18:51:15.078453+0000","last_clean":"2024-05-08T18:51:15.078453+0000","last_became_active":"2024-05-08T18:50:34.039668+0000","last_became_peered":"2024-05-08T18:50:34.039668+0000","last_unstale":"2024-05-08T18:51:15.078453+0000","last_undegraded":"2024-05-08T18:51:15.078453+0000","last_fullsized":"2024-05-08T18:51:15.078453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:06.348421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.083199+0000","last_change":"2024-05-08T18:50:28.026330+0000","last_active":"2024-05-08T18:51:15.083199+0000","last_peered":"2024-05-08T18:51:15.083199+0000","last_clean":"2024-05-08T18:51:15.083199+0000","last_became_active":"2024-05-08T18:50:28.025862+0000","last_became_peered":"2024-05-08T18:50:28.025862+0000","last_unstale":"2024-05-08T18:51:15.083199+0000","last_undegraded":"2024-05-08T18:51:15.083199+0000","last_fullsized":"2024-05-08T18:51:15.083199+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:14.186696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074050+0000","last_change":"2024-05-08T18:50:26.023167+0000","last_active":"2024-05-08T18:51:15.074050+0000","last_peered":"2024-05-08T18:51:15.074050+0000","last_clean":"2024-05-08T18:51:15.074050+0000","last_became_active":"2024-05-08T18:50:26.022874+0000","last_became_peered":"2024-05-08T18:50:26.022874+0000","last_unstale":"2024-05-08T18:51:15.074050+0000","last_undegraded":"2024-05-08T18:51:15.074050+0000","last_fullsized":"2024-05-08T18:51:15.074050+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:06.231586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074887+0000","last_change":"2024-05-08T18:50:30.029972+0000","last_active":"2024-05-08T18:51:15.074887+0000","last_peered":"2024-05-08T18:51:15.074887+0000","last_clean":"2024-05-08T18:51:15.074887+0000","last_became_active":"2024-05-08T18:50:30.029570+0000","last_became_peered":"2024-05-08T18:50:30.029570+0000","last_unstale":"2024-05-08T18:51:15.074887+0000","last_undegraded":"2024-05-08T18:51:15.074887+0000","last_fullsized":"2024-05-08T18:51:15.074887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:16.505368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"27'56","reported_seq":112,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.796965+0000","last_change":"2024-05-08T18:50:32.039614+0000","last_active":"2024-05-08T18:52:32.796965+0000","last_peered":"2024-05-08T18:52:32.796965+0000","last_clean":"2024-05-08T18:52:32.796965+0000","last_became_active":"2024-05-08T18:50:32.039293+0000","last_became_peered":"2024-05-08T18:50:32.039293+0000","last_unstale":"2024-05-08T18:52:32.796965+0000","last_undegraded":"2024-05-08T18:52:32.796965+0000","last_fullsized":"2024-05-08T18:52:32.796965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:36.221887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078524+0000","last_change":"2024-05-08T18:50:34.047399+0000","last_active":"2024-05-08T18:51:15.078524+0000","last_peered":"2024-05-08T18:51:15.078524+0000","last_clean":"2024-05-08T18:51:15.078524+0000","last_became_active":"2024-05-08T18:50:34.047111+0000","last_became_peered":"2024-05-08T18:50:34.047111+0000","last_unstale":"2024-05-08T18:51:15.078524+0000","last_undegraded":"2024-05-08T18:51:15.078524+0000","last_fullsized":"2024-05-08T18:51:15.078524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:20.207624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"27'14","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.179268+0000","last_change":"2024-05-08T18:50:36.047518+0000","last_active":"2024-05-08T18:52:34.179268+0000","last_peered":"2024-05-08T18:52:34.179268+0000","last_clean":"2024-05-08T18:52:34.179268+0000","last_became_active":"2024-05-08T18:50:36.046834+0000","last_became_peered":"2024-05-08T18:50:36.046834+0000","last_unstale":"2024-05-08T18:52:34.179268+0000","last_undegraded":"2024-05-08T18:52:34.179268+0000","last_fullsized":"2024-05-08T18:52:34.179268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:30.137484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'6","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.690403+0000","last_change":"2024-05-08T18:50:28.023338+0000","last_active":"2024-05-08T18:53:34.690403+0000","last_peered":"2024-05-08T18:53:34.690403+0000","last_clean":"2024-05-08T18:53:34.690403+0000","last_became_active":"2024-05-08T18:50:28.023049+0000","last_became_peered":"2024-05-08T18:50:28.023049+0000","last_unstale":"2024-05-08T18:53:34.690403+0000","last_undegraded":"2024-05-08T18:53:34.690403+0000","last_fullsized":"2024-05-08T18:53:34.690403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:29:28.977842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.811771+0000","last_change":"2024-05-08T18:50:26.030145+0000","last_active":"2024-05-08T18:53:34.811771+0000","last_peered":"2024-05-08T18:53:34.811771+0000","last_clean":"2024-05-08T18:53:34.811771+0000","last_became_active":"2024-05-08T18:50:26.029008+0000","last_became_peered":"2024-05-08T18:50:26.029008+0000","last_unstale":"2024-05-08T18:53:34.811771+0000","last_undegraded":"2024-05-08T18:53:34.811771+0000","last_fullsized":"2024-05-08T18:53:34.811771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:47.912064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078862+0000","last_change":"2024-05-08T18:50:30.027158+0000","last_active":"2024-05-08T18:51:15.078862+0000","last_peered":"2024-05-08T18:51:15.078862+0000","last_clean":"2024-05-08T18:51:15.078862+0000","last_became_active":"2024-05-08T18:50:30.026853+0000","last_became_peered":"2024-05-08T18:50:30.026853+0000","last_unstale":"2024-05-08T18:51:15.078862+0000","last_undegraded":"2024-05-08T18:51:15.078862+0000","last_fullsized":"2024-05-08T18:51:15.078862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:25.865274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"27'36","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.776794+0000","last_change":"2024-05-08T18:50:32.041607+0000","last_active":"2024-05-08T18:52:32.776794+0000","last_peered":"2024-05-08T18:52:32.776794+0000","last_clean":"2024-05-08T18:52:32.776794+0000","last_became_active":"2024-05-08T18:50:32.041208+0000","last_became_peered":"2024-05-08T18:50:32.041208+0000","last_unstale":"2024-05-08T18:52:32.776794+0000","last_undegraded":"2024-05-08T18:52:32.776794+0000","last_fullsized":"2024-05-08T18:52:32.776794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:00.288699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081778+0000","last_change":"2024-05-08T18:50:34.049030+0000","last_active":"2024-05-08T18:51:15.081778+0000","last_peered":"2024-05-08T18:51:15.081778+0000","last_clean":"2024-05-08T18:51:15.081778+0000","last_became_active":"2024-05-08T18:50:34.048749+0000","last_became_peered":"2024-05-08T18:50:34.048749+0000","last_unstale":"2024-05-08T18:51:15.081778+0000","last_undegraded":"2024-05-08T18:51:15.081778+0000","last_fullsized":"2024-05-08T18:51:15.081778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:52.535624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076062+0000","last_change":"2024-05-08T18:50:36.057323+0000","last_active":"2024-05-08T18:51:15.076062+0000","last_peered":"2024-05-08T18:51:15.076062+0000","last_clean":"2024-05-08T18:51:15.076062+0000","last_became_active":"2024-05-08T18:50:36.056960+0000","last_became_peered":"2024-05-08T18:50:36.056960+0000","last_unstale":"2024-05-08T18:51:15.076062+0000","last_undegraded":"2024-05-08T18:51:15.076062+0000","last_fullsized":"2024-05-08T18:51:15.076062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:33.422610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"27'8","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.243573+0000","last_change":"2024-05-08T18:50:28.038865+0000","last_active":"2024-05-08T18:52:34.243573+0000","last_peered":"2024-05-08T18:52:34.243573+0000","last_clean":"2024-05-08T18:52:34.243573+0000","last_became_active":"2024-05-08T18:50:28.038364+0000","last_became_peered":"2024-05-08T18:50:28.038364+0000","last_unstale":"2024-05-08T18:52:34.243573+0000","last_undegraded":"2024-05-08T18:52:34.243573+0000","last_fullsized":"2024-05-08T18:52:34.243573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:22.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.819164+0000","last_change":"2024-05-08T18:50:26.012760+0000","last_active":"2024-05-08T18:53:34.819164+0000","last_peered":"2024-05-08T18:53:34.819164+0000","last_clean":"2024-05-08T18:53:34.819164+0000","last_became_active":"2024-05-08T18:50:26.012506+0000","last_became_peered":"2024-05-08T18:50:26.012506+0000","last_unstale":"2024-05-08T18:53:34.819164+0000","last_undegraded":"2024-05-08T18:53:34.819164+0000","last_fullsized":"2024-05-08T18:53:34.819164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:13.215678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078388+0000","last_change":"2024-05-08T18:50:30.026843+0000","last_active":"2024-05-08T18:51:15.078388+0000","last_peered":"2024-05-08T18:51:15.078388+0000","last_clean":"2024-05-08T18:51:15.078388+0000","last_became_active":"2024-05-08T18:50:30.026445+0000","last_became_peered":"2024-05-08T18:50:30.026445+0000","last_unstale":"2024-05-08T18:51:15.078388+0000","last_undegraded":"2024-05-08T18:51:15.078388+0000","last_fullsized":"2024-05-08T18:51:15.078388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:57.129506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"27'32","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.794556+0000","last_change":"2024-05-08T18:50:32.041022+0000","last_active":"2024-05-08T18:52:32.794556+0000","last_peered":"2024-05-08T18:52:32.794556+0000","last_clean":"2024-05-08T18:52:32.794556+0000","last_became_active":"2024-05-08T18:50:32.040745+0000","last_became_peered":"2024-05-08T18:50:32.040745+0000","last_unstale":"2024-05-08T18:52:32.794556+0000","last_undegraded":"2024-05-08T18:52:32.794556+0000","last_fullsized":"2024-05-08T18:52:32.794556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:18.200841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073810+0000","last_change":"2024-05-08T18:50:34.047857+0000","last_active":"2024-05-08T18:51:15.073810+0000","last_peered":"2024-05-08T18:51:15.073810+0000","last_clean":"2024-05-08T18:51:15.073810+0000","last_became_active":"2024-05-08T18:50:34.047508+0000","last_became_peered":"2024-05-08T18:50:34.047508+0000","last_unstale":"2024-05-08T18:51:15.073810+0000","last_undegraded":"2024-05-08T18:51:15.073810+0000","last_fullsized":"2024-05-08T18:51:15.073810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:42:03.694060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"27'9","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.334554+0000","last_change":"2024-05-08T18:50:36.058170+0000","last_active":"2024-05-08T18:53:34.334554+0000","last_peered":"2024-05-08T18:53:34.334554+0000","last_clean":"2024-05-08T18:53:34.334554+0000","last_became_active":"2024-05-08T18:50:36.057863+0000","last_became_peered":"2024-05-08T18:50:36.057863+0000","last_unstale":"2024-05-08T18:53:34.334554+0000","last_undegraded":"2024-05-08T18:53:34.334554+0000","last_fullsized":"2024-05-08T18:53:34.334554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:47.312916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"25'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074376+0000","last_change":"2024-05-08T18:50:28.021697+0000","last_active":"2024-05-08T18:51:15.074376+0000","last_peered":"2024-05-08T18:51:15.074376+0000","last_clean":"2024-05-08T18:51:15.074376+0000","last_became_active":"2024-05-08T18:50:28.020441+0000","last_became_peered":"2024-05-08T18:50:28.020441+0000","last_unstale":"2024-05-08T18:51:15.074376+0000","last_undegraded":"2024-05-08T18:51:15.074376+0000","last_fullsized":"2024-05-08T18:51:15.074376+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:42.970406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"25'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077959+0000","last_change":"2024-05-08T18:50:26.025468+0000","last_active":"2024-05-08T18:51:15.077959+0000","last_peered":"2024-05-08T18:51:15.077959+0000","last_clean":"2024-05-08T18:51:15.077959+0000","last_became_active":"2024-05-08T18:50:26.024274+0000","last_became_peered":"2024-05-08T18:50:26.024274+0000","last_unstale":"2024-05-08T18:51:15.077959+0000","last_undegraded":"2024-05-08T18:51:15.077959+0000","last_fullsized":"2024-05-08T18:51:15.077959+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:27.236646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081882+0000","last_change":"2024-05-08T18:50:30.029259+0000","last_active":"2024-05-08T18:51:15.081882+0000","last_peered":"2024-05-08T18:51:15.081882+0000","last_clean":"2024-05-08T18:51:15.081882+0000","last_became_active":"2024-05-08T18:50:30.028877+0000","last_became_peered":"2024-05-08T18:50:30.028877+0000","last_unstale":"2024-05-08T18:51:15.081882+0000","last_undegraded":"2024-05-08T18:51:15.081882+0000","last_fullsized":"2024-05-08T18:51:15.081882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:57.176423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"25'10","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079404+0000","last_change":"2024-05-08T18:50:32.042114+0000","last_active":"2024-05-08T18:51:15.079404+0000","last_peered":"2024-05-08T18:51:15.079404+0000","last_clean":"2024-05-08T18:51:15.079404+0000","last_became_active":"2024-05-08T18:50:32.041539+0000","last_became_peered":"2024-05-08T18:50:32.041539+0000","last_unstale":"2024-05-08T18:51:15.079404+0000","last_undegraded":"2024-05-08T18:51:15.079404+0000","last_fullsized":"2024-05-08T18:51:15.079404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:42.799113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"27'282","reported_seq":406,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:35.111598+0000","last_change":"2024-05-08T18:50:34.048713+0000","last_active":"2024-05-08T18:53:35.111598+0000","last_peered":"2024-05-08T18:53:35.111598+0000","last_clean":"2024-05-08T18:53:35.111598+0000","last_became_active":"2024-05-08T18:50:34.048421+0000","last_became_peered":"2024-05-08T18:50:34.048421+0000","last_unstale":"2024-05-08T18:53:35.111598+0000","last_undegraded":"2024-05-08T18:53:35.111598+0000","last_fullsized":"2024-05-08T18:53:35.111598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:31.497412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"27'6","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.940415+0000","last_change":"2024-05-08T18:50:36.055738+0000","last_active":"2024-05-08T18:53:34.940415+0000","last_peered":"2024-05-08T18:53:34.940415+0000","last_clean":"2024-05-08T18:53:34.940415+0000","last_became_active":"2024-05-08T18:50:36.055184+0000","last_became_peered":"2024-05-08T18:50:36.055184+0000","last_unstale":"2024-05-08T18:53:34.940415+0000","last_undegraded":"2024-05-08T18:53:34.940415+0000","last_fullsized":"2024-05-08T18:53:34.940415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:08:53.899906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.868347+0000","last_change":"2024-05-08T18:50:28.025621+0000","last_active":"2024-05-08T18:53:34.868347+0000","last_peered":"2024-05-08T18:53:34.868347+0000","last_clean":"2024-05-08T18:53:34.868347+0000","last_became_active":"2024-05-08T18:50:28.025313+0000","last_became_peered":"2024-05-08T18:50:28.025313+0000","last_unstale":"2024-05-08T18:53:34.868347+0000","last_undegraded":"2024-05-08T18:53:34.868347+0000","last_fullsized":"2024-05-08T18:53:34.868347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:55.202102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079286+0000","last_change":"2024-05-08T18:50:26.030334+0000","last_active":"2024-05-08T18:51:15.079286+0000","last_peered":"2024-05-08T18:51:15.079286+0000","last_clean":"2024-05-08T18:51:15.079286+0000","last_became_active":"2024-05-08T18:50:26.030058+0000","last_became_peered":"2024-05-08T18:50:26.030058+0000","last_unstale":"2024-05-08T18:51:15.079286+0000","last_undegraded":"2024-05-08T18:51:15.079286+0000","last_fullsized":"2024-05-08T18:51:15.079286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:40.472317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"18'1","reported_seq":218,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.890531+0000","last_change":"2024-05-08T18:50:30.024313+0000","last_active":"2024-05-08T18:52:33.890531+0000","last_peered":"2024-05-08T18:52:33.890531+0000","last_clean":"2024-05-08T18:52:33.890531+0000","last_became_active":"2024-05-08T18:50:30.024032+0000","last_became_peered":"2024-05-08T18:50:30.024032+0000","last_unstale":"2024-05-08T18:52:33.890531+0000","last_undegraded":"2024-05-08T18:52:33.890531+0000","last_fullsized":"2024-05-08T18:52:33.890531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:43.500296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"27'37","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.008888+0000","last_change":"2024-05-08T18:50:32.036101+0000","last_active":"2024-05-08T18:52:58.008888+0000","last_peered":"2024-05-08T18:52:58.008888+0000","last_clean":"2024-05-08T18:52:58.008888+0000","last_became_active":"2024-05-08T18:50:32.035792+0000","last_became_peered":"2024-05-08T18:50:32.035792+0000","last_unstale":"2024-05-08T18:52:58.008888+0000","last_undegraded":"2024-05-08T18:52:58.008888+0000","last_fullsized":"2024-05-08T18:52:58.008888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:06:52.558231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.071790+0000","last_change":"2024-05-08T18:50:34.045008+0000","last_active":"2024-05-08T18:51:15.071790+0000","last_peered":"2024-05-08T18:51:15.071790+0000","last_clean":"2024-05-08T18:51:15.071790+0000","last_became_active":"2024-05-08T18:50:34.044586+0000","last_became_peered":"2024-05-08T18:50:34.044586+0000","last_unstale":"2024-05-08T18:51:15.071790+0000","last_undegraded":"2024-05-08T18:51:15.071790+0000","last_fullsized":"2024-05-08T18:51:15.071790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:19.094040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"27'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.240649+0000","last_change":"2024-05-08T18:50:36.053212+0000","last_active":"2024-05-08T18:52:34.240649+0000","last_peered":"2024-05-08T18:52:34.240649+0000","last_clean":"2024-05-08T18:52:34.240649+0000","last_became_active":"2024-05-08T18:50:36.052885+0000","last_became_peered":"2024-05-08T18:50:36.052885+0000","last_unstale":"2024-05-08T18:52:34.240649+0000","last_undegraded":"2024-05-08T18:52:34.240649+0000","last_fullsized":"2024-05-08T18:52:34.240649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:18.424066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"27'28","reported_seq":114,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887556+0000","last_change":"2024-05-08T18:50:28.025900+0000","last_active":"2024-05-08T18:53:34.887556+0000","last_peered":"2024-05-08T18:53:34.887556+0000","last_clean":"2024-05-08T18:53:34.887556+0000","last_became_active":"2024-05-08T18:50:28.025162+0000","last_became_peered":"2024-05-08T18:50:28.025162+0000","last_unstale":"2024-05-08T18:53:34.887556+0000","last_undegraded":"2024-05-08T18:53:34.887556+0000","last_fullsized":"2024-05-08T18:53:34.887556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:38:05.876708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":112,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079886+0000","last_change":"2024-05-08T18:50:26.027367+0000","last_active":"2024-05-08T18:51:15.079886+0000","last_peered":"2024-05-08T18:51:15.079886+0000","last_clean":"2024-05-08T18:51:15.079886+0000","last_became_active":"2024-05-08T18:50:26.027067+0000","last_became_peered":"2024-05-08T18:50:26.027067+0000","last_unstale":"2024-05-08T18:51:15.079886+0000","last_undegraded":"2024-05-08T18:51:15.079886+0000","last_fullsized":"2024-05-08T18:51:15.079886+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:30.486245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078349+0000","last_change":"2024-05-08T18:50:30.034913+0000","last_active":"2024-05-08T18:51:15.078349+0000","last_peered":"2024-05-08T18:51:15.078349+0000","last_clean":"2024-05-08T18:51:15.078349+0000","last_became_active":"2024-05-08T18:50:30.034616+0000","last_became_peered":"2024-05-08T18:50:30.034616+0000","last_unstale":"2024-05-08T18:51:15.078349+0000","last_undegraded":"2024-05-08T18:51:15.078349+0000","last_fullsized":"2024-05-08T18:51:15.078349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:58.001297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"27'32","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.246102+0000","last_change":"2024-05-08T18:50:32.042047+0000","last_active":"2024-05-08T18:52:34.246102+0000","last_peered":"2024-05-08T18:52:34.246102+0000","last_clean":"2024-05-08T18:52:34.246102+0000","last_became_active":"2024-05-08T18:50:32.041806+0000","last_became_peered":"2024-05-08T18:50:32.041806+0000","last_unstale":"2024-05-08T18:52:34.246102+0000","last_undegraded":"2024-05-08T18:52:34.246102+0000","last_fullsized":"2024-05-08T18:52:34.246102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:20.454485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075987+0000","last_change":"2024-05-08T18:50:34.050795+0000","last_active":"2024-05-08T18:51:15.075987+0000","last_peered":"2024-05-08T18:51:15.075987+0000","last_clean":"2024-05-08T18:51:15.075987+0000","last_became_active":"2024-05-08T18:50:34.050445+0000","last_became_peered":"2024-05-08T18:50:34.050445+0000","last_unstale":"2024-05-08T18:51:15.075987+0000","last_undegraded":"2024-05-08T18:51:15.075987+0000","last_fullsized":"2024-05-08T18:51:15.075987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:03.912574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079231+0000","last_change":"2024-05-08T18:50:36.060634+0000","last_active":"2024-05-08T18:51:15.079231+0000","last_peered":"2024-05-08T18:51:15.079231+0000","last_clean":"2024-05-08T18:51:15.079231+0000","last_became_active":"2024-05-08T18:50:36.060318+0000","last_became_peered":"2024-05-08T18:50:36.060318+0000","last_unstale":"2024-05-08T18:51:15.079231+0000","last_undegraded":"2024-05-08T18:51:15.079231+0000","last_fullsized":"2024-05-08T18:51:15.079231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:22:59.024364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.823408+0000","last_change":"2024-05-08T18:50:28.029928+0000","last_active":"2024-05-08T18:53:34.823408+0000","last_peered":"2024-05-08T18:53:34.823408+0000","last_clean":"2024-05-08T18:53:34.823408+0000","last_became_active":"2024-05-08T18:50:28.029624+0000","last_became_peered":"2024-05-08T18:50:28.029624+0000","last_unstale":"2024-05-08T18:53:34.823408+0000","last_undegraded":"2024-05-08T18:53:34.823408+0000","last_fullsized":"2024-05-08T18:53:34.823408+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:41.493309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.589006+0000","last_change":"2024-05-08T18:50:26.029045+0000","last_active":"2024-05-08T18:53:34.589006+0000","last_peered":"2024-05-08T18:53:34.589006+0000","last_clean":"2024-05-08T18:53:34.589006+0000","last_became_active":"2024-05-08T18:50:26.028615+0000","last_became_peered":"2024-05-08T18:50:26.028615+0000","last_unstale":"2024-05-08T18:53:34.589006+0000","last_undegraded":"2024-05-08T18:53:34.589006+0000","last_fullsized":"2024-05-08T18:53:34.589006+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:52:05.955423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079116+0000","last_change":"2024-05-08T18:50:30.030595+0000","last_active":"2024-05-08T18:51:15.079116+0000","last_peered":"2024-05-08T18:51:15.079116+0000","last_clean":"2024-05-08T18:51:15.079116+0000","last_became_active":"2024-05-08T18:50:30.030295+0000","last_became_peered":"2024-05-08T18:50:30.030295+0000","last_unstale":"2024-05-08T18:51:15.079116+0000","last_undegraded":"2024-05-08T18:51:15.079116+0000","last_fullsized":"2024-05-08T18:51:15.079116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:39.211003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"27'26","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.792030+0000","last_change":"2024-05-08T18:50:32.040967+0000","last_active":"2024-05-08T18:52:32.792030+0000","last_peered":"2024-05-08T18:52:32.792030+0000","last_clean":"2024-05-08T18:52:32.792030+0000","last_became_active":"2024-05-08T18:50:32.040661+0000","last_became_peered":"2024-05-08T18:50:32.040661+0000","last_unstale":"2024-05-08T18:52:32.792030+0000","last_undegraded":"2024-05-08T18:52:32.792030+0000","last_fullsized":"2024-05-08T18:52:32.792030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:17.855961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076341+0000","last_change":"2024-05-08T18:50:34.045449+0000","last_active":"2024-05-08T18:51:15.076341+0000","last_peered":"2024-05-08T18:51:15.076341+0000","last_clean":"2024-05-08T18:51:15.076341+0000","last_became_active":"2024-05-08T18:50:34.045040+0000","last_became_peered":"2024-05-08T18:50:34.045040+0000","last_unstale":"2024-05-08T18:51:15.076341+0000","last_undegraded":"2024-05-08T18:51:15.076341+0000","last_fullsized":"2024-05-08T18:51:15.076341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:24.033430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.802348+0000","last_change":"2024-05-08T18:50:36.060675+0000","last_active":"2024-05-08T18:52:32.802348+0000","last_peered":"2024-05-08T18:52:32.802348+0000","last_clean":"2024-05-08T18:52:32.802348+0000","last_became_active":"2024-05-08T18:50:36.060382+0000","last_became_peered":"2024-05-08T18:50:36.060382+0000","last_unstale":"2024-05-08T18:52:32.802348+0000","last_undegraded":"2024-05-08T18:52:32.802348+0000","last_fullsized":"2024-05-08T18:52:32.802348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:13.860024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'11","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.612979+0000","last_change":"2024-05-08T18:50:28.020688+0000","last_active":"2024-05-08T18:53:34.612979+0000","last_peered":"2024-05-08T18:53:34.612979+0000","last_clean":"2024-05-08T18:53:34.612979+0000","last_became_active":"2024-05-08T18:50:28.020421+0000","last_became_peered":"2024-05-08T18:50:28.020421+0000","last_unstale":"2024-05-08T18:53:34.612979+0000","last_undegraded":"2024-05-08T18:53:34.612979+0000","last_fullsized":"2024-05-08T18:53:34.612979+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:38.101169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.814081+0000","last_change":"2024-05-08T18:50:26.012375+0000","last_active":"2024-05-08T18:53:34.814081+0000","last_peered":"2024-05-08T18:53:34.814081+0000","last_clean":"2024-05-08T18:53:34.814081+0000","last_became_active":"2024-05-08T18:50:26.011299+0000","last_became_peered":"2024-05-08T18:50:26.011299+0000","last_unstale":"2024-05-08T18:53:34.814081+0000","last_undegraded":"2024-05-08T18:53:34.814081+0000","last_fullsized":"2024-05-08T18:53:34.814081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:37.913831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"27'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:31.488124+0000","last_change":"2024-05-08T18:50:30.032861+0000","last_active":"2024-05-08T18:52:31.488124+0000","last_peered":"2024-05-08T18:52:31.488124+0000","last_clean":"2024-05-08T18:52:31.488124+0000","last_became_active":"2024-05-08T18:50:30.032578+0000","last_became_peered":"2024-05-08T18:50:30.032578+0000","last_unstale":"2024-05-08T18:52:31.488124+0000","last_undegraded":"2024-05-08T18:52:31.488124+0000","last_fullsized":"2024-05-08T18:52:31.488124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:01:09.465423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"27'33","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.276328+0000","last_change":"2024-05-08T18:50:32.042986+0000","last_active":"2024-05-08T18:53:34.276328+0000","last_peered":"2024-05-08T18:53:34.276328+0000","last_clean":"2024-05-08T18:53:34.276328+0000","last_became_active":"2024-05-08T18:50:32.042700+0000","last_became_peered":"2024-05-08T18:50:32.042700+0000","last_unstale":"2024-05-08T18:53:34.276328+0000","last_undegraded":"2024-05-08T18:53:34.276328+0000","last_fullsized":"2024-05-08T18:53:34.276328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:17.682080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072389+0000","last_change":"2024-05-08T18:50:34.045188+0000","last_active":"2024-05-08T18:51:15.072389+0000","last_peered":"2024-05-08T18:51:15.072389+0000","last_clean":"2024-05-08T18:51:15.072389+0000","last_became_active":"2024-05-08T18:50:34.044872+0000","last_became_peered":"2024-05-08T18:50:34.044872+0000","last_unstale":"2024-05-08T18:51:15.072389+0000","last_undegraded":"2024-05-08T18:51:15.072389+0000","last_fullsized":"2024-05-08T18:51:15.072389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:12.079998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.805125+0000","last_change":"2024-05-08T18:50:36.055685+0000","last_active":"2024-05-08T18:52:32.805125+0000","last_peered":"2024-05-08T18:52:32.805125+0000","last_clean":"2024-05-08T18:52:32.805125+0000","last_became_active":"2024-05-08T18:50:36.055188+0000","last_became_peered":"2024-05-08T18:50:36.055188+0000","last_unstale":"2024-05-08T18:52:32.805125+0000","last_undegraded":"2024-05-08T18:52:32.805125+0000","last_fullsized":"2024-05-08T18:52:32.805125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:29:30.352392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"27'12","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.613503+0000","last_change":"2024-05-08T18:50:28.039552+0000","last_active":"2024-05-08T18:53:34.613503+0000","last_peered":"2024-05-08T18:53:34.613503+0000","last_clean":"2024-05-08T18:53:34.613503+0000","last_became_active":"2024-05-08T18:50:28.039290+0000","last_became_peered":"2024-05-08T18:50:28.039290+0000","last_unstale":"2024-05-08T18:53:34.613503+0000","last_undegraded":"2024-05-08T18:53:34.613503+0000","last_fullsized":"2024-05-08T18:53:34.613503+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:14.876681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"27'3","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.465227+0000","last_change":"2024-05-08T18:50:26.019000+0000","last_active":"2024-05-08T18:51:50.465227+0000","last_peered":"2024-05-08T18:51:50.465227+0000","last_clean":"2024-05-08T18:51:50.465227+0000","last_became_active":"2024-05-08T18:50:26.018713+0000","last_became_peered":"2024-05-08T18:50:26.018713+0000","last_unstale":"2024-05-08T18:51:50.465227+0000","last_undegraded":"2024-05-08T18:51:50.465227+0000","last_fullsized":"2024-05-08T18:51:50.465227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:00:06.975161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"27'5","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.001130+0000","last_change":"2024-05-08T18:50:28.026675+0000","last_active":"2024-05-08T18:52:38.001130+0000","last_peered":"2024-05-08T18:52:38.001130+0000","last_clean":"2024-05-08T18:52:38.001130+0000","last_became_active":"2024-05-08T18:50:28.026292+0000","last_became_peered":"2024-05-08T18:50:28.026292+0000","last_unstale":"2024-05-08T18:52:38.001130+0000","last_undegraded":"2024-05-08T18:52:38.001130+0000","last_fullsized":"2024-05-08T18:52:38.001130+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:07.047413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072010+0000","last_change":"2024-05-08T18:50:26.013052+0000","last_active":"2024-05-08T18:51:15.072010+0000","last_peered":"2024-05-08T18:51:15.072010+0000","last_clean":"2024-05-08T18:51:15.072010+0000","last_became_active":"2024-05-08T18:50:26.012760+0000","last_became_peered":"2024-05-08T18:50:26.012760+0000","last_unstale":"2024-05-08T18:51:15.072010+0000","last_undegraded":"2024-05-08T18:51:15.072010+0000","last_fullsized":"2024-05-08T18:51:15.072010+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:13.215678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'4","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.605684+0000","last_change":"2024-05-08T18:50:28.039172+0000","last_active":"2024-05-08T18:53:34.605684+0000","last_peered":"2024-05-08T18:53:34.605684+0000","last_clean":"2024-05-08T18:53:34.605684+0000","last_became_active":"2024-05-08T18:50:28.038785+0000","last_became_peered":"2024-05-08T18:50:28.038785+0000","last_unstale":"2024-05-08T18:53:34.605684+0000","last_undegraded":"2024-05-08T18:53:34.605684+0000","last_fullsized":"2024-05-08T18:53:34.605684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:11.113877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077113+0000","last_change":"2024-05-08T18:50:26.026716+0000","last_active":"2024-05-08T18:51:15.077113+0000","last_peered":"2024-05-08T18:51:15.077113+0000","last_clean":"2024-05-08T18:51:15.077113+0000","last_became_active":"2024-05-08T18:50:26.025958+0000","last_became_peered":"2024-05-08T18:50:26.025958+0000","last_unstale":"2024-05-08T18:51:15.077113+0000","last_undegraded":"2024-05-08T18:51:15.077113+0000","last_fullsized":"2024-05-08T18:51:15.077113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:53:26.336839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.861403+0000","last_change":"2024-05-08T18:50:28.026318+0000","last_active":"2024-05-08T18:53:34.861403+0000","last_peered":"2024-05-08T18:53:34.861403+0000","last_clean":"2024-05-08T18:53:34.861403+0000","last_became_active":"2024-05-08T18:50:28.025866+0000","last_became_peered":"2024-05-08T18:50:28.025866+0000","last_unstale":"2024-05-08T18:53:34.861403+0000","last_undegraded":"2024-05-08T18:53:34.861403+0000","last_fullsized":"2024-05-08T18:53:34.861403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:01.592206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072761+0000","last_change":"2024-05-08T18:50:26.025390+0000","last_active":"2024-05-08T18:51:15.072761+0000","last_peered":"2024-05-08T18:51:15.072761+0000","last_clean":"2024-05-08T18:51:15.072761+0000","last_became_active":"2024-05-08T18:50:26.025120+0000","last_became_peered":"2024-05-08T18:50:26.025120+0000","last_unstale":"2024-05-08T18:51:15.072761+0000","last_undegraded":"2024-05-08T18:51:15.072761+0000","last_fullsized":"2024-05-08T18:51:15.072761+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:07.534900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"27'8","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.690848+0000","last_change":"2024-05-08T18:50:28.025392+0000","last_active":"2024-05-08T18:53:34.690848+0000","last_peered":"2024-05-08T18:53:34.690848+0000","last_clean":"2024-05-08T18:53:34.690848+0000","last_became_active":"2024-05-08T18:50:28.025098+0000","last_became_peered":"2024-05-08T18:50:28.025098+0000","last_unstale":"2024-05-08T18:53:34.690848+0000","last_undegraded":"2024-05-08T18:53:34.690848+0000","last_fullsized":"2024-05-08T18:53:34.690848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:08:56.748370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.001075+0000","last_change":"2024-05-08T18:50:26.014734+0000","last_active":"2024-05-08T18:52:38.001075+0000","last_peered":"2024-05-08T18:52:38.001075+0000","last_clean":"2024-05-08T18:52:38.001075+0000","last_became_active":"2024-05-08T18:50:26.014434+0000","last_became_peered":"2024-05-08T18:50:26.014434+0000","last_unstale":"2024-05-08T18:52:38.001075+0000","last_undegraded":"2024-05-08T18:52:38.001075+0000","last_fullsized":"2024-05-08T18:52:38.001075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:08:13.942735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"27'10","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.860680+0000","last_change":"2024-05-08T18:50:28.037769+0000","last_active":"2024-05-08T18:53:34.860680+0000","last_peered":"2024-05-08T18:53:34.860680+0000","last_clean":"2024-05-08T18:53:34.860680+0000","last_became_active":"2024-05-08T18:50:28.037400+0000","last_became_peered":"2024-05-08T18:50:28.037400+0000","last_unstale":"2024-05-08T18:53:34.860680+0000","last_undegraded":"2024-05-08T18:53:34.860680+0000","last_fullsized":"2024-05-08T18:53:34.860680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:32.886516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"25'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081132+0000","last_change":"2024-05-08T18:50:26.029481+0000","last_active":"2024-05-08T18:51:15.081132+0000","last_peered":"2024-05-08T18:51:15.081132+0000","last_clean":"2024-05-08T18:51:15.081132+0000","last_became_active":"2024-05-08T18:50:26.029047+0000","last_became_peered":"2024-05-08T18:50:26.029047+0000","last_unstale":"2024-05-08T18:51:15.081132+0000","last_undegraded":"2024-05-08T18:51:15.081132+0000","last_fullsized":"2024-05-08T18:51:15.081132+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:13:25.895646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.690549+0000","last_change":"2024-05-08T18:50:28.021411+0000","last_active":"2024-05-08T18:53:34.690549+0000","last_peered":"2024-05-08T18:53:34.690549+0000","last_clean":"2024-05-08T18:53:34.690549+0000","last_became_active":"2024-05-08T18:50:28.021140+0000","last_became_peered":"2024-05-08T18:50:28.021140+0000","last_unstale":"2024-05-08T18:53:34.690549+0000","last_undegraded":"2024-05-08T18:53:34.690549+0000","last_fullsized":"2024-05-08T18:53:34.690549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:14.472478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076427+0000","last_change":"2024-05-08T18:50:26.031998+0000","last_active":"2024-05-08T18:51:15.076427+0000","last_peered":"2024-05-08T18:51:15.076427+0000","last_clean":"2024-05-08T18:51:15.076427+0000","last_became_active":"2024-05-08T18:50:26.031680+0000","last_became_peered":"2024-05-08T18:50:26.031680+0000","last_unstale":"2024-05-08T18:51:15.076427+0000","last_undegraded":"2024-05-08T18:51:15.076427+0000","last_fullsized":"2024-05-08T18:51:15.076427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:40.472317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"27'11","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.004738+0000","last_change":"2024-05-08T18:50:28.023037+0000","last_active":"2024-05-08T18:52:33.004738+0000","last_peered":"2024-05-08T18:52:33.004738+0000","last_clean":"2024-05-08T18:52:33.004738+0000","last_became_active":"2024-05-08T18:50:28.021588+0000","last_became_peered":"2024-05-08T18:50:28.021588+0000","last_unstale":"2024-05-08T18:52:33.004738+0000","last_undegraded":"2024-05-08T18:52:33.004738+0000","last_fullsized":"2024-05-08T18:52:33.004738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.433020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074638+0000","last_change":"2024-05-08T18:50:26.014622+0000","last_active":"2024-05-08T18:51:15.074638+0000","last_peered":"2024-05-08T18:51:15.074638+0000","last_clean":"2024-05-08T18:51:15.074638+0000","last_became_active":"2024-05-08T18:50:26.014383+0000","last_became_peered":"2024-05-08T18:50:26.014383+0000","last_unstale":"2024-05-08T18:51:15.074638+0000","last_undegraded":"2024-05-08T18:51:15.074638+0000","last_fullsized":"2024-05-08T18:51:15.074638+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:31:52.859857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"27'5","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007384+0000","last_change":"2024-05-08T18:50:28.032443+0000","last_active":"2024-05-08T18:52:48.007384+0000","last_peered":"2024-05-08T18:52:48.007384+0000","last_clean":"2024-05-08T18:52:48.007384+0000","last_became_active":"2024-05-08T18:50:28.032181+0000","last_became_peered":"2024-05-08T18:50:28.032181+0000","last_unstale":"2024-05-08T18:52:48.007384+0000","last_undegraded":"2024-05-08T18:52:48.007384+0000","last_fullsized":"2024-05-08T18:52:48.007384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:14.122243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"27'3","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.005971+0000","last_change":"2024-05-08T18:50:26.025793+0000","last_active":"2024-05-08T18:52:38.005971+0000","last_peered":"2024-05-08T18:52:38.005971+0000","last_clean":"2024-05-08T18:52:38.005971+0000","last_became_active":"2024-05-08T18:50:26.025473+0000","last_became_peered":"2024-05-08T18:50:26.025473+0000","last_unstale":"2024-05-08T18:52:38.005971+0000","last_undegraded":"2024-05-08T18:52:38.005971+0000","last_fullsized":"2024-05-08T18:52:38.005971+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:54.988707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.860972+0000","last_change":"2024-05-08T18:50:28.032744+0000","last_active":"2024-05-08T18:53:34.860972+0000","last_peered":"2024-05-08T18:53:34.860972+0000","last_clean":"2024-05-08T18:53:34.860972+0000","last_became_active":"2024-05-08T18:50:28.032462+0000","last_became_peered":"2024-05-08T18:50:28.032462+0000","last_unstale":"2024-05-08T18:53:34.860972+0000","last_undegraded":"2024-05-08T18:53:34.860972+0000","last_fullsized":"2024-05-08T18:53:34.860972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:56.484964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072300+0000","last_change":"2024-05-08T18:50:26.019960+0000","last_active":"2024-05-08T18:51:15.072300+0000","last_peered":"2024-05-08T18:51:15.072300+0000","last_clean":"2024-05-08T18:51:15.072300+0000","last_became_active":"2024-05-08T18:50:26.019706+0000","last_became_peered":"2024-05-08T18:50:26.019706+0000","last_unstale":"2024-05-08T18:51:15.072300+0000","last_undegraded":"2024-05-08T18:51:15.072300+0000","last_fullsized":"2024-05-08T18:51:15.072300+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:09.253705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"27'1","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.001897+0000","last_change":"2024-05-08T18:50:28.031514+0000","last_active":"2024-05-08T18:52:43.001897+0000","last_peered":"2024-05-08T18:52:43.001897+0000","last_clean":"2024-05-08T18:52:43.001897+0000","last_became_active":"2024-05-08T18:50:28.031188+0000","last_became_peered":"2024-05-08T18:50:28.031188+0000","last_unstale":"2024-05-08T18:52:43.001897+0000","last_undegraded":"2024-05-08T18:52:43.001897+0000","last_fullsized":"2024-05-08T18:52:43.001897+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:29.243577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075633+0000","last_change":"2024-05-08T18:50:26.025601+0000","last_active":"2024-05-08T18:51:15.075633+0000","last_peered":"2024-05-08T18:51:15.075633+0000","last_clean":"2024-05-08T18:51:15.075633+0000","last_became_active":"2024-05-08T18:50:26.024808+0000","last_became_peered":"2024-05-08T18:50:26.024808+0000","last_unstale":"2024-05-08T18:51:15.075633+0000","last_undegraded":"2024-05-08T18:51:15.075633+0000","last_fullsized":"2024-05-08T18:51:15.075633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:09.253705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887561+0000","last_change":"2024-05-08T18:50:28.023364+0000","last_active":"2024-05-08T18:53:34.887561+0000","last_peered":"2024-05-08T18:53:34.887561+0000","last_clean":"2024-05-08T18:53:34.887561+0000","last_became_active":"2024-05-08T18:50:28.022905+0000","last_became_peered":"2024-05-08T18:50:28.022905+0000","last_unstale":"2024-05-08T18:53:34.887561+0000","last_undegraded":"2024-05-08T18:53:34.887561+0000","last_fullsized":"2024-05-08T18:53:34.887561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:29:28.977842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078754+0000","last_change":"2024-05-08T18:50:26.025267+0000","last_active":"2024-05-08T18:51:15.078754+0000","last_peered":"2024-05-08T18:51:15.078754+0000","last_clean":"2024-05-08T18:51:15.078754+0000","last_became_active":"2024-05-08T18:50:26.024977+0000","last_became_peered":"2024-05-08T18:50:26.024977+0000","last_unstale":"2024-05-08T18:51:15.078754+0000","last_undegraded":"2024-05-08T18:51:15.078754+0000","last_fullsized":"2024-05-08T18:51:15.078754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:07.271771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076314+0000","last_change":"2024-05-08T18:50:28.037398+0000","last_active":"2024-05-08T18:51:15.076314+0000","last_peered":"2024-05-08T18:51:15.076314+0000","last_clean":"2024-05-08T18:51:15.076314+0000","last_became_active":"2024-05-08T18:50:28.037153+0000","last_became_peered":"2024-05-08T18:50:28.037153+0000","last_unstale":"2024-05-08T18:51:15.076314+0000","last_undegraded":"2024-05-08T18:51:15.076314+0000","last_fullsized":"2024-05-08T18:51:15.076314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:24.508392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079754+0000","last_change":"2024-05-08T18:50:26.012280+0000","last_active":"2024-05-08T18:51:15.079754+0000","last_peered":"2024-05-08T18:51:15.079754+0000","last_clean":"2024-05-08T18:51:15.079754+0000","last_became_active":"2024-05-08T18:50:26.011982+0000","last_became_peered":"2024-05-08T18:50:26.011982+0000","last_unstale":"2024-05-08T18:51:15.079754+0000","last_undegraded":"2024-05-08T18:51:15.079754+0000","last_fullsized":"2024-05-08T18:51:15.079754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:12.465547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"27'8","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.475728+0000","last_change":"2024-05-08T18:50:28.028689+0000","last_active":"2024-05-08T18:51:50.475728+0000","last_peered":"2024-05-08T18:51:50.475728+0000","last_clean":"2024-05-08T18:51:50.475728+0000","last_became_active":"2024-05-08T18:50:28.028405+0000","last_became_peered":"2024-05-08T18:50:28.028405+0000","last_unstale":"2024-05-08T18:51:50.475728+0000","last_undegraded":"2024-05-08T18:51:50.475728+0000","last_fullsized":"2024-05-08T18:51:50.475728+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:29.243577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:31.110738+0000","last_change":"2024-05-08T18:50:26.023917+0000","last_active":"2024-05-08T18:52:31.110738+0000","last_peered":"2024-05-08T18:52:31.110738+0000","last_clean":"2024-05-08T18:52:31.110738+0000","last_became_active":"2024-05-08T18:50:26.023658+0000","last_became_peered":"2024-05-08T18:50:26.023658+0000","last_unstale":"2024-05-08T18:52:31.110738+0000","last_undegraded":"2024-05-08T18:52:31.110738+0000","last_fullsized":"2024-05-08T18:52:31.110738+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:38:03.869777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"25'4","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076645+0000","last_change":"2024-05-08T18:50:28.032840+0000","last_active":"2024-05-08T18:51:15.076645+0000","last_peered":"2024-05-08T18:51:15.076645+0000","last_clean":"2024-05-08T18:51:15.076645+0000","last_became_active":"2024-05-08T18:50:28.032552+0000","last_became_peered":"2024-05-08T18:50:28.032552+0000","last_unstale":"2024-05-08T18:51:15.076645+0000","last_undegraded":"2024-05-08T18:51:15.076645+0000","last_fullsized":"2024-05-08T18:51:15.076645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:37.204016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075410+0000","last_change":"2024-05-08T18:50:26.032685+0000","last_active":"2024-05-08T18:51:15.075410+0000","last_peered":"2024-05-08T18:51:15.075410+0000","last_clean":"2024-05-08T18:51:15.075410+0000","last_became_active":"2024-05-08T18:50:26.032385+0000","last_became_peered":"2024-05-08T18:50:26.032385+0000","last_unstale":"2024-05-08T18:51:15.075410+0000","last_undegraded":"2024-05-08T18:51:15.075410+0000","last_fullsized":"2024-05-08T18:51:15.075410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:10.080123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"27'6","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.242807+0000","last_change":"2024-05-08T18:50:28.024068+0000","last_active":"2024-05-08T18:52:34.242807+0000","last_peered":"2024-05-08T18:52:34.242807+0000","last_clean":"2024-05-08T18:52:34.242807+0000","last_became_active":"2024-05-08T18:50:28.023807+0000","last_became_peered":"2024-05-08T18:50:28.023807+0000","last_unstale":"2024-05-08T18:52:34.242807+0000","last_undegraded":"2024-05-08T18:52:34.242807+0000","last_fullsized":"2024-05-08T18:52:34.242807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:13.501403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.221151+0000","last_change":"2024-05-08T18:50:26.026065+0000","last_active":"2024-05-08T18:52:34.221151+0000","last_peered":"2024-05-08T18:52:34.221151+0000","last_clean":"2024-05-08T18:52:34.221151+0000","last_became_active":"2024-05-08T18:50:26.025023+0000","last_became_peered":"2024-05-08T18:50:26.025023+0000","last_unstale":"2024-05-08T18:52:34.221151+0000","last_undegraded":"2024-05-08T18:52:34.221151+0000","last_fullsized":"2024-05-08T18:52:34.221151+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:28.045523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'6","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.152460+0000","last_change":"2024-05-08T18:50:26.026599+0000","last_active":"2024-05-08T18:52:34.152460+0000","last_peered":"2024-05-08T18:52:34.152460+0000","last_clean":"2024-05-08T18:52:34.152460+0000","last_became_active":"2024-05-08T18:50:26.026333+0000","last_became_peered":"2024-05-08T18:50:26.026333+0000","last_unstale":"2024-05-08T18:52:34.152460+0000","last_undegraded":"2024-05-08T18:52:34.152460+0000","last_fullsized":"2024-05-08T18:52:34.152460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:05.498928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"25'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075022+0000","last_change":"2024-05-08T18:50:28.024946+0000","last_active":"2024-05-08T18:51:15.075022+0000","last_peered":"2024-05-08T18:51:15.075022+0000","last_clean":"2024-05-08T18:51:15.075022+0000","last_became_active":"2024-05-08T18:50:28.024627+0000","last_became_peered":"2024-05-08T18:50:28.024627+0000","last_unstale":"2024-05-08T18:51:15.075022+0000","last_undegraded":"2024-05-08T18:51:15.075022+0000","last_fullsized":"2024-05-08T18:51:15.075022+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:44.968210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.002479+0000","last_change":"2024-05-08T18:50:26.025142+0000","last_active":"2024-05-08T18:52:48.002479+0000","last_peered":"2024-05-08T18:52:48.002479+0000","last_clean":"2024-05-08T18:52:48.002479+0000","last_became_active":"2024-05-08T18:50:26.024839+0000","last_became_peered":"2024-05-08T18:50:26.024839+0000","last_unstale":"2024-05-08T18:52:48.002479+0000","last_undegraded":"2024-05-08T18:52:48.002479+0000","last_fullsized":"2024-05-08T18:52:48.002479+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:13:25.895646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'7","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.008084+0000","last_change":"2024-05-08T18:50:28.038943+0000","last_active":"2024-05-08T18:52:53.008084+0000","last_peered":"2024-05-08T18:52:53.008084+0000","last_clean":"2024-05-08T18:52:53.008084+0000","last_became_active":"2024-05-08T18:50:28.038677+0000","last_became_peered":"2024-05-08T18:50:28.038677+0000","last_unstale":"2024-05-08T18:52:53.008084+0000","last_undegraded":"2024-05-08T18:52:53.008084+0000","last_fullsized":"2024-05-08T18:52:53.008084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:55.122520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1601,"num_read_kb":1491,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705707,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56228,"kb_used_data":20892,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94315612,"statfs":{"total":96636764160,"available":96579186688,"internally_reserved":0,"allocated":21393408,"data_stored":21094274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705708,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48548,"kb_used_data":13212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94323292,"statfs":{"total":96636764160,"available":96587051008,"internally_reserved":0,"allocated":13529088,"data_stored":13292544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705707,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45104,"kb_used_data":9768,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326736,"statfs":{"total":96636764160,"available":96590577664,"internally_reserved":0,"allocated":10002432,"data_stored":9737407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705707,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40368,"kb_used_data":9192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331472,"statfs":{"total":96636764160,"available":96595427328,"internally_reserved":0,"allocated":9412608,"data_stored":9148355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9031680,"data_stored":9028480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9031680,"data_stored":9028480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:53:42.683 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:53:42.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.817+0000 7f60b62db640 1 Processor -- start 2024-05-08T18:53:42.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.817+0000 7f60b62db640 1 -- start start 2024-05-08T18:53:42.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.818+0000 7f60b62db640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f60b012eb90 0x7f60b0130f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:42.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.818+0000 7f60b62db640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60b00719e0 con 0x7f60b012bdd0 2024-05-08T18:53:42.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.818+0000 7f60b62db640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f60b012b9a0 con 0x7f60b012eb90 2024-05-08T18:53:42.817 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.818+0000 7f60af7fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f60b012eb90 0x7f60b0130f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:42.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.818+0000 7f60affff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f60b012bdd0 0x7f60b012c1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:47186/0 (socket says 172.21.15.42:47186) 2024-05-08T18:53:42.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.818+0000 7f60affff640 1 -- 172.21.15.42:0/740993759 learned_addr learned my addr 172.21.15.42:0/740993759 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:53:42.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.818+0000 7f60af7fe640 1 -- 172.21.15.42:0/740993759 >> v1:172.21.15.42:6789/0 conn(0x7f60b012bdd0 legacy=0x7f60b012c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:42.818 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.818+0000 7f60af7fe640 1 -- 172.21.15.42:0/740993759 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b0072330 con 0x7f60b012eb90 2024-05-08T18:53:42.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.819+0000 7f60af7fe640 1 --2- 172.21.15.42:0/740993759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60b012eb90 0x7f60b0130f80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009720 tx=0x7f60a402c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8205fa9ca6a06e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:42.819 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.819+0000 7f60aeffd640 1 -- 172.21.15.42:0/740993759 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60a4035070 con 0x7f60b012eb90 2024-05-08T18:53:42.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.819+0000 7f60aeffd640 1 -- 172.21.15.42:0/740993759 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60a4031740 con 0x7f60b012eb90 2024-05-08T18:53:42.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.819+0000 7f60aeffd640 1 -- 172.21.15.42:0/740993759 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60a4031a40 con 0x7f60b012eb90 2024-05-08T18:53:42.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.819+0000 7f60b62db640 1 -- 172.21.15.42:0/740993759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60b012eb90 msgr2=0x7f60b0130f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:42.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.819+0000 7f60b62db640 1 --2- 172.21.15.42:0/740993759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60b012eb90 0x7f60b0130f80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009720 tx=0x7f60a402c950 comp rx=0 tx=0).stop 2024-05-08T18:53:42.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.820+0000 7f60b62db640 1 -- 172.21.15.42:0/740993759 shutdown_connections 2024-05-08T18:53:42.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.820+0000 7f60b62db640 1 --2- 172.21.15.42:0/740993759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60b012eb90 0x7f60b0130f80 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:42.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.820+0000 7f60b62db640 1 -- 172.21.15.42:0/740993759 >> 172.21.15.42:0/740993759 conn(0x7f60b009a910 msgr2=0x7f60b006e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:42.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.820+0000 7f60b62db640 1 -- 172.21.15.42:0/740993759 shutdown_connections 2024-05-08T18:53:42.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.820+0000 7f60b62db640 1 -- 172.21.15.42:0/740993759 wait complete. 2024-05-08T18:53:42.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.820+0000 7f60b62db640 1 Processor -- start 2024-05-08T18:53:42.820 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.821+0000 7f60b62db640 1 -- start start 2024-05-08T18:53:42.822 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.821+0000 7f60b62db640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60b012bdd0 0x7f60b0115e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:42.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.821+0000 7f60b62db640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f60b0073290 con 0x7f60b012bdd0 2024-05-08T18:53:42.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.821+0000 7f60affff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60b012bdd0 0x7f60b0115e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:42.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.821+0000 7f60affff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60b012bdd0 0x7f60b0115e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45800/0 (socket says 172.21.15.42:45800) 2024-05-08T18:53:42.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.821+0000 7f60affff640 1 -- 172.21.15.42:0/1030946490 learned_addr learned my addr 172.21.15.42:0/1030946490 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:53:42.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.821+0000 7f60affff640 1 -- 172.21.15.42:0/1030946490 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b0128f70 con 0x7f60b012bdd0 2024-05-08T18:53:42.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.822+0000 7f60affff640 1 --2- 172.21.15.42:0/1030946490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60b012bdd0 0x7f60b0115e40 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f60a000c4a0 tx=0x7f60a000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:42.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.822+0000 7f60acff9640 1 -- 172.21.15.42:0/1030946490 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60a0017070 con 0x7f60b012bdd0 2024-05-08T18:53:42.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.822+0000 7f60acff9640 1 -- 172.21.15.42:0/1030946490 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60a0005c10 con 0x7f60b012bdd0 2024-05-08T18:53:42.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.822+0000 7f60b62db640 1 -- 172.21.15.42:0/1030946490 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b0117270 con 0x7f60b012bdd0 2024-05-08T18:53:42.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.822+0000 7f60acff9640 1 -- 172.21.15.42:0/1030946490 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60a0007070 con 0x7f60b012bdd0 2024-05-08T18:53:42.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.822+0000 7f60b62db640 1 -- 172.21.15.42:0/1030946490 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b01183a0 con 0x7f60b012bdd0 2024-05-08T18:53:42.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.823+0000 7f60acff9640 1 -- 172.21.15.42:0/1030946490 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f60a001a070 con 0x7f60b012bdd0 2024-05-08T18:53:42.823 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.823+0000 7f60b62db640 1 -- 172.21.15.42:0/1030946490 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60b0064010 con 0x7f60b012bdd0 2024-05-08T18:53:42.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.823+0000 7f60acff9640 1 --2- 172.21.15.42:0/1030946490 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f609c03d2b0 0x7f609c03f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:42.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.823+0000 7f60acff9640 1 -- 172.21.15.42:0/1030946490 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f60a0050fa0 con 0x7f60b012bdd0 2024-05-08T18:53:42.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.823+0000 7f60af7fe640 1 --2- 172.21.15.42:0/1030946490 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f609c03d2b0 0x7f609c03f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:42.824 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.824+0000 7f60af7fe640 1 --2- 172.21.15.42:0/1030946490 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f609c03d2b0 0x7f609c03f770 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f60a4037000 tx=0x7f60a4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:42.826 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:42.828+0000 7f60acff9640 1 -- 172.21.15.42:0/1030946490 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f60a0011cc0 con 0x7f60b012bdd0 2024-05-08T18:53:43.017 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:43.018+0000 7f60b62db640 1 -- 172.21.15.42:0/1030946490 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60b0118a60 con 0x7f60b012bdd0 2024-05-08T18:53:43.019 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:43.020+0000 7f60acff9640 1 -- 172.21.15.42:0/1030946490 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+21125 (secure 0 0 0) 0x7f60a0010300 con 0x7f60b012bdd0 2024-05-08T18:53:43.019 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:53:43.020 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":27,"fsid":"772ec65a-301b-4446-89ae-86d9bcfb0a5c","created":"2024-05-08T18:50:09.489497+0000","modified":"2024-05-08T18:51:15.066510+0000","last_up_change":"2024-05-08T18:50:17.729597+0000","last_in_change":"2024-05-08T18:50:10.598140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T18:50:17.942051+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T18:50:18.435323+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-08T18:50:24.072981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-08T18:50:26.324845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-08T18:50:28.309578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-08T18:50:30.099205+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-08T18:50:32.048148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-08T18:50:34.118691+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0977d23d-95b7-40ad-9731-d8830f6eed5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1521799280},{"type":"v1","addr":"172.21.15.42:6801","nonce":1521799280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1521799280},{"type":"v1","addr":"172.21.15.42:6803","nonce":1521799280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1521799280},{"type":"v1","addr":"172.21.15.42:6807","nonce":1521799280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1521799280},{"type":"v1","addr":"172.21.15.42:6805","nonce":1521799280}]},"public_addr":"172.21.15.42:6801/1521799280","cluster_addr":"172.21.15.42:6803/1521799280","heartbeat_back_addr":"172.21.15.42:6807/1521799280","heartbeat_front_addr":"172.21.15.42:6805/1521799280","state":["exists","up"]},{"osd":1,"uuid":"cb3d63fc-91ce-46e0-8917-0552f4753541","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3697320277},{"type":"v1","addr":"172.21.15.132:6801","nonce":3697320277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3697320277},{"type":"v1","addr":"172.21.15.132:6803","nonce":3697320277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3697320277},{"type":"v1","addr":"172.21.15.132:6807","nonce":3697320277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":3697320277},{"type":"v1","addr":"172.21.15.132:6805","nonce":3697320277}]},"public_addr":"172.21.15.132:6801/3697320277","cluster_addr":"172.21.15.132:6803/3697320277","heartbeat_back_addr":"172.21.15.132:6807/3697320277","heartbeat_front_addr":"172.21.15.132:6805/3697320277","state":["exists","up"]},{"osd":2,"uuid":"c3d3af18-54c3-492d-a4f1-72075b0fd6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":1108348591},{"type":"v1","addr":"172.21.15.132:6809","nonce":1108348591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":1108348591},{"type":"v1","addr":"172.21.15.132:6811","nonce":1108348591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":1108348591},{"type":"v1","addr":"172.21.15.132:6815","nonce":1108348591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":1108348591},{"type":"v1","addr":"172.21.15.132:6813","nonce":1108348591}]},"public_addr":"172.21.15.132:6809/1108348591","cluster_addr":"172.21.15.132:6811/1108348591","heartbeat_back_addr":"172.21.15.132:6815/1108348591","heartbeat_front_addr":"172.21.15.132:6813/1108348591","state":["exists","up"]},{"osd":3,"uuid":"07166424-d9c6-44be-b49f-173ad316b7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":17827703},{"type":"v1","addr":"172.21.15.132:6817","nonce":17827703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":17827703},{"type":"v1","addr":"172.21.15.132:6819","nonce":17827703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":17827703},{"type":"v1","addr":"172.21.15.132:6823","nonce":17827703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":17827703},{"type":"v1","addr":"172.21.15.132:6821","nonce":17827703}]},"public_addr":"172.21.15.132:6817/17827703","cluster_addr":"172.21.15.132:6819/17827703","heartbeat_back_addr":"172.21.15.132:6823/17827703","heartbeat_front_addr":"172.21.15.132:6821/17827703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:50:15.606047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:50:15.744620+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:50:15.774231+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:50:15.779858+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.3d","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"5.3","mappings":[{"from":0,"to":2}]},{"pgid":"5.7","mappings":[{"from":0,"to":2}]},{"pgid":"5.12","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:53:43.021 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:43.022+0000 7f60b62db640 1 -- 172.21.15.42:0/1030946490 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f609c03d2b0 msgr2=0x7f609c03f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:43.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:43.022+0000 7f60b62db640 1 --2- 172.21.15.42:0/1030946490 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f609c03d2b0 0x7f609c03f770 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f60a4037000 tx=0x7f60a4008030 comp rx=0 tx=0).stop 2024-05-08T18:53:43.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:43.022+0000 7f60b62db640 1 -- 172.21.15.42:0/1030946490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60b012bdd0 msgr2=0x7f60b0115e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:43.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:43.022+0000 7f60b62db640 1 --2- 172.21.15.42:0/1030946490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60b012bdd0 0x7f60b0115e40 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f60a000c4a0 tx=0x7f60a000c960 comp rx=0 tx=0).stop 2024-05-08T18:53:43.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:43.022+0000 7f60b62db640 1 -- 172.21.15.42:0/1030946490 shutdown_connections 2024-05-08T18:53:43.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:43.022+0000 7f60b62db640 1 --2- 172.21.15.42:0/1030946490 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f609c03d2b0 0x7f609c03f770 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:43.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:43.022+0000 7f60b62db640 1 --2- 172.21.15.42:0/1030946490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60b012bdd0 0x7f60b0115e40 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:43.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:43.022+0000 7f60b62db640 1 -- 172.21.15.42:0/1030946490 >> 172.21.15.42:0/1030946490 conn(0x7f60b009a910 msgr2=0x7f60b012d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:43.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:43.022+0000 7f60b62db640 1 -- 172.21.15.42:0/1030946490 shutdown_connections 2024-05-08T18:53:43.022 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:43.022+0000 7f60b62db640 1 -- 172.21.15.42:0/1030946490 wait complete. 2024-05-08T18:53:44.033 INFO:tasks.ceph:Scrubbing osd.0 2024-05-08T18:53:44.034 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:53:44.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.153+0000 7fbd7f35c640 1 Processor -- start 2024-05-08T18:53:44.152 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.154+0000 7fbd7f35c640 1 -- start start 2024-05-08T18:53:44.153 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.154+0000 7fbd7f35c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbd7812e6f0 0x7fbd7812ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:44.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.154+0000 7fbd7f35c640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd7806eec0 con 0x7fbd7809d490 2024-05-08T18:53:44.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.154+0000 7fbd7f35c640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fbd7809adc0 con 0x7fbd7812e6f0 2024-05-08T18:53:44.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.154+0000 7fbd7d0f8640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbd7812e6f0 0x7fbd7812ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:44.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.154+0000 7fbd7c8f7640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fbd7809d490 0x7fbd7809d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:47202/0 (socket says 172.21.15.42:47202) 2024-05-08T18:53:44.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.154+0000 7fbd7c8f7640 1 -- 172.21.15.42:0/3742613871 learned_addr learned my addr 172.21.15.42:0/3742613871 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:53:44.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.154+0000 7fbd7d0f8640 1 -- 172.21.15.42:0/3742613871 >> v1:172.21.15.42:6789/0 conn(0x7fbd7809d490 legacy=0x7fbd7809d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:44.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.154+0000 7fbd7d0f8640 1 -- 172.21.15.42:0/3742613871 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7809b300 con 0x7fbd7812e6f0 2024-05-08T18:53:44.154 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.154+0000 7fbd6ffff640 1 -- 172.21.15.42:0/3742613871 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 445614173 0 0) 0x7fbd7806eec0 con 0x7fbd7809d490 2024-05-08T18:53:44.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.155+0000 7fbd7d0f8640 1 --2- 172.21.15.42:0/3742613871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd7812e6f0 0x7fbd7812ead0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009720 tx=0x7fbd7402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5089c35846ca1a4b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:44.155 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.155+0000 7fbd6ffff640 1 -- 172.21.15.42:0/3742613871 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd740316d0 con 0x7fbd7812e6f0 2024-05-08T18:53:44.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.155+0000 7fbd6ffff640 1 -- 172.21.15.42:0/3742613871 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd74037070 con 0x7fbd7812e6f0 2024-05-08T18:53:44.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.155+0000 7fbd6ffff640 1 -- 172.21.15.42:0/3742613871 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd740319c0 con 0x7fbd7812e6f0 2024-05-08T18:53:44.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.156+0000 7fbd7f35c640 1 -- 172.21.15.42:0/3742613871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd7812e6f0 msgr2=0x7fbd7812ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:44.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.156+0000 7fbd7f35c640 1 --2- 172.21.15.42:0/3742613871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd7812e6f0 0x7fbd7812ead0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009720 tx=0x7fbd7402b840 comp rx=0 tx=0).stop 2024-05-08T18:53:44.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.156+0000 7fbd7f35c640 1 -- 172.21.15.42:0/3742613871 shutdown_connections 2024-05-08T18:53:44.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.156+0000 7fbd7f35c640 1 --2- 172.21.15.42:0/3742613871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd7812e6f0 0x7fbd7812ead0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:44.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.156+0000 7fbd7f35c640 1 -- 172.21.15.42:0/3742613871 >> 172.21.15.42:0/3742613871 conn(0x7fbd7806e160 msgr2=0x7fbd7806e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:44.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.156+0000 7fbd7f35c640 1 -- 172.21.15.42:0/3742613871 shutdown_connections 2024-05-08T18:53:44.156 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.156+0000 7fbd7f35c640 1 -- 172.21.15.42:0/3742613871 wait complete. 2024-05-08T18:53:44.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.157+0000 7fbd7f35c640 1 Processor -- start 2024-05-08T18:53:44.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.157+0000 7fbd7f35c640 1 -- start start 2024-05-08T18:53:44.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.157+0000 7fbd7f35c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd7809d490 0x7fbd7811a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:44.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.157+0000 7fbd7f35c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbd7809a440 con 0x7fbd7809d490 2024-05-08T18:53:44.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.158+0000 7fbd7d0f8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd7809d490 0x7fbd7811a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:44.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.158+0000 7fbd7d0f8640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd7809d490 0x7fbd7811a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45816/0 (socket says 172.21.15.42:45816) 2024-05-08T18:53:44.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.158+0000 7fbd7d0f8640 1 -- 172.21.15.42:0/1249276187 learned_addr learned my addr 172.21.15.42:0/1249276187 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:53:44.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.158+0000 7fbd7d0f8640 1 -- 172.21.15.42:0/1249276187 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd7811d470 con 0x7fbd7809d490 2024-05-08T18:53:44.158 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.158+0000 7fbd7d0f8640 1 --2- 172.21.15.42:0/1249276187 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd7809d490 0x7fbd7811a310 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009840 tx=0x7fbd740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:44.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.158+0000 7fbd6dffb640 1 -- 172.21.15.42:0/1249276187 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd74004030 con 0x7fbd7809d490 2024-05-08T18:53:44.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.158+0000 7fbd6dffb640 1 -- 172.21.15.42:0/1249276187 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd740041d0 con 0x7fbd7809d490 2024-05-08T18:53:44.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.158+0000 7fbd7f35c640 1 -- 172.21.15.42:0/1249276187 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd7811d8b0 con 0x7fbd7809d490 2024-05-08T18:53:44.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.158+0000 7fbd6dffb640 1 -- 172.21.15.42:0/1249276187 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd740044b0 con 0x7fbd7809d490 2024-05-08T18:53:44.159 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.158+0000 7fbd7f35c640 1 -- 172.21.15.42:0/1249276187 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd7811a850 con 0x7fbd7809d490 2024-05-08T18:53:44.160 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.159+0000 7fbd6dffb640 1 -- 172.21.15.42:0/1249276187 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fbd74003610 con 0x7fbd7809d490 2024-05-08T18:53:44.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.159+0000 7fbd7f35c640 1 -- 172.21.15.42:0/1249276187 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbd78064010 con 0x7fbd7809d490 2024-05-08T18:53:44.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.160+0000 7fbd6dffb640 1 --2- 172.21.15.42:0/1249276187 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd5c03d2b0 0x7fbd5c03f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:44.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.160+0000 7fbd6dffb640 1 -- 172.21.15.42:0/1249276187 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fbd7402f050 con 0x7fbd7809d490 2024-05-08T18:53:44.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.160+0000 7fbd6dffb640 1 --2- 172.21.15.42:0/1249276187 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fbd5c049030 0x7fbd5c04b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:44.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.160+0000 7fbd6dffb640 1 -- 172.21.15.42:0/1249276187 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd7402de50 con 0x7fbd5c049030 2024-05-08T18:53:44.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.160+0000 7fbd7d8f9640 1 --2- 172.21.15.42:0/1249276187 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fbd5c049030 0x7fbd5c04b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:44.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.160+0000 7fbd7c8f7640 1 --2- 172.21.15.42:0/1249276187 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd5c03d2b0 0x7fbd5c03f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:44.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.160+0000 7fbd7d8f9640 1 --2- 172.21.15.42:0/1249276187 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fbd5c049030 0x7fbd5c04b4d0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:44.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.161+0000 7fbd7c8f7640 1 --2- 172.21.15.42:0/1249276187 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd5c03d2b0 0x7fbd5c03f770 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbd68000c00 tx=0x7fbd68007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:44.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.161+0000 7fbd6dffb640 1 -- 172.21.15.42:0/1249276187 <== osd.0 v2:172.21.15.42:6800/1521799280 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbd7402de50 con 0x7fbd5c049030 2024-05-08T18:53:44.161 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.161+0000 7fbd6dffb640 1 -- 172.21.15.42:0/1249276187 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbd7404d360 con 0x7fbd7809d490 2024-05-08T18:53:44.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.174+0000 7fbd7f35c640 1 -- 172.21.15.42:0/1249276187 --> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbd7811ce90 con 0x7fbd5c049030 2024-05-08T18:53:44.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.174+0000 7fbd6dffb640 1 -- 172.21.15.42:0/1249276187 <== osd.0 v2:172.21.15.42:6800/1521799280 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbd7000ad10 con 0x7fbd5c049030 2024-05-08T18:53:44.174 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-08T18:53:44.174 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:53:44.174 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-08T18:53:44.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.175+0000 7fbd7f35c640 1 -- 172.21.15.42:0/1249276187 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fbd5c049030 msgr2=0x7fbd5c04b4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:44.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.175+0000 7fbd7f35c640 1 --2- 172.21.15.42:0/1249276187 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fbd5c049030 0x7fbd5c04b4d0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:44.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.175+0000 7fbd7f35c640 1 -- 172.21.15.42:0/1249276187 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd5c03d2b0 msgr2=0x7fbd5c03f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:44.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.175+0000 7fbd7f35c640 1 --2- 172.21.15.42:0/1249276187 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd5c03d2b0 0x7fbd5c03f770 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbd68000c00 tx=0x7fbd68007910 comp rx=0 tx=0).stop 2024-05-08T18:53:44.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.175+0000 7fbd7f35c640 1 -- 172.21.15.42:0/1249276187 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd7809d490 msgr2=0x7fbd7811a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:44.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.175+0000 7fbd7f35c640 1 --2- 172.21.15.42:0/1249276187 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd7809d490 0x7fbd7811a310 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009840 tx=0x7fbd740046c0 comp rx=0 tx=0).stop 2024-05-08T18:53:44.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.175+0000 7fbd7f35c640 1 -- 172.21.15.42:0/1249276187 shutdown_connections 2024-05-08T18:53:44.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.175+0000 7fbd7f35c640 1 --2- 172.21.15.42:0/1249276187 >> [v2:172.21.15.42:6800/1521799280,v1:172.21.15.42:6801/1521799280] conn(0x7fbd5c049030 0x7fbd5c04b4d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:44.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.175+0000 7fbd7f35c640 1 --2- 172.21.15.42:0/1249276187 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbd5c03d2b0 0x7fbd5c03f770 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:44.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.175+0000 7fbd7f35c640 1 --2- 172.21.15.42:0/1249276187 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbd7809d490 0x7fbd7811a310 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:44.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.175+0000 7fbd7f35c640 1 -- 172.21.15.42:0/1249276187 >> 172.21.15.42:0/1249276187 conn(0x7fbd7806e160 msgr2=0x7fbd781b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:44.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.175+0000 7fbd7f35c640 1 -- 172.21.15.42:0/1249276187 shutdown_connections 2024-05-08T18:53:44.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.175+0000 7fbd7f35c640 1 -- 172.21.15.42:0/1249276187 wait complete. 2024-05-08T18:53:44.185 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-08T18:53:44.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.289+0000 7fcf3b57e640 1 Processor -- start 2024-05-08T18:53:44.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.289+0000 7fcf3b57e640 1 -- start start 2024-05-08T18:53:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.290+0000 7fcf3b57e640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcf34129560 0x7fcf341313d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.290+0000 7fcf3b57e640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf34072dc0 con 0x7fcf3406fe20 2024-05-08T18:53:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.290+0000 7fcf3b57e640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fcf341299f0 con 0x7fcf34129560 2024-05-08T18:53:44.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.290+0000 7fcf38b19640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcf34129560 0x7fcf341313d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:44.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.290+0000 7fcf38b19640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcf34129560 0x7fcf341313d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45822/0 (socket says 172.21.15.42:45822) 2024-05-08T18:53:44.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.290+0000 7fcf3931a640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fcf3406fe20 0x7fcf34128e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:47210/0 (socket says 172.21.15.42:47210) 2024-05-08T18:53:44.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.290+0000 7fcf38b19640 1 -- 172.21.15.42:0/963028960 learned_addr learned my addr 172.21.15.42:0/963028960 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:53:44.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.290+0000 7fcf38b19640 1 -- 172.21.15.42:0/963028960 >> v1:172.21.15.42:6789/0 conn(0x7fcf3406fe20 legacy=0x7fcf34128e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:44.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.290+0000 7fcf38b19640 1 -- 172.21.15.42:0/963028960 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf34128ad0 con 0x7fcf34129560 2024-05-08T18:53:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.291+0000 7fcf38b19640 1 --2- 172.21.15.42:0/963028960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf34129560 0x7fcf341313d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fcf240097f0 tx=0x7fcf2402b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783195939de17aab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.291+0000 7fcf2bfff640 1 -- 172.21.15.42:0/963028960 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf24035020 con 0x7fcf34129560 2024-05-08T18:53:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.291+0000 7fcf2bfff640 1 -- 172.21.15.42:0/963028960 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf240317c0 con 0x7fcf34129560 2024-05-08T18:53:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.291+0000 7fcf2bfff640 1 -- 172.21.15.42:0/963028960 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf24031ac0 con 0x7fcf34129560 2024-05-08T18:53:44.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.291+0000 7fcf3b57e640 1 -- 172.21.15.42:0/963028960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf34129560 msgr2=0x7fcf341313d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.291+0000 7fcf3b57e640 1 --2- 172.21.15.42:0/963028960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf34129560 0x7fcf341313d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fcf240097f0 tx=0x7fcf2402b930 comp rx=0 tx=0).stop 2024-05-08T18:53:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.291+0000 7fcf3b57e640 1 -- 172.21.15.42:0/963028960 shutdown_connections 2024-05-08T18:53:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.291+0000 7fcf3b57e640 1 --2- 172.21.15.42:0/963028960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf34129560 0x7fcf341313d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.292+0000 7fcf3b57e640 1 -- 172.21.15.42:0/963028960 >> 172.21.15.42:0/963028960 conn(0x7fcf3409a910 msgr2=0x7fcf3406e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.292+0000 7fcf3b57e640 1 -- 172.21.15.42:0/963028960 shutdown_connections 2024-05-08T18:53:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.292+0000 7fcf3b57e640 1 -- 172.21.15.42:0/963028960 wait complete. 2024-05-08T18:53:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.292+0000 7fcf3b57e640 1 Processor -- start 2024-05-08T18:53:44.292 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.292+0000 7fcf3b57e640 1 -- start start 2024-05-08T18:53:44.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.293+0000 7fcf3b57e640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf3406fe20 0x7fcf34114d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:44.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.293+0000 7fcf3b57e640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fcf34131910 con 0x7fcf3406fe20 2024-05-08T18:53:44.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.293+0000 7fcf3931a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf3406fe20 0x7fcf34114d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:44.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.293+0000 7fcf3931a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf3406fe20 0x7fcf34114d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45830/0 (socket says 172.21.15.42:45830) 2024-05-08T18:53:44.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.293+0000 7fcf3931a640 1 -- 172.21.15.42:0/2912394894 learned_addr learned my addr 172.21.15.42:0/2912394894 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:53:44.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.293+0000 7fcf3931a640 1 -- 172.21.15.42:0/2912394894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf34117d00 con 0x7fcf3406fe20 2024-05-08T18:53:44.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.293+0000 7fcf3931a640 1 --2- 172.21.15.42:0/2912394894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf3406fe20 0x7fcf34114d70 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fcf3000c380 tx=0x7fcf3000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:44.294 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.293+0000 7fcf29ffb640 1 -- 172.21.15.42:0/2912394894 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf30007410 con 0x7fcf3406fe20 2024-05-08T18:53:44.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.294+0000 7fcf29ffb640 1 -- 172.21.15.42:0/2912394894 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf300075b0 con 0x7fcf3406fe20 2024-05-08T18:53:44.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.294+0000 7fcf3b57e640 1 -- 172.21.15.42:0/2912394894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf34117560 con 0x7fcf3406fe20 2024-05-08T18:53:44.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.294+0000 7fcf29ffb640 1 -- 172.21.15.42:0/2912394894 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf300047e0 con 0x7fcf3406fe20 2024-05-08T18:53:44.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.294+0000 7fcf3b57e640 1 -- 172.21.15.42:0/2912394894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf341152b0 con 0x7fcf3406fe20 2024-05-08T18:53:44.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.295+0000 7fcf29ffb640 1 -- 172.21.15.42:0/2912394894 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fcf3001a020 con 0x7fcf3406fe20 2024-05-08T18:53:44.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.295+0000 7fcf3b57e640 1 -- 172.21.15.42:0/2912394894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf34064010 con 0x7fcf3406fe20 2024-05-08T18:53:44.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.295+0000 7fcf29ffb640 1 --2- 172.21.15.42:0/2912394894 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcf1803d2b0 0x7fcf1803f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:44.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.295+0000 7fcf29ffb640 1 -- 172.21.15.42:0/2912394894 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fcf300514a0 con 0x7fcf3406fe20 2024-05-08T18:53:44.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.295+0000 7fcf38b19640 1 --2- 172.21.15.42:0/2912394894 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcf1803d2b0 0x7fcf1803f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:44.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.296+0000 7fcf38b19640 1 --2- 172.21.15.42:0/2912394894 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcf1803d2b0 0x7fcf1803f770 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcf24036000 tx=0x7fcf24008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:44.298 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.300+0000 7fcf29ffb640 1 -- 172.21.15.42:0/2912394894 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fcf300113a0 con 0x7fcf3406fe20 2024-05-08T18:53:44.488 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.489+0000 7fcf3b57e640 1 -- 172.21.15.42:0/2912394894 --> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fcf34073aa0 con 0x7fcf1803d2b0 2024-05-08T18:53:44.489 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.490+0000 7fcf29ffb640 1 -- 172.21.15.42:0/2912394894 <== mgr.4102 v2:172.21.15.132:6824/2104266563 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcf34073aa0 con 0x7fcf1803d2b0 2024-05-08T18:53:44.489 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 0 to deep-scrub 2024-05-08T18:53:44.491 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.492+0000 7fcf3b57e640 1 -- 172.21.15.42:0/2912394894 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcf1803d2b0 msgr2=0x7fcf1803f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:44.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.492+0000 7fcf3b57e640 1 --2- 172.21.15.42:0/2912394894 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcf1803d2b0 0x7fcf1803f770 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcf24036000 tx=0x7fcf24008030 comp rx=0 tx=0).stop 2024-05-08T18:53:44.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.492+0000 7fcf3b57e640 1 -- 172.21.15.42:0/2912394894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf3406fe20 msgr2=0x7fcf34114d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:44.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.492+0000 7fcf3b57e640 1 --2- 172.21.15.42:0/2912394894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf3406fe20 0x7fcf34114d70 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fcf3000c380 tx=0x7fcf3000c840 comp rx=0 tx=0).stop 2024-05-08T18:53:44.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.492+0000 7fcf3b57e640 1 -- 172.21.15.42:0/2912394894 shutdown_connections 2024-05-08T18:53:44.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.492+0000 7fcf3b57e640 1 --2- 172.21.15.42:0/2912394894 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fcf1803d2b0 0x7fcf1803f770 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:44.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.492+0000 7fcf3b57e640 1 --2- 172.21.15.42:0/2912394894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf3406fe20 0x7fcf34114d70 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:44.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.492+0000 7fcf3b57e640 1 -- 172.21.15.42:0/2912394894 >> 172.21.15.42:0/2912394894 conn(0x7fcf3409a910 msgr2=0x7fcf340706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:44.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.492+0000 7fcf3b57e640 1 -- 172.21.15.42:0/2912394894 shutdown_connections 2024-05-08T18:53:44.492 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.492+0000 7fcf3b57e640 1 -- 172.21.15.42:0/2912394894 wait complete. 2024-05-08T18:53:44.502 INFO:tasks.ceph:Scrubbing osd.1 2024-05-08T18:53:44.502 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:53:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.609+0000 7fbfdee9c640 1 Processor -- start 2024-05-08T18:53:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.609+0000 7fbfdee9c640 1 -- start start 2024-05-08T18:53:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.609+0000 7fbfdee9c640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbfd8130460 0x7fbfd8132850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.609+0000 7fbfdee9c640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfd812d270 con 0x7fbfd812d470 2024-05-08T18:53:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.609+0000 7fbfdee9c640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fbfd8073600 con 0x7fbfd8130460 2024-05-08T18:53:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.610+0000 7fbfd7fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbfd8130460 0x7fbfd8132850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.610+0000 7fbfdcc38640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fbfd812d470 0x7fbfd812d850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:47218/0 (socket says 172.21.15.42:47218) 2024-05-08T18:53:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.610+0000 7fbfdcc38640 1 -- 172.21.15.42:0/2457193510 learned_addr learned my addr 172.21.15.42:0/2457193510 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:53:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.610+0000 7fbfd7fff640 1 -- 172.21.15.42:0/2457193510 >> v1:172.21.15.42:6789/0 conn(0x7fbfd812d470 legacy=0x7fbfd812d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:44.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.610+0000 7fbfd7fff640 1 -- 172.21.15.42:0/2457193510 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd8113ca0 con 0x7fbfd8130460 2024-05-08T18:53:44.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.611+0000 7fbfd7fff640 1 --2- 172.21.15.42:0/2457193510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbfd8130460 0x7fbfd8132850 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4009720 tx=0x7fbfc402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4def159edf2df380 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:44.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.611+0000 7fbfd77fe640 1 -- 172.21.15.42:0/2457193510 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfc40316d0 con 0x7fbfd8130460 2024-05-08T18:53:44.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.611+0000 7fbfd77fe640 1 -- 172.21.15.42:0/2457193510 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfc4037070 con 0x7fbfd8130460 2024-05-08T18:53:44.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.611+0000 7fbfd77fe640 1 -- 172.21.15.42:0/2457193510 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfc40319c0 con 0x7fbfd8130460 2024-05-08T18:53:44.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.611+0000 7fbfdee9c640 1 -- 172.21.15.42:0/2457193510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbfd8130460 msgr2=0x7fbfd8132850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:44.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.611+0000 7fbfdee9c640 1 --2- 172.21.15.42:0/2457193510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbfd8130460 0x7fbfd8132850 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4009720 tx=0x7fbfc402b840 comp rx=0 tx=0).stop 2024-05-08T18:53:44.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.611+0000 7fbfdee9c640 1 -- 172.21.15.42:0/2457193510 shutdown_connections 2024-05-08T18:53:44.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.611+0000 7fbfdee9c640 1 --2- 172.21.15.42:0/2457193510 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbfd8130460 0x7fbfd8132850 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:44.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.611+0000 7fbfdee9c640 1 -- 172.21.15.42:0/2457193510 >> 172.21.15.42:0/2457193510 conn(0x7fbfd809a330 msgr2=0x7fbfd809a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:44.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.611+0000 7fbfdee9c640 1 -- 172.21.15.42:0/2457193510 shutdown_connections 2024-05-08T18:53:44.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.611+0000 7fbfdee9c640 1 -- 172.21.15.42:0/2457193510 wait complete. 2024-05-08T18:53:44.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.612+0000 7fbfdee9c640 1 Processor -- start 2024-05-08T18:53:44.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.612+0000 7fbfdee9c640 1 -- start start 2024-05-08T18:53:44.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.613+0000 7fbfdee9c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbfd812d470 0x7fbfd8114fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:44.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.613+0000 7fbfdee9c640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd8114870 con 0x7fbfd812d470 2024-05-08T18:53:44.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.613+0000 7fbfdcc38640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbfd812d470 0x7fbfd8114fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:44.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.613+0000 7fbfdcc38640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbfd812d470 0x7fbfd8114fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45838/0 (socket says 172.21.15.42:45838) 2024-05-08T18:53:44.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.613+0000 7fbfdcc38640 1 -- 172.21.15.42:0/1186009340 learned_addr learned my addr 172.21.15.42:0/1186009340 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:53:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.613+0000 7fbfdcc38640 1 -- 172.21.15.42:0/1186009340 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd8129ea0 con 0x7fbfd812d470 2024-05-08T18:53:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.613+0000 7fbfdcc38640 1 --2- 172.21.15.42:0/1186009340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbfd812d470 0x7fbfd8114fc0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00c4a0 tx=0x7fbfcc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.613+0000 7fbfd57fa640 1 -- 172.21.15.42:0/1186009340 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc017070 con 0x7fbfd812d470 2024-05-08T18:53:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.613+0000 7fbfd57fa640 1 -- 172.21.15.42:0/1186009340 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfcc005c10 con 0x7fbfd812d470 2024-05-08T18:53:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.613+0000 7fbfdee9c640 1 -- 172.21.15.42:0/1186009340 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfd812a560 con 0x7fbfd812d470 2024-05-08T18:53:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.613+0000 7fbfd57fa640 1 -- 172.21.15.42:0/1186009340 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbfcc007070 con 0x7fbfd812d470 2024-05-08T18:53:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.613+0000 7fbfdee9c640 1 -- 172.21.15.42:0/1186009340 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfd8117610 con 0x7fbfd812d470 2024-05-08T18:53:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.614+0000 7fbfdee9c640 1 -- 172.21.15.42:0/1186009340 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbfd81169c0 con 0x7fbfd812d470 2024-05-08T18:53:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.614+0000 7fbfd57fa640 1 -- 172.21.15.42:0/1186009340 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fbfcc01a070 con 0x7fbfd812d470 2024-05-08T18:53:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.615+0000 7fbfd57fa640 1 --2- 172.21.15.42:0/1186009340 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbfbc03d2b0 0x7fbfbc03f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.615+0000 7fbfd57fa640 1 -- 172.21.15.42:0/1186009340 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fbfcc050f90 con 0x7fbfd812d470 2024-05-08T18:53:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.615+0000 7fbfd57fa640 1 --2- 172.21.15.42:0/1186009340 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x7fbfbc0490b0 0x7fbfbc04b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:44.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.615+0000 7fbfd57fa640 1 -- 172.21.15.42:0/1186009340 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbfcc014ec0 con 0x7fbfbc0490b0 2024-05-08T18:53:44.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.615+0000 7fbfd57fa640 1 -- 172.21.15.42:0/1186009340 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fbfcc0535e0 con 0x7fbfd812d470 2024-05-08T18:53:44.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.615+0000 7fbfd7fff640 1 --2- 172.21.15.42:0/1186009340 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbfbc03d2b0 0x7fbfbc03f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:44.616 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.615+0000 7fbfdd439640 1 --2- 172.21.15.42:0/1186009340 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x7fbfbc0490b0 0x7fbfbc04b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:44.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.616+0000 7fbfd7fff640 1 --2- 172.21.15.42:0/1186009340 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbfbc03d2b0 0x7fbfbc03f770 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4036000 tx=0x7fbfc4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:44.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.616+0000 7fbfdd439640 1 --2- 172.21.15.42:0/1186009340 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x7fbfbc0490b0 0x7fbfbc04b550 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:44.617 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.616+0000 7fbfd57fa640 1 -- 172.21.15.42:0/1186009340 <== osd.1 v2:172.21.15.132:6800/3697320277 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbfcc014ec0 con 0x7fbfbc0490b0 2024-05-08T18:53:44.628 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.629+0000 7fbfdee9c640 1 -- 172.21.15.42:0/1186009340 --> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbfd8064010 con 0x7fbfbc0490b0 2024-05-08T18:53:44.629 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.630+0000 7fbfd57fa640 1 -- 172.21.15.42:0/1186009340 <== osd.1 v2:172.21.15.132:6800/3697320277 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbfd8064010 con 0x7fbfbc0490b0 2024-05-08T18:53:44.629 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-08T18:53:44.629 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:53:44.629 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-08T18:53:44.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.630+0000 7fbfdee9c640 1 -- 172.21.15.42:0/1186009340 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x7fbfbc0490b0 msgr2=0x7fbfbc04b550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:44.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.630+0000 7fbfdee9c640 1 --2- 172.21.15.42:0/1186009340 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x7fbfbc0490b0 0x7fbfbc04b550 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:44.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.630+0000 7fbfdee9c640 1 -- 172.21.15.42:0/1186009340 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbfbc03d2b0 msgr2=0x7fbfbc03f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:44.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.630+0000 7fbfdee9c640 1 --2- 172.21.15.42:0/1186009340 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbfbc03d2b0 0x7fbfbc03f770 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4036000 tx=0x7fbfc4008030 comp rx=0 tx=0).stop 2024-05-08T18:53:44.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.630+0000 7fbfdee9c640 1 -- 172.21.15.42:0/1186009340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbfd812d470 msgr2=0x7fbfd8114fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:44.630 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.630+0000 7fbfdee9c640 1 --2- 172.21.15.42:0/1186009340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbfd812d470 0x7fbfd8114fc0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00c4a0 tx=0x7fbfcc00c960 comp rx=0 tx=0).stop 2024-05-08T18:53:44.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.630+0000 7fbfdee9c640 1 -- 172.21.15.42:0/1186009340 shutdown_connections 2024-05-08T18:53:44.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.630+0000 7fbfdee9c640 1 --2- 172.21.15.42:0/1186009340 >> [v2:172.21.15.132:6800/3697320277,v1:172.21.15.132:6801/3697320277] conn(0x7fbfbc0490b0 0x7fbfbc04b550 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:44.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.630+0000 7fbfdee9c640 1 --2- 172.21.15.42:0/1186009340 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fbfbc03d2b0 0x7fbfbc03f770 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:44.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.630+0000 7fbfdee9c640 1 --2- 172.21.15.42:0/1186009340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbfd812d470 0x7fbfd8114fc0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:44.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.630+0000 7fbfdee9c640 1 -- 172.21.15.42:0/1186009340 >> 172.21.15.42:0/1186009340 conn(0x7fbfd809a330 msgr2=0x7fbfd812bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:44.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.630+0000 7fbfdee9c640 1 -- 172.21.15.42:0/1186009340 shutdown_connections 2024-05-08T18:53:44.631 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.630+0000 7fbfdee9c640 1 -- 172.21.15.42:0/1186009340 wait complete. 2024-05-08T18:53:44.639 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-08T18:53:44.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.744+0000 7f931452b640 1 Processor -- start 2024-05-08T18:53:44.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.744+0000 7f931452b640 1 -- start start 2024-05-08T18:53:44.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.744+0000 7f931452b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f930c06fe20 0x7f930c128e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:44.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.744+0000 7f931452b640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f930c072dc0 con 0x7f930c129390 2024-05-08T18:53:44.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.744+0000 7f931452b640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f930c128ad0 con 0x7f930c06fe20 2024-05-08T18:53:44.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.745+0000 7f93122c7640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f930c06fe20 0x7f930c128e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:44.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.745+0000 7f9311ac6640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f930c129390 0x7f930c12c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:47226/0 (socket says 172.21.15.42:47226) 2024-05-08T18:53:44.744 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.745+0000 7f9311ac6640 1 -- 172.21.15.42:0/2967995238 learned_addr learned my addr 172.21.15.42:0/2967995238 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:53:44.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.745+0000 7f93122c7640 1 -- 172.21.15.42:0/2967995238 >> v1:172.21.15.42:6789/0 conn(0x7f930c129390 legacy=0x7f930c12c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:44.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.745+0000 7f93122c7640 1 -- 172.21.15.42:0/2967995238 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930c0739e0 con 0x7f930c06fe20 2024-05-08T18:53:44.745 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.745+0000 7f93112c5640 1 -- 172.21.15.42:0/2967995238 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3808975822 0 0) 0x7f930c072dc0 con 0x7f930c129390 2024-05-08T18:53:44.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.746+0000 7f93122c7640 1 --2- 172.21.15.42:0/2967995238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f930c06fe20 0x7f930c128e50 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f9300009720 tx=0x7f930002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd095b552e749a6f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:44.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.746+0000 7f93112c5640 1 -- 172.21.15.42:0/2967995238 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93000316d0 con 0x7f930c06fe20 2024-05-08T18:53:44.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.746+0000 7f93112c5640 1 -- 172.21.15.42:0/2967995238 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9300037070 con 0x7f930c06fe20 2024-05-08T18:53:44.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.746+0000 7f93112c5640 1 -- 172.21.15.42:0/2967995238 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93000319c0 con 0x7f930c06fe20 2024-05-08T18:53:44.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.746+0000 7f931452b640 1 -- 172.21.15.42:0/2967995238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f930c06fe20 msgr2=0x7f930c128e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:44.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.746+0000 7f931452b640 1 --2- 172.21.15.42:0/2967995238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f930c06fe20 0x7f930c128e50 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f9300009720 tx=0x7f930002b840 comp rx=0 tx=0).stop 2024-05-08T18:53:44.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.746+0000 7f931452b640 1 -- 172.21.15.42:0/2967995238 shutdown_connections 2024-05-08T18:53:44.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.746+0000 7f931452b640 1 --2- 172.21.15.42:0/2967995238 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f930c06fe20 0x7f930c128e50 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:44.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.746+0000 7f931452b640 1 -- 172.21.15.42:0/2967995238 >> 172.21.15.42:0/2967995238 conn(0x7f930c09a910 msgr2=0x7f930c06e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:44.747 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.746+0000 7f931452b640 1 -- 172.21.15.42:0/2967995238 shutdown_connections 2024-05-08T18:53:44.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.746+0000 7f931452b640 1 -- 172.21.15.42:0/2967995238 wait complete. 2024-05-08T18:53:44.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.747+0000 7f931452b640 1 Processor -- start 2024-05-08T18:53:44.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.747+0000 7f931452b640 1 -- start start 2024-05-08T18:53:44.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.748+0000 7f931452b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f930c06fe20 0x7f930c129e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:44.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.748+0000 7f931452b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f930c1299a0 con 0x7f930c06fe20 2024-05-08T18:53:44.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.748+0000 7f93122c7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f930c06fe20 0x7f930c129e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:44.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.748+0000 7f93122c7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f930c06fe20 0x7f930c129e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45852/0 (socket says 172.21.15.42:45852) 2024-05-08T18:53:44.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.748+0000 7f93122c7640 1 -- 172.21.15.42:0/3898753043 learned_addr learned my addr 172.21.15.42:0/3898753043 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:53:44.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.748+0000 7f93122c7640 1 -- 172.21.15.42:0/3898753043 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930c12b210 con 0x7f930c06fe20 2024-05-08T18:53:44.749 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.748+0000 7f93122c7640 1 --2- 172.21.15.42:0/3898753043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f930c06fe20 0x7f930c129e30 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f9300034040 tx=0x7f93000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:44.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.748+0000 7f92feffd640 1 -- 172.21.15.42:0/3898753043 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9300032770 con 0x7f930c06fe20 2024-05-08T18:53:44.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.748+0000 7f92feffd640 1 -- 172.21.15.42:0/3898753043 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9300032910 con 0x7f930c06fe20 2024-05-08T18:53:44.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.748+0000 7f931452b640 1 -- 172.21.15.42:0/3898753043 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f930c12afd0 con 0x7f930c06fe20 2024-05-08T18:53:44.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.748+0000 7f92feffd640 1 -- 172.21.15.42:0/3898753043 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9300032c30 con 0x7f930c06fe20 2024-05-08T18:53:44.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.748+0000 7f931452b640 1 -- 172.21.15.42:0/3898753043 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f930c12bc60 con 0x7f930c06fe20 2024-05-08T18:53:44.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.749+0000 7f92feffd640 1 -- 172.21.15.42:0/3898753043 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f930004c060 con 0x7f930c06fe20 2024-05-08T18:53:44.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.749+0000 7f931452b640 1 -- 172.21.15.42:0/3898753043 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f930c064010 con 0x7f930c06fe20 2024-05-08T18:53:44.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.750+0000 7f92feffd640 1 --2- 172.21.15.42:0/3898753043 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f92f003d2b0 0x7f92f003f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:44.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.750+0000 7f92feffd640 1 -- 172.21.15.42:0/3898753043 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f930002f050 con 0x7f930c06fe20 2024-05-08T18:53:44.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.750+0000 7f9311ac6640 1 --2- 172.21.15.42:0/3898753043 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f92f003d2b0 0x7f92f003f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:44.750 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.750+0000 7f9311ac6640 1 --2- 172.21.15.42:0/3898753043 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f92f003d2b0 0x7f92f003f770 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9308000c00 tx=0x7f9308007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:44.753 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.754+0000 7f92feffd640 1 -- 172.21.15.42:0/3898753043 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9300040070 con 0x7f930c06fe20 2024-05-08T18:53:44.944 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.945+0000 7f931452b640 1 -- 172.21.15.42:0/3898753043 --> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f930c09c830 con 0x7f92f003d2b0 2024-05-08T18:53:44.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.946+0000 7f92feffd640 1 -- 172.21.15.42:0/3898753043 <== mgr.4102 v2:172.21.15.132:6824/2104266563 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f930c09c830 con 0x7f92f003d2b0 2024-05-08T18:53:44.945 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 1 to deep-scrub 2024-05-08T18:53:44.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.949+0000 7f931452b640 1 -- 172.21.15.42:0/3898753043 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f92f003d2b0 msgr2=0x7f92f003f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:44.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.949+0000 7f931452b640 1 --2- 172.21.15.42:0/3898753043 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f92f003d2b0 0x7f92f003f770 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9308000c00 tx=0x7f9308007970 comp rx=0 tx=0).stop 2024-05-08T18:53:44.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.949+0000 7f931452b640 1 -- 172.21.15.42:0/3898753043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f930c06fe20 msgr2=0x7f930c129e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:44.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.949+0000 7f931452b640 1 --2- 172.21.15.42:0/3898753043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f930c06fe20 0x7f930c129e30 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f9300034040 tx=0x7f93000046c0 comp rx=0 tx=0).stop 2024-05-08T18:53:44.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.949+0000 7f931452b640 1 -- 172.21.15.42:0/3898753043 shutdown_connections 2024-05-08T18:53:44.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.949+0000 7f931452b640 1 --2- 172.21.15.42:0/3898753043 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f92f003d2b0 0x7f92f003f770 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:44.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.949+0000 7f931452b640 1 --2- 172.21.15.42:0/3898753043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f930c06fe20 0x7f930c129e30 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:44.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.949+0000 7f931452b640 1 -- 172.21.15.42:0/3898753043 >> 172.21.15.42:0/3898753043 conn(0x7f930c09a910 msgr2=0x7f930c0706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:44.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.949+0000 7f931452b640 1 -- 172.21.15.42:0/3898753043 shutdown_connections 2024-05-08T18:53:44.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:44.949+0000 7f931452b640 1 -- 172.21.15.42:0/3898753043 wait complete. 2024-05-08T18:53:44.959 INFO:tasks.ceph:Scrubbing osd.2 2024-05-08T18:53:44.959 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:53:45.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.066+0000 7fb6b29a4640 1 Processor -- start 2024-05-08T18:53:45.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.066+0000 7fb6b29a4640 1 -- start start 2024-05-08T18:53:45.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.067+0000 7fb6b29a4640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb6ac12e6f0 0x7fb6ac12ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:45.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.067+0000 7fb6b29a4640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6ac06eec0 con 0x7fb6ac09d490 2024-05-08T18:53:45.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.067+0000 7fb6b29a4640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fb6ac09adc0 con 0x7fb6ac12e6f0 2024-05-08T18:53:45.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.067+0000 7fb6abfff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb6ac12e6f0 0x7fb6ac12ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:45.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.067+0000 7fb6ab7fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fb6ac09d490 0x7fb6ac09d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:47234/0 (socket says 172.21.15.42:47234) 2024-05-08T18:53:45.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.067+0000 7fb6ab7fe640 1 -- 172.21.15.42:0/1572684778 learned_addr learned my addr 172.21.15.42:0/1572684778 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:53:45.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.067+0000 7fb6abfff640 1 -- 172.21.15.42:0/1572684778 >> v1:172.21.15.42:6789/0 conn(0x7fb6ac09d490 legacy=0x7fb6ac09d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:45.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.067+0000 7fb6aaffd640 1 -- 172.21.15.42:0/1572684778 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3032706276 0 0) 0x7fb6ac06eec0 con 0x7fb6ac09d490 2024-05-08T18:53:45.067 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.067+0000 7fb6abfff640 1 -- 172.21.15.42:0/1572684778 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6ac09b300 con 0x7fb6ac12e6f0 2024-05-08T18:53:45.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.068+0000 7fb6abfff640 1 --2- 172.21.15.42:0/1572684778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6ac12e6f0 0x7fb6ac12ead0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fb69c009720 tx=0x7fb69c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6fdafef56836b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:45.070 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.068+0000 7fb6aaffd640 1 -- 172.21.15.42:0/1572684778 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb69c0316d0 con 0x7fb6ac12e6f0 2024-05-08T18:53:45.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.068+0000 7fb6aaffd640 1 -- 172.21.15.42:0/1572684778 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb69c037070 con 0x7fb6ac12e6f0 2024-05-08T18:53:45.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.068+0000 7fb6aaffd640 1 -- 172.21.15.42:0/1572684778 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb69c0319c0 con 0x7fb6ac12e6f0 2024-05-08T18:53:45.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.069+0000 7fb6b29a4640 1 -- 172.21.15.42:0/1572684778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6ac12e6f0 msgr2=0x7fb6ac12ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:45.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.069+0000 7fb6b29a4640 1 --2- 172.21.15.42:0/1572684778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6ac12e6f0 0x7fb6ac12ead0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fb69c009720 tx=0x7fb69c02b840 comp rx=0 tx=0).stop 2024-05-08T18:53:45.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.069+0000 7fb6b29a4640 1 -- 172.21.15.42:0/1572684778 shutdown_connections 2024-05-08T18:53:45.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.069+0000 7fb6b29a4640 1 --2- 172.21.15.42:0/1572684778 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6ac12e6f0 0x7fb6ac12ead0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:45.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.069+0000 7fb6b29a4640 1 -- 172.21.15.42:0/1572684778 >> 172.21.15.42:0/1572684778 conn(0x7fb6ac06e160 msgr2=0x7fb6ac06e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:45.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.069+0000 7fb6b29a4640 1 -- 172.21.15.42:0/1572684778 shutdown_connections 2024-05-08T18:53:45.071 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.069+0000 7fb6b29a4640 1 -- 172.21.15.42:0/1572684778 wait complete. 2024-05-08T18:53:45.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.069+0000 7fb6b29a4640 1 Processor -- start 2024-05-08T18:53:45.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.070+0000 7fb6b29a4640 1 -- start start 2024-05-08T18:53:45.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.070+0000 7fb6b29a4640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6ac09d490 0x7fb6ac11a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:45.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.070+0000 7fb6b29a4640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fb6ac09a440 con 0x7fb6ac09d490 2024-05-08T18:53:45.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.070+0000 7fb6abfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6ac09d490 0x7fb6ac11a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:45.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.070+0000 7fb6abfff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6ac09d490 0x7fb6ac11a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45862/0 (socket says 172.21.15.42:45862) 2024-05-08T18:53:45.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.070+0000 7fb6abfff640 1 -- 172.21.15.42:0/1363203370 learned_addr learned my addr 172.21.15.42:0/1363203370 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:53:45.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.070+0000 7fb6abfff640 1 -- 172.21.15.42:0/1363203370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6ac11d730 con 0x7fb6ac09d490 2024-05-08T18:53:45.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.071+0000 7fb6abfff640 1 --2- 172.21.15.42:0/1363203370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6ac09d490 0x7fb6ac11a670 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb69c034040 tx=0x7fb69c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:45.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.071+0000 7fb6a8ff9640 1 -- 172.21.15.42:0/1363203370 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb69c032770 con 0x7fb6ac09d490 2024-05-08T18:53:45.072 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.071+0000 7fb6a8ff9640 1 -- 172.21.15.42:0/1363203370 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb69c032910 con 0x7fb6ac09d490 2024-05-08T18:53:45.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.071+0000 7fb6a8ff9640 1 -- 172.21.15.42:0/1363203370 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb69c032c30 con 0x7fb6ac09d490 2024-05-08T18:53:45.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.071+0000 7fb6b29a4640 1 -- 172.21.15.42:0/1363203370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6ac11ca90 con 0x7fb6ac09d490 2024-05-08T18:53:45.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.071+0000 7fb6b29a4640 1 -- 172.21.15.42:0/1363203370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6ac11abb0 con 0x7fb6ac09d490 2024-05-08T18:53:45.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.072+0000 7fb6b29a4640 1 -- 172.21.15.42:0/1363203370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb6ac064010 con 0x7fb6ac09d490 2024-05-08T18:53:45.073 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.072+0000 7fb6a8ff9640 1 -- 172.21.15.42:0/1363203370 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fb69c04c060 con 0x7fb6ac09d490 2024-05-08T18:53:45.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.072+0000 7fb6a8ff9640 1 --2- 172.21.15.42:0/1363203370 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb69803d2b0 0x7fb69803f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:45.074 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.072+0000 7fb6a8ff9640 1 -- 172.21.15.42:0/1363203370 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fb69c02f050 con 0x7fb6ac09d490 2024-05-08T18:53:45.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.072+0000 7fb6a8ff9640 1 --2- 172.21.15.42:0/1363203370 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb6980490b0 0x7fb69804b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:45.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.072+0000 7fb6a8ff9640 1 -- 172.21.15.42:0/1363203370 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb69c04cec0 con 0x7fb6980490b0 2024-05-08T18:53:45.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.072+0000 7fb6a8ff9640 1 -- 172.21.15.42:0/1363203370 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb69c07a050 con 0x7fb6ac09d490 2024-05-08T18:53:45.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.072+0000 7fb6ab7fe640 1 --2- 172.21.15.42:0/1363203370 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb69803d2b0 0x7fb69803f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:45.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.073+0000 7fb6b0f41640 1 --2- 172.21.15.42:0/1363203370 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb6980490b0 0x7fb69804b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:45.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.073+0000 7fb6ab7fe640 1 --2- 172.21.15.42:0/1363203370 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb69803d2b0 0x7fb69803f770 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0000c00 tx=0x7fb6a0007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:45.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.073+0000 7fb6b0f41640 1 --2- 172.21.15.42:0/1363203370 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb6980490b0 0x7fb69804b550 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:45.075 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.074+0000 7fb6a8ff9640 1 -- 172.21.15.42:0/1363203370 <== osd.2 v2:172.21.15.132:6808/1108348591 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb69c04cec0 con 0x7fb6980490b0 2024-05-08T18:53:45.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.087+0000 7fb6b29a4640 1 -- 172.21.15.42:0/1363203370 --> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb6ac12cc50 con 0x7fb6980490b0 2024-05-08T18:53:45.086 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.087+0000 7fb6a8ff9640 1 -- 172.21.15.42:0/1363203370 <== osd.2 v2:172.21.15.132:6808/1108348591 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb6ac12cc50 con 0x7fb6980490b0 2024-05-08T18:53:45.086 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-08T18:53:45.087 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:53:45.087 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-08T18:53:45.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.088+0000 7fb6b29a4640 1 -- 172.21.15.42:0/1363203370 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb6980490b0 msgr2=0x7fb69804b550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:45.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.088+0000 7fb6b29a4640 1 --2- 172.21.15.42:0/1363203370 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb6980490b0 0x7fb69804b550 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:45.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.088+0000 7fb6b29a4640 1 -- 172.21.15.42:0/1363203370 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb69803d2b0 msgr2=0x7fb69803f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:45.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.088+0000 7fb6b29a4640 1 --2- 172.21.15.42:0/1363203370 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb69803d2b0 0x7fb69803f770 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0000c00 tx=0x7fb6a0007910 comp rx=0 tx=0).stop 2024-05-08T18:53:45.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.088+0000 7fb6b29a4640 1 -- 172.21.15.42:0/1363203370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6ac09d490 msgr2=0x7fb6ac11a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:45.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.088+0000 7fb6b29a4640 1 --2- 172.21.15.42:0/1363203370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6ac09d490 0x7fb6ac11a670 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb69c034040 tx=0x7fb69c0046c0 comp rx=0 tx=0).stop 2024-05-08T18:53:45.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.088+0000 7fb6b29a4640 1 -- 172.21.15.42:0/1363203370 shutdown_connections 2024-05-08T18:53:45.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.088+0000 7fb6b29a4640 1 --2- 172.21.15.42:0/1363203370 >> [v2:172.21.15.132:6808/1108348591,v1:172.21.15.132:6809/1108348591] conn(0x7fb6980490b0 0x7fb69804b550 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:45.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.088+0000 7fb6b29a4640 1 --2- 172.21.15.42:0/1363203370 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fb69803d2b0 0x7fb69803f770 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:45.088 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.088+0000 7fb6b29a4640 1 --2- 172.21.15.42:0/1363203370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6ac09d490 0x7fb6ac11a670 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:45.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.088+0000 7fb6b29a4640 1 -- 172.21.15.42:0/1363203370 >> 172.21.15.42:0/1363203370 conn(0x7fb6ac06e160 msgr2=0x7fb6ac1b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:45.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.088+0000 7fb6b29a4640 1 -- 172.21.15.42:0/1363203370 shutdown_connections 2024-05-08T18:53:45.089 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.088+0000 7fb6b29a4640 1 -- 172.21.15.42:0/1363203370 wait complete. 2024-05-08T18:53:45.097 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-08T18:53:45.201 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.201+0000 7f922635b640 1 Processor -- start 2024-05-08T18:53:45.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.202+0000 7f922635b640 1 -- start start 2024-05-08T18:53:45.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.202+0000 7f922635b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f922012c7f0 0x7f922012cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:45.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.202+0000 7f922635b640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92200a23e0 con 0x7f9220070850 2024-05-08T18:53:45.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.202+0000 7f922635b640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f9220072fc0 con 0x7f922012c7f0 2024-05-08T18:53:45.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.202+0000 7f921ffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f922012c7f0 0x7f922012cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:45.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.202+0000 7f921f7fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f9220070850 0x7f9220070ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:47250/0 (socket says 172.21.15.42:47250) 2024-05-08T18:53:45.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.202+0000 7f921ffff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f922012c7f0 0x7f922012cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45872/0 (socket says 172.21.15.42:45872) 2024-05-08T18:53:45.202 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.202+0000 7f921f7fe640 1 -- 172.21.15.42:0/70449751 learned_addr learned my addr 172.21.15.42:0/70449751 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:53:45.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.202+0000 7f921ffff640 1 -- 172.21.15.42:0/70449751 >> v1:172.21.15.42:6789/0 conn(0x7f9220070850 legacy=0x7f9220070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:45.203 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.202+0000 7f921ffff640 1 -- 172.21.15.42:0/70449751 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9220071f80 con 0x7f922012c7f0 2024-05-08T18:53:45.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.203+0000 7f921ffff640 1 --2- 172.21.15.42:0/70449751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f922012c7f0 0x7f922012cbd0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f9210009720 tx=0x7f921002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8065fa714e0f64 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:45.206 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.203+0000 7f921effd640 1 -- 172.21.15.42:0/70449751 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92100316d0 con 0x7f922012c7f0 2024-05-08T18:53:45.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.203+0000 7f921effd640 1 -- 172.21.15.42:0/70449751 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9210037070 con 0x7f922012c7f0 2024-05-08T18:53:45.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.203+0000 7f921effd640 1 -- 172.21.15.42:0/70449751 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92100319c0 con 0x7f922012c7f0 2024-05-08T18:53:45.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.204+0000 7f922635b640 1 -- 172.21.15.42:0/70449751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f922012c7f0 msgr2=0x7f922012cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:45.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.204+0000 7f922635b640 1 --2- 172.21.15.42:0/70449751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f922012c7f0 0x7f922012cbd0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f9210009720 tx=0x7f921002b840 comp rx=0 tx=0).stop 2024-05-08T18:53:45.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.204+0000 7f922635b640 1 -- 172.21.15.42:0/70449751 shutdown_connections 2024-05-08T18:53:45.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.204+0000 7f922635b640 1 --2- 172.21.15.42:0/70449751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f922012c7f0 0x7f922012cbd0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:45.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.204+0000 7f922635b640 1 -- 172.21.15.42:0/70449751 >> 172.21.15.42:0/70449751 conn(0x7f922009ff90 msgr2=0x7f92200a1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:45.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.204+0000 7f922635b640 1 -- 172.21.15.42:0/70449751 shutdown_connections 2024-05-08T18:53:45.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.204+0000 7f922635b640 1 -- 172.21.15.42:0/70449751 wait complete. 2024-05-08T18:53:45.207 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.205+0000 7f922635b640 1 Processor -- start 2024-05-08T18:53:45.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.205+0000 7f922635b640 1 -- start start 2024-05-08T18:53:45.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.205+0000 7f922635b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9220070850 0x7f922011a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:45.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.205+0000 7f922635b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f9220071530 con 0x7f9220070850 2024-05-08T18:53:45.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.205+0000 7f921ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9220070850 0x7f922011a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:45.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.206+0000 7f921ffff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9220070850 0x7f922011a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45876/0 (socket says 172.21.15.42:45876) 2024-05-08T18:53:45.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.206+0000 7f921ffff640 1 -- 172.21.15.42:0/626430043 learned_addr learned my addr 172.21.15.42:0/626430043 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:53:45.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.206+0000 7f921ffff640 1 -- 172.21.15.42:0/626430043 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922011d550 con 0x7f9220070850 2024-05-08T18:53:45.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.206+0000 7f921ffff640 1 --2- 172.21.15.42:0/626430043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9220070850 0x7f922011a440 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f9210034040 tx=0x7f92100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:45.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.206+0000 7f921cff9640 1 -- 172.21.15.42:0/626430043 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9210032770 con 0x7f9220070850 2024-05-08T18:53:45.208 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.206+0000 7f921cff9640 1 -- 172.21.15.42:0/626430043 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9210032910 con 0x7f9220070850 2024-05-08T18:53:45.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.206+0000 7f922635b640 1 -- 172.21.15.42:0/626430043 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f922011d990 con 0x7f9220070850 2024-05-08T18:53:45.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.206+0000 7f921cff9640 1 -- 172.21.15.42:0/626430043 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9210032c30 con 0x7f9220070850 2024-05-08T18:53:45.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.206+0000 7f922635b640 1 -- 172.21.15.42:0/626430043 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f922011ab60 con 0x7f9220070850 2024-05-08T18:53:45.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.207+0000 7f921cff9640 1 -- 172.21.15.42:0/626430043 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f921004c060 con 0x7f9220070850 2024-05-08T18:53:45.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.207+0000 7f921cff9640 1 --2- 172.21.15.42:0/626430043 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f920c03d2b0 0x7f920c03f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:45.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.207+0000 7f922635b640 1 -- 172.21.15.42:0/626430043 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f922012a010 con 0x7f9220070850 2024-05-08T18:53:45.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.207+0000 7f921cff9640 1 -- 172.21.15.42:0/626430043 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f921002f050 con 0x7f9220070850 2024-05-08T18:53:45.209 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.207+0000 7f921f7fe640 1 --2- 172.21.15.42:0/626430043 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f920c03d2b0 0x7f920c03f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:45.210 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.208+0000 7f921f7fe640 1 --2- 172.21.15.42:0/626430043 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f920c03d2b0 0x7f920c03f770 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9214007fd0 tx=0x7f9214007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:45.211 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.212+0000 7f921cff9640 1 -- 172.21.15.42:0/626430043 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f9210040070 con 0x7f9220070850 2024-05-08T18:53:45.402 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.404+0000 7f922635b640 1 -- 172.21.15.42:0/626430043 --> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f922012c0a0 con 0x7f920c03d2b0 2024-05-08T18:53:45.403 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.404+0000 7f921cff9640 1 -- 172.21.15.42:0/626430043 <== mgr.4102 v2:172.21.15.132:6824/2104266563 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f922012c0a0 con 0x7f920c03d2b0 2024-05-08T18:53:45.403 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 2 to deep-scrub 2024-05-08T18:53:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.406+0000 7f922635b640 1 -- 172.21.15.42:0/626430043 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f920c03d2b0 msgr2=0x7f920c03f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.406+0000 7f922635b640 1 --2- 172.21.15.42:0/626430043 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f920c03d2b0 0x7f920c03f770 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9214007fd0 tx=0x7f9214007ac0 comp rx=0 tx=0).stop 2024-05-08T18:53:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.406+0000 7f922635b640 1 -- 172.21.15.42:0/626430043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9220070850 msgr2=0x7f922011a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.406+0000 7f922635b640 1 --2- 172.21.15.42:0/626430043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9220070850 0x7f922011a440 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f9210034040 tx=0x7f92100046c0 comp rx=0 tx=0).stop 2024-05-08T18:53:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.406+0000 7f922635b640 1 -- 172.21.15.42:0/626430043 shutdown_connections 2024-05-08T18:53:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.406+0000 7f922635b640 1 --2- 172.21.15.42:0/626430043 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f920c03d2b0 0x7f920c03f770 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.406+0000 7f922635b640 1 --2- 172.21.15.42:0/626430043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9220070850 0x7f922011a440 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.406+0000 7f922635b640 1 -- 172.21.15.42:0/626430043 >> 172.21.15.42:0/626430043 conn(0x7f922009ff90 msgr2=0x7f92201b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.407+0000 7f922635b640 1 -- 172.21.15.42:0/626430043 shutdown_connections 2024-05-08T18:53:45.406 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.407+0000 7f922635b640 1 -- 172.21.15.42:0/626430043 wait complete. 2024-05-08T18:53:45.417 INFO:tasks.ceph:Scrubbing osd.3 2024-05-08T18:53:45.417 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:53:45.469 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-05-08T18:53:45.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.524+0000 7fe36aa27640 1 Processor -- start 2024-05-08T18:53:45.523 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.524+0000 7fe36aa27640 1 -- start start 2024-05-08T18:53:45.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.524+0000 7fe36aa27640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe36412cc20 0x7fe3641313c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:45.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.524+0000 7fe36aa27640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe36412c0e0 con 0x7fe36406f780 2024-05-08T18:53:45.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.524+0000 7fe36aa27640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fe364073300 con 0x7fe36412cc20 2024-05-08T18:53:45.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.525+0000 7fe3637fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe36412cc20 0x7fe3641313c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:45.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.525+0000 7fe363fff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe36406f780 0x7fe36412c510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:47258/0 (socket says 172.21.15.42:47258) 2024-05-08T18:53:45.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.525+0000 7fe3637fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe36412cc20 0x7fe3641313c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45880/0 (socket says 172.21.15.42:45880) 2024-05-08T18:53:45.525 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.525+0000 7fe363fff640 1 -- 172.21.15.42:0/2922937745 learned_addr learned my addr 172.21.15.42:0/2922937745 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:53:45.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.525+0000 7fe3637fe640 1 -- 172.21.15.42:0/2922937745 >> v1:172.21.15.42:6789/0 conn(0x7fe36406f780 legacy=0x7fe36412c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:45.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.525+0000 7fe3637fe640 1 -- 172.21.15.42:0/2922937745 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe364113ca0 con 0x7fe36412cc20 2024-05-08T18:53:45.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.526+0000 7fe3637fe640 1 --2- 172.21.15.42:0/2922937745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe36412cc20 0x7fe3641313c0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fe358009720 tx=0x7fe35802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96a44f43a047bae server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:45.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.526+0000 7fe362ffd640 1 -- 172.21.15.42:0/2922937745 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe358035020 con 0x7fe36412cc20 2024-05-08T18:53:45.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.526+0000 7fe362ffd640 1 -- 172.21.15.42:0/2922937745 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe358031760 con 0x7fe36412cc20 2024-05-08T18:53:45.526 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.526+0000 7fe362ffd640 1 -- 172.21.15.42:0/2922937745 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe358031a60 con 0x7fe36412cc20 2024-05-08T18:53:45.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.526+0000 7fe36aa27640 1 -- 172.21.15.42:0/2922937745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe36412cc20 msgr2=0x7fe3641313c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:45.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.526+0000 7fe36aa27640 1 --2- 172.21.15.42:0/2922937745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe36412cc20 0x7fe3641313c0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fe358009720 tx=0x7fe35802b8d0 comp rx=0 tx=0).stop 2024-05-08T18:53:45.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.526+0000 7fe36aa27640 1 -- 172.21.15.42:0/2922937745 shutdown_connections 2024-05-08T18:53:45.528 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.526+0000 7fe36aa27640 1 --2- 172.21.15.42:0/2922937745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe36412cc20 0x7fe3641313c0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:45.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.526+0000 7fe36aa27640 1 -- 172.21.15.42:0/2922937745 >> 172.21.15.42:0/2922937745 conn(0x7fe36409a330 msgr2=0x7fe36409a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:45.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.526+0000 7fe36aa27640 1 -- 172.21.15.42:0/2922937745 shutdown_connections 2024-05-08T18:53:45.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.526+0000 7fe36aa27640 1 -- 172.21.15.42:0/2922937745 wait complete. 2024-05-08T18:53:45.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.527+0000 7fe36aa27640 1 Processor -- start 2024-05-08T18:53:45.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.527+0000 7fe36aa27640 1 -- start start 2024-05-08T18:53:45.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.528+0000 7fe36aa27640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe36406f780 0x7fe3641c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:45.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.528+0000 7fe36aa27640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fe364131a80 con 0x7fe36406f780 2024-05-08T18:53:45.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.528+0000 7fe363fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe36406f780 0x7fe3641c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:45.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.528+0000 7fe363fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe36406f780 0x7fe3641c1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45892/0 (socket says 172.21.15.42:45892) 2024-05-08T18:53:45.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.528+0000 7fe363fff640 1 -- 172.21.15.42:0/1072635894 learned_addr learned my addr 172.21.15.42:0/1072635894 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:53:45.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.528+0000 7fe363fff640 1 -- 172.21.15.42:0/1072635894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3641151c0 con 0x7fe36406f780 2024-05-08T18:53:45.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.528+0000 7fe363fff640 1 --2- 172.21.15.42:0/1072635894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe36406f780 0x7fe3641c1dc0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fe35400c480 tx=0x7fe35400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:45.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.528+0000 7fe360ff9640 1 -- 172.21.15.42:0/1072635894 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe354017070 con 0x7fe36406f780 2024-05-08T18:53:45.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.528+0000 7fe360ff9640 1 -- 172.21.15.42:0/1072635894 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe354005c10 con 0x7fe36406f780 2024-05-08T18:53:45.529 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.528+0000 7fe360ff9640 1 -- 172.21.15.42:0/1072635894 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3540070d0 con 0x7fe36406f780 2024-05-08T18:53:45.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.528+0000 7fe36aa27640 1 -- 172.21.15.42:0/1072635894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe364130220 con 0x7fe36406f780 2024-05-08T18:53:45.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.529+0000 7fe36aa27640 1 -- 172.21.15.42:0/1072635894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3641165c0 con 0x7fe36406f780 2024-05-08T18:53:45.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.529+0000 7fe36aa27640 1 -- 172.21.15.42:0/1072635894 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe364064010 con 0x7fe36406f780 2024-05-08T18:53:45.530 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.530+0000 7fe360ff9640 1 -- 172.21.15.42:0/1072635894 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fe35401a070 con 0x7fe36406f780 2024-05-08T18:53:45.531 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.530+0000 7fe360ff9640 1 --2- 172.21.15.42:0/1072635894 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe35003d2b0 0x7fe35003f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:45.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.530+0000 7fe360ff9640 1 -- 172.21.15.42:0/1072635894 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fe354050f10 con 0x7fe36406f780 2024-05-08T18:53:45.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.530+0000 7fe360ff9640 1 --2- 172.21.15.42:0/1072635894 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x7fe350049110 0x7fe35004b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:45.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.530+0000 7fe360ff9640 1 -- 172.21.15.42:0/1072635894 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe354009e50 con 0x7fe350049110 2024-05-08T18:53:45.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.530+0000 7fe360ff9640 1 -- 172.21.15.42:0/1072635894 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe3540535c0 con 0x7fe36406f780 2024-05-08T18:53:45.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.530+0000 7fe3637fe640 1 --2- 172.21.15.42:0/1072635894 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe35003d2b0 0x7fe35003f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:45.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.530+0000 7fe368fc4640 1 --2- 172.21.15.42:0/1072635894 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x7fe350049110 0x7fe35004b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:45.532 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.531+0000 7fe368fc4640 1 --2- 172.21.15.42:0/1072635894 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x7fe350049110 0x7fe35004b5b0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:45.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.531+0000 7fe3637fe640 1 --2- 172.21.15.42:0/1072635894 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe35003d2b0 0x7fe35003f770 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe358036000 tx=0x7fe358008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:45.533 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.532+0000 7fe360ff9640 1 -- 172.21.15.42:0/1072635894 <== osd.3 v2:172.21.15.132:6816/17827703 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe354009e50 con 0x7fe350049110 2024-05-08T18:53:45.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.545+0000 7fe36aa27640 1 -- 172.21.15.42:0/1072635894 --> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe3641158f0 con 0x7fe350049110 2024-05-08T18:53:45.544 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.545+0000 7fe360ff9640 1 -- 172.21.15.42:0/1072635894 <== osd.3 v2:172.21.15.132:6816/17827703 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe3641158f0 con 0x7fe350049110 2024-05-08T18:53:45.544 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2024-05-08T18:53:45.544 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:53:45.545 INFO:teuthology.orchestra.run.smithi042.stdout:} 2024-05-08T18:53:45.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.546+0000 7fe36aa27640 1 -- 172.21.15.42:0/1072635894 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x7fe350049110 msgr2=0x7fe35004b5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:45.545 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.546+0000 7fe36aa27640 1 --2- 172.21.15.42:0/1072635894 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x7fe350049110 0x7fe35004b5b0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:45.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.546+0000 7fe36aa27640 1 -- 172.21.15.42:0/1072635894 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe35003d2b0 msgr2=0x7fe35003f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:45.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.546+0000 7fe36aa27640 1 --2- 172.21.15.42:0/1072635894 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe35003d2b0 0x7fe35003f770 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe358036000 tx=0x7fe358008030 comp rx=0 tx=0).stop 2024-05-08T18:53:45.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.546+0000 7fe36aa27640 1 -- 172.21.15.42:0/1072635894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe36406f780 msgr2=0x7fe3641c1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:45.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.546+0000 7fe36aa27640 1 --2- 172.21.15.42:0/1072635894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe36406f780 0x7fe3641c1dc0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fe35400c480 tx=0x7fe35400c940 comp rx=0 tx=0).stop 2024-05-08T18:53:45.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.546+0000 7fe36aa27640 1 -- 172.21.15.42:0/1072635894 shutdown_connections 2024-05-08T18:53:45.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.546+0000 7fe36aa27640 1 --2- 172.21.15.42:0/1072635894 >> [v2:172.21.15.132:6816/17827703,v1:172.21.15.132:6817/17827703] conn(0x7fe350049110 0x7fe35004b5b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:45.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.546+0000 7fe36aa27640 1 --2- 172.21.15.42:0/1072635894 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fe35003d2b0 0x7fe35003f770 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:45.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.546+0000 7fe36aa27640 1 --2- 172.21.15.42:0/1072635894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe36406f780 0x7fe3641c1dc0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:45.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.546+0000 7fe36aa27640 1 -- 172.21.15.42:0/1072635894 >> 172.21.15.42:0/1072635894 conn(0x7fe36409a330 msgr2=0x7fe364125530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:45.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.546+0000 7fe36aa27640 1 -- 172.21.15.42:0/1072635894 shutdown_connections 2024-05-08T18:53:45.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.546+0000 7fe36aa27640 1 -- 172.21.15.42:0/1072635894 wait complete. 2024-05-08T18:53:45.555 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-08T18:53:45.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.659+0000 7f89edfab640 1 Processor -- start 2024-05-08T18:53:45.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.659+0000 7f89edfab640 1 -- start start 2024-05-08T18:53:45.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.660+0000 7f89edfab640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f89e812d1b0 0x7f89e812d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:45.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.660+0000 7f89edfab640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e812d590 con 0x7f89e812dda0 2024-05-08T18:53:45.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.660+0000 7f89edfab640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f89e8114de0 con 0x7f89e812d1b0 2024-05-08T18:53:45.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.660+0000 7f89e77fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f89e812d1b0 0x7f89e812d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:45.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.660+0000 7f89e6ffd640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f89e812dda0 0x7f89e8129c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:47268/0 (socket says 172.21.15.42:47268) 2024-05-08T18:53:45.659 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.660+0000 7f89e6ffd640 1 -- 172.21.15.42:0/2926757256 learned_addr learned my addr 172.21.15.42:0/2926757256 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:53:45.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.660+0000 7f89e77fe640 1 -- 172.21.15.42:0/2926757256 >> v1:172.21.15.42:6789/0 conn(0x7f89e812dda0 legacy=0x7f89e8129c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:45.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.660+0000 7f89e67fc640 1 -- 172.21.15.42:0/2926757256 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 222331299 0 0) 0x7f89e812d590 con 0x7f89e812dda0 2024-05-08T18:53:45.660 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.660+0000 7f89e77fe640 1 -- 172.21.15.42:0/2926757256 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e8113c30 con 0x7f89e812d1b0 2024-05-08T18:53:45.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.661+0000 7f89e77fe640 1 --2- 172.21.15.42:0/2926757256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89e812d1b0 0x7f89e812d860 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f89d8009720 tx=0x7f89d802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58379e42761127cf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:45.661 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.661+0000 7f89e67fc640 1 -- 172.21.15.42:0/2926757256 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d80316d0 con 0x7f89e812d1b0 2024-05-08T18:53:45.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.661+0000 7f89e67fc640 1 -- 172.21.15.42:0/2926757256 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d8037070 con 0x7f89e812d1b0 2024-05-08T18:53:45.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.661+0000 7f89e67fc640 1 -- 172.21.15.42:0/2926757256 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d80319c0 con 0x7f89e812d1b0 2024-05-08T18:53:45.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.662+0000 7f89edfab640 1 -- 172.21.15.42:0/2926757256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89e812d1b0 msgr2=0x7f89e812d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:45.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.662+0000 7f89edfab640 1 --2- 172.21.15.42:0/2926757256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89e812d1b0 0x7f89e812d860 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f89d8009720 tx=0x7f89d802b840 comp rx=0 tx=0).stop 2024-05-08T18:53:45.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.662+0000 7f89edfab640 1 -- 172.21.15.42:0/2926757256 shutdown_connections 2024-05-08T18:53:45.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.662+0000 7f89edfab640 1 --2- 172.21.15.42:0/2926757256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89e812d1b0 0x7f89e812d860 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:45.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.662+0000 7f89edfab640 1 -- 172.21.15.42:0/2926757256 >> 172.21.15.42:0/2926757256 conn(0x7f89e809a910 msgr2=0x7f89e806e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:45.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.662+0000 7f89edfab640 1 -- 172.21.15.42:0/2926757256 shutdown_connections 2024-05-08T18:53:45.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.662+0000 7f89edfab640 1 -- 172.21.15.42:0/2926757256 wait complete. 2024-05-08T18:53:45.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.662+0000 7f89edfab640 1 Processor -- start 2024-05-08T18:53:45.662 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.663+0000 7f89edfab640 1 -- start start 2024-05-08T18:53:45.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.663+0000 7f89edfab640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89e812d1b0 0x7f89e81c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:45.664 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.663+0000 7f89edfab640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f89e812a6d0 con 0x7f89e812d1b0 2024-05-08T18:53:45.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.663+0000 7f89e77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89e812d1b0 0x7f89e81c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:45.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.663+0000 7f89e77fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89e812d1b0 0x7f89e81c4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45908/0 (socket says 172.21.15.42:45908) 2024-05-08T18:53:45.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.663+0000 7f89e77fe640 1 -- 172.21.15.42:0/1826387876 learned_addr learned my addr 172.21.15.42:0/1826387876 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:53:45.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.663+0000 7f89e77fe640 1 -- 172.21.15.42:0/1826387876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e811bbd0 con 0x7f89e812d1b0 2024-05-08T18:53:45.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.664+0000 7f89e77fe640 1 --2- 172.21.15.42:0/1826387876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89e812d1b0 0x7f89e81c4270 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f89d802b880 tx=0x7f89d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:45.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.664+0000 7f89cffff640 1 -- 172.21.15.42:0/1826387876 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d8004030 con 0x7f89e812d1b0 2024-05-08T18:53:45.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.664+0000 7f89cffff640 1 -- 172.21.15.42:0/1826387876 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d80041d0 con 0x7f89e812d1b0 2024-05-08T18:53:45.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.664+0000 7f89edfab640 1 -- 172.21.15.42:0/1826387876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e811c620 con 0x7f89e812d1b0 2024-05-08T18:53:45.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.664+0000 7f89cffff640 1 -- 172.21.15.42:0/1826387876 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89d8032640 con 0x7f89e812d1b0 2024-05-08T18:53:45.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.664+0000 7f89edfab640 1 -- 172.21.15.42:0/1826387876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e81c4990 con 0x7f89e812d1b0 2024-05-08T18:53:45.665 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.665+0000 7f89edfab640 1 -- 172.21.15.42:0/1826387876 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89e8064010 con 0x7f89e812d1b0 2024-05-08T18:53:45.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.665+0000 7f89cffff640 1 -- 172.21.15.42:0/1826387876 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f89d80327e0 con 0x7f89e812d1b0 2024-05-08T18:53:45.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.665+0000 7f89cffff640 1 --2- 172.21.15.42:0/1826387876 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f89d403d2b0 0x7f89d403f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:45.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.665+0000 7f89cffff640 1 -- 172.21.15.42:0/1826387876 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f89d802f050 con 0x7f89e812d1b0 2024-05-08T18:53:45.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.665+0000 7f89e6ffd640 1 --2- 172.21.15.42:0/1826387876 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f89d403d2b0 0x7f89d403f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:45.666 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.666+0000 7f89e6ffd640 1 --2- 172.21.15.42:0/1826387876 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f89d403d2b0 0x7f89d403f770 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f89dc000c00 tx=0x7f89dc007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:45.668 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.670+0000 7f89cffff640 1 -- 172.21.15.42:0/1826387876 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f89d8041070 con 0x7f89e812d1b0 2024-05-08T18:53:45.859 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.860+0000 7f89edfab640 1 -- 172.21.15.42:0/1826387876 --> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f89e8073320 con 0x7f89d403d2b0 2024-05-08T18:53:45.860 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.861+0000 7f89cffff640 1 -- 172.21.15.42:0/1826387876 <== mgr.4102 v2:172.21.15.132:6824/2104266563 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f89e8073320 con 0x7f89d403d2b0 2024-05-08T18:53:45.860 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 3 to deep-scrub 2024-05-08T18:53:45.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.862+0000 7f89edfab640 1 -- 172.21.15.42:0/1826387876 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f89d403d2b0 msgr2=0x7f89d403f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:45.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.862+0000 7f89edfab640 1 --2- 172.21.15.42:0/1826387876 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f89d403d2b0 0x7f89d403f770 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f89dc000c00 tx=0x7f89dc007970 comp rx=0 tx=0).stop 2024-05-08T18:53:45.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.862+0000 7f89edfab640 1 -- 172.21.15.42:0/1826387876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89e812d1b0 msgr2=0x7f89e81c4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:45.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.862+0000 7f89edfab640 1 --2- 172.21.15.42:0/1826387876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89e812d1b0 0x7f89e81c4270 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f89d802b880 tx=0x7f89d80046c0 comp rx=0 tx=0).stop 2024-05-08T18:53:45.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.862+0000 7f89edfab640 1 -- 172.21.15.42:0/1826387876 shutdown_connections 2024-05-08T18:53:45.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.862+0000 7f89edfab640 1 --2- 172.21.15.42:0/1826387876 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f89d403d2b0 0x7f89d403f770 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:45.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.862+0000 7f89edfab640 1 --2- 172.21.15.42:0/1826387876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89e812d1b0 0x7f89e81c4270 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:45.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.862+0000 7f89edfab640 1 -- 172.21.15.42:0/1826387876 >> 172.21.15.42:0/1826387876 conn(0x7f89e809a910 msgr2=0x7f89e8070790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:45.862 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.863+0000 7f89edfab640 1 -- 172.21.15.42:0/1826387876 shutdown_connections 2024-05-08T18:53:45.863 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.863+0000 7f89edfab640 1 -- 172.21.15.42:0/1826387876 wait complete. 2024-05-08T18:53:45.872 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:53:45.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.976+0000 7f172e526640 1 Processor -- start 2024-05-08T18:53:45.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.976+0000 7f172e526640 1 -- start start 2024-05-08T18:53:45.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.977+0000 7f172e526640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f172812f510 0x7f172812f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:45.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.977+0000 7f172e526640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f172809f1e0 con 0x7f172812fe30 2024-05-08T18:53:45.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.977+0000 7f172e526640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f1728070d00 con 0x7f172812f510 2024-05-08T18:53:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.977+0000 7f1727fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f172812f510 0x7f172812f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.977+0000 7f17277fe640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f172812fe30 0x7f172812e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:47274/0 (socket says 172.21.15.42:47274) 2024-05-08T18:53:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.977+0000 7f17277fe640 1 -- 172.21.15.42:0/3014342091 learned_addr learned my addr 172.21.15.42:0/3014342091 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:53:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.977+0000 7f1727fff640 1 -- 172.21.15.42:0/3014342091 >> v1:172.21.15.42:6789/0 conn(0x7f172812fe30 legacy=0x7f172812e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.977+0000 7f1727fff640 1 -- 172.21.15.42:0/3014342091 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17280737b0 con 0x7f172812f510 2024-05-08T18:53:45.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.977+0000 7f1726ffd640 1 -- 172.21.15.42:0/3014342091 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2174573462 0 0) 0x7f172809f1e0 con 0x7f172812fe30 2024-05-08T18:53:45.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.978+0000 7f1727fff640 1 --2- 172.21.15.42:0/3014342091 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f172812f510 0x7f172812f8f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1718009720 tx=0x7f171802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f12a13ec4024f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:45.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.978+0000 7f1726ffd640 1 -- 172.21.15.42:0/3014342091 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17180316d0 con 0x7f172812f510 2024-05-08T18:53:45.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.978+0000 7f1726ffd640 1 -- 172.21.15.42:0/3014342091 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1718037070 con 0x7f172812f510 2024-05-08T18:53:45.981 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.978+0000 7f1726ffd640 1 -- 172.21.15.42:0/3014342091 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17180319c0 con 0x7f172812f510 2024-05-08T18:53:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.978+0000 7f172e526640 1 -- 172.21.15.42:0/3014342091 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f172812f510 msgr2=0x7f172812f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.978+0000 7f172e526640 1 --2- 172.21.15.42:0/3014342091 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f172812f510 0x7f172812f8f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1718009720 tx=0x7f171802b840 comp rx=0 tx=0).stop 2024-05-08T18:53:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.978+0000 7f172e526640 1 -- 172.21.15.42:0/3014342091 shutdown_connections 2024-05-08T18:53:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.978+0000 7f172e526640 1 --2- 172.21.15.42:0/3014342091 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f172812f510 0x7f172812f8f0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.979+0000 7f172e526640 1 -- 172.21.15.42:0/3014342091 >> 172.21.15.42:0/3014342091 conn(0x7f172809c7a0 msgr2=0x7f172809cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.979+0000 7f172e526640 1 -- 172.21.15.42:0/3014342091 shutdown_connections 2024-05-08T18:53:45.982 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.979+0000 7f172e526640 1 -- 172.21.15.42:0/3014342091 wait complete. 2024-05-08T18:53:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.979+0000 7f172e526640 1 Processor -- start 2024-05-08T18:53:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.980+0000 7f172e526640 1 -- start start 2024-05-08T18:53:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.980+0000 7f172e526640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f172812f510 0x7f1728121cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.980+0000 7f172e526640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f17281302b0 con 0x7f172812f510 2024-05-08T18:53:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.980+0000 7f1727fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f172812f510 0x7f1728121cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.980+0000 7f1727fff640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f172812f510 0x7f1728121cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:45914/0 (socket says 172.21.15.42:45914) 2024-05-08T18:53:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.980+0000 7f1727fff640 1 -- 172.21.15.42:0/3980755832 learned_addr learned my addr 172.21.15.42:0/3980755832 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:53:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.980+0000 7f1727fff640 1 -- 172.21.15.42:0/3980755832 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1728123a50 con 0x7f172812f510 2024-05-08T18:53:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.981+0000 7f1727fff640 1 --2- 172.21.15.42:0/3980755832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f172812f510 0x7f1728121cf0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f1718009840 tx=0x7f17180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.981+0000 7f1724ff9640 1 -- 172.21.15.42:0/3980755832 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1718032770 con 0x7f172812f510 2024-05-08T18:53:45.983 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.981+0000 7f1724ff9640 1 -- 172.21.15.42:0/3980755832 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1718032910 con 0x7f172812f510 2024-05-08T18:53:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.981+0000 7f1724ff9640 1 -- 172.21.15.42:0/3980755832 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1718032c10 con 0x7f172812f510 2024-05-08T18:53:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.981+0000 7f172e526640 1 -- 172.21.15.42:0/3980755832 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17281246e0 con 0x7f172812f510 2024-05-08T18:53:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.981+0000 7f172e526640 1 -- 172.21.15.42:0/3980755832 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1728122230 con 0x7f172812f510 2024-05-08T18:53:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.982+0000 7f1724ff9640 1 -- 172.21.15.42:0/3980755832 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f171804c060 con 0x7f172812f510 2024-05-08T18:53:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.982+0000 7f172e526640 1 -- 172.21.15.42:0/3980755832 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1728064010 con 0x7f172812f510 2024-05-08T18:53:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.982+0000 7f1724ff9640 1 --2- 172.21.15.42:0/3980755832 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f171403d2b0 0x7f171403f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:53:45.984 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.982+0000 7f1724ff9640 1 -- 172.21.15.42:0/3980755832 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f171802f050 con 0x7f172812f510 2024-05-08T18:53:45.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.982+0000 7f17277fe640 1 --2- 172.21.15.42:0/3980755832 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f171403d2b0 0x7f171403f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:53:45.985 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.983+0000 7f17277fe640 1 --2- 172.21.15.42:0/3980755832 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f171403d2b0 0x7f171403f770 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f171c000c00 tx=0x7f171c007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:53:45.986 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:45.987+0000 7f1724ff9640 1 -- 172.21.15.42:0/3980755832 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1718040070 con 0x7f172812f510 2024-05-08T18:53:46.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:46.180+0000 7f172e526640 1 -- 172.21.15.42:0/3980755832 --> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1728124240 con 0x7f171403d2b0 2024-05-08T18:53:46.194 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:46.196+0000 7f1724ff9640 1 -- 172.21.15.42:0/3980755832 <== mgr.4102 v2:172.21.15.132:6824/2104266563 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665255 (secure 0 0 0) 0x7f171c0070d0 con 0x7f171403d2b0 2024-05-08T18:53:46.204 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:53:46.210 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-08T18:53:46.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:46.200+0000 7f172e526640 1 -- 172.21.15.42:0/3980755832 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f171403d2b0 msgr2=0x7f171403f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:46.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:46.200+0000 7f172e526640 1 --2- 172.21.15.42:0/3980755832 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f171403d2b0 0x7f171403f770 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f171c000c00 tx=0x7f171c007910 comp rx=0 tx=0).stop 2024-05-08T18:53:46.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:46.200+0000 7f172e526640 1 -- 172.21.15.42:0/3980755832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f172812f510 msgr2=0x7f1728121cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:53:46.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:46.200+0000 7f172e526640 1 --2- 172.21.15.42:0/3980755832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f172812f510 0x7f1728121cf0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f1718009840 tx=0x7f17180046c0 comp rx=0 tx=0).stop 2024-05-08T18:53:46.213 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:46.200+0000 7f172e526640 1 -- 172.21.15.42:0/3980755832 shutdown_connections 2024-05-08T18:53:46.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:46.200+0000 7f172e526640 1 --2- 172.21.15.42:0/3980755832 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f171403d2b0 0x7f171403f770 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:46.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:46.200+0000 7f172e526640 1 --2- 172.21.15.42:0/3980755832 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f172812f510 0x7f1728121cf0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:53:46.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:46.200+0000 7f172e526640 1 -- 172.21.15.42:0/3980755832 >> 172.21.15.42:0/3980755832 conn(0x7f172809c7a0 msgr2=0x7f172809ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:53:46.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:46.200+0000 7f172e526640 1 -- 172.21.15.42:0/3980755832 shutdown_connections 2024-05-08T18:53:46.214 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:53:46.200+0000 7f172e526640 1 -- 172.21.15.42:0/3980755832 wait complete. 2024-05-08T18:53:46.214 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2024-05-08T18:53:45.988419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5031,"num_read_kb":4621,"num_write":2119,"num_write_kb":60585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4561,"ondisk_log_size":4561,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":139840,"kb_used_data":2648,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377347520,"statfs":{"total":386547056640,"available":386403860480,"internally_reserved":0,"allocated":2711552,"data_stored":1657766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4281,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":713,"num_read_kb":672,"num_write":457,"num_write_kb":29372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004114"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079566+0000","last_change":"2024-05-08T18:50:26.031610+0000","last_active":"2024-05-08T18:51:15.079566+0000","last_peered":"2024-05-08T18:51:15.079566+0000","last_clean":"2024-05-08T18:51:15.079566+0000","last_became_active":"2024-05-08T18:50:26.031359+0000","last_became_peered":"2024-05-08T18:50:26.031359+0000","last_unstale":"2024-05-08T18:51:15.079566+0000","last_undegraded":"2024-05-08T18:51:15.079566+0000","last_fullsized":"2024-05-08T18:51:15.079566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:47.912064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.861653+0000","last_change":"2024-05-08T18:50:28.028609+0000","last_active":"2024-05-08T18:53:34.861653+0000","last_peered":"2024-05-08T18:53:34.861653+0000","last_clean":"2024-05-08T18:53:34.861653+0000","last_became_active":"2024-05-08T18:50:28.028352+0000","last_became_peered":"2024-05-08T18:50:28.028352+0000","last_unstale":"2024-05-08T18:53:34.861653+0000","last_undegraded":"2024-05-08T18:53:34.861653+0000","last_fullsized":"2024-05-08T18:53:34.861653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:01.592206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.086736+0000","last_change":"2024-05-08T18:50:26.029183+0000","last_active":"2024-05-08T18:52:34.086736+0000","last_peered":"2024-05-08T18:52:34.086736+0000","last_clean":"2024-05-08T18:52:34.086736+0000","last_became_active":"2024-05-08T18:50:26.028799+0000","last_became_peered":"2024-05-08T18:50:26.028799+0000","last_unstale":"2024-05-08T18:52:34.086736+0000","last_undegraded":"2024-05-08T18:52:34.086736+0000","last_fullsized":"2024-05-08T18:52:34.086736+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:51.140557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"27'6","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887526+0000","last_change":"2024-05-08T18:50:28.034919+0000","last_active":"2024-05-08T18:53:34.887526+0000","last_peered":"2024-05-08T18:53:34.887526+0000","last_clean":"2024-05-08T18:53:34.887526+0000","last_became_active":"2024-05-08T18:50:28.033466+0000","last_became_peered":"2024-05-08T18:50:28.033466+0000","last_unstale":"2024-05-08T18:53:34.887526+0000","last_undegraded":"2024-05-08T18:53:34.887526+0000","last_fullsized":"2024-05-08T18:53:34.887526+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:01:07.458436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:17.995039+0000","last_change":"2024-05-08T18:51:15.084166+0000","last_active":"2024-05-08T18:51:17.995039+0000","last_peered":"2024-05-08T18:51:17.995039+0000","last_clean":"2024-05-08T18:51:17.995039+0000","last_became_active":"2024-05-08T18:51:15.083809+0000","last_became_peered":"2024-05-08T18:51:15.083809+0000","last_unstale":"2024-05-08T18:51:17.995039+0000","last_undegraded":"2024-05-08T18:51:17.995039+0000","last_fullsized":"2024-05-08T18:51:17.995039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:21.925661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"25'2","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.084345+0000","last_change":"2024-05-08T18:51:15.083978+0000","last_active":"2024-05-08T18:51:15.084345+0000","last_peered":"2024-05-08T18:51:15.084345+0000","last_clean":"2024-05-08T18:51:15.084345+0000","last_became_active":"2024-05-08T18:51:15.080716+0000","last_became_peered":"2024-05-08T18:51:15.080716+0000","last_unstale":"2024-05-08T18:51:15.084345+0000","last_undegraded":"2024-05-08T18:51:15.084345+0000","last_fullsized":"2024-05-08T18:51:15.084345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:08.301578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076692+0000","last_change":"2024-05-08T18:50:26.024545+0000","last_active":"2024-05-08T18:51:15.076692+0000","last_peered":"2024-05-08T18:51:15.076692+0000","last_clean":"2024-05-08T18:51:15.076692+0000","last_became_active":"2024-05-08T18:50:26.024243+0000","last_became_peered":"2024-05-08T18:50:26.024243+0000","last_unstale":"2024-05-08T18:51:15.076692+0000","last_undegraded":"2024-05-08T18:51:15.076692+0000","last_fullsized":"2024-05-08T18:51:15.076692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:59.917414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"27'4","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.690261+0000","last_change":"2024-05-08T18:50:28.026931+0000","last_active":"2024-05-08T18:53:34.690261+0000","last_peered":"2024-05-08T18:53:34.690261+0000","last_clean":"2024-05-08T18:53:34.690261+0000","last_became_active":"2024-05-08T18:50:28.026380+0000","last_became_peered":"2024-05-08T18:50:28.026380+0000","last_unstale":"2024-05-08T18:53:34.690261+0000","last_undegraded":"2024-05-08T18:53:34.690261+0000","last_fullsized":"2024-05-08T18:53:34.690261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:06:48.544087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079861+0000","last_change":"2024-05-08T18:50:26.023188+0000","last_active":"2024-05-08T18:51:15.079861+0000","last_peered":"2024-05-08T18:51:15.079861+0000","last_clean":"2024-05-08T18:51:15.079861+0000","last_became_active":"2024-05-08T18:50:26.022914+0000","last_became_peered":"2024-05-08T18:50:26.022914+0000","last_unstale":"2024-05-08T18:51:15.079861+0000","last_undegraded":"2024-05-08T18:51:15.079861+0000","last_fullsized":"2024-05-08T18:51:15.079861+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:22.501461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'6","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887773+0000","last_change":"2024-05-08T18:50:28.023780+0000","last_active":"2024-05-08T18:53:34.887773+0000","last_peered":"2024-05-08T18:53:34.887773+0000","last_clean":"2024-05-08T18:53:34.887773+0000","last_became_active":"2024-05-08T18:50:28.023506+0000","last_became_peered":"2024-05-08T18:50:28.023506+0000","last_unstale":"2024-05-08T18:53:34.887773+0000","last_undegraded":"2024-05-08T18:53:34.887773+0000","last_fullsized":"2024-05-08T18:53:34.887773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:07.047413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074268+0000","last_change":"2024-05-08T18:50:26.024901+0000","last_active":"2024-05-08T18:51:15.074268+0000","last_peered":"2024-05-08T18:51:15.074268+0000","last_clean":"2024-05-08T18:51:15.074268+0000","last_became_active":"2024-05-08T18:50:26.024493+0000","last_became_peered":"2024-05-08T18:50:26.024493+0000","last_unstale":"2024-05-08T18:51:15.074268+0000","last_undegraded":"2024-05-08T18:51:15.074268+0000","last_fullsized":"2024-05-08T18:51:15.074268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:45.479269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"27'10","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.607900+0000","last_change":"2024-05-08T18:50:28.037839+0000","last_active":"2024-05-08T18:53:34.607900+0000","last_peered":"2024-05-08T18:53:34.607900+0000","last_clean":"2024-05-08T18:53:34.607900+0000","last_became_active":"2024-05-08T18:50:28.037266+0000","last_became_peered":"2024-05-08T18:50:28.037266+0000","last_unstale":"2024-05-08T18:53:34.607900+0000","last_undegraded":"2024-05-08T18:53:34.607900+0000","last_fullsized":"2024-05-08T18:53:34.607900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:55.169436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.506572+0000","last_change":"2024-05-08T18:50:26.011072+0000","last_active":"2024-05-08T18:53:34.506572+0000","last_peered":"2024-05-08T18:53:34.506572+0000","last_clean":"2024-05-08T18:53:34.506572+0000","last_became_active":"2024-05-08T18:50:26.010734+0000","last_became_peered":"2024-05-08T18:50:26.010734+0000","last_unstale":"2024-05-08T18:53:34.506572+0000","last_undegraded":"2024-05-08T18:53:34.506572+0000","last_fullsized":"2024-05-08T18:53:34.506572+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:34.544725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076550+0000","last_change":"2024-05-08T18:50:28.026695+0000","last_active":"2024-05-08T18:51:15.076550+0000","last_peered":"2024-05-08T18:51:15.076550+0000","last_clean":"2024-05-08T18:51:15.076550+0000","last_became_active":"2024-05-08T18:50:28.026028+0000","last_became_peered":"2024-05-08T18:50:28.026028+0000","last_unstale":"2024-05-08T18:51:15.076550+0000","last_undegraded":"2024-05-08T18:51:15.076550+0000","last_fullsized":"2024-05-08T18:51:15.076550+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:08:56.748370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"25'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072030+0000","last_change":"2024-05-08T18:50:26.029712+0000","last_active":"2024-05-08T18:51:15.072030+0000","last_peered":"2024-05-08T18:51:15.072030+0000","last_clean":"2024-05-08T18:51:15.072030+0000","last_became_active":"2024-05-08T18:50:26.029435+0000","last_became_peered":"2024-05-08T18:50:26.029435+0000","last_unstale":"2024-05-08T18:51:15.072030+0000","last_undegraded":"2024-05-08T18:51:15.072030+0000","last_fullsized":"2024-05-08T18:51:15.072030+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:07.271771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"27'6","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887632+0000","last_change":"2024-05-08T18:50:28.033720+0000","last_active":"2024-05-08T18:53:34.887632+0000","last_peered":"2024-05-08T18:53:34.887632+0000","last_clean":"2024-05-08T18:53:34.887632+0000","last_became_active":"2024-05-08T18:50:28.033311+0000","last_became_peered":"2024-05-08T18:50:28.033311+0000","last_unstale":"2024-05-08T18:53:34.887632+0000","last_undegraded":"2024-05-08T18:53:34.887632+0000","last_fullsized":"2024-05-08T18:53:34.887632+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:53:28.343769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"27'10","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.243057+0000","last_change":"2024-05-08T18:50:28.033240+0000","last_active":"2024-05-08T18:52:34.243057+0000","last_peered":"2024-05-08T18:52:34.243057+0000","last_clean":"2024-05-08T18:52:34.243057+0000","last_became_active":"2024-05-08T18:50:28.032951+0000","last_became_peered":"2024-05-08T18:50:28.032951+0000","last_unstale":"2024-05-08T18:52:34.243057+0000","last_undegraded":"2024-05-08T18:52:34.243057+0000","last_fullsized":"2024-05-08T18:52:34.243057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:33:40.152329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'4","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.082075+0000","last_change":"2024-05-08T18:50:26.030698+0000","last_active":"2024-05-08T18:51:15.082075+0000","last_peered":"2024-05-08T18:51:15.082075+0000","last_clean":"2024-05-08T18:51:15.082075+0000","last_became_active":"2024-05-08T18:50:26.030437+0000","last_became_peered":"2024-05-08T18:50:26.030437+0000","last_unstale":"2024-05-08T18:51:15.082075+0000","last_undegraded":"2024-05-08T18:51:15.082075+0000","last_fullsized":"2024-05-08T18:51:15.082075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:07.534900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'21","reported_seq":106,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.613463+0000","last_change":"2024-05-08T18:50:28.028447+0000","last_active":"2024-05-08T18:53:34.613463+0000","last_peered":"2024-05-08T18:53:34.613463+0000","last_clean":"2024-05-08T18:53:34.613463+0000","last_became_active":"2024-05-08T18:50:28.028184+0000","last_became_peered":"2024-05-08T18:50:28.028184+0000","last_unstale":"2024-05-08T18:53:34.613463+0000","last_undegraded":"2024-05-08T18:53:34.613463+0000","last_fullsized":"2024-05-08T18:53:34.613463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:08:56.748370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":94,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.816663+0000","last_change":"2024-05-08T18:50:26.032028+0000","last_active":"2024-05-08T18:53:34.816663+0000","last_peered":"2024-05-08T18:53:34.816663+0000","last_clean":"2024-05-08T18:53:34.816663+0000","last_became_active":"2024-05-08T18:50:26.031768+0000","last_became_peered":"2024-05-08T18:50:26.031768+0000","last_unstale":"2024-05-08T18:53:34.816663+0000","last_undegraded":"2024-05-08T18:53:34.816663+0000","last_fullsized":"2024-05-08T18:53:34.816663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:09.253705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'8","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887843+0000","last_change":"2024-05-08T18:50:28.029440+0000","last_active":"2024-05-08T18:53:34.887843+0000","last_peered":"2024-05-08T18:53:34.887843+0000","last_clean":"2024-05-08T18:53:34.887843+0000","last_became_active":"2024-05-08T18:50:28.029145+0000","last_became_peered":"2024-05-08T18:50:28.029145+0000","last_unstale":"2024-05-08T18:53:34.887843+0000","last_undegraded":"2024-05-08T18:53:34.887843+0000","last_fullsized":"2024-05-08T18:53:34.887843+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:23.929950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.809112+0000","last_change":"2024-05-08T18:50:26.031782+0000","last_active":"2024-05-08T18:53:34.809112+0000","last_peered":"2024-05-08T18:53:34.809112+0000","last_clean":"2024-05-08T18:53:34.809112+0000","last_became_active":"2024-05-08T18:50:26.031545+0000","last_became_peered":"2024-05-08T18:50:26.031545+0000","last_unstale":"2024-05-08T18:53:34.809112+0000","last_undegraded":"2024-05-08T18:53:34.809112+0000","last_fullsized":"2024-05-08T18:53:34.809112+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:59.917414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"27'16","reported_seq":74,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887608+0000","last_change":"2024-05-08T18:50:28.023032+0000","last_active":"2024-05-08T18:53:34.887608+0000","last_peered":"2024-05-08T18:53:34.887608+0000","last_clean":"2024-05-08T18:53:34.887608+0000","last_became_active":"2024-05-08T18:50:28.022683+0000","last_became_peered":"2024-05-08T18:50:28.022683+0000","last_unstale":"2024-05-08T18:53:34.887608+0000","last_undegraded":"2024-05-08T18:53:34.887608+0000","last_fullsized":"2024-05-08T18:53:34.887608+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:53:28.343769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.570317+0000","last_change":"2024-05-08T18:50:26.013216+0000","last_active":"2024-05-08T18:53:34.570317+0000","last_peered":"2024-05-08T18:53:34.570317+0000","last_clean":"2024-05-08T18:53:34.570317+0000","last_became_active":"2024-05-08T18:50:26.011512+0000","last_became_peered":"2024-05-08T18:50:26.011512+0000","last_unstale":"2024-05-08T18:53:34.570317+0000","last_undegraded":"2024-05-08T18:53:34.570317+0000","last_fullsized":"2024-05-08T18:53:34.570317+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:10.080123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078245+0000","last_change":"2024-05-08T18:50:28.033091+0000","last_active":"2024-05-08T18:51:15.078245+0000","last_peered":"2024-05-08T18:51:15.078245+0000","last_clean":"2024-05-08T18:51:15.078245+0000","last_became_active":"2024-05-08T18:50:28.032768+0000","last_became_peered":"2024-05-08T18:50:28.032768+0000","last_unstale":"2024-05-08T18:51:15.078245+0000","last_undegraded":"2024-05-08T18:51:15.078245+0000","last_fullsized":"2024-05-08T18:51:15.078245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:14.472478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073068+0000","last_change":"2024-05-08T18:50:26.029400+0000","last_active":"2024-05-08T18:51:15.073068+0000","last_peered":"2024-05-08T18:51:15.073068+0000","last_clean":"2024-05-08T18:51:15.073068+0000","last_became_active":"2024-05-08T18:50:26.029015+0000","last_became_peered":"2024-05-08T18:50:26.029015+0000","last_unstale":"2024-05-08T18:51:15.073068+0000","last_undegraded":"2024-05-08T18:51:15.073068+0000","last_fullsized":"2024-05-08T18:51:15.073068+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:10.080123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"27'14","reported_seq":68,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.861465+0000","last_change":"2024-05-08T18:50:28.022984+0000","last_active":"2024-05-08T18:53:34.861465+0000","last_peered":"2024-05-08T18:53:34.861465+0000","last_clean":"2024-05-08T18:53:34.861465+0000","last_became_active":"2024-05-08T18:50:28.022359+0000","last_became_peered":"2024-05-08T18:50:28.022359+0000","last_unstale":"2024-05-08T18:53:34.861465+0000","last_undegraded":"2024-05-08T18:53:34.861465+0000","last_fullsized":"2024-05-08T18:53:34.861465+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:53.851136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.535196+0000","last_change":"2024-05-08T18:50:26.017214+0000","last_active":"2024-05-08T18:53:34.535196+0000","last_peered":"2024-05-08T18:53:34.535196+0000","last_clean":"2024-05-08T18:53:34.535196+0000","last_became_active":"2024-05-08T18:50:26.016932+0000","last_became_peered":"2024-05-08T18:50:26.016932+0000","last_unstale":"2024-05-08T18:53:34.535196+0000","last_undegraded":"2024-05-08T18:53:34.535196+0000","last_fullsized":"2024-05-08T18:53:34.535196+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:16:36.779493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"27'41","reported_seq":107,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.843008+0000","last_change":"2024-05-08T18:50:36.055719+0000","last_active":"2024-05-08T18:53:34.843008+0000","last_peered":"2024-05-08T18:53:34.843008+0000","last_clean":"2024-05-08T18:53:34.843008+0000","last_became_active":"2024-05-08T18:50:36.055045+0000","last_became_peered":"2024-05-08T18:50:36.055045+0000","last_unstale":"2024-05-08T18:53:34.843008+0000","last_undegraded":"2024-05-08T18:53:34.843008+0000","last_fullsized":"2024-05-08T18:53:34.843008+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:51.311129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":182,"num_write":115,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'10","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.823446+0000","last_change":"2024-05-08T18:50:28.025676+0000","last_active":"2024-05-08T18:53:34.823446+0000","last_peered":"2024-05-08T18:53:34.823446+0000","last_clean":"2024-05-08T18:53:34.823446+0000","last_became_active":"2024-05-08T18:50:28.025239+0000","last_became_peered":"2024-05-08T18:50:28.025239+0000","last_unstale":"2024-05-08T18:53:34.823446+0000","last_undegraded":"2024-05-08T18:53:34.823446+0000","last_fullsized":"2024-05-08T18:53:34.823446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:43.734077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077683+0000","last_change":"2024-05-08T18:50:26.026659+0000","last_active":"2024-05-08T18:51:15.077683+0000","last_peered":"2024-05-08T18:51:15.077683+0000","last_clean":"2024-05-08T18:51:15.077683+0000","last_became_active":"2024-05-08T18:50:26.026400+0000","last_became_peered":"2024-05-08T18:50:26.026400+0000","last_unstale":"2024-05-08T18:51:15.077683+0000","last_undegraded":"2024-05-08T18:51:15.077683+0000","last_fullsized":"2024-05-08T18:51:15.077683+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:42.961279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079375+0000","last_change":"2024-05-08T18:50:30.036048+0000","last_active":"2024-05-08T18:51:15.079375+0000","last_peered":"2024-05-08T18:51:15.079375+0000","last_clean":"2024-05-08T18:51:15.079375+0000","last_became_active":"2024-05-08T18:50:30.034832+0000","last_became_peered":"2024-05-08T18:50:30.034832+0000","last_unstale":"2024-05-08T18:51:15.079375+0000","last_undegraded":"2024-05-08T18:51:15.079375+0000","last_fullsized":"2024-05-08T18:51:15.079375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:46.416875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"27'33","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.568215+0000","last_change":"2024-05-08T18:50:32.044302+0000","last_active":"2024-05-08T18:53:41.568215+0000","last_peered":"2024-05-08T18:53:41.568215+0000","last_clean":"2024-05-08T18:53:41.568215+0000","last_became_active":"2024-05-08T18:50:32.042432+0000","last_became_peered":"2024-05-08T18:50:32.042432+0000","last_unstale":"2024-05-08T18:53:41.568215+0000","last_undegraded":"2024-05-08T18:53:41.568215+0000","last_fullsized":"2024-05-08T18:53:41.568215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:10.539618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081525+0000","last_change":"2024-05-08T18:50:34.048749+0000","last_active":"2024-05-08T18:51:15.081525+0000","last_peered":"2024-05-08T18:51:15.081525+0000","last_clean":"2024-05-08T18:51:15.081525+0000","last_became_active":"2024-05-08T18:50:34.048339+0000","last_became_peered":"2024-05-08T18:50:34.048339+0000","last_unstale":"2024-05-08T18:51:15.081525+0000","last_undegraded":"2024-05-08T18:51:15.081525+0000","last_fullsized":"2024-05-08T18:51:15.081525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:11.762112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"27'7","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.481284+0000","last_change":"2024-05-08T18:50:36.055618+0000","last_active":"2024-05-08T18:51:50.481284+0000","last_peered":"2024-05-08T18:51:50.481284+0000","last_clean":"2024-05-08T18:51:50.481284+0000","last_became_active":"2024-05-08T18:50:36.055220+0000","last_became_peered":"2024-05-08T18:50:36.055220+0000","last_unstale":"2024-05-08T18:51:50.481284+0000","last_undegraded":"2024-05-08T18:51:50.481284+0000","last_fullsized":"2024-05-08T18:51:50.481284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:17.604372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"25'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.080146+0000","last_change":"2024-05-08T18:50:28.038524+0000","last_active":"2024-05-08T18:51:15.080146+0000","last_peered":"2024-05-08T18:51:15.080146+0000","last_clean":"2024-05-08T18:51:15.080146+0000","last_became_active":"2024-05-08T18:50:28.038232+0000","last_became_peered":"2024-05-08T18:50:28.038232+0000","last_unstale":"2024-05-08T18:51:15.080146+0000","last_undegraded":"2024-05-08T18:51:15.080146+0000","last_fullsized":"2024-05-08T18:51:15.080146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:25.476484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.495989+0000","last_change":"2024-05-08T18:50:26.031250+0000","last_active":"2024-05-08T18:53:34.495989+0000","last_peered":"2024-05-08T18:53:34.495989+0000","last_clean":"2024-05-08T18:53:34.495989+0000","last_became_active":"2024-05-08T18:50:26.030986+0000","last_became_peered":"2024-05-08T18:50:26.030986+0000","last_unstale":"2024-05-08T18:53:34.495989+0000","last_undegraded":"2024-05-08T18:53:34.495989+0000","last_fullsized":"2024-05-08T18:53:34.495989+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:47.462940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073251+0000","last_change":"2024-05-08T18:50:30.026937+0000","last_active":"2024-05-08T18:51:15.073251+0000","last_peered":"2024-05-08T18:51:15.073251+0000","last_clean":"2024-05-08T18:51:15.073251+0000","last_became_active":"2024-05-08T18:50:30.026538+0000","last_became_peered":"2024-05-08T18:50:30.026538+0000","last_unstale":"2024-05-08T18:51:15.073251+0000","last_undegraded":"2024-05-08T18:51:15.073251+0000","last_fullsized":"2024-05-08T18:51:15.073251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:07.500017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"25'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081630+0000","last_change":"2024-05-08T18:50:32.039340+0000","last_active":"2024-05-08T18:51:15.081630+0000","last_peered":"2024-05-08T18:51:15.081630+0000","last_clean":"2024-05-08T18:51:15.081630+0000","last_became_active":"2024-05-08T18:50:32.039031+0000","last_became_peered":"2024-05-08T18:50:32.039031+0000","last_unstale":"2024-05-08T18:51:15.081630+0000","last_undegraded":"2024-05-08T18:51:15.081630+0000","last_fullsized":"2024-05-08T18:51:15.081630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:40.432123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.080159+0000","last_change":"2024-05-08T18:50:34.050921+0000","last_active":"2024-05-08T18:51:15.080159+0000","last_peered":"2024-05-08T18:51:15.080159+0000","last_clean":"2024-05-08T18:51:15.080159+0000","last_became_active":"2024-05-08T18:50:34.050512+0000","last_became_peered":"2024-05-08T18:50:34.050512+0000","last_unstale":"2024-05-08T18:51:15.080159+0000","last_undegraded":"2024-05-08T18:51:15.080159+0000","last_fullsized":"2024-05-08T18:51:15.080159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:12.079998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"25'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072106+0000","last_change":"2024-05-08T18:50:36.048388+0000","last_active":"2024-05-08T18:51:15.072106+0000","last_peered":"2024-05-08T18:51:15.072106+0000","last_clean":"2024-05-08T18:51:15.072106+0000","last_became_active":"2024-05-08T18:50:36.048075+0000","last_became_peered":"2024-05-08T18:50:36.048075+0000","last_unstale":"2024-05-08T18:51:15.072106+0000","last_undegraded":"2024-05-08T18:51:15.072106+0000","last_fullsized":"2024-05-08T18:51:15.072106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:35.422216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'10","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.861231+0000","last_change":"2024-05-08T18:50:28.026321+0000","last_active":"2024-05-08T18:53:34.861231+0000","last_peered":"2024-05-08T18:53:34.861231+0000","last_clean":"2024-05-08T18:53:34.861231+0000","last_became_active":"2024-05-08T18:50:28.025867+0000","last_became_peered":"2024-05-08T18:50:28.025867+0000","last_unstale":"2024-05-08T18:53:34.861231+0000","last_undegraded":"2024-05-08T18:53:34.861231+0000","last_fullsized":"2024-05-08T18:53:34.861231+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:19:58.219100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.520268+0000","last_change":"2024-05-08T18:50:26.025750+0000","last_active":"2024-05-08T18:53:34.520268+0000","last_peered":"2024-05-08T18:53:34.520268+0000","last_clean":"2024-05-08T18:53:34.520268+0000","last_became_active":"2024-05-08T18:50:26.025410+0000","last_became_peered":"2024-05-08T18:50:26.025410+0000","last_unstale":"2024-05-08T18:53:34.520268+0000","last_undegraded":"2024-05-08T18:53:34.520268+0000","last_fullsized":"2024-05-08T18:53:34.520268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:50:43.198256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075129+0000","last_change":"2024-05-08T18:50:30.029531+0000","last_active":"2024-05-08T18:51:15.075129+0000","last_peered":"2024-05-08T18:51:15.075129+0000","last_clean":"2024-05-08T18:51:15.075129+0000","last_became_active":"2024-05-08T18:50:30.029196+0000","last_became_peered":"2024-05-08T18:50:30.029196+0000","last_unstale":"2024-05-08T18:51:15.075129+0000","last_undegraded":"2024-05-08T18:51:15.075129+0000","last_fullsized":"2024-05-08T18:51:15.075129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:03.285378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"25'10","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078489+0000","last_change":"2024-05-08T18:50:32.044406+0000","last_active":"2024-05-08T18:51:15.078489+0000","last_peered":"2024-05-08T18:51:15.078489+0000","last_clean":"2024-05-08T18:51:15.078489+0000","last_became_active":"2024-05-08T18:50:32.044056+0000","last_became_peered":"2024-05-08T18:50:32.044056+0000","last_unstale":"2024-05-08T18:51:15.078489+0000","last_undegraded":"2024-05-08T18:51:15.078489+0000","last_fullsized":"2024-05-08T18:51:15.078489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:24.002892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"27'285","reported_seq":393,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.416991+0000","last_change":"2024-05-08T18:50:34.042149+0000","last_active":"2024-05-08T18:53:41.416991+0000","last_peered":"2024-05-08T18:53:41.416991+0000","last_clean":"2024-05-08T18:53:41.416991+0000","last_became_active":"2024-05-08T18:50:34.041872+0000","last_became_peered":"2024-05-08T18:50:34.041872+0000","last_unstale":"2024-05-08T18:53:41.416991+0000","last_undegraded":"2024-05-08T18:53:41.416991+0000","last_fullsized":"2024-05-08T18:53:41.416991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:15:51.976316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075671+0000","last_change":"2024-05-08T18:50:36.049616+0000","last_active":"2024-05-08T18:51:15.075671+0000","last_peered":"2024-05-08T18:51:15.075671+0000","last_clean":"2024-05-08T18:51:15.075671+0000","last_became_active":"2024-05-08T18:50:36.049346+0000","last_became_peered":"2024-05-08T18:50:36.049346+0000","last_unstale":"2024-05-08T18:51:15.075671+0000","last_undegraded":"2024-05-08T18:51:15.075671+0000","last_fullsized":"2024-05-08T18:51:15.075671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:30:50.522610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'6","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:31.121826+0000","last_change":"2024-05-08T18:50:28.031653+0000","last_active":"2024-05-08T18:52:31.121826+0000","last_peered":"2024-05-08T18:52:31.121826+0000","last_clean":"2024-05-08T18:52:31.121826+0000","last_became_active":"2024-05-08T18:50:28.031332+0000","last_became_peered":"2024-05-08T18:50:28.031332+0000","last_unstale":"2024-05-08T18:52:31.121826+0000","last_undegraded":"2024-05-08T18:52:31.121826+0000","last_fullsized":"2024-05-08T18:52:31.121826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:30.052454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076511+0000","last_change":"2024-05-08T18:50:26.032415+0000","last_active":"2024-05-08T18:51:15.076511+0000","last_peered":"2024-05-08T18:51:15.076511+0000","last_clean":"2024-05-08T18:51:15.076511+0000","last_became_active":"2024-05-08T18:50:26.032155+0000","last_became_peered":"2024-05-08T18:50:26.032155+0000","last_unstale":"2024-05-08T18:51:15.076511+0000","last_undegraded":"2024-05-08T18:51:15.076511+0000","last_fullsized":"2024-05-08T18:51:15.076511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:45.479269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"27'4","reported_seq":228,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.388429+0000","last_change":"2024-05-08T18:50:30.035403+0000","last_active":"2024-05-08T18:53:41.388429+0000","last_peered":"2024-05-08T18:53:41.388429+0000","last_clean":"2024-05-08T18:53:41.388429+0000","last_became_active":"2024-05-08T18:50:30.034798+0000","last_became_peered":"2024-05-08T18:50:30.034798+0000","last_unstale":"2024-05-08T18:53:41.388429+0000","last_undegraded":"2024-05-08T18:53:41.388429+0000","last_fullsized":"2024-05-08T18:53:41.388429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:08:03.148182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"27'33","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.552175+0000","last_change":"2024-05-08T18:50:32.043871+0000","last_active":"2024-05-08T18:53:41.552175+0000","last_peered":"2024-05-08T18:53:41.552175+0000","last_clean":"2024-05-08T18:53:41.552175+0000","last_became_active":"2024-05-08T18:50:32.043573+0000","last_became_peered":"2024-05-08T18:50:32.043573+0000","last_unstale":"2024-05-08T18:53:41.552175+0000","last_undegraded":"2024-05-08T18:53:41.552175+0000","last_fullsized":"2024-05-08T18:53:41.552175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:33:44.166474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"27'285","reported_seq":404,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.421801+0000","last_change":"2024-05-08T18:50:34.050464+0000","last_active":"2024-05-08T18:53:41.421801+0000","last_peered":"2024-05-08T18:53:41.421801+0000","last_clean":"2024-05-08T18:53:41.421801+0000","last_became_active":"2024-05-08T18:50:34.050122+0000","last_became_peered":"2024-05-08T18:50:34.050122+0000","last_unstale":"2024-05-08T18:53:41.421801+0000","last_undegraded":"2024-05-08T18:53:41.421801+0000","last_fullsized":"2024-05-08T18:53:41.421801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:11.762112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"27'6","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.691043+0000","last_change":"2024-05-08T18:50:28.035510+0000","last_active":"2024-05-08T18:53:34.691043+0000","last_peered":"2024-05-08T18:53:34.691043+0000","last_clean":"2024-05-08T18:53:34.691043+0000","last_became_active":"2024-05-08T18:50:28.034992+0000","last_became_peered":"2024-05-08T18:50:28.034992+0000","last_unstale":"2024-05-08T18:53:34.691043+0000","last_undegraded":"2024-05-08T18:53:34.691043+0000","last_fullsized":"2024-05-08T18:53:34.691043+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:42:18.934758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079658+0000","last_change":"2024-05-08T18:50:26.023445+0000","last_active":"2024-05-08T18:51:15.079658+0000","last_peered":"2024-05-08T18:51:15.079658+0000","last_clean":"2024-05-08T18:51:15.079658+0000","last_became_active":"2024-05-08T18:50:26.023141+0000","last_became_peered":"2024-05-08T18:50:26.023141+0000","last_unstale":"2024-05-08T18:51:15.079658+0000","last_undegraded":"2024-05-08T18:51:15.079658+0000","last_fullsized":"2024-05-08T18:51:15.079658+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:07.534900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075851+0000","last_change":"2024-05-08T18:50:30.030136+0000","last_active":"2024-05-08T18:51:15.075851+0000","last_peered":"2024-05-08T18:51:15.075851+0000","last_clean":"2024-05-08T18:51:15.075851+0000","last_became_active":"2024-05-08T18:50:30.029482+0000","last_became_peered":"2024-05-08T18:50:30.029482+0000","last_unstale":"2024-05-08T18:51:15.075851+0000","last_undegraded":"2024-05-08T18:51:15.075851+0000","last_fullsized":"2024-05-08T18:51:15.075851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:13:46.352309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"27'44","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.470445+0000","last_change":"2024-05-08T18:50:32.038383+0000","last_active":"2024-05-08T18:53:41.470445+0000","last_peered":"2024-05-08T18:53:41.470445+0000","last_clean":"2024-05-08T18:53:41.470445+0000","last_became_active":"2024-05-08T18:50:32.038121+0000","last_became_peered":"2024-05-08T18:50:32.038121+0000","last_unstale":"2024-05-08T18:53:41.470445+0000","last_undegraded":"2024-05-08T18:53:41.470445+0000","last_fullsized":"2024-05-08T18:53:41.470445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:18.512526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072455+0000","last_change":"2024-05-08T18:50:34.047709+0000","last_active":"2024-05-08T18:51:15.072455+0000","last_peered":"2024-05-08T18:51:15.072455+0000","last_clean":"2024-05-08T18:51:15.072455+0000","last_became_active":"2024-05-08T18:50:34.047404+0000","last_became_peered":"2024-05-08T18:50:34.047404+0000","last_unstale":"2024-05-08T18:51:15.072455+0000","last_undegraded":"2024-05-08T18:51:15.072455+0000","last_fullsized":"2024-05-08T18:51:15.072455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:54.419559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"27'3","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.483004+0000","last_change":"2024-05-08T18:50:36.052192+0000","last_active":"2024-05-08T18:51:50.483004+0000","last_peered":"2024-05-08T18:51:50.483004+0000","last_clean":"2024-05-08T18:51:50.483004+0000","last_became_active":"2024-05-08T18:50:36.051055+0000","last_became_peered":"2024-05-08T18:50:36.051055+0000","last_unstale":"2024-05-08T18:51:50.483004+0000","last_undegraded":"2024-05-08T18:51:50.483004+0000","last_fullsized":"2024-05-08T18:51:50.483004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:38.752303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"27'7","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.868063+0000","last_change":"2024-05-08T18:50:28.018783+0000","last_active":"2024-05-08T18:53:34.868063+0000","last_peered":"2024-05-08T18:53:34.868063+0000","last_clean":"2024-05-08T18:53:34.868063+0000","last_became_active":"2024-05-08T18:50:28.018022+0000","last_became_peered":"2024-05-08T18:50:28.018022+0000","last_unstale":"2024-05-08T18:53:34.868063+0000","last_undegraded":"2024-05-08T18:53:34.868063+0000","last_fullsized":"2024-05-08T18:53:34.868063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:23.858287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076642+0000","last_change":"2024-05-08T18:50:26.025311+0000","last_active":"2024-05-08T18:51:15.076642+0000","last_peered":"2024-05-08T18:51:15.076642+0000","last_clean":"2024-05-08T18:51:15.076642+0000","last_became_active":"2024-05-08T18:50:26.025028+0000","last_became_peered":"2024-05-08T18:50:26.025028+0000","last_unstale":"2024-05-08T18:51:15.076642+0000","last_undegraded":"2024-05-08T18:51:15.076642+0000","last_fullsized":"2024-05-08T18:51:15.076642+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:08:13.942735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072580+0000","last_change":"2024-05-08T18:50:30.032000+0000","last_active":"2024-05-08T18:51:15.072580+0000","last_peered":"2024-05-08T18:51:15.072580+0000","last_clean":"2024-05-08T18:51:15.072580+0000","last_became_active":"2024-05-08T18:50:30.031574+0000","last_became_peered":"2024-05-08T18:50:30.031574+0000","last_unstale":"2024-05-08T18:51:15.072580+0000","last_undegraded":"2024-05-08T18:51:15.072580+0000","last_fullsized":"2024-05-08T18:51:15.072580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:05.406989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"27'35","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.519643+0000","last_change":"2024-05-08T18:50:32.042012+0000","last_active":"2024-05-08T18:53:41.519643+0000","last_peered":"2024-05-08T18:53:41.519643+0000","last_clean":"2024-05-08T18:53:41.519643+0000","last_became_active":"2024-05-08T18:50:32.041239+0000","last_became_peered":"2024-05-08T18:50:32.041239+0000","last_unstale":"2024-05-08T18:53:41.519643+0000","last_undegraded":"2024-05-08T18:53:41.519643+0000","last_fullsized":"2024-05-08T18:53:41.519643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:21.232439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072331+0000","last_change":"2024-05-08T18:50:34.044867+0000","last_active":"2024-05-08T18:51:15.072331+0000","last_peered":"2024-05-08T18:51:15.072331+0000","last_clean":"2024-05-08T18:51:15.072331+0000","last_became_active":"2024-05-08T18:50:34.044487+0000","last_became_peered":"2024-05-08T18:50:34.044487+0000","last_unstale":"2024-05-08T18:51:15.072331+0000","last_undegraded":"2024-05-08T18:51:15.072331+0000","last_fullsized":"2024-05-08T18:51:15.072331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:26:22.790796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"27'7","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.864198+0000","last_change":"2024-05-08T18:50:36.051009+0000","last_active":"2024-05-08T18:53:34.864198+0000","last_peered":"2024-05-08T18:53:34.864198+0000","last_clean":"2024-05-08T18:53:34.864198+0000","last_became_active":"2024-05-08T18:50:36.050379+0000","last_became_peered":"2024-05-08T18:50:36.050379+0000","last_unstale":"2024-05-08T18:53:34.864198+0000","last_undegraded":"2024-05-08T18:53:34.864198+0000","last_fullsized":"2024-05-08T18:53:34.864198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:50.929055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:31.119400+0000","last_change":"2024-05-08T18:50:28.037118+0000","last_active":"2024-05-08T18:52:31.119400+0000","last_peered":"2024-05-08T18:52:31.119400+0000","last_clean":"2024-05-08T18:52:31.119400+0000","last_became_active":"2024-05-08T18:50:28.036821+0000","last_became_peered":"2024-05-08T18:50:28.036821+0000","last_unstale":"2024-05-08T18:52:31.119400+0000","last_undegraded":"2024-05-08T18:52:31.119400+0000","last_fullsized":"2024-05-08T18:52:31.119400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:32.493176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079688+0000","last_change":"2024-05-08T18:50:26.023248+0000","last_active":"2024-05-08T18:51:15.079688+0000","last_peered":"2024-05-08T18:51:15.079688+0000","last_clean":"2024-05-08T18:51:15.079688+0000","last_became_active":"2024-05-08T18:50:26.022938+0000","last_became_peered":"2024-05-08T18:50:26.022938+0000","last_unstale":"2024-05-08T18:51:15.079688+0000","last_undegraded":"2024-05-08T18:51:15.079688+0000","last_fullsized":"2024-05-08T18:51:15.079688+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:53.195171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073993+0000","last_change":"2024-05-08T18:50:30.029421+0000","last_active":"2024-05-08T18:51:15.073993+0000","last_peered":"2024-05-08T18:51:15.073993+0000","last_clean":"2024-05-08T18:51:15.073993+0000","last_became_active":"2024-05-08T18:50:30.029134+0000","last_became_peered":"2024-05-08T18:50:30.029134+0000","last_unstale":"2024-05-08T18:51:15.073993+0000","last_undegraded":"2024-05-08T18:51:15.073993+0000","last_fullsized":"2024-05-08T18:51:15.073993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:46.684447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"27'40","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.476223+0000","last_change":"2024-05-08T18:50:32.035457+0000","last_active":"2024-05-08T18:53:41.476223+0000","last_peered":"2024-05-08T18:53:41.476223+0000","last_clean":"2024-05-08T18:53:41.476223+0000","last_became_active":"2024-05-08T18:50:32.035189+0000","last_became_peered":"2024-05-08T18:50:32.035189+0000","last_unstale":"2024-05-08T18:53:41.476223+0000","last_undegraded":"2024-05-08T18:53:41.476223+0000","last_fullsized":"2024-05-08T18:53:41.476223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:02.364503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"27'285","reported_seq":357,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.423016+0000","last_change":"2024-05-08T18:50:34.048274+0000","last_active":"2024-05-08T18:53:41.423016+0000","last_peered":"2024-05-08T18:53:41.423016+0000","last_clean":"2024-05-08T18:53:41.423016+0000","last_became_active":"2024-05-08T18:50:34.047999+0000","last_became_peered":"2024-05-08T18:50:34.047999+0000","last_unstale":"2024-05-08T18:53:41.423016+0000","last_undegraded":"2024-05-08T18:53:41.423016+0000","last_fullsized":"2024-05-08T18:53:41.423016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:36.744889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073643+0000","last_change":"2024-05-08T18:50:36.048278+0000","last_active":"2024-05-08T18:51:15.073643+0000","last_peered":"2024-05-08T18:51:15.073643+0000","last_clean":"2024-05-08T18:51:15.073643+0000","last_became_active":"2024-05-08T18:50:36.047981+0000","last_became_peered":"2024-05-08T18:50:36.047981+0000","last_unstale":"2024-05-08T18:51:15.073643+0000","last_undegraded":"2024-05-08T18:51:15.073643+0000","last_fullsized":"2024-05-08T18:51:15.073643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:39.176315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"27'8","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.474560+0000","last_change":"2024-05-08T18:50:28.020443+0000","last_active":"2024-05-08T18:51:50.474560+0000","last_peered":"2024-05-08T18:51:50.474560+0000","last_clean":"2024-05-08T18:51:50.474560+0000","last_became_active":"2024-05-08T18:50:28.020004+0000","last_became_peered":"2024-05-08T18:50:28.020004+0000","last_unstale":"2024-05-08T18:51:50.474560+0000","last_undegraded":"2024-05-08T18:51:50.474560+0000","last_fullsized":"2024-05-08T18:51:50.474560+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:26.670671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079070+0000","last_change":"2024-05-08T18:50:26.017413+0000","last_active":"2024-05-08T18:51:15.079070+0000","last_peered":"2024-05-08T18:51:15.079070+0000","last_clean":"2024-05-08T18:51:15.079070+0000","last_became_active":"2024-05-08T18:50:26.015955+0000","last_became_peered":"2024-05-08T18:50:26.015955+0000","last_unstale":"2024-05-08T18:51:15.079070+0000","last_undegraded":"2024-05-08T18:51:15.079070+0000","last_fullsized":"2024-05-08T18:51:15.079070+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:59.585275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073289+0000","last_change":"2024-05-08T18:50:30.030443+0000","last_active":"2024-05-08T18:51:15.073289+0000","last_peered":"2024-05-08T18:51:15.073289+0000","last_clean":"2024-05-08T18:51:15.073289+0000","last_became_active":"2024-05-08T18:50:30.030140+0000","last_became_peered":"2024-05-08T18:50:30.030140+0000","last_unstale":"2024-05-08T18:51:15.073289+0000","last_undegraded":"2024-05-08T18:51:15.073289+0000","last_fullsized":"2024-05-08T18:51:15.073289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:27.912865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"27'61","reported_seq":125,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.528127+0000","last_change":"2024-05-08T18:50:32.041420+0000","last_active":"2024-05-08T18:53:41.528127+0000","last_peered":"2024-05-08T18:53:41.528127+0000","last_clean":"2024-05-08T18:53:41.528127+0000","last_became_active":"2024-05-08T18:50:32.040633+0000","last_became_peered":"2024-05-08T18:50:32.040633+0000","last_unstale":"2024-05-08T18:53:41.528127+0000","last_undegraded":"2024-05-08T18:53:41.528127+0000","last_fullsized":"2024-05-08T18:53:41.528127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:36:35.162116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072394+0000","last_change":"2024-05-08T18:50:34.044110+0000","last_active":"2024-05-08T18:51:15.072394+0000","last_peered":"2024-05-08T18:51:15.072394+0000","last_clean":"2024-05-08T18:51:15.072394+0000","last_became_active":"2024-05-08T18:50:34.043817+0000","last_became_peered":"2024-05-08T18:50:34.043817+0000","last_unstale":"2024-05-08T18:51:15.072394+0000","last_undegraded":"2024-05-08T18:51:15.072394+0000","last_fullsized":"2024-05-08T18:51:15.072394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:52.535624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"27'18","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.978577+0000","last_change":"2024-05-08T18:50:36.054529+0000","last_active":"2024-05-08T18:53:34.978577+0000","last_peered":"2024-05-08T18:53:34.978577+0000","last_clean":"2024-05-08T18:53:34.978577+0000","last_became_active":"2024-05-08T18:50:36.054237+0000","last_became_peered":"2024-05-08T18:50:36.054237+0000","last_unstale":"2024-05-08T18:53:34.978577+0000","last_undegraded":"2024-05-08T18:53:34.978577+0000","last_fullsized":"2024-05-08T18:53:34.978577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:06.378701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"27'10","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.862996+0000","last_change":"2024-05-08T18:51:15.097690+0000","last_active":"2024-05-08T18:53:34.862996+0000","last_peered":"2024-05-08T18:53:34.862996+0000","last_clean":"2024-05-08T18:53:34.862996+0000","last_became_active":"2024-05-08T18:51:15.085560+0000","last_became_peered":"2024-05-08T18:51:15.085560+0000","last_unstale":"2024-05-08T18:53:34.862996+0000","last_undegraded":"2024-05-08T18:53:34.862996+0000","last_fullsized":"2024-05-08T18:53:34.862996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:42.900712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.080760+0000","last_change":"2024-05-08T18:51:15.080314+0000","last_active":"2024-05-08T18:51:15.080760+0000","last_peered":"2024-05-08T18:51:15.080760+0000","last_clean":"2024-05-08T18:51:15.080760+0000","last_became_active":"2024-05-08T18:51:15.080071+0000","last_became_peered":"2024-05-08T18:51:15.080071+0000","last_unstale":"2024-05-08T18:51:15.080760+0000","last_undegraded":"2024-05-08T18:51:15.080760+0000","last_fullsized":"2024-05-08T18:51:15.080760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:41.372462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075379+0000","last_change":"2024-05-08T18:50:30.033626+0000","last_active":"2024-05-08T18:51:15.075379+0000","last_peered":"2024-05-08T18:51:15.075379+0000","last_clean":"2024-05-08T18:51:15.075379+0000","last_became_active":"2024-05-08T18:50:30.033318+0000","last_became_peered":"2024-05-08T18:50:30.033318+0000","last_unstale":"2024-05-08T18:51:15.075379+0000","last_undegraded":"2024-05-08T18:51:15.075379+0000","last_fullsized":"2024-05-08T18:51:15.075379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:25.936937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"27'36","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.531369+0000","last_change":"2024-05-08T18:50:32.035227+0000","last_active":"2024-05-08T18:53:41.531369+0000","last_peered":"2024-05-08T18:53:41.531369+0000","last_clean":"2024-05-08T18:53:41.531369+0000","last_became_active":"2024-05-08T18:50:32.034914+0000","last_became_peered":"2024-05-08T18:50:32.034914+0000","last_unstale":"2024-05-08T18:53:41.531369+0000","last_undegraded":"2024-05-08T18:53:41.531369+0000","last_fullsized":"2024-05-08T18:53:41.531369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:42:57.344797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.082244+0000","last_change":"2024-05-08T18:50:34.047372+0000","last_active":"2024-05-08T18:51:15.082244+0000","last_peered":"2024-05-08T18:51:15.082244+0000","last_clean":"2024-05-08T18:51:15.082244+0000","last_became_active":"2024-05-08T18:50:34.047075+0000","last_became_peered":"2024-05-08T18:50:34.047075+0000","last_unstale":"2024-05-08T18:51:15.082244+0000","last_undegraded":"2024-05-08T18:51:15.082244+0000","last_fullsized":"2024-05-08T18:51:15.082244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:50:39.931353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"27'3","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.005911+0000","last_change":"2024-05-08T18:50:36.055688+0000","last_active":"2024-05-08T18:52:38.005911+0000","last_peered":"2024-05-08T18:52:38.005911+0000","last_clean":"2024-05-08T18:52:38.005911+0000","last_became_active":"2024-05-08T18:50:36.055385+0000","last_became_peered":"2024-05-08T18:50:36.055385+0000","last_unstale":"2024-05-08T18:52:38.005911+0000","last_undegraded":"2024-05-08T18:52:38.005911+0000","last_fullsized":"2024-05-08T18:52:38.005911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:06.579528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'4","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.243668+0000","last_change":"2024-05-08T18:50:28.039067+0000","last_active":"2024-05-08T18:52:34.243668+0000","last_peered":"2024-05-08T18:52:34.243668+0000","last_clean":"2024-05-08T18:52:34.243668+0000","last_became_active":"2024-05-08T18:50:28.038633+0000","last_became_peered":"2024-05-08T18:50:28.038633+0000","last_unstale":"2024-05-08T18:52:34.243668+0000","last_undegraded":"2024-05-08T18:52:34.243668+0000","last_fullsized":"2024-05-08T18:52:34.243668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:06.211199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077754+0000","last_change":"2024-05-08T18:50:26.016599+0000","last_active":"2024-05-08T18:51:15.077754+0000","last_peered":"2024-05-08T18:51:15.077754+0000","last_clean":"2024-05-08T18:51:15.077754+0000","last_became_active":"2024-05-08T18:50:26.016308+0000","last_became_peered":"2024-05-08T18:50:26.016308+0000","last_unstale":"2024-05-08T18:51:15.077754+0000","last_undegraded":"2024-05-08T18:51:15.077754+0000","last_fullsized":"2024-05-08T18:51:15.077754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:04.583010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074792+0000","last_change":"2024-05-08T18:50:30.032199+0000","last_active":"2024-05-08T18:51:15.074792+0000","last_peered":"2024-05-08T18:51:15.074792+0000","last_clean":"2024-05-08T18:51:15.074792+0000","last_became_active":"2024-05-08T18:50:30.031765+0000","last_became_peered":"2024-05-08T18:50:30.031765+0000","last_unstale":"2024-05-08T18:51:15.074792+0000","last_undegraded":"2024-05-08T18:51:15.074792+0000","last_fullsized":"2024-05-08T18:51:15.074792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:33:42.159316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"27'39","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.510400+0000","last_change":"2024-05-08T18:50:32.035413+0000","last_active":"2024-05-08T18:53:41.510400+0000","last_peered":"2024-05-08T18:53:41.510400+0000","last_clean":"2024-05-08T18:53:41.510400+0000","last_became_active":"2024-05-08T18:50:32.035131+0000","last_became_peered":"2024-05-08T18:50:32.035131+0000","last_unstale":"2024-05-08T18:53:41.510400+0000","last_undegraded":"2024-05-08T18:53:41.510400+0000","last_fullsized":"2024-05-08T18:53:41.510400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:01:11.472580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"27'285","reported_seq":433,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.417989+0000","last_change":"2024-05-08T18:50:34.047467+0000","last_active":"2024-05-08T18:53:41.417989+0000","last_peered":"2024-05-08T18:53:41.417989+0000","last_clean":"2024-05-08T18:53:41.417989+0000","last_became_active":"2024-05-08T18:50:34.047184+0000","last_became_peered":"2024-05-08T18:50:34.047184+0000","last_unstale":"2024-05-08T18:53:41.417989+0000","last_undegraded":"2024-05-08T18:53:41.417989+0000","last_fullsized":"2024-05-08T18:53:41.417989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:17.134805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"27'12","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.001806+0000","last_change":"2024-05-08T18:50:36.046523+0000","last_active":"2024-05-08T18:52:43.001806+0000","last_peered":"2024-05-08T18:52:43.001806+0000","last_clean":"2024-05-08T18:52:43.001806+0000","last_became_active":"2024-05-08T18:50:36.046209+0000","last_became_peered":"2024-05-08T18:50:36.046209+0000","last_unstale":"2024-05-08T18:52:43.001806+0000","last_undegraded":"2024-05-08T18:52:43.001806+0000","last_fullsized":"2024-05-08T18:52:43.001806+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:18.424066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'6","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.661317+0000","last_change":"2024-05-08T18:50:28.037293+0000","last_active":"2024-05-08T18:51:50.661317+0000","last_peered":"2024-05-08T18:51:50.661317+0000","last_clean":"2024-05-08T18:51:50.661317+0000","last_became_active":"2024-05-08T18:50:28.036946+0000","last_became_peered":"2024-05-08T18:50:28.036946+0000","last_unstale":"2024-05-08T18:51:50.661317+0000","last_undegraded":"2024-05-08T18:51:50.661317+0000","last_fullsized":"2024-05-08T18:51:50.661317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:01.592206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076372+0000","last_change":"2024-05-08T18:50:26.027911+0000","last_active":"2024-05-08T18:51:15.076372+0000","last_peered":"2024-05-08T18:51:15.076372+0000","last_clean":"2024-05-08T18:51:15.076372+0000","last_became_active":"2024-05-08T18:50:26.027657+0000","last_became_peered":"2024-05-08T18:50:26.027657+0000","last_unstale":"2024-05-08T18:51:15.076372+0000","last_undegraded":"2024-05-08T18:51:15.076372+0000","last_fullsized":"2024-05-08T18:51:15.076372+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:36.094238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"27'3","reported_seq":417,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.398774+0000","last_change":"2024-05-08T18:50:30.027736+0000","last_active":"2024-05-08T18:53:41.398774+0000","last_peered":"2024-05-08T18:53:41.398774+0000","last_clean":"2024-05-08T18:53:41.398774+0000","last_became_active":"2024-05-08T18:50:30.027420+0000","last_became_peered":"2024-05-08T18:50:30.027420+0000","last_unstale":"2024-05-08T18:53:41.398774+0000","last_undegraded":"2024-05-08T18:53:41.398774+0000","last_fullsized":"2024-05-08T18:53:41.398774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:18.447327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'11","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007718+0000","last_change":"2024-05-08T18:50:32.041941+0000","last_active":"2024-05-08T18:52:48.007718+0000","last_peered":"2024-05-08T18:52:48.007718+0000","last_clean":"2024-05-08T18:52:48.007718+0000","last_became_active":"2024-05-08T18:50:32.040988+0000","last_became_peered":"2024-05-08T18:50:32.040988+0000","last_unstale":"2024-05-08T18:52:48.007718+0000","last_undegraded":"2024-05-08T18:52:48.007718+0000","last_fullsized":"2024-05-08T18:52:48.007718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:07.623019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"27'285","reported_seq":462,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.419226+0000","last_change":"2024-05-08T18:50:34.040798+0000","last_active":"2024-05-08T18:53:41.419226+0000","last_peered":"2024-05-08T18:53:41.419226+0000","last_clean":"2024-05-08T18:53:41.419226+0000","last_became_active":"2024-05-08T18:50:34.040477+0000","last_became_peered":"2024-05-08T18:50:34.040477+0000","last_unstale":"2024-05-08T18:53:41.419226+0000","last_undegraded":"2024-05-08T18:53:41.419226+0000","last_fullsized":"2024-05-08T18:53:41.419226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:35.940316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.028319+0000","last_change":"2024-05-08T18:50:36.047258+0000","last_active":"2024-05-08T18:52:34.028319+0000","last_peered":"2024-05-08T18:52:34.028319+0000","last_clean":"2024-05-08T18:52:34.028319+0000","last_became_active":"2024-05-08T18:50:36.045976+0000","last_became_peered":"2024-05-08T18:50:36.045976+0000","last_unstale":"2024-05-08T18:52:34.028319+0000","last_undegraded":"2024-05-08T18:52:34.028319+0000","last_fullsized":"2024-05-08T18:52:34.028319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:00.262083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.823223+0000","last_change":"2024-05-08T18:50:28.039262+0000","last_active":"2024-05-08T18:53:34.823223+0000","last_peered":"2024-05-08T18:53:34.823223+0000","last_clean":"2024-05-08T18:53:34.823223+0000","last_became_active":"2024-05-08T18:50:28.038871+0000","last_became_peered":"2024-05-08T18:50:28.038871+0000","last_unstale":"2024-05-08T18:53:34.823223+0000","last_undegraded":"2024-05-08T18:53:34.823223+0000","last_fullsized":"2024-05-08T18:53:34.823223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:03.400002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073931+0000","last_change":"2024-05-08T18:50:26.025766+0000","last_active":"2024-05-08T18:51:15.073931+0000","last_peered":"2024-05-08T18:51:15.073931+0000","last_clean":"2024-05-08T18:51:15.073931+0000","last_became_active":"2024-05-08T18:50:26.025547+0000","last_became_peered":"2024-05-08T18:50:26.025547+0000","last_unstale":"2024-05-08T18:51:15.073931+0000","last_undegraded":"2024-05-08T18:51:15.073931+0000","last_fullsized":"2024-05-08T18:51:15.073931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:51:35.439520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079352+0000","last_change":"2024-05-08T18:50:30.036033+0000","last_active":"2024-05-08T18:51:15.079352+0000","last_peered":"2024-05-08T18:51:15.079352+0000","last_clean":"2024-05-08T18:51:15.079352+0000","last_became_active":"2024-05-08T18:50:30.035734+0000","last_became_peered":"2024-05-08T18:50:30.035734+0000","last_unstale":"2024-05-08T18:51:15.079352+0000","last_undegraded":"2024-05-08T18:51:15.079352+0000","last_fullsized":"2024-05-08T18:51:15.079352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:41:58.722929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"27'41","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.461464+0000","last_change":"2024-05-08T18:50:32.035183+0000","last_active":"2024-05-08T18:53:41.461464+0000","last_peered":"2024-05-08T18:53:41.461464+0000","last_clean":"2024-05-08T18:53:41.461464+0000","last_became_active":"2024-05-08T18:50:32.034769+0000","last_became_peered":"2024-05-08T18:50:32.034769+0000","last_unstale":"2024-05-08T18:53:41.461464+0000","last_undegraded":"2024-05-08T18:53:41.461464+0000","last_fullsized":"2024-05-08T18:53:41.461464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:53.194472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076855+0000","last_change":"2024-05-08T18:50:34.050327+0000","last_active":"2024-05-08T18:51:15.076855+0000","last_peered":"2024-05-08T18:51:15.076855+0000","last_clean":"2024-05-08T18:51:15.076855+0000","last_became_active":"2024-05-08T18:50:34.050018+0000","last_became_peered":"2024-05-08T18:50:34.050018+0000","last_unstale":"2024-05-08T18:51:15.076855+0000","last_undegraded":"2024-05-08T18:51:15.076855+0000","last_fullsized":"2024-05-08T18:51:15.076855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:38.228671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"27'8","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.918767+0000","last_change":"2024-05-08T18:50:36.049559+0000","last_active":"2024-05-08T18:53:34.918767+0000","last_peered":"2024-05-08T18:53:34.918767+0000","last_clean":"2024-05-08T18:53:34.918767+0000","last_became_active":"2024-05-08T18:50:36.049274+0000","last_became_peered":"2024-05-08T18:50:36.049274+0000","last_unstale":"2024-05-08T18:53:34.918767+0000","last_undegraded":"2024-05-08T18:53:34.918767+0000","last_fullsized":"2024-05-08T18:53:34.918767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:38:35.422216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'8","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887656+0000","last_change":"2024-05-08T18:50:28.037991+0000","last_active":"2024-05-08T18:53:34.887656+0000","last_peered":"2024-05-08T18:53:34.887656+0000","last_clean":"2024-05-08T18:53:34.887656+0000","last_became_active":"2024-05-08T18:50:28.037545+0000","last_became_peered":"2024-05-08T18:50:28.037545+0000","last_unstale":"2024-05-08T18:53:34.887656+0000","last_undegraded":"2024-05-08T18:53:34.887656+0000","last_fullsized":"2024-05-08T18:53:34.887656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:00.327493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":133,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073990+0000","last_change":"2024-05-08T18:50:19.740594+0000","last_active":"2024-05-08T18:51:15.073990+0000","last_peered":"2024-05-08T18:51:15.073990+0000","last_clean":"2024-05-08T18:51:15.073990+0000","last_became_active":"2024-05-08T18:50:19.739986+0000","last_became_peered":"2024-05-08T18:50:19.739986+0000","last_unstale":"2024-05-08T18:51:15.073990+0000","last_undegraded":"2024-05-08T18:51:15.073990+0000","last_fullsized":"2024-05-08T18:51:15.073990+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:57.647604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077812+0000","last_change":"2024-05-08T18:50:19.740266+0000","last_active":"2024-05-08T18:51:15.077812+0000","last_peered":"2024-05-08T18:51:15.077812+0000","last_clean":"2024-05-08T18:51:15.077812+0000","last_became_active":"2024-05-08T18:50:19.739403+0000","last_became_peered":"2024-05-08T18:50:19.739403+0000","last_unstale":"2024-05-08T18:51:15.077812+0000","last_undegraded":"2024-05-08T18:51:15.077812+0000","last_fullsized":"2024-05-08T18:51:15.077812+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:59:48.671095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076533+0000","last_change":"2024-05-08T18:50:26.026328+0000","last_active":"2024-05-08T18:51:15.076533+0000","last_peered":"2024-05-08T18:51:15.076533+0000","last_clean":"2024-05-08T18:51:15.076533+0000","last_became_active":"2024-05-08T18:50:26.024249+0000","last_became_peered":"2024-05-08T18:50:26.024249+0000","last_unstale":"2024-05-08T18:51:15.076533+0000","last_undegraded":"2024-05-08T18:51:15.076533+0000","last_fullsized":"2024-05-08T18:51:15.076533+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:04.180310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078700+0000","last_change":"2024-05-08T18:50:30.030654+0000","last_active":"2024-05-08T18:51:15.078700+0000","last_peered":"2024-05-08T18:51:15.078700+0000","last_clean":"2024-05-08T18:51:15.078700+0000","last_became_active":"2024-05-08T18:50:30.029744+0000","last_became_peered":"2024-05-08T18:50:30.029744+0000","last_unstale":"2024-05-08T18:51:15.078700+0000","last_undegraded":"2024-05-08T18:51:15.078700+0000","last_fullsized":"2024-05-08T18:51:15.078700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:45.741064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"27'85","reported_seq":166,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.561711+0000","last_change":"2024-05-08T18:50:32.043836+0000","last_active":"2024-05-08T18:53:41.561711+0000","last_peered":"2024-05-08T18:53:41.561711+0000","last_clean":"2024-05-08T18:53:41.561711+0000","last_became_active":"2024-05-08T18:50:32.043533+0000","last_became_peered":"2024-05-08T18:50:32.043533+0000","last_unstale":"2024-05-08T18:53:41.561711+0000","last_undegraded":"2024-05-08T18:53:41.561711+0000","last_fullsized":"2024-05-08T18:53:41.561711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:19.800626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074939+0000","last_change":"2024-05-08T18:50:34.049133+0000","last_active":"2024-05-08T18:51:15.074939+0000","last_peered":"2024-05-08T18:51:15.074939+0000","last_clean":"2024-05-08T18:51:15.074939+0000","last_became_active":"2024-05-08T18:50:34.048859+0000","last_became_peered":"2024-05-08T18:50:34.048859+0000","last_unstale":"2024-05-08T18:51:15.074939+0000","last_undegraded":"2024-05-08T18:51:15.074939+0000","last_fullsized":"2024-05-08T18:51:15.074939+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:08:07.162123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"27'81","reported_seq":162,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.897033+0000","last_change":"2024-05-08T18:50:36.045215+0000","last_active":"2024-05-08T18:53:34.897033+0000","last_peered":"2024-05-08T18:53:34.897033+0000","last_clean":"2024-05-08T18:53:34.897033+0000","last_became_active":"2024-05-08T18:50:36.044928+0000","last_became_peered":"2024-05-08T18:50:36.044928+0000","last_unstale":"2024-05-08T18:53:34.897033+0000","last_undegraded":"2024-05-08T18:53:34.897033+0000","last_fullsized":"2024-05-08T18:53:34.897033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:21.101455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"27'4","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.475111+0000","last_change":"2024-05-08T18:50:28.032137+0000","last_active":"2024-05-08T18:51:50.475111+0000","last_peered":"2024-05-08T18:51:50.475111+0000","last_clean":"2024-05-08T18:51:50.475111+0000","last_became_active":"2024-05-08T18:50:28.030761+0000","last_became_peered":"2024-05-08T18:50:28.030761+0000","last_unstale":"2024-05-08T18:51:50.475111+0000","last_undegraded":"2024-05-08T18:51:50.475111+0000","last_fullsized":"2024-05-08T18:51:50.475111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:32.207743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073767+0000","last_change":"2024-05-08T18:50:19.739194+0000","last_active":"2024-05-08T18:51:15.073767+0000","last_peered":"2024-05-08T18:51:15.073767+0000","last_clean":"2024-05-08T18:51:15.073767+0000","last_became_active":"2024-05-08T18:50:19.738872+0000","last_became_peered":"2024-05-08T18:50:19.738872+0000","last_unstale":"2024-05-08T18:51:15.073767+0000","last_undegraded":"2024-05-08T18:51:15.073767+0000","last_fullsized":"2024-05-08T18:51:15.073767+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:28:20.859312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072516+0000","last_change":"2024-05-08T18:50:26.024886+0000","last_active":"2024-05-08T18:51:15.072516+0000","last_peered":"2024-05-08T18:51:15.072516+0000","last_clean":"2024-05-08T18:51:15.072516+0000","last_became_active":"2024-05-08T18:50:26.024549+0000","last_became_peered":"2024-05-08T18:50:26.024549+0000","last_unstale":"2024-05-08T18:51:15.072516+0000","last_undegraded":"2024-05-08T18:51:15.072516+0000","last_fullsized":"2024-05-08T18:51:15.072516+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:47.912064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.089720+0000","last_change":"2024-05-08T18:51:15.084930+0000","last_active":"2024-05-08T18:51:15.089720+0000","last_peered":"2024-05-08T18:51:15.089720+0000","last_clean":"2024-05-08T18:51:15.089720+0000","last_became_active":"2024-05-08T18:51:15.084599+0000","last_became_peered":"2024-05-08T18:51:15.084599+0000","last_unstale":"2024-05-08T18:51:15.089720+0000","last_undegraded":"2024-05-08T18:51:15.089720+0000","last_fullsized":"2024-05-08T18:51:15.089720+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:34.404707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"27'284","reported_seq":500,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.559667+0000","last_change":"2024-05-08T18:50:32.044834+0000","last_active":"2024-05-08T18:53:41.559667+0000","last_peered":"2024-05-08T18:53:41.559667+0000","last_clean":"2024-05-08T18:53:41.559667+0000","last_became_active":"2024-05-08T18:50:32.044539+0000","last_became_peered":"2024-05-08T18:50:32.044539+0000","last_unstale":"2024-05-08T18:53:41.559667+0000","last_undegraded":"2024-05-08T18:53:41.559667+0000","last_fullsized":"2024-05-08T18:53:41.559667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:10.225343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077927+0000","last_change":"2024-05-08T18:50:34.044400+0000","last_active":"2024-05-08T18:51:15.077927+0000","last_peered":"2024-05-08T18:51:15.077927+0000","last_clean":"2024-05-08T18:51:15.077927+0000","last_became_active":"2024-05-08T18:50:34.043966+0000","last_became_peered":"2024-05-08T18:50:34.043966+0000","last_unstale":"2024-05-08T18:51:15.077927+0000","last_undegraded":"2024-05-08T18:51:15.077927+0000","last_fullsized":"2024-05-08T18:51:15.077927+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:31:35.369229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"27'3","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.479087+0000","last_change":"2024-05-08T18:50:36.050905+0000","last_active":"2024-05-08T18:51:50.479087+0000","last_peered":"2024-05-08T18:51:50.479087+0000","last_clean":"2024-05-08T18:51:50.479087+0000","last_became_active":"2024-05-08T18:50:36.050573+0000","last_became_peered":"2024-05-08T18:50:36.050573+0000","last_unstale":"2024-05-08T18:51:50.479087+0000","last_undegraded":"2024-05-08T18:51:50.479087+0000","last_fullsized":"2024-05-08T18:51:50.479087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:54:56.963493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:31.121841+0000","last_change":"2024-05-08T18:50:28.027882+0000","last_active":"2024-05-08T18:52:31.121841+0000","last_peered":"2024-05-08T18:52:31.121841+0000","last_clean":"2024-05-08T18:52:31.121841+0000","last_became_active":"2024-05-08T18:50:28.027492+0000","last_became_peered":"2024-05-08T18:50:28.027492+0000","last_unstale":"2024-05-08T18:52:31.121841+0000","last_undegraded":"2024-05-08T18:52:31.121841+0000","last_fullsized":"2024-05-08T18:52:31.121841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:13.501403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074929+0000","last_change":"2024-05-08T18:50:19.739149+0000","last_active":"2024-05-08T18:51:15.074929+0000","last_peered":"2024-05-08T18:51:15.074929+0000","last_clean":"2024-05-08T18:51:15.074929+0000","last_became_active":"2024-05-08T18:50:19.738788+0000","last_became_peered":"2024-05-08T18:50:19.738788+0000","last_unstale":"2024-05-08T18:51:15.074929+0000","last_undegraded":"2024-05-08T18:51:15.074929+0000","last_fullsized":"2024-05-08T18:51:15.074929+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:29:46.772075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.071890+0000","last_change":"2024-05-08T18:50:26.029767+0000","last_active":"2024-05-08T18:51:15.071890+0000","last_peered":"2024-05-08T18:51:15.071890+0000","last_clean":"2024-05-08T18:51:15.071890+0000","last_became_active":"2024-05-08T18:50:26.029197+0000","last_became_peered":"2024-05-08T18:50:26.029197+0000","last_unstale":"2024-05-08T18:51:15.071890+0000","last_undegraded":"2024-05-08T18:51:15.071890+0000","last_fullsized":"2024-05-08T18:51:15.071890+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:48:59.917414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"18'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076801+0000","last_change":"2024-05-08T18:50:30.028419+0000","last_active":"2024-05-08T18:51:15.076801+0000","last_peered":"2024-05-08T18:51:15.076801+0000","last_clean":"2024-05-08T18:51:15.076801+0000","last_became_active":"2024-05-08T18:50:30.028028+0000","last_became_peered":"2024-05-08T18:50:30.028028+0000","last_unstale":"2024-05-08T18:51:15.076801+0000","last_undegraded":"2024-05-08T18:51:15.076801+0000","last_fullsized":"2024-05-08T18:51:15.076801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:34.893503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"27'16","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:30.110915+0000","last_change":"2024-05-08T18:50:32.036344+0000","last_active":"2024-05-08T18:53:30.110915+0000","last_peered":"2024-05-08T18:53:30.110915+0000","last_clean":"2024-05-08T18:53:30.110915+0000","last_became_active":"2024-05-08T18:50:32.036051+0000","last_became_peered":"2024-05-08T18:50:32.036051+0000","last_unstale":"2024-05-08T18:53:30.110915+0000","last_undegraded":"2024-05-08T18:53:30.110915+0000","last_fullsized":"2024-05-08T18:53:30.110915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:48.691605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073226+0000","last_change":"2024-05-08T18:50:34.045839+0000","last_active":"2024-05-08T18:51:15.073226+0000","last_peered":"2024-05-08T18:51:15.073226+0000","last_clean":"2024-05-08T18:51:15.073226+0000","last_became_active":"2024-05-08T18:50:34.045541+0000","last_became_peered":"2024-05-08T18:50:34.045541+0000","last_unstale":"2024-05-08T18:51:15.073226+0000","last_undegraded":"2024-05-08T18:51:15.073226+0000","last_fullsized":"2024-05-08T18:51:15.073226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:02.736870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077233+0000","last_change":"2024-05-08T18:50:36.058086+0000","last_active":"2024-05-08T18:51:15.077233+0000","last_peered":"2024-05-08T18:51:15.077233+0000","last_clean":"2024-05-08T18:51:15.077233+0000","last_became_active":"2024-05-08T18:50:36.057093+0000","last_became_peered":"2024-05-08T18:50:36.057093+0000","last_unstale":"2024-05-08T18:51:15.077233+0000","last_undegraded":"2024-05-08T18:51:15.077233+0000","last_fullsized":"2024-05-08T18:51:15.077233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:29:55.363199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'22","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887602+0000","last_change":"2024-05-08T18:50:28.026195+0000","last_active":"2024-05-08T18:53:34.887602+0000","last_peered":"2024-05-08T18:53:34.887602+0000","last_clean":"2024-05-08T18:53:34.887602+0000","last_became_active":"2024-05-08T18:50:28.025645+0000","last_became_peered":"2024-05-08T18:50:28.025645+0000","last_unstale":"2024-05-08T18:53:34.887602+0000","last_undegraded":"2024-05-08T18:53:34.887602+0000","last_fullsized":"2024-05-08T18:53:34.887602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:24.508392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076436+0000","last_change":"2024-05-08T18:50:19.739898+0000","last_active":"2024-05-08T18:51:15.076436+0000","last_peered":"2024-05-08T18:51:15.076436+0000","last_clean":"2024-05-08T18:51:15.076436+0000","last_became_active":"2024-05-08T18:50:19.739620+0000","last_became_peered":"2024-05-08T18:50:19.739620+0000","last_unstale":"2024-05-08T18:51:15.076436+0000","last_undegraded":"2024-05-08T18:51:15.076436+0000","last_fullsized":"2024-05-08T18:51:15.076436+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:58.286521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.651104+0000","last_change":"2024-05-08T18:50:26.023831+0000","last_active":"2024-05-08T18:51:50.651104+0000","last_peered":"2024-05-08T18:51:50.651104+0000","last_clean":"2024-05-08T18:51:50.651104+0000","last_became_active":"2024-05-08T18:50:26.023522+0000","last_became_peered":"2024-05-08T18:50:26.023522+0000","last_unstale":"2024-05-08T18:51:50.651104+0000","last_undegraded":"2024-05-08T18:51:50.651104+0000","last_fullsized":"2024-05-08T18:51:50.651104+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:07.271771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075093+0000","last_change":"2024-05-08T18:50:30.035182+0000","last_active":"2024-05-08T18:51:15.075093+0000","last_peered":"2024-05-08T18:51:15.075093+0000","last_clean":"2024-05-08T18:51:15.075093+0000","last_became_active":"2024-05-08T18:50:30.034806+0000","last_became_peered":"2024-05-08T18:50:30.034806+0000","last_unstale":"2024-05-08T18:51:15.075093+0000","last_undegraded":"2024-05-08T18:51:15.075093+0000","last_fullsized":"2024-05-08T18:51:15.075093+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:25:21.995734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"27'13","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.256028+0000","last_change":"2024-05-08T18:50:32.042494+0000","last_active":"2024-05-08T18:53:34.256028+0000","last_peered":"2024-05-08T18:53:34.256028+0000","last_clean":"2024-05-08T18:53:34.256028+0000","last_became_active":"2024-05-08T18:50:32.042183+0000","last_became_peered":"2024-05-08T18:50:32.042183+0000","last_unstale":"2024-05-08T18:53:34.256028+0000","last_undegraded":"2024-05-08T18:53:34.256028+0000","last_fullsized":"2024-05-08T18:53:34.256028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:21.537487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.082328+0000","last_change":"2024-05-08T18:50:34.045641+0000","last_active":"2024-05-08T18:51:15.082328+0000","last_peered":"2024-05-08T18:51:15.082328+0000","last_clean":"2024-05-08T18:51:15.082328+0000","last_became_active":"2024-05-08T18:50:34.044358+0000","last_became_peered":"2024-05-08T18:50:34.044358+0000","last_unstale":"2024-05-08T18:51:15.082328+0000","last_undegraded":"2024-05-08T18:51:15.082328+0000","last_fullsized":"2024-05-08T18:51:15.082328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:30:35.167490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.008973+0000","last_change":"2024-05-08T18:50:36.058516+0000","last_active":"2024-05-08T18:52:34.008973+0000","last_peered":"2024-05-08T18:52:34.008973+0000","last_clean":"2024-05-08T18:52:34.008973+0000","last_became_active":"2024-05-08T18:50:36.058267+0000","last_became_peered":"2024-05-08T18:50:36.058267+0000","last_unstale":"2024-05-08T18:52:34.008973+0000","last_undegraded":"2024-05-08T18:52:34.008973+0000","last_fullsized":"2024-05-08T18:52:34.008973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:30.137484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'12","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.607240+0000","last_change":"2024-05-08T18:50:28.039245+0000","last_active":"2024-05-08T18:53:34.607240+0000","last_peered":"2024-05-08T18:53:34.607240+0000","last_clean":"2024-05-08T18:53:34.607240+0000","last_became_active":"2024-05-08T18:50:28.038935+0000","last_became_peered":"2024-05-08T18:50:28.038935+0000","last_unstale":"2024-05-08T18:53:34.607240+0000","last_undegraded":"2024-05-08T18:53:34.607240+0000","last_fullsized":"2024-05-08T18:53:34.607240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:44.968210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075852+0000","last_change":"2024-05-08T18:50:26.019026+0000","last_active":"2024-05-08T18:51:15.075852+0000","last_peered":"2024-05-08T18:51:15.075852+0000","last_clean":"2024-05-08T18:51:15.075852+0000","last_became_active":"2024-05-08T18:50:26.018739+0000","last_became_peered":"2024-05-08T18:50:26.018739+0000","last_unstale":"2024-05-08T18:51:15.075852+0000","last_undegraded":"2024-05-08T18:51:15.075852+0000","last_fullsized":"2024-05-08T18:51:15.075852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:13.215678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073107+0000","last_change":"2024-05-08T18:50:19.741144+0000","last_active":"2024-05-08T18:51:15.073107+0000","last_peered":"2024-05-08T18:51:15.073107+0000","last_clean":"2024-05-08T18:51:15.073107+0000","last_became_active":"2024-05-08T18:50:19.740835+0000","last_became_peered":"2024-05-08T18:50:19.740835+0000","last_unstale":"2024-05-08T18:51:15.073107+0000","last_undegraded":"2024-05-08T18:51:15.073107+0000","last_fullsized":"2024-05-08T18:51:15.073107+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:28:30.349801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.999922+0000","last_change":"2024-05-08T18:51:15.083500+0000","last_active":"2024-05-08T18:53:34.999922+0000","last_peered":"2024-05-08T18:53:34.999922+0000","last_clean":"2024-05-08T18:53:34.999922+0000","last_became_active":"2024-05-08T18:51:15.083141+0000","last_became_peered":"2024-05-08T18:51:15.083141+0000","last_unstale":"2024-05-08T18:53:34.999922+0000","last_undegraded":"2024-05-08T18:53:34.999922+0000","last_fullsized":"2024-05-08T18:53:34.999922+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:11.583016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"27'67","reported_seq":134,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.555454+0000","last_change":"2024-05-08T18:50:32.042368+0000","last_active":"2024-05-08T18:53:41.555454+0000","last_peered":"2024-05-08T18:53:41.555454+0000","last_clean":"2024-05-08T18:53:41.555454+0000","last_became_active":"2024-05-08T18:50:32.042046+0000","last_became_peered":"2024-05-08T18:50:32.042046+0000","last_unstale":"2024-05-08T18:53:41.555454+0000","last_undegraded":"2024-05-08T18:53:41.555454+0000","last_fullsized":"2024-05-08T18:53:41.555454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:02.233245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076297+0000","last_change":"2024-05-08T18:50:34.044814+0000","last_active":"2024-05-08T18:51:15.076297+0000","last_peered":"2024-05-08T18:51:15.076297+0000","last_clean":"2024-05-08T18:51:15.076297+0000","last_became_active":"2024-05-08T18:50:34.044520+0000","last_became_peered":"2024-05-08T18:50:34.044520+0000","last_unstale":"2024-05-08T18:51:15.076297+0000","last_undegraded":"2024-05-08T18:51:15.076297+0000","last_fullsized":"2024-05-08T18:51:15.076297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:02.505892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"27'9","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.182379+0000","last_change":"2024-05-08T18:50:36.047417+0000","last_active":"2024-05-08T18:52:34.182379+0000","last_peered":"2024-05-08T18:52:34.182379+0000","last_clean":"2024-05-08T18:52:34.182379+0000","last_became_active":"2024-05-08T18:50:36.046757+0000","last_became_peered":"2024-05-08T18:50:36.046757+0000","last_unstale":"2024-05-08T18:52:34.182379+0000","last_undegraded":"2024-05-08T18:52:34.182379+0000","last_fullsized":"2024-05-08T18:52:34.182379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:56.465327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"27'10","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.823507+0000","last_change":"2024-05-08T18:51:15.095543+0000","last_active":"2024-05-08T18:53:34.823507+0000","last_peered":"2024-05-08T18:53:34.823507+0000","last_clean":"2024-05-08T18:53:34.823507+0000","last_became_active":"2024-05-08T18:51:15.084151+0000","last_became_peered":"2024-05-08T18:51:15.084151+0000","last_unstale":"2024-05-08T18:53:34.823507+0000","last_undegraded":"2024-05-08T18:53:34.823507+0000","last_fullsized":"2024-05-08T18:53:34.823507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:15.066531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074090+0000","last_change":"2024-05-08T18:50:26.025460+0000","last_active":"2024-05-08T18:51:15.074090+0000","last_peered":"2024-05-08T18:51:15.074090+0000","last_clean":"2024-05-08T18:51:15.074090+0000","last_became_active":"2024-05-08T18:50:26.024894+0000","last_became_peered":"2024-05-08T18:50:26.024894+0000","last_unstale":"2024-05-08T18:51:15.074090+0000","last_undegraded":"2024-05-08T18:51:15.074090+0000","last_fullsized":"2024-05-08T18:51:15.074090+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:40.472317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079603+0000","last_change":"2024-05-08T18:50:19.739473+0000","last_active":"2024-05-08T18:51:15.079603+0000","last_peered":"2024-05-08T18:51:15.079603+0000","last_clean":"2024-05-08T18:51:15.079603+0000","last_became_active":"2024-05-08T18:50:19.739124+0000","last_became_peered":"2024-05-08T18:50:19.739124+0000","last_unstale":"2024-05-08T18:51:15.079603+0000","last_undegraded":"2024-05-08T18:51:15.079603+0000","last_fullsized":"2024-05-08T18:51:15.079603+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:59:22.202213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076770+0000","last_change":"2024-05-08T18:50:30.033607+0000","last_active":"2024-05-08T18:51:15.076770+0000","last_peered":"2024-05-08T18:51:15.076770+0000","last_clean":"2024-05-08T18:51:15.076770+0000","last_became_active":"2024-05-08T18:50:30.032546+0000","last_became_peered":"2024-05-08T18:50:30.032546+0000","last_unstale":"2024-05-08T18:51:15.076770+0000","last_undegraded":"2024-05-08T18:51:15.076770+0000","last_fullsized":"2024-05-08T18:51:15.076770+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:48.521683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"25'14","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076154+0000","last_change":"2024-05-08T18:50:32.040984+0000","last_active":"2024-05-08T18:51:15.076154+0000","last_peered":"2024-05-08T18:51:15.076154+0000","last_clean":"2024-05-08T18:51:15.076154+0000","last_became_active":"2024-05-08T18:50:32.040767+0000","last_became_peered":"2024-05-08T18:50:32.040767+0000","last_unstale":"2024-05-08T18:51:15.076154+0000","last_undegraded":"2024-05-08T18:51:15.076154+0000","last_fullsized":"2024-05-08T18:51:15.076154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:26.346126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"27'285","reported_seq":377,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.415479+0000","last_change":"2024-05-08T18:50:34.043559+0000","last_active":"2024-05-08T18:53:41.415479+0000","last_peered":"2024-05-08T18:53:41.415479+0000","last_clean":"2024-05-08T18:53:41.415479+0000","last_became_active":"2024-05-08T18:50:34.043167+0000","last_became_peered":"2024-05-08T18:50:34.043167+0000","last_unstale":"2024-05-08T18:53:41.415479+0000","last_undegraded":"2024-05-08T18:53:41.415479+0000","last_fullsized":"2024-05-08T18:53:41.415479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:50.430816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.849637+0000","last_change":"2024-05-08T18:50:36.061014+0000","last_active":"2024-05-08T18:53:34.849637+0000","last_peered":"2024-05-08T18:53:34.849637+0000","last_clean":"2024-05-08T18:53:34.849637+0000","last_became_active":"2024-05-08T18:50:36.060727+0000","last_became_peered":"2024-05-08T18:50:36.060727+0000","last_unstale":"2024-05-08T18:53:34.849637+0000","last_undegraded":"2024-05-08T18:53:34.849637+0000","last_fullsized":"2024-05-08T18:53:34.849637+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:01.420579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"27'22","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.690982+0000","last_change":"2024-05-08T18:51:15.092701+0000","last_active":"2024-05-08T18:53:34.690982+0000","last_peered":"2024-05-08T18:53:34.690982+0000","last_clean":"2024-05-08T18:53:34.690982+0000","last_became_active":"2024-05-08T18:51:15.083568+0000","last_became_peered":"2024-05-08T18:51:15.083568+0000","last_unstale":"2024-05-08T18:53:34.690982+0000","last_undegraded":"2024-05-08T18:53:34.690982+0000","last_fullsized":"2024-05-08T18:53:34.690982+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:43.282786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":68,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.883437+0000","last_change":"2024-05-08T18:50:26.016666+0000","last_active":"2024-05-08T18:53:34.883437+0000","last_peered":"2024-05-08T18:53:34.883437+0000","last_clean":"2024-05-08T18:53:34.883437+0000","last_became_active":"2024-05-08T18:50:26.016210+0000","last_became_peered":"2024-05-08T18:50:26.016210+0000","last_unstale":"2024-05-08T18:53:34.883437+0000","last_undegraded":"2024-05-08T18:53:34.883437+0000","last_fullsized":"2024-05-08T18:53:34.883437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:11.494472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074021+0000","last_change":"2024-05-08T18:50:19.740832+0000","last_active":"2024-05-08T18:51:15.074021+0000","last_peered":"2024-05-08T18:51:15.074021+0000","last_clean":"2024-05-08T18:51:15.074021+0000","last_became_active":"2024-05-08T18:50:19.740355+0000","last_became_peered":"2024-05-08T18:50:19.740355+0000","last_unstale":"2024-05-08T18:51:15.074021+0000","last_undegraded":"2024-05-08T18:51:15.074021+0000","last_fullsized":"2024-05-08T18:51:15.074021+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:13:57.647604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077142+0000","last_change":"2024-05-08T18:50:30.033678+0000","last_active":"2024-05-08T18:51:15.077142+0000","last_peered":"2024-05-08T18:51:15.077142+0000","last_clean":"2024-05-08T18:51:15.077142+0000","last_became_active":"2024-05-08T18:50:30.031351+0000","last_became_peered":"2024-05-08T18:50:30.031351+0000","last_unstale":"2024-05-08T18:51:15.077142+0000","last_undegraded":"2024-05-08T18:51:15.077142+0000","last_fullsized":"2024-05-08T18:51:15.077142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:08.066057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"25'10","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077487+0000","last_change":"2024-05-08T18:50:32.042333+0000","last_active":"2024-05-08T18:51:15.077487+0000","last_peered":"2024-05-08T18:51:15.077487+0000","last_clean":"2024-05-08T18:51:15.077487+0000","last_became_active":"2024-05-08T18:50:32.041231+0000","last_became_peered":"2024-05-08T18:50:32.041231+0000","last_unstale":"2024-05-08T18:51:15.077487+0000","last_undegraded":"2024-05-08T18:51:15.077487+0000","last_fullsized":"2024-05-08T18:51:15.077487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:10:21.403251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"27'285","reported_seq":392,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.420455+0000","last_change":"2024-05-08T18:50:34.048062+0000","last_active":"2024-05-08T18:53:41.420455+0000","last_peered":"2024-05-08T18:53:41.420455+0000","last_clean":"2024-05-08T18:53:41.420455+0000","last_became_active":"2024-05-08T18:50:34.047608+0000","last_became_peered":"2024-05-08T18:50:34.047608+0000","last_unstale":"2024-05-08T18:53:41.420455+0000","last_undegraded":"2024-05-08T18:53:41.420455+0000","last_fullsized":"2024-05-08T18:53:41.420455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:55:50.430816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"25'5","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076053+0000","last_change":"2024-05-08T18:50:36.055086+0000","last_active":"2024-05-08T18:51:15.076053+0000","last_peered":"2024-05-08T18:51:15.076053+0000","last_clean":"2024-05-08T18:51:15.076053+0000","last_became_active":"2024-05-08T18:50:36.054747+0000","last_became_peered":"2024-05-08T18:50:36.054747+0000","last_unstale":"2024-05-08T18:51:15.076053+0000","last_undegraded":"2024-05-08T18:51:15.076053+0000","last_fullsized":"2024-05-08T18:51:15.076053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:23.094874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887634+0000","last_change":"2024-05-08T18:50:28.033530+0000","last_active":"2024-05-08T18:53:34.887634+0000","last_peered":"2024-05-08T18:53:34.887634+0000","last_clean":"2024-05-08T18:53:34.887634+0000","last_became_active":"2024-05-08T18:50:28.033163+0000","last_became_peered":"2024-05-08T18:50:28.033163+0000","last_unstale":"2024-05-08T18:53:34.887634+0000","last_undegraded":"2024-05-08T18:53:34.887634+0000","last_fullsized":"2024-05-08T18:53:34.887634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:01:06.589941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081490+0000","last_change":"2024-05-08T18:50:26.027003+0000","last_active":"2024-05-08T18:51:15.081490+0000","last_peered":"2024-05-08T18:51:15.081490+0000","last_clean":"2024-05-08T18:51:15.081490+0000","last_became_active":"2024-05-08T18:50:26.026719+0000","last_became_peered":"2024-05-08T18:50:26.026719+0000","last_unstale":"2024-05-08T18:51:15.081490+0000","last_undegraded":"2024-05-08T18:51:15.081490+0000","last_fullsized":"2024-05-08T18:51:15.081490+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:47.462940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.082412+0000","last_change":"2024-05-08T18:50:19.739345+0000","last_active":"2024-05-08T18:51:15.082412+0000","last_peered":"2024-05-08T18:51:15.082412+0000","last_clean":"2024-05-08T18:51:15.082412+0000","last_became_active":"2024-05-08T18:50:19.738971+0000","last_became_peered":"2024-05-08T18:50:19.738971+0000","last_unstale":"2024-05-08T18:51:15.082412+0000","last_undegraded":"2024-05-08T18:51:15.082412+0000","last_fullsized":"2024-05-08T18:51:15.082412+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:52:49.278410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075321+0000","last_change":"2024-05-08T18:50:30.033620+0000","last_active":"2024-05-08T18:51:15.075321+0000","last_peered":"2024-05-08T18:51:15.075321+0000","last_clean":"2024-05-08T18:51:15.075321+0000","last_became_active":"2024-05-08T18:50:30.032197+0000","last_became_peered":"2024-05-08T18:50:30.032197+0000","last_unstale":"2024-05-08T18:51:15.075321+0000","last_undegraded":"2024-05-08T18:51:15.075321+0000","last_fullsized":"2024-05-08T18:51:15.075321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:31.926375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"27'91","reported_seq":175,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.564736+0000","last_change":"2024-05-08T18:50:32.043393+0000","last_active":"2024-05-08T18:53:41.564736+0000","last_peered":"2024-05-08T18:53:41.564736+0000","last_clean":"2024-05-08T18:53:41.564736+0000","last_became_active":"2024-05-08T18:50:32.043109+0000","last_became_peered":"2024-05-08T18:50:32.043109+0000","last_unstale":"2024-05-08T18:53:41.564736+0000","last_undegraded":"2024-05-08T18:53:41.564736+0000","last_fullsized":"2024-05-08T18:53:41.564736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:46:05.292535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073040+0000","last_change":"2024-05-08T18:50:34.043856+0000","last_active":"2024-05-08T18:51:15.073040+0000","last_peered":"2024-05-08T18:51:15.073040+0000","last_clean":"2024-05-08T18:51:15.073040+0000","last_became_active":"2024-05-08T18:50:34.043495+0000","last_became_peered":"2024-05-08T18:50:34.043495+0000","last_unstale":"2024-05-08T18:51:15.073040+0000","last_undegraded":"2024-05-08T18:51:15.073040+0000","last_fullsized":"2024-05-08T18:51:15.073040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:35.940316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"25'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073950+0000","last_change":"2024-05-08T18:50:36.044755+0000","last_active":"2024-05-08T18:51:15.073950+0000","last_peered":"2024-05-08T18:51:15.073950+0000","last_clean":"2024-05-08T18:51:15.073950+0000","last_became_active":"2024-05-08T18:50:36.044491+0000","last_became_peered":"2024-05-08T18:50:36.044491+0000","last_unstale":"2024-05-08T18:51:15.073950+0000","last_undegraded":"2024-05-08T18:51:15.073950+0000","last_fullsized":"2024-05-08T18:51:15.073950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:26:24.798211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078569+0000","last_change":"2024-05-08T18:50:36.050995+0000","last_active":"2024-05-08T18:51:15.078569+0000","last_peered":"2024-05-08T18:51:15.078569+0000","last_clean":"2024-05-08T18:51:15.078569+0000","last_became_active":"2024-05-08T18:50:36.050722+0000","last_became_peered":"2024-05-08T18:50:36.050722+0000","last_unstale":"2024-05-08T18:51:15.078569+0000","last_undegraded":"2024-05-08T18:51:15.078569+0000","last_fullsized":"2024-05-08T18:51:15.078569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:14.087413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"27'9","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.868849+0000","last_change":"2024-05-08T18:50:28.033284+0000","last_active":"2024-05-08T18:53:34.868849+0000","last_peered":"2024-05-08T18:53:34.868849+0000","last_clean":"2024-05-08T18:53:34.868849+0000","last_became_active":"2024-05-08T18:50:28.033010+0000","last_became_peered":"2024-05-08T18:50:28.033010+0000","last_unstale":"2024-05-08T18:53:34.868849+0000","last_undegraded":"2024-05-08T18:53:34.868849+0000","last_fullsized":"2024-05-08T18:53:34.868849+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:13:06.187241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077875+0000","last_change":"2024-05-08T18:50:26.027008+0000","last_active":"2024-05-08T18:51:15.077875+0000","last_peered":"2024-05-08T18:51:15.077875+0000","last_clean":"2024-05-08T18:51:15.077875+0000","last_became_active":"2024-05-08T18:50:26.025828+0000","last_became_peered":"2024-05-08T18:50:26.025828+0000","last_unstale":"2024-05-08T18:51:15.077875+0000","last_undegraded":"2024-05-08T18:51:15.077875+0000","last_fullsized":"2024-05-08T18:51:15.077875+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:08:54.741439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.083669+0000","last_change":"2024-05-08T18:51:15.082912+0000","last_active":"2024-05-08T18:51:15.083669+0000","last_peered":"2024-05-08T18:51:15.083669+0000","last_clean":"2024-05-08T18:51:15.083669+0000","last_became_active":"2024-05-08T18:51:15.082590+0000","last_became_peered":"2024-05-08T18:51:15.082590+0000","last_unstale":"2024-05-08T18:51:15.083669+0000","last_undegraded":"2024-05-08T18:51:15.083669+0000","last_fullsized":"2024-05-08T18:51:15.083669+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:19.530329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"27'36","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.473171+0000","last_change":"2024-05-08T18:50:32.038887+0000","last_active":"2024-05-08T18:53:41.473171+0000","last_peered":"2024-05-08T18:53:41.473171+0000","last_clean":"2024-05-08T18:53:41.473171+0000","last_became_active":"2024-05-08T18:50:32.038591+0000","last_became_peered":"2024-05-08T18:50:32.038591+0000","last_unstale":"2024-05-08T18:53:41.473171+0000","last_undegraded":"2024-05-08T18:53:41.473171+0000","last_fullsized":"2024-05-08T18:53:41.473171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:52.451129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075130+0000","last_change":"2024-05-08T18:50:34.051041+0000","last_active":"2024-05-08T18:51:15.075130+0000","last_peered":"2024-05-08T18:51:15.075130+0000","last_clean":"2024-05-08T18:51:15.075130+0000","last_became_active":"2024-05-08T18:50:34.050749+0000","last_became_peered":"2024-05-08T18:50:34.050749+0000","last_unstale":"2024-05-08T18:51:15.075130+0000","last_undegraded":"2024-05-08T18:51:15.075130+0000","last_fullsized":"2024-05-08T18:51:15.075130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:42:34.776407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"27'15","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.692332+0000","last_change":"2024-05-08T18:50:36.054332+0000","last_active":"2024-05-08T18:53:34.692332+0000","last_peered":"2024-05-08T18:53:34.692332+0000","last_clean":"2024-05-08T18:53:34.692332+0000","last_became_active":"2024-05-08T18:50:36.054102+0000","last_became_peered":"2024-05-08T18:50:36.054102+0000","last_unstale":"2024-05-08T18:53:34.692332+0000","last_undegraded":"2024-05-08T18:53:34.692332+0000","last_fullsized":"2024-05-08T18:53:34.692332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:40.601584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"27'6","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.691151+0000","last_change":"2024-05-08T18:50:28.038986+0000","last_active":"2024-05-08T18:53:34.691151+0000","last_peered":"2024-05-08T18:53:34.691151+0000","last_clean":"2024-05-08T18:53:34.691151+0000","last_became_active":"2024-05-08T18:50:28.038587+0000","last_became_peered":"2024-05-08T18:50:28.038587+0000","last_unstale":"2024-05-08T18:53:34.691151+0000","last_undegraded":"2024-05-08T18:53:34.691151+0000","last_fullsized":"2024-05-08T18:53:34.691151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:55.994310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075642+0000","last_change":"2024-05-08T18:50:26.031798+0000","last_active":"2024-05-08T18:51:15.075642+0000","last_peered":"2024-05-08T18:51:15.075642+0000","last_clean":"2024-05-08T18:51:15.075642+0000","last_became_active":"2024-05-08T18:50:26.031509+0000","last_became_peered":"2024-05-08T18:50:26.031509+0000","last_unstale":"2024-05-08T18:51:15.075642+0000","last_undegraded":"2024-05-08T18:51:15.075642+0000","last_fullsized":"2024-05-08T18:51:15.075642+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:13:25.895646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.082399+0000","last_change":"2024-05-08T18:50:30.035310+0000","last_active":"2024-05-08T18:51:15.082399+0000","last_peered":"2024-05-08T18:51:15.082399+0000","last_clean":"2024-05-08T18:51:15.082399+0000","last_became_active":"2024-05-08T18:50:30.034178+0000","last_became_peered":"2024-05-08T18:50:30.034178+0000","last_unstale":"2024-05-08T18:51:15.082399+0000","last_undegraded":"2024-05-08T18:51:15.082399+0000","last_fullsized":"2024-05-08T18:51:15.082399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:50:07.748171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'6","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.260326+0000","last_change":"2024-05-08T18:50:32.036694+0000","last_active":"2024-05-08T18:53:34.260326+0000","last_peered":"2024-05-08T18:53:34.260326+0000","last_clean":"2024-05-08T18:53:34.260326+0000","last_became_active":"2024-05-08T18:50:32.036371+0000","last_became_peered":"2024-05-08T18:50:32.036371+0000","last_unstale":"2024-05-08T18:53:34.260326+0000","last_undegraded":"2024-05-08T18:53:34.260326+0000","last_fullsized":"2024-05-08T18:53:34.260326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:24:34.246835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076167+0000","last_change":"2024-05-08T18:50:34.049216+0000","last_active":"2024-05-08T18:51:15.076167+0000","last_peered":"2024-05-08T18:51:15.076167+0000","last_clean":"2024-05-08T18:51:15.076167+0000","last_became_active":"2024-05-08T18:50:34.048434+0000","last_became_peered":"2024-05-08T18:50:34.048434+0000","last_unstale":"2024-05-08T18:51:15.076167+0000","last_undegraded":"2024-05-08T18:51:15.076167+0000","last_fullsized":"2024-05-08T18:51:15.076167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:04.240028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"25'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073391+0000","last_change":"2024-05-08T18:50:36.047682+0000","last_active":"2024-05-08T18:51:15.073391+0000","last_peered":"2024-05-08T18:51:15.073391+0000","last_clean":"2024-05-08T18:51:15.073391+0000","last_became_active":"2024-05-08T18:50:36.047379+0000","last_became_peered":"2024-05-08T18:50:36.047379+0000","last_unstale":"2024-05-08T18:51:15.073391+0000","last_undegraded":"2024-05-08T18:51:15.073391+0000","last_fullsized":"2024-05-08T18:51:15.073391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:54:56.963493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"27'6","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887519+0000","last_change":"2024-05-08T18:50:28.022958+0000","last_active":"2024-05-08T18:53:34.887519+0000","last_peered":"2024-05-08T18:53:34.887519+0000","last_clean":"2024-05-08T18:53:34.887519+0000","last_became_active":"2024-05-08T18:50:28.022636+0000","last_became_peered":"2024-05-08T18:50:28.022636+0000","last_unstale":"2024-05-08T18:53:34.887519+0000","last_undegraded":"2024-05-08T18:53:34.887519+0000","last_fullsized":"2024-05-08T18:53:34.887519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:26.670671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075046+0000","last_change":"2024-05-08T18:50:26.031227+0000","last_active":"2024-05-08T18:51:15.075046+0000","last_peered":"2024-05-08T18:51:15.075046+0000","last_clean":"2024-05-08T18:51:15.075046+0000","last_became_active":"2024-05-08T18:50:26.030884+0000","last_became_peered":"2024-05-08T18:50:26.030884+0000","last_unstale":"2024-05-08T18:51:15.075046+0000","last_undegraded":"2024-05-08T18:51:15.075046+0000","last_fullsized":"2024-05-08T18:51:15.075046+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:37.913831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073198+0000","last_change":"2024-05-08T18:50:30.031104+0000","last_active":"2024-05-08T18:51:15.073198+0000","last_peered":"2024-05-08T18:51:15.073198+0000","last_clean":"2024-05-08T18:51:15.073198+0000","last_became_active":"2024-05-08T18:50:30.030773+0000","last_became_peered":"2024-05-08T18:50:30.030773+0000","last_unstale":"2024-05-08T18:51:15.073198+0000","last_undegraded":"2024-05-08T18:51:15.073198+0000","last_fullsized":"2024-05-08T18:51:15.073198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:44.977393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"27'43","reported_seq":106,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.549103+0000","last_change":"2024-05-08T18:50:32.032531+0000","last_active":"2024-05-08T18:53:41.549103+0000","last_peered":"2024-05-08T18:53:41.549103+0000","last_clean":"2024-05-08T18:53:41.549103+0000","last_became_active":"2024-05-08T18:50:32.032289+0000","last_became_peered":"2024-05-08T18:50:32.032289+0000","last_unstale":"2024-05-08T18:53:41.549103+0000","last_undegraded":"2024-05-08T18:53:41.549103+0000","last_fullsized":"2024-05-08T18:53:41.549103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:00.499108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073965+0000","last_change":"2024-05-08T18:50:34.043178+0000","last_active":"2024-05-08T18:51:15.073965+0000","last_peered":"2024-05-08T18:51:15.073965+0000","last_clean":"2024-05-08T18:51:15.073965+0000","last_became_active":"2024-05-08T18:50:34.042903+0000","last_became_peered":"2024-05-08T18:50:34.042903+0000","last_unstale":"2024-05-08T18:51:15.073965+0000","last_undegraded":"2024-05-08T18:51:15.073965+0000","last_fullsized":"2024-05-08T18:51:15.073965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:54.419559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077587+0000","last_change":"2024-05-08T18:50:36.056236+0000","last_active":"2024-05-08T18:51:15.077587+0000","last_peered":"2024-05-08T18:51:15.077587+0000","last_clean":"2024-05-08T18:51:15.077587+0000","last_became_active":"2024-05-08T18:50:36.055855+0000","last_became_peered":"2024-05-08T18:50:36.055855+0000","last_unstale":"2024-05-08T18:51:15.077587+0000","last_undegraded":"2024-05-08T18:51:15.077587+0000","last_fullsized":"2024-05-08T18:51:15.077587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:37.833469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"27'11","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007535+0000","last_change":"2024-05-08T18:50:28.035297+0000","last_active":"2024-05-08T18:52:48.007535+0000","last_peered":"2024-05-08T18:52:48.007535+0000","last_clean":"2024-05-08T18:52:48.007535+0000","last_became_active":"2024-05-08T18:50:28.034819+0000","last_became_peered":"2024-05-08T18:50:28.034819+0000","last_unstale":"2024-05-08T18:52:48.007535+0000","last_undegraded":"2024-05-08T18:52:48.007535+0000","last_fullsized":"2024-05-08T18:52:48.007535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:13:44.345322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081828+0000","last_change":"2024-05-08T18:50:26.029507+0000","last_active":"2024-05-08T18:51:15.081828+0000","last_peered":"2024-05-08T18:51:15.081828+0000","last_clean":"2024-05-08T18:51:15.081828+0000","last_became_active":"2024-05-08T18:50:26.029211+0000","last_became_peered":"2024-05-08T18:50:26.029211+0000","last_unstale":"2024-05-08T18:51:15.081828+0000","last_undegraded":"2024-05-08T18:51:15.081828+0000","last_fullsized":"2024-05-08T18:51:15.081828+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:08:13.942735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077144+0000","last_change":"2024-05-08T18:50:30.031830+0000","last_active":"2024-05-08T18:51:15.077144+0000","last_peered":"2024-05-08T18:51:15.077144+0000","last_clean":"2024-05-08T18:51:15.077144+0000","last_became_active":"2024-05-08T18:50:30.031588+0000","last_became_peered":"2024-05-08T18:50:30.031588+0000","last_unstale":"2024-05-08T18:51:15.077144+0000","last_undegraded":"2024-05-08T18:51:15.077144+0000","last_fullsized":"2024-05-08T18:51:15.077144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:50.405618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"27'33","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.538307+0000","last_change":"2024-05-08T18:50:32.035464+0000","last_active":"2024-05-08T18:53:41.538307+0000","last_peered":"2024-05-08T18:53:41.538307+0000","last_clean":"2024-05-08T18:53:41.538307+0000","last_became_active":"2024-05-08T18:50:32.035181+0000","last_became_peered":"2024-05-08T18:50:32.035181+0000","last_unstale":"2024-05-08T18:53:41.538307+0000","last_undegraded":"2024-05-08T18:53:41.538307+0000","last_fullsized":"2024-05-08T18:53:41.538307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:09.507174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078453+0000","last_change":"2024-05-08T18:50:34.042398+0000","last_active":"2024-05-08T18:51:15.078453+0000","last_peered":"2024-05-08T18:51:15.078453+0000","last_clean":"2024-05-08T18:51:15.078453+0000","last_became_active":"2024-05-08T18:50:34.039668+0000","last_became_peered":"2024-05-08T18:50:34.039668+0000","last_unstale":"2024-05-08T18:51:15.078453+0000","last_undegraded":"2024-05-08T18:51:15.078453+0000","last_fullsized":"2024-05-08T18:51:15.078453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:19:06.348421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.083199+0000","last_change":"2024-05-08T18:50:28.026330+0000","last_active":"2024-05-08T18:51:15.083199+0000","last_peered":"2024-05-08T18:51:15.083199+0000","last_clean":"2024-05-08T18:51:15.083199+0000","last_became_active":"2024-05-08T18:50:28.025862+0000","last_became_peered":"2024-05-08T18:50:28.025862+0000","last_unstale":"2024-05-08T18:51:15.083199+0000","last_undegraded":"2024-05-08T18:51:15.083199+0000","last_fullsized":"2024-05-08T18:51:15.083199+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:14.186696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074050+0000","last_change":"2024-05-08T18:50:26.023167+0000","last_active":"2024-05-08T18:51:15.074050+0000","last_peered":"2024-05-08T18:51:15.074050+0000","last_clean":"2024-05-08T18:51:15.074050+0000","last_became_active":"2024-05-08T18:50:26.022874+0000","last_became_peered":"2024-05-08T18:50:26.022874+0000","last_unstale":"2024-05-08T18:51:15.074050+0000","last_undegraded":"2024-05-08T18:51:15.074050+0000","last_fullsized":"2024-05-08T18:51:15.074050+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:06.231586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074887+0000","last_change":"2024-05-08T18:50:30.029972+0000","last_active":"2024-05-08T18:51:15.074887+0000","last_peered":"2024-05-08T18:51:15.074887+0000","last_clean":"2024-05-08T18:51:15.074887+0000","last_became_active":"2024-05-08T18:50:30.029570+0000","last_became_peered":"2024-05-08T18:50:30.029570+0000","last_unstale":"2024-05-08T18:51:15.074887+0000","last_undegraded":"2024-05-08T18:51:15.074887+0000","last_fullsized":"2024-05-08T18:51:15.074887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:59:16.505368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"27'62","reported_seq":126,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.535115+0000","last_change":"2024-05-08T18:50:32.039614+0000","last_active":"2024-05-08T18:53:41.535115+0000","last_peered":"2024-05-08T18:53:41.535115+0000","last_clean":"2024-05-08T18:53:41.535115+0000","last_became_active":"2024-05-08T18:50:32.039293+0000","last_became_peered":"2024-05-08T18:50:32.039293+0000","last_unstale":"2024-05-08T18:53:41.535115+0000","last_undegraded":"2024-05-08T18:53:41.535115+0000","last_fullsized":"2024-05-08T18:53:41.535115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:36.221887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078524+0000","last_change":"2024-05-08T18:50:34.047399+0000","last_active":"2024-05-08T18:51:15.078524+0000","last_peered":"2024-05-08T18:51:15.078524+0000","last_clean":"2024-05-08T18:51:15.078524+0000","last_became_active":"2024-05-08T18:50:34.047111+0000","last_became_peered":"2024-05-08T18:50:34.047111+0000","last_unstale":"2024-05-08T18:51:15.078524+0000","last_undegraded":"2024-05-08T18:51:15.078524+0000","last_fullsized":"2024-05-08T18:51:15.078524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:20.207624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"27'14","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.179268+0000","last_change":"2024-05-08T18:50:36.047518+0000","last_active":"2024-05-08T18:52:34.179268+0000","last_peered":"2024-05-08T18:52:34.179268+0000","last_clean":"2024-05-08T18:52:34.179268+0000","last_became_active":"2024-05-08T18:50:36.046834+0000","last_became_peered":"2024-05-08T18:50:36.046834+0000","last_unstale":"2024-05-08T18:52:34.179268+0000","last_undegraded":"2024-05-08T18:52:34.179268+0000","last_fullsized":"2024-05-08T18:52:34.179268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:22:30.137484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'6","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.690403+0000","last_change":"2024-05-08T18:50:28.023338+0000","last_active":"2024-05-08T18:53:34.690403+0000","last_peered":"2024-05-08T18:53:34.690403+0000","last_clean":"2024-05-08T18:53:34.690403+0000","last_became_active":"2024-05-08T18:50:28.023049+0000","last_became_peered":"2024-05-08T18:50:28.023049+0000","last_unstale":"2024-05-08T18:53:34.690403+0000","last_undegraded":"2024-05-08T18:53:34.690403+0000","last_fullsized":"2024-05-08T18:53:34.690403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:29:28.977842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.811771+0000","last_change":"2024-05-08T18:50:26.030145+0000","last_active":"2024-05-08T18:53:34.811771+0000","last_peered":"2024-05-08T18:53:34.811771+0000","last_clean":"2024-05-08T18:53:34.811771+0000","last_became_active":"2024-05-08T18:50:26.029008+0000","last_became_peered":"2024-05-08T18:50:26.029008+0000","last_unstale":"2024-05-08T18:53:34.811771+0000","last_undegraded":"2024-05-08T18:53:34.811771+0000","last_fullsized":"2024-05-08T18:53:34.811771+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:33:47.912064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078862+0000","last_change":"2024-05-08T18:50:30.027158+0000","last_active":"2024-05-08T18:51:15.078862+0000","last_peered":"2024-05-08T18:51:15.078862+0000","last_clean":"2024-05-08T18:51:15.078862+0000","last_became_active":"2024-05-08T18:50:30.026853+0000","last_became_peered":"2024-05-08T18:50:30.026853+0000","last_unstale":"2024-05-08T18:51:15.078862+0000","last_undegraded":"2024-05-08T18:51:15.078862+0000","last_fullsized":"2024-05-08T18:51:15.078862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:25.865274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"27'39","reported_seq":88,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.541407+0000","last_change":"2024-05-08T18:50:32.041607+0000","last_active":"2024-05-08T18:53:41.541407+0000","last_peered":"2024-05-08T18:53:41.541407+0000","last_clean":"2024-05-08T18:53:41.541407+0000","last_became_active":"2024-05-08T18:50:32.041208+0000","last_became_peered":"2024-05-08T18:50:32.041208+0000","last_unstale":"2024-05-08T18:53:41.541407+0000","last_undegraded":"2024-05-08T18:53:41.541407+0000","last_fullsized":"2024-05-08T18:53:41.541407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:00.288699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081778+0000","last_change":"2024-05-08T18:50:34.049030+0000","last_active":"2024-05-08T18:51:15.081778+0000","last_peered":"2024-05-08T18:51:15.081778+0000","last_clean":"2024-05-08T18:51:15.081778+0000","last_became_active":"2024-05-08T18:50:34.048749+0000","last_became_peered":"2024-05-08T18:50:34.048749+0000","last_unstale":"2024-05-08T18:51:15.081778+0000","last_undegraded":"2024-05-08T18:51:15.081778+0000","last_fullsized":"2024-05-08T18:51:15.081778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:12:52.535624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076062+0000","last_change":"2024-05-08T18:50:36.057323+0000","last_active":"2024-05-08T18:51:15.076062+0000","last_peered":"2024-05-08T18:51:15.076062+0000","last_clean":"2024-05-08T18:51:15.076062+0000","last_became_active":"2024-05-08T18:50:36.056960+0000","last_became_peered":"2024-05-08T18:50:36.056960+0000","last_unstale":"2024-05-08T18:51:15.076062+0000","last_undegraded":"2024-05-08T18:51:15.076062+0000","last_fullsized":"2024-05-08T18:51:15.076062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:33.422610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"27'8","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.243573+0000","last_change":"2024-05-08T18:50:28.038865+0000","last_active":"2024-05-08T18:52:34.243573+0000","last_peered":"2024-05-08T18:52:34.243573+0000","last_clean":"2024-05-08T18:52:34.243573+0000","last_became_active":"2024-05-08T18:50:28.038364+0000","last_became_peered":"2024-05-08T18:50:28.038364+0000","last_unstale":"2024-05-08T18:52:34.243573+0000","last_undegraded":"2024-05-08T18:52:34.243573+0000","last_fullsized":"2024-05-08T18:52:34.243573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:22.331982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.819164+0000","last_change":"2024-05-08T18:50:26.012760+0000","last_active":"2024-05-08T18:53:34.819164+0000","last_peered":"2024-05-08T18:53:34.819164+0000","last_clean":"2024-05-08T18:53:34.819164+0000","last_became_active":"2024-05-08T18:50:26.012506+0000","last_became_peered":"2024-05-08T18:50:26.012506+0000","last_unstale":"2024-05-08T18:53:34.819164+0000","last_undegraded":"2024-05-08T18:53:34.819164+0000","last_fullsized":"2024-05-08T18:53:34.819164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:13.215678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078388+0000","last_change":"2024-05-08T18:50:30.026843+0000","last_active":"2024-05-08T18:51:15.078388+0000","last_peered":"2024-05-08T18:51:15.078388+0000","last_clean":"2024-05-08T18:51:15.078388+0000","last_became_active":"2024-05-08T18:50:30.026445+0000","last_became_peered":"2024-05-08T18:50:30.026445+0000","last_unstale":"2024-05-08T18:51:15.078388+0000","last_undegraded":"2024-05-08T18:51:15.078388+0000","last_fullsized":"2024-05-08T18:51:15.078388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:57.129506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"27'35","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.484989+0000","last_change":"2024-05-08T18:50:32.041022+0000","last_active":"2024-05-08T18:53:41.484989+0000","last_peered":"2024-05-08T18:53:41.484989+0000","last_clean":"2024-05-08T18:53:41.484989+0000","last_became_active":"2024-05-08T18:50:32.040745+0000","last_became_peered":"2024-05-08T18:50:32.040745+0000","last_unstale":"2024-05-08T18:53:41.484989+0000","last_undegraded":"2024-05-08T18:53:41.484989+0000","last_fullsized":"2024-05-08T18:53:41.484989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:18.200841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.073810+0000","last_change":"2024-05-08T18:50:34.047857+0000","last_active":"2024-05-08T18:51:15.073810+0000","last_peered":"2024-05-08T18:51:15.073810+0000","last_clean":"2024-05-08T18:51:15.073810+0000","last_became_active":"2024-05-08T18:50:34.047508+0000","last_became_peered":"2024-05-08T18:50:34.047508+0000","last_unstale":"2024-05-08T18:51:15.073810+0000","last_undegraded":"2024-05-08T18:51:15.073810+0000","last_fullsized":"2024-05-08T18:51:15.073810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:42:03.694060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"27'9","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.334554+0000","last_change":"2024-05-08T18:50:36.058170+0000","last_active":"2024-05-08T18:53:34.334554+0000","last_peered":"2024-05-08T18:53:34.334554+0000","last_clean":"2024-05-08T18:53:34.334554+0000","last_became_active":"2024-05-08T18:50:36.057863+0000","last_became_peered":"2024-05-08T18:50:36.057863+0000","last_unstale":"2024-05-08T18:53:34.334554+0000","last_undegraded":"2024-05-08T18:53:34.334554+0000","last_fullsized":"2024-05-08T18:53:34.334554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:47.312916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"25'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074376+0000","last_change":"2024-05-08T18:50:28.021697+0000","last_active":"2024-05-08T18:51:15.074376+0000","last_peered":"2024-05-08T18:51:15.074376+0000","last_clean":"2024-05-08T18:51:15.074376+0000","last_became_active":"2024-05-08T18:50:28.020441+0000","last_became_peered":"2024-05-08T18:50:28.020441+0000","last_unstale":"2024-05-08T18:51:15.074376+0000","last_undegraded":"2024-05-08T18:51:15.074376+0000","last_fullsized":"2024-05-08T18:51:15.074376+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:07:42.970406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"25'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077959+0000","last_change":"2024-05-08T18:50:26.025468+0000","last_active":"2024-05-08T18:51:15.077959+0000","last_peered":"2024-05-08T18:51:15.077959+0000","last_clean":"2024-05-08T18:51:15.077959+0000","last_became_active":"2024-05-08T18:50:26.024274+0000","last_became_peered":"2024-05-08T18:50:26.024274+0000","last_unstale":"2024-05-08T18:51:15.077959+0000","last_undegraded":"2024-05-08T18:51:15.077959+0000","last_fullsized":"2024-05-08T18:51:15.077959+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:27.236646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081882+0000","last_change":"2024-05-08T18:50:30.029259+0000","last_active":"2024-05-08T18:51:15.081882+0000","last_peered":"2024-05-08T18:51:15.081882+0000","last_clean":"2024-05-08T18:51:15.081882+0000","last_became_active":"2024-05-08T18:50:30.028877+0000","last_became_peered":"2024-05-08T18:50:30.028877+0000","last_unstale":"2024-05-08T18:51:15.081882+0000","last_undegraded":"2024-05-08T18:51:15.081882+0000","last_fullsized":"2024-05-08T18:51:15.081882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:24:57.176423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"25'10","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079404+0000","last_change":"2024-05-08T18:50:32.042114+0000","last_active":"2024-05-08T18:51:15.079404+0000","last_peered":"2024-05-08T18:51:15.079404+0000","last_clean":"2024-05-08T18:51:15.079404+0000","last_became_active":"2024-05-08T18:50:32.041539+0000","last_became_peered":"2024-05-08T18:50:32.041539+0000","last_unstale":"2024-05-08T18:51:15.079404+0000","last_undegraded":"2024-05-08T18:51:15.079404+0000","last_fullsized":"2024-05-08T18:51:15.079404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:42.799113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"27'285","reported_seq":409,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.413791+0000","last_change":"2024-05-08T18:50:34.048713+0000","last_active":"2024-05-08T18:53:41.413791+0000","last_peered":"2024-05-08T18:53:41.413791+0000","last_clean":"2024-05-08T18:53:41.413791+0000","last_became_active":"2024-05-08T18:50:34.048421+0000","last_became_peered":"2024-05-08T18:50:34.048421+0000","last_unstale":"2024-05-08T18:53:41.413791+0000","last_undegraded":"2024-05-08T18:53:41.413791+0000","last_fullsized":"2024-05-08T18:53:41.413791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:31.497412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"27'6","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.940415+0000","last_change":"2024-05-08T18:50:36.055738+0000","last_active":"2024-05-08T18:53:34.940415+0000","last_peered":"2024-05-08T18:53:34.940415+0000","last_clean":"2024-05-08T18:53:34.940415+0000","last_became_active":"2024-05-08T18:50:36.055184+0000","last_became_peered":"2024-05-08T18:50:36.055184+0000","last_unstale":"2024-05-08T18:53:34.940415+0000","last_undegraded":"2024-05-08T18:53:34.940415+0000","last_fullsized":"2024-05-08T18:53:34.940415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:08:53.899906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"27'3","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.868347+0000","last_change":"2024-05-08T18:50:28.025621+0000","last_active":"2024-05-08T18:53:34.868347+0000","last_peered":"2024-05-08T18:53:34.868347+0000","last_clean":"2024-05-08T18:53:34.868347+0000","last_became_active":"2024-05-08T18:50:28.025313+0000","last_became_peered":"2024-05-08T18:50:28.025313+0000","last_unstale":"2024-05-08T18:53:34.868347+0000","last_undegraded":"2024-05-08T18:53:34.868347+0000","last_fullsized":"2024-05-08T18:53:34.868347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:55.202102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079286+0000","last_change":"2024-05-08T18:50:26.030334+0000","last_active":"2024-05-08T18:51:15.079286+0000","last_peered":"2024-05-08T18:51:15.079286+0000","last_clean":"2024-05-08T18:51:15.079286+0000","last_became_active":"2024-05-08T18:50:26.030058+0000","last_became_peered":"2024-05-08T18:50:26.030058+0000","last_unstale":"2024-05-08T18:51:15.079286+0000","last_undegraded":"2024-05-08T18:51:15.079286+0000","last_fullsized":"2024-05-08T18:51:15.079286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:40.472317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"18'1","reported_seq":220,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.389036+0000","last_change":"2024-05-08T18:50:30.024313+0000","last_active":"2024-05-08T18:53:41.389036+0000","last_peered":"2024-05-08T18:53:41.389036+0000","last_clean":"2024-05-08T18:53:41.389036+0000","last_became_active":"2024-05-08T18:50:30.024032+0000","last_became_peered":"2024-05-08T18:50:30.024032+0000","last_unstale":"2024-05-08T18:53:41.389036+0000","last_undegraded":"2024-05-08T18:53:41.389036+0000","last_fullsized":"2024-05-08T18:53:41.389036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:43.500296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"27'40","reported_seq":89,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.513593+0000","last_change":"2024-05-08T18:50:32.036101+0000","last_active":"2024-05-08T18:53:41.513593+0000","last_peered":"2024-05-08T18:53:41.513593+0000","last_clean":"2024-05-08T18:53:41.513593+0000","last_became_active":"2024-05-08T18:50:32.035792+0000","last_became_peered":"2024-05-08T18:50:32.035792+0000","last_unstale":"2024-05-08T18:53:41.513593+0000","last_undegraded":"2024-05-08T18:53:41.513593+0000","last_fullsized":"2024-05-08T18:53:41.513593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:06:52.558231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.071790+0000","last_change":"2024-05-08T18:50:34.045008+0000","last_active":"2024-05-08T18:51:15.071790+0000","last_peered":"2024-05-08T18:51:15.071790+0000","last_clean":"2024-05-08T18:51:15.071790+0000","last_became_active":"2024-05-08T18:50:34.044586+0000","last_became_peered":"2024-05-08T18:50:34.044586+0000","last_unstale":"2024-05-08T18:51:15.071790+0000","last_undegraded":"2024-05-08T18:51:15.071790+0000","last_fullsized":"2024-05-08T18:51:15.071790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:19.094040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"27'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.240649+0000","last_change":"2024-05-08T18:50:36.053212+0000","last_active":"2024-05-08T18:52:34.240649+0000","last_peered":"2024-05-08T18:52:34.240649+0000","last_clean":"2024-05-08T18:52:34.240649+0000","last_became_active":"2024-05-08T18:50:36.052885+0000","last_became_peered":"2024-05-08T18:50:36.052885+0000","last_unstale":"2024-05-08T18:52:34.240649+0000","last_undegraded":"2024-05-08T18:52:34.240649+0000","last_fullsized":"2024-05-08T18:52:34.240649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:06:18.424066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"27'28","reported_seq":114,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887556+0000","last_change":"2024-05-08T18:50:28.025900+0000","last_active":"2024-05-08T18:53:34.887556+0000","last_peered":"2024-05-08T18:53:34.887556+0000","last_clean":"2024-05-08T18:53:34.887556+0000","last_became_active":"2024-05-08T18:50:28.025162+0000","last_became_peered":"2024-05-08T18:50:28.025162+0000","last_unstale":"2024-05-08T18:53:34.887556+0000","last_undegraded":"2024-05-08T18:53:34.887556+0000","last_fullsized":"2024-05-08T18:53:34.887556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:38:05.876708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":112,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079886+0000","last_change":"2024-05-08T18:50:26.027367+0000","last_active":"2024-05-08T18:51:15.079886+0000","last_peered":"2024-05-08T18:51:15.079886+0000","last_clean":"2024-05-08T18:51:15.079886+0000","last_became_active":"2024-05-08T18:50:26.027067+0000","last_became_peered":"2024-05-08T18:50:26.027067+0000","last_unstale":"2024-05-08T18:51:15.079886+0000","last_undegraded":"2024-05-08T18:51:15.079886+0000","last_fullsized":"2024-05-08T18:51:15.079886+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:30.486245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078349+0000","last_change":"2024-05-08T18:50:30.034913+0000","last_active":"2024-05-08T18:51:15.078349+0000","last_peered":"2024-05-08T18:51:15.078349+0000","last_clean":"2024-05-08T18:51:15.078349+0000","last_became_active":"2024-05-08T18:50:30.034616+0000","last_became_peered":"2024-05-08T18:50:30.034616+0000","last_unstale":"2024-05-08T18:51:15.078349+0000","last_undegraded":"2024-05-08T18:51:15.078349+0000","last_fullsized":"2024-05-08T18:51:15.078349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:58.001297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"27'35","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.516708+0000","last_change":"2024-05-08T18:50:32.042047+0000","last_active":"2024-05-08T18:53:41.516708+0000","last_peered":"2024-05-08T18:53:41.516708+0000","last_clean":"2024-05-08T18:53:41.516708+0000","last_became_active":"2024-05-08T18:50:32.041806+0000","last_became_peered":"2024-05-08T18:50:32.041806+0000","last_unstale":"2024-05-08T18:53:41.516708+0000","last_undegraded":"2024-05-08T18:53:41.516708+0000","last_fullsized":"2024-05-08T18:53:41.516708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:20.454485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075987+0000","last_change":"2024-05-08T18:50:34.050795+0000","last_active":"2024-05-08T18:51:15.075987+0000","last_peered":"2024-05-08T18:51:15.075987+0000","last_clean":"2024-05-08T18:51:15.075987+0000","last_became_active":"2024-05-08T18:50:34.050445+0000","last_became_peered":"2024-05-08T18:50:34.050445+0000","last_unstale":"2024-05-08T18:51:15.075987+0000","last_undegraded":"2024-05-08T18:51:15.075987+0000","last_fullsized":"2024-05-08T18:51:15.075987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:03.912574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079231+0000","last_change":"2024-05-08T18:50:36.060634+0000","last_active":"2024-05-08T18:51:15.079231+0000","last_peered":"2024-05-08T18:51:15.079231+0000","last_clean":"2024-05-08T18:51:15.079231+0000","last_became_active":"2024-05-08T18:50:36.060318+0000","last_became_peered":"2024-05-08T18:50:36.060318+0000","last_unstale":"2024-05-08T18:51:15.079231+0000","last_undegraded":"2024-05-08T18:51:15.079231+0000","last_fullsized":"2024-05-08T18:51:15.079231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:22:59.024364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.823408+0000","last_change":"2024-05-08T18:50:28.029928+0000","last_active":"2024-05-08T18:53:34.823408+0000","last_peered":"2024-05-08T18:53:34.823408+0000","last_clean":"2024-05-08T18:53:34.823408+0000","last_became_active":"2024-05-08T18:50:28.029624+0000","last_became_peered":"2024-05-08T18:50:28.029624+0000","last_unstale":"2024-05-08T18:53:34.823408+0000","last_undegraded":"2024-05-08T18:53:34.823408+0000","last_fullsized":"2024-05-08T18:53:34.823408+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:41.493309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.589006+0000","last_change":"2024-05-08T18:50:26.029045+0000","last_active":"2024-05-08T18:53:34.589006+0000","last_peered":"2024-05-08T18:53:34.589006+0000","last_clean":"2024-05-08T18:53:34.589006+0000","last_became_active":"2024-05-08T18:50:26.028615+0000","last_became_peered":"2024-05-08T18:50:26.028615+0000","last_unstale":"2024-05-08T18:53:34.589006+0000","last_undegraded":"2024-05-08T18:53:34.589006+0000","last_fullsized":"2024-05-08T18:53:34.589006+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:52:05.955423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079116+0000","last_change":"2024-05-08T18:50:30.030595+0000","last_active":"2024-05-08T18:51:15.079116+0000","last_peered":"2024-05-08T18:51:15.079116+0000","last_clean":"2024-05-08T18:51:15.079116+0000","last_became_active":"2024-05-08T18:50:30.030295+0000","last_became_peered":"2024-05-08T18:50:30.030295+0000","last_unstale":"2024-05-08T18:51:15.079116+0000","last_undegraded":"2024-05-08T18:51:15.079116+0000","last_fullsized":"2024-05-08T18:51:15.079116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:39.211003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"27'29","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.479108+0000","last_change":"2024-05-08T18:50:32.040967+0000","last_active":"2024-05-08T18:53:41.479108+0000","last_peered":"2024-05-08T18:53:41.479108+0000","last_clean":"2024-05-08T18:53:41.479108+0000","last_became_active":"2024-05-08T18:50:32.040661+0000","last_became_peered":"2024-05-08T18:50:32.040661+0000","last_unstale":"2024-05-08T18:53:41.479108+0000","last_undegraded":"2024-05-08T18:53:41.479108+0000","last_fullsized":"2024-05-08T18:53:41.479108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:03:17.855961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076341+0000","last_change":"2024-05-08T18:50:34.045449+0000","last_active":"2024-05-08T18:51:15.076341+0000","last_peered":"2024-05-08T18:51:15.076341+0000","last_clean":"2024-05-08T18:51:15.076341+0000","last_became_active":"2024-05-08T18:50:34.045040+0000","last_became_peered":"2024-05-08T18:50:34.045040+0000","last_unstale":"2024-05-08T18:51:15.076341+0000","last_undegraded":"2024-05-08T18:51:15.076341+0000","last_fullsized":"2024-05-08T18:51:15.076341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:24.033430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.802348+0000","last_change":"2024-05-08T18:50:36.060675+0000","last_active":"2024-05-08T18:52:32.802348+0000","last_peered":"2024-05-08T18:52:32.802348+0000","last_clean":"2024-05-08T18:52:32.802348+0000","last_became_active":"2024-05-08T18:50:36.060382+0000","last_became_peered":"2024-05-08T18:50:36.060382+0000","last_unstale":"2024-05-08T18:52:32.802348+0000","last_undegraded":"2024-05-08T18:52:32.802348+0000","last_fullsized":"2024-05-08T18:52:32.802348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:13.860024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'11","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.612979+0000","last_change":"2024-05-08T18:50:28.020688+0000","last_active":"2024-05-08T18:53:34.612979+0000","last_peered":"2024-05-08T18:53:34.612979+0000","last_clean":"2024-05-08T18:53:34.612979+0000","last_became_active":"2024-05-08T18:50:28.020421+0000","last_became_peered":"2024-05-08T18:50:28.020421+0000","last_unstale":"2024-05-08T18:53:34.612979+0000","last_undegraded":"2024-05-08T18:53:34.612979+0000","last_fullsized":"2024-05-08T18:53:34.612979+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:33:38.101169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.814081+0000","last_change":"2024-05-08T18:50:26.012375+0000","last_active":"2024-05-08T18:53:34.814081+0000","last_peered":"2024-05-08T18:53:34.814081+0000","last_clean":"2024-05-08T18:53:34.814081+0000","last_became_active":"2024-05-08T18:50:26.011299+0000","last_became_peered":"2024-05-08T18:50:26.011299+0000","last_unstale":"2024-05-08T18:53:34.814081+0000","last_undegraded":"2024-05-08T18:53:34.814081+0000","last_fullsized":"2024-05-08T18:53:34.814081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:37.913831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"27'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:31.488124+0000","last_change":"2024-05-08T18:50:30.032861+0000","last_active":"2024-05-08T18:52:31.488124+0000","last_peered":"2024-05-08T18:52:31.488124+0000","last_clean":"2024-05-08T18:52:31.488124+0000","last_became_active":"2024-05-08T18:50:30.032578+0000","last_became_peered":"2024-05-08T18:50:30.032578+0000","last_unstale":"2024-05-08T18:52:31.488124+0000","last_undegraded":"2024-05-08T18:52:31.488124+0000","last_fullsized":"2024-05-08T18:52:31.488124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:01:09.465423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"27'37","reported_seq":85,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.497650+0000","last_change":"2024-05-08T18:50:32.042986+0000","last_active":"2024-05-08T18:53:41.497650+0000","last_peered":"2024-05-08T18:53:41.497650+0000","last_clean":"2024-05-08T18:53:41.497650+0000","last_became_active":"2024-05-08T18:50:32.042700+0000","last_became_peered":"2024-05-08T18:50:32.042700+0000","last_unstale":"2024-05-08T18:53:41.497650+0000","last_undegraded":"2024-05-08T18:53:41.497650+0000","last_fullsized":"2024-05-08T18:53:41.497650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:27:17.682080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":49,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072389+0000","last_change":"2024-05-08T18:50:34.045188+0000","last_active":"2024-05-08T18:51:15.072389+0000","last_peered":"2024-05-08T18:51:15.072389+0000","last_clean":"2024-05-08T18:51:15.072389+0000","last_became_active":"2024-05-08T18:50:34.044872+0000","last_became_peered":"2024-05-08T18:50:34.044872+0000","last_unstale":"2024-05-08T18:51:15.072389+0000","last_undegraded":"2024-05-08T18:51:15.072389+0000","last_fullsized":"2024-05-08T18:51:15.072389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:02:12.079998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:32.805125+0000","last_change":"2024-05-08T18:50:36.055685+0000","last_active":"2024-05-08T18:52:32.805125+0000","last_peered":"2024-05-08T18:52:32.805125+0000","last_clean":"2024-05-08T18:52:32.805125+0000","last_became_active":"2024-05-08T18:50:36.055188+0000","last_became_peered":"2024-05-08T18:50:36.055188+0000","last_unstale":"2024-05-08T18:52:32.805125+0000","last_undegraded":"2024-05-08T18:52:32.805125+0000","last_fullsized":"2024-05-08T18:52:32.805125+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:29:30.352392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"27'12","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.613503+0000","last_change":"2024-05-08T18:50:28.039552+0000","last_active":"2024-05-08T18:53:34.613503+0000","last_peered":"2024-05-08T18:53:34.613503+0000","last_clean":"2024-05-08T18:53:34.613503+0000","last_became_active":"2024-05-08T18:50:28.039290+0000","last_became_peered":"2024-05-08T18:50:28.039290+0000","last_unstale":"2024-05-08T18:53:34.613503+0000","last_undegraded":"2024-05-08T18:53:34.613503+0000","last_fullsized":"2024-05-08T18:53:34.613503+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:14.876681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"27'3","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.465227+0000","last_change":"2024-05-08T18:50:26.019000+0000","last_active":"2024-05-08T18:51:50.465227+0000","last_peered":"2024-05-08T18:51:50.465227+0000","last_clean":"2024-05-08T18:51:50.465227+0000","last_became_active":"2024-05-08T18:50:26.018713+0000","last_became_peered":"2024-05-08T18:50:26.018713+0000","last_unstale":"2024-05-08T18:51:50.465227+0000","last_undegraded":"2024-05-08T18:51:50.465227+0000","last_fullsized":"2024-05-08T18:51:50.465227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:00:06.975161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"27'5","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.001130+0000","last_change":"2024-05-08T18:50:28.026675+0000","last_active":"2024-05-08T18:52:38.001130+0000","last_peered":"2024-05-08T18:52:38.001130+0000","last_clean":"2024-05-08T18:52:38.001130+0000","last_became_active":"2024-05-08T18:50:28.026292+0000","last_became_peered":"2024-05-08T18:50:28.026292+0000","last_unstale":"2024-05-08T18:52:38.001130+0000","last_undegraded":"2024-05-08T18:52:38.001130+0000","last_fullsized":"2024-05-08T18:52:38.001130+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:07.047413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072010+0000","last_change":"2024-05-08T18:50:26.013052+0000","last_active":"2024-05-08T18:51:15.072010+0000","last_peered":"2024-05-08T18:51:15.072010+0000","last_clean":"2024-05-08T18:51:15.072010+0000","last_became_active":"2024-05-08T18:50:26.012760+0000","last_became_peered":"2024-05-08T18:50:26.012760+0000","last_unstale":"2024-05-08T18:51:15.072010+0000","last_undegraded":"2024-05-08T18:51:15.072010+0000","last_fullsized":"2024-05-08T18:51:15.072010+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:13.215678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'4","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.605684+0000","last_change":"2024-05-08T18:50:28.039172+0000","last_active":"2024-05-08T18:53:34.605684+0000","last_peered":"2024-05-08T18:53:34.605684+0000","last_clean":"2024-05-08T18:53:34.605684+0000","last_became_active":"2024-05-08T18:50:28.038785+0000","last_became_peered":"2024-05-08T18:50:28.038785+0000","last_unstale":"2024-05-08T18:53:34.605684+0000","last_undegraded":"2024-05-08T18:53:34.605684+0000","last_fullsized":"2024-05-08T18:53:34.605684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:11.113877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.077113+0000","last_change":"2024-05-08T18:50:26.026716+0000","last_active":"2024-05-08T18:51:15.077113+0000","last_peered":"2024-05-08T18:51:15.077113+0000","last_clean":"2024-05-08T18:51:15.077113+0000","last_became_active":"2024-05-08T18:50:26.025958+0000","last_became_peered":"2024-05-08T18:50:26.025958+0000","last_unstale":"2024-05-08T18:51:15.077113+0000","last_undegraded":"2024-05-08T18:51:15.077113+0000","last_fullsized":"2024-05-08T18:51:15.077113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:53:26.336839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.861403+0000","last_change":"2024-05-08T18:50:28.026318+0000","last_active":"2024-05-08T18:53:34.861403+0000","last_peered":"2024-05-08T18:53:34.861403+0000","last_clean":"2024-05-08T18:53:34.861403+0000","last_became_active":"2024-05-08T18:50:28.025866+0000","last_became_peered":"2024-05-08T18:50:28.025866+0000","last_unstale":"2024-05-08T18:53:34.861403+0000","last_undegraded":"2024-05-08T18:53:34.861403+0000","last_fullsized":"2024-05-08T18:53:34.861403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:01.592206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072761+0000","last_change":"2024-05-08T18:50:26.025390+0000","last_active":"2024-05-08T18:51:15.072761+0000","last_peered":"2024-05-08T18:51:15.072761+0000","last_clean":"2024-05-08T18:51:15.072761+0000","last_became_active":"2024-05-08T18:50:26.025120+0000","last_became_peered":"2024-05-08T18:50:26.025120+0000","last_unstale":"2024-05-08T18:51:15.072761+0000","last_undegraded":"2024-05-08T18:51:15.072761+0000","last_fullsized":"2024-05-08T18:51:15.072761+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:44:07.534900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"27'8","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.690848+0000","last_change":"2024-05-08T18:50:28.025392+0000","last_active":"2024-05-08T18:53:34.690848+0000","last_peered":"2024-05-08T18:53:34.690848+0000","last_clean":"2024-05-08T18:53:34.690848+0000","last_became_active":"2024-05-08T18:50:28.025098+0000","last_became_peered":"2024-05-08T18:50:28.025098+0000","last_unstale":"2024-05-08T18:53:34.690848+0000","last_undegraded":"2024-05-08T18:53:34.690848+0000","last_fullsized":"2024-05-08T18:53:34.690848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:08:56.748370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.552531+0000","last_change":"2024-05-08T18:50:26.014734+0000","last_active":"2024-05-08T18:53:34.552531+0000","last_peered":"2024-05-08T18:53:34.552531+0000","last_clean":"2024-05-08T18:53:34.552531+0000","last_became_active":"2024-05-08T18:50:26.014434+0000","last_became_peered":"2024-05-08T18:50:26.014434+0000","last_unstale":"2024-05-08T18:53:34.552531+0000","last_undegraded":"2024-05-08T18:53:34.552531+0000","last_fullsized":"2024-05-08T18:53:34.552531+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:08:13.942735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"27'10","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.860680+0000","last_change":"2024-05-08T18:50:28.037769+0000","last_active":"2024-05-08T18:53:34.860680+0000","last_peered":"2024-05-08T18:53:34.860680+0000","last_clean":"2024-05-08T18:53:34.860680+0000","last_became_active":"2024-05-08T18:50:28.037400+0000","last_became_peered":"2024-05-08T18:50:28.037400+0000","last_unstale":"2024-05-08T18:53:34.860680+0000","last_undegraded":"2024-05-08T18:53:34.860680+0000","last_fullsized":"2024-05-08T18:53:34.860680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:32.886516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"25'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.081132+0000","last_change":"2024-05-08T18:50:26.029481+0000","last_active":"2024-05-08T18:51:15.081132+0000","last_peered":"2024-05-08T18:51:15.081132+0000","last_clean":"2024-05-08T18:51:15.081132+0000","last_became_active":"2024-05-08T18:50:26.029047+0000","last_became_peered":"2024-05-08T18:50:26.029047+0000","last_unstale":"2024-05-08T18:51:15.081132+0000","last_undegraded":"2024-05-08T18:51:15.081132+0000","last_fullsized":"2024-05-08T18:51:15.081132+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:13:25.895646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.690549+0000","last_change":"2024-05-08T18:50:28.021411+0000","last_active":"2024-05-08T18:53:34.690549+0000","last_peered":"2024-05-08T18:53:34.690549+0000","last_clean":"2024-05-08T18:53:34.690549+0000","last_became_active":"2024-05-08T18:50:28.021140+0000","last_became_peered":"2024-05-08T18:50:28.021140+0000","last_unstale":"2024-05-08T18:53:34.690549+0000","last_undegraded":"2024-05-08T18:53:34.690549+0000","last_fullsized":"2024-05-08T18:53:34.690549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:14.472478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076427+0000","last_change":"2024-05-08T18:50:26.031998+0000","last_active":"2024-05-08T18:51:15.076427+0000","last_peered":"2024-05-08T18:51:15.076427+0000","last_clean":"2024-05-08T18:51:15.076427+0000","last_became_active":"2024-05-08T18:50:26.031680+0000","last_became_peered":"2024-05-08T18:50:26.031680+0000","last_unstale":"2024-05-08T18:51:15.076427+0000","last_undegraded":"2024-05-08T18:51:15.076427+0000","last_fullsized":"2024-05-08T18:51:15.076427+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:07:40.472317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"27'11","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.004738+0000","last_change":"2024-05-08T18:50:28.023037+0000","last_active":"2024-05-08T18:52:33.004738+0000","last_peered":"2024-05-08T18:52:33.004738+0000","last_clean":"2024-05-08T18:52:33.004738+0000","last_became_active":"2024-05-08T18:50:28.021588+0000","last_became_peered":"2024-05-08T18:50:28.021588+0000","last_unstale":"2024-05-08T18:52:33.004738+0000","last_undegraded":"2024-05-08T18:52:33.004738+0000","last_fullsized":"2024-05-08T18:52:33.004738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:04.433020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.074638+0000","last_change":"2024-05-08T18:50:26.014622+0000","last_active":"2024-05-08T18:51:15.074638+0000","last_peered":"2024-05-08T18:51:15.074638+0000","last_clean":"2024-05-08T18:51:15.074638+0000","last_became_active":"2024-05-08T18:50:26.014383+0000","last_became_peered":"2024-05-08T18:50:26.014383+0000","last_unstale":"2024-05-08T18:51:15.074638+0000","last_undegraded":"2024-05-08T18:51:15.074638+0000","last_fullsized":"2024-05-08T18:51:15.074638+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:31:52.859857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"27'5","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007384+0000","last_change":"2024-05-08T18:50:28.032443+0000","last_active":"2024-05-08T18:52:48.007384+0000","last_peered":"2024-05-08T18:52:48.007384+0000","last_clean":"2024-05-08T18:52:48.007384+0000","last_became_active":"2024-05-08T18:50:28.032181+0000","last_became_peered":"2024-05-08T18:50:28.032181+0000","last_unstale":"2024-05-08T18:52:48.007384+0000","last_undegraded":"2024-05-08T18:52:48.007384+0000","last_fullsized":"2024-05-08T18:52:48.007384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:14.122243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.554953+0000","last_change":"2024-05-08T18:50:26.025793+0000","last_active":"2024-05-08T18:53:34.554953+0000","last_peered":"2024-05-08T18:53:34.554953+0000","last_clean":"2024-05-08T18:53:34.554953+0000","last_became_active":"2024-05-08T18:50:26.025473+0000","last_became_peered":"2024-05-08T18:50:26.025473+0000","last_unstale":"2024-05-08T18:53:34.554953+0000","last_undegraded":"2024-05-08T18:53:34.554953+0000","last_fullsized":"2024-05-08T18:53:34.554953+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:54.988707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.860972+0000","last_change":"2024-05-08T18:50:28.032744+0000","last_active":"2024-05-08T18:53:34.860972+0000","last_peered":"2024-05-08T18:53:34.860972+0000","last_clean":"2024-05-08T18:53:34.860972+0000","last_became_active":"2024-05-08T18:50:28.032462+0000","last_became_peered":"2024-05-08T18:50:28.032462+0000","last_unstale":"2024-05-08T18:53:34.860972+0000","last_undegraded":"2024-05-08T18:53:34.860972+0000","last_fullsized":"2024-05-08T18:53:34.860972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:56.484964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.072300+0000","last_change":"2024-05-08T18:50:26.019960+0000","last_active":"2024-05-08T18:51:15.072300+0000","last_peered":"2024-05-08T18:51:15.072300+0000","last_clean":"2024-05-08T18:51:15.072300+0000","last_became_active":"2024-05-08T18:50:26.019706+0000","last_became_peered":"2024-05-08T18:50:26.019706+0000","last_unstale":"2024-05-08T18:51:15.072300+0000","last_undegraded":"2024-05-08T18:51:15.072300+0000","last_fullsized":"2024-05-08T18:51:15.072300+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:09.253705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"27'1","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.001897+0000","last_change":"2024-05-08T18:50:28.031514+0000","last_active":"2024-05-08T18:52:43.001897+0000","last_peered":"2024-05-08T18:52:43.001897+0000","last_clean":"2024-05-08T18:52:43.001897+0000","last_became_active":"2024-05-08T18:50:28.031188+0000","last_became_peered":"2024-05-08T18:50:28.031188+0000","last_unstale":"2024-05-08T18:52:43.001897+0000","last_undegraded":"2024-05-08T18:52:43.001897+0000","last_fullsized":"2024-05-08T18:52:43.001897+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:29.243577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075633+0000","last_change":"2024-05-08T18:50:26.025601+0000","last_active":"2024-05-08T18:51:15.075633+0000","last_peered":"2024-05-08T18:51:15.075633+0000","last_clean":"2024-05-08T18:51:15.075633+0000","last_became_active":"2024-05-08T18:50:26.024808+0000","last_became_peered":"2024-05-08T18:50:26.024808+0000","last_unstale":"2024-05-08T18:51:15.075633+0000","last_undegraded":"2024-05-08T18:51:15.075633+0000","last_fullsized":"2024-05-08T18:51:15.075633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:09.253705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"27'6","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.887561+0000","last_change":"2024-05-08T18:50:28.023364+0000","last_active":"2024-05-08T18:53:34.887561+0000","last_peered":"2024-05-08T18:53:34.887561+0000","last_clean":"2024-05-08T18:53:34.887561+0000","last_became_active":"2024-05-08T18:50:28.022905+0000","last_became_peered":"2024-05-08T18:50:28.022905+0000","last_unstale":"2024-05-08T18:53:34.887561+0000","last_undegraded":"2024-05-08T18:53:34.887561+0000","last_fullsized":"2024-05-08T18:53:34.887561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:29:28.977842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.078754+0000","last_change":"2024-05-08T18:50:26.025267+0000","last_active":"2024-05-08T18:51:15.078754+0000","last_peered":"2024-05-08T18:51:15.078754+0000","last_clean":"2024-05-08T18:51:15.078754+0000","last_became_active":"2024-05-08T18:50:26.024977+0000","last_became_peered":"2024-05-08T18:50:26.024977+0000","last_unstale":"2024-05-08T18:51:15.078754+0000","last_undegraded":"2024-05-08T18:51:15.078754+0000","last_fullsized":"2024-05-08T18:51:15.078754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:07.271771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076314+0000","last_change":"2024-05-08T18:50:28.037398+0000","last_active":"2024-05-08T18:51:15.076314+0000","last_peered":"2024-05-08T18:51:15.076314+0000","last_clean":"2024-05-08T18:51:15.076314+0000","last_became_active":"2024-05-08T18:50:28.037153+0000","last_became_peered":"2024-05-08T18:50:28.037153+0000","last_unstale":"2024-05-08T18:51:15.076314+0000","last_undegraded":"2024-05-08T18:51:15.076314+0000","last_fullsized":"2024-05-08T18:51:15.076314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:02:24.508392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.079754+0000","last_change":"2024-05-08T18:50:26.012280+0000","last_active":"2024-05-08T18:51:15.079754+0000","last_peered":"2024-05-08T18:51:15.079754+0000","last_clean":"2024-05-08T18:51:15.079754+0000","last_became_active":"2024-05-08T18:50:26.011982+0000","last_became_peered":"2024-05-08T18:50:26.011982+0000","last_unstale":"2024-05-08T18:51:15.079754+0000","last_undegraded":"2024-05-08T18:51:15.079754+0000","last_fullsized":"2024-05-08T18:51:15.079754+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:12.465547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"27'8","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:50.475728+0000","last_change":"2024-05-08T18:50:28.028689+0000","last_active":"2024-05-08T18:51:50.475728+0000","last_peered":"2024-05-08T18:51:50.475728+0000","last_clean":"2024-05-08T18:51:50.475728+0000","last_became_active":"2024-05-08T18:50:28.028405+0000","last_became_peered":"2024-05-08T18:50:28.028405+0000","last_unstale":"2024-05-08T18:51:50.475728+0000","last_undegraded":"2024-05-08T18:51:50.475728+0000","last_fullsized":"2024-05-08T18:51:50.475728+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:29.243577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:31.110738+0000","last_change":"2024-05-08T18:50:26.023917+0000","last_active":"2024-05-08T18:52:31.110738+0000","last_peered":"2024-05-08T18:52:31.110738+0000","last_clean":"2024-05-08T18:52:31.110738+0000","last_became_active":"2024-05-08T18:50:26.023658+0000","last_became_peered":"2024-05-08T18:50:26.023658+0000","last_unstale":"2024-05-08T18:52:31.110738+0000","last_undegraded":"2024-05-08T18:52:31.110738+0000","last_fullsized":"2024-05-08T18:52:31.110738+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:38:03.869777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"25'4","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.076645+0000","last_change":"2024-05-08T18:50:28.032840+0000","last_active":"2024-05-08T18:51:15.076645+0000","last_peered":"2024-05-08T18:51:15.076645+0000","last_clean":"2024-05-08T18:51:15.076645+0000","last_became_active":"2024-05-08T18:50:28.032552+0000","last_became_peered":"2024-05-08T18:50:28.032552+0000","last_unstale":"2024-05-08T18:51:15.076645+0000","last_undegraded":"2024-05-08T18:51:15.076645+0000","last_fullsized":"2024-05-08T18:51:15.076645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:37.204016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075410+0000","last_change":"2024-05-08T18:50:26.032685+0000","last_active":"2024-05-08T18:51:15.075410+0000","last_peered":"2024-05-08T18:51:15.075410+0000","last_clean":"2024-05-08T18:51:15.075410+0000","last_became_active":"2024-05-08T18:50:26.032385+0000","last_became_peered":"2024-05-08T18:50:26.032385+0000","last_unstale":"2024-05-08T18:51:15.075410+0000","last_undegraded":"2024-05-08T18:51:15.075410+0000","last_fullsized":"2024-05-08T18:51:15.075410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:10.080123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"27'6","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.242807+0000","last_change":"2024-05-08T18:50:28.024068+0000","last_active":"2024-05-08T18:52:34.242807+0000","last_peered":"2024-05-08T18:52:34.242807+0000","last_clean":"2024-05-08T18:52:34.242807+0000","last_became_active":"2024-05-08T18:50:28.023807+0000","last_became_peered":"2024-05-08T18:50:28.023807+0000","last_unstale":"2024-05-08T18:52:34.242807+0000","last_undegraded":"2024-05-08T18:52:34.242807+0000","last_fullsized":"2024-05-08T18:52:34.242807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:13.501403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.221151+0000","last_change":"2024-05-08T18:50:26.026065+0000","last_active":"2024-05-08T18:52:34.221151+0000","last_peered":"2024-05-08T18:52:34.221151+0000","last_clean":"2024-05-08T18:52:34.221151+0000","last_became_active":"2024-05-08T18:50:26.025023+0000","last_became_peered":"2024-05-08T18:50:26.025023+0000","last_unstale":"2024-05-08T18:52:34.221151+0000","last_undegraded":"2024-05-08T18:52:34.221151+0000","last_fullsized":"2024-05-08T18:52:34.221151+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:45:28.045523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'6","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.152460+0000","last_change":"2024-05-08T18:50:26.026599+0000","last_active":"2024-05-08T18:52:34.152460+0000","last_peered":"2024-05-08T18:52:34.152460+0000","last_clean":"2024-05-08T18:52:34.152460+0000","last_became_active":"2024-05-08T18:50:26.026333+0000","last_became_peered":"2024-05-08T18:50:26.026333+0000","last_unstale":"2024-05-08T18:52:34.152460+0000","last_undegraded":"2024-05-08T18:52:34.152460+0000","last_fullsized":"2024-05-08T18:52:34.152460+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:05.498928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"25'4","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:51:15.075022+0000","last_change":"2024-05-08T18:50:28.024946+0000","last_active":"2024-05-08T18:51:15.075022+0000","last_peered":"2024-05-08T18:51:15.075022+0000","last_clean":"2024-05-08T18:51:15.075022+0000","last_became_active":"2024-05-08T18:50:28.024627+0000","last_became_peered":"2024-05-08T18:50:28.024627+0000","last_unstale":"2024-05-08T18:51:15.075022+0000","last_undegraded":"2024-05-08T18:51:15.075022+0000","last_fullsized":"2024-05-08T18:51:15.075022+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:44.968210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.551493+0000","last_change":"2024-05-08T18:50:26.025142+0000","last_active":"2024-05-08T18:53:34.551493+0000","last_peered":"2024-05-08T18:53:34.551493+0000","last_clean":"2024-05-08T18:53:34.551493+0000","last_became_active":"2024-05-08T18:50:26.024839+0000","last_became_peered":"2024-05-08T18:50:26.024839+0000","last_unstale":"2024-05-08T18:53:34.551493+0000","last_undegraded":"2024-05-08T18:53:34.551493+0000","last_fullsized":"2024-05-08T18:53:34.551493+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:13:25.895646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'7","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.008084+0000","last_change":"2024-05-08T18:50:28.038943+0000","last_active":"2024-05-08T18:52:53.008084+0000","last_peered":"2024-05-08T18:52:53.008084+0000","last_clean":"2024-05-08T18:52:53.008084+0000","last_became_active":"2024-05-08T18:50:28.038677+0000","last_became_peered":"2024-05-08T18:50:28.038677+0000","last_unstale":"2024-05-08T18:52:53.008084+0000","last_undegraded":"2024-05-08T18:52:53.008084+0000","last_fullsized":"2024-05-08T18:52:53.008084+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:05:55.122520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1374,"ondisk_log_size":1374,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1601,"num_read_kb":1491,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705708,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35748,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336092,"statfs":{"total":96636764160,"available":96600158208,"internally_reserved":0,"allocated":417792,"data_stored":121043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705709,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36260,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335580,"statfs":{"total":96636764160,"available":96599633920,"internally_reserved":0,"allocated":942080,"data_stored":707921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705708,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36284,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335556,"statfs":{"total":96636764160,"available":96599609344,"internally_reserved":0,"allocated":970752,"data_stored":708927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":380928,"data_stored":119875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:53:46.226 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.226 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.226 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.226 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.226 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.227 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.227 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.227 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.227 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.227 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.227 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.227 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.227 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.228 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.228 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.228 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.228 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.228 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.228 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.228 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.228 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.228 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.229 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.229 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.229 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.229 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.229 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.229 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.229 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.230 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.230 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.230 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.230 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.230 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.230 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.230 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.231 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.231 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.231 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.231 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.231 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.231 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.231 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.231 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.232 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.232 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.232 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.232 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.232 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.232 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.233 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.233 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.233 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.233 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.233 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.233 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.233 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.233 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.234 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.234 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.234 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.234 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.234 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.234 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.235 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.235 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.235 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.235 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.235 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.235 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.235 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.236 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.236 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.236 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.236 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.236 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.236 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.236 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.236 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.237 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.237 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.237 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.237 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.237 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.237 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.238 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.238 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.238 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.238 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.238 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.238 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.238 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.238 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.239 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.239 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.239 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.239 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.239 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.239 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.239 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.240 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.240 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.240 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.240 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.240 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.240 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.241 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.241 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.241 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.241 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.241 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.241 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.242 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.242 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.242 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.242 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.242 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.243 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.243 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.243 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.243 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.243 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.243 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.243 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.243 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.243 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.244 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.244 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.244 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.244 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.244 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.244 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.244 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.244 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.244 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.245 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.245 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.245 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.245 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.245 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.245 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.245 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.245 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.245 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.246 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.246 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.246 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.246 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.246 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.246 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.246 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.246 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.246 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.247 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.247 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.247 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.247 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.247 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.247 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.247 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.247 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.248 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.248 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.248 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.248 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.248 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.248 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.248 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.248 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.249 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.249 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.249 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.249 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.249 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.249 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.249 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.249 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.249 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.250 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.250 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.250 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.250 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.250 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.250 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.250 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.250 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.250 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.251 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.251 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.251 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.251 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.251 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.251 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.251 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.251 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.251 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.252 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.252 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.252 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.252 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.252 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.253 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.253 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.253 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.253 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.253 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.253 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.253 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.253 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.254 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.254 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.254 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.254 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.255 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.255 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.255 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.255 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.255 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.255 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.255 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.255 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.255 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.255 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.256 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.256 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.256 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.256 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.256 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.256 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.256 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.256 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.257 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.257 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.257 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.257 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.257 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.257 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.257 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.257 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.257 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.258 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.258 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.258 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.258 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.258 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.258 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.258 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.258 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.258 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.259 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.259 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.259 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.259 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.259 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.259 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.259 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.259 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.259 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.260 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.260 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.260 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.260 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.260 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.260 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.260 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:53:46.260 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T18:54:06.262 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:54:06.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.377+0000 7f134f8ed640 1 Processor -- start 2024-05-08T18:54:06.377 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.377+0000 7f134f8ed640 1 -- start start 2024-05-08T18:54:06.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.377+0000 7f134f8ed640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1348129560 0x7f13481313d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:54:06.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.377+0000 7f134f8ed640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1348072dc0 con 0x7f134806fe20 2024-05-08T18:54:06.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.377+0000 7f134f8ed640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f13481299f0 con 0x7f1348129560 2024-05-08T18:54:06.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.378+0000 7f134ce88640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1348129560 0x7f13481313d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:54:06.378 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.378+0000 7f134d689640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f134806fe20 0x7f1348128e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:42794/0 (socket says 172.21.15.42:42794) 2024-05-08T18:54:06.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.378+0000 7f134d689640 1 -- 172.21.15.42:0/9894528 learned_addr learned my addr 172.21.15.42:0/9894528 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:54:06.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.378+0000 7f133ffff640 1 -- 172.21.15.42:0/9894528 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3818519396 0 0) 0x7f1348072dc0 con 0x7f134806fe20 2024-05-08T18:54:06.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.378+0000 7f133ffff640 1 -- 172.21.15.42:0/9894528 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1334003520 con 0x7f134806fe20 2024-05-08T18:54:06.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.378+0000 7f134ce88640 1 -- 172.21.15.42:0/9894528 >> v1:172.21.15.42:6789/0 conn(0x7f134806fe20 legacy=0x7f1348128e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:54:06.379 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.378+0000 7f134ce88640 1 -- 172.21.15.42:0/9894528 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1348128ad0 con 0x7f1348129560 2024-05-08T18:54:06.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.379+0000 7f134ce88640 1 --2- 172.21.15.42:0/9894528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1348129560 0x7f13481313d0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f1338009720 tx=0x7f133802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488bcae2013b9c57 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:54:06.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.379+0000 7f133ffff640 1 -- 172.21.15.42:0/9894528 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13380316d0 con 0x7f1348129560 2024-05-08T18:54:06.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.379+0000 7f133ffff640 1 -- 172.21.15.42:0/9894528 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1338037070 con 0x7f1348129560 2024-05-08T18:54:06.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.379+0000 7f133ffff640 1 -- 172.21.15.42:0/9894528 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13380319c0 con 0x7f1348129560 2024-05-08T18:54:06.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.379+0000 7f134f8ed640 1 -- 172.21.15.42:0/9894528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1348129560 msgr2=0x7f13481313d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:54:06.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.379+0000 7f134f8ed640 1 --2- 172.21.15.42:0/9894528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1348129560 0x7f13481313d0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f1338009720 tx=0x7f133802b840 comp rx=0 tx=0).stop 2024-05-08T18:54:06.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.379+0000 7f134f8ed640 1 -- 172.21.15.42:0/9894528 shutdown_connections 2024-05-08T18:54:06.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.379+0000 7f134f8ed640 1 --2- 172.21.15.42:0/9894528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1348129560 0x7f13481313d0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:54:06.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.379+0000 7f134f8ed640 1 -- 172.21.15.42:0/9894528 >> 172.21.15.42:0/9894528 conn(0x7f134809a910 msgr2=0x7f134806e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:54:06.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.380+0000 7f134f8ed640 1 -- 172.21.15.42:0/9894528 shutdown_connections 2024-05-08T18:54:06.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.380+0000 7f134f8ed640 1 -- 172.21.15.42:0/9894528 wait complete. 2024-05-08T18:54:06.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.380+0000 7f134f8ed640 1 Processor -- start 2024-05-08T18:54:06.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.381+0000 7f134f8ed640 1 -- start start 2024-05-08T18:54:06.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.381+0000 7f134f8ed640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f134806fe20 0x7f13481c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:54:06.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.381+0000 7f134f8ed640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f1348131910 con 0x7f134806fe20 2024-05-08T18:54:06.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.381+0000 7f134d689640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f134806fe20 0x7f13481c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:54:06.383 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.381+0000 7f134d689640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f134806fe20 0x7f13481c1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:33274/0 (socket says 172.21.15.42:33274) 2024-05-08T18:54:06.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.381+0000 7f134d689640 1 -- 172.21.15.42:0/514067146 learned_addr learned my addr 172.21.15.42:0/514067146 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:54:06.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.381+0000 7f134d689640 1 -- 172.21.15.42:0/514067146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1348115ab0 con 0x7f134806fe20 2024-05-08T18:54:06.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.381+0000 7f134d689640 1 --2- 172.21.15.42:0/514067146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f134806fe20 0x7f13481c1c40 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f134400c480 tx=0x7f134400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:54:06.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.382+0000 7f133dffb640 1 -- 172.21.15.42:0/514067146 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1344017070 con 0x7f134806fe20 2024-05-08T18:54:06.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.382+0000 7f133dffb640 1 -- 172.21.15.42:0/514067146 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1344005c10 con 0x7f134806fe20 2024-05-08T18:54:06.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.382+0000 7f133dffb640 1 -- 172.21.15.42:0/514067146 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1344007070 con 0x7f134806fe20 2024-05-08T18:54:06.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.382+0000 7f134f8ed640 1 -- 172.21.15.42:0/514067146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1348130270 con 0x7f134806fe20 2024-05-08T18:54:06.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.382+0000 7f134f8ed640 1 -- 172.21.15.42:0/514067146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1348130b20 con 0x7f134806fe20 2024-05-08T18:54:06.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.383+0000 7f133dffb640 1 -- 172.21.15.42:0/514067146 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f134401a070 con 0x7f134806fe20 2024-05-08T18:54:06.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.383+0000 7f134f8ed640 1 -- 172.21.15.42:0/514067146 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1348114ec0 con 0x7f134806fe20 2024-05-08T18:54:06.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.383+0000 7f133dffb640 1 --2- 172.21.15.42:0/514067146 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f132c03d2b0 0x7f132c03f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:54:06.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.383+0000 7f133dffb640 1 -- 172.21.15.42:0/514067146 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f1344051040 con 0x7f134806fe20 2024-05-08T18:54:06.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.383+0000 7f134ce88640 1 --2- 172.21.15.42:0/514067146 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f132c03d2b0 0x7f132c03f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:54:06.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.384+0000 7f134ce88640 1 --2- 172.21.15.42:0/514067146 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f132c03d2b0 0x7f132c03f770 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1338036000 tx=0x7f1338008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:54:06.388 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.388+0000 7f133dffb640 1 -- 172.21.15.42:0/514067146 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f1344011c70 con 0x7f134806fe20 2024-05-08T18:54:06.578 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.578+0000 7f134f8ed640 1 -- 172.21.15.42:0/514067146 --> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1348073aa0 con 0x7f132c03d2b0 2024-05-08T18:54:06.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.593+0000 7f133dffb640 1 -- 172.21.15.42:0/514067146 <== mgr.4102 v2:172.21.15.132:6824/2104266563 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658277 (secure 0 0 0) 0x7f1348073aa0 con 0x7f132c03d2b0 2024-05-08T18:54:06.601 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:54:06.607 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-08T18:54:06.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.598+0000 7f134f8ed640 1 -- 172.21.15.42:0/514067146 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f132c03d2b0 msgr2=0x7f132c03f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:54:06.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.598+0000 7f134f8ed640 1 --2- 172.21.15.42:0/514067146 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f132c03d2b0 0x7f132c03f770 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1338036000 tx=0x7f1338008030 comp rx=0 tx=0).stop 2024-05-08T18:54:06.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.598+0000 7f134f8ed640 1 -- 172.21.15.42:0/514067146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f134806fe20 msgr2=0x7f13481c1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:54:06.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.598+0000 7f134f8ed640 1 --2- 172.21.15.42:0/514067146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f134806fe20 0x7f13481c1c40 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f134400c480 tx=0x7f134400c940 comp rx=0 tx=0).stop 2024-05-08T18:54:06.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.598+0000 7f134f8ed640 1 -- 172.21.15.42:0/514067146 shutdown_connections 2024-05-08T18:54:06.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.598+0000 7f134f8ed640 1 --2- 172.21.15.42:0/514067146 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f132c03d2b0 0x7f132c03f770 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:54:06.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.598+0000 7f134f8ed640 1 --2- 172.21.15.42:0/514067146 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f134806fe20 0x7f13481c1c40 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:54:06.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.598+0000 7f134f8ed640 1 -- 172.21.15.42:0/514067146 >> 172.21.15.42:0/514067146 conn(0x7f134809a910 msgr2=0x7f1348125760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:54:06.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.598+0000 7f134f8ed640 1 -- 172.21.15.42:0/514067146 shutdown_connections 2024-05-08T18:54:06.610 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:06.598+0000 7f134f8ed640 1 -- 172.21.15.42:0/514067146 wait complete. 2024-05-08T18:54:06.610 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-05-08T18:54:05.995171+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5031,"num_read_kb":4621,"num_write":2119,"num_write_kb":60585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1336,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4683,"ondisk_log_size":4683,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":139832,"kb_used_data":2648,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377347528,"statfs":{"total":386547056640,"available":386403868672,"internally_reserved":0,"allocated":2711552,"data_stored":1657766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1336,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004321"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.004692+0000","last_change":"2024-05-08T18:50:26.031610+0000","last_active":"2024-05-08T18:52:33.004692+0000","last_peered":"2024-05-08T18:52:33.004692+0000","last_clean":"2024-05-08T18:52:33.004692+0000","last_became_active":"2024-05-08T18:50:26.031359+0000","last_became_peered":"2024-05-08T18:50:26.031359+0000","last_unstale":"2024-05-08T18:52:33.004692+0000","last_undegraded":"2024-05-08T18:52:33.004692+0000","last_fullsized":"2024-05-08T18:52:33.004692+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"27'8","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.869005+0000","last_change":"2024-05-08T18:50:28.028609+0000","last_active":"2024-05-08T18:53:34.869005+0000","last_peered":"2024-05-08T18:53:34.869005+0000","last_clean":"2024-05-08T18:53:34.869005+0000","last_became_active":"2024-05-08T18:50:28.028352+0000","last_became_peered":"2024-05-08T18:50:28.028352+0000","last_unstale":"2024-05-08T18:53:34.869005+0000","last_undegraded":"2024-05-08T18:53:34.869005+0000","last_fullsized":"2024-05-08T18:53:34.869005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.089033+0000","last_change":"2024-05-08T18:50:26.029183+0000","last_active":"2024-05-08T18:52:34.089033+0000","last_peered":"2024-05-08T18:52:34.089033+0000","last_clean":"2024-05-08T18:52:34.089033+0000","last_became_active":"2024-05-08T18:50:26.028799+0000","last_became_peered":"2024-05-08T18:50:26.028799+0000","last_unstale":"2024-05-08T18:52:34.089033+0000","last_undegraded":"2024-05-08T18:52:34.089033+0000","last_fullsized":"2024-05-08T18:52:34.089033+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"27'6","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.894270+0000","last_change":"2024-05-08T18:50:28.034919+0000","last_active":"2024-05-08T18:53:34.894270+0000","last_peered":"2024-05-08T18:53:34.894270+0000","last_clean":"2024-05-08T18:53:34.894270+0000","last_became_active":"2024-05-08T18:50:28.033466+0000","last_became_peered":"2024-05-08T18:50:28.033466+0000","last_unstale":"2024-05-08T18:53:34.894270+0000","last_undegraded":"2024-05-08T18:53:34.894270+0000","last_fullsized":"2024-05-08T18:53:34.894270+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:23.012828+0000","last_change":"2024-05-08T18:51:15.084166+0000","last_active":"2024-05-08T18:53:23.012828+0000","last_peered":"2024-05-08T18:53:23.012828+0000","last_clean":"2024-05-08T18:53:23.012828+0000","last_became_active":"2024-05-08T18:51:15.083809+0000","last_became_peered":"2024-05-08T18:51:15.083809+0000","last_unstale":"2024-05-08T18:53:23.012828+0000","last_undegraded":"2024-05-08T18:53:23.012828+0000","last_fullsized":"2024-05-08T18:53:23.012828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"25'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:44.491509+0000","last_change":"2024-05-08T18:51:15.083978+0000","last_active":"2024-05-08T18:53:44.491509+0000","last_peered":"2024-05-08T18:53:44.491509+0000","last_clean":"2024-05-08T18:53:44.491509+0000","last_became_active":"2024-05-08T18:51:15.080716+0000","last_became_peered":"2024-05-08T18:51:15.080716+0000","last_unstale":"2024-05-08T18:53:44.491509+0000","last_undegraded":"2024-05-08T18:53:44.491509+0000","last_fullsized":"2024-05-08T18:53:44.491509+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:28.003903+0000","last_change":"2024-05-08T18:50:26.024545+0000","last_active":"2024-05-08T18:52:28.003903+0000","last_peered":"2024-05-08T18:52:28.003903+0000","last_clean":"2024-05-08T18:52:28.003903+0000","last_became_active":"2024-05-08T18:50:26.024243+0000","last_became_peered":"2024-05-08T18:50:26.024243+0000","last_unstale":"2024-05-08T18:52:28.003903+0000","last_undegraded":"2024-05-08T18:52:28.003903+0000","last_fullsized":"2024-05-08T18:52:28.003903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"27'4","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.696124+0000","last_change":"2024-05-08T18:50:28.026931+0000","last_active":"2024-05-08T18:53:34.696124+0000","last_peered":"2024-05-08T18:53:34.696124+0000","last_clean":"2024-05-08T18:53:34.696124+0000","last_became_active":"2024-05-08T18:50:28.026380+0000","last_became_peered":"2024-05-08T18:50:28.026380+0000","last_unstale":"2024-05-08T18:53:34.696124+0000","last_undegraded":"2024-05-08T18:53:34.696124+0000","last_fullsized":"2024-05-08T18:53:34.696124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"25'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.009373+0000","last_change":"2024-05-08T18:50:26.023188+0000","last_active":"2024-05-08T18:52:58.009373+0000","last_peered":"2024-05-08T18:52:58.009373+0000","last_clean":"2024-05-08T18:52:58.009373+0000","last_became_active":"2024-05-08T18:50:26.022914+0000","last_became_peered":"2024-05-08T18:50:26.022914+0000","last_unstale":"2024-05-08T18:52:58.009373+0000","last_undegraded":"2024-05-08T18:52:58.009373+0000","last_fullsized":"2024-05-08T18:52:58.009373+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'6","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.894361+0000","last_change":"2024-05-08T18:50:28.023780+0000","last_active":"2024-05-08T18:53:34.894361+0000","last_peered":"2024-05-08T18:53:34.894361+0000","last_clean":"2024-05-08T18:53:34.894361+0000","last_became_active":"2024-05-08T18:50:28.023506+0000","last_became_peered":"2024-05-08T18:50:28.023506+0000","last_unstale":"2024-05-08T18:53:34.894361+0000","last_undegraded":"2024-05-08T18:53:34.894361+0000","last_fullsized":"2024-05-08T18:53:34.894361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"25'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.008779+0000","last_change":"2024-05-08T18:50:26.024901+0000","last_active":"2024-05-08T18:52:58.008779+0000","last_peered":"2024-05-08T18:52:58.008779+0000","last_clean":"2024-05-08T18:52:58.008779+0000","last_became_active":"2024-05-08T18:50:26.024493+0000","last_became_peered":"2024-05-08T18:50:26.024493+0000","last_unstale":"2024-05-08T18:52:58.008779+0000","last_undegraded":"2024-05-08T18:52:58.008779+0000","last_fullsized":"2024-05-08T18:52:58.008779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"27'10","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.613971+0000","last_change":"2024-05-08T18:50:28.037839+0000","last_active":"2024-05-08T18:53:34.613971+0000","last_peered":"2024-05-08T18:53:34.613971+0000","last_clean":"2024-05-08T18:53:34.613971+0000","last_became_active":"2024-05-08T18:50:28.037266+0000","last_became_peered":"2024-05-08T18:50:28.037266+0000","last_unstale":"2024-05-08T18:53:34.613971+0000","last_undegraded":"2024-05-08T18:53:34.613971+0000","last_fullsized":"2024-05-08T18:53:34.613971+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.491075+0000","last_change":"2024-05-08T18:50:26.011072+0000","last_active":"2024-05-08T18:53:41.491075+0000","last_peered":"2024-05-08T18:53:41.491075+0000","last_clean":"2024-05-08T18:53:41.491075+0000","last_became_active":"2024-05-08T18:50:26.010734+0000","last_became_peered":"2024-05-08T18:50:26.010734+0000","last_unstale":"2024-05-08T18:53:41.491075+0000","last_undegraded":"2024-05-08T18:53:41.491075+0000","last_fullsized":"2024-05-08T18:53:41.491075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.004650+0000","last_change":"2024-05-08T18:50:28.026695+0000","last_active":"2024-05-08T18:52:33.004650+0000","last_peered":"2024-05-08T18:52:33.004650+0000","last_clean":"2024-05-08T18:52:33.004650+0000","last_became_active":"2024-05-08T18:50:28.026028+0000","last_became_peered":"2024-05-08T18:50:28.026028+0000","last_unstale":"2024-05-08T18:52:33.004650+0000","last_undegraded":"2024-05-08T18:52:33.004650+0000","last_fullsized":"2024-05-08T18:52:33.004650+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.003767+0000","last_change":"2024-05-08T18:50:26.029712+0000","last_active":"2024-05-08T18:52:58.003767+0000","last_peered":"2024-05-08T18:52:58.003767+0000","last_clean":"2024-05-08T18:52:58.003767+0000","last_became_active":"2024-05-08T18:50:26.029435+0000","last_became_peered":"2024-05-08T18:50:26.029435+0000","last_unstale":"2024-05-08T18:52:58.003767+0000","last_undegraded":"2024-05-08T18:52:58.003767+0000","last_fullsized":"2024-05-08T18:52:58.003767+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"27'6","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.894454+0000","last_change":"2024-05-08T18:50:28.033720+0000","last_active":"2024-05-08T18:53:34.894454+0000","last_peered":"2024-05-08T18:53:34.894454+0000","last_clean":"2024-05-08T18:53:34.894454+0000","last_became_active":"2024-05-08T18:50:28.033311+0000","last_became_peered":"2024-05-08T18:50:28.033311+0000","last_unstale":"2024-05-08T18:53:34.894454+0000","last_undegraded":"2024-05-08T18:53:34.894454+0000","last_fullsized":"2024-05-08T18:53:34.894454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"27'10","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007556+0000","last_change":"2024-05-08T18:50:28.033240+0000","last_active":"2024-05-08T18:52:48.007556+0000","last_peered":"2024-05-08T18:52:48.007556+0000","last_clean":"2024-05-08T18:52:48.007556+0000","last_became_active":"2024-05-08T18:50:28.032951+0000","last_became_peered":"2024-05-08T18:50:28.032951+0000","last_unstale":"2024-05-08T18:52:48.007556+0000","last_undegraded":"2024-05-08T18:52:48.007556+0000","last_fullsized":"2024-05-08T18:52:48.007556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'4","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.008127+0000","last_change":"2024-05-08T18:50:26.030698+0000","last_active":"2024-05-08T18:52:53.008127+0000","last_peered":"2024-05-08T18:52:53.008127+0000","last_clean":"2024-05-08T18:52:53.008127+0000","last_became_active":"2024-05-08T18:50:26.030437+0000","last_became_peered":"2024-05-08T18:50:26.030437+0000","last_unstale":"2024-05-08T18:52:53.008127+0000","last_undegraded":"2024-05-08T18:52:53.008127+0000","last_fullsized":"2024-05-08T18:52:53.008127+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'21","reported_seq":107,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.939241+0000","last_change":"2024-05-08T18:50:28.028447+0000","last_active":"2024-05-08T18:53:34.939241+0000","last_peered":"2024-05-08T18:53:34.939241+0000","last_clean":"2024-05-08T18:53:34.939241+0000","last_became_active":"2024-05-08T18:50:28.028184+0000","last_became_peered":"2024-05-08T18:50:28.028184+0000","last_unstale":"2024-05-08T18:53:34.939241+0000","last_undegraded":"2024-05-08T18:53:34.939241+0000","last_fullsized":"2024-05-08T18:53:34.939241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":94,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.818857+0000","last_change":"2024-05-08T18:50:26.032028+0000","last_active":"2024-05-08T18:53:34.818857+0000","last_peered":"2024-05-08T18:53:34.818857+0000","last_clean":"2024-05-08T18:53:34.818857+0000","last_became_active":"2024-05-08T18:50:26.031768+0000","last_became_peered":"2024-05-08T18:50:26.031768+0000","last_unstale":"2024-05-08T18:53:34.818857+0000","last_undegraded":"2024-05-08T18:53:34.818857+0000","last_fullsized":"2024-05-08T18:53:34.818857+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'8","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.894630+0000","last_change":"2024-05-08T18:50:28.029440+0000","last_active":"2024-05-08T18:53:34.894630+0000","last_peered":"2024-05-08T18:53:34.894630+0000","last_clean":"2024-05-08T18:53:34.894630+0000","last_became_active":"2024-05-08T18:50:28.029145+0000","last_became_peered":"2024-05-08T18:50:28.029145+0000","last_unstale":"2024-05-08T18:53:34.894630+0000","last_undegraded":"2024-05-08T18:53:34.894630+0000","last_fullsized":"2024-05-08T18:53:34.894630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.811465+0000","last_change":"2024-05-08T18:50:26.031782+0000","last_active":"2024-05-08T18:53:34.811465+0000","last_peered":"2024-05-08T18:53:34.811465+0000","last_clean":"2024-05-08T18:53:34.811465+0000","last_became_active":"2024-05-08T18:50:26.031545+0000","last_became_peered":"2024-05-08T18:50:26.031545+0000","last_unstale":"2024-05-08T18:53:34.811465+0000","last_undegraded":"2024-05-08T18:53:34.811465+0000","last_fullsized":"2024-05-08T18:53:34.811465+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"27'16","reported_seq":75,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.894241+0000","last_change":"2024-05-08T18:50:28.023032+0000","last_active":"2024-05-08T18:53:34.894241+0000","last_peered":"2024-05-08T18:53:34.894241+0000","last_clean":"2024-05-08T18:53:34.894241+0000","last_became_active":"2024-05-08T18:50:28.022683+0000","last_became_peered":"2024-05-08T18:50:28.022683+0000","last_unstale":"2024-05-08T18:53:34.894241+0000","last_undegraded":"2024-05-08T18:53:34.894241+0000","last_fullsized":"2024-05-08T18:53:34.894241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.574146+0000","last_change":"2024-05-08T18:50:26.013216+0000","last_active":"2024-05-08T18:53:34.574146+0000","last_peered":"2024-05-08T18:53:34.574146+0000","last_clean":"2024-05-08T18:53:34.574146+0000","last_became_active":"2024-05-08T18:50:26.011512+0000","last_became_peered":"2024-05-08T18:50:26.011512+0000","last_unstale":"2024-05-08T18:53:34.574146+0000","last_undegraded":"2024-05-08T18:53:34.574146+0000","last_fullsized":"2024-05-08T18:53:34.574146+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.007856+0000","last_change":"2024-05-08T18:50:28.033091+0000","last_active":"2024-05-08T18:52:53.007856+0000","last_peered":"2024-05-08T18:52:53.007856+0000","last_clean":"2024-05-08T18:52:53.007856+0000","last_became_active":"2024-05-08T18:50:28.032768+0000","last_became_peered":"2024-05-08T18:50:28.032768+0000","last_unstale":"2024-05-08T18:52:53.007856+0000","last_undegraded":"2024-05-08T18:52:53.007856+0000","last_fullsized":"2024-05-08T18:52:53.007856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.003227+0000","last_change":"2024-05-08T18:50:26.029400+0000","last_active":"2024-05-08T18:52:53.003227+0000","last_peered":"2024-05-08T18:52:53.003227+0000","last_clean":"2024-05-08T18:52:53.003227+0000","last_became_active":"2024-05-08T18:50:26.029015+0000","last_became_peered":"2024-05-08T18:50:26.029015+0000","last_unstale":"2024-05-08T18:52:53.003227+0000","last_undegraded":"2024-05-08T18:52:53.003227+0000","last_fullsized":"2024-05-08T18:52:53.003227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"27'14","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.868651+0000","last_change":"2024-05-08T18:50:28.022984+0000","last_active":"2024-05-08T18:53:34.868651+0000","last_peered":"2024-05-08T18:53:34.868651+0000","last_clean":"2024-05-08T18:53:34.868651+0000","last_became_active":"2024-05-08T18:50:28.022359+0000","last_became_peered":"2024-05-08T18:50:28.022359+0000","last_unstale":"2024-05-08T18:53:34.868651+0000","last_undegraded":"2024-05-08T18:53:34.868651+0000","last_fullsized":"2024-05-08T18:53:34.868651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.493628+0000","last_change":"2024-05-08T18:50:26.017214+0000","last_active":"2024-05-08T18:53:41.493628+0000","last_peered":"2024-05-08T18:53:41.493628+0000","last_clean":"2024-05-08T18:53:41.493628+0000","last_became_active":"2024-05-08T18:50:26.016932+0000","last_became_peered":"2024-05-08T18:50:26.016932+0000","last_unstale":"2024-05-08T18:53:41.493628+0000","last_undegraded":"2024-05-08T18:53:41.493628+0000","last_fullsized":"2024-05-08T18:53:41.493628+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"27'41","reported_seq":108,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.902438+0000","last_change":"2024-05-08T18:50:36.055719+0000","last_active":"2024-05-08T18:53:34.902438+0000","last_peered":"2024-05-08T18:53:34.902438+0000","last_clean":"2024-05-08T18:53:34.902438+0000","last_became_active":"2024-05-08T18:50:36.055045+0000","last_became_peered":"2024-05-08T18:50:36.055045+0000","last_unstale":"2024-05-08T18:53:34.902438+0000","last_undegraded":"2024-05-08T18:53:34.902438+0000","last_fullsized":"2024-05-08T18:53:34.902438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":182,"num_write":115,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'10","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.829686+0000","last_change":"2024-05-08T18:50:28.025676+0000","last_active":"2024-05-08T18:53:34.829686+0000","last_peered":"2024-05-08T18:53:34.829686+0000","last_clean":"2024-05-08T18:53:34.829686+0000","last_became_active":"2024-05-08T18:50:28.025239+0000","last_became_peered":"2024-05-08T18:50:28.025239+0000","last_unstale":"2024-05-08T18:53:34.829686+0000","last_undegraded":"2024-05-08T18:53:34.829686+0000","last_fullsized":"2024-05-08T18:53:34.829686+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007667+0000","last_change":"2024-05-08T18:50:26.026659+0000","last_active":"2024-05-08T18:52:48.007667+0000","last_peered":"2024-05-08T18:52:48.007667+0000","last_clean":"2024-05-08T18:52:48.007667+0000","last_became_active":"2024-05-08T18:50:26.026400+0000","last_became_peered":"2024-05-08T18:50:26.026400+0000","last_unstale":"2024-05-08T18:52:48.007667+0000","last_undegraded":"2024-05-08T18:52:48.007667+0000","last_fullsized":"2024-05-08T18:52:48.007667+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:46.101267+0000","last_change":"2024-05-08T18:53:46.101302+0000","last_active":"2024-05-08T18:53:46.101267+0000","last_peered":"2024-05-08T18:53:46.101267+0000","last_clean":"2024-05-08T18:53:46.101267+0000","last_became_active":"2024-05-08T18:50:30.034832+0000","last_became_peered":"2024-05-08T18:50:30.034832+0000","last_unstale":"2024-05-08T18:53:46.101267+0000","last_undegraded":"2024-05-08T18:53:46.101267+0000","last_fullsized":"2024-05-08T18:53:46.101267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:46.101144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:46.101144+0000","last_clean_scrub_stamp":"2024-05-08T18:53:46.101144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:47.297905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"27'33","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.569109+0000","last_change":"2024-05-08T18:50:32.044302+0000","last_active":"2024-05-08T18:53:41.569109+0000","last_peered":"2024-05-08T18:53:41.569109+0000","last_clean":"2024-05-08T18:53:41.569109+0000","last_became_active":"2024-05-08T18:50:32.042432+0000","last_became_peered":"2024-05-08T18:50:32.042432+0000","last_unstale":"2024-05-08T18:53:41.569109+0000","last_undegraded":"2024-05-08T18:53:41.569109+0000","last_fullsized":"2024-05-08T18:53:41.569109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:52.079227+0000","last_change":"2024-05-08T18:53:52.079267+0000","last_active":"2024-05-08T18:53:52.079227+0000","last_peered":"2024-05-08T18:53:52.079227+0000","last_clean":"2024-05-08T18:53:52.079227+0000","last_became_active":"2024-05-08T18:50:34.048339+0000","last_became_peered":"2024-05-08T18:50:34.048339+0000","last_unstale":"2024-05-08T18:53:52.079227+0000","last_undegraded":"2024-05-08T18:53:52.079227+0000","last_fullsized":"2024-05-08T18:53:52.079227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:52.079130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:52.079130+0000","last_clean_scrub_stamp":"2024-05-08T18:53:52.079130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:45.266873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"27'7","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:03.009599+0000","last_change":"2024-05-08T18:50:36.055618+0000","last_active":"2024-05-08T18:53:03.009599+0000","last_peered":"2024-05-08T18:53:03.009599+0000","last_clean":"2024-05-08T18:53:03.009599+0000","last_became_active":"2024-05-08T18:50:36.055220+0000","last_became_peered":"2024-05-08T18:50:36.055220+0000","last_unstale":"2024-05-08T18:53:03.009599+0000","last_undegraded":"2024-05-08T18:53:03.009599+0000","last_fullsized":"2024-05-08T18:53:03.009599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"25'2","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.008572+0000","last_change":"2024-05-08T18:50:28.038524+0000","last_active":"2024-05-08T18:52:53.008572+0000","last_peered":"2024-05-08T18:52:53.008572+0000","last_clean":"2024-05-08T18:52:53.008572+0000","last_became_active":"2024-05-08T18:50:28.038232+0000","last_became_peered":"2024-05-08T18:50:28.038232+0000","last_unstale":"2024-05-08T18:52:53.008572+0000","last_undegraded":"2024-05-08T18:52:53.008572+0000","last_fullsized":"2024-05-08T18:52:53.008572+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.496533+0000","last_change":"2024-05-08T18:50:26.031250+0000","last_active":"2024-05-08T18:53:41.496533+0000","last_peered":"2024-05-08T18:53:41.496533+0000","last_clean":"2024-05-08T18:53:41.496533+0000","last_became_active":"2024-05-08T18:50:26.030986+0000","last_became_peered":"2024-05-08T18:50:26.030986+0000","last_unstale":"2024-05-08T18:53:41.496533+0000","last_undegraded":"2024-05-08T18:53:41.496533+0000","last_fullsized":"2024-05-08T18:53:41.496533+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.003249+0000","last_change":"2024-05-08T18:50:30.026937+0000","last_active":"2024-05-08T18:52:53.003249+0000","last_peered":"2024-05-08T18:52:53.003249+0000","last_clean":"2024-05-08T18:52:53.003249+0000","last_became_active":"2024-05-08T18:50:30.026538+0000","last_became_peered":"2024-05-08T18:50:30.026538+0000","last_unstale":"2024-05-08T18:52:53.003249+0000","last_undegraded":"2024-05-08T18:52:53.003249+0000","last_fullsized":"2024-05-08T18:52:53.003249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:50.126320+0000","last_change":"2024-05-08T18:53:50.126357+0000","last_active":"2024-05-08T18:53:50.126320+0000","last_peered":"2024-05-08T18:53:50.126320+0000","last_clean":"2024-05-08T18:53:50.126320+0000","last_became_active":"2024-05-08T18:50:32.039031+0000","last_became_peered":"2024-05-08T18:50:32.039031+0000","last_unstale":"2024-05-08T18:53:50.126320+0000","last_undegraded":"2024-05-08T18:53:50.126320+0000","last_fullsized":"2024-05-08T18:53:50.126320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-08T18:53:50.126231+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-08T18:53:50.126231+0000","last_clean_scrub_stamp":"2024-05-08T18:53:50.126231+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:49.044855+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:00.011377+0000","last_change":"2024-05-08T18:54:00.011405+0000","last_active":"2024-05-08T18:54:00.011377+0000","last_peered":"2024-05-08T18:54:00.011377+0000","last_clean":"2024-05-08T18:54:00.011377+0000","last_became_active":"2024-05-08T18:50:34.050512+0000","last_became_peered":"2024-05-08T18:50:34.050512+0000","last_unstale":"2024-05-08T18:54:00.011377+0000","last_undegraded":"2024-05-08T18:54:00.011377+0000","last_fullsized":"2024-05-08T18:54:00.011377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:00.011283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:00.011283+0000","last_clean_scrub_stamp":"2024-05-08T18:54:00.011283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:48.823802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"25'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:08.005296+0000","last_change":"2024-05-08T18:50:36.048388+0000","last_active":"2024-05-08T18:53:08.005296+0000","last_peered":"2024-05-08T18:53:08.005296+0000","last_clean":"2024-05-08T18:53:08.005296+0000","last_became_active":"2024-05-08T18:50:36.048075+0000","last_became_peered":"2024-05-08T18:50:36.048075+0000","last_unstale":"2024-05-08T18:53:08.005296+0000","last_undegraded":"2024-05-08T18:53:08.005296+0000","last_fullsized":"2024-05-08T18:53:08.005296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'10","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.868598+0000","last_change":"2024-05-08T18:50:28.026321+0000","last_active":"2024-05-08T18:53:34.868598+0000","last_peered":"2024-05-08T18:53:34.868598+0000","last_clean":"2024-05-08T18:53:34.868598+0000","last_became_active":"2024-05-08T18:50:28.025867+0000","last_became_peered":"2024-05-08T18:50:28.025867+0000","last_unstale":"2024-05-08T18:53:34.868598+0000","last_undegraded":"2024-05-08T18:53:34.868598+0000","last_fullsized":"2024-05-08T18:53:34.868598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.490938+0000","last_change":"2024-05-08T18:50:26.025750+0000","last_active":"2024-05-08T18:53:41.490938+0000","last_peered":"2024-05-08T18:53:41.490938+0000","last_clean":"2024-05-08T18:53:41.490938+0000","last_became_active":"2024-05-08T18:50:26.025410+0000","last_became_peered":"2024-05-08T18:50:26.025410+0000","last_unstale":"2024-05-08T18:53:41.490938+0000","last_undegraded":"2024-05-08T18:53:41.490938+0000","last_fullsized":"2024-05-08T18:53:41.490938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.003925+0000","last_change":"2024-05-08T18:50:30.029531+0000","last_active":"2024-05-08T18:52:58.003925+0000","last_peered":"2024-05-08T18:52:58.003925+0000","last_clean":"2024-05-08T18:52:58.003925+0000","last_became_active":"2024-05-08T18:50:30.029196+0000","last_became_peered":"2024-05-08T18:50:30.029196+0000","last_unstale":"2024-05-08T18:52:58.003925+0000","last_undegraded":"2024-05-08T18:52:58.003925+0000","last_fullsized":"2024-05-08T18:52:58.003925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"27'15","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:51.005744+0000","last_change":"2024-05-08T18:53:51.005796+0000","last_active":"2024-05-08T18:53:51.005744+0000","last_peered":"2024-05-08T18:53:51.005744+0000","last_clean":"2024-05-08T18:53:51.005744+0000","last_became_active":"2024-05-08T18:50:32.044056+0000","last_became_peered":"2024-05-08T18:50:32.044056+0000","last_unstale":"2024-05-08T18:53:51.005744+0000","last_undegraded":"2024-05-08T18:53:51.005744+0000","last_fullsized":"2024-05-08T18:53:51.005744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-08T18:53:51.005656+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-08T18:53:51.005656+0000","last_clean_scrub_stamp":"2024-05-08T18:53:51.005656+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:01:56.400586+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"27'285","reported_seq":394,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.574171+0000","last_change":"2024-05-08T18:50:34.042149+0000","last_active":"2024-05-08T18:53:41.574171+0000","last_peered":"2024-05-08T18:53:41.574171+0000","last_clean":"2024-05-08T18:53:41.574171+0000","last_became_active":"2024-05-08T18:50:34.041872+0000","last_became_peered":"2024-05-08T18:50:34.041872+0000","last_unstale":"2024-05-08T18:53:41.574171+0000","last_undegraded":"2024-05-08T18:53:41.574171+0000","last_fullsized":"2024-05-08T18:53:41.574171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:08.010430+0000","last_change":"2024-05-08T18:50:36.049616+0000","last_active":"2024-05-08T18:53:08.010430+0000","last_peered":"2024-05-08T18:53:08.010430+0000","last_clean":"2024-05-08T18:53:08.010430+0000","last_became_active":"2024-05-08T18:50:36.049346+0000","last_became_peered":"2024-05-08T18:50:36.049346+0000","last_unstale":"2024-05-08T18:53:08.010430+0000","last_undegraded":"2024-05-08T18:53:08.010430+0000","last_fullsized":"2024-05-08T18:53:08.010430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'6","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.003303+0000","last_change":"2024-05-08T18:50:28.031653+0000","last_active":"2024-05-08T18:52:53.003303+0000","last_peered":"2024-05-08T18:52:53.003303+0000","last_clean":"2024-05-08T18:52:53.003303+0000","last_became_active":"2024-05-08T18:50:28.031332+0000","last_became_peered":"2024-05-08T18:50:28.031332+0000","last_unstale":"2024-05-08T18:52:53.003303+0000","last_undegraded":"2024-05-08T18:52:53.003303+0000","last_fullsized":"2024-05-08T18:52:53.003303+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007135+0000","last_change":"2024-05-08T18:50:26.032415+0000","last_active":"2024-05-08T18:52:48.007135+0000","last_peered":"2024-05-08T18:52:48.007135+0000","last_clean":"2024-05-08T18:52:48.007135+0000","last_became_active":"2024-05-08T18:50:26.032155+0000","last_became_peered":"2024-05-08T18:50:26.032155+0000","last_unstale":"2024-05-08T18:52:48.007135+0000","last_undegraded":"2024-05-08T18:52:48.007135+0000","last_fullsized":"2024-05-08T18:52:48.007135+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"27'5","reported_seq":238,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:49.069175+0000","last_change":"2024-05-08T18:53:49.069207+0000","last_active":"2024-05-08T18:53:49.069175+0000","last_peered":"2024-05-08T18:53:49.069175+0000","last_clean":"2024-05-08T18:53:49.069175+0000","last_became_active":"2024-05-08T18:50:30.034798+0000","last_became_peered":"2024-05-08T18:50:30.034798+0000","last_unstale":"2024-05-08T18:53:49.069175+0000","last_undegraded":"2024-05-08T18:53:49.069175+0000","last_fullsized":"2024-05-08T18:53:49.069175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-08T18:53:49.069063+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-08T18:53:49.069063+0000","last_clean_scrub_stamp":"2024-05-08T18:53:49.069063+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:32.617643+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"27'36","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.006281+0000","last_change":"2024-05-08T18:53:53.006323+0000","last_active":"2024-05-08T18:53:53.006281+0000","last_peered":"2024-05-08T18:53:53.006281+0000","last_clean":"2024-05-08T18:53:53.006281+0000","last_became_active":"2024-05-08T18:50:32.043573+0000","last_became_peered":"2024-05-08T18:50:32.043573+0000","last_unstale":"2024-05-08T18:53:53.006281+0000","last_undegraded":"2024-05-08T18:53:53.006281+0000","last_fullsized":"2024-05-08T18:53:53.006281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-05-08T18:53:53.006187+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-05-08T18:53:53.006187+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.006187+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:39.343300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"27'285","reported_seq":413,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:03.005283+0000","last_change":"2024-05-08T18:54:03.005312+0000","last_active":"2024-05-08T18:54:03.005283+0000","last_peered":"2024-05-08T18:54:03.005283+0000","last_clean":"2024-05-08T18:54:03.005283+0000","last_became_active":"2024-05-08T18:50:34.050122+0000","last_became_peered":"2024-05-08T18:50:34.050122+0000","last_unstale":"2024-05-08T18:54:03.005283+0000","last_undegraded":"2024-05-08T18:54:03.005283+0000","last_fullsized":"2024-05-08T18:54:03.005283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:54:03.005191+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:54:03.005191+0000","last_clean_scrub_stamp":"2024-05-08T18:54:03.005191+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:17.903758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"27'6","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.699195+0000","last_change":"2024-05-08T18:50:28.035510+0000","last_active":"2024-05-08T18:53:34.699195+0000","last_peered":"2024-05-08T18:53:34.699195+0000","last_clean":"2024-05-08T18:53:34.699195+0000","last_became_active":"2024-05-08T18:50:28.034992+0000","last_became_peered":"2024-05-08T18:50:28.034992+0000","last_unstale":"2024-05-08T18:53:34.699195+0000","last_undegraded":"2024-05-08T18:53:34.699195+0000","last_fullsized":"2024-05-08T18:53:34.699195+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006194+0000","last_change":"2024-05-08T18:50:26.023445+0000","last_active":"2024-05-08T18:52:43.006194+0000","last_peered":"2024-05-08T18:52:43.006194+0000","last_clean":"2024-05-08T18:52:43.006194+0000","last_became_active":"2024-05-08T18:50:26.023141+0000","last_became_peered":"2024-05-08T18:50:26.023141+0000","last_unstale":"2024-05-08T18:52:43.006194+0000","last_undegraded":"2024-05-08T18:52:43.006194+0000","last_fullsized":"2024-05-08T18:52:43.006194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:59.048708+0000","last_change":"2024-05-08T18:53:59.048754+0000","last_active":"2024-05-08T18:53:59.048708+0000","last_peered":"2024-05-08T18:53:59.048708+0000","last_clean":"2024-05-08T18:53:59.048708+0000","last_became_active":"2024-05-08T18:50:30.029482+0000","last_became_peered":"2024-05-08T18:50:30.029482+0000","last_unstale":"2024-05-08T18:53:59.048708+0000","last_undegraded":"2024-05-08T18:53:59.048708+0000","last_fullsized":"2024-05-08T18:53:59.048708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:59.048606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:59.048606+0000","last_clean_scrub_stamp":"2024-05-08T18:53:59.048606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:51.442116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"27'52","reported_seq":112,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:54.955612+0000","last_change":"2024-05-08T18:53:54.955673+0000","last_active":"2024-05-08T18:53:54.955612+0000","last_peered":"2024-05-08T18:53:54.955612+0000","last_clean":"2024-05-08T18:53:54.955612+0000","last_became_active":"2024-05-08T18:50:32.038121+0000","last_became_peered":"2024-05-08T18:50:32.038121+0000","last_unstale":"2024-05-08T18:53:54.955612+0000","last_undegraded":"2024-05-08T18:53:54.955612+0000","last_fullsized":"2024-05-08T18:53:54.955612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'52","last_scrub_stamp":"2024-05-08T18:53:54.955515+0000","last_deep_scrub":"27'52","last_deep_scrub_stamp":"2024-05-08T18:53:54.955515+0000","last_clean_scrub_stamp":"2024-05-08T18:53:54.955515+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:16.055669+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:44.931133+0000","last_change":"2024-05-08T18:53:44.931154+0000","last_active":"2024-05-08T18:53:44.931133+0000","last_peered":"2024-05-08T18:53:44.931133+0000","last_clean":"2024-05-08T18:53:44.931133+0000","last_became_active":"2024-05-08T18:50:34.047404+0000","last_became_peered":"2024-05-08T18:50:34.047404+0000","last_unstale":"2024-05-08T18:53:44.931133+0000","last_undegraded":"2024-05-08T18:53:44.931133+0000","last_fullsized":"2024-05-08T18:53:44.931133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:44.931063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:44.931063+0000","last_clean_scrub_stamp":"2024-05-08T18:53:44.931063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:50.136970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"27'3","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006034+0000","last_change":"2024-05-08T18:50:36.052192+0000","last_active":"2024-05-08T18:52:43.006034+0000","last_peered":"2024-05-08T18:52:43.006034+0000","last_clean":"2024-05-08T18:52:43.006034+0000","last_became_active":"2024-05-08T18:50:36.051055+0000","last_became_peered":"2024-05-08T18:50:36.051055+0000","last_unstale":"2024-05-08T18:52:43.006034+0000","last_undegraded":"2024-05-08T18:52:43.006034+0000","last_fullsized":"2024-05-08T18:52:43.006034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"27'7","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.938959+0000","last_change":"2024-05-08T18:50:28.018783+0000","last_active":"2024-05-08T18:53:34.938959+0000","last_peered":"2024-05-08T18:53:34.938959+0000","last_clean":"2024-05-08T18:53:34.938959+0000","last_became_active":"2024-05-08T18:50:28.018022+0000","last_became_peered":"2024-05-08T18:50:28.018022+0000","last_unstale":"2024-05-08T18:53:34.938959+0000","last_undegraded":"2024-05-08T18:53:34.938959+0000","last_fullsized":"2024-05-08T18:53:34.938959+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006108+0000","last_change":"2024-05-08T18:50:26.025311+0000","last_active":"2024-05-08T18:52:43.006108+0000","last_peered":"2024-05-08T18:52:43.006108+0000","last_clean":"2024-05-08T18:52:43.006108+0000","last_became_active":"2024-05-08T18:50:26.025028+0000","last_became_peered":"2024-05-08T18:50:26.025028+0000","last_unstale":"2024-05-08T18:52:43.006108+0000","last_undegraded":"2024-05-08T18:52:43.006108+0000","last_fullsized":"2024-05-08T18:52:43.006108+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.001768+0000","last_change":"2024-05-08T18:50:30.032000+0000","last_active":"2024-05-08T18:52:43.001768+0000","last_peered":"2024-05-08T18:52:43.001768+0000","last_clean":"2024-05-08T18:52:43.001768+0000","last_became_active":"2024-05-08T18:50:30.031574+0000","last_became_peered":"2024-05-08T18:50:30.031574+0000","last_unstale":"2024-05-08T18:52:43.001768+0000","last_undegraded":"2024-05-08T18:52:43.001768+0000","last_fullsized":"2024-05-08T18:52:43.001768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"27'35","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.520518+0000","last_change":"2024-05-08T18:50:32.042012+0000","last_active":"2024-05-08T18:53:41.520518+0000","last_peered":"2024-05-08T18:53:41.520518+0000","last_clean":"2024-05-08T18:53:41.520518+0000","last_became_active":"2024-05-08T18:50:32.041239+0000","last_became_peered":"2024-05-08T18:50:32.041239+0000","last_unstale":"2024-05-08T18:53:41.520518+0000","last_undegraded":"2024-05-08T18:53:41.520518+0000","last_fullsized":"2024-05-08T18:53:41.520518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:50.038894+0000","last_change":"2024-05-08T18:53:50.038945+0000","last_active":"2024-05-08T18:53:50.038894+0000","last_peered":"2024-05-08T18:53:50.038894+0000","last_clean":"2024-05-08T18:53:50.038894+0000","last_became_active":"2024-05-08T18:50:34.044487+0000","last_became_peered":"2024-05-08T18:50:34.044487+0000","last_unstale":"2024-05-08T18:53:50.038894+0000","last_undegraded":"2024-05-08T18:53:50.038894+0000","last_fullsized":"2024-05-08T18:53:50.038894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:50.038762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:50.038762+0000","last_clean_scrub_stamp":"2024-05-08T18:53:50.038762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.226504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"27'7","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.870030+0000","last_change":"2024-05-08T18:50:36.051009+0000","last_active":"2024-05-08T18:53:34.870030+0000","last_peered":"2024-05-08T18:53:34.870030+0000","last_clean":"2024-05-08T18:53:34.870030+0000","last_became_active":"2024-05-08T18:50:36.050379+0000","last_became_peered":"2024-05-08T18:50:36.050379+0000","last_unstale":"2024-05-08T18:53:34.870030+0000","last_undegraded":"2024-05-08T18:53:34.870030+0000","last_fullsized":"2024-05-08T18:53:34.870030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"27'6","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.005253+0000","last_change":"2024-05-08T18:50:28.037118+0000","last_active":"2024-05-08T18:52:38.005253+0000","last_peered":"2024-05-08T18:52:38.005253+0000","last_clean":"2024-05-08T18:52:38.005253+0000","last_became_active":"2024-05-08T18:50:28.036821+0000","last_became_peered":"2024-05-08T18:50:28.036821+0000","last_unstale":"2024-05-08T18:52:38.005253+0000","last_undegraded":"2024-05-08T18:52:38.005253+0000","last_fullsized":"2024-05-08T18:52:38.005253+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006852+0000","last_change":"2024-05-08T18:50:26.023248+0000","last_active":"2024-05-08T18:52:43.006852+0000","last_peered":"2024-05-08T18:52:43.006852+0000","last_clean":"2024-05-08T18:52:43.006852+0000","last_became_active":"2024-05-08T18:50:26.022938+0000","last_became_peered":"2024-05-08T18:50:26.022938+0000","last_unstale":"2024-05-08T18:52:43.006852+0000","last_undegraded":"2024-05-08T18:52:43.006852+0000","last_fullsized":"2024-05-08T18:52:43.006852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.002536+0000","last_change":"2024-05-08T18:50:30.029421+0000","last_active":"2024-05-08T18:52:48.002536+0000","last_peered":"2024-05-08T18:52:48.002536+0000","last_clean":"2024-05-08T18:52:48.002536+0000","last_became_active":"2024-05-08T18:50:30.029134+0000","last_became_peered":"2024-05-08T18:50:30.029134+0000","last_unstale":"2024-05-08T18:52:48.002536+0000","last_undegraded":"2024-05-08T18:52:48.002536+0000","last_fullsized":"2024-05-08T18:52:48.002536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"27'46","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:48.046782+0000","last_change":"2024-05-08T18:53:48.046823+0000","last_active":"2024-05-08T18:53:48.046782+0000","last_peered":"2024-05-08T18:53:48.046782+0000","last_clean":"2024-05-08T18:53:48.046782+0000","last_became_active":"2024-05-08T18:50:32.035189+0000","last_became_peered":"2024-05-08T18:50:32.035189+0000","last_unstale":"2024-05-08T18:53:48.046782+0000","last_undegraded":"2024-05-08T18:53:48.046782+0000","last_fullsized":"2024-05-08T18:53:48.046782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-05-08T18:53:48.046702+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-05-08T18:53:48.046702+0000","last_clean_scrub_stamp":"2024-05-08T18:53:48.046702+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:09.757527+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"27'285","reported_seq":366,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:54.987049+0000","last_change":"2024-05-08T18:53:54.987120+0000","last_active":"2024-05-08T18:53:54.987049+0000","last_peered":"2024-05-08T18:53:54.987049+0000","last_clean":"2024-05-08T18:53:54.987049+0000","last_became_active":"2024-05-08T18:50:34.047999+0000","last_became_peered":"2024-05-08T18:50:34.047999+0000","last_unstale":"2024-05-08T18:53:54.987049+0000","last_undegraded":"2024-05-08T18:53:54.987049+0000","last_fullsized":"2024-05-08T18:53:54.987049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:54.986938+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:54.986938+0000","last_clean_scrub_stamp":"2024-05-08T18:53:54.986938+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:56.968910+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.002583+0000","last_change":"2024-05-08T18:50:36.048278+0000","last_active":"2024-05-08T18:52:48.002583+0000","last_peered":"2024-05-08T18:52:48.002583+0000","last_clean":"2024-05-08T18:52:48.002583+0000","last_became_active":"2024-05-08T18:50:36.047981+0000","last_became_peered":"2024-05-08T18:50:36.047981+0000","last_unstale":"2024-05-08T18:52:48.002583+0000","last_undegraded":"2024-05-08T18:52:48.002583+0000","last_fullsized":"2024-05-08T18:52:48.002583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"27'8","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006011+0000","last_change":"2024-05-08T18:50:28.020443+0000","last_active":"2024-05-08T18:52:43.006011+0000","last_peered":"2024-05-08T18:52:43.006011+0000","last_clean":"2024-05-08T18:52:43.006011+0000","last_became_active":"2024-05-08T18:50:28.020004+0000","last_became_peered":"2024-05-08T18:50:28.020004+0000","last_unstale":"2024-05-08T18:52:43.006011+0000","last_undegraded":"2024-05-08T18:52:43.006011+0000","last_fullsized":"2024-05-08T18:52:43.006011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006811+0000","last_change":"2024-05-08T18:50:26.017413+0000","last_active":"2024-05-08T18:52:43.006811+0000","last_peered":"2024-05-08T18:52:43.006811+0000","last_clean":"2024-05-08T18:52:43.006811+0000","last_became_active":"2024-05-08T18:50:26.015955+0000","last_became_peered":"2024-05-08T18:50:26.015955+0000","last_unstale":"2024-05-08T18:52:43.006811+0000","last_undegraded":"2024-05-08T18:52:43.006811+0000","last_fullsized":"2024-05-08T18:52:43.006811+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.001828+0000","last_change":"2024-05-08T18:50:30.030443+0000","last_active":"2024-05-08T18:52:43.001828+0000","last_peered":"2024-05-08T18:52:43.001828+0000","last_clean":"2024-05-08T18:52:43.001828+0000","last_became_active":"2024-05-08T18:50:30.030140+0000","last_became_peered":"2024-05-08T18:50:30.030140+0000","last_unstale":"2024-05-08T18:52:43.001828+0000","last_undegraded":"2024-05-08T18:52:43.001828+0000","last_fullsized":"2024-05-08T18:52:43.001828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"27'64","reported_seq":137,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:56.075355+0000","last_change":"2024-05-08T18:53:56.075427+0000","last_active":"2024-05-08T18:53:56.075355+0000","last_peered":"2024-05-08T18:53:56.075355+0000","last_clean":"2024-05-08T18:53:56.075355+0000","last_became_active":"2024-05-08T18:50:32.040633+0000","last_became_peered":"2024-05-08T18:50:32.040633+0000","last_unstale":"2024-05-08T18:53:56.075355+0000","last_undegraded":"2024-05-08T18:53:56.075355+0000","last_fullsized":"2024-05-08T18:53:56.075355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'64","last_scrub_stamp":"2024-05-08T18:53:56.075259+0000","last_deep_scrub":"27'64","last_deep_scrub_stamp":"2024-05-08T18:53:56.075259+0000","last_clean_scrub_stamp":"2024-05-08T18:53:56.075259+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:31.454654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:51.968283+0000","last_change":"2024-05-08T18:53:51.968305+0000","last_active":"2024-05-08T18:53:51.968283+0000","last_peered":"2024-05-08T18:53:51.968283+0000","last_clean":"2024-05-08T18:53:51.968283+0000","last_became_active":"2024-05-08T18:50:34.043817+0000","last_became_peered":"2024-05-08T18:50:34.043817+0000","last_unstale":"2024-05-08T18:53:51.968283+0000","last_undegraded":"2024-05-08T18:53:51.968283+0000","last_fullsized":"2024-05-08T18:53:51.968283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:51.968195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:51.968195+0000","last_clean_scrub_stamp":"2024-05-08T18:53:51.968195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:00.724814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"27'18","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.982121+0000","last_change":"2024-05-08T18:50:36.054529+0000","last_active":"2024-05-08T18:53:34.982121+0000","last_peered":"2024-05-08T18:53:34.982121+0000","last_clean":"2024-05-08T18:53:34.982121+0000","last_became_active":"2024-05-08T18:50:36.054237+0000","last_became_peered":"2024-05-08T18:50:36.054237+0000","last_unstale":"2024-05-08T18:53:34.982121+0000","last_undegraded":"2024-05-08T18:53:34.982121+0000","last_fullsized":"2024-05-08T18:53:34.982121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"27'10","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.868912+0000","last_change":"2024-05-08T18:51:15.097690+0000","last_active":"2024-05-08T18:53:34.868912+0000","last_peered":"2024-05-08T18:53:34.868912+0000","last_clean":"2024-05-08T18:53:34.868912+0000","last_became_active":"2024-05-08T18:51:15.085560+0000","last_became_peered":"2024-05-08T18:51:15.085560+0000","last_unstale":"2024-05-08T18:53:34.868912+0000","last_undegraded":"2024-05-08T18:53:34.868912+0000","last_fullsized":"2024-05-08T18:53:34.868912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.001851+0000","last_change":"2024-05-08T18:51:15.080314+0000","last_active":"2024-05-08T18:52:43.001851+0000","last_peered":"2024-05-08T18:52:43.001851+0000","last_clean":"2024-05-08T18:52:43.001851+0000","last_became_active":"2024-05-08T18:51:15.080071+0000","last_became_peered":"2024-05-08T18:51:15.080071+0000","last_unstale":"2024-05-08T18:52:43.001851+0000","last_undegraded":"2024-05-08T18:52:43.001851+0000","last_fullsized":"2024-05-08T18:52:43.001851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:01.928027+0000","last_change":"2024-05-08T18:54:01.928071+0000","last_active":"2024-05-08T18:54:01.928027+0000","last_peered":"2024-05-08T18:54:01.928027+0000","last_clean":"2024-05-08T18:54:01.928027+0000","last_became_active":"2024-05-08T18:50:30.033318+0000","last_became_peered":"2024-05-08T18:50:30.033318+0000","last_unstale":"2024-05-08T18:54:01.928027+0000","last_undegraded":"2024-05-08T18:54:01.928027+0000","last_fullsized":"2024-05-08T18:54:01.928027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:01.927918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:01.927918+0000","last_clean_scrub_stamp":"2024-05-08T18:54:01.927918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:00.640748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"27'40","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.113280+0000","last_change":"2024-05-08T18:53:53.113321+0000","last_active":"2024-05-08T18:53:53.113280+0000","last_peered":"2024-05-08T18:53:53.113280+0000","last_clean":"2024-05-08T18:53:53.113280+0000","last_became_active":"2024-05-08T18:50:32.034914+0000","last_became_peered":"2024-05-08T18:50:32.034914+0000","last_unstale":"2024-05-08T18:53:53.113280+0000","last_undegraded":"2024-05-08T18:53:53.113280+0000","last_fullsized":"2024-05-08T18:53:53.113280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-05-08T18:53:53.113190+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-05-08T18:53:53.113190+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.113190+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:19.438913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.008619+0000","last_change":"2024-05-08T18:50:34.047372+0000","last_active":"2024-05-08T18:52:53.008619+0000","last_peered":"2024-05-08T18:52:53.008619+0000","last_clean":"2024-05-08T18:52:53.008619+0000","last_became_active":"2024-05-08T18:50:34.047075+0000","last_became_peered":"2024-05-08T18:50:34.047075+0000","last_unstale":"2024-05-08T18:52:53.008619+0000","last_undegraded":"2024-05-08T18:52:53.008619+0000","last_fullsized":"2024-05-08T18:52:53.008619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.941970+0000","last_change":"2024-05-08T18:50:36.055688+0000","last_active":"2024-05-08T18:53:34.941970+0000","last_peered":"2024-05-08T18:53:34.941970+0000","last_clean":"2024-05-08T18:53:34.941970+0000","last_became_active":"2024-05-08T18:50:36.055385+0000","last_became_peered":"2024-05-08T18:50:36.055385+0000","last_unstale":"2024-05-08T18:53:34.941970+0000","last_undegraded":"2024-05-08T18:53:34.941970+0000","last_fullsized":"2024-05-08T18:53:34.941970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'4","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:01.045296+0000","last_change":"2024-05-08T18:54:01.045321+0000","last_active":"2024-05-08T18:54:01.045296+0000","last_peered":"2024-05-08T18:54:01.045296+0000","last_clean":"2024-05-08T18:54:01.045296+0000","last_became_active":"2024-05-08T18:50:28.038633+0000","last_became_peered":"2024-05-08T18:50:28.038633+0000","last_unstale":"2024-05-08T18:54:01.045296+0000","last_undegraded":"2024-05-08T18:54:01.045296+0000","last_fullsized":"2024-05-08T18:54:01.045296+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:01.045175+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:01.045175+0000","last_clean_scrub_stamp":"2024-05-08T18:54:01.045175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:30.675649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.006123+0000","last_change":"2024-05-08T18:50:26.016599+0000","last_active":"2024-05-08T18:52:38.006123+0000","last_peered":"2024-05-08T18:52:38.006123+0000","last_clean":"2024-05-08T18:52:38.006123+0000","last_became_active":"2024-05-08T18:50:26.016308+0000","last_became_peered":"2024-05-08T18:50:26.016308+0000","last_unstale":"2024-05-08T18:52:38.006123+0000","last_undegraded":"2024-05-08T18:52:38.006123+0000","last_fullsized":"2024-05-08T18:52:38.006123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.002563+0000","last_change":"2024-05-08T18:50:30.032199+0000","last_active":"2024-05-08T18:52:48.002563+0000","last_peered":"2024-05-08T18:52:48.002563+0000","last_clean":"2024-05-08T18:52:48.002563+0000","last_became_active":"2024-05-08T18:50:30.031765+0000","last_became_peered":"2024-05-08T18:50:30.031765+0000","last_unstale":"2024-05-08T18:52:48.002563+0000","last_undegraded":"2024-05-08T18:52:48.002563+0000","last_fullsized":"2024-05-08T18:52:48.002563+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"27'45","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.930724+0000","last_change":"2024-05-08T18:53:58.930760+0000","last_active":"2024-05-08T18:53:58.930724+0000","last_peered":"2024-05-08T18:53:58.930724+0000","last_clean":"2024-05-08T18:53:58.930724+0000","last_became_active":"2024-05-08T18:50:32.035131+0000","last_became_peered":"2024-05-08T18:50:32.035131+0000","last_unstale":"2024-05-08T18:53:58.930724+0000","last_undegraded":"2024-05-08T18:53:58.930724+0000","last_fullsized":"2024-05-08T18:53:58.930724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-05-08T18:53:58.930638+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-05-08T18:53:58.930638+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.930638+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:52.118381+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"27'285","reported_seq":442,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.946293+0000","last_change":"2024-05-08T18:53:45.946321+0000","last_active":"2024-05-08T18:53:45.946293+0000","last_peered":"2024-05-08T18:53:45.946293+0000","last_clean":"2024-05-08T18:53:45.946293+0000","last_became_active":"2024-05-08T18:50:34.047184+0000","last_became_peered":"2024-05-08T18:50:34.047184+0000","last_unstale":"2024-05-08T18:53:45.946293+0000","last_undegraded":"2024-05-08T18:53:45.946293+0000","last_fullsized":"2024-05-08T18:53:45.946293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:45.946195+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:45.946195+0000","last_clean_scrub_stamp":"2024-05-08T18:53:45.946195+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:08:51.238216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"27'12","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.943713+0000","last_change":"2024-05-08T18:50:36.046523+0000","last_active":"2024-05-08T18:53:34.943713+0000","last_peered":"2024-05-08T18:53:34.943713+0000","last_clean":"2024-05-08T18:53:34.943713+0000","last_became_active":"2024-05-08T18:50:36.046209+0000","last_became_peered":"2024-05-08T18:50:36.046209+0000","last_unstale":"2024-05-08T18:53:34.943713+0000","last_undegraded":"2024-05-08T18:53:34.943713+0000","last_fullsized":"2024-05-08T18:53:34.943713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'6","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006141+0000","last_change":"2024-05-08T18:50:28.037293+0000","last_active":"2024-05-08T18:52:43.006141+0000","last_peered":"2024-05-08T18:52:43.006141+0000","last_clean":"2024-05-08T18:52:43.006141+0000","last_became_active":"2024-05-08T18:50:28.036946+0000","last_became_peered":"2024-05-08T18:50:28.036946+0000","last_unstale":"2024-05-08T18:52:43.006141+0000","last_undegraded":"2024-05-08T18:52:43.006141+0000","last_fullsized":"2024-05-08T18:52:43.006141+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.006028+0000","last_change":"2024-05-08T18:50:26.027911+0000","last_active":"2024-05-08T18:52:38.006028+0000","last_peered":"2024-05-08T18:52:38.006028+0000","last_clean":"2024-05-08T18:52:38.006028+0000","last_became_active":"2024-05-08T18:50:26.027657+0000","last_became_peered":"2024-05-08T18:50:26.027657+0000","last_unstale":"2024-05-08T18:52:38.006028+0000","last_undegraded":"2024-05-08T18:52:38.006028+0000","last_fullsized":"2024-05-08T18:52:38.006028+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"27'5","reported_seq":428,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:02.003885+0000","last_change":"2024-05-08T18:54:02.003952+0000","last_active":"2024-05-08T18:54:02.003885+0000","last_peered":"2024-05-08T18:54:02.003885+0000","last_clean":"2024-05-08T18:54:02.003885+0000","last_became_active":"2024-05-08T18:50:30.027420+0000","last_became_peered":"2024-05-08T18:50:30.027420+0000","last_unstale":"2024-05-08T18:54:02.003885+0000","last_undegraded":"2024-05-08T18:54:02.003885+0000","last_fullsized":"2024-05-08T18:54:02.003885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-08T18:54:02.003784+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-08T18:54:02.003784+0000","last_clean_scrub_stamp":"2024-05-08T18:54:02.003784+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:09.462769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'16","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:00.007839+0000","last_change":"2024-05-08T18:54:00.007874+0000","last_active":"2024-05-08T18:54:00.007839+0000","last_peered":"2024-05-08T18:54:00.007839+0000","last_clean":"2024-05-08T18:54:00.007839+0000","last_became_active":"2024-05-08T18:50:32.040988+0000","last_became_peered":"2024-05-08T18:50:32.040988+0000","last_unstale":"2024-05-08T18:54:00.007839+0000","last_undegraded":"2024-05-08T18:54:00.007839+0000","last_fullsized":"2024-05-08T18:54:00.007839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-05-08T18:54:00.007737+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-05-08T18:54:00.007737+0000","last_clean_scrub_stamp":"2024-05-08T18:54:00.007737+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:07.927405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"27'285","reported_seq":471,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:46.055717+0000","last_change":"2024-05-08T18:53:46.055745+0000","last_active":"2024-05-08T18:53:46.055717+0000","last_peered":"2024-05-08T18:53:46.055717+0000","last_clean":"2024-05-08T18:53:46.055717+0000","last_became_active":"2024-05-08T18:50:34.040477+0000","last_became_peered":"2024-05-08T18:50:34.040477+0000","last_unstale":"2024-05-08T18:53:46.055717+0000","last_undegraded":"2024-05-08T18:53:46.055717+0000","last_fullsized":"2024-05-08T18:53:46.055717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:46.055625+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:46.055625+0000","last_clean_scrub_stamp":"2024-05-08T18:53:46.055625+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:55:05.788331+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.005972+0000","last_change":"2024-05-08T18:50:36.047258+0000","last_active":"2024-05-08T18:52:43.005972+0000","last_peered":"2024-05-08T18:52:43.005972+0000","last_clean":"2024-05-08T18:52:43.005972+0000","last_became_active":"2024-05-08T18:50:36.045976+0000","last_became_peered":"2024-05-08T18:50:36.045976+0000","last_unstale":"2024-05-08T18:52:43.005972+0000","last_undegraded":"2024-05-08T18:52:43.005972+0000","last_fullsized":"2024-05-08T18:52:43.005972+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"27'4","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.829778+0000","last_change":"2024-05-08T18:50:28.039262+0000","last_active":"2024-05-08T18:53:34.829778+0000","last_peered":"2024-05-08T18:53:34.829778+0000","last_clean":"2024-05-08T18:53:34.829778+0000","last_became_active":"2024-05-08T18:50:28.038871+0000","last_became_peered":"2024-05-08T18:50:28.038871+0000","last_unstale":"2024-05-08T18:53:34.829778+0000","last_undegraded":"2024-05-08T18:53:34.829778+0000","last_fullsized":"2024-05-08T18:53:34.829778+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.005947+0000","last_change":"2024-05-08T18:50:26.025766+0000","last_active":"2024-05-08T18:52:38.005947+0000","last_peered":"2024-05-08T18:52:38.005947+0000","last_clean":"2024-05-08T18:52:38.005947+0000","last_became_active":"2024-05-08T18:50:26.025547+0000","last_became_peered":"2024-05-08T18:50:26.025547+0000","last_unstale":"2024-05-08T18:52:38.005947+0000","last_undegraded":"2024-05-08T18:52:38.005947+0000","last_fullsized":"2024-05-08T18:52:38.005947+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:47.056975+0000","last_change":"2024-05-08T18:53:47.057018+0000","last_active":"2024-05-08T18:53:47.056975+0000","last_peered":"2024-05-08T18:53:47.056975+0000","last_clean":"2024-05-08T18:53:47.056975+0000","last_became_active":"2024-05-08T18:50:30.035734+0000","last_became_peered":"2024-05-08T18:50:30.035734+0000","last_unstale":"2024-05-08T18:53:47.056975+0000","last_undegraded":"2024-05-08T18:53:47.056975+0000","last_fullsized":"2024-05-08T18:53:47.056975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:47.056868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:47.056868+0000","last_clean_scrub_stamp":"2024-05-08T18:53:47.056868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:03:47.172253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"27'48","reported_seq":107,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:54.094025+0000","last_change":"2024-05-08T18:53:54.094067+0000","last_active":"2024-05-08T18:53:54.094025+0000","last_peered":"2024-05-08T18:53:54.094025+0000","last_clean":"2024-05-08T18:53:54.094025+0000","last_became_active":"2024-05-08T18:50:32.034769+0000","last_became_peered":"2024-05-08T18:50:32.034769+0000","last_unstale":"2024-05-08T18:53:54.094025+0000","last_undegraded":"2024-05-08T18:53:54.094025+0000","last_fullsized":"2024-05-08T18:53:54.094025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-05-08T18:53:54.093941+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-05-08T18:53:54.093941+0000","last_clean_scrub_stamp":"2024-05-08T18:53:54.093941+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:02.850561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:55.963122+0000","last_change":"2024-05-08T18:53:55.963149+0000","last_active":"2024-05-08T18:53:55.963122+0000","last_peered":"2024-05-08T18:53:55.963122+0000","last_clean":"2024-05-08T18:53:55.963122+0000","last_became_active":"2024-05-08T18:50:34.050018+0000","last_became_peered":"2024-05-08T18:50:34.050018+0000","last_unstale":"2024-05-08T18:53:55.963122+0000","last_undegraded":"2024-05-08T18:53:55.963122+0000","last_fullsized":"2024-05-08T18:53:55.963122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:55.963020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:55.963020+0000","last_clean_scrub_stamp":"2024-05-08T18:53:55.963020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:07.576169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"27'8","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.980348+0000","last_change":"2024-05-08T18:50:36.049559+0000","last_active":"2024-05-08T18:53:34.980348+0000","last_peered":"2024-05-08T18:53:34.980348+0000","last_clean":"2024-05-08T18:53:34.980348+0000","last_became_active":"2024-05-08T18:50:36.049274+0000","last_became_peered":"2024-05-08T18:50:36.049274+0000","last_unstale":"2024-05-08T18:53:34.980348+0000","last_undegraded":"2024-05-08T18:53:34.980348+0000","last_fullsized":"2024-05-08T18:53:34.980348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'8","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.894132+0000","last_change":"2024-05-08T18:50:28.037991+0000","last_active":"2024-05-08T18:53:34.894132+0000","last_peered":"2024-05-08T18:53:34.894132+0000","last_clean":"2024-05-08T18:53:34.894132+0000","last_became_active":"2024-05-08T18:50:28.037545+0000","last_became_peered":"2024-05-08T18:50:28.037545+0000","last_unstale":"2024-05-08T18:53:34.894132+0000","last_undegraded":"2024-05-08T18:53:34.894132+0000","last_fullsized":"2024-05-08T18:53:34.894132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":134,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:23.003378+0000","last_change":"2024-05-08T18:50:19.740594+0000","last_active":"2024-05-08T18:52:23.003378+0000","last_peered":"2024-05-08T18:52:23.003378+0000","last_clean":"2024-05-08T18:52:23.003378+0000","last_became_active":"2024-05-08T18:50:19.739986+0000","last_became_peered":"2024-05-08T18:50:19.739986+0000","last_unstale":"2024-05-08T18:52:23.003378+0000","last_undegraded":"2024-05-08T18:52:23.003378+0000","last_fullsized":"2024-05-08T18:52:23.003378+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:28.004563+0000","last_change":"2024-05-08T18:50:19.740266+0000","last_active":"2024-05-08T18:52:28.004563+0000","last_peered":"2024-05-08T18:52:28.004563+0000","last_clean":"2024-05-08T18:52:28.004563+0000","last_became_active":"2024-05-08T18:50:19.739403+0000","last_became_peered":"2024-05-08T18:50:19.739403+0000","last_unstale":"2024-05-08T18:52:28.004563+0000","last_undegraded":"2024-05-08T18:52:28.004563+0000","last_fullsized":"2024-05-08T18:52:28.004563+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.005279+0000","last_change":"2024-05-08T18:50:26.026328+0000","last_active":"2024-05-08T18:52:33.005279+0000","last_peered":"2024-05-08T18:52:33.005279+0000","last_clean":"2024-05-08T18:52:33.005279+0000","last_became_active":"2024-05-08T18:50:26.024249+0000","last_became_peered":"2024-05-08T18:50:26.024249+0000","last_unstale":"2024-05-08T18:52:33.005279+0000","last_undegraded":"2024-05-08T18:52:33.005279+0000","last_fullsized":"2024-05-08T18:52:33.005279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:57.039174+0000","last_change":"2024-05-08T18:53:57.039225+0000","last_active":"2024-05-08T18:53:57.039174+0000","last_peered":"2024-05-08T18:53:57.039174+0000","last_clean":"2024-05-08T18:53:57.039174+0000","last_became_active":"2024-05-08T18:50:30.029744+0000","last_became_peered":"2024-05-08T18:50:30.029744+0000","last_unstale":"2024-05-08T18:53:57.039174+0000","last_undegraded":"2024-05-08T18:53:57.039174+0000","last_fullsized":"2024-05-08T18:53:57.039174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:57.039062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:57.039062+0000","last_clean_scrub_stamp":"2024-05-08T18:53:57.039062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:59.021034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"27'85","reported_seq":167,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.562726+0000","last_change":"2024-05-08T18:50:32.043836+0000","last_active":"2024-05-08T18:53:41.562726+0000","last_peered":"2024-05-08T18:53:41.562726+0000","last_clean":"2024-05-08T18:53:41.562726+0000","last_became_active":"2024-05-08T18:50:32.043533+0000","last_became_peered":"2024-05-08T18:50:32.043533+0000","last_unstale":"2024-05-08T18:53:41.562726+0000","last_undegraded":"2024-05-08T18:53:41.562726+0000","last_fullsized":"2024-05-08T18:53:41.562726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.995645+0000","last_change":"2024-05-08T18:53:58.995677+0000","last_active":"2024-05-08T18:53:58.995645+0000","last_peered":"2024-05-08T18:53:58.995645+0000","last_clean":"2024-05-08T18:53:58.995645+0000","last_became_active":"2024-05-08T18:50:34.048859+0000","last_became_peered":"2024-05-08T18:50:34.048859+0000","last_unstale":"2024-05-08T18:53:58.995645+0000","last_undegraded":"2024-05-08T18:53:58.995645+0000","last_fullsized":"2024-05-08T18:53:58.995645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:58.995550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:58.995550+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.995550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:54.841405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"27'81","reported_seq":163,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.900994+0000","last_change":"2024-05-08T18:50:36.045215+0000","last_active":"2024-05-08T18:53:34.900994+0000","last_peered":"2024-05-08T18:53:34.900994+0000","last_clean":"2024-05-08T18:53:34.900994+0000","last_became_active":"2024-05-08T18:50:36.044928+0000","last_became_peered":"2024-05-08T18:50:36.044928+0000","last_unstale":"2024-05-08T18:53:34.900994+0000","last_undegraded":"2024-05-08T18:53:34.900994+0000","last_fullsized":"2024-05-08T18:53:34.900994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"27'4","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.006202+0000","last_change":"2024-05-08T18:50:28.032137+0000","last_active":"2024-05-08T18:52:38.006202+0000","last_peered":"2024-05-08T18:52:38.006202+0000","last_clean":"2024-05-08T18:52:38.006202+0000","last_became_active":"2024-05-08T18:50:28.030761+0000","last_became_peered":"2024-05-08T18:50:28.030761+0000","last_unstale":"2024-05-08T18:52:38.006202+0000","last_undegraded":"2024-05-08T18:52:38.006202+0000","last_fullsized":"2024-05-08T18:52:38.006202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:23.003796+0000","last_change":"2024-05-08T18:50:19.739194+0000","last_active":"2024-05-08T18:52:23.003796+0000","last_peered":"2024-05-08T18:52:23.003796+0000","last_clean":"2024-05-08T18:52:23.003796+0000","last_became_active":"2024-05-08T18:50:19.738872+0000","last_became_peered":"2024-05-08T18:50:19.738872+0000","last_unstale":"2024-05-08T18:52:23.003796+0000","last_undegraded":"2024-05-08T18:52:23.003796+0000","last_fullsized":"2024-05-08T18:52:23.003796+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.000385+0000","last_change":"2024-05-08T18:50:26.024886+0000","last_active":"2024-05-08T18:52:33.000385+0000","last_peered":"2024-05-08T18:52:33.000385+0000","last_clean":"2024-05-08T18:52:33.000385+0000","last_became_active":"2024-05-08T18:50:26.024549+0000","last_became_peered":"2024-05-08T18:50:26.024549+0000","last_unstale":"2024-05-08T18:52:33.000385+0000","last_undegraded":"2024-05-08T18:52:33.000385+0000","last_fullsized":"2024-05-08T18:52:33.000385+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006928+0000","last_change":"2024-05-08T18:51:15.084930+0000","last_active":"2024-05-08T18:52:43.006928+0000","last_peered":"2024-05-08T18:52:43.006928+0000","last_clean":"2024-05-08T18:52:43.006928+0000","last_became_active":"2024-05-08T18:51:15.084599+0000","last_became_peered":"2024-05-08T18:51:15.084599+0000","last_unstale":"2024-05-08T18:52:43.006928+0000","last_undegraded":"2024-05-08T18:52:43.006928+0000","last_fullsized":"2024-05-08T18:52:43.006928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"27'290","reported_seq":515,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:47.103005+0000","last_change":"2024-05-08T18:53:47.103048+0000","last_active":"2024-05-08T18:53:47.103005+0000","last_peered":"2024-05-08T18:53:47.103005+0000","last_clean":"2024-05-08T18:53:47.103005+0000","last_became_active":"2024-05-08T18:50:32.044539+0000","last_became_peered":"2024-05-08T18:50:32.044539+0000","last_unstale":"2024-05-08T18:53:47.103005+0000","last_undegraded":"2024-05-08T18:53:47.103005+0000","last_fullsized":"2024-05-08T18:53:47.103005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'290","last_scrub_stamp":"2024-05-08T18:53:47.102914+0000","last_deep_scrub":"27'290","last_deep_scrub_stamp":"2024-05-08T18:53:47.102914+0000","last_clean_scrub_stamp":"2024-05-08T18:53:47.102914+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:52.308821+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006836+0000","last_change":"2024-05-08T18:50:34.044400+0000","last_active":"2024-05-08T18:52:43.006836+0000","last_peered":"2024-05-08T18:52:43.006836+0000","last_clean":"2024-05-08T18:52:43.006836+0000","last_became_active":"2024-05-08T18:50:34.043966+0000","last_became_peered":"2024-05-08T18:50:34.043966+0000","last_unstale":"2024-05-08T18:52:43.006836+0000","last_undegraded":"2024-05-08T18:52:43.006836+0000","last_fullsized":"2024-05-08T18:52:43.006836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007258+0000","last_change":"2024-05-08T18:50:36.050905+0000","last_active":"2024-05-08T18:52:48.007258+0000","last_peered":"2024-05-08T18:52:48.007258+0000","last_clean":"2024-05-08T18:52:48.007258+0000","last_became_active":"2024-05-08T18:50:36.050573+0000","last_became_peered":"2024-05-08T18:50:36.050573+0000","last_unstale":"2024-05-08T18:52:48.007258+0000","last_undegraded":"2024-05-08T18:52:48.007258+0000","last_fullsized":"2024-05-08T18:52:48.007258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'4","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.001152+0000","last_change":"2024-05-08T18:50:28.027882+0000","last_active":"2024-05-08T18:52:38.001152+0000","last_peered":"2024-05-08T18:52:38.001152+0000","last_clean":"2024-05-08T18:52:38.001152+0000","last_became_active":"2024-05-08T18:50:28.027492+0000","last_became_peered":"2024-05-08T18:50:28.027492+0000","last_unstale":"2024-05-08T18:52:38.001152+0000","last_undegraded":"2024-05-08T18:52:38.001152+0000","last_fullsized":"2024-05-08T18:52:38.001152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:23.003120+0000","last_change":"2024-05-08T18:50:19.739149+0000","last_active":"2024-05-08T18:52:23.003120+0000","last_peered":"2024-05-08T18:52:23.003120+0000","last_clean":"2024-05-08T18:52:23.003120+0000","last_became_active":"2024-05-08T18:50:19.738788+0000","last_became_peered":"2024-05-08T18:50:19.738788+0000","last_unstale":"2024-05-08T18:52:23.003120+0000","last_undegraded":"2024-05-08T18:52:23.003120+0000","last_fullsized":"2024-05-08T18:52:23.003120+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:27.999646+0000","last_change":"2024-05-08T18:50:26.029767+0000","last_active":"2024-05-08T18:52:27.999646+0000","last_peered":"2024-05-08T18:52:27.999646+0000","last_clean":"2024-05-08T18:52:27.999646+0000","last_became_active":"2024-05-08T18:50:26.029197+0000","last_became_peered":"2024-05-08T18:50:26.029197+0000","last_unstale":"2024-05-08T18:52:27.999646+0000","last_undegraded":"2024-05-08T18:52:27.999646+0000","last_fullsized":"2024-05-08T18:52:27.999646+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"18'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006126+0000","last_change":"2024-05-08T18:50:30.028419+0000","last_active":"2024-05-08T18:52:43.006126+0000","last_peered":"2024-05-08T18:52:43.006126+0000","last_clean":"2024-05-08T18:52:43.006126+0000","last_became_active":"2024-05-08T18:50:30.028028+0000","last_became_peered":"2024-05-08T18:50:30.028028+0000","last_unstale":"2024-05-08T18:52:43.006126+0000","last_undegraded":"2024-05-08T18:52:43.006126+0000","last_fullsized":"2024-05-08T18:52:43.006126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"27'23","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:56.984057+0000","last_change":"2024-05-08T18:53:56.984125+0000","last_active":"2024-05-08T18:53:56.984057+0000","last_peered":"2024-05-08T18:53:56.984057+0000","last_clean":"2024-05-08T18:53:56.984057+0000","last_became_active":"2024-05-08T18:50:32.036051+0000","last_became_peered":"2024-05-08T18:50:32.036051+0000","last_unstale":"2024-05-08T18:53:56.984057+0000","last_undegraded":"2024-05-08T18:53:56.984057+0000","last_fullsized":"2024-05-08T18:53:56.984057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-05-08T18:53:56.983946+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-05-08T18:53:56.983946+0000","last_clean_scrub_stamp":"2024-05-08T18:53:56.983946+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:47.425987+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.955595+0000","last_change":"2024-05-08T18:53:45.955616+0000","last_active":"2024-05-08T18:53:45.955595+0000","last_peered":"2024-05-08T18:53:45.955595+0000","last_clean":"2024-05-08T18:53:45.955595+0000","last_became_active":"2024-05-08T18:50:34.045541+0000","last_became_peered":"2024-05-08T18:50:34.045541+0000","last_unstale":"2024-05-08T18:53:45.955595+0000","last_undegraded":"2024-05-08T18:53:45.955595+0000","last_fullsized":"2024-05-08T18:53:45.955595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:45.955524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:45.955524+0000","last_clean_scrub_stamp":"2024-05-08T18:53:45.955524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:07.055678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.008500+0000","last_change":"2024-05-08T18:50:36.058086+0000","last_active":"2024-05-08T18:52:53.008500+0000","last_peered":"2024-05-08T18:52:53.008500+0000","last_clean":"2024-05-08T18:52:53.008500+0000","last_became_active":"2024-05-08T18:50:36.057093+0000","last_became_peered":"2024-05-08T18:50:36.057093+0000","last_unstale":"2024-05-08T18:52:53.008500+0000","last_undegraded":"2024-05-08T18:52:53.008500+0000","last_fullsized":"2024-05-08T18:52:53.008500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'22","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.894606+0000","last_change":"2024-05-08T18:50:28.026195+0000","last_active":"2024-05-08T18:53:34.894606+0000","last_peered":"2024-05-08T18:53:34.894606+0000","last_clean":"2024-05-08T18:53:34.894606+0000","last_became_active":"2024-05-08T18:50:28.025645+0000","last_became_peered":"2024-05-08T18:50:28.025645+0000","last_unstale":"2024-05-08T18:53:34.894606+0000","last_undegraded":"2024-05-08T18:53:34.894606+0000","last_fullsized":"2024-05-08T18:53:34.894606+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:23.003873+0000","last_change":"2024-05-08T18:50:19.739898+0000","last_active":"2024-05-08T18:52:23.003873+0000","last_peered":"2024-05-08T18:52:23.003873+0000","last_clean":"2024-05-08T18:52:23.003873+0000","last_became_active":"2024-05-08T18:50:19.739620+0000","last_became_peered":"2024-05-08T18:50:19.739620+0000","last_unstale":"2024-05-08T18:52:23.003873+0000","last_undegraded":"2024-05-08T18:52:23.003873+0000","last_fullsized":"2024-05-08T18:52:23.003873+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.004566+0000","last_change":"2024-05-08T18:50:26.023831+0000","last_active":"2024-05-08T18:52:33.004566+0000","last_peered":"2024-05-08T18:52:33.004566+0000","last_clean":"2024-05-08T18:52:33.004566+0000","last_became_active":"2024-05-08T18:50:26.023522+0000","last_became_peered":"2024-05-08T18:50:26.023522+0000","last_unstale":"2024-05-08T18:52:33.004566+0000","last_undegraded":"2024-05-08T18:52:33.004566+0000","last_fullsized":"2024-05-08T18:52:33.004566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:02.050033+0000","last_change":"2024-05-08T18:54:02.050063+0000","last_active":"2024-05-08T18:54:02.050033+0000","last_peered":"2024-05-08T18:54:02.050033+0000","last_clean":"2024-05-08T18:54:02.050033+0000","last_became_active":"2024-05-08T18:50:30.034806+0000","last_became_peered":"2024-05-08T18:50:30.034806+0000","last_unstale":"2024-05-08T18:54:02.050033+0000","last_undegraded":"2024-05-08T18:54:02.050033+0000","last_fullsized":"2024-05-08T18:54:02.050033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:02.049920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:02.049920+0000","last_clean_scrub_stamp":"2024-05-08T18:54:02.049920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:23.760745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"27'13","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.271460+0000","last_change":"2024-05-08T18:50:32.042494+0000","last_active":"2024-05-08T18:53:34.271460+0000","last_peered":"2024-05-08T18:53:34.271460+0000","last_clean":"2024-05-08T18:53:34.271460+0000","last_became_active":"2024-05-08T18:50:32.042183+0000","last_became_peered":"2024-05-08T18:50:32.042183+0000","last_unstale":"2024-05-08T18:53:34.271460+0000","last_undegraded":"2024-05-08T18:53:34.271460+0000","last_fullsized":"2024-05-08T18:53:34.271460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007830+0000","last_change":"2024-05-08T18:50:34.045641+0000","last_active":"2024-05-08T18:52:48.007830+0000","last_peered":"2024-05-08T18:52:48.007830+0000","last_clean":"2024-05-08T18:52:48.007830+0000","last_became_active":"2024-05-08T18:50:34.044358+0000","last_became_peered":"2024-05-08T18:50:34.044358+0000","last_unstale":"2024-05-08T18:52:48.007830+0000","last_undegraded":"2024-05-08T18:52:48.007830+0000","last_fullsized":"2024-05-08T18:52:48.007830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007178+0000","last_change":"2024-05-08T18:50:36.058516+0000","last_active":"2024-05-08T18:52:48.007178+0000","last_peered":"2024-05-08T18:52:48.007178+0000","last_clean":"2024-05-08T18:52:48.007178+0000","last_became_active":"2024-05-08T18:50:36.058267+0000","last_became_peered":"2024-05-08T18:50:36.058267+0000","last_unstale":"2024-05-08T18:52:48.007178+0000","last_undegraded":"2024-05-08T18:52:48.007178+0000","last_fullsized":"2024-05-08T18:52:48.007178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'12","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.614044+0000","last_change":"2024-05-08T18:50:28.039245+0000","last_active":"2024-05-08T18:53:34.614044+0000","last_peered":"2024-05-08T18:53:34.614044+0000","last_clean":"2024-05-08T18:53:34.614044+0000","last_became_active":"2024-05-08T18:50:28.038935+0000","last_became_peered":"2024-05-08T18:50:28.038935+0000","last_unstale":"2024-05-08T18:53:34.614044+0000","last_undegraded":"2024-05-08T18:53:34.614044+0000","last_fullsized":"2024-05-08T18:53:34.614044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.004624+0000","last_change":"2024-05-08T18:50:26.019026+0000","last_active":"2024-05-08T18:52:33.004624+0000","last_peered":"2024-05-08T18:52:33.004624+0000","last_clean":"2024-05-08T18:52:33.004624+0000","last_became_active":"2024-05-08T18:50:26.018739+0000","last_became_peered":"2024-05-08T18:50:26.018739+0000","last_unstale":"2024-05-08T18:52:33.004624+0000","last_undegraded":"2024-05-08T18:52:33.004624+0000","last_fullsized":"2024-05-08T18:52:33.004624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:27.999742+0000","last_change":"2024-05-08T18:50:19.741144+0000","last_active":"2024-05-08T18:52:27.999742+0000","last_peered":"2024-05-08T18:52:27.999742+0000","last_clean":"2024-05-08T18:52:27.999742+0000","last_became_active":"2024-05-08T18:50:19.740835+0000","last_became_peered":"2024-05-08T18:50:19.740835+0000","last_unstale":"2024-05-08T18:52:27.999742+0000","last_undegraded":"2024-05-08T18:52:27.999742+0000","last_fullsized":"2024-05-08T18:52:27.999742+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"27'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.410946+0000","last_change":"2024-05-08T18:51:15.083500+0000","last_active":"2024-05-08T18:53:41.410946+0000","last_peered":"2024-05-08T18:53:41.410946+0000","last_clean":"2024-05-08T18:53:41.410946+0000","last_became_active":"2024-05-08T18:51:15.083141+0000","last_became_peered":"2024-05-08T18:51:15.083141+0000","last_unstale":"2024-05-08T18:53:41.410946+0000","last_undegraded":"2024-05-08T18:53:41.410946+0000","last_fullsized":"2024-05-08T18:53:41.410946+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"27'73","reported_seq":149,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.986154+0000","last_change":"2024-05-08T18:53:53.986211+0000","last_active":"2024-05-08T18:53:53.986154+0000","last_peered":"2024-05-08T18:53:53.986154+0000","last_clean":"2024-05-08T18:53:53.986154+0000","last_became_active":"2024-05-08T18:50:32.042046+0000","last_became_peered":"2024-05-08T18:50:32.042046+0000","last_unstale":"2024-05-08T18:53:53.986154+0000","last_undegraded":"2024-05-08T18:53:53.986154+0000","last_fullsized":"2024-05-08T18:53:53.986154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'73","last_scrub_stamp":"2024-05-08T18:53:53.986057+0000","last_deep_scrub":"27'73","last_deep_scrub_stamp":"2024-05-08T18:53:53.986057+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.986057+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:48:15.967078+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:48.999108+0000","last_change":"2024-05-08T18:53:48.999132+0000","last_active":"2024-05-08T18:53:48.999108+0000","last_peered":"2024-05-08T18:53:48.999108+0000","last_clean":"2024-05-08T18:53:48.999108+0000","last_became_active":"2024-05-08T18:50:34.044520+0000","last_became_peered":"2024-05-08T18:50:34.044520+0000","last_unstale":"2024-05-08T18:53:48.999108+0000","last_undegraded":"2024-05-08T18:53:48.999108+0000","last_fullsized":"2024-05-08T18:53:48.999108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:48.999007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:48.999007+0000","last_clean_scrub_stamp":"2024-05-08T18:53:48.999007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:21.742255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"27'9","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.003277+0000","last_change":"2024-05-08T18:50:36.047417+0000","last_active":"2024-05-08T18:52:53.003277+0000","last_peered":"2024-05-08T18:52:53.003277+0000","last_clean":"2024-05-08T18:52:53.003277+0000","last_became_active":"2024-05-08T18:50:36.046757+0000","last_became_peered":"2024-05-08T18:50:36.046757+0000","last_unstale":"2024-05-08T18:52:53.003277+0000","last_undegraded":"2024-05-08T18:52:53.003277+0000","last_fullsized":"2024-05-08T18:52:53.003277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.829837+0000","last_change":"2024-05-08T18:51:15.095543+0000","last_active":"2024-05-08T18:53:34.829837+0000","last_peered":"2024-05-08T18:53:34.829837+0000","last_clean":"2024-05-08T18:53:34.829837+0000","last_became_active":"2024-05-08T18:51:15.084151+0000","last_became_peered":"2024-05-08T18:51:15.084151+0000","last_unstale":"2024-05-08T18:53:34.829837+0000","last_undegraded":"2024-05-08T18:53:34.829837+0000","last_fullsized":"2024-05-08T18:53:34.829837+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.000437+0000","last_change":"2024-05-08T18:50:26.025460+0000","last_active":"2024-05-08T18:52:33.000437+0000","last_peered":"2024-05-08T18:52:33.000437+0000","last_clean":"2024-05-08T18:52:33.000437+0000","last_became_active":"2024-05-08T18:50:26.024894+0000","last_became_peered":"2024-05-08T18:50:26.024894+0000","last_unstale":"2024-05-08T18:52:33.000437+0000","last_undegraded":"2024-05-08T18:52:33.000437+0000","last_fullsized":"2024-05-08T18:52:33.000437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:28.004618+0000","last_change":"2024-05-08T18:50:19.739473+0000","last_active":"2024-05-08T18:52:28.004618+0000","last_peered":"2024-05-08T18:52:28.004618+0000","last_clean":"2024-05-08T18:52:28.004618+0000","last_became_active":"2024-05-08T18:50:19.739124+0000","last_became_peered":"2024-05-08T18:50:19.739124+0000","last_unstale":"2024-05-08T18:52:28.004618+0000","last_undegraded":"2024-05-08T18:52:28.004618+0000","last_fullsized":"2024-05-08T18:52:28.004618+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:54.073521+0000","last_change":"2024-05-08T18:53:54.073547+0000","last_active":"2024-05-08T18:53:54.073521+0000","last_peered":"2024-05-08T18:53:54.073521+0000","last_clean":"2024-05-08T18:53:54.073521+0000","last_became_active":"2024-05-08T18:50:30.032546+0000","last_became_peered":"2024-05-08T18:50:30.032546+0000","last_unstale":"2024-05-08T18:53:54.073521+0000","last_undegraded":"2024-05-08T18:53:54.073521+0000","last_fullsized":"2024-05-08T18:53:54.073521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:54.073430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:54.073430+0000","last_clean_scrub_stamp":"2024-05-08T18:53:54.073430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:08.017553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"27'21","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:49.087843+0000","last_change":"2024-05-08T18:53:49.087885+0000","last_active":"2024-05-08T18:53:49.087843+0000","last_peered":"2024-05-08T18:53:49.087843+0000","last_clean":"2024-05-08T18:53:49.087843+0000","last_became_active":"2024-05-08T18:50:32.040767+0000","last_became_peered":"2024-05-08T18:50:32.040767+0000","last_unstale":"2024-05-08T18:53:49.087843+0000","last_undegraded":"2024-05-08T18:53:49.087843+0000","last_fullsized":"2024-05-08T18:53:49.087843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-05-08T18:53:49.087754+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-05-08T18:53:49.087754+0000","last_clean_scrub_stamp":"2024-05-08T18:53:49.087754+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:00.700903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"27'285","reported_seq":386,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:48.068476+0000","last_change":"2024-05-08T18:53:48.068502+0000","last_active":"2024-05-08T18:53:48.068476+0000","last_peered":"2024-05-08T18:53:48.068476+0000","last_clean":"2024-05-08T18:53:48.068476+0000","last_became_active":"2024-05-08T18:50:34.043167+0000","last_became_peered":"2024-05-08T18:50:34.043167+0000","last_unstale":"2024-05-08T18:53:48.068476+0000","last_undegraded":"2024-05-08T18:53:48.068476+0000","last_fullsized":"2024-05-08T18:53:48.068476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:48.068390+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:48.068390+0000","last_clean_scrub_stamp":"2024-05-08T18:53:48.068390+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:09.168544+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.891908+0000","last_change":"2024-05-08T18:50:36.061014+0000","last_active":"2024-05-08T18:53:34.891908+0000","last_peered":"2024-05-08T18:53:34.891908+0000","last_clean":"2024-05-08T18:53:34.891908+0000","last_became_active":"2024-05-08T18:50:36.060727+0000","last_became_peered":"2024-05-08T18:50:36.060727+0000","last_unstale":"2024-05-08T18:53:34.891908+0000","last_undegraded":"2024-05-08T18:53:34.891908+0000","last_fullsized":"2024-05-08T18:53:34.891908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"27'22","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.696570+0000","last_change":"2024-05-08T18:51:15.092701+0000","last_active":"2024-05-08T18:53:34.696570+0000","last_peered":"2024-05-08T18:53:34.696570+0000","last_clean":"2024-05-08T18:53:34.696570+0000","last_became_active":"2024-05-08T18:51:15.083568+0000","last_became_peered":"2024-05-08T18:51:15.083568+0000","last_unstale":"2024-05-08T18:53:34.696570+0000","last_undegraded":"2024-05-08T18:53:34.696570+0000","last_fullsized":"2024-05-08T18:53:34.696570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":68,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.885575+0000","last_change":"2024-05-08T18:50:26.016666+0000","last_active":"2024-05-08T18:53:34.885575+0000","last_peered":"2024-05-08T18:53:34.885575+0000","last_clean":"2024-05-08T18:53:34.885575+0000","last_became_active":"2024-05-08T18:50:26.016210+0000","last_became_peered":"2024-05-08T18:50:26.016210+0000","last_unstale":"2024-05-08T18:53:34.885575+0000","last_undegraded":"2024-05-08T18:53:34.885575+0000","last_fullsized":"2024-05-08T18:53:34.885575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:27.999781+0000","last_change":"2024-05-08T18:50:19.740832+0000","last_active":"2024-05-08T18:52:27.999781+0000","last_peered":"2024-05-08T18:52:27.999781+0000","last_clean":"2024-05-08T18:52:27.999781+0000","last_became_active":"2024-05-08T18:50:19.740355+0000","last_became_peered":"2024-05-08T18:50:19.740355+0000","last_unstale":"2024-05-08T18:52:27.999781+0000","last_undegraded":"2024-05-08T18:52:27.999781+0000","last_fullsized":"2024-05-08T18:52:27.999781+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.055027+0000","last_change":"2024-05-08T18:53:53.055060+0000","last_active":"2024-05-08T18:53:53.055027+0000","last_peered":"2024-05-08T18:53:53.055027+0000","last_clean":"2024-05-08T18:53:53.055027+0000","last_became_active":"2024-05-08T18:50:30.031351+0000","last_became_peered":"2024-05-08T18:50:30.031351+0000","last_unstale":"2024-05-08T18:53:53.055027+0000","last_undegraded":"2024-05-08T18:53:53.055027+0000","last_fullsized":"2024-05-08T18:53:53.055027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:53.054930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:53.054930+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.054930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:23.805172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"25'10","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.006115+0000","last_change":"2024-05-08T18:50:32.042333+0000","last_active":"2024-05-08T18:52:38.006115+0000","last_peered":"2024-05-08T18:52:38.006115+0000","last_clean":"2024-05-08T18:52:38.006115+0000","last_became_active":"2024-05-08T18:50:32.041231+0000","last_became_peered":"2024-05-08T18:50:32.041231+0000","last_unstale":"2024-05-08T18:52:38.006115+0000","last_undegraded":"2024-05-08T18:52:38.006115+0000","last_fullsized":"2024-05-08T18:52:38.006115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"27'285","reported_seq":401,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:50.993021+0000","last_change":"2024-05-08T18:53:50.993052+0000","last_active":"2024-05-08T18:53:50.993021+0000","last_peered":"2024-05-08T18:53:50.993021+0000","last_clean":"2024-05-08T18:53:50.993021+0000","last_became_active":"2024-05-08T18:50:34.047608+0000","last_became_peered":"2024-05-08T18:50:34.047608+0000","last_unstale":"2024-05-08T18:53:50.993021+0000","last_undegraded":"2024-05-08T18:53:50.993021+0000","last_fullsized":"2024-05-08T18:53:50.993021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:50.992925+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:50.992925+0000","last_clean_scrub_stamp":"2024-05-08T18:53:50.992925+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:17.318647+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"25'5","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.008019+0000","last_change":"2024-05-08T18:50:36.055086+0000","last_active":"2024-05-08T18:52:53.008019+0000","last_peered":"2024-05-08T18:52:53.008019+0000","last_clean":"2024-05-08T18:52:53.008019+0000","last_became_active":"2024-05-08T18:50:36.054747+0000","last_became_peered":"2024-05-08T18:50:36.054747+0000","last_unstale":"2024-05-08T18:52:53.008019+0000","last_undegraded":"2024-05-08T18:52:53.008019+0000","last_fullsized":"2024-05-08T18:52:53.008019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.894488+0000","last_change":"2024-05-08T18:50:28.033530+0000","last_active":"2024-05-08T18:53:34.894488+0000","last_peered":"2024-05-08T18:53:34.894488+0000","last_clean":"2024-05-08T18:53:34.894488+0000","last_became_active":"2024-05-08T18:50:28.033163+0000","last_became_peered":"2024-05-08T18:50:28.033163+0000","last_unstale":"2024-05-08T18:53:34.894488+0000","last_undegraded":"2024-05-08T18:53:34.894488+0000","last_fullsized":"2024-05-08T18:53:34.894488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.005694+0000","last_change":"2024-05-08T18:50:26.027003+0000","last_active":"2024-05-08T18:52:38.005694+0000","last_peered":"2024-05-08T18:52:38.005694+0000","last_clean":"2024-05-08T18:52:38.005694+0000","last_became_active":"2024-05-08T18:50:26.026719+0000","last_became_peered":"2024-05-08T18:50:26.026719+0000","last_unstale":"2024-05-08T18:52:38.005694+0000","last_undegraded":"2024-05-08T18:52:38.005694+0000","last_fullsized":"2024-05-08T18:52:38.005694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:28.004669+0000","last_change":"2024-05-08T18:50:19.739345+0000","last_active":"2024-05-08T18:52:28.004669+0000","last_peered":"2024-05-08T18:52:28.004669+0000","last_clean":"2024-05-08T18:52:28.004669+0000","last_became_active":"2024-05-08T18:50:19.738971+0000","last_became_peered":"2024-05-08T18:50:19.738971+0000","last_unstale":"2024-05-08T18:52:28.004669+0000","last_undegraded":"2024-05-08T18:52:28.004669+0000","last_fullsized":"2024-05-08T18:52:28.004669+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:55.068985+0000","last_change":"2024-05-08T18:53:55.069024+0000","last_active":"2024-05-08T18:53:55.068985+0000","last_peered":"2024-05-08T18:53:55.068985+0000","last_clean":"2024-05-08T18:53:55.068985+0000","last_became_active":"2024-05-08T18:50:30.032197+0000","last_became_peered":"2024-05-08T18:50:30.032197+0000","last_unstale":"2024-05-08T18:53:55.068985+0000","last_undegraded":"2024-05-08T18:53:55.068985+0000","last_fullsized":"2024-05-08T18:53:55.068985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:55.068843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:55.068843+0000","last_clean_scrub_stamp":"2024-05-08T18:53:55.068843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:15.069363+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"27'96","reported_seq":189,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.978964+0000","last_change":"2024-05-08T18:53:53.979024+0000","last_active":"2024-05-08T18:53:53.978964+0000","last_peered":"2024-05-08T18:53:53.978964+0000","last_clean":"2024-05-08T18:53:53.978964+0000","last_became_active":"2024-05-08T18:50:32.043109+0000","last_became_peered":"2024-05-08T18:50:32.043109+0000","last_unstale":"2024-05-08T18:53:53.978964+0000","last_undegraded":"2024-05-08T18:53:53.978964+0000","last_fullsized":"2024-05-08T18:53:53.978964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'96","last_scrub_stamp":"2024-05-08T18:53:53.978862+0000","last_deep_scrub":"27'96","last_deep_scrub_stamp":"2024-05-08T18:53:53.978862+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.978862+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:02.797212+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:52.944796+0000","last_change":"2024-05-08T18:53:52.944818+0000","last_active":"2024-05-08T18:53:52.944796+0000","last_peered":"2024-05-08T18:53:52.944796+0000","last_clean":"2024-05-08T18:53:52.944796+0000","last_became_active":"2024-05-08T18:50:34.043495+0000","last_became_peered":"2024-05-08T18:50:34.043495+0000","last_unstale":"2024-05-08T18:53:52.944796+0000","last_undegraded":"2024-05-08T18:53:52.944796+0000","last_fullsized":"2024-05-08T18:53:52.944796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:52.944707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:52.944707+0000","last_clean_scrub_stamp":"2024-05-08T18:53:52.944707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:51.657538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:59.972475+0000","last_change":"2024-05-08T18:53:59.972499+0000","last_active":"2024-05-08T18:53:59.972475+0000","last_peered":"2024-05-08T18:53:59.972475+0000","last_clean":"2024-05-08T18:53:59.972475+0000","last_became_active":"2024-05-08T18:50:36.044491+0000","last_became_peered":"2024-05-08T18:50:36.044491+0000","last_unstale":"2024-05-08T18:53:59.972475+0000","last_undegraded":"2024-05-08T18:53:59.972475+0000","last_fullsized":"2024-05-08T18:53:59.972475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:53:59.972386+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:53:59.972386+0000","last_clean_scrub_stamp":"2024-05-08T18:53:59.972386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:29.340986+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006156+0000","last_change":"2024-05-08T18:50:36.050995+0000","last_active":"2024-05-08T18:52:43.006156+0000","last_peered":"2024-05-08T18:52:43.006156+0000","last_clean":"2024-05-08T18:52:43.006156+0000","last_became_active":"2024-05-08T18:50:36.050722+0000","last_became_peered":"2024-05-08T18:50:36.050722+0000","last_unstale":"2024-05-08T18:52:43.006156+0000","last_undegraded":"2024-05-08T18:52:43.006156+0000","last_fullsized":"2024-05-08T18:52:43.006156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"27'9","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.939056+0000","last_change":"2024-05-08T18:50:28.033284+0000","last_active":"2024-05-08T18:53:34.939056+0000","last_peered":"2024-05-08T18:53:34.939056+0000","last_clean":"2024-05-08T18:53:34.939056+0000","last_became_active":"2024-05-08T18:50:28.033010+0000","last_became_peered":"2024-05-08T18:50:28.033010+0000","last_unstale":"2024-05-08T18:53:34.939056+0000","last_undegraded":"2024-05-08T18:53:34.939056+0000","last_fullsized":"2024-05-08T18:53:34.939056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007703+0000","last_change":"2024-05-08T18:50:26.027008+0000","last_active":"2024-05-08T18:52:48.007703+0000","last_peered":"2024-05-08T18:52:48.007703+0000","last_clean":"2024-05-08T18:52:48.007703+0000","last_became_active":"2024-05-08T18:50:26.025828+0000","last_became_peered":"2024-05-08T18:50:26.025828+0000","last_unstale":"2024-05-08T18:52:48.007703+0000","last_undegraded":"2024-05-08T18:52:48.007703+0000","last_fullsized":"2024-05-08T18:52:48.007703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.007987+0000","last_change":"2024-05-08T18:51:15.082912+0000","last_active":"2024-05-08T18:52:53.007987+0000","last_peered":"2024-05-08T18:52:53.007987+0000","last_clean":"2024-05-08T18:52:53.007987+0000","last_became_active":"2024-05-08T18:51:15.082590+0000","last_became_peered":"2024-05-08T18:51:15.082590+0000","last_unstale":"2024-05-08T18:52:53.007987+0000","last_undegraded":"2024-05-08T18:52:53.007987+0000","last_fullsized":"2024-05-08T18:52:53.007987+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"27'40","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:50.089105+0000","last_change":"2024-05-08T18:53:50.089149+0000","last_active":"2024-05-08T18:53:50.089105+0000","last_peered":"2024-05-08T18:53:50.089105+0000","last_clean":"2024-05-08T18:53:50.089105+0000","last_became_active":"2024-05-08T18:50:32.038591+0000","last_became_peered":"2024-05-08T18:50:32.038591+0000","last_unstale":"2024-05-08T18:53:50.089105+0000","last_undegraded":"2024-05-08T18:53:50.089105+0000","last_fullsized":"2024-05-08T18:53:50.089105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-05-08T18:53:50.089008+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-05-08T18:53:50.089008+0000","last_clean_scrub_stamp":"2024-05-08T18:53:50.089008+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:59.963311+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.009233+0000","last_change":"2024-05-08T18:50:34.051041+0000","last_active":"2024-05-08T18:52:58.009233+0000","last_peered":"2024-05-08T18:52:58.009233+0000","last_clean":"2024-05-08T18:52:58.009233+0000","last_became_active":"2024-05-08T18:50:34.050749+0000","last_became_peered":"2024-05-08T18:50:34.050749+0000","last_unstale":"2024-05-08T18:52:58.009233+0000","last_undegraded":"2024-05-08T18:52:58.009233+0000","last_fullsized":"2024-05-08T18:52:58.009233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"27'15","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.700426+0000","last_change":"2024-05-08T18:50:36.054332+0000","last_active":"2024-05-08T18:53:34.700426+0000","last_peered":"2024-05-08T18:53:34.700426+0000","last_clean":"2024-05-08T18:53:34.700426+0000","last_became_active":"2024-05-08T18:50:36.054102+0000","last_became_peered":"2024-05-08T18:50:36.054102+0000","last_unstale":"2024-05-08T18:53:34.700426+0000","last_undegraded":"2024-05-08T18:53:34.700426+0000","last_fullsized":"2024-05-08T18:53:34.700426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"27'6","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.696562+0000","last_change":"2024-05-08T18:50:28.038986+0000","last_active":"2024-05-08T18:53:34.696562+0000","last_peered":"2024-05-08T18:53:34.696562+0000","last_clean":"2024-05-08T18:53:34.696562+0000","last_became_active":"2024-05-08T18:50:28.038587+0000","last_became_peered":"2024-05-08T18:50:28.038587+0000","last_unstale":"2024-05-08T18:53:34.696562+0000","last_undegraded":"2024-05-08T18:53:34.696562+0000","last_fullsized":"2024-05-08T18:53:34.696562+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.007900+0000","last_change":"2024-05-08T18:50:26.031798+0000","last_active":"2024-05-08T18:52:53.007900+0000","last_peered":"2024-05-08T18:52:53.007900+0000","last_clean":"2024-05-08T18:52:53.007900+0000","last_became_active":"2024-05-08T18:50:26.031509+0000","last_became_peered":"2024-05-08T18:50:26.031509+0000","last_unstale":"2024-05-08T18:52:53.007900+0000","last_undegraded":"2024-05-08T18:52:53.007900+0000","last_fullsized":"2024-05-08T18:52:53.007900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:51.065753+0000","last_change":"2024-05-08T18:53:51.065788+0000","last_active":"2024-05-08T18:53:51.065753+0000","last_peered":"2024-05-08T18:53:51.065753+0000","last_clean":"2024-05-08T18:53:51.065753+0000","last_became_active":"2024-05-08T18:50:30.034178+0000","last_became_peered":"2024-05-08T18:50:30.034178+0000","last_unstale":"2024-05-08T18:53:51.065753+0000","last_undegraded":"2024-05-08T18:53:51.065753+0000","last_fullsized":"2024-05-08T18:53:51.065753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:51.065645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:51.065645+0000","last_clean_scrub_stamp":"2024-05-08T18:53:51.065645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:42.592612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'9","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:00.016731+0000","last_change":"2024-05-08T18:54:00.016762+0000","last_active":"2024-05-08T18:54:00.016731+0000","last_peered":"2024-05-08T18:54:00.016731+0000","last_clean":"2024-05-08T18:54:00.016731+0000","last_became_active":"2024-05-08T18:50:32.036371+0000","last_became_peered":"2024-05-08T18:50:32.036371+0000","last_unstale":"2024-05-08T18:54:00.016731+0000","last_undegraded":"2024-05-08T18:54:00.016731+0000","last_fullsized":"2024-05-08T18:54:00.016731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-08T18:54:00.016634+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-08T18:54:00.016634+0000","last_clean_scrub_stamp":"2024-05-08T18:54:00.016634+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:07.475619+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:52.036037+0000","last_change":"2024-05-08T18:53:52.036087+0000","last_active":"2024-05-08T18:53:52.036037+0000","last_peered":"2024-05-08T18:53:52.036037+0000","last_clean":"2024-05-08T18:53:52.036037+0000","last_became_active":"2024-05-08T18:50:34.048434+0000","last_became_peered":"2024-05-08T18:50:34.048434+0000","last_unstale":"2024-05-08T18:53:52.036037+0000","last_undegraded":"2024-05-08T18:53:52.036037+0000","last_fullsized":"2024-05-08T18:53:52.036037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:52.035926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:52.035926+0000","last_clean_scrub_stamp":"2024-05-08T18:53:52.035926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:09.492022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"25'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:08.005367+0000","last_change":"2024-05-08T18:50:36.047682+0000","last_active":"2024-05-08T18:53:08.005367+0000","last_peered":"2024-05-08T18:53:08.005367+0000","last_clean":"2024-05-08T18:53:08.005367+0000","last_became_active":"2024-05-08T18:50:36.047379+0000","last_became_peered":"2024-05-08T18:50:36.047379+0000","last_unstale":"2024-05-08T18:53:08.005367+0000","last_undegraded":"2024-05-08T18:53:08.005367+0000","last_fullsized":"2024-05-08T18:53:08.005367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"27'6","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.894575+0000","last_change":"2024-05-08T18:50:28.022958+0000","last_active":"2024-05-08T18:53:34.894575+0000","last_peered":"2024-05-08T18:53:34.894575+0000","last_clean":"2024-05-08T18:53:34.894575+0000","last_became_active":"2024-05-08T18:50:28.022636+0000","last_became_peered":"2024-05-08T18:50:28.022636+0000","last_unstale":"2024-05-08T18:53:34.894575+0000","last_undegraded":"2024-05-08T18:53:34.894575+0000","last_fullsized":"2024-05-08T18:53:34.894575+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"25'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.007937+0000","last_change":"2024-05-08T18:50:26.031227+0000","last_active":"2024-05-08T18:52:53.007937+0000","last_peered":"2024-05-08T18:52:53.007937+0000","last_clean":"2024-05-08T18:52:53.007937+0000","last_became_active":"2024-05-08T18:50:26.030884+0000","last_became_peered":"2024-05-08T18:50:26.030884+0000","last_unstale":"2024-05-08T18:52:53.007937+0000","last_undegraded":"2024-05-08T18:52:53.007937+0000","last_fullsized":"2024-05-08T18:52:53.007937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:02.929650+0000","last_change":"2024-05-08T18:54:02.929688+0000","last_active":"2024-05-08T18:54:02.929650+0000","last_peered":"2024-05-08T18:54:02.929650+0000","last_clean":"2024-05-08T18:54:02.929650+0000","last_became_active":"2024-05-08T18:50:30.030773+0000","last_became_peered":"2024-05-08T18:50:30.030773+0000","last_unstale":"2024-05-08T18:54:02.929650+0000","last_undegraded":"2024-05-08T18:54:02.929650+0000","last_fullsized":"2024-05-08T18:54:02.929650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:02.929533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:02.929533+0000","last_clean_scrub_stamp":"2024-05-08T18:54:02.929533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:48:24.910553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"27'47","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:01.044939+0000","last_change":"2024-05-08T18:54:01.044974+0000","last_active":"2024-05-08T18:54:01.044939+0000","last_peered":"2024-05-08T18:54:01.044939+0000","last_clean":"2024-05-08T18:54:01.044939+0000","last_became_active":"2024-05-08T18:50:32.032289+0000","last_became_peered":"2024-05-08T18:50:32.032289+0000","last_unstale":"2024-05-08T18:54:01.044939+0000","last_undegraded":"2024-05-08T18:54:01.044939+0000","last_fullsized":"2024-05-08T18:54:01.044939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2024-05-08T18:54:01.044854+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2024-05-08T18:54:01.044854+0000","last_clean_scrub_stamp":"2024-05-08T18:54:01.044854+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:01.160239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.050696+0000","last_change":"2024-05-08T18:53:45.050721+0000","last_active":"2024-05-08T18:53:45.050696+0000","last_peered":"2024-05-08T18:53:45.050696+0000","last_clean":"2024-05-08T18:53:45.050696+0000","last_became_active":"2024-05-08T18:50:34.042903+0000","last_became_peered":"2024-05-08T18:50:34.042903+0000","last_unstale":"2024-05-08T18:53:45.050696+0000","last_undegraded":"2024-05-08T18:53:45.050696+0000","last_fullsized":"2024-05-08T18:53:45.050696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:45.050602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:45.050602+0000","last_clean_scrub_stamp":"2024-05-08T18:53:45.050602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:02.506698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:08.010901+0000","last_change":"2024-05-08T18:50:36.056236+0000","last_active":"2024-05-08T18:53:08.010901+0000","last_peered":"2024-05-08T18:53:08.010901+0000","last_clean":"2024-05-08T18:53:08.010901+0000","last_became_active":"2024-05-08T18:50:36.055855+0000","last_became_peered":"2024-05-08T18:50:36.055855+0000","last_unstale":"2024-05-08T18:53:08.010901+0000","last_undegraded":"2024-05-08T18:53:08.010901+0000","last_fullsized":"2024-05-08T18:53:08.010901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"27'11","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.939358+0000","last_change":"2024-05-08T18:50:28.035297+0000","last_active":"2024-05-08T18:53:34.939358+0000","last_peered":"2024-05-08T18:53:34.939358+0000","last_clean":"2024-05-08T18:53:34.939358+0000","last_became_active":"2024-05-08T18:50:28.034819+0000","last_became_peered":"2024-05-08T18:50:28.034819+0000","last_unstale":"2024-05-08T18:53:34.939358+0000","last_undegraded":"2024-05-08T18:53:34.939358+0000","last_fullsized":"2024-05-08T18:53:34.939358+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.008114+0000","last_change":"2024-05-08T18:50:26.029507+0000","last_active":"2024-05-08T18:52:53.008114+0000","last_peered":"2024-05-08T18:52:53.008114+0000","last_clean":"2024-05-08T18:52:53.008114+0000","last_became_active":"2024-05-08T18:50:26.029211+0000","last_became_peered":"2024-05-08T18:50:26.029211+0000","last_unstale":"2024-05-08T18:52:53.008114+0000","last_undegraded":"2024-05-08T18:52:53.008114+0000","last_fullsized":"2024-05-08T18:52:53.008114+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:57.055070+0000","last_change":"2024-05-08T18:53:57.055135+0000","last_active":"2024-05-08T18:53:57.055070+0000","last_peered":"2024-05-08T18:53:57.055070+0000","last_clean":"2024-05-08T18:53:57.055070+0000","last_became_active":"2024-05-08T18:50:30.031588+0000","last_became_peered":"2024-05-08T18:50:30.031588+0000","last_unstale":"2024-05-08T18:53:57.055070+0000","last_undegraded":"2024-05-08T18:53:57.055070+0000","last_fullsized":"2024-05-08T18:53:57.055070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:57.054969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:57.054969+0000","last_clean_scrub_stamp":"2024-05-08T18:53:57.054969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:57:44.577983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"27'36","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:57.960934+0000","last_change":"2024-05-08T18:53:57.960966+0000","last_active":"2024-05-08T18:53:57.960934+0000","last_peered":"2024-05-08T18:53:57.960934+0000","last_clean":"2024-05-08T18:53:57.960934+0000","last_became_active":"2024-05-08T18:50:32.035181+0000","last_became_peered":"2024-05-08T18:50:32.035181+0000","last_unstale":"2024-05-08T18:53:57.960934+0000","last_undegraded":"2024-05-08T18:53:57.960934+0000","last_fullsized":"2024-05-08T18:53:57.960934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-05-08T18:53:57.960820+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-05-08T18:53:57.960820+0000","last_clean_scrub_stamp":"2024-05-08T18:53:57.960820+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:23.268890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:49.951155+0000","last_change":"2024-05-08T18:53:49.951177+0000","last_active":"2024-05-08T18:53:49.951155+0000","last_peered":"2024-05-08T18:53:49.951155+0000","last_clean":"2024-05-08T18:53:49.951155+0000","last_became_active":"2024-05-08T18:50:34.039668+0000","last_became_peered":"2024-05-08T18:50:34.039668+0000","last_unstale":"2024-05-08T18:53:49.951155+0000","last_undegraded":"2024-05-08T18:53:49.951155+0000","last_fullsized":"2024-05-08T18:53:49.951155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:49.951058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:49.951058+0000","last_clean_scrub_stamp":"2024-05-08T18:53:49.951058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:24.708273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.005454+0000","last_change":"2024-05-08T18:50:28.026330+0000","last_active":"2024-05-08T18:52:33.005454+0000","last_peered":"2024-05-08T18:52:33.005454+0000","last_clean":"2024-05-08T18:52:33.005454+0000","last_became_active":"2024-05-08T18:50:28.025862+0000","last_became_peered":"2024-05-08T18:50:28.025862+0000","last_unstale":"2024-05-08T18:52:33.005454+0000","last_undegraded":"2024-05-08T18:52:33.005454+0000","last_fullsized":"2024-05-08T18:52:33.005454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.008366+0000","last_change":"2024-05-08T18:50:26.023167+0000","last_active":"2024-05-08T18:52:53.008366+0000","last_peered":"2024-05-08T18:52:53.008366+0000","last_clean":"2024-05-08T18:52:53.008366+0000","last_became_active":"2024-05-08T18:50:26.022874+0000","last_became_peered":"2024-05-08T18:50:26.022874+0000","last_unstale":"2024-05-08T18:52:53.008366+0000","last_undegraded":"2024-05-08T18:52:53.008366+0000","last_fullsized":"2024-05-08T18:52:53.008366+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.000480+0000","last_change":"2024-05-08T18:50:30.029972+0000","last_active":"2024-05-08T18:52:33.000480+0000","last_peered":"2024-05-08T18:52:33.000480+0000","last_clean":"2024-05-08T18:52:33.000480+0000","last_became_active":"2024-05-08T18:50:30.029570+0000","last_became_peered":"2024-05-08T18:50:30.029570+0000","last_unstale":"2024-05-08T18:52:33.000480+0000","last_undegraded":"2024-05-08T18:52:33.000480+0000","last_fullsized":"2024-05-08T18:52:33.000480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"27'65","reported_seq":138,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.032557+0000","last_change":"2024-05-08T18:53:58.032598+0000","last_active":"2024-05-08T18:53:58.032557+0000","last_peered":"2024-05-08T18:53:58.032557+0000","last_clean":"2024-05-08T18:53:58.032557+0000","last_became_active":"2024-05-08T18:50:32.039293+0000","last_became_peered":"2024-05-08T18:50:32.039293+0000","last_unstale":"2024-05-08T18:53:58.032557+0000","last_undegraded":"2024-05-08T18:53:58.032557+0000","last_fullsized":"2024-05-08T18:53:58.032557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'65","last_scrub_stamp":"2024-05-08T18:53:58.032459+0000","last_deep_scrub":"27'65","last_deep_scrub_stamp":"2024-05-08T18:53:58.032459+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.032459+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:46.844977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:46.910687+0000","last_change":"2024-05-08T18:53:46.910709+0000","last_active":"2024-05-08T18:53:46.910687+0000","last_peered":"2024-05-08T18:53:46.910687+0000","last_clean":"2024-05-08T18:53:46.910687+0000","last_became_active":"2024-05-08T18:50:34.047111+0000","last_became_peered":"2024-05-08T18:50:34.047111+0000","last_unstale":"2024-05-08T18:53:46.910687+0000","last_undegraded":"2024-05-08T18:53:46.910687+0000","last_fullsized":"2024-05-08T18:53:46.910687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:46.910595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:46.910595+0000","last_clean_scrub_stamp":"2024-05-08T18:53:46.910595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:27.588782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"27'14","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.003842+0000","last_change":"2024-05-08T18:50:36.047518+0000","last_active":"2024-05-08T18:52:58.003842+0000","last_peered":"2024-05-08T18:52:58.003842+0000","last_clean":"2024-05-08T18:52:58.003842+0000","last_became_active":"2024-05-08T18:50:36.046834+0000","last_became_peered":"2024-05-08T18:50:36.046834+0000","last_unstale":"2024-05-08T18:52:58.003842+0000","last_undegraded":"2024-05-08T18:52:58.003842+0000","last_fullsized":"2024-05-08T18:52:58.003842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'6","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.696487+0000","last_change":"2024-05-08T18:50:28.023338+0000","last_active":"2024-05-08T18:53:34.696487+0000","last_peered":"2024-05-08T18:53:34.696487+0000","last_clean":"2024-05-08T18:53:34.696487+0000","last_became_active":"2024-05-08T18:50:28.023049+0000","last_became_peered":"2024-05-08T18:50:28.023049+0000","last_unstale":"2024-05-08T18:53:34.696487+0000","last_undegraded":"2024-05-08T18:53:34.696487+0000","last_fullsized":"2024-05-08T18:53:34.696487+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.813775+0000","last_change":"2024-05-08T18:50:26.030145+0000","last_active":"2024-05-08T18:53:34.813775+0000","last_peered":"2024-05-08T18:53:34.813775+0000","last_clean":"2024-05-08T18:53:34.813775+0000","last_became_active":"2024-05-08T18:50:26.029008+0000","last_became_peered":"2024-05-08T18:50:26.029008+0000","last_unstale":"2024-05-08T18:53:34.813775+0000","last_undegraded":"2024-05-08T18:53:34.813775+0000","last_fullsized":"2024-05-08T18:53:34.813775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.005425+0000","last_change":"2024-05-08T18:50:30.027158+0000","last_active":"2024-05-08T18:52:38.005425+0000","last_peered":"2024-05-08T18:52:38.005425+0000","last_clean":"2024-05-08T18:52:38.005425+0000","last_became_active":"2024-05-08T18:50:30.026853+0000","last_became_peered":"2024-05-08T18:50:30.026853+0000","last_unstale":"2024-05-08T18:52:38.005425+0000","last_undegraded":"2024-05-08T18:52:38.005425+0000","last_fullsized":"2024-05-08T18:52:38.005425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"27'45","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.018036+0000","last_change":"2024-05-08T18:53:58.018103+0000","last_active":"2024-05-08T18:53:58.018036+0000","last_peered":"2024-05-08T18:53:58.018036+0000","last_clean":"2024-05-08T18:53:58.018036+0000","last_became_active":"2024-05-08T18:50:32.041208+0000","last_became_peered":"2024-05-08T18:50:32.041208+0000","last_unstale":"2024-05-08T18:53:58.018036+0000","last_undegraded":"2024-05-08T18:53:58.018036+0000","last_fullsized":"2024-05-08T18:53:58.018036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-05-08T18:53:58.017901+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-05-08T18:53:58.017901+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.017901+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:24:08.011328+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:56.078504+0000","last_change":"2024-05-08T18:53:56.078528+0000","last_active":"2024-05-08T18:53:56.078504+0000","last_peered":"2024-05-08T18:53:56.078504+0000","last_clean":"2024-05-08T18:53:56.078504+0000","last_became_active":"2024-05-08T18:50:34.048749+0000","last_became_peered":"2024-05-08T18:50:34.048749+0000","last_unstale":"2024-05-08T18:53:56.078504+0000","last_undegraded":"2024-05-08T18:53:56.078504+0000","last_fullsized":"2024-05-08T18:53:56.078504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:56.078418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:56.078418+0000","last_clean_scrub_stamp":"2024-05-08T18:53:56.078418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:48:18.059438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.009318+0000","last_change":"2024-05-08T18:50:36.057323+0000","last_active":"2024-05-08T18:52:58.009318+0000","last_peered":"2024-05-08T18:52:58.009318+0000","last_clean":"2024-05-08T18:52:58.009318+0000","last_became_active":"2024-05-08T18:50:36.056960+0000","last_became_peered":"2024-05-08T18:50:36.056960+0000","last_unstale":"2024-05-08T18:52:58.009318+0000","last_undegraded":"2024-05-08T18:52:58.009318+0000","last_fullsized":"2024-05-08T18:52:58.009318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"27'8","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:02.075651+0000","last_change":"2024-05-08T18:54:02.075677+0000","last_active":"2024-05-08T18:54:02.075651+0000","last_peered":"2024-05-08T18:54:02.075651+0000","last_clean":"2024-05-08T18:54:02.075651+0000","last_became_active":"2024-05-08T18:50:28.038364+0000","last_became_peered":"2024-05-08T18:50:28.038364+0000","last_unstale":"2024-05-08T18:54:02.075651+0000","last_undegraded":"2024-05-08T18:54:02.075651+0000","last_fullsized":"2024-05-08T18:54:02.075651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:02.075564+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:02.075564+0000","last_clean_scrub_stamp":"2024-05-08T18:54:02.075564+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:34.353002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'4","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.821307+0000","last_change":"2024-05-08T18:50:26.012760+0000","last_active":"2024-05-08T18:53:34.821307+0000","last_peered":"2024-05-08T18:53:34.821307+0000","last_clean":"2024-05-08T18:53:34.821307+0000","last_became_active":"2024-05-08T18:50:26.012506+0000","last_became_peered":"2024-05-08T18:50:26.012506+0000","last_unstale":"2024-05-08T18:53:34.821307+0000","last_undegraded":"2024-05-08T18:53:34.821307+0000","last_fullsized":"2024-05-08T18:53:34.821307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:03.009662+0000","last_change":"2024-05-08T18:50:30.026843+0000","last_active":"2024-05-08T18:53:03.009662+0000","last_peered":"2024-05-08T18:53:03.009662+0000","last_clean":"2024-05-08T18:53:03.009662+0000","last_became_active":"2024-05-08T18:50:30.026445+0000","last_became_peered":"2024-05-08T18:50:30.026445+0000","last_unstale":"2024-05-08T18:53:03.009662+0000","last_undegraded":"2024-05-08T18:53:03.009662+0000","last_fullsized":"2024-05-08T18:53:03.009662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"27'39","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:57.045765+0000","last_change":"2024-05-08T18:53:57.045805+0000","last_active":"2024-05-08T18:53:57.045765+0000","last_peered":"2024-05-08T18:53:57.045765+0000","last_clean":"2024-05-08T18:53:57.045765+0000","last_became_active":"2024-05-08T18:50:32.040745+0000","last_became_peered":"2024-05-08T18:50:32.040745+0000","last_unstale":"2024-05-08T18:53:57.045765+0000","last_undegraded":"2024-05-08T18:53:57.045765+0000","last_fullsized":"2024-05-08T18:53:57.045765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-05-08T18:53:57.045641+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-05-08T18:53:57.045641+0000","last_clean_scrub_stamp":"2024-05-08T18:53:57.045641+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:49.439151+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:46.999266+0000","last_change":"2024-05-08T18:53:46.999290+0000","last_active":"2024-05-08T18:53:46.999266+0000","last_peered":"2024-05-08T18:53:46.999266+0000","last_clean":"2024-05-08T18:53:46.999266+0000","last_became_active":"2024-05-08T18:50:34.047508+0000","last_became_peered":"2024-05-08T18:50:34.047508+0000","last_unstale":"2024-05-08T18:53:46.999266+0000","last_undegraded":"2024-05-08T18:53:46.999266+0000","last_fullsized":"2024-05-08T18:53:46.999266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:46.999168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:46.999168+0000","last_clean_scrub_stamp":"2024-05-08T18:53:46.999168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:21:10.901638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"27'9","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.610816+0000","last_change":"2024-05-08T18:50:36.058170+0000","last_active":"2024-05-08T18:53:34.610816+0000","last_peered":"2024-05-08T18:53:34.610816+0000","last_clean":"2024-05-08T18:53:34.610816+0000","last_became_active":"2024-05-08T18:50:36.057863+0000","last_became_peered":"2024-05-08T18:50:36.057863+0000","last_unstale":"2024-05-08T18:53:34.610816+0000","last_undegraded":"2024-05-08T18:53:34.610816+0000","last_fullsized":"2024-05-08T18:53:34.610816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"25'2","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.003881+0000","last_change":"2024-05-08T18:50:28.021697+0000","last_active":"2024-05-08T18:52:58.003881+0000","last_peered":"2024-05-08T18:52:58.003881+0000","last_clean":"2024-05-08T18:52:58.003881+0000","last_became_active":"2024-05-08T18:50:28.020441+0000","last_became_peered":"2024-05-08T18:50:28.020441+0000","last_unstale":"2024-05-08T18:52:58.003881+0000","last_undegraded":"2024-05-08T18:52:58.003881+0000","last_fullsized":"2024-05-08T18:52:58.003881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.009352+0000","last_change":"2024-05-08T18:50:26.025468+0000","last_active":"2024-05-08T18:52:58.009352+0000","last_peered":"2024-05-08T18:52:58.009352+0000","last_clean":"2024-05-08T18:52:58.009352+0000","last_became_active":"2024-05-08T18:50:26.024274+0000","last_became_peered":"2024-05-08T18:50:26.024274+0000","last_unstale":"2024-05-08T18:52:58.009352+0000","last_undegraded":"2024-05-08T18:52:58.009352+0000","last_fullsized":"2024-05-08T18:52:58.009352+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:01.042454+0000","last_change":"2024-05-08T18:54:01.042477+0000","last_active":"2024-05-08T18:54:01.042454+0000","last_peered":"2024-05-08T18:54:01.042454+0000","last_clean":"2024-05-08T18:54:01.042454+0000","last_became_active":"2024-05-08T18:50:30.028877+0000","last_became_peered":"2024-05-08T18:50:30.028877+0000","last_unstale":"2024-05-08T18:54:01.042454+0000","last_undegraded":"2024-05-08T18:54:01.042454+0000","last_fullsized":"2024-05-08T18:54:01.042454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:01.042364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:01.042364+0000","last_clean_scrub_stamp":"2024-05-08T18:54:01.042364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:56.888219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"25'10","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.005414+0000","last_change":"2024-05-08T18:50:32.042114+0000","last_active":"2024-05-08T18:52:33.005414+0000","last_peered":"2024-05-08T18:52:33.005414+0000","last_clean":"2024-05-08T18:52:33.005414+0000","last_became_active":"2024-05-08T18:50:32.041539+0000","last_became_peered":"2024-05-08T18:50:32.041539+0000","last_unstale":"2024-05-08T18:52:33.005414+0000","last_undegraded":"2024-05-08T18:52:33.005414+0000","last_fullsized":"2024-05-08T18:52:33.005414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"27'285","reported_seq":418,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:47.959722+0000","last_change":"2024-05-08T18:53:47.959752+0000","last_active":"2024-05-08T18:53:47.959722+0000","last_peered":"2024-05-08T18:53:47.959722+0000","last_clean":"2024-05-08T18:53:47.959722+0000","last_became_active":"2024-05-08T18:50:34.048421+0000","last_became_peered":"2024-05-08T18:50:34.048421+0000","last_unstale":"2024-05-08T18:53:47.959722+0000","last_undegraded":"2024-05-08T18:53:47.959722+0000","last_fullsized":"2024-05-08T18:53:47.959722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:47.959631+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:47.959631+0000","last_clean_scrub_stamp":"2024-05-08T18:53:47.959631+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:52:13.795244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"27'6","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.990989+0000","last_change":"2024-05-08T18:50:36.055738+0000","last_active":"2024-05-08T18:53:34.990989+0000","last_peered":"2024-05-08T18:53:34.990989+0000","last_clean":"2024-05-08T18:53:34.990989+0000","last_became_active":"2024-05-08T18:50:36.055184+0000","last_became_peered":"2024-05-08T18:50:36.055184+0000","last_unstale":"2024-05-08T18:53:34.990989+0000","last_undegraded":"2024-05-08T18:53:34.990989+0000","last_fullsized":"2024-05-08T18:53:34.990989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"27'3","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.936715+0000","last_change":"2024-05-08T18:50:28.025621+0000","last_active":"2024-05-08T18:53:34.936715+0000","last_peered":"2024-05-08T18:53:34.936715+0000","last_clean":"2024-05-08T18:53:34.936715+0000","last_became_active":"2024-05-08T18:50:28.025313+0000","last_became_peered":"2024-05-08T18:50:28.025313+0000","last_unstale":"2024-05-08T18:53:34.936715+0000","last_undegraded":"2024-05-08T18:53:34.936715+0000","last_fullsized":"2024-05-08T18:53:34.936715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.008945+0000","last_change":"2024-05-08T18:50:26.030334+0000","last_active":"2024-05-08T18:52:58.008945+0000","last_peered":"2024-05-08T18:52:58.008945+0000","last_clean":"2024-05-08T18:52:58.008945+0000","last_became_active":"2024-05-08T18:50:26.030058+0000","last_became_peered":"2024-05-08T18:50:26.030058+0000","last_unstale":"2024-05-08T18:52:58.008945+0000","last_undegraded":"2024-05-08T18:52:58.008945+0000","last_fullsized":"2024-05-08T18:52:58.008945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"18'1","reported_seq":221,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.410467+0000","last_change":"2024-05-08T18:50:30.024313+0000","last_active":"2024-05-08T18:53:41.410467+0000","last_peered":"2024-05-08T18:53:41.410467+0000","last_clean":"2024-05-08T18:53:41.410467+0000","last_became_active":"2024-05-08T18:50:30.024032+0000","last_became_peered":"2024-05-08T18:50:30.024032+0000","last_unstale":"2024-05-08T18:53:41.410467+0000","last_undegraded":"2024-05-08T18:53:41.410467+0000","last_fullsized":"2024-05-08T18:53:41.410467+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"27'46","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:51.108219+0000","last_change":"2024-05-08T18:53:51.108258+0000","last_active":"2024-05-08T18:53:51.108219+0000","last_peered":"2024-05-08T18:53:51.108219+0000","last_clean":"2024-05-08T18:53:51.108219+0000","last_became_active":"2024-05-08T18:50:32.035792+0000","last_became_peered":"2024-05-08T18:50:32.035792+0000","last_unstale":"2024-05-08T18:53:51.108219+0000","last_undegraded":"2024-05-08T18:53:51.108219+0000","last_fullsized":"2024-05-08T18:53:51.108219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-05-08T18:53:51.108138+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-05-08T18:53:51.108138+0000","last_clean_scrub_stamp":"2024-05-08T18:53:51.108138+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:39.003860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:49.040915+0000","last_change":"2024-05-08T18:53:49.040955+0000","last_active":"2024-05-08T18:53:49.040915+0000","last_peered":"2024-05-08T18:53:49.040915+0000","last_clean":"2024-05-08T18:53:49.040915+0000","last_became_active":"2024-05-08T18:50:34.044586+0000","last_became_peered":"2024-05-08T18:50:34.044586+0000","last_unstale":"2024-05-08T18:53:49.040915+0000","last_undegraded":"2024-05-08T18:53:49.040915+0000","last_fullsized":"2024-05-08T18:53:49.040915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:49.040776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:49.040776+0000","last_clean_scrub_stamp":"2024-05-08T18:53:49.040776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:14.348846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:03.009756+0000","last_change":"2024-05-08T18:50:36.053212+0000","last_active":"2024-05-08T18:53:03.009756+0000","last_peered":"2024-05-08T18:53:03.009756+0000","last_clean":"2024-05-08T18:53:03.009756+0000","last_became_active":"2024-05-08T18:50:36.052885+0000","last_became_peered":"2024-05-08T18:50:36.052885+0000","last_unstale":"2024-05-08T18:53:03.009756+0000","last_undegraded":"2024-05-08T18:53:03.009756+0000","last_fullsized":"2024-05-08T18:53:03.009756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"27'28","reported_seq":115,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.894108+0000","last_change":"2024-05-08T18:50:28.025900+0000","last_active":"2024-05-08T18:53:34.894108+0000","last_peered":"2024-05-08T18:53:34.894108+0000","last_clean":"2024-05-08T18:53:34.894108+0000","last_became_active":"2024-05-08T18:50:28.025162+0000","last_became_peered":"2024-05-08T18:50:28.025162+0000","last_unstale":"2024-05-08T18:53:34.894108+0000","last_undegraded":"2024-05-08T18:53:34.894108+0000","last_fullsized":"2024-05-08T18:53:34.894108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":112,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.009424+0000","last_change":"2024-05-08T18:50:26.027367+0000","last_active":"2024-05-08T18:52:58.009424+0000","last_peered":"2024-05-08T18:52:58.009424+0000","last_clean":"2024-05-08T18:52:58.009424+0000","last_became_active":"2024-05-08T18:50:26.027067+0000","last_became_peered":"2024-05-08T18:50:26.027067+0000","last_unstale":"2024-05-08T18:52:58.009424+0000","last_undegraded":"2024-05-08T18:52:58.009424+0000","last_fullsized":"2024-05-08T18:52:58.009424+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:00.968059+0000","last_change":"2024-05-08T18:54:00.968081+0000","last_active":"2024-05-08T18:54:00.968059+0000","last_peered":"2024-05-08T18:54:00.968059+0000","last_clean":"2024-05-08T18:54:00.968059+0000","last_became_active":"2024-05-08T18:50:30.034616+0000","last_became_peered":"2024-05-08T18:50:30.034616+0000","last_unstale":"2024-05-08T18:54:00.968059+0000","last_undegraded":"2024-05-08T18:54:00.968059+0000","last_fullsized":"2024-05-08T18:54:00.968059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:00.967968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:00.967968+0000","last_clean_scrub_stamp":"2024-05-08T18:54:00.967968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:09.724587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"27'38","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:56.013273+0000","last_change":"2024-05-08T18:53:56.013305+0000","last_active":"2024-05-08T18:53:56.013273+0000","last_peered":"2024-05-08T18:53:56.013273+0000","last_clean":"2024-05-08T18:53:56.013273+0000","last_became_active":"2024-05-08T18:50:32.041806+0000","last_became_peered":"2024-05-08T18:50:32.041806+0000","last_unstale":"2024-05-08T18:53:56.013273+0000","last_undegraded":"2024-05-08T18:53:56.013273+0000","last_fullsized":"2024-05-08T18:53:56.013273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2024-05-08T18:53:56.013183+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2024-05-08T18:53:56.013183+0000","last_clean_scrub_stamp":"2024-05-08T18:53:56.013183+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:02.069580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:03.010011+0000","last_change":"2024-05-08T18:50:34.050795+0000","last_active":"2024-05-08T18:53:03.010011+0000","last_peered":"2024-05-08T18:53:03.010011+0000","last_clean":"2024-05-08T18:53:03.010011+0000","last_became_active":"2024-05-08T18:50:34.050445+0000","last_became_peered":"2024-05-08T18:50:34.050445+0000","last_unstale":"2024-05-08T18:53:03.010011+0000","last_undegraded":"2024-05-08T18:53:03.010011+0000","last_fullsized":"2024-05-08T18:53:03.010011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:03.010228+0000","last_change":"2024-05-08T18:50:36.060634+0000","last_active":"2024-05-08T18:53:03.010228+0000","last_peered":"2024-05-08T18:53:03.010228+0000","last_clean":"2024-05-08T18:53:03.010228+0000","last_became_active":"2024-05-08T18:50:36.060318+0000","last_became_peered":"2024-05-08T18:50:36.060318+0000","last_unstale":"2024-05-08T18:53:03.010228+0000","last_undegraded":"2024-05-08T18:53:03.010228+0000","last_fullsized":"2024-05-08T18:53:03.010228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'4","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.829040+0000","last_change":"2024-05-08T18:50:28.029928+0000","last_active":"2024-05-08T18:53:34.829040+0000","last_peered":"2024-05-08T18:53:34.829040+0000","last_clean":"2024-05-08T18:53:34.829040+0000","last_became_active":"2024-05-08T18:50:28.029624+0000","last_became_peered":"2024-05-08T18:50:28.029624+0000","last_unstale":"2024-05-08T18:53:34.829040+0000","last_undegraded":"2024-05-08T18:53:34.829040+0000","last_fullsized":"2024-05-08T18:53:34.829040+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'4","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.591326+0000","last_change":"2024-05-08T18:50:26.029045+0000","last_active":"2024-05-08T18:53:34.591326+0000","last_peered":"2024-05-08T18:53:34.591326+0000","last_clean":"2024-05-08T18:53:34.591326+0000","last_became_active":"2024-05-08T18:50:26.028615+0000","last_became_peered":"2024-05-08T18:50:26.028615+0000","last_unstale":"2024-05-08T18:53:34.591326+0000","last_undegraded":"2024-05-08T18:53:34.591326+0000","last_fullsized":"2024-05-08T18:53:34.591326+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.082251+0000","last_change":"2024-05-08T18:53:58.082277+0000","last_active":"2024-05-08T18:53:58.082251+0000","last_peered":"2024-05-08T18:53:58.082251+0000","last_clean":"2024-05-08T18:53:58.082251+0000","last_became_active":"2024-05-08T18:50:30.030295+0000","last_became_peered":"2024-05-08T18:50:30.030295+0000","last_unstale":"2024-05-08T18:53:58.082251+0000","last_undegraded":"2024-05-08T18:53:58.082251+0000","last_fullsized":"2024-05-08T18:53:58.082251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:58.082158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:58.082158+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.082158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:04.138554+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"27'30","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:52.080875+0000","last_change":"2024-05-08T18:53:52.080925+0000","last_active":"2024-05-08T18:53:52.080875+0000","last_peered":"2024-05-08T18:53:52.080875+0000","last_clean":"2024-05-08T18:53:52.080875+0000","last_became_active":"2024-05-08T18:50:32.040661+0000","last_became_peered":"2024-05-08T18:50:32.040661+0000","last_unstale":"2024-05-08T18:53:52.080875+0000","last_undegraded":"2024-05-08T18:53:52.080875+0000","last_fullsized":"2024-05-08T18:53:52.080875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-05-08T18:53:52.080762+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-05-08T18:53:52.080762+0000","last_clean_scrub_stamp":"2024-05-08T18:53:52.080762+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:00.849983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:08.010841+0000","last_change":"2024-05-08T18:50:34.045449+0000","last_active":"2024-05-08T18:53:08.010841+0000","last_peered":"2024-05-08T18:53:08.010841+0000","last_clean":"2024-05-08T18:53:08.010841+0000","last_became_active":"2024-05-08T18:50:34.045040+0000","last_became_peered":"2024-05-08T18:50:34.045040+0000","last_unstale":"2024-05-08T18:53:08.010841+0000","last_undegraded":"2024-05-08T18:53:08.010841+0000","last_fullsized":"2024-05-08T18:53:08.010841+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:33.023718+0000","last_clean_scrub_stamp":"2024-05-08T18:50:33.023718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:03.010192+0000","last_change":"2024-05-08T18:50:36.060675+0000","last_active":"2024-05-08T18:53:03.010192+0000","last_peered":"2024-05-08T18:53:03.010192+0000","last_clean":"2024-05-08T18:53:03.010192+0000","last_became_active":"2024-05-08T18:50:36.060382+0000","last_became_peered":"2024-05-08T18:50:36.060382+0000","last_unstale":"2024-05-08T18:53:03.010192+0000","last_undegraded":"2024-05-08T18:53:03.010192+0000","last_fullsized":"2024-05-08T18:53:03.010192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'11","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.936824+0000","last_change":"2024-05-08T18:50:28.020688+0000","last_active":"2024-05-08T18:53:34.936824+0000","last_peered":"2024-05-08T18:53:34.936824+0000","last_clean":"2024-05-08T18:53:34.936824+0000","last_became_active":"2024-05-08T18:50:28.020421+0000","last_became_peered":"2024-05-08T18:50:28.020421+0000","last_unstale":"2024-05-08T18:53:34.936824+0000","last_undegraded":"2024-05-08T18:53:34.936824+0000","last_fullsized":"2024-05-08T18:53:34.936824+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"27'4","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.816333+0000","last_change":"2024-05-08T18:50:26.012375+0000","last_active":"2024-05-08T18:53:34.816333+0000","last_peered":"2024-05-08T18:53:34.816333+0000","last_clean":"2024-05-08T18:53:34.816333+0000","last_became_active":"2024-05-08T18:50:26.011299+0000","last_became_peered":"2024-05-08T18:50:26.011299+0000","last_unstale":"2024-05-08T18:53:34.816333+0000","last_undegraded":"2024-05-08T18:53:34.816333+0000","last_fullsized":"2024-05-08T18:53:34.816333+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:55.127436+0000","last_change":"2024-05-08T18:53:55.127480+0000","last_active":"2024-05-08T18:53:55.127436+0000","last_peered":"2024-05-08T18:53:55.127436+0000","last_clean":"2024-05-08T18:53:55.127436+0000","last_became_active":"2024-05-08T18:50:30.032578+0000","last_became_peered":"2024-05-08T18:50:30.032578+0000","last_unstale":"2024-05-08T18:53:55.127436+0000","last_undegraded":"2024-05-08T18:53:55.127436+0000","last_fullsized":"2024-05-08T18:53:55.127436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-08T18:53:55.127322+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-08T18:53:55.127322+0000","last_clean_scrub_stamp":"2024-05-08T18:53:55.127322+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:53.840153+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"27'37","reported_seq":86,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.498598+0000","last_change":"2024-05-08T18:50:32.042986+0000","last_active":"2024-05-08T18:53:41.498598+0000","last_peered":"2024-05-08T18:53:41.498598+0000","last_clean":"2024-05-08T18:53:41.498598+0000","last_became_active":"2024-05-08T18:50:32.042700+0000","last_became_peered":"2024-05-08T18:50:32.042700+0000","last_unstale":"2024-05-08T18:53:41.498598+0000","last_undegraded":"2024-05-08T18:53:41.498598+0000","last_fullsized":"2024-05-08T18:53:41.498598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:31.016934+0000","last_clean_scrub_stamp":"2024-05-08T18:50:31.016934+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":49,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:48.036967+0000","last_change":"2024-05-08T18:53:48.036991+0000","last_active":"2024-05-08T18:53:48.036967+0000","last_peered":"2024-05-08T18:53:48.036967+0000","last_clean":"2024-05-08T18:53:48.036967+0000","last_became_active":"2024-05-08T18:50:34.044872+0000","last_became_peered":"2024-05-08T18:50:34.044872+0000","last_unstale":"2024-05-08T18:53:48.036967+0000","last_undegraded":"2024-05-08T18:53:48.036967+0000","last_fullsized":"2024-05-08T18:53:48.036967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:48.036872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:48.036872+0000","last_clean_scrub_stamp":"2024-05-08T18:53:48.036872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:38.478912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"27'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.009385+0000","last_change":"2024-05-08T18:50:36.055685+0000","last_active":"2024-05-08T18:52:58.009385+0000","last_peered":"2024-05-08T18:52:58.009385+0000","last_clean":"2024-05-08T18:52:58.009385+0000","last_became_active":"2024-05-08T18:50:36.055188+0000","last_became_peered":"2024-05-08T18:50:36.055188+0000","last_unstale":"2024-05-08T18:52:58.009385+0000","last_undegraded":"2024-05-08T18:52:58.009385+0000","last_fullsized":"2024-05-08T18:52:58.009385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"27'12","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.614089+0000","last_change":"2024-05-08T18:50:28.039552+0000","last_active":"2024-05-08T18:53:34.614089+0000","last_peered":"2024-05-08T18:53:34.614089+0000","last_clean":"2024-05-08T18:53:34.614089+0000","last_became_active":"2024-05-08T18:50:28.039290+0000","last_became_peered":"2024-05-08T18:50:28.039290+0000","last_unstale":"2024-05-08T18:53:34.614089+0000","last_undegraded":"2024-05-08T18:53:34.614089+0000","last_fullsized":"2024-05-08T18:53:34.614089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"27'3","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.004487+0000","last_change":"2024-05-08T18:50:26.019000+0000","last_active":"2024-05-08T18:52:33.004487+0000","last_peered":"2024-05-08T18:52:33.004487+0000","last_clean":"2024-05-08T18:52:33.004487+0000","last_became_active":"2024-05-08T18:50:26.018713+0000","last_became_peered":"2024-05-08T18:50:26.018713+0000","last_unstale":"2024-05-08T18:52:33.004487+0000","last_undegraded":"2024-05-08T18:52:33.004487+0000","last_fullsized":"2024-05-08T18:52:33.004487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"27'5","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.936932+0000","last_change":"2024-05-08T18:50:28.026675+0000","last_active":"2024-05-08T18:53:34.936932+0000","last_peered":"2024-05-08T18:53:34.936932+0000","last_clean":"2024-05-08T18:53:34.936932+0000","last_became_active":"2024-05-08T18:50:28.026292+0000","last_became_peered":"2024-05-08T18:50:28.026292+0000","last_unstale":"2024-05-08T18:53:34.936932+0000","last_undegraded":"2024-05-08T18:53:34.936932+0000","last_fullsized":"2024-05-08T18:53:34.936932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.000365+0000","last_change":"2024-05-08T18:50:26.013052+0000","last_active":"2024-05-08T18:52:33.000365+0000","last_peered":"2024-05-08T18:52:33.000365+0000","last_clean":"2024-05-08T18:52:33.000365+0000","last_became_active":"2024-05-08T18:50:26.012760+0000","last_became_peered":"2024-05-08T18:50:26.012760+0000","last_unstale":"2024-05-08T18:52:33.000365+0000","last_undegraded":"2024-05-08T18:52:33.000365+0000","last_fullsized":"2024-05-08T18:52:33.000365+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'4","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.998032+0000","last_change":"2024-05-08T18:53:58.998059+0000","last_active":"2024-05-08T18:53:58.998032+0000","last_peered":"2024-05-08T18:53:58.998032+0000","last_clean":"2024-05-08T18:53:58.998032+0000","last_became_active":"2024-05-08T18:50:28.038785+0000","last_became_peered":"2024-05-08T18:50:28.038785+0000","last_unstale":"2024-05-08T18:53:58.998032+0000","last_undegraded":"2024-05-08T18:53:58.998032+0000","last_fullsized":"2024-05-08T18:53:58.998032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:53:58.997912+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:53:58.997912+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.997912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:10.188121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"25'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.005297+0000","last_change":"2024-05-08T18:50:26.026716+0000","last_active":"2024-05-08T18:52:33.005297+0000","last_peered":"2024-05-08T18:52:33.005297+0000","last_clean":"2024-05-08T18:52:33.005297+0000","last_became_active":"2024-05-08T18:50:26.025958+0000","last_became_peered":"2024-05-08T18:50:26.025958+0000","last_unstale":"2024-05-08T18:52:33.005297+0000","last_undegraded":"2024-05-08T18:52:33.005297+0000","last_fullsized":"2024-05-08T18:52:33.005297+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"27'6","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.868472+0000","last_change":"2024-05-08T18:50:28.026318+0000","last_active":"2024-05-08T18:53:34.868472+0000","last_peered":"2024-05-08T18:53:34.868472+0000","last_clean":"2024-05-08T18:53:34.868472+0000","last_became_active":"2024-05-08T18:50:28.025866+0000","last_became_peered":"2024-05-08T18:50:28.025866+0000","last_unstale":"2024-05-08T18:53:34.868472+0000","last_undegraded":"2024-05-08T18:53:34.868472+0000","last_fullsized":"2024-05-08T18:53:34.868472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.000410+0000","last_change":"2024-05-08T18:50:26.025390+0000","last_active":"2024-05-08T18:52:33.000410+0000","last_peered":"2024-05-08T18:52:33.000410+0000","last_clean":"2024-05-08T18:52:33.000410+0000","last_became_active":"2024-05-08T18:50:26.025120+0000","last_became_peered":"2024-05-08T18:50:26.025120+0000","last_unstale":"2024-05-08T18:52:33.000410+0000","last_undegraded":"2024-05-08T18:52:33.000410+0000","last_fullsized":"2024-05-08T18:52:33.000410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"27'8","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.696280+0000","last_change":"2024-05-08T18:50:28.025392+0000","last_active":"2024-05-08T18:53:34.696280+0000","last_peered":"2024-05-08T18:53:34.696280+0000","last_clean":"2024-05-08T18:53:34.696280+0000","last_became_active":"2024-05-08T18:50:28.025098+0000","last_became_peered":"2024-05-08T18:50:28.025098+0000","last_unstale":"2024-05-08T18:53:34.696280+0000","last_undegraded":"2024-05-08T18:53:34.696280+0000","last_fullsized":"2024-05-08T18:53:34.696280+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.489721+0000","last_change":"2024-05-08T18:50:26.014734+0000","last_active":"2024-05-08T18:53:41.489721+0000","last_peered":"2024-05-08T18:53:41.489721+0000","last_clean":"2024-05-08T18:53:41.489721+0000","last_became_active":"2024-05-08T18:50:26.014434+0000","last_became_peered":"2024-05-08T18:50:26.014434+0000","last_unstale":"2024-05-08T18:53:41.489721+0000","last_undegraded":"2024-05-08T18:53:41.489721+0000","last_fullsized":"2024-05-08T18:53:41.489721+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"27'10","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.868824+0000","last_change":"2024-05-08T18:50:28.037769+0000","last_active":"2024-05-08T18:53:34.868824+0000","last_peered":"2024-05-08T18:53:34.868824+0000","last_clean":"2024-05-08T18:53:34.868824+0000","last_became_active":"2024-05-08T18:50:28.037400+0000","last_became_peered":"2024-05-08T18:50:28.037400+0000","last_unstale":"2024-05-08T18:53:34.868824+0000","last_undegraded":"2024-05-08T18:53:34.868824+0000","last_fullsized":"2024-05-08T18:53:34.868824+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.005662+0000","last_change":"2024-05-08T18:50:26.029481+0000","last_active":"2024-05-08T18:52:38.005662+0000","last_peered":"2024-05-08T18:52:38.005662+0000","last_clean":"2024-05-08T18:52:38.005662+0000","last_became_active":"2024-05-08T18:50:26.029047+0000","last_became_peered":"2024-05-08T18:50:26.029047+0000","last_unstale":"2024-05-08T18:52:38.005662+0000","last_undegraded":"2024-05-08T18:52:38.005662+0000","last_fullsized":"2024-05-08T18:52:38.005662+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"27'4","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.699334+0000","last_change":"2024-05-08T18:50:28.021411+0000","last_active":"2024-05-08T18:53:34.699334+0000","last_peered":"2024-05-08T18:53:34.699334+0000","last_clean":"2024-05-08T18:53:34.699334+0000","last_became_active":"2024-05-08T18:50:28.021140+0000","last_became_peered":"2024-05-08T18:50:28.021140+0000","last_unstale":"2024-05-08T18:53:34.699334+0000","last_undegraded":"2024-05-08T18:53:34.699334+0000","last_fullsized":"2024-05-08T18:53:34.699334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.005387+0000","last_change":"2024-05-08T18:50:26.031998+0000","last_active":"2024-05-08T18:52:38.005387+0000","last_peered":"2024-05-08T18:52:38.005387+0000","last_clean":"2024-05-08T18:52:38.005387+0000","last_became_active":"2024-05-08T18:50:26.031680+0000","last_became_peered":"2024-05-08T18:50:26.031680+0000","last_unstale":"2024-05-08T18:52:38.005387+0000","last_undegraded":"2024-05-08T18:52:38.005387+0000","last_fullsized":"2024-05-08T18:52:38.005387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"27'11","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.937075+0000","last_change":"2024-05-08T18:50:28.023037+0000","last_active":"2024-05-08T18:53:34.937075+0000","last_peered":"2024-05-08T18:53:34.937075+0000","last_clean":"2024-05-08T18:53:34.937075+0000","last_became_active":"2024-05-08T18:50:28.021588+0000","last_became_peered":"2024-05-08T18:50:28.021588+0000","last_unstale":"2024-05-08T18:53:34.937075+0000","last_undegraded":"2024-05-08T18:53:34.937075+0000","last_fullsized":"2024-05-08T18:53:34.937075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.001143+0000","last_change":"2024-05-08T18:50:26.014622+0000","last_active":"2024-05-08T18:52:38.001143+0000","last_peered":"2024-05-08T18:52:38.001143+0000","last_clean":"2024-05-08T18:52:38.001143+0000","last_became_active":"2024-05-08T18:50:26.014383+0000","last_became_peered":"2024-05-08T18:50:26.014383+0000","last_unstale":"2024-05-08T18:52:38.001143+0000","last_undegraded":"2024-05-08T18:52:38.001143+0000","last_fullsized":"2024-05-08T18:52:38.001143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.936702+0000","last_change":"2024-05-08T18:50:28.032443+0000","last_active":"2024-05-08T18:53:34.936702+0000","last_peered":"2024-05-08T18:53:34.936702+0000","last_clean":"2024-05-08T18:53:34.936702+0000","last_became_active":"2024-05-08T18:50:28.032181+0000","last_became_peered":"2024-05-08T18:50:28.032181+0000","last_unstale":"2024-05-08T18:53:34.936702+0000","last_undegraded":"2024-05-08T18:53:34.936702+0000","last_fullsized":"2024-05-08T18:53:34.936702+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.496383+0000","last_change":"2024-05-08T18:50:26.025793+0000","last_active":"2024-05-08T18:53:41.496383+0000","last_peered":"2024-05-08T18:53:41.496383+0000","last_clean":"2024-05-08T18:53:41.496383+0000","last_became_active":"2024-05-08T18:50:26.025473+0000","last_became_peered":"2024-05-08T18:50:26.025473+0000","last_unstale":"2024-05-08T18:53:41.496383+0000","last_undegraded":"2024-05-08T18:53:41.496383+0000","last_fullsized":"2024-05-08T18:53:41.496383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'4","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.868764+0000","last_change":"2024-05-08T18:50:28.032744+0000","last_active":"2024-05-08T18:53:34.868764+0000","last_peered":"2024-05-08T18:53:34.868764+0000","last_clean":"2024-05-08T18:53:34.868764+0000","last_became_active":"2024-05-08T18:50:28.032462+0000","last_became_peered":"2024-05-08T18:50:28.032462+0000","last_unstale":"2024-05-08T18:53:34.868764+0000","last_undegraded":"2024-05-08T18:53:34.868764+0000","last_fullsized":"2024-05-08T18:53:34.868764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.001795+0000","last_change":"2024-05-08T18:50:26.019960+0000","last_active":"2024-05-08T18:52:43.001795+0000","last_peered":"2024-05-08T18:52:43.001795+0000","last_clean":"2024-05-08T18:52:43.001795+0000","last_became_active":"2024-05-08T18:50:26.019706+0000","last_became_peered":"2024-05-08T18:50:26.019706+0000","last_unstale":"2024-05-08T18:52:43.001795+0000","last_undegraded":"2024-05-08T18:52:43.001795+0000","last_fullsized":"2024-05-08T18:52:43.001795+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"27'1","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.936489+0000","last_change":"2024-05-08T18:50:28.031514+0000","last_active":"2024-05-08T18:53:34.936489+0000","last_peered":"2024-05-08T18:53:34.936489+0000","last_clean":"2024-05-08T18:53:34.936489+0000","last_became_active":"2024-05-08T18:50:28.031188+0000","last_became_peered":"2024-05-08T18:50:28.031188+0000","last_unstale":"2024-05-08T18:53:34.936489+0000","last_undegraded":"2024-05-08T18:53:34.936489+0000","last_fullsized":"2024-05-08T18:53:34.936489+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006306+0000","last_change":"2024-05-08T18:50:26.025601+0000","last_active":"2024-05-08T18:52:43.006306+0000","last_peered":"2024-05-08T18:52:43.006306+0000","last_clean":"2024-05-08T18:52:43.006306+0000","last_became_active":"2024-05-08T18:50:26.024808+0000","last_became_peered":"2024-05-08T18:50:26.024808+0000","last_unstale":"2024-05-08T18:52:43.006306+0000","last_undegraded":"2024-05-08T18:52:43.006306+0000","last_fullsized":"2024-05-08T18:52:43.006306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"27'6","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.894035+0000","last_change":"2024-05-08T18:50:28.023364+0000","last_active":"2024-05-08T18:53:34.894035+0000","last_peered":"2024-05-08T18:53:34.894035+0000","last_clean":"2024-05-08T18:53:34.894035+0000","last_became_active":"2024-05-08T18:50:28.022905+0000","last_became_peered":"2024-05-08T18:50:28.022905+0000","last_unstale":"2024-05-08T18:53:34.894035+0000","last_undegraded":"2024-05-08T18:53:34.894035+0000","last_fullsized":"2024-05-08T18:53:34.894035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006380+0000","last_change":"2024-05-08T18:50:26.025267+0000","last_active":"2024-05-08T18:52:43.006380+0000","last_peered":"2024-05-08T18:52:43.006380+0000","last_clean":"2024-05-08T18:52:43.006380+0000","last_became_active":"2024-05-08T18:50:26.024977+0000","last_became_peered":"2024-05-08T18:50:26.024977+0000","last_unstale":"2024-05-08T18:52:43.006380+0000","last_undegraded":"2024-05-08T18:52:43.006380+0000","last_fullsized":"2024-05-08T18:52:43.006380+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006348+0000","last_change":"2024-05-08T18:50:28.037398+0000","last_active":"2024-05-08T18:52:43.006348+0000","last_peered":"2024-05-08T18:52:43.006348+0000","last_clean":"2024-05-08T18:52:43.006348+0000","last_became_active":"2024-05-08T18:50:28.037153+0000","last_became_peered":"2024-05-08T18:50:28.037153+0000","last_unstale":"2024-05-08T18:52:43.006348+0000","last_undegraded":"2024-05-08T18:52:43.006348+0000","last_fullsized":"2024-05-08T18:52:43.006348+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006824+0000","last_change":"2024-05-08T18:50:26.012280+0000","last_active":"2024-05-08T18:52:43.006824+0000","last_peered":"2024-05-08T18:52:43.006824+0000","last_clean":"2024-05-08T18:52:43.006824+0000","last_became_active":"2024-05-08T18:50:26.011982+0000","last_became_peered":"2024-05-08T18:50:26.011982+0000","last_unstale":"2024-05-08T18:52:43.006824+0000","last_undegraded":"2024-05-08T18:52:43.006824+0000","last_fullsized":"2024-05-08T18:52:43.006824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"27'8","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006326+0000","last_change":"2024-05-08T18:50:28.028689+0000","last_active":"2024-05-08T18:52:43.006326+0000","last_peered":"2024-05-08T18:52:43.006326+0000","last_clean":"2024-05-08T18:52:43.006326+0000","last_became_active":"2024-05-08T18:50:28.028405+0000","last_became_peered":"2024-05-08T18:50:28.028405+0000","last_unstale":"2024-05-08T18:52:43.006326+0000","last_undegraded":"2024-05-08T18:52:43.006326+0000","last_fullsized":"2024-05-08T18:52:43.006326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006862+0000","last_change":"2024-05-08T18:50:26.023917+0000","last_active":"2024-05-08T18:52:43.006862+0000","last_peered":"2024-05-08T18:52:43.006862+0000","last_clean":"2024-05-08T18:52:43.006862+0000","last_became_active":"2024-05-08T18:50:26.023658+0000","last_became_peered":"2024-05-08T18:50:26.023658+0000","last_unstale":"2024-05-08T18:52:43.006862+0000","last_undegraded":"2024-05-08T18:52:43.006862+0000","last_fullsized":"2024-05-08T18:52:43.006862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"25'4","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006754+0000","last_change":"2024-05-08T18:50:28.032840+0000","last_active":"2024-05-08T18:52:43.006754+0000","last_peered":"2024-05-08T18:52:43.006754+0000","last_clean":"2024-05-08T18:52:43.006754+0000","last_became_active":"2024-05-08T18:50:28.032552+0000","last_became_peered":"2024-05-08T18:50:28.032552+0000","last_unstale":"2024-05-08T18:52:43.006754+0000","last_undegraded":"2024-05-08T18:52:43.006754+0000","last_fullsized":"2024-05-08T18:52:43.006754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007053+0000","last_change":"2024-05-08T18:50:26.032685+0000","last_active":"2024-05-08T18:52:48.007053+0000","last_peered":"2024-05-08T18:52:48.007053+0000","last_clean":"2024-05-08T18:52:48.007053+0000","last_became_active":"2024-05-08T18:50:26.032385+0000","last_became_peered":"2024-05-08T18:50:26.032385+0000","last_unstale":"2024-05-08T18:52:48.007053+0000","last_undegraded":"2024-05-08T18:52:48.007053+0000","last_fullsized":"2024-05-08T18:52:48.007053+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"27'6","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.005502+0000","last_change":"2024-05-08T18:50:28.024068+0000","last_active":"2024-05-08T18:52:38.005502+0000","last_peered":"2024-05-08T18:52:38.005502+0000","last_clean":"2024-05-08T18:52:38.005502+0000","last_became_active":"2024-05-08T18:50:28.023807+0000","last_became_peered":"2024-05-08T18:50:28.023807+0000","last_unstale":"2024-05-08T18:52:38.005502+0000","last_undegraded":"2024-05-08T18:52:38.005502+0000","last_fullsized":"2024-05-08T18:52:38.005502+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007840+0000","last_change":"2024-05-08T18:50:26.026065+0000","last_active":"2024-05-08T18:52:48.007840+0000","last_peered":"2024-05-08T18:52:48.007840+0000","last_clean":"2024-05-08T18:52:48.007840+0000","last_became_active":"2024-05-08T18:50:26.025023+0000","last_became_peered":"2024-05-08T18:50:26.025023+0000","last_unstale":"2024-05-08T18:52:48.007840+0000","last_undegraded":"2024-05-08T18:52:48.007840+0000","last_fullsized":"2024-05-08T18:52:48.007840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'6","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007502+0000","last_change":"2024-05-08T18:50:26.026599+0000","last_active":"2024-05-08T18:52:48.007502+0000","last_peered":"2024-05-08T18:52:48.007502+0000","last_clean":"2024-05-08T18:52:48.007502+0000","last_became_active":"2024-05-08T18:50:26.026333+0000","last_became_peered":"2024-05-08T18:50:26.026333+0000","last_unstale":"2024-05-08T18:52:48.007502+0000","last_undegraded":"2024-05-08T18:52:48.007502+0000","last_fullsized":"2024-05-08T18:52:48.007502+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"25'4","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.003310+0000","last_change":"2024-05-08T18:50:28.024946+0000","last_active":"2024-05-08T18:52:53.003310+0000","last_peered":"2024-05-08T18:52:53.003310+0000","last_clean":"2024-05-08T18:52:53.003310+0000","last_became_active":"2024-05-08T18:50:28.024627+0000","last_became_peered":"2024-05-08T18:50:28.024627+0000","last_unstale":"2024-05-08T18:52:53.003310+0000","last_undegraded":"2024-05-08T18:52:53.003310+0000","last_fullsized":"2024-05-08T18:52:53.003310+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.493958+0000","last_change":"2024-05-08T18:50:26.025142+0000","last_active":"2024-05-08T18:53:41.493958+0000","last_peered":"2024-05-08T18:53:41.493958+0000","last_clean":"2024-05-08T18:53:41.493958+0000","last_became_active":"2024-05-08T18:50:26.024839+0000","last_became_peered":"2024-05-08T18:50:26.024839+0000","last_unstale":"2024-05-08T18:53:41.493958+0000","last_undegraded":"2024-05-08T18:53:41.493958+0000","last_fullsized":"2024-05-08T18:53:41.493958+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'7","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.939251+0000","last_change":"2024-05-08T18:50:28.038943+0000","last_active":"2024-05-08T18:53:34.939251+0000","last_peered":"2024-05-08T18:53:34.939251+0000","last_clean":"2024-05-08T18:53:34.939251+0000","last_became_active":"2024-05-08T18:50:28.038677+0000","last_became_peered":"2024-05-08T18:50:28.038677+0000","last_unstale":"2024-05-08T18:53:34.939251+0000","last_undegraded":"2024-05-08T18:53:34.939251+0000","last_fullsized":"2024-05-08T18:53:34.939251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1336,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1492,"ondisk_log_size":1492,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1601,"num_read_kb":1491,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705712,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35744,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336096,"statfs":{"total":96636764160,"available":96600162304,"internally_reserved":0,"allocated":417792,"data_stored":121043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705713,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36256,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335584,"statfs":{"total":96636764160,"available":96599638016,"internally_reserved":0,"allocated":942080,"data_stored":707921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705712,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36284,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335556,"statfs":{"total":96636764160,"available":96599609344,"internally_reserved":0,"allocated":970752,"data_stored":708927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705712,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":380928,"data_stored":119875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:54:06.654 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.654 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.654 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.654 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.654 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.654 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.654 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.655 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.655 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.655 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.655 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.655 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.655 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.655 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.655 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.655 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.656 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.656 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.656 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.656 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.656 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.656 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.656 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.656 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.656 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.657 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.657 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.657 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.657 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.657 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.657 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.657 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.657 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.657 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.658 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.658 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.658 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.658 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.658 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.658 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.658 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.658 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.658 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.659 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.659 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.659 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.659 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.659 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.659 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.659 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.659 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.660 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.660 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.660 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.660 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.660 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.660 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.660 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.660 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.660 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.661 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.661 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.661 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.661 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.661 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.661 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.661 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.661 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.662 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.662 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.662 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.662 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.662 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.662 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.662 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.662 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.663 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.663 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.663 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.663 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.663 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.663 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.663 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.663 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.663 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.664 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.664 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.664 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.664 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.664 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.664 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.664 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.664 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.664 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.665 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.665 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.665 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.665 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.665 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.665 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.665 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.665 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.665 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.666 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.666 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.666 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.666 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.666 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.666 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.666 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.666 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.667 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.667 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.667 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.667 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.667 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.667 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.667 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.667 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.667 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.668 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.668 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.668 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.668 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.668 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.668 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.668 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.668 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.669 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.669 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.669 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.669 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.669 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.669 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.669 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.669 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.669 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.670 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.670 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.670 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.670 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.670 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.670 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.670 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.670 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.671 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.671 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.671 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.671 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.671 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.671 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.671 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.671 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-08T18:50:33.023718+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.672 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.672 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.672 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.672 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-05-08T18:50:31.016934+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.672 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.672 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.672 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.672 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.672 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.673 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.673 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.673 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.673 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.673 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.673 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.673 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.673 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.673 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.673 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.674 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.674 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.674 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.674 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.674 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.674 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.674 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.677 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.677 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.678 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.678 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.678 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.678 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.678 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.678 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.678 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.678 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.679 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.679 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.679 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.679 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:06.679 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T18:54:26.680 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:54:26.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.795+0000 7f205be4b640 1 Processor -- start 2024-05-08T18:54:26.795 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.795+0000 7f205be4b640 1 -- start start 2024-05-08T18:54:26.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.796+0000 7f205be4b640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f205412d1b0 0x7f205412d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:54:26.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.796+0000 7f205be4b640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f205412d590 con 0x7f205412dda0 2024-05-08T18:54:26.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.796+0000 7f205be4b640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f2054114de0 con 0x7f205412d1b0 2024-05-08T18:54:26.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.796+0000 7f2059be7640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f205412d1b0 0x7f205412d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:54:26.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.796+0000 7f20593e6640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f205412dda0 0x7f2054129c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:47420/0 (socket says 172.21.15.42:47420) 2024-05-08T18:54:26.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.796+0000 7f20593e6640 1 -- 172.21.15.42:0/3150112409 learned_addr learned my addr 172.21.15.42:0/3150112409 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:54:26.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.796+0000 7f2059be7640 1 -- 172.21.15.42:0/3150112409 >> v1:172.21.15.42:6789/0 conn(0x7f205412dda0 legacy=0x7f2054129c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:54:26.796 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.796+0000 7f2059be7640 1 -- 172.21.15.42:0/3150112409 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2054113c30 con 0x7f205412d1b0 2024-05-08T18:54:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.797+0000 7f2059be7640 1 --2- 172.21.15.42:0/3150112409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f205412d1b0 0x7f205412d860 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f2050009d90 tx=0x7f205002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbee70401660e63b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:54:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.797+0000 7f2058be5640 1 -- 172.21.15.42:0/3150112409 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2050039070 con 0x7f205412d1b0 2024-05-08T18:54:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.797+0000 7f2058be5640 1 -- 172.21.15.42:0/3150112409 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205002cb10 con 0x7f205412d1b0 2024-05-08T18:54:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.797+0000 7f2058be5640 1 -- 172.21.15.42:0/3150112409 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f205002ce10 con 0x7f205412d1b0 2024-05-08T18:54:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.798+0000 7f205be4b640 1 -- 172.21.15.42:0/3150112409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f205412d1b0 msgr2=0x7f205412d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:54:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.798+0000 7f205be4b640 1 --2- 172.21.15.42:0/3150112409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f205412d1b0 0x7f205412d860 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f2050009d90 tx=0x7f205002beb0 comp rx=0 tx=0).stop 2024-05-08T18:54:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.798+0000 7f205be4b640 1 -- 172.21.15.42:0/3150112409 shutdown_connections 2024-05-08T18:54:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.798+0000 7f205be4b640 1 --2- 172.21.15.42:0/3150112409 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f205412d1b0 0x7f205412d860 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:54:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.798+0000 7f205be4b640 1 -- 172.21.15.42:0/3150112409 >> 172.21.15.42:0/3150112409 conn(0x7f205409a910 msgr2=0x7f205406e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:54:26.798 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.798+0000 7f205be4b640 1 -- 172.21.15.42:0/3150112409 shutdown_connections 2024-05-08T18:54:26.799 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.798+0000 7f205be4b640 1 -- 172.21.15.42:0/3150112409 wait complete. 2024-05-08T18:54:26.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.799+0000 7f205be4b640 1 Processor -- start 2024-05-08T18:54:26.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.799+0000 7f205be4b640 1 -- start start 2024-05-08T18:54:26.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.799+0000 7f205be4b640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f205412d1b0 0x7f2054071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:54:26.800 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.799+0000 7f205be4b640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f205412a6d0 con 0x7f205412d1b0 2024-05-08T18:54:26.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.799+0000 7f2059be7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f205412d1b0 0x7f2054071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:54:26.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.799+0000 7f2059be7640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f205412d1b0 0x7f2054071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58976/0 (socket says 172.21.15.42:58976) 2024-05-08T18:54:26.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.799+0000 7f2059be7640 1 -- 172.21.15.42:0/3909029477 learned_addr learned my addr 172.21.15.42:0/3909029477 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:54:26.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.799+0000 7f2059be7640 1 -- 172.21.15.42:0/3909029477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2054073770 con 0x7f205412d1b0 2024-05-08T18:54:26.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.800+0000 7f2059be7640 1 --2- 172.21.15.42:0/3909029477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f205412d1b0 0x7f2054071850 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f2050009d90 tx=0x7f2050004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:54:26.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.800+0000 7f204a7fc640 1 -- 172.21.15.42:0/3909029477 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2050044020 con 0x7f205412d1b0 2024-05-08T18:54:26.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.800+0000 7f204a7fc640 1 -- 172.21.15.42:0/3909029477 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f205003f680 con 0x7f205412d1b0 2024-05-08T18:54:26.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.800+0000 7f204a7fc640 1 -- 172.21.15.42:0/3909029477 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2050039040 con 0x7f205412d1b0 2024-05-08T18:54:26.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.800+0000 7f205be4b640 1 -- 172.21.15.42:0/3909029477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f205411cb80 con 0x7f205412d1b0 2024-05-08T18:54:26.801 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.800+0000 7f205be4b640 1 -- 172.21.15.42:0/3909029477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2054071d90 con 0x7f205412d1b0 2024-05-08T18:54:26.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.801+0000 7f204a7fc640 1 -- 172.21.15.42:0/3909029477 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f2050047020 con 0x7f205412d1b0 2024-05-08T18:54:26.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.801+0000 7f205be4b640 1 -- 172.21.15.42:0/3909029477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f205411c6e0 con 0x7f205412d1b0 2024-05-08T18:54:26.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.801+0000 7f204a7fc640 1 --2- 172.21.15.42:0/3909029477 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f203803d2b0 0x7f203803f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:54:26.802 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.801+0000 7f204a7fc640 1 -- 172.21.15.42:0/3909029477 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f2050074b50 con 0x7f205412d1b0 2024-05-08T18:54:26.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.801+0000 7f20593e6640 1 --2- 172.21.15.42:0/3909029477 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f203803d2b0 0x7f203803f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:54:26.803 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.802+0000 7f20593e6640 1 --2- 172.21.15.42:0/3909029477 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f203803d2b0 0x7f203803f770 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2044000f60 tx=0x7f2044007a80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:54:26.806 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.806+0000 7f204a7fc640 1 -- 172.21.15.42:0/3909029477 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f205004e030 con 0x7f205412d1b0 2024-05-08T18:54:26.993 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:26.993+0000 7f205be4b640 1 -- 172.21.15.42:0/3909029477 --> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2054129b30 con 0x7f203803d2b0 2024-05-08T18:54:27.008 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:27.008+0000 7f204a7fc640 1 -- 172.21.15.42:0/3909029477 <== mgr.4102 v2:172.21.15.132:6824/2104266563 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+661415 (secure 0 0 0) 0x7f2054129b30 con 0x7f203803d2b0 2024-05-08T18:54:27.017 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:54:27.022 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-08T18:54:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:27.013+0000 7f205be4b640 1 -- 172.21.15.42:0/3909029477 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f203803d2b0 msgr2=0x7f203803f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:54:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:27.013+0000 7f205be4b640 1 --2- 172.21.15.42:0/3909029477 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f203803d2b0 0x7f203803f770 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2044000f60 tx=0x7f2044007a80 comp rx=0 tx=0).stop 2024-05-08T18:54:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:27.013+0000 7f205be4b640 1 -- 172.21.15.42:0/3909029477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f205412d1b0 msgr2=0x7f2054071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:54:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:27.013+0000 7f205be4b640 1 --2- 172.21.15.42:0/3909029477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f205412d1b0 0x7f2054071850 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f2050009d90 tx=0x7f2050004a40 comp rx=0 tx=0).stop 2024-05-08T18:54:27.025 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:27.013+0000 7f205be4b640 1 -- 172.21.15.42:0/3909029477 shutdown_connections 2024-05-08T18:54:27.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:27.013+0000 7f205be4b640 1 --2- 172.21.15.42:0/3909029477 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f203803d2b0 0x7f203803f770 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:54:27.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:27.013+0000 7f205be4b640 1 --2- 172.21.15.42:0/3909029477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f205412d1b0 0x7f2054071850 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:54:27.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:27.013+0000 7f205be4b640 1 -- 172.21.15.42:0/3909029477 >> 172.21.15.42:0/3909029477 conn(0x7f205409a910 msgr2=0x7f205406f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:54:27.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:27.013+0000 7f205be4b640 1 -- 172.21.15.42:0/3909029477 shutdown_connections 2024-05-08T18:54:27.026 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:27.013+0000 7f205be4b640 1 -- 172.21.15.42:0/3909029477 wait complete. 2024-05-08T18:54:27.027 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-05-08T18:54:26.001314+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5031,"num_read_kb":4621,"num_write":2119,"num_write_kb":60585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4726,"ondisk_log_size":4726,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":143992,"kb_used_data":2648,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343368,"statfs":{"total":386547056640,"available":386399608832,"internally_reserved":0,"allocated":2711552,"data_stored":1657766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1664,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003819"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:20.917434+0000","last_change":"2024-05-08T18:54:20.917462+0000","last_active":"2024-05-08T18:54:20.917434+0000","last_peered":"2024-05-08T18:54:20.917434+0000","last_clean":"2024-05-08T18:54:20.917434+0000","last_became_active":"2024-05-08T18:50:26.031359+0000","last_became_peered":"2024-05-08T18:50:26.031359+0000","last_unstale":"2024-05-08T18:54:20.917434+0000","last_undegraded":"2024-05-08T18:54:20.917434+0000","last_fullsized":"2024-05-08T18:54:20.917434+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:20.917335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:20.917335+0000","last_clean_scrub_stamp":"2024-05-08T18:54:20.917335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:04.286184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"27'8","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.869005+0000","last_change":"2024-05-08T18:50:28.028609+0000","last_active":"2024-05-08T18:53:34.869005+0000","last_peered":"2024-05-08T18:53:34.869005+0000","last_clean":"2024-05-08T18:53:34.869005+0000","last_became_active":"2024-05-08T18:50:28.028352+0000","last_became_peered":"2024-05-08T18:50:28.028352+0000","last_unstale":"2024-05-08T18:53:34.869005+0000","last_undegraded":"2024-05-08T18:53:34.869005+0000","last_fullsized":"2024-05-08T18:53:34.869005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:34.089033+0000","last_change":"2024-05-08T18:50:26.029183+0000","last_active":"2024-05-08T18:52:34.089033+0000","last_peered":"2024-05-08T18:52:34.089033+0000","last_clean":"2024-05-08T18:52:34.089033+0000","last_became_active":"2024-05-08T18:50:26.028799+0000","last_became_peered":"2024-05-08T18:50:26.028799+0000","last_unstale":"2024-05-08T18:52:34.089033+0000","last_undegraded":"2024-05-08T18:52:34.089033+0000","last_fullsized":"2024-05-08T18:52:34.089033+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"27'6","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:22.049106+0000","last_change":"2024-05-08T18:54:22.049138+0000","last_active":"2024-05-08T18:54:22.049106+0000","last_peered":"2024-05-08T18:54:22.049106+0000","last_clean":"2024-05-08T18:54:22.049106+0000","last_became_active":"2024-05-08T18:50:28.033466+0000","last_became_peered":"2024-05-08T18:50:28.033466+0000","last_unstale":"2024-05-08T18:54:22.049106+0000","last_undegraded":"2024-05-08T18:54:22.049106+0000","last_fullsized":"2024-05-08T18:54:22.049106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:22.049001+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:22.049001+0000","last_clean_scrub_stamp":"2024-05-08T18:54:22.049001+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:03.232750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:23.012828+0000","last_change":"2024-05-08T18:51:15.084166+0000","last_active":"2024-05-08T18:53:23.012828+0000","last_peered":"2024-05-08T18:53:23.012828+0000","last_clean":"2024-05-08T18:53:23.012828+0000","last_became_active":"2024-05-08T18:51:15.083809+0000","last_became_peered":"2024-05-08T18:51:15.083809+0000","last_unstale":"2024-05-08T18:53:23.012828+0000","last_undegraded":"2024-05-08T18:53:23.012828+0000","last_fullsized":"2024-05-08T18:53:23.012828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"25'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:44.491509+0000","last_change":"2024-05-08T18:51:15.083978+0000","last_active":"2024-05-08T18:53:44.491509+0000","last_peered":"2024-05-08T18:53:44.491509+0000","last_clean":"2024-05-08T18:53:44.491509+0000","last_became_active":"2024-05-08T18:51:15.080716+0000","last_became_peered":"2024-05-08T18:51:15.080716+0000","last_unstale":"2024-05-08T18:53:44.491509+0000","last_undegraded":"2024-05-08T18:53:44.491509+0000","last_fullsized":"2024-05-08T18:53:44.491509+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:28.003903+0000","last_change":"2024-05-08T18:50:26.024545+0000","last_active":"2024-05-08T18:52:28.003903+0000","last_peered":"2024-05-08T18:52:28.003903+0000","last_clean":"2024-05-08T18:52:28.003903+0000","last_became_active":"2024-05-08T18:50:26.024243+0000","last_became_peered":"2024-05-08T18:50:26.024243+0000","last_unstale":"2024-05-08T18:52:28.003903+0000","last_undegraded":"2024-05-08T18:52:28.003903+0000","last_fullsized":"2024-05-08T18:52:28.003903+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"27'4","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.696124+0000","last_change":"2024-05-08T18:50:28.026931+0000","last_active":"2024-05-08T18:53:34.696124+0000","last_peered":"2024-05-08T18:53:34.696124+0000","last_clean":"2024-05-08T18:53:34.696124+0000","last_became_active":"2024-05-08T18:50:28.026380+0000","last_became_peered":"2024-05-08T18:50:28.026380+0000","last_unstale":"2024-05-08T18:53:34.696124+0000","last_undegraded":"2024-05-08T18:53:34.696124+0000","last_fullsized":"2024-05-08T18:53:34.696124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"25'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.009373+0000","last_change":"2024-05-08T18:50:26.023188+0000","last_active":"2024-05-08T18:52:58.009373+0000","last_peered":"2024-05-08T18:52:58.009373+0000","last_clean":"2024-05-08T18:52:58.009373+0000","last_became_active":"2024-05-08T18:50:26.022914+0000","last_became_peered":"2024-05-08T18:50:26.022914+0000","last_unstale":"2024-05-08T18:52:58.009373+0000","last_undegraded":"2024-05-08T18:52:58.009373+0000","last_fullsized":"2024-05-08T18:52:58.009373+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'6","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:17.878073+0000","last_change":"2024-05-08T18:54:17.878113+0000","last_active":"2024-05-08T18:54:17.878073+0000","last_peered":"2024-05-08T18:54:17.878073+0000","last_clean":"2024-05-08T18:54:17.878073+0000","last_became_active":"2024-05-08T18:50:28.023506+0000","last_became_peered":"2024-05-08T18:50:28.023506+0000","last_unstale":"2024-05-08T18:54:17.878073+0000","last_undegraded":"2024-05-08T18:54:17.878073+0000","last_fullsized":"2024-05-08T18:54:17.878073+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:17.877983+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:17.877983+0000","last_clean_scrub_stamp":"2024-05-08T18:54:17.877983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:50.155421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"25'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.008779+0000","last_change":"2024-05-08T18:50:26.024901+0000","last_active":"2024-05-08T18:52:58.008779+0000","last_peered":"2024-05-08T18:52:58.008779+0000","last_clean":"2024-05-08T18:52:58.008779+0000","last_became_active":"2024-05-08T18:50:26.024493+0000","last_became_peered":"2024-05-08T18:50:26.024493+0000","last_unstale":"2024-05-08T18:52:58.008779+0000","last_undegraded":"2024-05-08T18:52:58.008779+0000","last_fullsized":"2024-05-08T18:52:58.008779+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"27'10","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:18.071840+0000","last_change":"2024-05-08T18:54:18.071888+0000","last_active":"2024-05-08T18:54:18.071840+0000","last_peered":"2024-05-08T18:54:18.071840+0000","last_clean":"2024-05-08T18:54:18.071840+0000","last_became_active":"2024-05-08T18:50:28.037266+0000","last_became_peered":"2024-05-08T18:50:28.037266+0000","last_unstale":"2024-05-08T18:54:18.071840+0000","last_undegraded":"2024-05-08T18:54:18.071840+0000","last_fullsized":"2024-05-08T18:54:18.071840+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:18.071727+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:18.071727+0000","last_clean_scrub_stamp":"2024-05-08T18:54:18.071727+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:22.473146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.491075+0000","last_change":"2024-05-08T18:50:26.011072+0000","last_active":"2024-05-08T18:53:41.491075+0000","last_peered":"2024-05-08T18:53:41.491075+0000","last_clean":"2024-05-08T18:53:41.491075+0000","last_became_active":"2024-05-08T18:50:26.010734+0000","last_became_peered":"2024-05-08T18:50:26.010734+0000","last_unstale":"2024-05-08T18:53:41.491075+0000","last_undegraded":"2024-05-08T18:53:41.491075+0000","last_fullsized":"2024-05-08T18:53:41.491075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:15.936130+0000","last_change":"2024-05-08T18:54:15.936164+0000","last_active":"2024-05-08T18:54:15.936130+0000","last_peered":"2024-05-08T18:54:15.936130+0000","last_clean":"2024-05-08T18:54:15.936130+0000","last_became_active":"2024-05-08T18:50:28.026028+0000","last_became_peered":"2024-05-08T18:50:28.026028+0000","last_unstale":"2024-05-08T18:54:15.936130+0000","last_undegraded":"2024-05-08T18:54:15.936130+0000","last_fullsized":"2024-05-08T18:54:15.936130+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:15.936014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:15.936014+0000","last_clean_scrub_stamp":"2024-05-08T18:54:15.936014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:46.686256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"25'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:22.076100+0000","last_change":"2024-05-08T18:54:22.076129+0000","last_active":"2024-05-08T18:54:22.076100+0000","last_peered":"2024-05-08T18:54:22.076100+0000","last_clean":"2024-05-08T18:54:22.076100+0000","last_became_active":"2024-05-08T18:50:26.029435+0000","last_became_peered":"2024-05-08T18:50:26.029435+0000","last_unstale":"2024-05-08T18:54:22.076100+0000","last_undegraded":"2024-05-08T18:54:22.076100+0000","last_fullsized":"2024-05-08T18:54:22.076100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:22.076003+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:22.076003+0000","last_clean_scrub_stamp":"2024-05-08T18:54:22.076003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:28.517889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"27'6","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.894454+0000","last_change":"2024-05-08T18:50:28.033720+0000","last_active":"2024-05-08T18:53:34.894454+0000","last_peered":"2024-05-08T18:53:34.894454+0000","last_clean":"2024-05-08T18:53:34.894454+0000","last_became_active":"2024-05-08T18:50:28.033311+0000","last_became_peered":"2024-05-08T18:50:28.033311+0000","last_unstale":"2024-05-08T18:53:34.894454+0000","last_undegraded":"2024-05-08T18:53:34.894454+0000","last_fullsized":"2024-05-08T18:53:34.894454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"27'10","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007556+0000","last_change":"2024-05-08T18:50:28.033240+0000","last_active":"2024-05-08T18:52:48.007556+0000","last_peered":"2024-05-08T18:52:48.007556+0000","last_clean":"2024-05-08T18:52:48.007556+0000","last_became_active":"2024-05-08T18:50:28.032951+0000","last_became_peered":"2024-05-08T18:50:28.032951+0000","last_unstale":"2024-05-08T18:52:48.007556+0000","last_undegraded":"2024-05-08T18:52:48.007556+0000","last_fullsized":"2024-05-08T18:52:48.007556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'4","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:22.772336+0000","last_change":"2024-05-08T18:54:22.772365+0000","last_active":"2024-05-08T18:54:22.772336+0000","last_peered":"2024-05-08T18:54:22.772336+0000","last_clean":"2024-05-08T18:54:22.772336+0000","last_became_active":"2024-05-08T18:50:26.030437+0000","last_became_peered":"2024-05-08T18:50:26.030437+0000","last_unstale":"2024-05-08T18:54:22.772336+0000","last_undegraded":"2024-05-08T18:54:22.772336+0000","last_fullsized":"2024-05-08T18:54:22.772336+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-08T18:54:22.772232+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-08T18:54:22.772232+0000","last_clean_scrub_stamp":"2024-05-08T18:54:22.772232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:30.535173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'22","reported_seq":116,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:21.778508+0000","last_change":"2024-05-08T18:54:21.778559+0000","last_active":"2024-05-08T18:54:21.778508+0000","last_peered":"2024-05-08T18:54:21.778508+0000","last_clean":"2024-05-08T18:54:21.778508+0000","last_became_active":"2024-05-08T18:50:28.028184+0000","last_became_peered":"2024-05-08T18:50:28.028184+0000","last_unstale":"2024-05-08T18:54:21.778508+0000","last_undegraded":"2024-05-08T18:54:21.778508+0000","last_fullsized":"2024-05-08T18:54:21.778508+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-05-08T18:54:21.778405+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-05-08T18:54:21.778405+0000","last_clean_scrub_stamp":"2024-05-08T18:54:21.778405+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:34.523219+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":94,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"27'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:14.975181+0000","last_change":"2024-05-08T18:54:14.975221+0000","last_active":"2024-05-08T18:54:14.975181+0000","last_peered":"2024-05-08T18:54:14.975181+0000","last_clean":"2024-05-08T18:54:14.975181+0000","last_became_active":"2024-05-08T18:50:26.031768+0000","last_became_peered":"2024-05-08T18:50:26.031768+0000","last_unstale":"2024-05-08T18:54:14.975181+0000","last_undegraded":"2024-05-08T18:54:14.975181+0000","last_fullsized":"2024-05-08T18:54:14.975181+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:14.975072+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:14.975072+0000","last_clean_scrub_stamp":"2024-05-08T18:54:14.975072+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:23.744293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'8","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.894630+0000","last_change":"2024-05-08T18:50:28.029440+0000","last_active":"2024-05-08T18:53:34.894630+0000","last_peered":"2024-05-08T18:53:34.894630+0000","last_clean":"2024-05-08T18:53:34.894630+0000","last_became_active":"2024-05-08T18:50:28.029145+0000","last_became_peered":"2024-05-08T18:50:28.029145+0000","last_unstale":"2024-05-08T18:53:34.894630+0000","last_undegraded":"2024-05-08T18:53:34.894630+0000","last_fullsized":"2024-05-08T18:53:34.894630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"27'4","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:20.823534+0000","last_change":"2024-05-08T18:54:20.823562+0000","last_active":"2024-05-08T18:54:20.823534+0000","last_peered":"2024-05-08T18:54:20.823534+0000","last_clean":"2024-05-08T18:54:20.823534+0000","last_became_active":"2024-05-08T18:50:26.031545+0000","last_became_peered":"2024-05-08T18:50:26.031545+0000","last_unstale":"2024-05-08T18:54:20.823534+0000","last_undegraded":"2024-05-08T18:54:20.823534+0000","last_fullsized":"2024-05-08T18:54:20.823534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:20.823443+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:20.823443+0000","last_clean_scrub_stamp":"2024-05-08T18:54:20.823443+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:58.388872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"27'16","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:21.125113+0000","last_change":"2024-05-08T18:54:21.125177+0000","last_active":"2024-05-08T18:54:21.125113+0000","last_peered":"2024-05-08T18:54:21.125113+0000","last_clean":"2024-05-08T18:54:21.125113+0000","last_became_active":"2024-05-08T18:50:28.022683+0000","last_became_peered":"2024-05-08T18:50:28.022683+0000","last_unstale":"2024-05-08T18:54:21.125113+0000","last_undegraded":"2024-05-08T18:54:21.125113+0000","last_fullsized":"2024-05-08T18:54:21.125113+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-05-08T18:54:21.125005+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-05-08T18:54:21.125005+0000","last_clean_scrub_stamp":"2024-05-08T18:54:21.125005+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.887946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.574146+0000","last_change":"2024-05-08T18:50:26.013216+0000","last_active":"2024-05-08T18:53:34.574146+0000","last_peered":"2024-05-08T18:53:34.574146+0000","last_clean":"2024-05-08T18:53:34.574146+0000","last_became_active":"2024-05-08T18:50:26.011512+0000","last_became_peered":"2024-05-08T18:50:26.011512+0000","last_unstale":"2024-05-08T18:53:34.574146+0000","last_undegraded":"2024-05-08T18:53:34.574146+0000","last_fullsized":"2024-05-08T18:53:34.574146+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:19.891014+0000","last_change":"2024-05-08T18:54:19.891039+0000","last_active":"2024-05-08T18:54:19.891014+0000","last_peered":"2024-05-08T18:54:19.891014+0000","last_clean":"2024-05-08T18:54:19.891014+0000","last_became_active":"2024-05-08T18:50:28.032768+0000","last_became_peered":"2024-05-08T18:50:28.032768+0000","last_unstale":"2024-05-08T18:54:19.891014+0000","last_undegraded":"2024-05-08T18:54:19.891014+0000","last_fullsized":"2024-05-08T18:54:19.891014+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:19.890923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:19.890923+0000","last_clean_scrub_stamp":"2024-05-08T18:54:19.890923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:07.413936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.003227+0000","last_change":"2024-05-08T18:50:26.029400+0000","last_active":"2024-05-08T18:52:53.003227+0000","last_peered":"2024-05-08T18:52:53.003227+0000","last_clean":"2024-05-08T18:52:53.003227+0000","last_became_active":"2024-05-08T18:50:26.029015+0000","last_became_peered":"2024-05-08T18:50:26.029015+0000","last_unstale":"2024-05-08T18:52:53.003227+0000","last_undegraded":"2024-05-08T18:52:53.003227+0000","last_fullsized":"2024-05-08T18:52:53.003227+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"27'14","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:14.955599+0000","last_change":"2024-05-08T18:54:14.955626+0000","last_active":"2024-05-08T18:54:14.955599+0000","last_peered":"2024-05-08T18:54:14.955599+0000","last_clean":"2024-05-08T18:54:14.955599+0000","last_became_active":"2024-05-08T18:50:28.022359+0000","last_became_peered":"2024-05-08T18:50:28.022359+0000","last_unstale":"2024-05-08T18:54:14.955599+0000","last_undegraded":"2024-05-08T18:54:14.955599+0000","last_fullsized":"2024-05-08T18:54:14.955599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-05-08T18:54:14.955510+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-05-08T18:54:14.955510+0000","last_clean_scrub_stamp":"2024-05-08T18:54:14.955510+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:26.145719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.493628+0000","last_change":"2024-05-08T18:50:26.017214+0000","last_active":"2024-05-08T18:53:41.493628+0000","last_peered":"2024-05-08T18:53:41.493628+0000","last_clean":"2024-05-08T18:53:41.493628+0000","last_became_active":"2024-05-08T18:50:26.016932+0000","last_became_peered":"2024-05-08T18:50:26.016932+0000","last_unstale":"2024-05-08T18:53:41.493628+0000","last_undegraded":"2024-05-08T18:53:41.493628+0000","last_fullsized":"2024-05-08T18:53:41.493628+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"27'41","reported_seq":108,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.902438+0000","last_change":"2024-05-08T18:50:36.055719+0000","last_active":"2024-05-08T18:53:34.902438+0000","last_peered":"2024-05-08T18:53:34.902438+0000","last_clean":"2024-05-08T18:53:34.902438+0000","last_became_active":"2024-05-08T18:50:36.055045+0000","last_became_peered":"2024-05-08T18:50:36.055045+0000","last_unstale":"2024-05-08T18:53:34.902438+0000","last_undegraded":"2024-05-08T18:53:34.902438+0000","last_fullsized":"2024-05-08T18:53:34.902438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":182,"num_write":115,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'10","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.829686+0000","last_change":"2024-05-08T18:50:28.025676+0000","last_active":"2024-05-08T18:53:34.829686+0000","last_peered":"2024-05-08T18:53:34.829686+0000","last_clean":"2024-05-08T18:53:34.829686+0000","last_became_active":"2024-05-08T18:50:28.025239+0000","last_became_peered":"2024-05-08T18:50:28.025239+0000","last_unstale":"2024-05-08T18:53:34.829686+0000","last_undegraded":"2024-05-08T18:53:34.829686+0000","last_fullsized":"2024-05-08T18:53:34.829686+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007667+0000","last_change":"2024-05-08T18:50:26.026659+0000","last_active":"2024-05-08T18:52:48.007667+0000","last_peered":"2024-05-08T18:52:48.007667+0000","last_clean":"2024-05-08T18:52:48.007667+0000","last_became_active":"2024-05-08T18:50:26.026400+0000","last_became_peered":"2024-05-08T18:50:26.026400+0000","last_unstale":"2024-05-08T18:52:48.007667+0000","last_undegraded":"2024-05-08T18:52:48.007667+0000","last_fullsized":"2024-05-08T18:52:48.007667+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:46.101267+0000","last_change":"2024-05-08T18:53:46.101302+0000","last_active":"2024-05-08T18:53:46.101267+0000","last_peered":"2024-05-08T18:53:46.101267+0000","last_clean":"2024-05-08T18:53:46.101267+0000","last_became_active":"2024-05-08T18:50:30.034832+0000","last_became_peered":"2024-05-08T18:50:30.034832+0000","last_unstale":"2024-05-08T18:53:46.101267+0000","last_undegraded":"2024-05-08T18:53:46.101267+0000","last_fullsized":"2024-05-08T18:53:46.101267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:46.101144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:46.101144+0000","last_clean_scrub_stamp":"2024-05-08T18:53:46.101144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:47.297905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"27'36","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:10.133225+0000","last_change":"2024-05-08T18:54:10.133267+0000","last_active":"2024-05-08T18:54:10.133225+0000","last_peered":"2024-05-08T18:54:10.133225+0000","last_clean":"2024-05-08T18:54:10.133225+0000","last_became_active":"2024-05-08T18:50:32.042432+0000","last_became_peered":"2024-05-08T18:50:32.042432+0000","last_unstale":"2024-05-08T18:54:10.133225+0000","last_undegraded":"2024-05-08T18:54:10.133225+0000","last_fullsized":"2024-05-08T18:54:10.133225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-05-08T18:54:10.133140+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-05-08T18:54:10.133140+0000","last_clean_scrub_stamp":"2024-05-08T18:54:10.133140+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:10:47.056279+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:52.079227+0000","last_change":"2024-05-08T18:53:52.079267+0000","last_active":"2024-05-08T18:53:52.079227+0000","last_peered":"2024-05-08T18:53:52.079227+0000","last_clean":"2024-05-08T18:53:52.079227+0000","last_became_active":"2024-05-08T18:50:34.048339+0000","last_became_peered":"2024-05-08T18:50:34.048339+0000","last_unstale":"2024-05-08T18:53:52.079227+0000","last_undegraded":"2024-05-08T18:53:52.079227+0000","last_fullsized":"2024-05-08T18:53:52.079227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:52.079130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:52.079130+0000","last_clean_scrub_stamp":"2024-05-08T18:53:52.079130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:45.266873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"27'7","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:03.009599+0000","last_change":"2024-05-08T18:50:36.055618+0000","last_active":"2024-05-08T18:53:03.009599+0000","last_peered":"2024-05-08T18:53:03.009599+0000","last_clean":"2024-05-08T18:53:03.009599+0000","last_became_active":"2024-05-08T18:50:36.055220+0000","last_became_peered":"2024-05-08T18:50:36.055220+0000","last_unstale":"2024-05-08T18:53:03.009599+0000","last_undegraded":"2024-05-08T18:53:03.009599+0000","last_fullsized":"2024-05-08T18:53:03.009599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"25'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:03.039013+0000","last_change":"2024-05-08T18:54:03.039054+0000","last_active":"2024-05-08T18:54:03.039013+0000","last_peered":"2024-05-08T18:54:03.039013+0000","last_clean":"2024-05-08T18:54:03.039013+0000","last_became_active":"2024-05-08T18:50:28.038232+0000","last_became_peered":"2024-05-08T18:50:28.038232+0000","last_unstale":"2024-05-08T18:54:03.039013+0000","last_undegraded":"2024-05-08T18:54:03.039013+0000","last_fullsized":"2024-05-08T18:54:03.039013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:03.038905+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:03.038905+0000","last_clean_scrub_stamp":"2024-05-08T18:54:03.038905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:05.325298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.496533+0000","last_change":"2024-05-08T18:50:26.031250+0000","last_active":"2024-05-08T18:53:41.496533+0000","last_peered":"2024-05-08T18:53:41.496533+0000","last_clean":"2024-05-08T18:53:41.496533+0000","last_became_active":"2024-05-08T18:50:26.030986+0000","last_became_peered":"2024-05-08T18:50:26.030986+0000","last_unstale":"2024-05-08T18:53:41.496533+0000","last_undegraded":"2024-05-08T18:53:41.496533+0000","last_fullsized":"2024-05-08T18:53:41.496533+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:12.104653+0000","last_change":"2024-05-08T18:54:12.104703+0000","last_active":"2024-05-08T18:54:12.104653+0000","last_peered":"2024-05-08T18:54:12.104653+0000","last_clean":"2024-05-08T18:54:12.104653+0000","last_became_active":"2024-05-08T18:50:30.026538+0000","last_became_peered":"2024-05-08T18:50:30.026538+0000","last_unstale":"2024-05-08T18:54:12.104653+0000","last_undegraded":"2024-05-08T18:54:12.104653+0000","last_fullsized":"2024-05-08T18:54:12.104653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:12.104549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:12.104549+0000","last_clean_scrub_stamp":"2024-05-08T18:54:12.104549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:24:22.097976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:50.126320+0000","last_change":"2024-05-08T18:53:50.126357+0000","last_active":"2024-05-08T18:53:50.126320+0000","last_peered":"2024-05-08T18:53:50.126320+0000","last_clean":"2024-05-08T18:53:50.126320+0000","last_became_active":"2024-05-08T18:50:32.039031+0000","last_became_peered":"2024-05-08T18:50:32.039031+0000","last_unstale":"2024-05-08T18:53:50.126320+0000","last_undegraded":"2024-05-08T18:53:50.126320+0000","last_fullsized":"2024-05-08T18:53:50.126320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-08T18:53:50.126231+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-08T18:53:50.126231+0000","last_clean_scrub_stamp":"2024-05-08T18:53:50.126231+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:49.044855+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:00.011377+0000","last_change":"2024-05-08T18:54:00.011405+0000","last_active":"2024-05-08T18:54:00.011377+0000","last_peered":"2024-05-08T18:54:00.011377+0000","last_clean":"2024-05-08T18:54:00.011377+0000","last_became_active":"2024-05-08T18:50:34.050512+0000","last_became_peered":"2024-05-08T18:50:34.050512+0000","last_unstale":"2024-05-08T18:54:00.011377+0000","last_undegraded":"2024-05-08T18:54:00.011377+0000","last_fullsized":"2024-05-08T18:54:00.011377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:00.011283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:00.011283+0000","last_clean_scrub_stamp":"2024-05-08T18:54:00.011283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:48.823802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"25'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:08.005296+0000","last_change":"2024-05-08T18:50:36.048388+0000","last_active":"2024-05-08T18:53:08.005296+0000","last_peered":"2024-05-08T18:53:08.005296+0000","last_clean":"2024-05-08T18:53:08.005296+0000","last_became_active":"2024-05-08T18:50:36.048075+0000","last_became_peered":"2024-05-08T18:50:36.048075+0000","last_unstale":"2024-05-08T18:53:08.005296+0000","last_undegraded":"2024-05-08T18:53:08.005296+0000","last_fullsized":"2024-05-08T18:53:08.005296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'10","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.868598+0000","last_change":"2024-05-08T18:50:28.026321+0000","last_active":"2024-05-08T18:53:34.868598+0000","last_peered":"2024-05-08T18:53:34.868598+0000","last_clean":"2024-05-08T18:53:34.868598+0000","last_became_active":"2024-05-08T18:50:28.025867+0000","last_became_peered":"2024-05-08T18:50:28.025867+0000","last_unstale":"2024-05-08T18:53:34.868598+0000","last_undegraded":"2024-05-08T18:53:34.868598+0000","last_fullsized":"2024-05-08T18:53:34.868598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.490938+0000","last_change":"2024-05-08T18:50:26.025750+0000","last_active":"2024-05-08T18:53:41.490938+0000","last_peered":"2024-05-08T18:53:41.490938+0000","last_clean":"2024-05-08T18:53:41.490938+0000","last_became_active":"2024-05-08T18:50:26.025410+0000","last_became_peered":"2024-05-08T18:50:26.025410+0000","last_unstale":"2024-05-08T18:53:41.490938+0000","last_undegraded":"2024-05-08T18:53:41.490938+0000","last_fullsized":"2024-05-08T18:53:41.490938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:09.051908+0000","last_change":"2024-05-08T18:54:09.051964+0000","last_active":"2024-05-08T18:54:09.051908+0000","last_peered":"2024-05-08T18:54:09.051908+0000","last_clean":"2024-05-08T18:54:09.051908+0000","last_became_active":"2024-05-08T18:50:30.029196+0000","last_became_peered":"2024-05-08T18:50:30.029196+0000","last_unstale":"2024-05-08T18:54:09.051908+0000","last_undegraded":"2024-05-08T18:54:09.051908+0000","last_fullsized":"2024-05-08T18:54:09.051908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:09.051799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:09.051799+0000","last_clean_scrub_stamp":"2024-05-08T18:54:09.051799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:04.437066+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"27'15","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:51.005744+0000","last_change":"2024-05-08T18:53:51.005796+0000","last_active":"2024-05-08T18:53:51.005744+0000","last_peered":"2024-05-08T18:53:51.005744+0000","last_clean":"2024-05-08T18:53:51.005744+0000","last_became_active":"2024-05-08T18:50:32.044056+0000","last_became_peered":"2024-05-08T18:50:32.044056+0000","last_unstale":"2024-05-08T18:53:51.005744+0000","last_undegraded":"2024-05-08T18:53:51.005744+0000","last_fullsized":"2024-05-08T18:53:51.005744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-08T18:53:51.005656+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-08T18:53:51.005656+0000","last_clean_scrub_stamp":"2024-05-08T18:53:51.005656+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:01:56.400586+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"27'285","reported_seq":402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:09.098897+0000","last_change":"2024-05-08T18:54:09.098926+0000","last_active":"2024-05-08T18:54:09.098897+0000","last_peered":"2024-05-08T18:54:09.098897+0000","last_clean":"2024-05-08T18:54:09.098897+0000","last_became_active":"2024-05-08T18:50:34.041872+0000","last_became_peered":"2024-05-08T18:50:34.041872+0000","last_unstale":"2024-05-08T18:54:09.098897+0000","last_undegraded":"2024-05-08T18:54:09.098897+0000","last_fullsized":"2024-05-08T18:54:09.098897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:54:09.098809+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:54:09.098809+0000","last_clean_scrub_stamp":"2024-05-08T18:54:09.098809+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:58.498954+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:08.010430+0000","last_change":"2024-05-08T18:50:36.049616+0000","last_active":"2024-05-08T18:53:08.010430+0000","last_peered":"2024-05-08T18:53:08.010430+0000","last_clean":"2024-05-08T18:53:08.010430+0000","last_became_active":"2024-05-08T18:50:36.049346+0000","last_became_peered":"2024-05-08T18:50:36.049346+0000","last_unstale":"2024-05-08T18:53:08.010430+0000","last_undegraded":"2024-05-08T18:53:08.010430+0000","last_fullsized":"2024-05-08T18:53:08.010430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'6","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:13.114919+0000","last_change":"2024-05-08T18:54:13.114946+0000","last_active":"2024-05-08T18:54:13.114919+0000","last_peered":"2024-05-08T18:54:13.114919+0000","last_clean":"2024-05-08T18:54:13.114919+0000","last_became_active":"2024-05-08T18:50:28.031332+0000","last_became_peered":"2024-05-08T18:50:28.031332+0000","last_unstale":"2024-05-08T18:54:13.114919+0000","last_undegraded":"2024-05-08T18:54:13.114919+0000","last_fullsized":"2024-05-08T18:54:13.114919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:13.114824+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:13.114824+0000","last_clean_scrub_stamp":"2024-05-08T18:54:13.114824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:53:47.219370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:18.862259+0000","last_change":"2024-05-08T18:54:18.862299+0000","last_active":"2024-05-08T18:54:18.862259+0000","last_peered":"2024-05-08T18:54:18.862259+0000","last_clean":"2024-05-08T18:54:18.862259+0000","last_became_active":"2024-05-08T18:50:26.032155+0000","last_became_peered":"2024-05-08T18:50:26.032155+0000","last_unstale":"2024-05-08T18:54:18.862259+0000","last_undegraded":"2024-05-08T18:54:18.862259+0000","last_fullsized":"2024-05-08T18:54:18.862259+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:18.862147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:18.862147+0000","last_clean_scrub_stamp":"2024-05-08T18:54:18.862147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:21.148541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"27'5","reported_seq":238,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:49.069175+0000","last_change":"2024-05-08T18:53:49.069207+0000","last_active":"2024-05-08T18:53:49.069175+0000","last_peered":"2024-05-08T18:53:49.069175+0000","last_clean":"2024-05-08T18:53:49.069175+0000","last_became_active":"2024-05-08T18:50:30.034798+0000","last_became_peered":"2024-05-08T18:50:30.034798+0000","last_unstale":"2024-05-08T18:53:49.069175+0000","last_undegraded":"2024-05-08T18:53:49.069175+0000","last_fullsized":"2024-05-08T18:53:49.069175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-08T18:53:49.069063+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-08T18:53:49.069063+0000","last_clean_scrub_stamp":"2024-05-08T18:53:49.069063+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:32.617643+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"27'36","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.006281+0000","last_change":"2024-05-08T18:53:53.006323+0000","last_active":"2024-05-08T18:53:53.006281+0000","last_peered":"2024-05-08T18:53:53.006281+0000","last_clean":"2024-05-08T18:53:53.006281+0000","last_became_active":"2024-05-08T18:50:32.043573+0000","last_became_peered":"2024-05-08T18:50:32.043573+0000","last_unstale":"2024-05-08T18:53:53.006281+0000","last_undegraded":"2024-05-08T18:53:53.006281+0000","last_fullsized":"2024-05-08T18:53:53.006281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-05-08T18:53:53.006187+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-05-08T18:53:53.006187+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.006187+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:39.343300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"27'285","reported_seq":413,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:03.005283+0000","last_change":"2024-05-08T18:54:03.005312+0000","last_active":"2024-05-08T18:54:03.005283+0000","last_peered":"2024-05-08T18:54:03.005283+0000","last_clean":"2024-05-08T18:54:03.005283+0000","last_became_active":"2024-05-08T18:50:34.050122+0000","last_became_peered":"2024-05-08T18:50:34.050122+0000","last_unstale":"2024-05-08T18:54:03.005283+0000","last_undegraded":"2024-05-08T18:54:03.005283+0000","last_fullsized":"2024-05-08T18:54:03.005283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:54:03.005191+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:54:03.005191+0000","last_clean_scrub_stamp":"2024-05-08T18:54:03.005191+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:17.903758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"27'6","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:19.034397+0000","last_change":"2024-05-08T18:54:19.034422+0000","last_active":"2024-05-08T18:54:19.034397+0000","last_peered":"2024-05-08T18:54:19.034397+0000","last_clean":"2024-05-08T18:54:19.034397+0000","last_became_active":"2024-05-08T18:50:28.034992+0000","last_became_peered":"2024-05-08T18:50:28.034992+0000","last_unstale":"2024-05-08T18:54:19.034397+0000","last_undegraded":"2024-05-08T18:54:19.034397+0000","last_fullsized":"2024-05-08T18:54:19.034397+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:19.034312+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:19.034312+0000","last_clean_scrub_stamp":"2024-05-08T18:54:19.034312+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:24.299155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006194+0000","last_change":"2024-05-08T18:50:26.023445+0000","last_active":"2024-05-08T18:52:43.006194+0000","last_peered":"2024-05-08T18:52:43.006194+0000","last_clean":"2024-05-08T18:52:43.006194+0000","last_became_active":"2024-05-08T18:50:26.023141+0000","last_became_peered":"2024-05-08T18:50:26.023141+0000","last_unstale":"2024-05-08T18:52:43.006194+0000","last_undegraded":"2024-05-08T18:52:43.006194+0000","last_fullsized":"2024-05-08T18:52:43.006194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:59.048708+0000","last_change":"2024-05-08T18:53:59.048754+0000","last_active":"2024-05-08T18:53:59.048708+0000","last_peered":"2024-05-08T18:53:59.048708+0000","last_clean":"2024-05-08T18:53:59.048708+0000","last_became_active":"2024-05-08T18:50:30.029482+0000","last_became_peered":"2024-05-08T18:50:30.029482+0000","last_unstale":"2024-05-08T18:53:59.048708+0000","last_undegraded":"2024-05-08T18:53:59.048708+0000","last_fullsized":"2024-05-08T18:53:59.048708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:59.048606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:59.048606+0000","last_clean_scrub_stamp":"2024-05-08T18:53:59.048606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:51.442116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"27'52","reported_seq":112,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:54.955612+0000","last_change":"2024-05-08T18:53:54.955673+0000","last_active":"2024-05-08T18:53:54.955612+0000","last_peered":"2024-05-08T18:53:54.955612+0000","last_clean":"2024-05-08T18:53:54.955612+0000","last_became_active":"2024-05-08T18:50:32.038121+0000","last_became_peered":"2024-05-08T18:50:32.038121+0000","last_unstale":"2024-05-08T18:53:54.955612+0000","last_undegraded":"2024-05-08T18:53:54.955612+0000","last_fullsized":"2024-05-08T18:53:54.955612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'52","last_scrub_stamp":"2024-05-08T18:53:54.955515+0000","last_deep_scrub":"27'52","last_deep_scrub_stamp":"2024-05-08T18:53:54.955515+0000","last_clean_scrub_stamp":"2024-05-08T18:53:54.955515+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:16.055669+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:44.931133+0000","last_change":"2024-05-08T18:53:44.931154+0000","last_active":"2024-05-08T18:53:44.931133+0000","last_peered":"2024-05-08T18:53:44.931133+0000","last_clean":"2024-05-08T18:53:44.931133+0000","last_became_active":"2024-05-08T18:50:34.047404+0000","last_became_peered":"2024-05-08T18:50:34.047404+0000","last_unstale":"2024-05-08T18:53:44.931133+0000","last_undegraded":"2024-05-08T18:53:44.931133+0000","last_fullsized":"2024-05-08T18:53:44.931133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:44.931063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:44.931063+0000","last_clean_scrub_stamp":"2024-05-08T18:53:44.931063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:50.136970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"27'3","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006034+0000","last_change":"2024-05-08T18:50:36.052192+0000","last_active":"2024-05-08T18:52:43.006034+0000","last_peered":"2024-05-08T18:52:43.006034+0000","last_clean":"2024-05-08T18:52:43.006034+0000","last_became_active":"2024-05-08T18:50:36.051055+0000","last_became_peered":"2024-05-08T18:50:36.051055+0000","last_unstale":"2024-05-08T18:52:43.006034+0000","last_undegraded":"2024-05-08T18:52:43.006034+0000","last_fullsized":"2024-05-08T18:52:43.006034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"27'8","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:16.905151+0000","last_change":"2024-05-08T18:54:16.905203+0000","last_active":"2024-05-08T18:54:16.905151+0000","last_peered":"2024-05-08T18:54:16.905151+0000","last_clean":"2024-05-08T18:54:16.905151+0000","last_became_active":"2024-05-08T18:50:28.018022+0000","last_became_peered":"2024-05-08T18:50:28.018022+0000","last_unstale":"2024-05-08T18:54:16.905151+0000","last_undegraded":"2024-05-08T18:54:16.905151+0000","last_fullsized":"2024-05-08T18:54:16.905151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:16.905016+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:16.905016+0000","last_clean_scrub_stamp":"2024-05-08T18:54:16.905016+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:46.535490+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006108+0000","last_change":"2024-05-08T18:50:26.025311+0000","last_active":"2024-05-08T18:52:43.006108+0000","last_peered":"2024-05-08T18:52:43.006108+0000","last_clean":"2024-05-08T18:52:43.006108+0000","last_became_active":"2024-05-08T18:50:26.025028+0000","last_became_peered":"2024-05-08T18:50:26.025028+0000","last_unstale":"2024-05-08T18:52:43.006108+0000","last_undegraded":"2024-05-08T18:52:43.006108+0000","last_fullsized":"2024-05-08T18:52:43.006108+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:05.046356+0000","last_change":"2024-05-08T18:54:05.046379+0000","last_active":"2024-05-08T18:54:05.046356+0000","last_peered":"2024-05-08T18:54:05.046356+0000","last_clean":"2024-05-08T18:54:05.046356+0000","last_became_active":"2024-05-08T18:50:30.031574+0000","last_became_peered":"2024-05-08T18:50:30.031574+0000","last_unstale":"2024-05-08T18:54:05.046356+0000","last_undegraded":"2024-05-08T18:54:05.046356+0000","last_fullsized":"2024-05-08T18:54:05.046356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:05.046264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:05.046264+0000","last_clean_scrub_stamp":"2024-05-08T18:54:05.046264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:56.573231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"27'38","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:04.084010+0000","last_change":"2024-05-08T18:54:04.084045+0000","last_active":"2024-05-08T18:54:04.084010+0000","last_peered":"2024-05-08T18:54:04.084010+0000","last_clean":"2024-05-08T18:54:04.084010+0000","last_became_active":"2024-05-08T18:50:32.041239+0000","last_became_peered":"2024-05-08T18:50:32.041239+0000","last_unstale":"2024-05-08T18:54:04.084010+0000","last_undegraded":"2024-05-08T18:54:04.084010+0000","last_fullsized":"2024-05-08T18:54:04.084010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2024-05-08T18:54:04.083924+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2024-05-08T18:54:04.083924+0000","last_clean_scrub_stamp":"2024-05-08T18:54:04.083924+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:32.880132+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:50.038894+0000","last_change":"2024-05-08T18:53:50.038945+0000","last_active":"2024-05-08T18:53:50.038894+0000","last_peered":"2024-05-08T18:53:50.038894+0000","last_clean":"2024-05-08T18:53:50.038894+0000","last_became_active":"2024-05-08T18:50:34.044487+0000","last_became_peered":"2024-05-08T18:50:34.044487+0000","last_unstale":"2024-05-08T18:53:50.038894+0000","last_undegraded":"2024-05-08T18:53:50.038894+0000","last_fullsized":"2024-05-08T18:53:50.038894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:50.038762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:50.038762+0000","last_clean_scrub_stamp":"2024-05-08T18:53:50.038762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.226504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"27'8","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:12.011596+0000","last_change":"2024-05-08T18:54:12.011630+0000","last_active":"2024-05-08T18:54:12.011596+0000","last_peered":"2024-05-08T18:54:12.011596+0000","last_clean":"2024-05-08T18:54:12.011596+0000","last_became_active":"2024-05-08T18:50:36.050379+0000","last_became_peered":"2024-05-08T18:50:36.050379+0000","last_unstale":"2024-05-08T18:54:12.011596+0000","last_undegraded":"2024-05-08T18:54:12.011596+0000","last_fullsized":"2024-05-08T18:54:12.011596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:12.011510+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:12.011510+0000","last_clean_scrub_stamp":"2024-05-08T18:54:12.011510+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:47.390905+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"27'6","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.005253+0000","last_change":"2024-05-08T18:50:28.037118+0000","last_active":"2024-05-08T18:52:38.005253+0000","last_peered":"2024-05-08T18:52:38.005253+0000","last_clean":"2024-05-08T18:52:38.005253+0000","last_became_active":"2024-05-08T18:50:28.036821+0000","last_became_peered":"2024-05-08T18:50:28.036821+0000","last_unstale":"2024-05-08T18:52:38.005253+0000","last_undegraded":"2024-05-08T18:52:38.005253+0000","last_fullsized":"2024-05-08T18:52:38.005253+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006852+0000","last_change":"2024-05-08T18:50:26.023248+0000","last_active":"2024-05-08T18:52:43.006852+0000","last_peered":"2024-05-08T18:52:43.006852+0000","last_clean":"2024-05-08T18:52:43.006852+0000","last_became_active":"2024-05-08T18:50:26.022938+0000","last_became_peered":"2024-05-08T18:50:26.022938+0000","last_unstale":"2024-05-08T18:52:43.006852+0000","last_undegraded":"2024-05-08T18:52:43.006852+0000","last_fullsized":"2024-05-08T18:52:43.006852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:10.062367+0000","last_change":"2024-05-08T18:54:10.062412+0000","last_active":"2024-05-08T18:54:10.062367+0000","last_peered":"2024-05-08T18:54:10.062367+0000","last_clean":"2024-05-08T18:54:10.062367+0000","last_became_active":"2024-05-08T18:50:30.029134+0000","last_became_peered":"2024-05-08T18:50:30.029134+0000","last_unstale":"2024-05-08T18:54:10.062367+0000","last_undegraded":"2024-05-08T18:54:10.062367+0000","last_fullsized":"2024-05-08T18:54:10.062367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:10.062263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:10.062263+0000","last_clean_scrub_stamp":"2024-05-08T18:54:10.062263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:53.020523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"27'46","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:48.046782+0000","last_change":"2024-05-08T18:53:48.046823+0000","last_active":"2024-05-08T18:53:48.046782+0000","last_peered":"2024-05-08T18:53:48.046782+0000","last_clean":"2024-05-08T18:53:48.046782+0000","last_became_active":"2024-05-08T18:50:32.035189+0000","last_became_peered":"2024-05-08T18:50:32.035189+0000","last_unstale":"2024-05-08T18:53:48.046782+0000","last_undegraded":"2024-05-08T18:53:48.046782+0000","last_fullsized":"2024-05-08T18:53:48.046782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-05-08T18:53:48.046702+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-05-08T18:53:48.046702+0000","last_clean_scrub_stamp":"2024-05-08T18:53:48.046702+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:09.757527+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"27'285","reported_seq":366,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:54.987049+0000","last_change":"2024-05-08T18:53:54.987120+0000","last_active":"2024-05-08T18:53:54.987049+0000","last_peered":"2024-05-08T18:53:54.987049+0000","last_clean":"2024-05-08T18:53:54.987049+0000","last_became_active":"2024-05-08T18:50:34.047999+0000","last_became_peered":"2024-05-08T18:50:34.047999+0000","last_unstale":"2024-05-08T18:53:54.987049+0000","last_undegraded":"2024-05-08T18:53:54.987049+0000","last_fullsized":"2024-05-08T18:53:54.987049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:54.986938+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:54.986938+0000","last_clean_scrub_stamp":"2024-05-08T18:53:54.986938+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:56.968910+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.002583+0000","last_change":"2024-05-08T18:50:36.048278+0000","last_active":"2024-05-08T18:52:48.002583+0000","last_peered":"2024-05-08T18:52:48.002583+0000","last_clean":"2024-05-08T18:52:48.002583+0000","last_became_active":"2024-05-08T18:50:36.047981+0000","last_became_peered":"2024-05-08T18:50:36.047981+0000","last_unstale":"2024-05-08T18:52:48.002583+0000","last_undegraded":"2024-05-08T18:52:48.002583+0000","last_fullsized":"2024-05-08T18:52:48.002583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"27'8","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:10.920896+0000","last_change":"2024-05-08T18:54:10.920922+0000","last_active":"2024-05-08T18:54:10.920896+0000","last_peered":"2024-05-08T18:54:10.920896+0000","last_clean":"2024-05-08T18:54:10.920896+0000","last_became_active":"2024-05-08T18:50:28.020004+0000","last_became_peered":"2024-05-08T18:50:28.020004+0000","last_unstale":"2024-05-08T18:54:10.920896+0000","last_undegraded":"2024-05-08T18:54:10.920896+0000","last_fullsized":"2024-05-08T18:54:10.920896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:10.920810+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:10.920810+0000","last_clean_scrub_stamp":"2024-05-08T18:54:10.920810+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:32.631635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006811+0000","last_change":"2024-05-08T18:50:26.017413+0000","last_active":"2024-05-08T18:52:43.006811+0000","last_peered":"2024-05-08T18:52:43.006811+0000","last_clean":"2024-05-08T18:52:43.006811+0000","last_became_active":"2024-05-08T18:50:26.015955+0000","last_became_peered":"2024-05-08T18:50:26.015955+0000","last_unstale":"2024-05-08T18:52:43.006811+0000","last_undegraded":"2024-05-08T18:52:43.006811+0000","last_fullsized":"2024-05-08T18:52:43.006811+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:06.010157+0000","last_change":"2024-05-08T18:54:06.010199+0000","last_active":"2024-05-08T18:54:06.010157+0000","last_peered":"2024-05-08T18:54:06.010157+0000","last_clean":"2024-05-08T18:54:06.010157+0000","last_became_active":"2024-05-08T18:50:30.030140+0000","last_became_peered":"2024-05-08T18:50:30.030140+0000","last_unstale":"2024-05-08T18:54:06.010157+0000","last_undegraded":"2024-05-08T18:54:06.010157+0000","last_fullsized":"2024-05-08T18:54:06.010157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:06.010052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:06.010052+0000","last_clean_scrub_stamp":"2024-05-08T18:54:06.010052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:14.779273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"27'64","reported_seq":137,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:56.075355+0000","last_change":"2024-05-08T18:53:56.075427+0000","last_active":"2024-05-08T18:53:56.075355+0000","last_peered":"2024-05-08T18:53:56.075355+0000","last_clean":"2024-05-08T18:53:56.075355+0000","last_became_active":"2024-05-08T18:50:32.040633+0000","last_became_peered":"2024-05-08T18:50:32.040633+0000","last_unstale":"2024-05-08T18:53:56.075355+0000","last_undegraded":"2024-05-08T18:53:56.075355+0000","last_fullsized":"2024-05-08T18:53:56.075355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'64","last_scrub_stamp":"2024-05-08T18:53:56.075259+0000","last_deep_scrub":"27'64","last_deep_scrub_stamp":"2024-05-08T18:53:56.075259+0000","last_clean_scrub_stamp":"2024-05-08T18:53:56.075259+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:31.454654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:51.968283+0000","last_change":"2024-05-08T18:53:51.968305+0000","last_active":"2024-05-08T18:53:51.968283+0000","last_peered":"2024-05-08T18:53:51.968283+0000","last_clean":"2024-05-08T18:53:51.968283+0000","last_became_active":"2024-05-08T18:50:34.043817+0000","last_became_peered":"2024-05-08T18:50:34.043817+0000","last_unstale":"2024-05-08T18:53:51.968283+0000","last_undegraded":"2024-05-08T18:53:51.968283+0000","last_fullsized":"2024-05-08T18:53:51.968283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:51.968195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:51.968195+0000","last_clean_scrub_stamp":"2024-05-08T18:53:51.968195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:00.724814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"27'18","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.982121+0000","last_change":"2024-05-08T18:50:36.054529+0000","last_active":"2024-05-08T18:53:34.982121+0000","last_peered":"2024-05-08T18:53:34.982121+0000","last_clean":"2024-05-08T18:53:34.982121+0000","last_became_active":"2024-05-08T18:50:36.054237+0000","last_became_peered":"2024-05-08T18:50:36.054237+0000","last_unstale":"2024-05-08T18:53:34.982121+0000","last_undegraded":"2024-05-08T18:53:34.982121+0000","last_fullsized":"2024-05-08T18:53:34.982121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"27'10","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.868912+0000","last_change":"2024-05-08T18:51:15.097690+0000","last_active":"2024-05-08T18:53:34.868912+0000","last_peered":"2024-05-08T18:53:34.868912+0000","last_clean":"2024-05-08T18:53:34.868912+0000","last_became_active":"2024-05-08T18:51:15.085560+0000","last_became_peered":"2024-05-08T18:51:15.085560+0000","last_unstale":"2024-05-08T18:53:34.868912+0000","last_undegraded":"2024-05-08T18:53:34.868912+0000","last_fullsized":"2024-05-08T18:53:34.868912+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.001851+0000","last_change":"2024-05-08T18:51:15.080314+0000","last_active":"2024-05-08T18:52:43.001851+0000","last_peered":"2024-05-08T18:52:43.001851+0000","last_clean":"2024-05-08T18:52:43.001851+0000","last_became_active":"2024-05-08T18:51:15.080071+0000","last_became_peered":"2024-05-08T18:51:15.080071+0000","last_unstale":"2024-05-08T18:52:43.001851+0000","last_undegraded":"2024-05-08T18:52:43.001851+0000","last_fullsized":"2024-05-08T18:52:43.001851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:01.928027+0000","last_change":"2024-05-08T18:54:01.928071+0000","last_active":"2024-05-08T18:54:01.928027+0000","last_peered":"2024-05-08T18:54:01.928027+0000","last_clean":"2024-05-08T18:54:01.928027+0000","last_became_active":"2024-05-08T18:50:30.033318+0000","last_became_peered":"2024-05-08T18:50:30.033318+0000","last_unstale":"2024-05-08T18:54:01.928027+0000","last_undegraded":"2024-05-08T18:54:01.928027+0000","last_fullsized":"2024-05-08T18:54:01.928027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:01.927918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:01.927918+0000","last_clean_scrub_stamp":"2024-05-08T18:54:01.927918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:00.640748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"27'40","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.113280+0000","last_change":"2024-05-08T18:53:53.113321+0000","last_active":"2024-05-08T18:53:53.113280+0000","last_peered":"2024-05-08T18:53:53.113280+0000","last_clean":"2024-05-08T18:53:53.113280+0000","last_became_active":"2024-05-08T18:50:32.034914+0000","last_became_peered":"2024-05-08T18:50:32.034914+0000","last_unstale":"2024-05-08T18:53:53.113280+0000","last_undegraded":"2024-05-08T18:53:53.113280+0000","last_fullsized":"2024-05-08T18:53:53.113280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-05-08T18:53:53.113190+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-05-08T18:53:53.113190+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.113190+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:19.438913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:12.112019+0000","last_change":"2024-05-08T18:54:12.112046+0000","last_active":"2024-05-08T18:54:12.112019+0000","last_peered":"2024-05-08T18:54:12.112019+0000","last_clean":"2024-05-08T18:54:12.112019+0000","last_became_active":"2024-05-08T18:50:34.047075+0000","last_became_peered":"2024-05-08T18:50:34.047075+0000","last_unstale":"2024-05-08T18:54:12.112019+0000","last_undegraded":"2024-05-08T18:54:12.112019+0000","last_fullsized":"2024-05-08T18:54:12.112019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:12.111934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:12.111934+0000","last_clean_scrub_stamp":"2024-05-08T18:54:12.111934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.935955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.941970+0000","last_change":"2024-05-08T18:50:36.055688+0000","last_active":"2024-05-08T18:53:34.941970+0000","last_peered":"2024-05-08T18:53:34.941970+0000","last_clean":"2024-05-08T18:53:34.941970+0000","last_became_active":"2024-05-08T18:50:36.055385+0000","last_became_peered":"2024-05-08T18:50:36.055385+0000","last_unstale":"2024-05-08T18:53:34.941970+0000","last_undegraded":"2024-05-08T18:53:34.941970+0000","last_fullsized":"2024-05-08T18:53:34.941970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'4","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:01.045296+0000","last_change":"2024-05-08T18:54:01.045321+0000","last_active":"2024-05-08T18:54:01.045296+0000","last_peered":"2024-05-08T18:54:01.045296+0000","last_clean":"2024-05-08T18:54:01.045296+0000","last_became_active":"2024-05-08T18:50:28.038633+0000","last_became_peered":"2024-05-08T18:50:28.038633+0000","last_unstale":"2024-05-08T18:54:01.045296+0000","last_undegraded":"2024-05-08T18:54:01.045296+0000","last_fullsized":"2024-05-08T18:54:01.045296+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:01.045175+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:01.045175+0000","last_clean_scrub_stamp":"2024-05-08T18:54:01.045175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:30.675649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.006123+0000","last_change":"2024-05-08T18:50:26.016599+0000","last_active":"2024-05-08T18:52:38.006123+0000","last_peered":"2024-05-08T18:52:38.006123+0000","last_clean":"2024-05-08T18:52:38.006123+0000","last_became_active":"2024-05-08T18:50:26.016308+0000","last_became_peered":"2024-05-08T18:50:26.016308+0000","last_unstale":"2024-05-08T18:52:38.006123+0000","last_undegraded":"2024-05-08T18:52:38.006123+0000","last_fullsized":"2024-05-08T18:52:38.006123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:04.039180+0000","last_change":"2024-05-08T18:54:04.039242+0000","last_active":"2024-05-08T18:54:04.039180+0000","last_peered":"2024-05-08T18:54:04.039180+0000","last_clean":"2024-05-08T18:54:04.039180+0000","last_became_active":"2024-05-08T18:50:30.031765+0000","last_became_peered":"2024-05-08T18:50:30.031765+0000","last_unstale":"2024-05-08T18:54:04.039180+0000","last_undegraded":"2024-05-08T18:54:04.039180+0000","last_fullsized":"2024-05-08T18:54:04.039180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:04.039072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:04.039072+0000","last_clean_scrub_stamp":"2024-05-08T18:54:04.039072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:13.913375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"27'45","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.930724+0000","last_change":"2024-05-08T18:53:58.930760+0000","last_active":"2024-05-08T18:53:58.930724+0000","last_peered":"2024-05-08T18:53:58.930724+0000","last_clean":"2024-05-08T18:53:58.930724+0000","last_became_active":"2024-05-08T18:50:32.035131+0000","last_became_peered":"2024-05-08T18:50:32.035131+0000","last_unstale":"2024-05-08T18:53:58.930724+0000","last_undegraded":"2024-05-08T18:53:58.930724+0000","last_fullsized":"2024-05-08T18:53:58.930724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-05-08T18:53:58.930638+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-05-08T18:53:58.930638+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.930638+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:52.118381+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"27'285","reported_seq":442,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.946293+0000","last_change":"2024-05-08T18:53:45.946321+0000","last_active":"2024-05-08T18:53:45.946293+0000","last_peered":"2024-05-08T18:53:45.946293+0000","last_clean":"2024-05-08T18:53:45.946293+0000","last_became_active":"2024-05-08T18:50:34.047184+0000","last_became_peered":"2024-05-08T18:50:34.047184+0000","last_unstale":"2024-05-08T18:53:45.946293+0000","last_undegraded":"2024-05-08T18:53:45.946293+0000","last_fullsized":"2024-05-08T18:53:45.946293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:45.946195+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:45.946195+0000","last_clean_scrub_stamp":"2024-05-08T18:53:45.946195+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:08:51.238216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"27'13","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:07.061502+0000","last_change":"2024-05-08T18:54:07.061529+0000","last_active":"2024-05-08T18:54:07.061502+0000","last_peered":"2024-05-08T18:54:07.061502+0000","last_clean":"2024-05-08T18:54:07.061502+0000","last_became_active":"2024-05-08T18:50:36.046209+0000","last_became_peered":"2024-05-08T18:50:36.046209+0000","last_unstale":"2024-05-08T18:54:07.061502+0000","last_undegraded":"2024-05-08T18:54:07.061502+0000","last_fullsized":"2024-05-08T18:54:07.061502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-05-08T18:54:07.061418+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-05-08T18:54:07.061418+0000","last_clean_scrub_stamp":"2024-05-08T18:54:07.061418+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:19.023570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'6","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:08.865080+0000","last_change":"2024-05-08T18:54:08.865151+0000","last_active":"2024-05-08T18:54:08.865080+0000","last_peered":"2024-05-08T18:54:08.865080+0000","last_clean":"2024-05-08T18:54:08.865080+0000","last_became_active":"2024-05-08T18:50:28.036946+0000","last_became_peered":"2024-05-08T18:50:28.036946+0000","last_unstale":"2024-05-08T18:54:08.865080+0000","last_undegraded":"2024-05-08T18:54:08.865080+0000","last_fullsized":"2024-05-08T18:54:08.865080+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:08.864977+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:08.864977+0000","last_clean_scrub_stamp":"2024-05-08T18:54:08.864977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:16.323961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.006028+0000","last_change":"2024-05-08T18:50:26.027911+0000","last_active":"2024-05-08T18:52:38.006028+0000","last_peered":"2024-05-08T18:52:38.006028+0000","last_clean":"2024-05-08T18:52:38.006028+0000","last_became_active":"2024-05-08T18:50:26.027657+0000","last_became_peered":"2024-05-08T18:50:26.027657+0000","last_unstale":"2024-05-08T18:52:38.006028+0000","last_undegraded":"2024-05-08T18:52:38.006028+0000","last_fullsized":"2024-05-08T18:52:38.006028+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"27'5","reported_seq":428,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:02.003885+0000","last_change":"2024-05-08T18:54:02.003952+0000","last_active":"2024-05-08T18:54:02.003885+0000","last_peered":"2024-05-08T18:54:02.003885+0000","last_clean":"2024-05-08T18:54:02.003885+0000","last_became_active":"2024-05-08T18:50:30.027420+0000","last_became_peered":"2024-05-08T18:50:30.027420+0000","last_unstale":"2024-05-08T18:54:02.003885+0000","last_undegraded":"2024-05-08T18:54:02.003885+0000","last_fullsized":"2024-05-08T18:54:02.003885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-08T18:54:02.003784+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-08T18:54:02.003784+0000","last_clean_scrub_stamp":"2024-05-08T18:54:02.003784+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:09.462769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'16","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:00.007839+0000","last_change":"2024-05-08T18:54:00.007874+0000","last_active":"2024-05-08T18:54:00.007839+0000","last_peered":"2024-05-08T18:54:00.007839+0000","last_clean":"2024-05-08T18:54:00.007839+0000","last_became_active":"2024-05-08T18:50:32.040988+0000","last_became_peered":"2024-05-08T18:50:32.040988+0000","last_unstale":"2024-05-08T18:54:00.007839+0000","last_undegraded":"2024-05-08T18:54:00.007839+0000","last_fullsized":"2024-05-08T18:54:00.007839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-05-08T18:54:00.007737+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-05-08T18:54:00.007737+0000","last_clean_scrub_stamp":"2024-05-08T18:54:00.007737+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:07.927405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"27'285","reported_seq":471,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:46.055717+0000","last_change":"2024-05-08T18:53:46.055745+0000","last_active":"2024-05-08T18:53:46.055717+0000","last_peered":"2024-05-08T18:53:46.055717+0000","last_clean":"2024-05-08T18:53:46.055717+0000","last_became_active":"2024-05-08T18:50:34.040477+0000","last_became_peered":"2024-05-08T18:50:34.040477+0000","last_unstale":"2024-05-08T18:53:46.055717+0000","last_undegraded":"2024-05-08T18:53:46.055717+0000","last_fullsized":"2024-05-08T18:53:46.055717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:46.055625+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:46.055625+0000","last_clean_scrub_stamp":"2024-05-08T18:53:46.055625+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:55:05.788331+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:07.875615+0000","last_change":"2024-05-08T18:54:07.875651+0000","last_active":"2024-05-08T18:54:07.875615+0000","last_peered":"2024-05-08T18:54:07.875615+0000","last_clean":"2024-05-08T18:54:07.875615+0000","last_became_active":"2024-05-08T18:50:36.045976+0000","last_became_peered":"2024-05-08T18:50:36.045976+0000","last_unstale":"2024-05-08T18:54:07.875615+0000","last_undegraded":"2024-05-08T18:54:07.875615+0000","last_fullsized":"2024-05-08T18:54:07.875615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:07.875523+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:07.875523+0000","last_clean_scrub_stamp":"2024-05-08T18:54:07.875523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:03.721378+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"27'4","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:05.968925+0000","last_change":"2024-05-08T18:54:05.968970+0000","last_active":"2024-05-08T18:54:05.968925+0000","last_peered":"2024-05-08T18:54:05.968925+0000","last_clean":"2024-05-08T18:54:05.968925+0000","last_became_active":"2024-05-08T18:50:28.038871+0000","last_became_peered":"2024-05-08T18:50:28.038871+0000","last_unstale":"2024-05-08T18:54:05.968925+0000","last_undegraded":"2024-05-08T18:54:05.968925+0000","last_fullsized":"2024-05-08T18:54:05.968925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:05.968831+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:05.968831+0000","last_clean_scrub_stamp":"2024-05-08T18:54:05.968831+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:15.843134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.005947+0000","last_change":"2024-05-08T18:50:26.025766+0000","last_active":"2024-05-08T18:52:38.005947+0000","last_peered":"2024-05-08T18:52:38.005947+0000","last_clean":"2024-05-08T18:52:38.005947+0000","last_became_active":"2024-05-08T18:50:26.025547+0000","last_became_peered":"2024-05-08T18:50:26.025547+0000","last_unstale":"2024-05-08T18:52:38.005947+0000","last_undegraded":"2024-05-08T18:52:38.005947+0000","last_fullsized":"2024-05-08T18:52:38.005947+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:47.056975+0000","last_change":"2024-05-08T18:53:47.057018+0000","last_active":"2024-05-08T18:53:47.056975+0000","last_peered":"2024-05-08T18:53:47.056975+0000","last_clean":"2024-05-08T18:53:47.056975+0000","last_became_active":"2024-05-08T18:50:30.035734+0000","last_became_peered":"2024-05-08T18:50:30.035734+0000","last_unstale":"2024-05-08T18:53:47.056975+0000","last_undegraded":"2024-05-08T18:53:47.056975+0000","last_fullsized":"2024-05-08T18:53:47.056975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:47.056868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:47.056868+0000","last_clean_scrub_stamp":"2024-05-08T18:53:47.056868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:03:47.172253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"27'48","reported_seq":107,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:54.094025+0000","last_change":"2024-05-08T18:53:54.094067+0000","last_active":"2024-05-08T18:53:54.094025+0000","last_peered":"2024-05-08T18:53:54.094025+0000","last_clean":"2024-05-08T18:53:54.094025+0000","last_became_active":"2024-05-08T18:50:32.034769+0000","last_became_peered":"2024-05-08T18:50:32.034769+0000","last_unstale":"2024-05-08T18:53:54.094025+0000","last_undegraded":"2024-05-08T18:53:54.094025+0000","last_fullsized":"2024-05-08T18:53:54.094025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-05-08T18:53:54.093941+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-05-08T18:53:54.093941+0000","last_clean_scrub_stamp":"2024-05-08T18:53:54.093941+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:02.850561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:55.963122+0000","last_change":"2024-05-08T18:53:55.963149+0000","last_active":"2024-05-08T18:53:55.963122+0000","last_peered":"2024-05-08T18:53:55.963122+0000","last_clean":"2024-05-08T18:53:55.963122+0000","last_became_active":"2024-05-08T18:50:34.050018+0000","last_became_peered":"2024-05-08T18:50:34.050018+0000","last_unstale":"2024-05-08T18:53:55.963122+0000","last_undegraded":"2024-05-08T18:53:55.963122+0000","last_fullsized":"2024-05-08T18:53:55.963122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:55.963020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:55.963020+0000","last_clean_scrub_stamp":"2024-05-08T18:53:55.963020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:07.576169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:04.012396+0000","last_change":"2024-05-08T18:54:04.012454+0000","last_active":"2024-05-08T18:54:04.012396+0000","last_peered":"2024-05-08T18:54:04.012396+0000","last_clean":"2024-05-08T18:54:04.012396+0000","last_became_active":"2024-05-08T18:50:36.049274+0000","last_became_peered":"2024-05-08T18:50:36.049274+0000","last_unstale":"2024-05-08T18:54:04.012396+0000","last_undegraded":"2024-05-08T18:54:04.012396+0000","last_fullsized":"2024-05-08T18:54:04.012396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:04.012274+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:04.012274+0000","last_clean_scrub_stamp":"2024-05-08T18:54:04.012274+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:25.723099+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'8","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:05.082192+0000","last_change":"2024-05-08T18:54:05.082216+0000","last_active":"2024-05-08T18:54:05.082192+0000","last_peered":"2024-05-08T18:54:05.082192+0000","last_clean":"2024-05-08T18:54:05.082192+0000","last_became_active":"2024-05-08T18:50:28.037545+0000","last_became_peered":"2024-05-08T18:50:28.037545+0000","last_unstale":"2024-05-08T18:54:05.082192+0000","last_undegraded":"2024-05-08T18:54:05.082192+0000","last_fullsized":"2024-05-08T18:54:05.082192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:05.082102+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:05.082102+0000","last_clean_scrub_stamp":"2024-05-08T18:54:05.082102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:42.647531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":135,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:44.947478+0000","last_change":"2024-05-08T18:50:19.740594+0000","last_active":"2024-05-08T18:53:44.947478+0000","last_peered":"2024-05-08T18:53:44.947478+0000","last_clean":"2024-05-08T18:53:44.947478+0000","last_became_active":"2024-05-08T18:50:19.739986+0000","last_became_peered":"2024-05-08T18:50:19.739986+0000","last_unstale":"2024-05-08T18:53:44.947478+0000","last_undegraded":"2024-05-08T18:53:44.947478+0000","last_fullsized":"2024-05-08T18:53:44.947478+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:28.004563+0000","last_change":"2024-05-08T18:50:19.740266+0000","last_active":"2024-05-08T18:52:28.004563+0000","last_peered":"2024-05-08T18:52:28.004563+0000","last_clean":"2024-05-08T18:52:28.004563+0000","last_became_active":"2024-05-08T18:50:19.739403+0000","last_became_peered":"2024-05-08T18:50:19.739403+0000","last_unstale":"2024-05-08T18:52:28.004563+0000","last_undegraded":"2024-05-08T18:52:28.004563+0000","last_fullsized":"2024-05-08T18:52:28.004563+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.005279+0000","last_change":"2024-05-08T18:50:26.026328+0000","last_active":"2024-05-08T18:52:33.005279+0000","last_peered":"2024-05-08T18:52:33.005279+0000","last_clean":"2024-05-08T18:52:33.005279+0000","last_became_active":"2024-05-08T18:50:26.024249+0000","last_became_peered":"2024-05-08T18:50:26.024249+0000","last_unstale":"2024-05-08T18:52:33.005279+0000","last_undegraded":"2024-05-08T18:52:33.005279+0000","last_fullsized":"2024-05-08T18:52:33.005279+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:57.039174+0000","last_change":"2024-05-08T18:53:57.039225+0000","last_active":"2024-05-08T18:53:57.039174+0000","last_peered":"2024-05-08T18:53:57.039174+0000","last_clean":"2024-05-08T18:53:57.039174+0000","last_became_active":"2024-05-08T18:50:30.029744+0000","last_became_peered":"2024-05-08T18:50:30.029744+0000","last_unstale":"2024-05-08T18:53:57.039174+0000","last_undegraded":"2024-05-08T18:53:57.039174+0000","last_fullsized":"2024-05-08T18:53:57.039174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:57.039062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:57.039062+0000","last_clean_scrub_stamp":"2024-05-08T18:53:57.039062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:59.021034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"27'87","reported_seq":177,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:11.115120+0000","last_change":"2024-05-08T18:54:11.115165+0000","last_active":"2024-05-08T18:54:11.115120+0000","last_peered":"2024-05-08T18:54:11.115120+0000","last_clean":"2024-05-08T18:54:11.115120+0000","last_became_active":"2024-05-08T18:50:32.043533+0000","last_became_peered":"2024-05-08T18:50:32.043533+0000","last_unstale":"2024-05-08T18:54:11.115120+0000","last_undegraded":"2024-05-08T18:54:11.115120+0000","last_fullsized":"2024-05-08T18:54:11.115120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'87","last_scrub_stamp":"2024-05-08T18:54:11.115039+0000","last_deep_scrub":"27'87","last_deep_scrub_stamp":"2024-05-08T18:54:11.115039+0000","last_clean_scrub_stamp":"2024-05-08T18:54:11.115039+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:20.191974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.995645+0000","last_change":"2024-05-08T18:53:58.995677+0000","last_active":"2024-05-08T18:53:58.995645+0000","last_peered":"2024-05-08T18:53:58.995645+0000","last_clean":"2024-05-08T18:53:58.995645+0000","last_became_active":"2024-05-08T18:50:34.048859+0000","last_became_peered":"2024-05-08T18:50:34.048859+0000","last_unstale":"2024-05-08T18:53:58.995645+0000","last_undegraded":"2024-05-08T18:53:58.995645+0000","last_fullsized":"2024-05-08T18:53:58.995645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:58.995550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:58.995550+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.995550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:54.841405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"27'81","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:03.892281+0000","last_change":"2024-05-08T18:54:03.892330+0000","last_active":"2024-05-08T18:54:03.892281+0000","last_peered":"2024-05-08T18:54:03.892281+0000","last_clean":"2024-05-08T18:54:03.892281+0000","last_became_active":"2024-05-08T18:50:36.044928+0000","last_became_peered":"2024-05-08T18:50:36.044928+0000","last_unstale":"2024-05-08T18:54:03.892281+0000","last_undegraded":"2024-05-08T18:54:03.892281+0000","last_fullsized":"2024-05-08T18:54:03.892281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'81","last_scrub_stamp":"2024-05-08T18:54:03.892165+0000","last_deep_scrub":"27'81","last_deep_scrub_stamp":"2024-05-08T18:54:03.892165+0000","last_clean_scrub_stamp":"2024-05-08T18:54:03.892165+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:34:05.874137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"27'4","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.006202+0000","last_change":"2024-05-08T18:50:28.032137+0000","last_active":"2024-05-08T18:52:38.006202+0000","last_peered":"2024-05-08T18:52:38.006202+0000","last_clean":"2024-05-08T18:52:38.006202+0000","last_became_active":"2024-05-08T18:50:28.030761+0000","last_became_peered":"2024-05-08T18:50:28.030761+0000","last_unstale":"2024-05-08T18:52:38.006202+0000","last_undegraded":"2024-05-08T18:52:38.006202+0000","last_fullsized":"2024-05-08T18:52:38.006202+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.862002+0000","last_change":"2024-05-08T18:50:19.739194+0000","last_active":"2024-05-08T18:53:45.862002+0000","last_peered":"2024-05-08T18:53:45.862002+0000","last_clean":"2024-05-08T18:53:45.862002+0000","last_became_active":"2024-05-08T18:50:19.738872+0000","last_became_peered":"2024-05-08T18:50:19.738872+0000","last_unstale":"2024-05-08T18:53:45.862002+0000","last_undegraded":"2024-05-08T18:53:45.862002+0000","last_fullsized":"2024-05-08T18:53:45.862002+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.000385+0000","last_change":"2024-05-08T18:50:26.024886+0000","last_active":"2024-05-08T18:52:33.000385+0000","last_peered":"2024-05-08T18:52:33.000385+0000","last_clean":"2024-05-08T18:52:33.000385+0000","last_became_active":"2024-05-08T18:50:26.024549+0000","last_became_peered":"2024-05-08T18:50:26.024549+0000","last_unstale":"2024-05-08T18:52:33.000385+0000","last_undegraded":"2024-05-08T18:52:33.000385+0000","last_fullsized":"2024-05-08T18:52:33.000385+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006928+0000","last_change":"2024-05-08T18:51:15.084930+0000","last_active":"2024-05-08T18:52:43.006928+0000","last_peered":"2024-05-08T18:52:43.006928+0000","last_clean":"2024-05-08T18:52:43.006928+0000","last_became_active":"2024-05-08T18:51:15.084599+0000","last_became_peered":"2024-05-08T18:51:15.084599+0000","last_unstale":"2024-05-08T18:52:43.006928+0000","last_undegraded":"2024-05-08T18:52:43.006928+0000","last_fullsized":"2024-05-08T18:52:43.006928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"27'290","reported_seq":515,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:47.103005+0000","last_change":"2024-05-08T18:53:47.103048+0000","last_active":"2024-05-08T18:53:47.103005+0000","last_peered":"2024-05-08T18:53:47.103005+0000","last_clean":"2024-05-08T18:53:47.103005+0000","last_became_active":"2024-05-08T18:50:32.044539+0000","last_became_peered":"2024-05-08T18:50:32.044539+0000","last_unstale":"2024-05-08T18:53:47.103005+0000","last_undegraded":"2024-05-08T18:53:47.103005+0000","last_fullsized":"2024-05-08T18:53:47.103005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'290","last_scrub_stamp":"2024-05-08T18:53:47.102914+0000","last_deep_scrub":"27'290","last_deep_scrub_stamp":"2024-05-08T18:53:47.102914+0000","last_clean_scrub_stamp":"2024-05-08T18:53:47.102914+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:52.308821+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:07.076576+0000","last_change":"2024-05-08T18:54:07.076608+0000","last_active":"2024-05-08T18:54:07.076576+0000","last_peered":"2024-05-08T18:54:07.076576+0000","last_clean":"2024-05-08T18:54:07.076576+0000","last_became_active":"2024-05-08T18:50:34.043966+0000","last_became_peered":"2024-05-08T18:50:34.043966+0000","last_unstale":"2024-05-08T18:54:07.076576+0000","last_undegraded":"2024-05-08T18:54:07.076576+0000","last_fullsized":"2024-05-08T18:54:07.076576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:07.076486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:07.076486+0000","last_clean_scrub_stamp":"2024-05-08T18:54:07.076486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:33.765444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:07.937006+0000","last_change":"2024-05-08T18:54:07.937032+0000","last_active":"2024-05-08T18:54:07.937006+0000","last_peered":"2024-05-08T18:54:07.937006+0000","last_clean":"2024-05-08T18:54:07.937006+0000","last_became_active":"2024-05-08T18:50:36.050573+0000","last_became_peered":"2024-05-08T18:50:36.050573+0000","last_unstale":"2024-05-08T18:54:07.937006+0000","last_undegraded":"2024-05-08T18:54:07.937006+0000","last_fullsized":"2024-05-08T18:54:07.937006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-08T18:54:07.936918+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-08T18:54:07.936918+0000","last_clean_scrub_stamp":"2024-05-08T18:54:07.936918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:16.706139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'4","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:16.165482+0000","last_change":"2024-05-08T18:54:16.165554+0000","last_active":"2024-05-08T18:54:16.165482+0000","last_peered":"2024-05-08T18:54:16.165482+0000","last_clean":"2024-05-08T18:54:16.165482+0000","last_became_active":"2024-05-08T18:50:28.027492+0000","last_became_peered":"2024-05-08T18:50:28.027492+0000","last_unstale":"2024-05-08T18:54:16.165482+0000","last_undegraded":"2024-05-08T18:54:16.165482+0000","last_fullsized":"2024-05-08T18:54:16.165482+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:16.165359+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:16.165359+0000","last_clean_scrub_stamp":"2024-05-08T18:54:16.165359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:48.442797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:23.003120+0000","last_change":"2024-05-08T18:50:19.739149+0000","last_active":"2024-05-08T18:52:23.003120+0000","last_peered":"2024-05-08T18:52:23.003120+0000","last_clean":"2024-05-08T18:52:23.003120+0000","last_became_active":"2024-05-08T18:50:19.738788+0000","last_became_peered":"2024-05-08T18:50:19.738788+0000","last_unstale":"2024-05-08T18:52:23.003120+0000","last_undegraded":"2024-05-08T18:52:23.003120+0000","last_fullsized":"2024-05-08T18:52:23.003120+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'4","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:20.096946+0000","last_change":"2024-05-08T18:54:20.096976+0000","last_active":"2024-05-08T18:54:20.096946+0000","last_peered":"2024-05-08T18:54:20.096946+0000","last_clean":"2024-05-08T18:54:20.096946+0000","last_became_active":"2024-05-08T18:50:26.029197+0000","last_became_peered":"2024-05-08T18:50:26.029197+0000","last_unstale":"2024-05-08T18:54:20.096946+0000","last_undegraded":"2024-05-08T18:54:20.096946+0000","last_fullsized":"2024-05-08T18:54:20.096946+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-08T18:54:20.096851+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-08T18:54:20.096851+0000","last_clean_scrub_stamp":"2024-05-08T18:54:20.096851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:32.841665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:04.894236+0000","last_change":"2024-05-08T18:54:04.894272+0000","last_active":"2024-05-08T18:54:04.894236+0000","last_peered":"2024-05-08T18:54:04.894236+0000","last_clean":"2024-05-08T18:54:04.894236+0000","last_became_active":"2024-05-08T18:50:30.028028+0000","last_became_peered":"2024-05-08T18:50:30.028028+0000","last_unstale":"2024-05-08T18:54:04.894236+0000","last_undegraded":"2024-05-08T18:54:04.894236+0000","last_fullsized":"2024-05-08T18:54:04.894236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:04.894146+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:04.894146+0000","last_clean_scrub_stamp":"2024-05-08T18:54:04.894146+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:10.950542+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"27'23","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:56.984057+0000","last_change":"2024-05-08T18:53:56.984125+0000","last_active":"2024-05-08T18:53:56.984057+0000","last_peered":"2024-05-08T18:53:56.984057+0000","last_clean":"2024-05-08T18:53:56.984057+0000","last_became_active":"2024-05-08T18:50:32.036051+0000","last_became_peered":"2024-05-08T18:50:32.036051+0000","last_unstale":"2024-05-08T18:53:56.984057+0000","last_undegraded":"2024-05-08T18:53:56.984057+0000","last_fullsized":"2024-05-08T18:53:56.984057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-05-08T18:53:56.983946+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-05-08T18:53:56.983946+0000","last_clean_scrub_stamp":"2024-05-08T18:53:56.983946+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:47.425987+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.955595+0000","last_change":"2024-05-08T18:53:45.955616+0000","last_active":"2024-05-08T18:53:45.955595+0000","last_peered":"2024-05-08T18:53:45.955595+0000","last_clean":"2024-05-08T18:53:45.955595+0000","last_became_active":"2024-05-08T18:50:34.045541+0000","last_became_peered":"2024-05-08T18:50:34.045541+0000","last_unstale":"2024-05-08T18:53:45.955595+0000","last_undegraded":"2024-05-08T18:53:45.955595+0000","last_fullsized":"2024-05-08T18:53:45.955595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:45.955524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:45.955524+0000","last_clean_scrub_stamp":"2024-05-08T18:53:45.955524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:07.055678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.008500+0000","last_change":"2024-05-08T18:50:36.058086+0000","last_active":"2024-05-08T18:52:53.008500+0000","last_peered":"2024-05-08T18:52:53.008500+0000","last_clean":"2024-05-08T18:52:53.008500+0000","last_became_active":"2024-05-08T18:50:36.057093+0000","last_became_peered":"2024-05-08T18:50:36.057093+0000","last_unstale":"2024-05-08T18:52:53.008500+0000","last_undegraded":"2024-05-08T18:52:53.008500+0000","last_fullsized":"2024-05-08T18:52:53.008500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'22","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.894606+0000","last_change":"2024-05-08T18:50:28.026195+0000","last_active":"2024-05-08T18:53:34.894606+0000","last_peered":"2024-05-08T18:53:34.894606+0000","last_clean":"2024-05-08T18:53:34.894606+0000","last_became_active":"2024-05-08T18:50:28.025645+0000","last_became_peered":"2024-05-08T18:50:28.025645+0000","last_unstale":"2024-05-08T18:53:34.894606+0000","last_undegraded":"2024-05-08T18:53:34.894606+0000","last_fullsized":"2024-05-08T18:53:34.894606+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:23.003873+0000","last_change":"2024-05-08T18:50:19.739898+0000","last_active":"2024-05-08T18:52:23.003873+0000","last_peered":"2024-05-08T18:52:23.003873+0000","last_clean":"2024-05-08T18:52:23.003873+0000","last_became_active":"2024-05-08T18:50:19.739620+0000","last_became_peered":"2024-05-08T18:50:19.739620+0000","last_unstale":"2024-05-08T18:52:23.003873+0000","last_undegraded":"2024-05-08T18:52:23.003873+0000","last_fullsized":"2024-05-08T18:52:23.003873+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.004566+0000","last_change":"2024-05-08T18:50:26.023831+0000","last_active":"2024-05-08T18:52:33.004566+0000","last_peered":"2024-05-08T18:52:33.004566+0000","last_clean":"2024-05-08T18:52:33.004566+0000","last_became_active":"2024-05-08T18:50:26.023522+0000","last_became_peered":"2024-05-08T18:50:26.023522+0000","last_unstale":"2024-05-08T18:52:33.004566+0000","last_undegraded":"2024-05-08T18:52:33.004566+0000","last_fullsized":"2024-05-08T18:52:33.004566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:02.050033+0000","last_change":"2024-05-08T18:54:02.050063+0000","last_active":"2024-05-08T18:54:02.050033+0000","last_peered":"2024-05-08T18:54:02.050033+0000","last_clean":"2024-05-08T18:54:02.050033+0000","last_became_active":"2024-05-08T18:50:30.034806+0000","last_became_peered":"2024-05-08T18:50:30.034806+0000","last_unstale":"2024-05-08T18:54:02.050033+0000","last_undegraded":"2024-05-08T18:54:02.050033+0000","last_fullsized":"2024-05-08T18:54:02.050033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:02.049920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:02.049920+0000","last_clean_scrub_stamp":"2024-05-08T18:54:02.049920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:23.760745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"27'20","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:14.125997+0000","last_change":"2024-05-08T18:54:14.126033+0000","last_active":"2024-05-08T18:54:14.125997+0000","last_peered":"2024-05-08T18:54:14.125997+0000","last_clean":"2024-05-08T18:54:14.125997+0000","last_became_active":"2024-05-08T18:50:32.042183+0000","last_became_peered":"2024-05-08T18:50:32.042183+0000","last_unstale":"2024-05-08T18:54:14.125997+0000","last_undegraded":"2024-05-08T18:54:14.125997+0000","last_fullsized":"2024-05-08T18:54:14.125997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-05-08T18:54:14.125910+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-05-08T18:54:14.125910+0000","last_clean_scrub_stamp":"2024-05-08T18:54:14.125910+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:13.974588+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:08.066453+0000","last_change":"2024-05-08T18:54:08.066476+0000","last_active":"2024-05-08T18:54:08.066453+0000","last_peered":"2024-05-08T18:54:08.066453+0000","last_clean":"2024-05-08T18:54:08.066453+0000","last_became_active":"2024-05-08T18:50:34.044358+0000","last_became_peered":"2024-05-08T18:50:34.044358+0000","last_unstale":"2024-05-08T18:54:08.066453+0000","last_undegraded":"2024-05-08T18:54:08.066453+0000","last_fullsized":"2024-05-08T18:54:08.066453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:08.066352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:08.066352+0000","last_clean_scrub_stamp":"2024-05-08T18:54:08.066352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:30:11.214559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007178+0000","last_change":"2024-05-08T18:50:36.058516+0000","last_active":"2024-05-08T18:52:48.007178+0000","last_peered":"2024-05-08T18:52:48.007178+0000","last_clean":"2024-05-08T18:52:48.007178+0000","last_became_active":"2024-05-08T18:50:36.058267+0000","last_became_peered":"2024-05-08T18:50:36.058267+0000","last_unstale":"2024-05-08T18:52:48.007178+0000","last_undegraded":"2024-05-08T18:52:48.007178+0000","last_fullsized":"2024-05-08T18:52:48.007178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'12","reported_seq":80,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:06.982212+0000","last_change":"2024-05-08T18:54:06.982247+0000","last_active":"2024-05-08T18:54:06.982212+0000","last_peered":"2024-05-08T18:54:06.982212+0000","last_clean":"2024-05-08T18:54:06.982212+0000","last_became_active":"2024-05-08T18:50:28.038935+0000","last_became_peered":"2024-05-08T18:50:28.038935+0000","last_unstale":"2024-05-08T18:54:06.982212+0000","last_undegraded":"2024-05-08T18:54:06.982212+0000","last_fullsized":"2024-05-08T18:54:06.982212+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-08T18:54:06.982117+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-08T18:54:06.982117+0000","last_clean_scrub_stamp":"2024-05-08T18:54:06.982117+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:58.509084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.004624+0000","last_change":"2024-05-08T18:50:26.019026+0000","last_active":"2024-05-08T18:52:33.004624+0000","last_peered":"2024-05-08T18:52:33.004624+0000","last_clean":"2024-05-08T18:52:33.004624+0000","last_became_active":"2024-05-08T18:50:26.018739+0000","last_became_peered":"2024-05-08T18:50:26.018739+0000","last_unstale":"2024-05-08T18:52:33.004624+0000","last_undegraded":"2024-05-08T18:52:33.004624+0000","last_fullsized":"2024-05-08T18:52:33.004624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:27.999742+0000","last_change":"2024-05-08T18:50:19.741144+0000","last_active":"2024-05-08T18:52:27.999742+0000","last_peered":"2024-05-08T18:52:27.999742+0000","last_clean":"2024-05-08T18:52:27.999742+0000","last_became_active":"2024-05-08T18:50:19.740835+0000","last_became_peered":"2024-05-08T18:50:19.740835+0000","last_unstale":"2024-05-08T18:52:27.999742+0000","last_undegraded":"2024-05-08T18:52:27.999742+0000","last_fullsized":"2024-05-08T18:52:27.999742+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"27'1","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.410946+0000","last_change":"2024-05-08T18:51:15.083500+0000","last_active":"2024-05-08T18:53:41.410946+0000","last_peered":"2024-05-08T18:53:41.410946+0000","last_clean":"2024-05-08T18:53:41.410946+0000","last_became_active":"2024-05-08T18:51:15.083141+0000","last_became_peered":"2024-05-08T18:51:15.083141+0000","last_unstale":"2024-05-08T18:53:41.410946+0000","last_undegraded":"2024-05-08T18:53:41.410946+0000","last_fullsized":"2024-05-08T18:53:41.410946+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"27'73","reported_seq":149,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.986154+0000","last_change":"2024-05-08T18:53:53.986211+0000","last_active":"2024-05-08T18:53:53.986154+0000","last_peered":"2024-05-08T18:53:53.986154+0000","last_clean":"2024-05-08T18:53:53.986154+0000","last_became_active":"2024-05-08T18:50:32.042046+0000","last_became_peered":"2024-05-08T18:50:32.042046+0000","last_unstale":"2024-05-08T18:53:53.986154+0000","last_undegraded":"2024-05-08T18:53:53.986154+0000","last_fullsized":"2024-05-08T18:53:53.986154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'73","last_scrub_stamp":"2024-05-08T18:53:53.986057+0000","last_deep_scrub":"27'73","last_deep_scrub_stamp":"2024-05-08T18:53:53.986057+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.986057+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:48:15.967078+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:48.999108+0000","last_change":"2024-05-08T18:53:48.999132+0000","last_active":"2024-05-08T18:53:48.999108+0000","last_peered":"2024-05-08T18:53:48.999108+0000","last_clean":"2024-05-08T18:53:48.999108+0000","last_became_active":"2024-05-08T18:50:34.044520+0000","last_became_peered":"2024-05-08T18:50:34.044520+0000","last_unstale":"2024-05-08T18:53:48.999108+0000","last_undegraded":"2024-05-08T18:53:48.999108+0000","last_fullsized":"2024-05-08T18:53:48.999108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:48.999007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:48.999007+0000","last_clean_scrub_stamp":"2024-05-08T18:53:48.999007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:21.742255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"27'9","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:11.060309+0000","last_change":"2024-05-08T18:54:11.060343+0000","last_active":"2024-05-08T18:54:11.060309+0000","last_peered":"2024-05-08T18:54:11.060309+0000","last_clean":"2024-05-08T18:54:11.060309+0000","last_became_active":"2024-05-08T18:50:36.046757+0000","last_became_peered":"2024-05-08T18:50:36.046757+0000","last_unstale":"2024-05-08T18:54:11.060309+0000","last_undegraded":"2024-05-08T18:54:11.060309+0000","last_fullsized":"2024-05-08T18:54:11.060309+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-08T18:54:11.060217+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-08T18:54:11.060217+0000","last_clean_scrub_stamp":"2024-05-08T18:54:11.060217+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:57:58.583230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.829837+0000","last_change":"2024-05-08T18:51:15.095543+0000","last_active":"2024-05-08T18:53:34.829837+0000","last_peered":"2024-05-08T18:53:34.829837+0000","last_clean":"2024-05-08T18:53:34.829837+0000","last_became_active":"2024-05-08T18:51:15.084151+0000","last_became_peered":"2024-05-08T18:51:15.084151+0000","last_unstale":"2024-05-08T18:53:34.829837+0000","last_undegraded":"2024-05-08T18:53:34.829837+0000","last_fullsized":"2024-05-08T18:53:34.829837+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.000437+0000","last_change":"2024-05-08T18:50:26.025460+0000","last_active":"2024-05-08T18:52:33.000437+0000","last_peered":"2024-05-08T18:52:33.000437+0000","last_clean":"2024-05-08T18:52:33.000437+0000","last_became_active":"2024-05-08T18:50:26.024894+0000","last_became_peered":"2024-05-08T18:50:26.024894+0000","last_unstale":"2024-05-08T18:52:33.000437+0000","last_undegraded":"2024-05-08T18:52:33.000437+0000","last_fullsized":"2024-05-08T18:52:33.000437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:28.004618+0000","last_change":"2024-05-08T18:50:19.739473+0000","last_active":"2024-05-08T18:52:28.004618+0000","last_peered":"2024-05-08T18:52:28.004618+0000","last_clean":"2024-05-08T18:52:28.004618+0000","last_became_active":"2024-05-08T18:50:19.739124+0000","last_became_peered":"2024-05-08T18:50:19.739124+0000","last_unstale":"2024-05-08T18:52:28.004618+0000","last_undegraded":"2024-05-08T18:52:28.004618+0000","last_fullsized":"2024-05-08T18:52:28.004618+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:54.073521+0000","last_change":"2024-05-08T18:53:54.073547+0000","last_active":"2024-05-08T18:53:54.073521+0000","last_peered":"2024-05-08T18:53:54.073521+0000","last_clean":"2024-05-08T18:53:54.073521+0000","last_became_active":"2024-05-08T18:50:30.032546+0000","last_became_peered":"2024-05-08T18:50:30.032546+0000","last_unstale":"2024-05-08T18:53:54.073521+0000","last_undegraded":"2024-05-08T18:53:54.073521+0000","last_fullsized":"2024-05-08T18:53:54.073521+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:54.073430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:54.073430+0000","last_clean_scrub_stamp":"2024-05-08T18:53:54.073430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:08.017553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"27'21","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:49.087843+0000","last_change":"2024-05-08T18:53:49.087885+0000","last_active":"2024-05-08T18:53:49.087843+0000","last_peered":"2024-05-08T18:53:49.087843+0000","last_clean":"2024-05-08T18:53:49.087843+0000","last_became_active":"2024-05-08T18:50:32.040767+0000","last_became_peered":"2024-05-08T18:50:32.040767+0000","last_unstale":"2024-05-08T18:53:49.087843+0000","last_undegraded":"2024-05-08T18:53:49.087843+0000","last_fullsized":"2024-05-08T18:53:49.087843+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-05-08T18:53:49.087754+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-05-08T18:53:49.087754+0000","last_clean_scrub_stamp":"2024-05-08T18:53:49.087754+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:00.700903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"27'285","reported_seq":386,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:48.068476+0000","last_change":"2024-05-08T18:53:48.068502+0000","last_active":"2024-05-08T18:53:48.068476+0000","last_peered":"2024-05-08T18:53:48.068476+0000","last_clean":"2024-05-08T18:53:48.068476+0000","last_became_active":"2024-05-08T18:50:34.043167+0000","last_became_peered":"2024-05-08T18:50:34.043167+0000","last_unstale":"2024-05-08T18:53:48.068476+0000","last_undegraded":"2024-05-08T18:53:48.068476+0000","last_fullsized":"2024-05-08T18:53:48.068476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:48.068390+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:48.068390+0000","last_clean_scrub_stamp":"2024-05-08T18:53:48.068390+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:09.168544+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.891908+0000","last_change":"2024-05-08T18:50:36.061014+0000","last_active":"2024-05-08T18:53:34.891908+0000","last_peered":"2024-05-08T18:53:34.891908+0000","last_clean":"2024-05-08T18:53:34.891908+0000","last_became_active":"2024-05-08T18:50:36.060727+0000","last_became_peered":"2024-05-08T18:50:36.060727+0000","last_unstale":"2024-05-08T18:53:34.891908+0000","last_undegraded":"2024-05-08T18:53:34.891908+0000","last_fullsized":"2024-05-08T18:53:34.891908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"27'22","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.696570+0000","last_change":"2024-05-08T18:51:15.092701+0000","last_active":"2024-05-08T18:53:34.696570+0000","last_peered":"2024-05-08T18:53:34.696570+0000","last_clean":"2024-05-08T18:53:34.696570+0000","last_became_active":"2024-05-08T18:51:15.083568+0000","last_became_peered":"2024-05-08T18:51:15.083568+0000","last_unstale":"2024-05-08T18:53:34.696570+0000","last_undegraded":"2024-05-08T18:53:34.696570+0000","last_fullsized":"2024-05-08T18:53:34.696570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":68,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.885575+0000","last_change":"2024-05-08T18:50:26.016666+0000","last_active":"2024-05-08T18:53:34.885575+0000","last_peered":"2024-05-08T18:53:34.885575+0000","last_clean":"2024-05-08T18:53:34.885575+0000","last_became_active":"2024-05-08T18:50:26.016210+0000","last_became_peered":"2024-05-08T18:50:26.016210+0000","last_unstale":"2024-05-08T18:53:34.885575+0000","last_undegraded":"2024-05-08T18:53:34.885575+0000","last_fullsized":"2024-05-08T18:53:34.885575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:27.999781+0000","last_change":"2024-05-08T18:50:19.740832+0000","last_active":"2024-05-08T18:52:27.999781+0000","last_peered":"2024-05-08T18:52:27.999781+0000","last_clean":"2024-05-08T18:52:27.999781+0000","last_became_active":"2024-05-08T18:50:19.740355+0000","last_became_peered":"2024-05-08T18:50:19.740355+0000","last_unstale":"2024-05-08T18:52:27.999781+0000","last_undegraded":"2024-05-08T18:52:27.999781+0000","last_fullsized":"2024-05-08T18:52:27.999781+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.055027+0000","last_change":"2024-05-08T18:53:53.055060+0000","last_active":"2024-05-08T18:53:53.055027+0000","last_peered":"2024-05-08T18:53:53.055027+0000","last_clean":"2024-05-08T18:53:53.055027+0000","last_became_active":"2024-05-08T18:50:30.031351+0000","last_became_peered":"2024-05-08T18:50:30.031351+0000","last_unstale":"2024-05-08T18:53:53.055027+0000","last_undegraded":"2024-05-08T18:53:53.055027+0000","last_fullsized":"2024-05-08T18:53:53.055027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:53.054930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:53.054930+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.054930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:23.805172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'15","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:15.083789+0000","last_change":"2024-05-08T18:54:15.083821+0000","last_active":"2024-05-08T18:54:15.083789+0000","last_peered":"2024-05-08T18:54:15.083789+0000","last_clean":"2024-05-08T18:54:15.083789+0000","last_became_active":"2024-05-08T18:50:32.041231+0000","last_became_peered":"2024-05-08T18:50:32.041231+0000","last_unstale":"2024-05-08T18:54:15.083789+0000","last_undegraded":"2024-05-08T18:54:15.083789+0000","last_fullsized":"2024-05-08T18:54:15.083789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-08T18:54:15.083708+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-08T18:54:15.083708+0000","last_clean_scrub_stamp":"2024-05-08T18:54:15.083708+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:23.385394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"27'285","reported_seq":401,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:50.993021+0000","last_change":"2024-05-08T18:53:50.993052+0000","last_active":"2024-05-08T18:53:50.993021+0000","last_peered":"2024-05-08T18:53:50.993021+0000","last_clean":"2024-05-08T18:53:50.993021+0000","last_became_active":"2024-05-08T18:50:34.047608+0000","last_became_peered":"2024-05-08T18:50:34.047608+0000","last_unstale":"2024-05-08T18:53:50.993021+0000","last_undegraded":"2024-05-08T18:53:50.993021+0000","last_fullsized":"2024-05-08T18:53:50.993021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:50.992925+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:50.992925+0000","last_clean_scrub_stamp":"2024-05-08T18:53:50.992925+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:17.318647+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"25'5","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.008019+0000","last_change":"2024-05-08T18:50:36.055086+0000","last_active":"2024-05-08T18:52:53.008019+0000","last_peered":"2024-05-08T18:52:53.008019+0000","last_clean":"2024-05-08T18:52:53.008019+0000","last_became_active":"2024-05-08T18:50:36.054747+0000","last_became_peered":"2024-05-08T18:50:36.054747+0000","last_unstale":"2024-05-08T18:52:53.008019+0000","last_undegraded":"2024-05-08T18:52:53.008019+0000","last_fullsized":"2024-05-08T18:52:53.008019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:21.941812+0000","last_change":"2024-05-08T18:54:21.941842+0000","last_active":"2024-05-08T18:54:21.941812+0000","last_peered":"2024-05-08T18:54:21.941812+0000","last_clean":"2024-05-08T18:54:21.941812+0000","last_became_active":"2024-05-08T18:50:28.033163+0000","last_became_peered":"2024-05-08T18:50:28.033163+0000","last_unstale":"2024-05-08T18:54:21.941812+0000","last_undegraded":"2024-05-08T18:54:21.941812+0000","last_fullsized":"2024-05-08T18:54:21.941812+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:21.941726+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:21.941726+0000","last_clean_scrub_stamp":"2024-05-08T18:54:21.941726+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:33.131935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.005694+0000","last_change":"2024-05-08T18:50:26.027003+0000","last_active":"2024-05-08T18:52:38.005694+0000","last_peered":"2024-05-08T18:52:38.005694+0000","last_clean":"2024-05-08T18:52:38.005694+0000","last_became_active":"2024-05-08T18:50:26.026719+0000","last_became_peered":"2024-05-08T18:50:26.026719+0000","last_unstale":"2024-05-08T18:52:38.005694+0000","last_undegraded":"2024-05-08T18:52:38.005694+0000","last_fullsized":"2024-05-08T18:52:38.005694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:28.004669+0000","last_change":"2024-05-08T18:50:19.739345+0000","last_active":"2024-05-08T18:52:28.004669+0000","last_peered":"2024-05-08T18:52:28.004669+0000","last_clean":"2024-05-08T18:52:28.004669+0000","last_became_active":"2024-05-08T18:50:19.738971+0000","last_became_peered":"2024-05-08T18:50:19.738971+0000","last_unstale":"2024-05-08T18:52:28.004669+0000","last_undegraded":"2024-05-08T18:52:28.004669+0000","last_fullsized":"2024-05-08T18:52:28.004669+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:55.068985+0000","last_change":"2024-05-08T18:53:55.069024+0000","last_active":"2024-05-08T18:53:55.068985+0000","last_peered":"2024-05-08T18:53:55.068985+0000","last_clean":"2024-05-08T18:53:55.068985+0000","last_became_active":"2024-05-08T18:50:30.032197+0000","last_became_peered":"2024-05-08T18:50:30.032197+0000","last_unstale":"2024-05-08T18:53:55.068985+0000","last_undegraded":"2024-05-08T18:53:55.068985+0000","last_fullsized":"2024-05-08T18:53:55.068985+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:55.068843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:55.068843+0000","last_clean_scrub_stamp":"2024-05-08T18:53:55.068843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:15.069363+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"27'96","reported_seq":189,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.978964+0000","last_change":"2024-05-08T18:53:53.979024+0000","last_active":"2024-05-08T18:53:53.978964+0000","last_peered":"2024-05-08T18:53:53.978964+0000","last_clean":"2024-05-08T18:53:53.978964+0000","last_became_active":"2024-05-08T18:50:32.043109+0000","last_became_peered":"2024-05-08T18:50:32.043109+0000","last_unstale":"2024-05-08T18:53:53.978964+0000","last_undegraded":"2024-05-08T18:53:53.978964+0000","last_fullsized":"2024-05-08T18:53:53.978964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'96","last_scrub_stamp":"2024-05-08T18:53:53.978862+0000","last_deep_scrub":"27'96","last_deep_scrub_stamp":"2024-05-08T18:53:53.978862+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.978862+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:02.797212+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:52.944796+0000","last_change":"2024-05-08T18:53:52.944818+0000","last_active":"2024-05-08T18:53:52.944796+0000","last_peered":"2024-05-08T18:53:52.944796+0000","last_clean":"2024-05-08T18:53:52.944796+0000","last_became_active":"2024-05-08T18:50:34.043495+0000","last_became_peered":"2024-05-08T18:50:34.043495+0000","last_unstale":"2024-05-08T18:53:52.944796+0000","last_undegraded":"2024-05-08T18:53:52.944796+0000","last_fullsized":"2024-05-08T18:53:52.944796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:52.944707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:52.944707+0000","last_clean_scrub_stamp":"2024-05-08T18:53:52.944707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:51.657538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:59.972475+0000","last_change":"2024-05-08T18:53:59.972499+0000","last_active":"2024-05-08T18:53:59.972475+0000","last_peered":"2024-05-08T18:53:59.972475+0000","last_clean":"2024-05-08T18:53:59.972475+0000","last_became_active":"2024-05-08T18:50:36.044491+0000","last_became_peered":"2024-05-08T18:50:36.044491+0000","last_unstale":"2024-05-08T18:53:59.972475+0000","last_undegraded":"2024-05-08T18:53:59.972475+0000","last_fullsized":"2024-05-08T18:53:59.972475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:53:59.972386+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:53:59.972386+0000","last_clean_scrub_stamp":"2024-05-08T18:53:59.972386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:29.340986+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006156+0000","last_change":"2024-05-08T18:50:36.050995+0000","last_active":"2024-05-08T18:52:43.006156+0000","last_peered":"2024-05-08T18:52:43.006156+0000","last_clean":"2024-05-08T18:52:43.006156+0000","last_became_active":"2024-05-08T18:50:36.050722+0000","last_became_peered":"2024-05-08T18:50:36.050722+0000","last_unstale":"2024-05-08T18:52:43.006156+0000","last_undegraded":"2024-05-08T18:52:43.006156+0000","last_fullsized":"2024-05-08T18:52:43.006156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"27'10","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:17.952118+0000","last_change":"2024-05-08T18:54:17.952151+0000","last_active":"2024-05-08T18:54:17.952118+0000","last_peered":"2024-05-08T18:54:17.952118+0000","last_clean":"2024-05-08T18:54:17.952118+0000","last_became_active":"2024-05-08T18:50:28.033010+0000","last_became_peered":"2024-05-08T18:50:28.033010+0000","last_unstale":"2024-05-08T18:54:17.952118+0000","last_undegraded":"2024-05-08T18:54:17.952118+0000","last_fullsized":"2024-05-08T18:54:17.952118+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:17.952018+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:17.952018+0000","last_clean_scrub_stamp":"2024-05-08T18:54:17.952018+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:37.952538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007703+0000","last_change":"2024-05-08T18:50:26.027008+0000","last_active":"2024-05-08T18:52:48.007703+0000","last_peered":"2024-05-08T18:52:48.007703+0000","last_clean":"2024-05-08T18:52:48.007703+0000","last_became_active":"2024-05-08T18:50:26.025828+0000","last_became_peered":"2024-05-08T18:50:26.025828+0000","last_unstale":"2024-05-08T18:52:48.007703+0000","last_undegraded":"2024-05-08T18:52:48.007703+0000","last_fullsized":"2024-05-08T18:52:48.007703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.007987+0000","last_change":"2024-05-08T18:51:15.082912+0000","last_active":"2024-05-08T18:52:53.007987+0000","last_peered":"2024-05-08T18:52:53.007987+0000","last_clean":"2024-05-08T18:52:53.007987+0000","last_became_active":"2024-05-08T18:51:15.082590+0000","last_became_peered":"2024-05-08T18:51:15.082590+0000","last_unstale":"2024-05-08T18:52:53.007987+0000","last_undegraded":"2024-05-08T18:52:53.007987+0000","last_fullsized":"2024-05-08T18:52:53.007987+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"27'40","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:50.089105+0000","last_change":"2024-05-08T18:53:50.089149+0000","last_active":"2024-05-08T18:53:50.089105+0000","last_peered":"2024-05-08T18:53:50.089105+0000","last_clean":"2024-05-08T18:53:50.089105+0000","last_became_active":"2024-05-08T18:50:32.038591+0000","last_became_peered":"2024-05-08T18:50:32.038591+0000","last_unstale":"2024-05-08T18:53:50.089105+0000","last_undegraded":"2024-05-08T18:53:50.089105+0000","last_fullsized":"2024-05-08T18:53:50.089105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-05-08T18:53:50.089008+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-05-08T18:53:50.089008+0000","last_clean_scrub_stamp":"2024-05-08T18:53:50.089008+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:59.963311+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:20.042995+0000","last_change":"2024-05-08T18:54:20.043031+0000","last_active":"2024-05-08T18:54:20.042995+0000","last_peered":"2024-05-08T18:54:20.042995+0000","last_clean":"2024-05-08T18:54:20.042995+0000","last_became_active":"2024-05-08T18:50:34.050749+0000","last_became_peered":"2024-05-08T18:50:34.050749+0000","last_unstale":"2024-05-08T18:54:20.042995+0000","last_undegraded":"2024-05-08T18:54:20.042995+0000","last_fullsized":"2024-05-08T18:54:20.042995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:20.042859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:20.042859+0000","last_clean_scrub_stamp":"2024-05-08T18:54:20.042859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:33.623374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"27'15","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.700426+0000","last_change":"2024-05-08T18:50:36.054332+0000","last_active":"2024-05-08T18:53:34.700426+0000","last_peered":"2024-05-08T18:53:34.700426+0000","last_clean":"2024-05-08T18:53:34.700426+0000","last_became_active":"2024-05-08T18:50:36.054102+0000","last_became_peered":"2024-05-08T18:50:36.054102+0000","last_unstale":"2024-05-08T18:53:34.700426+0000","last_undegraded":"2024-05-08T18:53:34.700426+0000","last_fullsized":"2024-05-08T18:53:34.700426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"27'6","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:08.935691+0000","last_change":"2024-05-08T18:54:08.935717+0000","last_active":"2024-05-08T18:54:08.935691+0000","last_peered":"2024-05-08T18:54:08.935691+0000","last_clean":"2024-05-08T18:54:08.935691+0000","last_became_active":"2024-05-08T18:50:28.038587+0000","last_became_peered":"2024-05-08T18:50:28.038587+0000","last_unstale":"2024-05-08T18:54:08.935691+0000","last_undegraded":"2024-05-08T18:54:08.935691+0000","last_fullsized":"2024-05-08T18:54:08.935691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:08.935594+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:08.935594+0000","last_clean_scrub_stamp":"2024-05-08T18:54:08.935594+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:39.685836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:18.918416+0000","last_change":"2024-05-08T18:54:18.918440+0000","last_active":"2024-05-08T18:54:18.918416+0000","last_peered":"2024-05-08T18:54:18.918416+0000","last_clean":"2024-05-08T18:54:18.918416+0000","last_became_active":"2024-05-08T18:50:26.031509+0000","last_became_peered":"2024-05-08T18:50:26.031509+0000","last_unstale":"2024-05-08T18:54:18.918416+0000","last_undegraded":"2024-05-08T18:54:18.918416+0000","last_fullsized":"2024-05-08T18:54:18.918416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:18.918312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:18.918312+0000","last_clean_scrub_stamp":"2024-05-08T18:54:18.918312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:54.297707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:51.065753+0000","last_change":"2024-05-08T18:53:51.065788+0000","last_active":"2024-05-08T18:53:51.065753+0000","last_peered":"2024-05-08T18:53:51.065753+0000","last_clean":"2024-05-08T18:53:51.065753+0000","last_became_active":"2024-05-08T18:50:30.034178+0000","last_became_peered":"2024-05-08T18:50:30.034178+0000","last_unstale":"2024-05-08T18:53:51.065753+0000","last_undegraded":"2024-05-08T18:53:51.065753+0000","last_fullsized":"2024-05-08T18:53:51.065753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:51.065645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:51.065645+0000","last_clean_scrub_stamp":"2024-05-08T18:53:51.065645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:42.592612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'9","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:00.016731+0000","last_change":"2024-05-08T18:54:00.016762+0000","last_active":"2024-05-08T18:54:00.016731+0000","last_peered":"2024-05-08T18:54:00.016731+0000","last_clean":"2024-05-08T18:54:00.016731+0000","last_became_active":"2024-05-08T18:50:32.036371+0000","last_became_peered":"2024-05-08T18:50:32.036371+0000","last_unstale":"2024-05-08T18:54:00.016731+0000","last_undegraded":"2024-05-08T18:54:00.016731+0000","last_fullsized":"2024-05-08T18:54:00.016731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-08T18:54:00.016634+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-08T18:54:00.016634+0000","last_clean_scrub_stamp":"2024-05-08T18:54:00.016634+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:07.475619+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:52.036037+0000","last_change":"2024-05-08T18:53:52.036087+0000","last_active":"2024-05-08T18:53:52.036037+0000","last_peered":"2024-05-08T18:53:52.036037+0000","last_clean":"2024-05-08T18:53:52.036037+0000","last_became_active":"2024-05-08T18:50:34.048434+0000","last_became_peered":"2024-05-08T18:50:34.048434+0000","last_unstale":"2024-05-08T18:53:52.036037+0000","last_undegraded":"2024-05-08T18:53:52.036037+0000","last_fullsized":"2024-05-08T18:53:52.036037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:52.035926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:52.035926+0000","last_clean_scrub_stamp":"2024-05-08T18:53:52.035926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:09.492022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"25'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:08.005367+0000","last_change":"2024-05-08T18:50:36.047682+0000","last_active":"2024-05-08T18:53:08.005367+0000","last_peered":"2024-05-08T18:53:08.005367+0000","last_clean":"2024-05-08T18:53:08.005367+0000","last_became_active":"2024-05-08T18:50:36.047379+0000","last_became_peered":"2024-05-08T18:50:36.047379+0000","last_unstale":"2024-05-08T18:53:08.005367+0000","last_undegraded":"2024-05-08T18:53:08.005367+0000","last_fullsized":"2024-05-08T18:53:08.005367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"27'6","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:19.140265+0000","last_change":"2024-05-08T18:54:19.140338+0000","last_active":"2024-05-08T18:54:19.140265+0000","last_peered":"2024-05-08T18:54:19.140265+0000","last_clean":"2024-05-08T18:54:19.140265+0000","last_became_active":"2024-05-08T18:50:28.022636+0000","last_became_peered":"2024-05-08T18:50:28.022636+0000","last_unstale":"2024-05-08T18:54:19.140265+0000","last_undegraded":"2024-05-08T18:54:19.140265+0000","last_fullsized":"2024-05-08T18:54:19.140265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:19.140160+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:19.140160+0000","last_clean_scrub_stamp":"2024-05-08T18:54:19.140160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:58:19.922822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"25'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:22.954334+0000","last_change":"2024-05-08T18:54:22.954361+0000","last_active":"2024-05-08T18:54:22.954334+0000","last_peered":"2024-05-08T18:54:22.954334+0000","last_clean":"2024-05-08T18:54:22.954334+0000","last_became_active":"2024-05-08T18:50:26.030884+0000","last_became_peered":"2024-05-08T18:50:26.030884+0000","last_unstale":"2024-05-08T18:54:22.954334+0000","last_undegraded":"2024-05-08T18:54:22.954334+0000","last_fullsized":"2024-05-08T18:54:22.954334+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:22.954247+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:22.954247+0000","last_clean_scrub_stamp":"2024-05-08T18:54:22.954247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:34.259820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:02.929650+0000","last_change":"2024-05-08T18:54:02.929688+0000","last_active":"2024-05-08T18:54:02.929650+0000","last_peered":"2024-05-08T18:54:02.929650+0000","last_clean":"2024-05-08T18:54:02.929650+0000","last_became_active":"2024-05-08T18:50:30.030773+0000","last_became_peered":"2024-05-08T18:50:30.030773+0000","last_unstale":"2024-05-08T18:54:02.929650+0000","last_undegraded":"2024-05-08T18:54:02.929650+0000","last_fullsized":"2024-05-08T18:54:02.929650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:02.929533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:02.929533+0000","last_clean_scrub_stamp":"2024-05-08T18:54:02.929533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:48:24.910553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"27'47","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:01.044939+0000","last_change":"2024-05-08T18:54:01.044974+0000","last_active":"2024-05-08T18:54:01.044939+0000","last_peered":"2024-05-08T18:54:01.044939+0000","last_clean":"2024-05-08T18:54:01.044939+0000","last_became_active":"2024-05-08T18:50:32.032289+0000","last_became_peered":"2024-05-08T18:50:32.032289+0000","last_unstale":"2024-05-08T18:54:01.044939+0000","last_undegraded":"2024-05-08T18:54:01.044939+0000","last_fullsized":"2024-05-08T18:54:01.044939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2024-05-08T18:54:01.044854+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2024-05-08T18:54:01.044854+0000","last_clean_scrub_stamp":"2024-05-08T18:54:01.044854+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:01.160239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.050696+0000","last_change":"2024-05-08T18:53:45.050721+0000","last_active":"2024-05-08T18:53:45.050696+0000","last_peered":"2024-05-08T18:53:45.050696+0000","last_clean":"2024-05-08T18:53:45.050696+0000","last_became_active":"2024-05-08T18:50:34.042903+0000","last_became_peered":"2024-05-08T18:50:34.042903+0000","last_unstale":"2024-05-08T18:53:45.050696+0000","last_undegraded":"2024-05-08T18:53:45.050696+0000","last_fullsized":"2024-05-08T18:53:45.050696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:45.050602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:45.050602+0000","last_clean_scrub_stamp":"2024-05-08T18:53:45.050602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:02.506698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:08.010901+0000","last_change":"2024-05-08T18:50:36.056236+0000","last_active":"2024-05-08T18:53:08.010901+0000","last_peered":"2024-05-08T18:53:08.010901+0000","last_clean":"2024-05-08T18:53:08.010901+0000","last_became_active":"2024-05-08T18:50:36.055855+0000","last_became_peered":"2024-05-08T18:50:36.055855+0000","last_unstale":"2024-05-08T18:53:08.010901+0000","last_undegraded":"2024-05-08T18:53:08.010901+0000","last_fullsized":"2024-05-08T18:53:08.010901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"27'12","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:21.089048+0000","last_change":"2024-05-08T18:54:21.089082+0000","last_active":"2024-05-08T18:54:21.089048+0000","last_peered":"2024-05-08T18:54:21.089048+0000","last_clean":"2024-05-08T18:54:21.089048+0000","last_became_active":"2024-05-08T18:50:28.034819+0000","last_became_peered":"2024-05-08T18:50:28.034819+0000","last_unstale":"2024-05-08T18:54:21.089048+0000","last_undegraded":"2024-05-08T18:54:21.089048+0000","last_fullsized":"2024-05-08T18:54:21.089048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-08T18:54:21.088960+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-08T18:54:21.088960+0000","last_clean_scrub_stamp":"2024-05-08T18:54:21.088960+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:41.111340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.008114+0000","last_change":"2024-05-08T18:50:26.029507+0000","last_active":"2024-05-08T18:52:53.008114+0000","last_peered":"2024-05-08T18:52:53.008114+0000","last_clean":"2024-05-08T18:52:53.008114+0000","last_became_active":"2024-05-08T18:50:26.029211+0000","last_became_peered":"2024-05-08T18:50:26.029211+0000","last_unstale":"2024-05-08T18:52:53.008114+0000","last_undegraded":"2024-05-08T18:52:53.008114+0000","last_fullsized":"2024-05-08T18:52:53.008114+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:57.055070+0000","last_change":"2024-05-08T18:53:57.055135+0000","last_active":"2024-05-08T18:53:57.055070+0000","last_peered":"2024-05-08T18:53:57.055070+0000","last_clean":"2024-05-08T18:53:57.055070+0000","last_became_active":"2024-05-08T18:50:30.031588+0000","last_became_peered":"2024-05-08T18:50:30.031588+0000","last_unstale":"2024-05-08T18:53:57.055070+0000","last_undegraded":"2024-05-08T18:53:57.055070+0000","last_fullsized":"2024-05-08T18:53:57.055070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:57.054969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:57.054969+0000","last_clean_scrub_stamp":"2024-05-08T18:53:57.054969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:57:44.577983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"27'36","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:57.960934+0000","last_change":"2024-05-08T18:53:57.960966+0000","last_active":"2024-05-08T18:53:57.960934+0000","last_peered":"2024-05-08T18:53:57.960934+0000","last_clean":"2024-05-08T18:53:57.960934+0000","last_became_active":"2024-05-08T18:50:32.035181+0000","last_became_peered":"2024-05-08T18:50:32.035181+0000","last_unstale":"2024-05-08T18:53:57.960934+0000","last_undegraded":"2024-05-08T18:53:57.960934+0000","last_fullsized":"2024-05-08T18:53:57.960934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-05-08T18:53:57.960820+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-05-08T18:53:57.960820+0000","last_clean_scrub_stamp":"2024-05-08T18:53:57.960820+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:23.268890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:49.951155+0000","last_change":"2024-05-08T18:53:49.951177+0000","last_active":"2024-05-08T18:53:49.951155+0000","last_peered":"2024-05-08T18:53:49.951155+0000","last_clean":"2024-05-08T18:53:49.951155+0000","last_became_active":"2024-05-08T18:50:34.039668+0000","last_became_peered":"2024-05-08T18:50:34.039668+0000","last_unstale":"2024-05-08T18:53:49.951155+0000","last_undegraded":"2024-05-08T18:53:49.951155+0000","last_fullsized":"2024-05-08T18:53:49.951155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:49.951058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:49.951058+0000","last_clean_scrub_stamp":"2024-05-08T18:53:49.951058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:24.708273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.005454+0000","last_change":"2024-05-08T18:50:28.026330+0000","last_active":"2024-05-08T18:52:33.005454+0000","last_peered":"2024-05-08T18:52:33.005454+0000","last_clean":"2024-05-08T18:52:33.005454+0000","last_became_active":"2024-05-08T18:50:28.025862+0000","last_became_peered":"2024-05-08T18:50:28.025862+0000","last_unstale":"2024-05-08T18:52:33.005454+0000","last_undegraded":"2024-05-08T18:52:33.005454+0000","last_fullsized":"2024-05-08T18:52:33.005454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.008366+0000","last_change":"2024-05-08T18:50:26.023167+0000","last_active":"2024-05-08T18:52:53.008366+0000","last_peered":"2024-05-08T18:52:53.008366+0000","last_clean":"2024-05-08T18:52:53.008366+0000","last_became_active":"2024-05-08T18:50:26.022874+0000","last_became_peered":"2024-05-08T18:50:26.022874+0000","last_unstale":"2024-05-08T18:52:53.008366+0000","last_undegraded":"2024-05-08T18:52:53.008366+0000","last_fullsized":"2024-05-08T18:52:53.008366+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:08.022442+0000","last_change":"2024-05-08T18:54:08.022479+0000","last_active":"2024-05-08T18:54:08.022442+0000","last_peered":"2024-05-08T18:54:08.022442+0000","last_clean":"2024-05-08T18:54:08.022442+0000","last_became_active":"2024-05-08T18:50:30.029570+0000","last_became_peered":"2024-05-08T18:50:30.029570+0000","last_unstale":"2024-05-08T18:54:08.022442+0000","last_undegraded":"2024-05-08T18:54:08.022442+0000","last_fullsized":"2024-05-08T18:54:08.022442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:08.022348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:08.022348+0000","last_clean_scrub_stamp":"2024-05-08T18:54:08.022348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:31.732172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"27'65","reported_seq":138,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.032557+0000","last_change":"2024-05-08T18:53:58.032598+0000","last_active":"2024-05-08T18:53:58.032557+0000","last_peered":"2024-05-08T18:53:58.032557+0000","last_clean":"2024-05-08T18:53:58.032557+0000","last_became_active":"2024-05-08T18:50:32.039293+0000","last_became_peered":"2024-05-08T18:50:32.039293+0000","last_unstale":"2024-05-08T18:53:58.032557+0000","last_undegraded":"2024-05-08T18:53:58.032557+0000","last_fullsized":"2024-05-08T18:53:58.032557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'65","last_scrub_stamp":"2024-05-08T18:53:58.032459+0000","last_deep_scrub":"27'65","last_deep_scrub_stamp":"2024-05-08T18:53:58.032459+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.032459+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:46.844977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:46.910687+0000","last_change":"2024-05-08T18:53:46.910709+0000","last_active":"2024-05-08T18:53:46.910687+0000","last_peered":"2024-05-08T18:53:46.910687+0000","last_clean":"2024-05-08T18:53:46.910687+0000","last_became_active":"2024-05-08T18:50:34.047111+0000","last_became_peered":"2024-05-08T18:50:34.047111+0000","last_unstale":"2024-05-08T18:53:46.910687+0000","last_undegraded":"2024-05-08T18:53:46.910687+0000","last_fullsized":"2024-05-08T18:53:46.910687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:46.910595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:46.910595+0000","last_clean_scrub_stamp":"2024-05-08T18:53:46.910595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:27.588782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"27'14","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:15.117084+0000","last_change":"2024-05-08T18:54:15.117146+0000","last_active":"2024-05-08T18:54:15.117084+0000","last_peered":"2024-05-08T18:54:15.117084+0000","last_clean":"2024-05-08T18:54:15.117084+0000","last_became_active":"2024-05-08T18:50:36.046834+0000","last_became_peered":"2024-05-08T18:50:36.046834+0000","last_unstale":"2024-05-08T18:54:15.117084+0000","last_undegraded":"2024-05-08T18:54:15.117084+0000","last_fullsized":"2024-05-08T18:54:15.117084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-05-08T18:54:15.116980+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-05-08T18:54:15.116980+0000","last_clean_scrub_stamp":"2024-05-08T18:54:15.116980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:44.747454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'6","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.696487+0000","last_change":"2024-05-08T18:50:28.023338+0000","last_active":"2024-05-08T18:53:34.696487+0000","last_peered":"2024-05-08T18:53:34.696487+0000","last_clean":"2024-05-08T18:53:34.696487+0000","last_became_active":"2024-05-08T18:50:28.023049+0000","last_became_peered":"2024-05-08T18:50:28.023049+0000","last_unstale":"2024-05-08T18:53:34.696487+0000","last_undegraded":"2024-05-08T18:53:34.696487+0000","last_fullsized":"2024-05-08T18:53:34.696487+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.813775+0000","last_change":"2024-05-08T18:50:26.030145+0000","last_active":"2024-05-08T18:53:34.813775+0000","last_peered":"2024-05-08T18:53:34.813775+0000","last_clean":"2024-05-08T18:53:34.813775+0000","last_became_active":"2024-05-08T18:50:26.029008+0000","last_became_peered":"2024-05-08T18:50:26.029008+0000","last_unstale":"2024-05-08T18:53:34.813775+0000","last_undegraded":"2024-05-08T18:53:34.813775+0000","last_fullsized":"2024-05-08T18:53:34.813775+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:05.886604+0000","last_change":"2024-05-08T18:54:05.886628+0000","last_active":"2024-05-08T18:54:05.886604+0000","last_peered":"2024-05-08T18:54:05.886604+0000","last_clean":"2024-05-08T18:54:05.886604+0000","last_became_active":"2024-05-08T18:50:30.026853+0000","last_became_peered":"2024-05-08T18:50:30.026853+0000","last_unstale":"2024-05-08T18:54:05.886604+0000","last_undegraded":"2024-05-08T18:54:05.886604+0000","last_fullsized":"2024-05-08T18:54:05.886604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:05.886508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:05.886508+0000","last_clean_scrub_stamp":"2024-05-08T18:54:05.886508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:58.280018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"27'45","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.018036+0000","last_change":"2024-05-08T18:53:58.018103+0000","last_active":"2024-05-08T18:53:58.018036+0000","last_peered":"2024-05-08T18:53:58.018036+0000","last_clean":"2024-05-08T18:53:58.018036+0000","last_became_active":"2024-05-08T18:50:32.041208+0000","last_became_peered":"2024-05-08T18:50:32.041208+0000","last_unstale":"2024-05-08T18:53:58.018036+0000","last_undegraded":"2024-05-08T18:53:58.018036+0000","last_fullsized":"2024-05-08T18:53:58.018036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-05-08T18:53:58.017901+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-05-08T18:53:58.017901+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.017901+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:24:08.011328+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:56.078504+0000","last_change":"2024-05-08T18:53:56.078528+0000","last_active":"2024-05-08T18:53:56.078504+0000","last_peered":"2024-05-08T18:53:56.078504+0000","last_clean":"2024-05-08T18:53:56.078504+0000","last_became_active":"2024-05-08T18:50:34.048749+0000","last_became_peered":"2024-05-08T18:50:34.048749+0000","last_unstale":"2024-05-08T18:53:56.078504+0000","last_undegraded":"2024-05-08T18:53:56.078504+0000","last_fullsized":"2024-05-08T18:53:56.078504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:56.078418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:56.078418+0000","last_clean_scrub_stamp":"2024-05-08T18:53:56.078418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:48:18.059438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.009318+0000","last_change":"2024-05-08T18:50:36.057323+0000","last_active":"2024-05-08T18:52:58.009318+0000","last_peered":"2024-05-08T18:52:58.009318+0000","last_clean":"2024-05-08T18:52:58.009318+0000","last_became_active":"2024-05-08T18:50:36.056960+0000","last_became_peered":"2024-05-08T18:50:36.056960+0000","last_unstale":"2024-05-08T18:52:58.009318+0000","last_undegraded":"2024-05-08T18:52:58.009318+0000","last_fullsized":"2024-05-08T18:52:58.009318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"27'8","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:02.075651+0000","last_change":"2024-05-08T18:54:02.075677+0000","last_active":"2024-05-08T18:54:02.075651+0000","last_peered":"2024-05-08T18:54:02.075651+0000","last_clean":"2024-05-08T18:54:02.075651+0000","last_became_active":"2024-05-08T18:50:28.038364+0000","last_became_peered":"2024-05-08T18:50:28.038364+0000","last_unstale":"2024-05-08T18:54:02.075651+0000","last_undegraded":"2024-05-08T18:54:02.075651+0000","last_fullsized":"2024-05-08T18:54:02.075651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:02.075564+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:02.075564+0000","last_clean_scrub_stamp":"2024-05-08T18:54:02.075564+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:34.353002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'4","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.821307+0000","last_change":"2024-05-08T18:50:26.012760+0000","last_active":"2024-05-08T18:53:34.821307+0000","last_peered":"2024-05-08T18:53:34.821307+0000","last_clean":"2024-05-08T18:53:34.821307+0000","last_became_active":"2024-05-08T18:50:26.012506+0000","last_became_peered":"2024-05-08T18:50:26.012506+0000","last_unstale":"2024-05-08T18:53:34.821307+0000","last_undegraded":"2024-05-08T18:53:34.821307+0000","last_fullsized":"2024-05-08T18:53:34.821307+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:06.873106+0000","last_change":"2024-05-08T18:54:06.873131+0000","last_active":"2024-05-08T18:54:06.873106+0000","last_peered":"2024-05-08T18:54:06.873106+0000","last_clean":"2024-05-08T18:54:06.873106+0000","last_became_active":"2024-05-08T18:50:30.026445+0000","last_became_peered":"2024-05-08T18:50:30.026445+0000","last_unstale":"2024-05-08T18:54:06.873106+0000","last_undegraded":"2024-05-08T18:54:06.873106+0000","last_fullsized":"2024-05-08T18:54:06.873106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:06.873001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:06.873001+0000","last_clean_scrub_stamp":"2024-05-08T18:54:06.873001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:55.685519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"27'39","reported_seq":95,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:57.045765+0000","last_change":"2024-05-08T18:53:57.045805+0000","last_active":"2024-05-08T18:53:57.045765+0000","last_peered":"2024-05-08T18:53:57.045765+0000","last_clean":"2024-05-08T18:53:57.045765+0000","last_became_active":"2024-05-08T18:50:32.040745+0000","last_became_peered":"2024-05-08T18:50:32.040745+0000","last_unstale":"2024-05-08T18:53:57.045765+0000","last_undegraded":"2024-05-08T18:53:57.045765+0000","last_fullsized":"2024-05-08T18:53:57.045765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-05-08T18:53:57.045641+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-05-08T18:53:57.045641+0000","last_clean_scrub_stamp":"2024-05-08T18:53:57.045641+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:49.439151+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:46.999266+0000","last_change":"2024-05-08T18:53:46.999290+0000","last_active":"2024-05-08T18:53:46.999266+0000","last_peered":"2024-05-08T18:53:46.999266+0000","last_clean":"2024-05-08T18:53:46.999266+0000","last_became_active":"2024-05-08T18:50:34.047508+0000","last_became_peered":"2024-05-08T18:50:34.047508+0000","last_unstale":"2024-05-08T18:53:46.999266+0000","last_undegraded":"2024-05-08T18:53:46.999266+0000","last_fullsized":"2024-05-08T18:53:46.999266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:46.999168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:46.999168+0000","last_clean_scrub_stamp":"2024-05-08T18:53:46.999168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:21:10.901638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"27'9","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.610816+0000","last_change":"2024-05-08T18:50:36.058170+0000","last_active":"2024-05-08T18:53:34.610816+0000","last_peered":"2024-05-08T18:53:34.610816+0000","last_clean":"2024-05-08T18:53:34.610816+0000","last_became_active":"2024-05-08T18:50:36.057863+0000","last_became_peered":"2024-05-08T18:50:36.057863+0000","last_unstale":"2024-05-08T18:53:34.610816+0000","last_undegraded":"2024-05-08T18:53:34.610816+0000","last_fullsized":"2024-05-08T18:53:34.610816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"25'2","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:17.193780+0000","last_change":"2024-05-08T18:54:17.193805+0000","last_active":"2024-05-08T18:54:17.193780+0000","last_peered":"2024-05-08T18:54:17.193780+0000","last_clean":"2024-05-08T18:54:17.193780+0000","last_became_active":"2024-05-08T18:50:28.020441+0000","last_became_peered":"2024-05-08T18:50:28.020441+0000","last_unstale":"2024-05-08T18:54:17.193780+0000","last_undegraded":"2024-05-08T18:54:17.193780+0000","last_fullsized":"2024-05-08T18:54:17.193780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:17.193655+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:17.193655+0000","last_clean_scrub_stamp":"2024-05-08T18:54:17.193655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:19.480048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.009352+0000","last_change":"2024-05-08T18:50:26.025468+0000","last_active":"2024-05-08T18:52:58.009352+0000","last_peered":"2024-05-08T18:52:58.009352+0000","last_clean":"2024-05-08T18:52:58.009352+0000","last_became_active":"2024-05-08T18:50:26.024274+0000","last_became_peered":"2024-05-08T18:50:26.024274+0000","last_unstale":"2024-05-08T18:52:58.009352+0000","last_undegraded":"2024-05-08T18:52:58.009352+0000","last_fullsized":"2024-05-08T18:52:58.009352+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:01.042454+0000","last_change":"2024-05-08T18:54:01.042477+0000","last_active":"2024-05-08T18:54:01.042454+0000","last_peered":"2024-05-08T18:54:01.042454+0000","last_clean":"2024-05-08T18:54:01.042454+0000","last_became_active":"2024-05-08T18:50:30.028877+0000","last_became_peered":"2024-05-08T18:50:30.028877+0000","last_unstale":"2024-05-08T18:54:01.042454+0000","last_undegraded":"2024-05-08T18:54:01.042454+0000","last_fullsized":"2024-05-08T18:54:01.042454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:01.042364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:01.042364+0000","last_clean_scrub_stamp":"2024-05-08T18:54:01.042364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:56.888219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'15","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:17.120927+0000","last_change":"2024-05-08T18:54:17.120963+0000","last_active":"2024-05-08T18:54:17.120927+0000","last_peered":"2024-05-08T18:54:17.120927+0000","last_clean":"2024-05-08T18:54:17.120927+0000","last_became_active":"2024-05-08T18:50:32.041539+0000","last_became_peered":"2024-05-08T18:50:32.041539+0000","last_unstale":"2024-05-08T18:54:17.120927+0000","last_undegraded":"2024-05-08T18:54:17.120927+0000","last_fullsized":"2024-05-08T18:54:17.120927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-08T18:54:17.120821+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-08T18:54:17.120821+0000","last_clean_scrub_stamp":"2024-05-08T18:54:17.120821+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:31.398678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"27'285","reported_seq":418,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:47.959722+0000","last_change":"2024-05-08T18:53:47.959752+0000","last_active":"2024-05-08T18:53:47.959722+0000","last_peered":"2024-05-08T18:53:47.959722+0000","last_clean":"2024-05-08T18:53:47.959722+0000","last_became_active":"2024-05-08T18:50:34.048421+0000","last_became_peered":"2024-05-08T18:50:34.048421+0000","last_unstale":"2024-05-08T18:53:47.959722+0000","last_undegraded":"2024-05-08T18:53:47.959722+0000","last_fullsized":"2024-05-08T18:53:47.959722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:47.959631+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:47.959631+0000","last_clean_scrub_stamp":"2024-05-08T18:53:47.959631+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:52:13.795244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"27'6","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.990989+0000","last_change":"2024-05-08T18:50:36.055738+0000","last_active":"2024-05-08T18:53:34.990989+0000","last_peered":"2024-05-08T18:53:34.990989+0000","last_clean":"2024-05-08T18:53:34.990989+0000","last_became_active":"2024-05-08T18:50:36.055184+0000","last_became_peered":"2024-05-08T18:50:36.055184+0000","last_unstale":"2024-05-08T18:53:34.990989+0000","last_undegraded":"2024-05-08T18:53:34.990989+0000","last_fullsized":"2024-05-08T18:53:34.990989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:11.971785+0000","last_change":"2024-05-08T18:54:11.971848+0000","last_active":"2024-05-08T18:54:11.971785+0000","last_peered":"2024-05-08T18:54:11.971785+0000","last_clean":"2024-05-08T18:54:11.971785+0000","last_became_active":"2024-05-08T18:50:28.025313+0000","last_became_peered":"2024-05-08T18:50:28.025313+0000","last_unstale":"2024-05-08T18:54:11.971785+0000","last_undegraded":"2024-05-08T18:54:11.971785+0000","last_fullsized":"2024-05-08T18:54:11.971785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:11.971660+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:11.971660+0000","last_clean_scrub_stamp":"2024-05-08T18:54:11.971660+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:55.520240+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.008945+0000","last_change":"2024-05-08T18:50:26.030334+0000","last_active":"2024-05-08T18:52:58.008945+0000","last_peered":"2024-05-08T18:52:58.008945+0000","last_clean":"2024-05-08T18:52:58.008945+0000","last_became_active":"2024-05-08T18:50:26.030058+0000","last_became_peered":"2024-05-08T18:50:26.030058+0000","last_unstale":"2024-05-08T18:52:58.008945+0000","last_undegraded":"2024-05-08T18:52:58.008945+0000","last_fullsized":"2024-05-08T18:52:58.008945+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"27'2","reported_seq":230,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:03.029231+0000","last_change":"2024-05-08T18:54:03.029261+0000","last_active":"2024-05-08T18:54:03.029231+0000","last_peered":"2024-05-08T18:54:03.029231+0000","last_clean":"2024-05-08T18:54:03.029231+0000","last_became_active":"2024-05-08T18:50:30.024032+0000","last_became_peered":"2024-05-08T18:50:30.024032+0000","last_unstale":"2024-05-08T18:54:03.029231+0000","last_undegraded":"2024-05-08T18:54:03.029231+0000","last_fullsized":"2024-05-08T18:54:03.029231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:03.029144+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:03.029144+0000","last_clean_scrub_stamp":"2024-05-08T18:54:03.029144+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:03.144529+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"27'46","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:51.108219+0000","last_change":"2024-05-08T18:53:51.108258+0000","last_active":"2024-05-08T18:53:51.108219+0000","last_peered":"2024-05-08T18:53:51.108219+0000","last_clean":"2024-05-08T18:53:51.108219+0000","last_became_active":"2024-05-08T18:50:32.035792+0000","last_became_peered":"2024-05-08T18:50:32.035792+0000","last_unstale":"2024-05-08T18:53:51.108219+0000","last_undegraded":"2024-05-08T18:53:51.108219+0000","last_fullsized":"2024-05-08T18:53:51.108219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-05-08T18:53:51.108138+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-05-08T18:53:51.108138+0000","last_clean_scrub_stamp":"2024-05-08T18:53:51.108138+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:39.003860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:49.040915+0000","last_change":"2024-05-08T18:53:49.040955+0000","last_active":"2024-05-08T18:53:49.040915+0000","last_peered":"2024-05-08T18:53:49.040915+0000","last_clean":"2024-05-08T18:53:49.040915+0000","last_became_active":"2024-05-08T18:50:34.044586+0000","last_became_peered":"2024-05-08T18:50:34.044586+0000","last_unstale":"2024-05-08T18:53:49.040915+0000","last_undegraded":"2024-05-08T18:53:49.040915+0000","last_fullsized":"2024-05-08T18:53:49.040915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:49.040776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:49.040776+0000","last_clean_scrub_stamp":"2024-05-08T18:53:49.040776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:14.348846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:03.009756+0000","last_change":"2024-05-08T18:50:36.053212+0000","last_active":"2024-05-08T18:53:03.009756+0000","last_peered":"2024-05-08T18:53:03.009756+0000","last_clean":"2024-05-08T18:53:03.009756+0000","last_became_active":"2024-05-08T18:50:36.052885+0000","last_became_peered":"2024-05-08T18:50:36.052885+0000","last_unstale":"2024-05-08T18:53:03.009756+0000","last_undegraded":"2024-05-08T18:53:03.009756+0000","last_fullsized":"2024-05-08T18:53:03.009756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"27'28","reported_seq":123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:13.997393+0000","last_change":"2024-05-08T18:54:13.997440+0000","last_active":"2024-05-08T18:54:13.997393+0000","last_peered":"2024-05-08T18:54:13.997393+0000","last_clean":"2024-05-08T18:54:13.997393+0000","last_became_active":"2024-05-08T18:50:28.025162+0000","last_became_peered":"2024-05-08T18:50:28.025162+0000","last_unstale":"2024-05-08T18:54:13.997393+0000","last_undegraded":"2024-05-08T18:54:13.997393+0000","last_fullsized":"2024-05-08T18:54:13.997393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-05-08T18:54:13.997287+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-05-08T18:54:13.997287+0000","last_clean_scrub_stamp":"2024-05-08T18:54:13.997287+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:28:05.524254+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":112,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.009424+0000","last_change":"2024-05-08T18:50:26.027367+0000","last_active":"2024-05-08T18:52:58.009424+0000","last_peered":"2024-05-08T18:52:58.009424+0000","last_clean":"2024-05-08T18:52:58.009424+0000","last_became_active":"2024-05-08T18:50:26.027067+0000","last_became_peered":"2024-05-08T18:50:26.027067+0000","last_unstale":"2024-05-08T18:52:58.009424+0000","last_undegraded":"2024-05-08T18:52:58.009424+0000","last_fullsized":"2024-05-08T18:52:58.009424+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:00.968059+0000","last_change":"2024-05-08T18:54:00.968081+0000","last_active":"2024-05-08T18:54:00.968059+0000","last_peered":"2024-05-08T18:54:00.968059+0000","last_clean":"2024-05-08T18:54:00.968059+0000","last_became_active":"2024-05-08T18:50:30.034616+0000","last_became_peered":"2024-05-08T18:50:30.034616+0000","last_unstale":"2024-05-08T18:54:00.968059+0000","last_undegraded":"2024-05-08T18:54:00.968059+0000","last_fullsized":"2024-05-08T18:54:00.968059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:00.967968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:00.967968+0000","last_clean_scrub_stamp":"2024-05-08T18:54:00.967968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:09.724587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"27'38","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:56.013273+0000","last_change":"2024-05-08T18:53:56.013305+0000","last_active":"2024-05-08T18:53:56.013273+0000","last_peered":"2024-05-08T18:53:56.013273+0000","last_clean":"2024-05-08T18:53:56.013273+0000","last_became_active":"2024-05-08T18:50:32.041806+0000","last_became_peered":"2024-05-08T18:50:32.041806+0000","last_unstale":"2024-05-08T18:53:56.013273+0000","last_undegraded":"2024-05-08T18:53:56.013273+0000","last_fullsized":"2024-05-08T18:53:56.013273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2024-05-08T18:53:56.013183+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2024-05-08T18:53:56.013183+0000","last_clean_scrub_stamp":"2024-05-08T18:53:56.013183+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:02.069580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:16.072290+0000","last_change":"2024-05-08T18:54:16.072313+0000","last_active":"2024-05-08T18:54:16.072290+0000","last_peered":"2024-05-08T18:54:16.072290+0000","last_clean":"2024-05-08T18:54:16.072290+0000","last_became_active":"2024-05-08T18:50:34.050445+0000","last_became_peered":"2024-05-08T18:50:34.050445+0000","last_unstale":"2024-05-08T18:54:16.072290+0000","last_undegraded":"2024-05-08T18:54:16.072290+0000","last_fullsized":"2024-05-08T18:54:16.072290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:16.072191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:16.072191+0000","last_clean_scrub_stamp":"2024-05-08T18:54:16.072191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:14.975396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:03.010228+0000","last_change":"2024-05-08T18:50:36.060634+0000","last_active":"2024-05-08T18:53:03.010228+0000","last_peered":"2024-05-08T18:53:03.010228+0000","last_clean":"2024-05-08T18:53:03.010228+0000","last_became_active":"2024-05-08T18:50:36.060318+0000","last_became_peered":"2024-05-08T18:50:36.060318+0000","last_unstale":"2024-05-08T18:53:03.010228+0000","last_undegraded":"2024-05-08T18:53:03.010228+0000","last_fullsized":"2024-05-08T18:53:03.010228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'4","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.829040+0000","last_change":"2024-05-08T18:50:28.029928+0000","last_active":"2024-05-08T18:53:34.829040+0000","last_peered":"2024-05-08T18:53:34.829040+0000","last_clean":"2024-05-08T18:53:34.829040+0000","last_became_active":"2024-05-08T18:50:28.029624+0000","last_became_peered":"2024-05-08T18:50:28.029624+0000","last_unstale":"2024-05-08T18:53:34.829040+0000","last_undegraded":"2024-05-08T18:53:34.829040+0000","last_fullsized":"2024-05-08T18:53:34.829040+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'4","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.591326+0000","last_change":"2024-05-08T18:50:26.029045+0000","last_active":"2024-05-08T18:53:34.591326+0000","last_peered":"2024-05-08T18:53:34.591326+0000","last_clean":"2024-05-08T18:53:34.591326+0000","last_became_active":"2024-05-08T18:50:26.028615+0000","last_became_peered":"2024-05-08T18:50:26.028615+0000","last_unstale":"2024-05-08T18:53:34.591326+0000","last_undegraded":"2024-05-08T18:53:34.591326+0000","last_fullsized":"2024-05-08T18:53:34.591326+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.082251+0000","last_change":"2024-05-08T18:53:58.082277+0000","last_active":"2024-05-08T18:53:58.082251+0000","last_peered":"2024-05-08T18:53:58.082251+0000","last_clean":"2024-05-08T18:53:58.082251+0000","last_became_active":"2024-05-08T18:50:30.030295+0000","last_became_peered":"2024-05-08T18:50:30.030295+0000","last_unstale":"2024-05-08T18:53:58.082251+0000","last_undegraded":"2024-05-08T18:53:58.082251+0000","last_fullsized":"2024-05-08T18:53:58.082251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:58.082158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:58.082158+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.082158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:04.138554+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"27'30","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:52.080875+0000","last_change":"2024-05-08T18:53:52.080925+0000","last_active":"2024-05-08T18:53:52.080875+0000","last_peered":"2024-05-08T18:53:52.080875+0000","last_clean":"2024-05-08T18:53:52.080875+0000","last_became_active":"2024-05-08T18:50:32.040661+0000","last_became_peered":"2024-05-08T18:50:32.040661+0000","last_unstale":"2024-05-08T18:53:52.080875+0000","last_undegraded":"2024-05-08T18:53:52.080875+0000","last_fullsized":"2024-05-08T18:53:52.080875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-05-08T18:53:52.080762+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-05-08T18:53:52.080762+0000","last_clean_scrub_stamp":"2024-05-08T18:53:52.080762+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:00.849983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:06.079512+0000","last_change":"2024-05-08T18:54:06.079537+0000","last_active":"2024-05-08T18:54:06.079512+0000","last_peered":"2024-05-08T18:54:06.079512+0000","last_clean":"2024-05-08T18:54:06.079512+0000","last_became_active":"2024-05-08T18:50:34.045040+0000","last_became_peered":"2024-05-08T18:50:34.045040+0000","last_unstale":"2024-05-08T18:54:06.079512+0000","last_undegraded":"2024-05-08T18:54:06.079512+0000","last_fullsized":"2024-05-08T18:54:06.079512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:06.079413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:06.079413+0000","last_clean_scrub_stamp":"2024-05-08T18:54:06.079413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:18.824227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:03.010192+0000","last_change":"2024-05-08T18:50:36.060675+0000","last_active":"2024-05-08T18:53:03.010192+0000","last_peered":"2024-05-08T18:53:03.010192+0000","last_clean":"2024-05-08T18:53:03.010192+0000","last_became_active":"2024-05-08T18:50:36.060382+0000","last_became_peered":"2024-05-08T18:50:36.060382+0000","last_unstale":"2024-05-08T18:53:03.010192+0000","last_undegraded":"2024-05-08T18:53:03.010192+0000","last_fullsized":"2024-05-08T18:53:03.010192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'12","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:09.881128+0000","last_change":"2024-05-08T18:54:09.881161+0000","last_active":"2024-05-08T18:54:09.881128+0000","last_peered":"2024-05-08T18:54:09.881128+0000","last_clean":"2024-05-08T18:54:09.881128+0000","last_became_active":"2024-05-08T18:50:28.020421+0000","last_became_peered":"2024-05-08T18:50:28.020421+0000","last_unstale":"2024-05-08T18:54:09.881128+0000","last_undegraded":"2024-05-08T18:54:09.881128+0000","last_fullsized":"2024-05-08T18:54:09.881128+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-08T18:54:09.881030+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-08T18:54:09.881030+0000","last_clean_scrub_stamp":"2024-05-08T18:54:09.881030+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:09.996415+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"27'4","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.816333+0000","last_change":"2024-05-08T18:50:26.012375+0000","last_active":"2024-05-08T18:53:34.816333+0000","last_peered":"2024-05-08T18:53:34.816333+0000","last_clean":"2024-05-08T18:53:34.816333+0000","last_became_active":"2024-05-08T18:50:26.011299+0000","last_became_peered":"2024-05-08T18:50:26.011299+0000","last_unstale":"2024-05-08T18:53:34.816333+0000","last_undegraded":"2024-05-08T18:53:34.816333+0000","last_fullsized":"2024-05-08T18:53:34.816333+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:55.127436+0000","last_change":"2024-05-08T18:53:55.127480+0000","last_active":"2024-05-08T18:53:55.127436+0000","last_peered":"2024-05-08T18:53:55.127436+0000","last_clean":"2024-05-08T18:53:55.127436+0000","last_became_active":"2024-05-08T18:50:30.032578+0000","last_became_peered":"2024-05-08T18:50:30.032578+0000","last_unstale":"2024-05-08T18:53:55.127436+0000","last_undegraded":"2024-05-08T18:53:55.127436+0000","last_fullsized":"2024-05-08T18:53:55.127436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-08T18:53:55.127322+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-08T18:53:55.127322+0000","last_clean_scrub_stamp":"2024-05-08T18:53:55.127322+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:53.840153+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"27'42","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:13.094540+0000","last_change":"2024-05-08T18:54:13.094581+0000","last_active":"2024-05-08T18:54:13.094540+0000","last_peered":"2024-05-08T18:54:13.094540+0000","last_clean":"2024-05-08T18:54:13.094540+0000","last_became_active":"2024-05-08T18:50:32.042700+0000","last_became_peered":"2024-05-08T18:50:32.042700+0000","last_unstale":"2024-05-08T18:54:13.094540+0000","last_undegraded":"2024-05-08T18:54:13.094540+0000","last_fullsized":"2024-05-08T18:54:13.094540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-05-08T18:54:13.094441+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-05-08T18:54:13.094441+0000","last_clean_scrub_stamp":"2024-05-08T18:54:13.094441+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:24.214241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":49,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:48.036967+0000","last_change":"2024-05-08T18:53:48.036991+0000","last_active":"2024-05-08T18:53:48.036967+0000","last_peered":"2024-05-08T18:53:48.036967+0000","last_clean":"2024-05-08T18:53:48.036967+0000","last_became_active":"2024-05-08T18:50:34.044872+0000","last_became_peered":"2024-05-08T18:50:34.044872+0000","last_unstale":"2024-05-08T18:53:48.036967+0000","last_undegraded":"2024-05-08T18:53:48.036967+0000","last_fullsized":"2024-05-08T18:53:48.036967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:48.036872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:48.036872+0000","last_clean_scrub_stamp":"2024-05-08T18:53:48.036872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:38.478912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"27'2","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.009385+0000","last_change":"2024-05-08T18:50:36.055685+0000","last_active":"2024-05-08T18:52:58.009385+0000","last_peered":"2024-05-08T18:52:58.009385+0000","last_clean":"2024-05-08T18:52:58.009385+0000","last_became_active":"2024-05-08T18:50:36.055188+0000","last_became_peered":"2024-05-08T18:50:36.055188+0000","last_unstale":"2024-05-08T18:52:58.009385+0000","last_undegraded":"2024-05-08T18:52:58.009385+0000","last_fullsized":"2024-05-08T18:52:58.009385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"27'12","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:04.981856+0000","last_change":"2024-05-08T18:54:04.981908+0000","last_active":"2024-05-08T18:54:04.981856+0000","last_peered":"2024-05-08T18:54:04.981856+0000","last_clean":"2024-05-08T18:54:04.981856+0000","last_became_active":"2024-05-08T18:50:28.039290+0000","last_became_peered":"2024-05-08T18:50:28.039290+0000","last_unstale":"2024-05-08T18:54:04.981856+0000","last_undegraded":"2024-05-08T18:54:04.981856+0000","last_fullsized":"2024-05-08T18:54:04.981856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-08T18:54:04.981738+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-08T18:54:04.981738+0000","last_clean_scrub_stamp":"2024-05-08T18:54:04.981738+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:48.530318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"27'3","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.004487+0000","last_change":"2024-05-08T18:50:26.019000+0000","last_active":"2024-05-08T18:52:33.004487+0000","last_peered":"2024-05-08T18:52:33.004487+0000","last_clean":"2024-05-08T18:52:33.004487+0000","last_became_active":"2024-05-08T18:50:26.018713+0000","last_became_peered":"2024-05-08T18:50:26.018713+0000","last_unstale":"2024-05-08T18:52:33.004487+0000","last_undegraded":"2024-05-08T18:52:33.004487+0000","last_fullsized":"2024-05-08T18:52:33.004487+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"27'5","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.936932+0000","last_change":"2024-05-08T18:50:28.026675+0000","last_active":"2024-05-08T18:53:34.936932+0000","last_peered":"2024-05-08T18:53:34.936932+0000","last_clean":"2024-05-08T18:53:34.936932+0000","last_became_active":"2024-05-08T18:50:28.026292+0000","last_became_peered":"2024-05-08T18:50:28.026292+0000","last_unstale":"2024-05-08T18:53:34.936932+0000","last_undegraded":"2024-05-08T18:53:34.936932+0000","last_fullsized":"2024-05-08T18:53:34.936932+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.000365+0000","last_change":"2024-05-08T18:50:26.013052+0000","last_active":"2024-05-08T18:52:33.000365+0000","last_peered":"2024-05-08T18:52:33.000365+0000","last_clean":"2024-05-08T18:52:33.000365+0000","last_became_active":"2024-05-08T18:50:26.012760+0000","last_became_peered":"2024-05-08T18:50:26.012760+0000","last_unstale":"2024-05-08T18:52:33.000365+0000","last_undegraded":"2024-05-08T18:52:33.000365+0000","last_fullsized":"2024-05-08T18:52:33.000365+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'4","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.998032+0000","last_change":"2024-05-08T18:53:58.998059+0000","last_active":"2024-05-08T18:53:58.998032+0000","last_peered":"2024-05-08T18:53:58.998032+0000","last_clean":"2024-05-08T18:53:58.998032+0000","last_became_active":"2024-05-08T18:50:28.038785+0000","last_became_peered":"2024-05-08T18:50:28.038785+0000","last_unstale":"2024-05-08T18:53:58.998032+0000","last_undegraded":"2024-05-08T18:53:58.998032+0000","last_fullsized":"2024-05-08T18:53:58.998032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:53:58.997912+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:53:58.997912+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.997912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:10.188121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"25'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.005297+0000","last_change":"2024-05-08T18:50:26.026716+0000","last_active":"2024-05-08T18:52:33.005297+0000","last_peered":"2024-05-08T18:52:33.005297+0000","last_clean":"2024-05-08T18:52:33.005297+0000","last_became_active":"2024-05-08T18:50:26.025958+0000","last_became_peered":"2024-05-08T18:50:26.025958+0000","last_unstale":"2024-05-08T18:52:33.005297+0000","last_undegraded":"2024-05-08T18:52:33.005297+0000","last_fullsized":"2024-05-08T18:52:33.005297+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"27'6","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.868472+0000","last_change":"2024-05-08T18:50:28.026318+0000","last_active":"2024-05-08T18:53:34.868472+0000","last_peered":"2024-05-08T18:53:34.868472+0000","last_clean":"2024-05-08T18:53:34.868472+0000","last_became_active":"2024-05-08T18:50:28.025866+0000","last_became_peered":"2024-05-08T18:50:28.025866+0000","last_unstale":"2024-05-08T18:53:34.868472+0000","last_undegraded":"2024-05-08T18:53:34.868472+0000","last_fullsized":"2024-05-08T18:53:34.868472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:33.000410+0000","last_change":"2024-05-08T18:50:26.025390+0000","last_active":"2024-05-08T18:52:33.000410+0000","last_peered":"2024-05-08T18:52:33.000410+0000","last_clean":"2024-05-08T18:52:33.000410+0000","last_became_active":"2024-05-08T18:50:26.025120+0000","last_became_peered":"2024-05-08T18:50:26.025120+0000","last_unstale":"2024-05-08T18:52:33.000410+0000","last_undegraded":"2024-05-08T18:52:33.000410+0000","last_fullsized":"2024-05-08T18:52:33.000410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"27'8","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.696280+0000","last_change":"2024-05-08T18:50:28.025392+0000","last_active":"2024-05-08T18:53:34.696280+0000","last_peered":"2024-05-08T18:53:34.696280+0000","last_clean":"2024-05-08T18:53:34.696280+0000","last_became_active":"2024-05-08T18:50:28.025098+0000","last_became_peered":"2024-05-08T18:50:28.025098+0000","last_unstale":"2024-05-08T18:53:34.696280+0000","last_undegraded":"2024-05-08T18:53:34.696280+0000","last_fullsized":"2024-05-08T18:53:34.696280+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.489721+0000","last_change":"2024-05-08T18:50:26.014734+0000","last_active":"2024-05-08T18:53:41.489721+0000","last_peered":"2024-05-08T18:53:41.489721+0000","last_clean":"2024-05-08T18:53:41.489721+0000","last_became_active":"2024-05-08T18:50:26.014434+0000","last_became_peered":"2024-05-08T18:50:26.014434+0000","last_unstale":"2024-05-08T18:53:41.489721+0000","last_undegraded":"2024-05-08T18:53:41.489721+0000","last_fullsized":"2024-05-08T18:53:41.489721+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"27'10","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:10.981310+0000","last_change":"2024-05-08T18:54:10.981338+0000","last_active":"2024-05-08T18:54:10.981310+0000","last_peered":"2024-05-08T18:54:10.981310+0000","last_clean":"2024-05-08T18:54:10.981310+0000","last_became_active":"2024-05-08T18:50:28.037400+0000","last_became_peered":"2024-05-08T18:50:28.037400+0000","last_unstale":"2024-05-08T18:54:10.981310+0000","last_undegraded":"2024-05-08T18:54:10.981310+0000","last_fullsized":"2024-05-08T18:54:10.981310+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:10.981224+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:10.981224+0000","last_clean_scrub_stamp":"2024-05-08T18:54:10.981224+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:30.981744+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.005662+0000","last_change":"2024-05-08T18:50:26.029481+0000","last_active":"2024-05-08T18:52:38.005662+0000","last_peered":"2024-05-08T18:52:38.005662+0000","last_clean":"2024-05-08T18:52:38.005662+0000","last_became_active":"2024-05-08T18:50:26.029047+0000","last_became_peered":"2024-05-08T18:50:26.029047+0000","last_unstale":"2024-05-08T18:52:38.005662+0000","last_undegraded":"2024-05-08T18:52:38.005662+0000","last_fullsized":"2024-05-08T18:52:38.005662+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:18.166185+0000","last_change":"2024-05-08T18:54:18.166245+0000","last_active":"2024-05-08T18:54:18.166185+0000","last_peered":"2024-05-08T18:54:18.166185+0000","last_clean":"2024-05-08T18:54:18.166185+0000","last_became_active":"2024-05-08T18:50:28.021140+0000","last_became_peered":"2024-05-08T18:50:28.021140+0000","last_unstale":"2024-05-08T18:54:18.166185+0000","last_undegraded":"2024-05-08T18:54:18.166185+0000","last_fullsized":"2024-05-08T18:54:18.166185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:18.166058+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:18.166058+0000","last_clean_scrub_stamp":"2024-05-08T18:54:18.166058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:46.962267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:16.964483+0000","last_change":"2024-05-08T18:54:16.964506+0000","last_active":"2024-05-08T18:54:16.964483+0000","last_peered":"2024-05-08T18:54:16.964483+0000","last_clean":"2024-05-08T18:54:16.964483+0000","last_became_active":"2024-05-08T18:50:26.031680+0000","last_became_peered":"2024-05-08T18:50:26.031680+0000","last_unstale":"2024-05-08T18:54:16.964483+0000","last_undegraded":"2024-05-08T18:54:16.964483+0000","last_fullsized":"2024-05-08T18:54:16.964483+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:16.964394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:16.964394+0000","last_clean_scrub_stamp":"2024-05-08T18:54:16.964394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:30.908518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"27'12","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:14.000829+0000","last_change":"2024-05-08T18:54:14.000877+0000","last_active":"2024-05-08T18:54:14.000829+0000","last_peered":"2024-05-08T18:54:14.000829+0000","last_clean":"2024-05-08T18:54:14.000829+0000","last_became_active":"2024-05-08T18:50:28.021588+0000","last_became_peered":"2024-05-08T18:50:28.021588+0000","last_unstale":"2024-05-08T18:54:14.000829+0000","last_undegraded":"2024-05-08T18:54:14.000829+0000","last_fullsized":"2024-05-08T18:54:14.000829+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-08T18:54:14.000720+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-08T18:54:14.000720+0000","last_clean_scrub_stamp":"2024-05-08T18:54:14.000720+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:24:23.994147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.001143+0000","last_change":"2024-05-08T18:50:26.014622+0000","last_active":"2024-05-08T18:52:38.001143+0000","last_peered":"2024-05-08T18:52:38.001143+0000","last_clean":"2024-05-08T18:52:38.001143+0000","last_became_active":"2024-05-08T18:50:26.014383+0000","last_became_peered":"2024-05-08T18:50:26.014383+0000","last_unstale":"2024-05-08T18:52:38.001143+0000","last_undegraded":"2024-05-08T18:52:38.001143+0000","last_fullsized":"2024-05-08T18:52:38.001143+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.936702+0000","last_change":"2024-05-08T18:50:28.032443+0000","last_active":"2024-05-08T18:53:34.936702+0000","last_peered":"2024-05-08T18:53:34.936702+0000","last_clean":"2024-05-08T18:53:34.936702+0000","last_became_active":"2024-05-08T18:50:28.032181+0000","last_became_peered":"2024-05-08T18:50:28.032181+0000","last_unstale":"2024-05-08T18:53:34.936702+0000","last_undegraded":"2024-05-08T18:53:34.936702+0000","last_fullsized":"2024-05-08T18:53:34.936702+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.496383+0000","last_change":"2024-05-08T18:50:26.025793+0000","last_active":"2024-05-08T18:53:41.496383+0000","last_peered":"2024-05-08T18:53:41.496383+0000","last_clean":"2024-05-08T18:53:41.496383+0000","last_became_active":"2024-05-08T18:50:26.025473+0000","last_became_peered":"2024-05-08T18:50:26.025473+0000","last_unstale":"2024-05-08T18:53:41.496383+0000","last_undegraded":"2024-05-08T18:53:41.496383+0000","last_fullsized":"2024-05-08T18:53:41.496383+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'4","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.868764+0000","last_change":"2024-05-08T18:50:28.032744+0000","last_active":"2024-05-08T18:53:34.868764+0000","last_peered":"2024-05-08T18:53:34.868764+0000","last_clean":"2024-05-08T18:53:34.868764+0000","last_became_active":"2024-05-08T18:50:28.032462+0000","last_became_peered":"2024-05-08T18:50:28.032462+0000","last_unstale":"2024-05-08T18:53:34.868764+0000","last_undegraded":"2024-05-08T18:53:34.868764+0000","last_fullsized":"2024-05-08T18:53:34.868764+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.001795+0000","last_change":"2024-05-08T18:50:26.019960+0000","last_active":"2024-05-08T18:52:43.001795+0000","last_peered":"2024-05-08T18:52:43.001795+0000","last_clean":"2024-05-08T18:52:43.001795+0000","last_became_active":"2024-05-08T18:50:26.019706+0000","last_became_peered":"2024-05-08T18:50:26.019706+0000","last_unstale":"2024-05-08T18:52:43.001795+0000","last_undegraded":"2024-05-08T18:52:43.001795+0000","last_fullsized":"2024-05-08T18:52:43.001795+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"27'2","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:14.148414+0000","last_change":"2024-05-08T18:54:14.148450+0000","last_active":"2024-05-08T18:54:14.148414+0000","last_peered":"2024-05-08T18:54:14.148414+0000","last_clean":"2024-05-08T18:54:14.148414+0000","last_became_active":"2024-05-08T18:50:28.031188+0000","last_became_peered":"2024-05-08T18:50:28.031188+0000","last_unstale":"2024-05-08T18:54:14.148414+0000","last_undegraded":"2024-05-08T18:54:14.148414+0000","last_fullsized":"2024-05-08T18:54:14.148414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:14.148328+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:14.148328+0000","last_clean_scrub_stamp":"2024-05-08T18:54:14.148328+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:04.976161+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006306+0000","last_change":"2024-05-08T18:50:26.025601+0000","last_active":"2024-05-08T18:52:43.006306+0000","last_peered":"2024-05-08T18:52:43.006306+0000","last_clean":"2024-05-08T18:52:43.006306+0000","last_became_active":"2024-05-08T18:50:26.024808+0000","last_became_peered":"2024-05-08T18:50:26.024808+0000","last_unstale":"2024-05-08T18:52:43.006306+0000","last_undegraded":"2024-05-08T18:52:43.006306+0000","last_fullsized":"2024-05-08T18:52:43.006306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"27'6","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:15.931056+0000","last_change":"2024-05-08T18:54:15.931086+0000","last_active":"2024-05-08T18:54:15.931056+0000","last_peered":"2024-05-08T18:54:15.931056+0000","last_clean":"2024-05-08T18:54:15.931056+0000","last_became_active":"2024-05-08T18:50:28.022905+0000","last_became_peered":"2024-05-08T18:50:28.022905+0000","last_unstale":"2024-05-08T18:54:15.931056+0000","last_undegraded":"2024-05-08T18:54:15.931056+0000","last_fullsized":"2024-05-08T18:54:15.931056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:15.930946+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:15.930946+0000","last_clean_scrub_stamp":"2024-05-08T18:54:15.930946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:23.850615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006380+0000","last_change":"2024-05-08T18:50:26.025267+0000","last_active":"2024-05-08T18:52:43.006380+0000","last_peered":"2024-05-08T18:52:43.006380+0000","last_clean":"2024-05-08T18:52:43.006380+0000","last_became_active":"2024-05-08T18:50:26.024977+0000","last_became_peered":"2024-05-08T18:50:26.024977+0000","last_unstale":"2024-05-08T18:52:43.006380+0000","last_undegraded":"2024-05-08T18:52:43.006380+0000","last_fullsized":"2024-05-08T18:52:43.006380+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:13.006755+0000","last_change":"2024-05-08T18:54:13.006779+0000","last_active":"2024-05-08T18:54:13.006755+0000","last_peered":"2024-05-08T18:54:13.006755+0000","last_clean":"2024-05-08T18:54:13.006755+0000","last_became_active":"2024-05-08T18:50:28.037153+0000","last_became_peered":"2024-05-08T18:50:28.037153+0000","last_unstale":"2024-05-08T18:54:13.006755+0000","last_undegraded":"2024-05-08T18:54:13.006755+0000","last_fullsized":"2024-05-08T18:54:13.006755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:13.006667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:13.006667+0000","last_clean_scrub_stamp":"2024-05-08T18:54:13.006667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:00.529680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006824+0000","last_change":"2024-05-08T18:50:26.012280+0000","last_active":"2024-05-08T18:52:43.006824+0000","last_peered":"2024-05-08T18:52:43.006824+0000","last_clean":"2024-05-08T18:52:43.006824+0000","last_became_active":"2024-05-08T18:50:26.011982+0000","last_became_peered":"2024-05-08T18:50:26.011982+0000","last_unstale":"2024-05-08T18:52:43.006824+0000","last_undegraded":"2024-05-08T18:52:43.006824+0000","last_fullsized":"2024-05-08T18:52:43.006824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"27'8","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006326+0000","last_change":"2024-05-08T18:50:28.028689+0000","last_active":"2024-05-08T18:52:43.006326+0000","last_peered":"2024-05-08T18:52:43.006326+0000","last_clean":"2024-05-08T18:52:43.006326+0000","last_became_active":"2024-05-08T18:50:28.028405+0000","last_became_peered":"2024-05-08T18:50:28.028405+0000","last_unstale":"2024-05-08T18:52:43.006326+0000","last_undegraded":"2024-05-08T18:52:43.006326+0000","last_fullsized":"2024-05-08T18:52:43.006326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006862+0000","last_change":"2024-05-08T18:50:26.023917+0000","last_active":"2024-05-08T18:52:43.006862+0000","last_peered":"2024-05-08T18:52:43.006862+0000","last_clean":"2024-05-08T18:52:43.006862+0000","last_became_active":"2024-05-08T18:50:26.023658+0000","last_became_peered":"2024-05-08T18:50:26.023658+0000","last_unstale":"2024-05-08T18:52:43.006862+0000","last_undegraded":"2024-05-08T18:52:43.006862+0000","last_fullsized":"2024-05-08T18:52:43.006862+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"25'4","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006754+0000","last_change":"2024-05-08T18:50:28.032840+0000","last_active":"2024-05-08T18:52:43.006754+0000","last_peered":"2024-05-08T18:52:43.006754+0000","last_clean":"2024-05-08T18:52:43.006754+0000","last_became_active":"2024-05-08T18:50:28.032552+0000","last_became_peered":"2024-05-08T18:50:28.032552+0000","last_unstale":"2024-05-08T18:52:43.006754+0000","last_undegraded":"2024-05-08T18:52:43.006754+0000","last_fullsized":"2024-05-08T18:52:43.006754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:12.958318+0000","last_change":"2024-05-08T18:54:12.958343+0000","last_active":"2024-05-08T18:54:12.958318+0000","last_peered":"2024-05-08T18:54:12.958318+0000","last_clean":"2024-05-08T18:54:12.958318+0000","last_became_active":"2024-05-08T18:50:26.032385+0000","last_became_peered":"2024-05-08T18:50:26.032385+0000","last_unstale":"2024-05-08T18:54:12.958318+0000","last_undegraded":"2024-05-08T18:54:12.958318+0000","last_fullsized":"2024-05-08T18:54:12.958318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:12.958227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:12.958227+0000","last_clean_scrub_stamp":"2024-05-08T18:54:12.958227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:22.832530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"27'6","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:19.850035+0000","last_change":"2024-05-08T18:54:19.850079+0000","last_active":"2024-05-08T18:54:19.850035+0000","last_peered":"2024-05-08T18:54:19.850035+0000","last_clean":"2024-05-08T18:54:19.850035+0000","last_became_active":"2024-05-08T18:50:28.023807+0000","last_became_peered":"2024-05-08T18:50:28.023807+0000","last_unstale":"2024-05-08T18:54:19.850035+0000","last_undegraded":"2024-05-08T18:54:19.850035+0000","last_fullsized":"2024-05-08T18:54:19.850035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:19.849922+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:19.849922+0000","last_clean_scrub_stamp":"2024-05-08T18:54:19.849922+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:48.646130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007840+0000","last_change":"2024-05-08T18:50:26.026065+0000","last_active":"2024-05-08T18:52:48.007840+0000","last_peered":"2024-05-08T18:52:48.007840+0000","last_clean":"2024-05-08T18:52:48.007840+0000","last_became_active":"2024-05-08T18:50:26.025023+0000","last_became_peered":"2024-05-08T18:50:26.025023+0000","last_unstale":"2024-05-08T18:52:48.007840+0000","last_undegraded":"2024-05-08T18:52:48.007840+0000","last_fullsized":"2024-05-08T18:52:48.007840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'6","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007502+0000","last_change":"2024-05-08T18:50:26.026599+0000","last_active":"2024-05-08T18:52:48.007502+0000","last_peered":"2024-05-08T18:52:48.007502+0000","last_clean":"2024-05-08T18:52:48.007502+0000","last_became_active":"2024-05-08T18:50:26.026333+0000","last_became_peered":"2024-05-08T18:50:26.026333+0000","last_unstale":"2024-05-08T18:52:48.007502+0000","last_undegraded":"2024-05-08T18:52:48.007502+0000","last_fullsized":"2024-05-08T18:52:48.007502+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"25'4","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.003310+0000","last_change":"2024-05-08T18:50:28.024946+0000","last_active":"2024-05-08T18:52:53.003310+0000","last_peered":"2024-05-08T18:52:53.003310+0000","last_clean":"2024-05-08T18:52:53.003310+0000","last_became_active":"2024-05-08T18:50:28.024627+0000","last_became_peered":"2024-05-08T18:50:28.024627+0000","last_unstale":"2024-05-08T18:52:53.003310+0000","last_undegraded":"2024-05-08T18:52:53.003310+0000","last_fullsized":"2024-05-08T18:52:53.003310+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'4","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.493958+0000","last_change":"2024-05-08T18:50:26.025142+0000","last_active":"2024-05-08T18:53:41.493958+0000","last_peered":"2024-05-08T18:53:41.493958+0000","last_clean":"2024-05-08T18:53:41.493958+0000","last_became_active":"2024-05-08T18:50:26.024839+0000","last_became_peered":"2024-05-08T18:50:26.024839+0000","last_unstale":"2024-05-08T18:53:41.493958+0000","last_undegraded":"2024-05-08T18:53:41.493958+0000","last_fullsized":"2024-05-08T18:53:41.493958+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'8","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:09.980517+0000","last_change":"2024-05-08T18:54:09.980547+0000","last_active":"2024-05-08T18:54:09.980517+0000","last_peered":"2024-05-08T18:54:09.980517+0000","last_clean":"2024-05-08T18:54:09.980517+0000","last_became_active":"2024-05-08T18:50:28.038677+0000","last_became_peered":"2024-05-08T18:50:28.038677+0000","last_unstale":"2024-05-08T18:54:09.980517+0000","last_undegraded":"2024-05-08T18:54:09.980517+0000","last_fullsized":"2024-05-08T18:54:09.980517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:09.980433+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:09.980433+0000","last_clean_scrub_stamp":"2024-05-08T18:54:09.980433+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:23.924556+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1522,"ondisk_log_size":1522,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1601,"num_read_kb":1491,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705716,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39904,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331936,"statfs":{"total":96636764160,"available":96595902464,"internally_reserved":0,"allocated":417792,"data_stored":121043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705717,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36256,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335584,"statfs":{"total":96636764160,"available":96599638016,"internally_reserved":0,"allocated":942080,"data_stored":707921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705716,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36284,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335556,"statfs":{"total":96636764160,"available":96599609344,"internally_reserved":0,"allocated":970752,"data_stored":708927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705716,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":380928,"data_stored":119875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:54:27.038 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.038 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.038 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.038 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.039 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.039 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.039 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.039 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.039 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.039 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.039 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.040 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.040 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.040 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.040 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.040 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.040 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.040 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.041 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.041 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.041 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.041 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.041 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.041 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.042 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.042 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.042 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.042 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.042 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.042 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.043 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.043 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.043 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.043 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.043 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.043 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.044 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.044 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.044 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.044 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.044 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.045 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.045 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.045 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.045 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.045 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.045 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.045 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.046 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.046 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.046 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.046 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.046 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.046 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.046 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.047 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.047 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.047 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.047 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.047 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.047 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.047 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.048 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.048 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.048 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.048 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.048 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.048 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.049 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.049 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.049 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.049 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.049 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.049 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.050 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.050 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.050 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.050 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.050 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.051 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.051 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.051 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.051 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.051 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.051 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.051 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.052 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.052 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.052 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.052 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.052 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.052 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.053 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.053 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.053 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.053 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.053 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.053 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.053 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.053 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.053 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.054 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.054 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.054 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.054 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.054 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.054 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.054 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.054 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.055 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.055 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.055 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.055 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:27.055 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T18:54:47.056 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:54:47.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.173+0000 7fd192259640 1 Processor -- start 2024-05-08T18:54:47.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.173+0000 7fd192259640 1 -- start start 2024-05-08T18:54:47.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.173+0000 7fd192259640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd18c06fe20 0x7fd18c128e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:54:47.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.173+0000 7fd192259640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd18c072dc0 con 0x7fd18c129390 2024-05-08T18:54:47.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.173+0000 7fd192259640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fd18c128ad0 con 0x7fd18c06fe20 2024-05-08T18:54:47.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.173+0000 7fd18b7fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd18c06fe20 0x7fd18c128e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:54:47.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.173+0000 7fd18affd640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd18c129390 0x7fd18c12c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:53578/0 (socket says 172.21.15.42:53578) 2024-05-08T18:54:47.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.174+0000 7fd18affd640 1 -- 172.21.15.42:0/2628040497 learned_addr learned my addr 172.21.15.42:0/2628040497 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:54:47.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.174+0000 7fd18b7fe640 1 -- 172.21.15.42:0/2628040497 >> v1:172.21.15.42:6789/0 conn(0x7fd18c129390 legacy=0x7fd18c12c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:54:47.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.174+0000 7fd18a7fc640 1 -- 172.21.15.42:0/2628040497 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3727415283 0 0) 0x7fd18c072dc0 con 0x7fd18c129390 2024-05-08T18:54:47.173 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.174+0000 7fd18b7fe640 1 -- 172.21.15.42:0/2628040497 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18c0739e0 con 0x7fd18c06fe20 2024-05-08T18:54:47.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.175+0000 7fd18b7fe640 1 --2- 172.21.15.42:0/2628040497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd18c06fe20 0x7fd18c128e50 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd17c009720 tx=0x7fd17c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969f9c60372afb71 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:54:47.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.175+0000 7fd18a7fc640 1 -- 172.21.15.42:0/2628040497 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd17c0316d0 con 0x7fd18c06fe20 2024-05-08T18:54:47.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.175+0000 7fd18a7fc640 1 -- 172.21.15.42:0/2628040497 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd17c037070 con 0x7fd18c06fe20 2024-05-08T18:54:47.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.175+0000 7fd18a7fc640 1 -- 172.21.15.42:0/2628040497 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd17c0319c0 con 0x7fd18c06fe20 2024-05-08T18:54:47.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.175+0000 7fd192259640 1 -- 172.21.15.42:0/2628040497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd18c06fe20 msgr2=0x7fd18c128e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:54:47.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.175+0000 7fd192259640 1 --2- 172.21.15.42:0/2628040497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd18c06fe20 0x7fd18c128e50 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd17c009720 tx=0x7fd17c02b840 comp rx=0 tx=0).stop 2024-05-08T18:54:47.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.175+0000 7fd192259640 1 -- 172.21.15.42:0/2628040497 shutdown_connections 2024-05-08T18:54:47.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.175+0000 7fd192259640 1 --2- 172.21.15.42:0/2628040497 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd18c06fe20 0x7fd18c128e50 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:54:47.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.175+0000 7fd192259640 1 -- 172.21.15.42:0/2628040497 >> 172.21.15.42:0/2628040497 conn(0x7fd18c09a910 msgr2=0x7fd18c06e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:54:47.175 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.175+0000 7fd192259640 1 -- 172.21.15.42:0/2628040497 shutdown_connections 2024-05-08T18:54:47.176 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.175+0000 7fd192259640 1 -- 172.21.15.42:0/2628040497 wait complete. 2024-05-08T18:54:47.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.176+0000 7fd192259640 1 Processor -- start 2024-05-08T18:54:47.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.177+0000 7fd192259640 1 -- start start 2024-05-08T18:54:47.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.177+0000 7fd192259640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd18c06fe20 0x7fd18c1151c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:54:47.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.177+0000 7fd192259640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fd18c1299a0 con 0x7fd18c06fe20 2024-05-08T18:54:47.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.177+0000 7fd18b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd18c06fe20 0x7fd18c1151c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:54:47.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.177+0000 7fd18b7fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd18c06fe20 0x7fd18c1151c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37830/0 (socket says 172.21.15.42:37830) 2024-05-08T18:54:47.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.177+0000 7fd18b7fe640 1 -- 172.21.15.42:0/4155923896 learned_addr learned my addr 172.21.15.42:0/4155923896 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:54:47.177 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.177+0000 7fd18b7fe640 1 -- 172.21.15.42:0/4155923896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18c1171a0 con 0x7fd18c06fe20 2024-05-08T18:54:47.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.178+0000 7fd18b7fe640 1 --2- 172.21.15.42:0/4155923896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd18c06fe20 0x7fd18c1151c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd17c034040 tx=0x7fd17c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:54:47.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.178+0000 7fd173fff640 1 -- 172.21.15.42:0/4155923896 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd17c032770 con 0x7fd18c06fe20 2024-05-08T18:54:47.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.178+0000 7fd173fff640 1 -- 172.21.15.42:0/4155923896 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd17c032910 con 0x7fd18c06fe20 2024-05-08T18:54:47.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.178+0000 7fd173fff640 1 -- 172.21.15.42:0/4155923896 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd17c032c30 con 0x7fd18c06fe20 2024-05-08T18:54:47.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.178+0000 7fd192259640 1 -- 172.21.15.42:0/4155923896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd18c122ac0 con 0x7fd18c06fe20 2024-05-08T18:54:47.178 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.178+0000 7fd192259640 1 -- 172.21.15.42:0/4155923896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd18c118010 con 0x7fd18c06fe20 2024-05-08T18:54:47.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.179+0000 7fd173fff640 1 -- 172.21.15.42:0/4155923896 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fd17c04c060 con 0x7fd18c06fe20 2024-05-08T18:54:47.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.179+0000 7fd192259640 1 -- 172.21.15.42:0/4155923896 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd18c064010 con 0x7fd18c06fe20 2024-05-08T18:54:47.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.179+0000 7fd173fff640 1 --2- 172.21.15.42:0/4155923896 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd17803d2b0 0x7fd17803f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:54:47.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.179+0000 7fd173fff640 1 -- 172.21.15.42:0/4155923896 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fd17c02f050 con 0x7fd18c06fe20 2024-05-08T18:54:47.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.180+0000 7fd18affd640 1 --2- 172.21.15.42:0/4155923896 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd17803d2b0 0x7fd17803f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:54:47.179 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.180+0000 7fd18affd640 1 --2- 172.21.15.42:0/4155923896 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd17803d2b0 0x7fd17803f770 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd180000f60 tx=0x7fd180009b80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:54:47.183 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.184+0000 7fd173fff640 1 -- 172.21.15.42:0/4155923896 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fd17c040070 con 0x7fd18c06fe20 2024-05-08T18:54:47.370 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.371+0000 7fd192259640 1 -- 172.21.15.42:0/4155923896 --> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd18c117970 con 0x7fd17803d2b0 2024-05-08T18:54:47.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.386+0000 7fd173fff640 1 -- 172.21.15.42:0/4155923896 <== mgr.4102 v2:172.21.15.132:6824/2104266563 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664423 (secure 0 0 0) 0x7fd18c117970 con 0x7fd17803d2b0 2024-05-08T18:54:47.393 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:54:47.398 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-08T18:54:47.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.391+0000 7fd192259640 1 -- 172.21.15.42:0/4155923896 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd17803d2b0 msgr2=0x7fd17803f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:54:47.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.391+0000 7fd192259640 1 --2- 172.21.15.42:0/4155923896 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd17803d2b0 0x7fd17803f770 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd180000f60 tx=0x7fd180009b80 comp rx=0 tx=0).stop 2024-05-08T18:54:47.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.391+0000 7fd192259640 1 -- 172.21.15.42:0/4155923896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd18c06fe20 msgr2=0x7fd18c1151c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:54:47.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.391+0000 7fd192259640 1 --2- 172.21.15.42:0/4155923896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd18c06fe20 0x7fd18c1151c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd17c034040 tx=0x7fd17c0046c0 comp rx=0 tx=0).stop 2024-05-08T18:54:47.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.391+0000 7fd192259640 1 -- 172.21.15.42:0/4155923896 shutdown_connections 2024-05-08T18:54:47.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.391+0000 7fd192259640 1 --2- 172.21.15.42:0/4155923896 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fd17803d2b0 0x7fd17803f770 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:54:47.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.391+0000 7fd192259640 1 --2- 172.21.15.42:0/4155923896 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd18c06fe20 0x7fd18c1151c0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:54:47.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.391+0000 7fd192259640 1 -- 172.21.15.42:0/4155923896 >> 172.21.15.42:0/4155923896 conn(0x7fd18c09a910 msgr2=0x7fd18c09bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:54:47.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.391+0000 7fd192259640 1 -- 172.21.15.42:0/4155923896 shutdown_connections 2024-05-08T18:54:47.401 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:54:47.391+0000 7fd192259640 1 -- 172.21.15.42:0/4155923896 wait complete. 2024-05-08T18:54:47.402 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-05-08T18:54:46.007389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5031,"num_read_kb":4621,"num_write":2119,"num_write_kb":60585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4734,"ondisk_log_size":4734,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":143992,"kb_used_data":2648,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343368,"statfs":{"total":386547056640,"available":386399608832,"internally_reserved":0,"allocated":2711552,"data_stored":1657766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003807"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:20.917462+0000","last_change":"2024-05-08T18:54:20.917462+0000","last_active":"2024-05-08T18:54:20.917462+0000","last_peered":"2024-05-08T18:54:20.917462+0000","last_clean":"2024-05-08T18:54:20.917462+0000","last_became_active":"2024-05-08T18:50:26.031359+0000","last_became_peered":"2024-05-08T18:50:26.031359+0000","last_unstale":"2024-05-08T18:54:20.917462+0000","last_undegraded":"2024-05-08T18:54:20.917462+0000","last_fullsized":"2024-05-08T18:54:20.917462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:20.917335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:20.917335+0000","last_clean_scrub_stamp":"2024-05-08T18:54:20.917335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:04.286184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"27'8","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:23.788793+0000","last_change":"2024-05-08T18:54:23.788822+0000","last_active":"2024-05-08T18:54:23.788793+0000","last_peered":"2024-05-08T18:54:23.788793+0000","last_clean":"2024-05-08T18:54:23.788793+0000","last_became_active":"2024-05-08T18:50:28.028352+0000","last_became_peered":"2024-05-08T18:50:28.028352+0000","last_unstale":"2024-05-08T18:54:23.788793+0000","last_undegraded":"2024-05-08T18:54:23.788793+0000","last_fullsized":"2024-05-08T18:54:23.788793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:23.788707+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:23.788707+0000","last_clean_scrub_stamp":"2024-05-08T18:54:23.788707+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:30:26.936915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"27'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:26.036038+0000","last_change":"2024-05-08T18:54:26.036038+0000","last_active":"2024-05-08T18:54:26.036038+0000","last_peered":"2024-05-08T18:54:26.036038+0000","last_clean":"2024-05-08T18:54:26.036038+0000","last_became_active":"2024-05-08T18:50:26.028799+0000","last_became_peered":"2024-05-08T18:50:26.028799+0000","last_unstale":"2024-05-08T18:54:26.036038+0000","last_undegraded":"2024-05-08T18:54:26.036038+0000","last_fullsized":"2024-05-08T18:54:26.036038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:26.035863+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:26.035863+0000","last_clean_scrub_stamp":"2024-05-08T18:54:26.035863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:02.859884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"27'6","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:22.049106+0000","last_change":"2024-05-08T18:54:22.049138+0000","last_active":"2024-05-08T18:54:22.049106+0000","last_peered":"2024-05-08T18:54:22.049106+0000","last_clean":"2024-05-08T18:54:22.049106+0000","last_became_active":"2024-05-08T18:50:28.033466+0000","last_became_peered":"2024-05-08T18:50:28.033466+0000","last_unstale":"2024-05-08T18:54:22.049106+0000","last_undegraded":"2024-05-08T18:54:22.049106+0000","last_fullsized":"2024-05-08T18:54:22.049106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:22.049001+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:22.049001+0000","last_clean_scrub_stamp":"2024-05-08T18:54:22.049001+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:03.232750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:23.012828+0000","last_change":"2024-05-08T18:51:15.084166+0000","last_active":"2024-05-08T18:53:23.012828+0000","last_peered":"2024-05-08T18:53:23.012828+0000","last_clean":"2024-05-08T18:53:23.012828+0000","last_became_active":"2024-05-08T18:51:15.083809+0000","last_became_peered":"2024-05-08T18:51:15.083809+0000","last_unstale":"2024-05-08T18:53:23.012828+0000","last_undegraded":"2024-05-08T18:53:23.012828+0000","last_fullsized":"2024-05-08T18:53:23.012828+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"25'2","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:44.491509+0000","last_change":"2024-05-08T18:51:15.083978+0000","last_active":"2024-05-08T18:53:44.491509+0000","last_peered":"2024-05-08T18:53:44.491509+0000","last_clean":"2024-05-08T18:53:44.491509+0000","last_became_active":"2024-05-08T18:51:15.080716+0000","last_became_peered":"2024-05-08T18:51:15.080716+0000","last_unstale":"2024-05-08T18:53:44.491509+0000","last_undegraded":"2024-05-08T18:53:44.491509+0000","last_fullsized":"2024-05-08T18:53:44.491509+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:27.002790+0000","last_clean_scrub_stamp":"2024-05-08T18:50:27.002790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:30.878537+0000","last_change":"2024-05-08T18:54:30.878562+0000","last_active":"2024-05-08T18:54:30.878537+0000","last_peered":"2024-05-08T18:54:30.878537+0000","last_clean":"2024-05-08T18:54:30.878537+0000","last_became_active":"2024-05-08T18:50:26.024243+0000","last_became_peered":"2024-05-08T18:50:26.024243+0000","last_unstale":"2024-05-08T18:54:30.878537+0000","last_undegraded":"2024-05-08T18:54:30.878537+0000","last_fullsized":"2024-05-08T18:54:30.878537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:30.878445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:30.878445+0000","last_clean_scrub_stamp":"2024-05-08T18:54:30.878445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:30:34.026653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"27'4","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:30.094768+0000","last_change":"2024-05-08T18:54:30.094795+0000","last_active":"2024-05-08T18:54:30.094768+0000","last_peered":"2024-05-08T18:54:30.094768+0000","last_clean":"2024-05-08T18:54:30.094768+0000","last_became_active":"2024-05-08T18:50:28.026380+0000","last_became_peered":"2024-05-08T18:50:28.026380+0000","last_unstale":"2024-05-08T18:54:30.094768+0000","last_undegraded":"2024-05-08T18:54:30.094768+0000","last_fullsized":"2024-05-08T18:54:30.094768+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:30.094665+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:30.094665+0000","last_clean_scrub_stamp":"2024-05-08T18:54:30.094665+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:30.168403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"25'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.009373+0000","last_change":"2024-05-08T18:50:26.023188+0000","last_active":"2024-05-08T18:52:58.009373+0000","last_peered":"2024-05-08T18:52:58.009373+0000","last_clean":"2024-05-08T18:52:58.009373+0000","last_became_active":"2024-05-08T18:50:26.022914+0000","last_became_peered":"2024-05-08T18:50:26.022914+0000","last_unstale":"2024-05-08T18:52:58.009373+0000","last_undegraded":"2024-05-08T18:52:58.009373+0000","last_fullsized":"2024-05-08T18:52:58.009373+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'6","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:17.878113+0000","last_change":"2024-05-08T18:54:17.878113+0000","last_active":"2024-05-08T18:54:17.878113+0000","last_peered":"2024-05-08T18:54:17.878113+0000","last_clean":"2024-05-08T18:54:17.878113+0000","last_became_active":"2024-05-08T18:50:28.023506+0000","last_became_peered":"2024-05-08T18:50:28.023506+0000","last_unstale":"2024-05-08T18:54:17.878113+0000","last_undegraded":"2024-05-08T18:54:17.878113+0000","last_fullsized":"2024-05-08T18:54:17.878113+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:17.877983+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:17.877983+0000","last_clean_scrub_stamp":"2024-05-08T18:54:17.877983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:50.155421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"25'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:31.877064+0000","last_change":"2024-05-08T18:54:31.877093+0000","last_active":"2024-05-08T18:54:31.877064+0000","last_peered":"2024-05-08T18:54:31.877064+0000","last_clean":"2024-05-08T18:54:31.877064+0000","last_became_active":"2024-05-08T18:50:26.024493+0000","last_became_peered":"2024-05-08T18:50:26.024493+0000","last_unstale":"2024-05-08T18:54:31.877064+0000","last_undegraded":"2024-05-08T18:54:31.877064+0000","last_fullsized":"2024-05-08T18:54:31.877064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:31.876973+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:31.876973+0000","last_clean_scrub_stamp":"2024-05-08T18:54:31.876973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:21.277118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"27'10","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:18.071888+0000","last_change":"2024-05-08T18:54:18.071888+0000","last_active":"2024-05-08T18:54:18.071888+0000","last_peered":"2024-05-08T18:54:18.071888+0000","last_clean":"2024-05-08T18:54:18.071888+0000","last_became_active":"2024-05-08T18:50:28.037266+0000","last_became_peered":"2024-05-08T18:50:28.037266+0000","last_unstale":"2024-05-08T18:54:18.071888+0000","last_undegraded":"2024-05-08T18:54:18.071888+0000","last_fullsized":"2024-05-08T18:54:18.071888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:18.071727+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:18.071727+0000","last_clean_scrub_stamp":"2024-05-08T18:54:18.071727+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:22.473146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.491075+0000","last_change":"2024-05-08T18:50:26.011072+0000","last_active":"2024-05-08T18:53:41.491075+0000","last_peered":"2024-05-08T18:53:41.491075+0000","last_clean":"2024-05-08T18:53:41.491075+0000","last_became_active":"2024-05-08T18:50:26.010734+0000","last_became_peered":"2024-05-08T18:50:26.010734+0000","last_unstale":"2024-05-08T18:53:41.491075+0000","last_undegraded":"2024-05-08T18:53:41.491075+0000","last_fullsized":"2024-05-08T18:53:41.491075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:15.936164+0000","last_change":"2024-05-08T18:54:15.936164+0000","last_active":"2024-05-08T18:54:15.936164+0000","last_peered":"2024-05-08T18:54:15.936164+0000","last_clean":"2024-05-08T18:54:15.936164+0000","last_became_active":"2024-05-08T18:50:28.026028+0000","last_became_peered":"2024-05-08T18:50:28.026028+0000","last_unstale":"2024-05-08T18:54:15.936164+0000","last_undegraded":"2024-05-08T18:54:15.936164+0000","last_fullsized":"2024-05-08T18:54:15.936164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:15.936014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:15.936014+0000","last_clean_scrub_stamp":"2024-05-08T18:54:15.936014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:46.686256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"25'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:22.076100+0000","last_change":"2024-05-08T18:54:22.076129+0000","last_active":"2024-05-08T18:54:22.076100+0000","last_peered":"2024-05-08T18:54:22.076100+0000","last_clean":"2024-05-08T18:54:22.076100+0000","last_became_active":"2024-05-08T18:50:26.029435+0000","last_became_peered":"2024-05-08T18:50:26.029435+0000","last_unstale":"2024-05-08T18:54:22.076100+0000","last_undegraded":"2024-05-08T18:54:22.076100+0000","last_fullsized":"2024-05-08T18:54:22.076100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:22.076003+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:22.076003+0000","last_clean_scrub_stamp":"2024-05-08T18:54:22.076003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:28.517889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"27'6","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:23.929209+0000","last_change":"2024-05-08T18:54:23.929209+0000","last_active":"2024-05-08T18:54:23.929209+0000","last_peered":"2024-05-08T18:54:23.929209+0000","last_clean":"2024-05-08T18:54:23.929209+0000","last_became_active":"2024-05-08T18:50:28.033311+0000","last_became_peered":"2024-05-08T18:50:28.033311+0000","last_unstale":"2024-05-08T18:54:23.929209+0000","last_undegraded":"2024-05-08T18:54:23.929209+0000","last_fullsized":"2024-05-08T18:54:23.929209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:23.929088+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:23.929088+0000","last_clean_scrub_stamp":"2024-05-08T18:54:23.929088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:53.559562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"27'10","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:23.094201+0000","last_change":"2024-05-08T18:54:23.094231+0000","last_active":"2024-05-08T18:54:23.094201+0000","last_peered":"2024-05-08T18:54:23.094201+0000","last_clean":"2024-05-08T18:54:23.094201+0000","last_became_active":"2024-05-08T18:50:28.032951+0000","last_became_peered":"2024-05-08T18:50:28.032951+0000","last_unstale":"2024-05-08T18:54:23.094201+0000","last_undegraded":"2024-05-08T18:54:23.094201+0000","last_fullsized":"2024-05-08T18:54:23.094201+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:23.094109+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:23.094109+0000","last_clean_scrub_stamp":"2024-05-08T18:54:23.094109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:00.987376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'4","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:22.772336+0000","last_change":"2024-05-08T18:54:22.772365+0000","last_active":"2024-05-08T18:54:22.772336+0000","last_peered":"2024-05-08T18:54:22.772336+0000","last_clean":"2024-05-08T18:54:22.772336+0000","last_became_active":"2024-05-08T18:50:26.030437+0000","last_became_peered":"2024-05-08T18:50:26.030437+0000","last_unstale":"2024-05-08T18:54:22.772336+0000","last_undegraded":"2024-05-08T18:54:22.772336+0000","last_fullsized":"2024-05-08T18:54:22.772336+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-08T18:54:22.772232+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-08T18:54:22.772232+0000","last_clean_scrub_stamp":"2024-05-08T18:54:22.772232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:30.535173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'22","reported_seq":116,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:21.778508+0000","last_change":"2024-05-08T18:54:21.778559+0000","last_active":"2024-05-08T18:54:21.778508+0000","last_peered":"2024-05-08T18:54:21.778508+0000","last_clean":"2024-05-08T18:54:21.778508+0000","last_became_active":"2024-05-08T18:50:28.028184+0000","last_became_peered":"2024-05-08T18:50:28.028184+0000","last_unstale":"2024-05-08T18:54:21.778508+0000","last_undegraded":"2024-05-08T18:54:21.778508+0000","last_fullsized":"2024-05-08T18:54:21.778508+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-05-08T18:54:21.778405+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-05-08T18:54:21.778405+0000","last_clean_scrub_stamp":"2024-05-08T18:54:21.778405+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:34.523219+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":94,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"27'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:14.975181+0000","last_change":"2024-05-08T18:54:14.975221+0000","last_active":"2024-05-08T18:54:14.975181+0000","last_peered":"2024-05-08T18:54:14.975181+0000","last_clean":"2024-05-08T18:54:14.975181+0000","last_became_active":"2024-05-08T18:50:26.031768+0000","last_became_peered":"2024-05-08T18:50:26.031768+0000","last_unstale":"2024-05-08T18:54:14.975181+0000","last_undegraded":"2024-05-08T18:54:14.975181+0000","last_fullsized":"2024-05-08T18:54:14.975181+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:14.975072+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:14.975072+0000","last_clean_scrub_stamp":"2024-05-08T18:54:14.975072+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:23.744293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'8","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:27.735916+0000","last_change":"2024-05-08T18:54:27.735944+0000","last_active":"2024-05-08T18:54:27.735916+0000","last_peered":"2024-05-08T18:54:27.735916+0000","last_clean":"2024-05-08T18:54:27.735916+0000","last_became_active":"2024-05-08T18:50:28.029145+0000","last_became_peered":"2024-05-08T18:50:28.029145+0000","last_unstale":"2024-05-08T18:54:27.735916+0000","last_undegraded":"2024-05-08T18:54:27.735916+0000","last_fullsized":"2024-05-08T18:54:27.735916+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:27.735826+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:27.735826+0000","last_clean_scrub_stamp":"2024-05-08T18:54:27.735826+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:04.559847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"27'4","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:20.823534+0000","last_change":"2024-05-08T18:54:20.823562+0000","last_active":"2024-05-08T18:54:20.823534+0000","last_peered":"2024-05-08T18:54:20.823534+0000","last_clean":"2024-05-08T18:54:20.823534+0000","last_became_active":"2024-05-08T18:50:26.031545+0000","last_became_peered":"2024-05-08T18:50:26.031545+0000","last_unstale":"2024-05-08T18:54:20.823534+0000","last_undegraded":"2024-05-08T18:54:20.823534+0000","last_fullsized":"2024-05-08T18:54:20.823534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:20.823443+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:20.823443+0000","last_clean_scrub_stamp":"2024-05-08T18:54:20.823443+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:58.388872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"27'16","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:21.125113+0000","last_change":"2024-05-08T18:54:21.125177+0000","last_active":"2024-05-08T18:54:21.125113+0000","last_peered":"2024-05-08T18:54:21.125113+0000","last_clean":"2024-05-08T18:54:21.125113+0000","last_became_active":"2024-05-08T18:50:28.022683+0000","last_became_peered":"2024-05-08T18:50:28.022683+0000","last_unstale":"2024-05-08T18:54:21.125113+0000","last_undegraded":"2024-05-08T18:54:21.125113+0000","last_fullsized":"2024-05-08T18:54:21.125113+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-05-08T18:54:21.125005+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-05-08T18:54:21.125005+0000","last_clean_scrub_stamp":"2024-05-08T18:54:21.125005+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.887946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:32.733387+0000","last_change":"2024-05-08T18:54:32.733415+0000","last_active":"2024-05-08T18:54:32.733387+0000","last_peered":"2024-05-08T18:54:32.733387+0000","last_clean":"2024-05-08T18:54:32.733387+0000","last_became_active":"2024-05-08T18:50:26.011512+0000","last_became_peered":"2024-05-08T18:50:26.011512+0000","last_unstale":"2024-05-08T18:54:32.733387+0000","last_undegraded":"2024-05-08T18:54:32.733387+0000","last_fullsized":"2024-05-08T18:54:32.733387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:32.733293+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:32.733293+0000","last_clean_scrub_stamp":"2024-05-08T18:54:32.733293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:47.011150+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:19.891014+0000","last_change":"2024-05-08T18:54:19.891039+0000","last_active":"2024-05-08T18:54:19.891014+0000","last_peered":"2024-05-08T18:54:19.891014+0000","last_clean":"2024-05-08T18:54:19.891014+0000","last_became_active":"2024-05-08T18:50:28.032768+0000","last_became_peered":"2024-05-08T18:50:28.032768+0000","last_unstale":"2024-05-08T18:54:19.891014+0000","last_undegraded":"2024-05-08T18:54:19.891014+0000","last_fullsized":"2024-05-08T18:54:19.891014+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:19.890923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:19.890923+0000","last_clean_scrub_stamp":"2024-05-08T18:54:19.890923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:07.413936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:24.086723+0000","last_change":"2024-05-08T18:54:24.086794+0000","last_active":"2024-05-08T18:54:24.086723+0000","last_peered":"2024-05-08T18:54:24.086723+0000","last_clean":"2024-05-08T18:54:24.086723+0000","last_became_active":"2024-05-08T18:50:26.029015+0000","last_became_peered":"2024-05-08T18:50:26.029015+0000","last_unstale":"2024-05-08T18:54:24.086723+0000","last_undegraded":"2024-05-08T18:54:24.086723+0000","last_fullsized":"2024-05-08T18:54:24.086723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:24.086613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:24.086613+0000","last_clean_scrub_stamp":"2024-05-08T18:54:24.086613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:17:23.170101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"27'14","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:14.955599+0000","last_change":"2024-05-08T18:54:14.955626+0000","last_active":"2024-05-08T18:54:14.955599+0000","last_peered":"2024-05-08T18:54:14.955599+0000","last_clean":"2024-05-08T18:54:14.955599+0000","last_became_active":"2024-05-08T18:50:28.022359+0000","last_became_peered":"2024-05-08T18:50:28.022359+0000","last_unstale":"2024-05-08T18:54:14.955599+0000","last_undegraded":"2024-05-08T18:54:14.955599+0000","last_fullsized":"2024-05-08T18:54:14.955599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-05-08T18:54:14.955510+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-05-08T18:54:14.955510+0000","last_clean_scrub_stamp":"2024-05-08T18:54:14.955510+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:26.145719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:41.493628+0000","last_change":"2024-05-08T18:50:26.017214+0000","last_active":"2024-05-08T18:53:41.493628+0000","last_peered":"2024-05-08T18:53:41.493628+0000","last_clean":"2024-05-08T18:53:41.493628+0000","last_became_active":"2024-05-08T18:50:26.016932+0000","last_became_peered":"2024-05-08T18:50:26.016932+0000","last_unstale":"2024-05-08T18:53:41.493628+0000","last_undegraded":"2024-05-08T18:53:41.493628+0000","last_fullsized":"2024-05-08T18:53:41.493628+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"27'42","reported_seq":117,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:41.827668+0000","last_change":"2024-05-08T18:54:41.827705+0000","last_active":"2024-05-08T18:54:41.827668+0000","last_peered":"2024-05-08T18:54:41.827668+0000","last_clean":"2024-05-08T18:54:41.827668+0000","last_became_active":"2024-05-08T18:50:36.055045+0000","last_became_peered":"2024-05-08T18:50:36.055045+0000","last_unstale":"2024-05-08T18:54:41.827668+0000","last_undegraded":"2024-05-08T18:54:41.827668+0000","last_fullsized":"2024-05-08T18:54:41.827668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-05-08T18:54:41.827577+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-05-08T18:54:41.827577+0000","last_clean_scrub_stamp":"2024-05-08T18:54:41.827577+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:51.438853+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":182,"num_write":115,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'10","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:34.116133+0000","last_change":"2024-05-08T18:54:34.116165+0000","last_active":"2024-05-08T18:54:34.116133+0000","last_peered":"2024-05-08T18:54:34.116133+0000","last_clean":"2024-05-08T18:54:34.116133+0000","last_became_active":"2024-05-08T18:50:28.025239+0000","last_became_peered":"2024-05-08T18:50:28.025239+0000","last_unstale":"2024-05-08T18:54:34.116133+0000","last_undegraded":"2024-05-08T18:54:34.116133+0000","last_fullsized":"2024-05-08T18:54:34.116133+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:34.115992+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:34.115992+0000","last_clean_scrub_stamp":"2024-05-08T18:54:34.115992+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:07:15.486159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007667+0000","last_change":"2024-05-08T18:50:26.026659+0000","last_active":"2024-05-08T18:52:48.007667+0000","last_peered":"2024-05-08T18:52:48.007667+0000","last_clean":"2024-05-08T18:52:48.007667+0000","last_became_active":"2024-05-08T18:50:26.026400+0000","last_became_peered":"2024-05-08T18:50:26.026400+0000","last_unstale":"2024-05-08T18:52:48.007667+0000","last_undegraded":"2024-05-08T18:52:48.007667+0000","last_fullsized":"2024-05-08T18:52:48.007667+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:46.101267+0000","last_change":"2024-05-08T18:53:46.101302+0000","last_active":"2024-05-08T18:53:46.101267+0000","last_peered":"2024-05-08T18:53:46.101267+0000","last_clean":"2024-05-08T18:53:46.101267+0000","last_became_active":"2024-05-08T18:50:30.034832+0000","last_became_peered":"2024-05-08T18:50:30.034832+0000","last_unstale":"2024-05-08T18:53:46.101267+0000","last_undegraded":"2024-05-08T18:53:46.101267+0000","last_fullsized":"2024-05-08T18:53:46.101267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:46.101144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:46.101144+0000","last_clean_scrub_stamp":"2024-05-08T18:53:46.101144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:47.297905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"27'36","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:10.133225+0000","last_change":"2024-05-08T18:54:10.133267+0000","last_active":"2024-05-08T18:54:10.133225+0000","last_peered":"2024-05-08T18:54:10.133225+0000","last_clean":"2024-05-08T18:54:10.133225+0000","last_became_active":"2024-05-08T18:50:32.042432+0000","last_became_peered":"2024-05-08T18:50:32.042432+0000","last_unstale":"2024-05-08T18:54:10.133225+0000","last_undegraded":"2024-05-08T18:54:10.133225+0000","last_fullsized":"2024-05-08T18:54:10.133225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-05-08T18:54:10.133140+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-05-08T18:54:10.133140+0000","last_clean_scrub_stamp":"2024-05-08T18:54:10.133140+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:10:47.056279+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:52.079227+0000","last_change":"2024-05-08T18:53:52.079267+0000","last_active":"2024-05-08T18:53:52.079227+0000","last_peered":"2024-05-08T18:53:52.079227+0000","last_clean":"2024-05-08T18:53:52.079227+0000","last_became_active":"2024-05-08T18:50:34.048339+0000","last_became_peered":"2024-05-08T18:50:34.048339+0000","last_unstale":"2024-05-08T18:53:52.079227+0000","last_undegraded":"2024-05-08T18:53:52.079227+0000","last_fullsized":"2024-05-08T18:53:52.079227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:52.079130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:52.079130+0000","last_clean_scrub_stamp":"2024-05-08T18:53:52.079130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:45.266873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:40.839654+0000","last_change":"2024-05-08T18:54:40.839700+0000","last_active":"2024-05-08T18:54:40.839654+0000","last_peered":"2024-05-08T18:54:40.839654+0000","last_clean":"2024-05-08T18:54:40.839654+0000","last_became_active":"2024-05-08T18:50:36.055220+0000","last_became_peered":"2024-05-08T18:50:36.055220+0000","last_unstale":"2024-05-08T18:54:40.839654+0000","last_undegraded":"2024-05-08T18:54:40.839654+0000","last_fullsized":"2024-05-08T18:54:40.839654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-08T18:54:40.839542+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-08T18:54:40.839542+0000","last_clean_scrub_stamp":"2024-05-08T18:54:40.839542+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:47.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"25'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:03.039013+0000","last_change":"2024-05-08T18:54:03.039054+0000","last_active":"2024-05-08T18:54:03.039013+0000","last_peered":"2024-05-08T18:54:03.039013+0000","last_clean":"2024-05-08T18:54:03.039013+0000","last_became_active":"2024-05-08T18:50:28.038232+0000","last_became_peered":"2024-05-08T18:50:28.038232+0000","last_unstale":"2024-05-08T18:54:03.039013+0000","last_undegraded":"2024-05-08T18:54:03.039013+0000","last_fullsized":"2024-05-08T18:54:03.039013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:03.038905+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:03.038905+0000","last_clean_scrub_stamp":"2024-05-08T18:54:03.038905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:05.325298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:24.931975+0000","last_change":"2024-05-08T18:54:24.932026+0000","last_active":"2024-05-08T18:54:24.931975+0000","last_peered":"2024-05-08T18:54:24.931975+0000","last_clean":"2024-05-08T18:54:24.931975+0000","last_became_active":"2024-05-08T18:50:26.030986+0000","last_became_peered":"2024-05-08T18:50:26.030986+0000","last_unstale":"2024-05-08T18:54:24.931975+0000","last_undegraded":"2024-05-08T18:54:24.931975+0000","last_fullsized":"2024-05-08T18:54:24.931975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:24.931877+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:24.931877+0000","last_clean_scrub_stamp":"2024-05-08T18:54:24.931877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:57.209315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:12.104653+0000","last_change":"2024-05-08T18:54:12.104703+0000","last_active":"2024-05-08T18:54:12.104653+0000","last_peered":"2024-05-08T18:54:12.104653+0000","last_clean":"2024-05-08T18:54:12.104653+0000","last_became_active":"2024-05-08T18:50:30.026538+0000","last_became_peered":"2024-05-08T18:50:30.026538+0000","last_unstale":"2024-05-08T18:54:12.104653+0000","last_undegraded":"2024-05-08T18:54:12.104653+0000","last_fullsized":"2024-05-08T18:54:12.104653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:12.104549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:12.104549+0000","last_clean_scrub_stamp":"2024-05-08T18:54:12.104549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:24:22.097976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:50.126320+0000","last_change":"2024-05-08T18:53:50.126357+0000","last_active":"2024-05-08T18:53:50.126320+0000","last_peered":"2024-05-08T18:53:50.126320+0000","last_clean":"2024-05-08T18:53:50.126320+0000","last_became_active":"2024-05-08T18:50:32.039031+0000","last_became_peered":"2024-05-08T18:50:32.039031+0000","last_unstale":"2024-05-08T18:53:50.126320+0000","last_undegraded":"2024-05-08T18:53:50.126320+0000","last_fullsized":"2024-05-08T18:53:50.126320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-08T18:53:50.126231+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-08T18:53:50.126231+0000","last_clean_scrub_stamp":"2024-05-08T18:53:50.126231+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:49.044855+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:00.011377+0000","last_change":"2024-05-08T18:54:00.011405+0000","last_active":"2024-05-08T18:54:00.011377+0000","last_peered":"2024-05-08T18:54:00.011377+0000","last_clean":"2024-05-08T18:54:00.011377+0000","last_became_active":"2024-05-08T18:50:34.050512+0000","last_became_peered":"2024-05-08T18:50:34.050512+0000","last_unstale":"2024-05-08T18:54:00.011377+0000","last_undegraded":"2024-05-08T18:54:00.011377+0000","last_fullsized":"2024-05-08T18:54:00.011377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:00.011283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:00.011283+0000","last_clean_scrub_stamp":"2024-05-08T18:54:00.011283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:48.823802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"25'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:08.005296+0000","last_change":"2024-05-08T18:50:36.048388+0000","last_active":"2024-05-08T18:53:08.005296+0000","last_peered":"2024-05-08T18:53:08.005296+0000","last_clean":"2024-05-08T18:53:08.005296+0000","last_became_active":"2024-05-08T18:50:36.048075+0000","last_became_peered":"2024-05-08T18:50:36.048075+0000","last_unstale":"2024-05-08T18:53:08.005296+0000","last_undegraded":"2024-05-08T18:53:08.005296+0000","last_fullsized":"2024-05-08T18:53:08.005296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'10","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:33.160313+0000","last_change":"2024-05-08T18:54:33.160341+0000","last_active":"2024-05-08T18:54:33.160313+0000","last_peered":"2024-05-08T18:54:33.160313+0000","last_clean":"2024-05-08T18:54:33.160313+0000","last_became_active":"2024-05-08T18:50:28.025867+0000","last_became_peered":"2024-05-08T18:50:28.025867+0000","last_unstale":"2024-05-08T18:54:33.160313+0000","last_undegraded":"2024-05-08T18:54:33.160313+0000","last_fullsized":"2024-05-08T18:54:33.160313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:33.160215+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:33.160215+0000","last_clean_scrub_stamp":"2024-05-08T18:54:33.160215+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:35.162766+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"27'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:38.072350+0000","last_change":"2024-05-08T18:54:38.072376+0000","last_active":"2024-05-08T18:54:38.072350+0000","last_peered":"2024-05-08T18:54:38.072350+0000","last_clean":"2024-05-08T18:54:38.072350+0000","last_became_active":"2024-05-08T18:50:26.025410+0000","last_became_peered":"2024-05-08T18:50:26.025410+0000","last_unstale":"2024-05-08T18:54:38.072350+0000","last_undegraded":"2024-05-08T18:54:38.072350+0000","last_fullsized":"2024-05-08T18:54:38.072350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:38.072264+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:38.072264+0000","last_clean_scrub_stamp":"2024-05-08T18:54:38.072264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:02.503035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:09.051908+0000","last_change":"2024-05-08T18:54:09.051964+0000","last_active":"2024-05-08T18:54:09.051908+0000","last_peered":"2024-05-08T18:54:09.051908+0000","last_clean":"2024-05-08T18:54:09.051908+0000","last_became_active":"2024-05-08T18:50:30.029196+0000","last_became_peered":"2024-05-08T18:50:30.029196+0000","last_unstale":"2024-05-08T18:54:09.051908+0000","last_undegraded":"2024-05-08T18:54:09.051908+0000","last_fullsized":"2024-05-08T18:54:09.051908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:09.051799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:09.051799+0000","last_clean_scrub_stamp":"2024-05-08T18:54:09.051799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:04.437066+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"27'15","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:51.005744+0000","last_change":"2024-05-08T18:53:51.005796+0000","last_active":"2024-05-08T18:53:51.005744+0000","last_peered":"2024-05-08T18:53:51.005744+0000","last_clean":"2024-05-08T18:53:51.005744+0000","last_became_active":"2024-05-08T18:50:32.044056+0000","last_became_peered":"2024-05-08T18:50:32.044056+0000","last_unstale":"2024-05-08T18:53:51.005744+0000","last_undegraded":"2024-05-08T18:53:51.005744+0000","last_fullsized":"2024-05-08T18:53:51.005744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-08T18:53:51.005656+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-08T18:53:51.005656+0000","last_clean_scrub_stamp":"2024-05-08T18:53:51.005656+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:01:56.400586+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"27'285","reported_seq":402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:09.098897+0000","last_change":"2024-05-08T18:54:09.098926+0000","last_active":"2024-05-08T18:54:09.098897+0000","last_peered":"2024-05-08T18:54:09.098897+0000","last_clean":"2024-05-08T18:54:09.098897+0000","last_became_active":"2024-05-08T18:50:34.041872+0000","last_became_peered":"2024-05-08T18:50:34.041872+0000","last_unstale":"2024-05-08T18:54:09.098897+0000","last_undegraded":"2024-05-08T18:54:09.098897+0000","last_fullsized":"2024-05-08T18:54:09.098897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:54:09.098809+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:54:09.098809+0000","last_clean_scrub_stamp":"2024-05-08T18:54:09.098809+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:58.498954+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:34.867887+0000","last_change":"2024-05-08T18:54:34.867909+0000","last_active":"2024-05-08T18:54:34.867887+0000","last_peered":"2024-05-08T18:54:34.867887+0000","last_clean":"2024-05-08T18:54:34.867887+0000","last_became_active":"2024-05-08T18:50:36.049346+0000","last_became_peered":"2024-05-08T18:50:36.049346+0000","last_unstale":"2024-05-08T18:54:34.867887+0000","last_undegraded":"2024-05-08T18:54:34.867887+0000","last_fullsized":"2024-05-08T18:54:34.867887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:34.867765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:34.867765+0000","last_clean_scrub_stamp":"2024-05-08T18:54:34.867765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:11.691786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'6","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:13.114919+0000","last_change":"2024-05-08T18:54:13.114946+0000","last_active":"2024-05-08T18:54:13.114919+0000","last_peered":"2024-05-08T18:54:13.114919+0000","last_clean":"2024-05-08T18:54:13.114919+0000","last_became_active":"2024-05-08T18:50:28.031332+0000","last_became_peered":"2024-05-08T18:50:28.031332+0000","last_unstale":"2024-05-08T18:54:13.114919+0000","last_undegraded":"2024-05-08T18:54:13.114919+0000","last_fullsized":"2024-05-08T18:54:13.114919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:13.114824+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:13.114824+0000","last_clean_scrub_stamp":"2024-05-08T18:54:13.114824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:53:47.219370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:18.862259+0000","last_change":"2024-05-08T18:54:18.862299+0000","last_active":"2024-05-08T18:54:18.862259+0000","last_peered":"2024-05-08T18:54:18.862259+0000","last_clean":"2024-05-08T18:54:18.862259+0000","last_became_active":"2024-05-08T18:50:26.032155+0000","last_became_peered":"2024-05-08T18:50:26.032155+0000","last_unstale":"2024-05-08T18:54:18.862259+0000","last_undegraded":"2024-05-08T18:54:18.862259+0000","last_fullsized":"2024-05-08T18:54:18.862259+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:18.862147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:18.862147+0000","last_clean_scrub_stamp":"2024-05-08T18:54:18.862147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:21.148541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"27'5","reported_seq":238,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:49.069175+0000","last_change":"2024-05-08T18:53:49.069207+0000","last_active":"2024-05-08T18:53:49.069175+0000","last_peered":"2024-05-08T18:53:49.069175+0000","last_clean":"2024-05-08T18:53:49.069175+0000","last_became_active":"2024-05-08T18:50:30.034798+0000","last_became_peered":"2024-05-08T18:50:30.034798+0000","last_unstale":"2024-05-08T18:53:49.069175+0000","last_undegraded":"2024-05-08T18:53:49.069175+0000","last_fullsized":"2024-05-08T18:53:49.069175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-08T18:53:49.069063+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-08T18:53:49.069063+0000","last_clean_scrub_stamp":"2024-05-08T18:53:49.069063+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:32.617643+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"27'36","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.006281+0000","last_change":"2024-05-08T18:53:53.006323+0000","last_active":"2024-05-08T18:53:53.006281+0000","last_peered":"2024-05-08T18:53:53.006281+0000","last_clean":"2024-05-08T18:53:53.006281+0000","last_became_active":"2024-05-08T18:50:32.043573+0000","last_became_peered":"2024-05-08T18:50:32.043573+0000","last_unstale":"2024-05-08T18:53:53.006281+0000","last_undegraded":"2024-05-08T18:53:53.006281+0000","last_fullsized":"2024-05-08T18:53:53.006281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-05-08T18:53:53.006187+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-05-08T18:53:53.006187+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.006187+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:39.343300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"27'285","reported_seq":413,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:03.005283+0000","last_change":"2024-05-08T18:54:03.005312+0000","last_active":"2024-05-08T18:54:03.005283+0000","last_peered":"2024-05-08T18:54:03.005283+0000","last_clean":"2024-05-08T18:54:03.005283+0000","last_became_active":"2024-05-08T18:50:34.050122+0000","last_became_peered":"2024-05-08T18:50:34.050122+0000","last_unstale":"2024-05-08T18:54:03.005283+0000","last_undegraded":"2024-05-08T18:54:03.005283+0000","last_fullsized":"2024-05-08T18:54:03.005283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:54:03.005191+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:54:03.005191+0000","last_clean_scrub_stamp":"2024-05-08T18:54:03.005191+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:17.903758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"27'6","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:19.034397+0000","last_change":"2024-05-08T18:54:19.034422+0000","last_active":"2024-05-08T18:54:19.034397+0000","last_peered":"2024-05-08T18:54:19.034397+0000","last_clean":"2024-05-08T18:54:19.034397+0000","last_became_active":"2024-05-08T18:50:28.034992+0000","last_became_peered":"2024-05-08T18:50:28.034992+0000","last_unstale":"2024-05-08T18:54:19.034397+0000","last_undegraded":"2024-05-08T18:54:19.034397+0000","last_fullsized":"2024-05-08T18:54:19.034397+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:19.034312+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:19.034312+0000","last_clean_scrub_stamp":"2024-05-08T18:54:19.034312+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:24.299155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:28.954628+0000","last_change":"2024-05-08T18:54:28.954650+0000","last_active":"2024-05-08T18:54:28.954628+0000","last_peered":"2024-05-08T18:54:28.954628+0000","last_clean":"2024-05-08T18:54:28.954628+0000","last_became_active":"2024-05-08T18:50:26.023141+0000","last_became_peered":"2024-05-08T18:50:26.023141+0000","last_unstale":"2024-05-08T18:54:28.954628+0000","last_undegraded":"2024-05-08T18:54:28.954628+0000","last_fullsized":"2024-05-08T18:54:28.954628+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:28.954540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:28.954540+0000","last_clean_scrub_stamp":"2024-05-08T18:54:28.954540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:41.699354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:59.048708+0000","last_change":"2024-05-08T18:53:59.048754+0000","last_active":"2024-05-08T18:53:59.048708+0000","last_peered":"2024-05-08T18:53:59.048708+0000","last_clean":"2024-05-08T18:53:59.048708+0000","last_became_active":"2024-05-08T18:50:30.029482+0000","last_became_peered":"2024-05-08T18:50:30.029482+0000","last_unstale":"2024-05-08T18:53:59.048708+0000","last_undegraded":"2024-05-08T18:53:59.048708+0000","last_fullsized":"2024-05-08T18:53:59.048708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:59.048606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:59.048606+0000","last_clean_scrub_stamp":"2024-05-08T18:53:59.048606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:51.442116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"27'52","reported_seq":112,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:54.955612+0000","last_change":"2024-05-08T18:53:54.955673+0000","last_active":"2024-05-08T18:53:54.955612+0000","last_peered":"2024-05-08T18:53:54.955612+0000","last_clean":"2024-05-08T18:53:54.955612+0000","last_became_active":"2024-05-08T18:50:32.038121+0000","last_became_peered":"2024-05-08T18:50:32.038121+0000","last_unstale":"2024-05-08T18:53:54.955612+0000","last_undegraded":"2024-05-08T18:53:54.955612+0000","last_fullsized":"2024-05-08T18:53:54.955612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'52","last_scrub_stamp":"2024-05-08T18:53:54.955515+0000","last_deep_scrub":"27'52","last_deep_scrub_stamp":"2024-05-08T18:53:54.955515+0000","last_clean_scrub_stamp":"2024-05-08T18:53:54.955515+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:16.055669+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:44.931133+0000","last_change":"2024-05-08T18:53:44.931154+0000","last_active":"2024-05-08T18:53:44.931133+0000","last_peered":"2024-05-08T18:53:44.931133+0000","last_clean":"2024-05-08T18:53:44.931133+0000","last_became_active":"2024-05-08T18:50:34.047404+0000","last_became_peered":"2024-05-08T18:50:34.047404+0000","last_unstale":"2024-05-08T18:53:44.931133+0000","last_undegraded":"2024-05-08T18:53:44.931133+0000","last_fullsized":"2024-05-08T18:53:44.931133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:44.931063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:44.931063+0000","last_clean_scrub_stamp":"2024-05-08T18:53:44.931063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:50.136970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:36.818329+0000","last_change":"2024-05-08T18:54:36.818397+0000","last_active":"2024-05-08T18:54:36.818329+0000","last_peered":"2024-05-08T18:54:36.818329+0000","last_clean":"2024-05-08T18:54:36.818329+0000","last_became_active":"2024-05-08T18:50:36.051055+0000","last_became_peered":"2024-05-08T18:50:36.051055+0000","last_unstale":"2024-05-08T18:54:36.818329+0000","last_undegraded":"2024-05-08T18:54:36.818329+0000","last_fullsized":"2024-05-08T18:54:36.818329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-08T18:54:36.818220+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-08T18:54:36.818220+0000","last_clean_scrub_stamp":"2024-05-08T18:54:36.818220+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:36.666898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"27'8","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:16.905151+0000","last_change":"2024-05-08T18:54:16.905203+0000","last_active":"2024-05-08T18:54:16.905151+0000","last_peered":"2024-05-08T18:54:16.905151+0000","last_clean":"2024-05-08T18:54:16.905151+0000","last_became_active":"2024-05-08T18:50:28.018022+0000","last_became_peered":"2024-05-08T18:50:28.018022+0000","last_unstale":"2024-05-08T18:54:16.905151+0000","last_undegraded":"2024-05-08T18:54:16.905151+0000","last_fullsized":"2024-05-08T18:54:16.905151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:16.905016+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:16.905016+0000","last_clean_scrub_stamp":"2024-05-08T18:54:16.905016+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:46.535490+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:32.845517+0000","last_change":"2024-05-08T18:54:32.845560+0000","last_active":"2024-05-08T18:54:32.845517+0000","last_peered":"2024-05-08T18:54:32.845517+0000","last_clean":"2024-05-08T18:54:32.845517+0000","last_became_active":"2024-05-08T18:50:26.025028+0000","last_became_peered":"2024-05-08T18:50:26.025028+0000","last_unstale":"2024-05-08T18:54:32.845517+0000","last_undegraded":"2024-05-08T18:54:32.845517+0000","last_fullsized":"2024-05-08T18:54:32.845517+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:32.845406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:32.845406+0000","last_clean_scrub_stamp":"2024-05-08T18:54:32.845406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:09.768544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:05.046356+0000","last_change":"2024-05-08T18:54:05.046379+0000","last_active":"2024-05-08T18:54:05.046356+0000","last_peered":"2024-05-08T18:54:05.046356+0000","last_clean":"2024-05-08T18:54:05.046356+0000","last_became_active":"2024-05-08T18:50:30.031574+0000","last_became_peered":"2024-05-08T18:50:30.031574+0000","last_unstale":"2024-05-08T18:54:05.046356+0000","last_undegraded":"2024-05-08T18:54:05.046356+0000","last_fullsized":"2024-05-08T18:54:05.046356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:05.046264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:05.046264+0000","last_clean_scrub_stamp":"2024-05-08T18:54:05.046264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:56.573231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"27'38","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:04.084010+0000","last_change":"2024-05-08T18:54:04.084045+0000","last_active":"2024-05-08T18:54:04.084010+0000","last_peered":"2024-05-08T18:54:04.084010+0000","last_clean":"2024-05-08T18:54:04.084010+0000","last_became_active":"2024-05-08T18:50:32.041239+0000","last_became_peered":"2024-05-08T18:50:32.041239+0000","last_unstale":"2024-05-08T18:54:04.084010+0000","last_undegraded":"2024-05-08T18:54:04.084010+0000","last_fullsized":"2024-05-08T18:54:04.084010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2024-05-08T18:54:04.083924+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2024-05-08T18:54:04.083924+0000","last_clean_scrub_stamp":"2024-05-08T18:54:04.083924+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:32.880132+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:50.038894+0000","last_change":"2024-05-08T18:53:50.038945+0000","last_active":"2024-05-08T18:53:50.038894+0000","last_peered":"2024-05-08T18:53:50.038894+0000","last_clean":"2024-05-08T18:53:50.038894+0000","last_became_active":"2024-05-08T18:50:34.044487+0000","last_became_peered":"2024-05-08T18:50:34.044487+0000","last_unstale":"2024-05-08T18:53:50.038894+0000","last_undegraded":"2024-05-08T18:53:50.038894+0000","last_fullsized":"2024-05-08T18:53:50.038894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:50.038762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:50.038762+0000","last_clean_scrub_stamp":"2024-05-08T18:53:50.038762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.226504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"27'8","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:12.011596+0000","last_change":"2024-05-08T18:54:12.011630+0000","last_active":"2024-05-08T18:54:12.011596+0000","last_peered":"2024-05-08T18:54:12.011596+0000","last_clean":"2024-05-08T18:54:12.011596+0000","last_became_active":"2024-05-08T18:50:36.050379+0000","last_became_peered":"2024-05-08T18:50:36.050379+0000","last_unstale":"2024-05-08T18:54:12.011596+0000","last_undegraded":"2024-05-08T18:54:12.011596+0000","last_fullsized":"2024-05-08T18:54:12.011596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:12.011510+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:12.011510+0000","last_clean_scrub_stamp":"2024-05-08T18:54:12.011510+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:47.390905+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"27'6","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:33.819644+0000","last_change":"2024-05-08T18:54:33.819673+0000","last_active":"2024-05-08T18:54:33.819644+0000","last_peered":"2024-05-08T18:54:33.819644+0000","last_clean":"2024-05-08T18:54:33.819644+0000","last_became_active":"2024-05-08T18:50:28.036821+0000","last_became_peered":"2024-05-08T18:50:28.036821+0000","last_unstale":"2024-05-08T18:54:33.819644+0000","last_undegraded":"2024-05-08T18:54:33.819644+0000","last_fullsized":"2024-05-08T18:54:33.819644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:33.819529+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:33.819529+0000","last_clean_scrub_stamp":"2024-05-08T18:54:33.819529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:42.896465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006852+0000","last_change":"2024-05-08T18:50:26.023248+0000","last_active":"2024-05-08T18:52:43.006852+0000","last_peered":"2024-05-08T18:52:43.006852+0000","last_clean":"2024-05-08T18:52:43.006852+0000","last_became_active":"2024-05-08T18:50:26.022938+0000","last_became_peered":"2024-05-08T18:50:26.022938+0000","last_unstale":"2024-05-08T18:52:43.006852+0000","last_undegraded":"2024-05-08T18:52:43.006852+0000","last_fullsized":"2024-05-08T18:52:43.006852+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:10.062367+0000","last_change":"2024-05-08T18:54:10.062412+0000","last_active":"2024-05-08T18:54:10.062367+0000","last_peered":"2024-05-08T18:54:10.062367+0000","last_clean":"2024-05-08T18:54:10.062367+0000","last_became_active":"2024-05-08T18:50:30.029134+0000","last_became_peered":"2024-05-08T18:50:30.029134+0000","last_unstale":"2024-05-08T18:54:10.062367+0000","last_undegraded":"2024-05-08T18:54:10.062367+0000","last_fullsized":"2024-05-08T18:54:10.062367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:10.062263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:10.062263+0000","last_clean_scrub_stamp":"2024-05-08T18:54:10.062263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:53.020523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"27'46","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:48.046782+0000","last_change":"2024-05-08T18:53:48.046823+0000","last_active":"2024-05-08T18:53:48.046782+0000","last_peered":"2024-05-08T18:53:48.046782+0000","last_clean":"2024-05-08T18:53:48.046782+0000","last_became_active":"2024-05-08T18:50:32.035189+0000","last_became_peered":"2024-05-08T18:50:32.035189+0000","last_unstale":"2024-05-08T18:53:48.046782+0000","last_undegraded":"2024-05-08T18:53:48.046782+0000","last_fullsized":"2024-05-08T18:53:48.046782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-05-08T18:53:48.046702+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-05-08T18:53:48.046702+0000","last_clean_scrub_stamp":"2024-05-08T18:53:48.046702+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:09.757527+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"27'285","reported_seq":366,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:54.987049+0000","last_change":"2024-05-08T18:53:54.987120+0000","last_active":"2024-05-08T18:53:54.987049+0000","last_peered":"2024-05-08T18:53:54.987049+0000","last_clean":"2024-05-08T18:53:54.987049+0000","last_became_active":"2024-05-08T18:50:34.047999+0000","last_became_peered":"2024-05-08T18:50:34.047999+0000","last_unstale":"2024-05-08T18:53:54.987049+0000","last_undegraded":"2024-05-08T18:53:54.987049+0000","last_fullsized":"2024-05-08T18:53:54.987049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:54.986938+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:54.986938+0000","last_clean_scrub_stamp":"2024-05-08T18:53:54.986938+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:56.968910+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.002583+0000","last_change":"2024-05-08T18:50:36.048278+0000","last_active":"2024-05-08T18:52:48.002583+0000","last_peered":"2024-05-08T18:52:48.002583+0000","last_clean":"2024-05-08T18:52:48.002583+0000","last_became_active":"2024-05-08T18:50:36.047981+0000","last_became_peered":"2024-05-08T18:50:36.047981+0000","last_unstale":"2024-05-08T18:52:48.002583+0000","last_undegraded":"2024-05-08T18:52:48.002583+0000","last_fullsized":"2024-05-08T18:52:48.002583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"27'8","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:10.920896+0000","last_change":"2024-05-08T18:54:10.920922+0000","last_active":"2024-05-08T18:54:10.920896+0000","last_peered":"2024-05-08T18:54:10.920896+0000","last_clean":"2024-05-08T18:54:10.920896+0000","last_became_active":"2024-05-08T18:50:28.020004+0000","last_became_peered":"2024-05-08T18:50:28.020004+0000","last_unstale":"2024-05-08T18:54:10.920896+0000","last_undegraded":"2024-05-08T18:54:10.920896+0000","last_fullsized":"2024-05-08T18:54:10.920896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:10.920810+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:10.920810+0000","last_clean_scrub_stamp":"2024-05-08T18:54:10.920810+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:32.631635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006811+0000","last_change":"2024-05-08T18:50:26.017413+0000","last_active":"2024-05-08T18:52:43.006811+0000","last_peered":"2024-05-08T18:52:43.006811+0000","last_clean":"2024-05-08T18:52:43.006811+0000","last_became_active":"2024-05-08T18:50:26.015955+0000","last_became_peered":"2024-05-08T18:50:26.015955+0000","last_unstale":"2024-05-08T18:52:43.006811+0000","last_undegraded":"2024-05-08T18:52:43.006811+0000","last_fullsized":"2024-05-08T18:52:43.006811+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:06.010157+0000","last_change":"2024-05-08T18:54:06.010199+0000","last_active":"2024-05-08T18:54:06.010157+0000","last_peered":"2024-05-08T18:54:06.010157+0000","last_clean":"2024-05-08T18:54:06.010157+0000","last_became_active":"2024-05-08T18:50:30.030140+0000","last_became_peered":"2024-05-08T18:50:30.030140+0000","last_unstale":"2024-05-08T18:54:06.010157+0000","last_undegraded":"2024-05-08T18:54:06.010157+0000","last_fullsized":"2024-05-08T18:54:06.010157+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:06.010052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:06.010052+0000","last_clean_scrub_stamp":"2024-05-08T18:54:06.010052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:14.779273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"27'64","reported_seq":137,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:56.075355+0000","last_change":"2024-05-08T18:53:56.075427+0000","last_active":"2024-05-08T18:53:56.075355+0000","last_peered":"2024-05-08T18:53:56.075355+0000","last_clean":"2024-05-08T18:53:56.075355+0000","last_became_active":"2024-05-08T18:50:32.040633+0000","last_became_peered":"2024-05-08T18:50:32.040633+0000","last_unstale":"2024-05-08T18:53:56.075355+0000","last_undegraded":"2024-05-08T18:53:56.075355+0000","last_fullsized":"2024-05-08T18:53:56.075355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'64","last_scrub_stamp":"2024-05-08T18:53:56.075259+0000","last_deep_scrub":"27'64","last_deep_scrub_stamp":"2024-05-08T18:53:56.075259+0000","last_clean_scrub_stamp":"2024-05-08T18:53:56.075259+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:31.454654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:51.968283+0000","last_change":"2024-05-08T18:53:51.968305+0000","last_active":"2024-05-08T18:53:51.968283+0000","last_peered":"2024-05-08T18:53:51.968283+0000","last_clean":"2024-05-08T18:53:51.968283+0000","last_became_active":"2024-05-08T18:50:34.043817+0000","last_became_peered":"2024-05-08T18:50:34.043817+0000","last_unstale":"2024-05-08T18:53:51.968283+0000","last_undegraded":"2024-05-08T18:53:51.968283+0000","last_fullsized":"2024-05-08T18:53:51.968283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:51.968195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:51.968195+0000","last_clean_scrub_stamp":"2024-05-08T18:53:51.968195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:00.724814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"27'18","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.982121+0000","last_change":"2024-05-08T18:50:36.054529+0000","last_active":"2024-05-08T18:53:34.982121+0000","last_peered":"2024-05-08T18:53:34.982121+0000","last_clean":"2024-05-08T18:53:34.982121+0000","last_became_active":"2024-05-08T18:50:36.054237+0000","last_became_peered":"2024-05-08T18:50:36.054237+0000","last_unstale":"2024-05-08T18:53:34.982121+0000","last_undegraded":"2024-05-08T18:53:34.982121+0000","last_fullsized":"2024-05-08T18:53:34.982121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"27'10","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:40.754428+0000","last_change":"2024-05-08T18:54:40.754452+0000","last_active":"2024-05-08T18:54:40.754428+0000","last_peered":"2024-05-08T18:54:40.754428+0000","last_clean":"2024-05-08T18:54:40.754428+0000","last_became_active":"2024-05-08T18:51:15.085560+0000","last_became_peered":"2024-05-08T18:51:15.085560+0000","last_unstale":"2024-05-08T18:54:40.754428+0000","last_undegraded":"2024-05-08T18:54:40.754428+0000","last_fullsized":"2024-05-08T18:54:40.754428+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:40.754335+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:40.754335+0000","last_clean_scrub_stamp":"2024-05-08T18:54:40.754335+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:45.155754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.001851+0000","last_change":"2024-05-08T18:51:15.080314+0000","last_active":"2024-05-08T18:52:43.001851+0000","last_peered":"2024-05-08T18:52:43.001851+0000","last_clean":"2024-05-08T18:52:43.001851+0000","last_became_active":"2024-05-08T18:51:15.080071+0000","last_became_peered":"2024-05-08T18:51:15.080071+0000","last_unstale":"2024-05-08T18:52:43.001851+0000","last_undegraded":"2024-05-08T18:52:43.001851+0000","last_fullsized":"2024-05-08T18:52:43.001851+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:01.928027+0000","last_change":"2024-05-08T18:54:01.928071+0000","last_active":"2024-05-08T18:54:01.928027+0000","last_peered":"2024-05-08T18:54:01.928027+0000","last_clean":"2024-05-08T18:54:01.928027+0000","last_became_active":"2024-05-08T18:50:30.033318+0000","last_became_peered":"2024-05-08T18:50:30.033318+0000","last_unstale":"2024-05-08T18:54:01.928027+0000","last_undegraded":"2024-05-08T18:54:01.928027+0000","last_fullsized":"2024-05-08T18:54:01.928027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:01.927918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:01.927918+0000","last_clean_scrub_stamp":"2024-05-08T18:54:01.927918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:00.640748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"27'40","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.113280+0000","last_change":"2024-05-08T18:53:53.113321+0000","last_active":"2024-05-08T18:53:53.113280+0000","last_peered":"2024-05-08T18:53:53.113280+0000","last_clean":"2024-05-08T18:53:53.113280+0000","last_became_active":"2024-05-08T18:50:32.034914+0000","last_became_peered":"2024-05-08T18:50:32.034914+0000","last_unstale":"2024-05-08T18:53:53.113280+0000","last_undegraded":"2024-05-08T18:53:53.113280+0000","last_fullsized":"2024-05-08T18:53:53.113280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-05-08T18:53:53.113190+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-05-08T18:53:53.113190+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.113190+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:19.438913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:12.112019+0000","last_change":"2024-05-08T18:54:12.112046+0000","last_active":"2024-05-08T18:54:12.112019+0000","last_peered":"2024-05-08T18:54:12.112019+0000","last_clean":"2024-05-08T18:54:12.112019+0000","last_became_active":"2024-05-08T18:50:34.047075+0000","last_became_peered":"2024-05-08T18:50:34.047075+0000","last_unstale":"2024-05-08T18:54:12.112019+0000","last_undegraded":"2024-05-08T18:54:12.112019+0000","last_fullsized":"2024-05-08T18:54:12.112019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:12.111934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:12.111934+0000","last_clean_scrub_stamp":"2024-05-08T18:54:12.111934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.935955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:28.106620+0000","last_change":"2024-05-08T18:54:28.106620+0000","last_active":"2024-05-08T18:54:28.106620+0000","last_peered":"2024-05-08T18:54:28.106620+0000","last_clean":"2024-05-08T18:54:28.106620+0000","last_became_active":"2024-05-08T18:50:36.055385+0000","last_became_peered":"2024-05-08T18:50:36.055385+0000","last_unstale":"2024-05-08T18:54:28.106620+0000","last_undegraded":"2024-05-08T18:54:28.106620+0000","last_fullsized":"2024-05-08T18:54:28.106620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:28.106488+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:28.106488+0000","last_clean_scrub_stamp":"2024-05-08T18:54:28.106488+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:44.661104+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'4","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:01.045296+0000","last_change":"2024-05-08T18:54:01.045321+0000","last_active":"2024-05-08T18:54:01.045296+0000","last_peered":"2024-05-08T18:54:01.045296+0000","last_clean":"2024-05-08T18:54:01.045296+0000","last_became_active":"2024-05-08T18:50:28.038633+0000","last_became_peered":"2024-05-08T18:50:28.038633+0000","last_unstale":"2024-05-08T18:54:01.045296+0000","last_undegraded":"2024-05-08T18:54:01.045296+0000","last_fullsized":"2024-05-08T18:54:01.045296+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:01.045175+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:01.045175+0000","last_clean_scrub_stamp":"2024-05-08T18:54:01.045175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:30.675649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:38.006123+0000","last_change":"2024-05-08T18:50:26.016599+0000","last_active":"2024-05-08T18:52:38.006123+0000","last_peered":"2024-05-08T18:52:38.006123+0000","last_clean":"2024-05-08T18:52:38.006123+0000","last_became_active":"2024-05-08T18:50:26.016308+0000","last_became_peered":"2024-05-08T18:50:26.016308+0000","last_unstale":"2024-05-08T18:52:38.006123+0000","last_undegraded":"2024-05-08T18:52:38.006123+0000","last_fullsized":"2024-05-08T18:52:38.006123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:04.039180+0000","last_change":"2024-05-08T18:54:04.039242+0000","last_active":"2024-05-08T18:54:04.039180+0000","last_peered":"2024-05-08T18:54:04.039180+0000","last_clean":"2024-05-08T18:54:04.039180+0000","last_became_active":"2024-05-08T18:50:30.031765+0000","last_became_peered":"2024-05-08T18:50:30.031765+0000","last_unstale":"2024-05-08T18:54:04.039180+0000","last_undegraded":"2024-05-08T18:54:04.039180+0000","last_fullsized":"2024-05-08T18:54:04.039180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:04.039072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:04.039072+0000","last_clean_scrub_stamp":"2024-05-08T18:54:04.039072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:13.913375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"27'45","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.930724+0000","last_change":"2024-05-08T18:53:58.930760+0000","last_active":"2024-05-08T18:53:58.930724+0000","last_peered":"2024-05-08T18:53:58.930724+0000","last_clean":"2024-05-08T18:53:58.930724+0000","last_became_active":"2024-05-08T18:50:32.035131+0000","last_became_peered":"2024-05-08T18:50:32.035131+0000","last_unstale":"2024-05-08T18:53:58.930724+0000","last_undegraded":"2024-05-08T18:53:58.930724+0000","last_fullsized":"2024-05-08T18:53:58.930724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-05-08T18:53:58.930638+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-05-08T18:53:58.930638+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.930638+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:52.118381+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"27'285","reported_seq":442,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.946293+0000","last_change":"2024-05-08T18:53:45.946321+0000","last_active":"2024-05-08T18:53:45.946293+0000","last_peered":"2024-05-08T18:53:45.946293+0000","last_clean":"2024-05-08T18:53:45.946293+0000","last_became_active":"2024-05-08T18:50:34.047184+0000","last_became_peered":"2024-05-08T18:50:34.047184+0000","last_unstale":"2024-05-08T18:53:45.946293+0000","last_undegraded":"2024-05-08T18:53:45.946293+0000","last_fullsized":"2024-05-08T18:53:45.946293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:45.946195+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:45.946195+0000","last_clean_scrub_stamp":"2024-05-08T18:53:45.946195+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:08:51.238216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"27'13","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:07.061502+0000","last_change":"2024-05-08T18:54:07.061529+0000","last_active":"2024-05-08T18:54:07.061502+0000","last_peered":"2024-05-08T18:54:07.061502+0000","last_clean":"2024-05-08T18:54:07.061502+0000","last_became_active":"2024-05-08T18:50:36.046209+0000","last_became_peered":"2024-05-08T18:50:36.046209+0000","last_unstale":"2024-05-08T18:54:07.061502+0000","last_undegraded":"2024-05-08T18:54:07.061502+0000","last_fullsized":"2024-05-08T18:54:07.061502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-05-08T18:54:07.061418+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-05-08T18:54:07.061418+0000","last_clean_scrub_stamp":"2024-05-08T18:54:07.061418+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:19.023570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'6","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:08.865080+0000","last_change":"2024-05-08T18:54:08.865151+0000","last_active":"2024-05-08T18:54:08.865080+0000","last_peered":"2024-05-08T18:54:08.865080+0000","last_clean":"2024-05-08T18:54:08.865080+0000","last_became_active":"2024-05-08T18:50:28.036946+0000","last_became_peered":"2024-05-08T18:50:28.036946+0000","last_unstale":"2024-05-08T18:54:08.865080+0000","last_undegraded":"2024-05-08T18:54:08.865080+0000","last_fullsized":"2024-05-08T18:54:08.865080+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:08.864977+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:08.864977+0000","last_clean_scrub_stamp":"2024-05-08T18:54:08.864977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:16.323961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:35.088927+0000","last_change":"2024-05-08T18:54:35.088964+0000","last_active":"2024-05-08T18:54:35.088927+0000","last_peered":"2024-05-08T18:54:35.088927+0000","last_clean":"2024-05-08T18:54:35.088927+0000","last_became_active":"2024-05-08T18:50:26.027657+0000","last_became_peered":"2024-05-08T18:50:26.027657+0000","last_unstale":"2024-05-08T18:54:35.088927+0000","last_undegraded":"2024-05-08T18:54:35.088927+0000","last_fullsized":"2024-05-08T18:54:35.088927+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:35.088831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:35.088831+0000","last_clean_scrub_stamp":"2024-05-08T18:54:35.088831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:07:23.601707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"27'5","reported_seq":428,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:02.003885+0000","last_change":"2024-05-08T18:54:02.003952+0000","last_active":"2024-05-08T18:54:02.003885+0000","last_peered":"2024-05-08T18:54:02.003885+0000","last_clean":"2024-05-08T18:54:02.003885+0000","last_became_active":"2024-05-08T18:50:30.027420+0000","last_became_peered":"2024-05-08T18:50:30.027420+0000","last_unstale":"2024-05-08T18:54:02.003885+0000","last_undegraded":"2024-05-08T18:54:02.003885+0000","last_fullsized":"2024-05-08T18:54:02.003885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-08T18:54:02.003784+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-08T18:54:02.003784+0000","last_clean_scrub_stamp":"2024-05-08T18:54:02.003784+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:09.462769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'16","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:00.007839+0000","last_change":"2024-05-08T18:54:00.007874+0000","last_active":"2024-05-08T18:54:00.007839+0000","last_peered":"2024-05-08T18:54:00.007839+0000","last_clean":"2024-05-08T18:54:00.007839+0000","last_became_active":"2024-05-08T18:50:32.040988+0000","last_became_peered":"2024-05-08T18:50:32.040988+0000","last_unstale":"2024-05-08T18:54:00.007839+0000","last_undegraded":"2024-05-08T18:54:00.007839+0000","last_fullsized":"2024-05-08T18:54:00.007839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-05-08T18:54:00.007737+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-05-08T18:54:00.007737+0000","last_clean_scrub_stamp":"2024-05-08T18:54:00.007737+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:07.927405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"27'285","reported_seq":471,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:46.055717+0000","last_change":"2024-05-08T18:53:46.055745+0000","last_active":"2024-05-08T18:53:46.055717+0000","last_peered":"2024-05-08T18:53:46.055717+0000","last_clean":"2024-05-08T18:53:46.055717+0000","last_became_active":"2024-05-08T18:50:34.040477+0000","last_became_peered":"2024-05-08T18:50:34.040477+0000","last_unstale":"2024-05-08T18:53:46.055717+0000","last_undegraded":"2024-05-08T18:53:46.055717+0000","last_fullsized":"2024-05-08T18:53:46.055717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:46.055625+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:46.055625+0000","last_clean_scrub_stamp":"2024-05-08T18:53:46.055625+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:55:05.788331+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:07.875615+0000","last_change":"2024-05-08T18:54:07.875651+0000","last_active":"2024-05-08T18:54:07.875615+0000","last_peered":"2024-05-08T18:54:07.875615+0000","last_clean":"2024-05-08T18:54:07.875615+0000","last_became_active":"2024-05-08T18:50:36.045976+0000","last_became_peered":"2024-05-08T18:50:36.045976+0000","last_unstale":"2024-05-08T18:54:07.875615+0000","last_undegraded":"2024-05-08T18:54:07.875615+0000","last_fullsized":"2024-05-08T18:54:07.875615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:07.875523+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:07.875523+0000","last_clean_scrub_stamp":"2024-05-08T18:54:07.875523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:03.721378+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"27'4","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:05.968925+0000","last_change":"2024-05-08T18:54:05.968970+0000","last_active":"2024-05-08T18:54:05.968925+0000","last_peered":"2024-05-08T18:54:05.968925+0000","last_clean":"2024-05-08T18:54:05.968925+0000","last_became_active":"2024-05-08T18:50:28.038871+0000","last_became_peered":"2024-05-08T18:50:28.038871+0000","last_unstale":"2024-05-08T18:54:05.968925+0000","last_undegraded":"2024-05-08T18:54:05.968925+0000","last_fullsized":"2024-05-08T18:54:05.968925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:05.968831+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:05.968831+0000","last_clean_scrub_stamp":"2024-05-08T18:54:05.968831+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:15.843134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:40.064323+0000","last_change":"2024-05-08T18:54:40.064360+0000","last_active":"2024-05-08T18:54:40.064323+0000","last_peered":"2024-05-08T18:54:40.064323+0000","last_clean":"2024-05-08T18:54:40.064323+0000","last_became_active":"2024-05-08T18:50:26.025547+0000","last_became_peered":"2024-05-08T18:50:26.025547+0000","last_unstale":"2024-05-08T18:54:40.064323+0000","last_undegraded":"2024-05-08T18:54:40.064323+0000","last_fullsized":"2024-05-08T18:54:40.064323+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:40.064223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:40.064223+0000","last_clean_scrub_stamp":"2024-05-08T18:54:40.064223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:21:06.700344+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:47.056975+0000","last_change":"2024-05-08T18:53:47.057018+0000","last_active":"2024-05-08T18:53:47.056975+0000","last_peered":"2024-05-08T18:53:47.056975+0000","last_clean":"2024-05-08T18:53:47.056975+0000","last_became_active":"2024-05-08T18:50:30.035734+0000","last_became_peered":"2024-05-08T18:50:30.035734+0000","last_unstale":"2024-05-08T18:53:47.056975+0000","last_undegraded":"2024-05-08T18:53:47.056975+0000","last_fullsized":"2024-05-08T18:53:47.056975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:47.056868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:47.056868+0000","last_clean_scrub_stamp":"2024-05-08T18:53:47.056868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:03:47.172253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"27'48","reported_seq":107,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:54.094025+0000","last_change":"2024-05-08T18:53:54.094067+0000","last_active":"2024-05-08T18:53:54.094025+0000","last_peered":"2024-05-08T18:53:54.094025+0000","last_clean":"2024-05-08T18:53:54.094025+0000","last_became_active":"2024-05-08T18:50:32.034769+0000","last_became_peered":"2024-05-08T18:50:32.034769+0000","last_unstale":"2024-05-08T18:53:54.094025+0000","last_undegraded":"2024-05-08T18:53:54.094025+0000","last_fullsized":"2024-05-08T18:53:54.094025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-05-08T18:53:54.093941+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-05-08T18:53:54.093941+0000","last_clean_scrub_stamp":"2024-05-08T18:53:54.093941+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:02.850561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:55.963122+0000","last_change":"2024-05-08T18:53:55.963149+0000","last_active":"2024-05-08T18:53:55.963122+0000","last_peered":"2024-05-08T18:53:55.963122+0000","last_clean":"2024-05-08T18:53:55.963122+0000","last_became_active":"2024-05-08T18:50:34.050018+0000","last_became_peered":"2024-05-08T18:50:34.050018+0000","last_unstale":"2024-05-08T18:53:55.963122+0000","last_undegraded":"2024-05-08T18:53:55.963122+0000","last_fullsized":"2024-05-08T18:53:55.963122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:55.963020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:55.963020+0000","last_clean_scrub_stamp":"2024-05-08T18:53:55.963020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:07.576169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:04.012396+0000","last_change":"2024-05-08T18:54:04.012454+0000","last_active":"2024-05-08T18:54:04.012396+0000","last_peered":"2024-05-08T18:54:04.012396+0000","last_clean":"2024-05-08T18:54:04.012396+0000","last_became_active":"2024-05-08T18:50:36.049274+0000","last_became_peered":"2024-05-08T18:50:36.049274+0000","last_unstale":"2024-05-08T18:54:04.012396+0000","last_undegraded":"2024-05-08T18:54:04.012396+0000","last_fullsized":"2024-05-08T18:54:04.012396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:04.012274+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:04.012274+0000","last_clean_scrub_stamp":"2024-05-08T18:54:04.012274+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:25.723099+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'8","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:05.082216+0000","last_change":"2024-05-08T18:54:05.082216+0000","last_active":"2024-05-08T18:54:05.082216+0000","last_peered":"2024-05-08T18:54:05.082216+0000","last_clean":"2024-05-08T18:54:05.082216+0000","last_became_active":"2024-05-08T18:50:28.037545+0000","last_became_peered":"2024-05-08T18:50:28.037545+0000","last_unstale":"2024-05-08T18:54:05.082216+0000","last_undegraded":"2024-05-08T18:54:05.082216+0000","last_fullsized":"2024-05-08T18:54:05.082216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:05.082102+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:05.082102+0000","last_clean_scrub_stamp":"2024-05-08T18:54:05.082102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:42.647531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'74","reported_seq":145,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:29.684035+0000","last_change":"2024-05-08T18:54:29.684064+0000","last_active":"2024-05-08T18:54:29.684035+0000","last_peered":"2024-05-08T18:54:29.684035+0000","last_clean":"2024-05-08T18:54:29.684035+0000","last_became_active":"2024-05-08T18:50:19.739986+0000","last_became_peered":"2024-05-08T18:50:19.739986+0000","last_unstale":"2024-05-08T18:54:29.684035+0000","last_undegraded":"2024-05-08T18:54:29.684035+0000","last_fullsized":"2024-05-08T18:54:29.684035+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'74","last_scrub_stamp":"2024-05-08T18:54:29.683948+0000","last_deep_scrub":"27'74","last_deep_scrub_stamp":"2024-05-08T18:54:29.683948+0000","last_clean_scrub_stamp":"2024-05-08T18:54:29.683948+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:01.256645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.862017+0000","last_change":"2024-05-08T18:50:19.740266+0000","last_active":"2024-05-08T18:53:45.862017+0000","last_peered":"2024-05-08T18:53:45.862017+0000","last_clean":"2024-05-08T18:53:45.862017+0000","last_became_active":"2024-05-08T18:50:19.739403+0000","last_became_peered":"2024-05-08T18:50:19.739403+0000","last_unstale":"2024-05-08T18:53:45.862017+0000","last_undegraded":"2024-05-08T18:53:45.862017+0000","last_fullsized":"2024-05-08T18:53:45.862017+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.862042+0000","last_change":"2024-05-08T18:50:26.026328+0000","last_active":"2024-05-08T18:53:45.862042+0000","last_peered":"2024-05-08T18:53:45.862042+0000","last_clean":"2024-05-08T18:53:45.862042+0000","last_became_active":"2024-05-08T18:50:26.024249+0000","last_became_peered":"2024-05-08T18:50:26.024249+0000","last_unstale":"2024-05-08T18:53:45.862042+0000","last_undegraded":"2024-05-08T18:53:45.862042+0000","last_fullsized":"2024-05-08T18:53:45.862042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:57.039225+0000","last_change":"2024-05-08T18:53:57.039225+0000","last_active":"2024-05-08T18:53:57.039225+0000","last_peered":"2024-05-08T18:53:57.039225+0000","last_clean":"2024-05-08T18:53:57.039225+0000","last_became_active":"2024-05-08T18:50:30.029744+0000","last_became_peered":"2024-05-08T18:50:30.029744+0000","last_unstale":"2024-05-08T18:53:57.039225+0000","last_undegraded":"2024-05-08T18:53:57.039225+0000","last_fullsized":"2024-05-08T18:53:57.039225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:57.039062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:57.039062+0000","last_clean_scrub_stamp":"2024-05-08T18:53:57.039062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:59.021034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"27'87","reported_seq":177,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:11.115120+0000","last_change":"2024-05-08T18:54:11.115165+0000","last_active":"2024-05-08T18:54:11.115120+0000","last_peered":"2024-05-08T18:54:11.115120+0000","last_clean":"2024-05-08T18:54:11.115120+0000","last_became_active":"2024-05-08T18:50:32.043533+0000","last_became_peered":"2024-05-08T18:50:32.043533+0000","last_unstale":"2024-05-08T18:54:11.115120+0000","last_undegraded":"2024-05-08T18:54:11.115120+0000","last_fullsized":"2024-05-08T18:54:11.115120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'87","last_scrub_stamp":"2024-05-08T18:54:11.115039+0000","last_deep_scrub":"27'87","last_deep_scrub_stamp":"2024-05-08T18:54:11.115039+0000","last_clean_scrub_stamp":"2024-05-08T18:54:11.115039+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:20.191974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.995645+0000","last_change":"2024-05-08T18:53:58.995677+0000","last_active":"2024-05-08T18:53:58.995645+0000","last_peered":"2024-05-08T18:53:58.995645+0000","last_clean":"2024-05-08T18:53:58.995645+0000","last_became_active":"2024-05-08T18:50:34.048859+0000","last_became_peered":"2024-05-08T18:50:34.048859+0000","last_unstale":"2024-05-08T18:53:58.995645+0000","last_undegraded":"2024-05-08T18:53:58.995645+0000","last_fullsized":"2024-05-08T18:53:58.995645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:58.995550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:58.995550+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.995550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:54.841405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"27'81","reported_seq":171,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:03.892281+0000","last_change":"2024-05-08T18:54:03.892330+0000","last_active":"2024-05-08T18:54:03.892281+0000","last_peered":"2024-05-08T18:54:03.892281+0000","last_clean":"2024-05-08T18:54:03.892281+0000","last_became_active":"2024-05-08T18:50:36.044928+0000","last_became_peered":"2024-05-08T18:50:36.044928+0000","last_unstale":"2024-05-08T18:54:03.892281+0000","last_undegraded":"2024-05-08T18:54:03.892281+0000","last_fullsized":"2024-05-08T18:54:03.892281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'81","last_scrub_stamp":"2024-05-08T18:54:03.892165+0000","last_deep_scrub":"27'81","last_deep_scrub_stamp":"2024-05-08T18:54:03.892165+0000","last_clean_scrub_stamp":"2024-05-08T18:54:03.892165+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:34:05.874137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"27'4","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:27.108359+0000","last_change":"2024-05-08T18:54:27.108387+0000","last_active":"2024-05-08T18:54:27.108359+0000","last_peered":"2024-05-08T18:54:27.108359+0000","last_clean":"2024-05-08T18:54:27.108359+0000","last_became_active":"2024-05-08T18:50:28.030761+0000","last_became_peered":"2024-05-08T18:50:28.030761+0000","last_unstale":"2024-05-08T18:54:27.108359+0000","last_undegraded":"2024-05-08T18:54:27.108359+0000","last_fullsized":"2024-05-08T18:54:27.108359+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:27.108273+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:27.108273+0000","last_clean_scrub_stamp":"2024-05-08T18:54:27.108273+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:08.292247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.862002+0000","last_change":"2024-05-08T18:50:19.739194+0000","last_active":"2024-05-08T18:53:45.862002+0000","last_peered":"2024-05-08T18:53:45.862002+0000","last_clean":"2024-05-08T18:53:45.862002+0000","last_became_active":"2024-05-08T18:50:19.738872+0000","last_became_peered":"2024-05-08T18:50:19.738872+0000","last_unstale":"2024-05-08T18:53:45.862002+0000","last_undegraded":"2024-05-08T18:53:45.862002+0000","last_fullsized":"2024-05-08T18:53:45.862002+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:39.101053+0000","last_change":"2024-05-08T18:54:39.101078+0000","last_active":"2024-05-08T18:54:39.101053+0000","last_peered":"2024-05-08T18:54:39.101053+0000","last_clean":"2024-05-08T18:54:39.101053+0000","last_became_active":"2024-05-08T18:50:26.024549+0000","last_became_peered":"2024-05-08T18:50:26.024549+0000","last_unstale":"2024-05-08T18:54:39.101053+0000","last_undegraded":"2024-05-08T18:54:39.101053+0000","last_fullsized":"2024-05-08T18:54:39.101053+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:39.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:39.100939+0000","last_clean_scrub_stamp":"2024-05-08T18:54:39.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:34:28.445091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006928+0000","last_change":"2024-05-08T18:51:15.084930+0000","last_active":"2024-05-08T18:52:43.006928+0000","last_peered":"2024-05-08T18:52:43.006928+0000","last_clean":"2024-05-08T18:52:43.006928+0000","last_became_active":"2024-05-08T18:51:15.084599+0000","last_became_peered":"2024-05-08T18:51:15.084599+0000","last_unstale":"2024-05-08T18:52:43.006928+0000","last_undegraded":"2024-05-08T18:52:43.006928+0000","last_fullsized":"2024-05-08T18:52:43.006928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"27'290","reported_seq":516,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:47.103048+0000","last_change":"2024-05-08T18:53:47.103048+0000","last_active":"2024-05-08T18:53:47.103048+0000","last_peered":"2024-05-08T18:53:47.103048+0000","last_clean":"2024-05-08T18:53:47.103048+0000","last_became_active":"2024-05-08T18:50:32.044539+0000","last_became_peered":"2024-05-08T18:50:32.044539+0000","last_unstale":"2024-05-08T18:53:47.103048+0000","last_undegraded":"2024-05-08T18:53:47.103048+0000","last_fullsized":"2024-05-08T18:53:47.103048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'290","last_scrub_stamp":"2024-05-08T18:53:47.102914+0000","last_deep_scrub":"27'290","last_deep_scrub_stamp":"2024-05-08T18:53:47.102914+0000","last_clean_scrub_stamp":"2024-05-08T18:53:47.102914+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:52.308821+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:07.076576+0000","last_change":"2024-05-08T18:54:07.076608+0000","last_active":"2024-05-08T18:54:07.076576+0000","last_peered":"2024-05-08T18:54:07.076576+0000","last_clean":"2024-05-08T18:54:07.076576+0000","last_became_active":"2024-05-08T18:50:34.043966+0000","last_became_peered":"2024-05-08T18:50:34.043966+0000","last_unstale":"2024-05-08T18:54:07.076576+0000","last_undegraded":"2024-05-08T18:54:07.076576+0000","last_fullsized":"2024-05-08T18:54:07.076576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:07.076486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:07.076486+0000","last_clean_scrub_stamp":"2024-05-08T18:54:07.076486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:33.765444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"27'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:07.937006+0000","last_change":"2024-05-08T18:54:07.937032+0000","last_active":"2024-05-08T18:54:07.937006+0000","last_peered":"2024-05-08T18:54:07.937006+0000","last_clean":"2024-05-08T18:54:07.937006+0000","last_became_active":"2024-05-08T18:50:36.050573+0000","last_became_peered":"2024-05-08T18:50:36.050573+0000","last_unstale":"2024-05-08T18:54:07.937006+0000","last_undegraded":"2024-05-08T18:54:07.937006+0000","last_fullsized":"2024-05-08T18:54:07.937006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-08T18:54:07.936918+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-08T18:54:07.936918+0000","last_clean_scrub_stamp":"2024-05-08T18:54:07.936918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:16.706139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'4","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:16.165482+0000","last_change":"2024-05-08T18:54:16.165554+0000","last_active":"2024-05-08T18:54:16.165482+0000","last_peered":"2024-05-08T18:54:16.165482+0000","last_clean":"2024-05-08T18:54:16.165482+0000","last_became_active":"2024-05-08T18:50:28.027492+0000","last_became_peered":"2024-05-08T18:50:28.027492+0000","last_unstale":"2024-05-08T18:54:16.165482+0000","last_undegraded":"2024-05-08T18:54:16.165482+0000","last_fullsized":"2024-05-08T18:54:16.165482+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:16.165359+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:16.165359+0000","last_clean_scrub_stamp":"2024-05-08T18:54:16.165359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:48.442797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:25.899694+0000","last_change":"2024-05-08T18:54:25.899694+0000","last_active":"2024-05-08T18:54:25.899694+0000","last_peered":"2024-05-08T18:54:25.899694+0000","last_clean":"2024-05-08T18:54:25.899694+0000","last_became_active":"2024-05-08T18:50:19.738788+0000","last_became_peered":"2024-05-08T18:50:19.738788+0000","last_unstale":"2024-05-08T18:54:25.899694+0000","last_undegraded":"2024-05-08T18:54:25.899694+0000","last_fullsized":"2024-05-08T18:54:25.899694+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:25.899584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:25.899584+0000","last_clean_scrub_stamp":"2024-05-08T18:54:25.899584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:28.185977+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'4","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:20.096976+0000","last_change":"2024-05-08T18:54:20.096976+0000","last_active":"2024-05-08T18:54:20.096976+0000","last_peered":"2024-05-08T18:54:20.096976+0000","last_clean":"2024-05-08T18:54:20.096976+0000","last_became_active":"2024-05-08T18:50:26.029197+0000","last_became_peered":"2024-05-08T18:50:26.029197+0000","last_unstale":"2024-05-08T18:54:20.096976+0000","last_undegraded":"2024-05-08T18:54:20.096976+0000","last_fullsized":"2024-05-08T18:54:20.096976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-08T18:54:20.096851+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-08T18:54:20.096851+0000","last_clean_scrub_stamp":"2024-05-08T18:54:20.096851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:32.841665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:04.894236+0000","last_change":"2024-05-08T18:54:04.894272+0000","last_active":"2024-05-08T18:54:04.894236+0000","last_peered":"2024-05-08T18:54:04.894236+0000","last_clean":"2024-05-08T18:54:04.894236+0000","last_became_active":"2024-05-08T18:50:30.028028+0000","last_became_peered":"2024-05-08T18:50:30.028028+0000","last_unstale":"2024-05-08T18:54:04.894236+0000","last_undegraded":"2024-05-08T18:54:04.894236+0000","last_fullsized":"2024-05-08T18:54:04.894236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:04.894146+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:04.894146+0000","last_clean_scrub_stamp":"2024-05-08T18:54:04.894146+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:10.950542+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"27'23","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:56.984125+0000","last_change":"2024-05-08T18:53:56.984125+0000","last_active":"2024-05-08T18:53:56.984125+0000","last_peered":"2024-05-08T18:53:56.984125+0000","last_clean":"2024-05-08T18:53:56.984125+0000","last_became_active":"2024-05-08T18:50:32.036051+0000","last_became_peered":"2024-05-08T18:50:32.036051+0000","last_unstale":"2024-05-08T18:53:56.984125+0000","last_undegraded":"2024-05-08T18:53:56.984125+0000","last_fullsized":"2024-05-08T18:53:56.984125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-05-08T18:53:56.983946+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-05-08T18:53:56.983946+0000","last_clean_scrub_stamp":"2024-05-08T18:53:56.983946+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:47.425987+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.955595+0000","last_change":"2024-05-08T18:53:45.955616+0000","last_active":"2024-05-08T18:53:45.955595+0000","last_peered":"2024-05-08T18:53:45.955595+0000","last_clean":"2024-05-08T18:53:45.955595+0000","last_became_active":"2024-05-08T18:50:34.045541+0000","last_became_peered":"2024-05-08T18:50:34.045541+0000","last_unstale":"2024-05-08T18:53:45.955595+0000","last_undegraded":"2024-05-08T18:53:45.955595+0000","last_fullsized":"2024-05-08T18:53:45.955595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:45.955524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:45.955524+0000","last_clean_scrub_stamp":"2024-05-08T18:53:45.955524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:07.055678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.008500+0000","last_change":"2024-05-08T18:50:36.058086+0000","last_active":"2024-05-08T18:52:53.008500+0000","last_peered":"2024-05-08T18:52:53.008500+0000","last_clean":"2024-05-08T18:52:53.008500+0000","last_became_active":"2024-05-08T18:50:36.057093+0000","last_became_peered":"2024-05-08T18:50:36.057093+0000","last_unstale":"2024-05-08T18:52:53.008500+0000","last_undegraded":"2024-05-08T18:52:53.008500+0000","last_fullsized":"2024-05-08T18:52:53.008500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'22","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:29.058250+0000","last_change":"2024-05-08T18:54:29.058250+0000","last_active":"2024-05-08T18:54:29.058250+0000","last_peered":"2024-05-08T18:54:29.058250+0000","last_clean":"2024-05-08T18:54:29.058250+0000","last_became_active":"2024-05-08T18:50:28.025645+0000","last_became_peered":"2024-05-08T18:50:28.025645+0000","last_unstale":"2024-05-08T18:54:29.058250+0000","last_undegraded":"2024-05-08T18:54:29.058250+0000","last_fullsized":"2024-05-08T18:54:29.058250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-05-08T18:54:29.058118+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-05-08T18:54:29.058118+0000","last_clean_scrub_stamp":"2024-05-08T18:54:29.058118+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:43.432282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.862003+0000","last_change":"2024-05-08T18:50:19.739898+0000","last_active":"2024-05-08T18:53:45.862003+0000","last_peered":"2024-05-08T18:53:45.862003+0000","last_clean":"2024-05-08T18:53:45.862003+0000","last_became_active":"2024-05-08T18:50:19.739620+0000","last_became_peered":"2024-05-08T18:50:19.739620+0000","last_unstale":"2024-05-08T18:53:45.862003+0000","last_undegraded":"2024-05-08T18:53:45.862003+0000","last_fullsized":"2024-05-08T18:53:45.862003+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:29.908194+0000","last_change":"2024-05-08T18:54:29.908194+0000","last_active":"2024-05-08T18:54:29.908194+0000","last_peered":"2024-05-08T18:54:29.908194+0000","last_clean":"2024-05-08T18:54:29.908194+0000","last_became_active":"2024-05-08T18:50:26.023522+0000","last_became_peered":"2024-05-08T18:50:26.023522+0000","last_unstale":"2024-05-08T18:54:29.908194+0000","last_undegraded":"2024-05-08T18:54:29.908194+0000","last_fullsized":"2024-05-08T18:54:29.908194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:29.908070+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:29.908070+0000","last_clean_scrub_stamp":"2024-05-08T18:54:29.908070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:56.597028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:02.050063+0000","last_change":"2024-05-08T18:54:02.050063+0000","last_active":"2024-05-08T18:54:02.050063+0000","last_peered":"2024-05-08T18:54:02.050063+0000","last_clean":"2024-05-08T18:54:02.050063+0000","last_became_active":"2024-05-08T18:50:30.034806+0000","last_became_peered":"2024-05-08T18:50:30.034806+0000","last_unstale":"2024-05-08T18:54:02.050063+0000","last_undegraded":"2024-05-08T18:54:02.050063+0000","last_fullsized":"2024-05-08T18:54:02.050063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:02.049920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:02.049920+0000","last_clean_scrub_stamp":"2024-05-08T18:54:02.049920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:23.760745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"27'20","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:14.125997+0000","last_change":"2024-05-08T18:54:14.126033+0000","last_active":"2024-05-08T18:54:14.125997+0000","last_peered":"2024-05-08T18:54:14.125997+0000","last_clean":"2024-05-08T18:54:14.125997+0000","last_became_active":"2024-05-08T18:50:32.042183+0000","last_became_peered":"2024-05-08T18:50:32.042183+0000","last_unstale":"2024-05-08T18:54:14.125997+0000","last_undegraded":"2024-05-08T18:54:14.125997+0000","last_fullsized":"2024-05-08T18:54:14.125997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-05-08T18:54:14.125910+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-05-08T18:54:14.125910+0000","last_clean_scrub_stamp":"2024-05-08T18:54:14.125910+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:13.974588+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:08.066453+0000","last_change":"2024-05-08T18:54:08.066476+0000","last_active":"2024-05-08T18:54:08.066453+0000","last_peered":"2024-05-08T18:54:08.066453+0000","last_clean":"2024-05-08T18:54:08.066453+0000","last_became_active":"2024-05-08T18:50:34.044358+0000","last_became_peered":"2024-05-08T18:50:34.044358+0000","last_unstale":"2024-05-08T18:54:08.066453+0000","last_undegraded":"2024-05-08T18:54:08.066453+0000","last_fullsized":"2024-05-08T18:54:08.066453+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:08.066352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:08.066352+0000","last_clean_scrub_stamp":"2024-05-08T18:54:08.066352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:30:11.214559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:42.847440+0000","last_change":"2024-05-08T18:54:42.847487+0000","last_active":"2024-05-08T18:54:42.847440+0000","last_peered":"2024-05-08T18:54:42.847440+0000","last_clean":"2024-05-08T18:54:42.847440+0000","last_became_active":"2024-05-08T18:50:36.058267+0000","last_became_peered":"2024-05-08T18:50:36.058267+0000","last_unstale":"2024-05-08T18:54:42.847440+0000","last_undegraded":"2024-05-08T18:54:42.847440+0000","last_fullsized":"2024-05-08T18:54:42.847440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:42.847331+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:42.847331+0000","last_clean_scrub_stamp":"2024-05-08T18:54:42.847331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:24.031305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'12","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:06.982247+0000","last_change":"2024-05-08T18:54:06.982247+0000","last_active":"2024-05-08T18:54:06.982247+0000","last_peered":"2024-05-08T18:54:06.982247+0000","last_clean":"2024-05-08T18:54:06.982247+0000","last_became_active":"2024-05-08T18:50:28.038935+0000","last_became_peered":"2024-05-08T18:50:28.038935+0000","last_unstale":"2024-05-08T18:54:06.982247+0000","last_undegraded":"2024-05-08T18:54:06.982247+0000","last_fullsized":"2024-05-08T18:54:06.982247+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-08T18:54:06.982117+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-08T18:54:06.982117+0000","last_clean_scrub_stamp":"2024-05-08T18:54:06.982117+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:58.509084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:27.936358+0000","last_change":"2024-05-08T18:54:27.936358+0000","last_active":"2024-05-08T18:54:27.936358+0000","last_peered":"2024-05-08T18:54:27.936358+0000","last_clean":"2024-05-08T18:54:27.936358+0000","last_became_active":"2024-05-08T18:50:26.018739+0000","last_became_peered":"2024-05-08T18:50:26.018739+0000","last_unstale":"2024-05-08T18:54:27.936358+0000","last_undegraded":"2024-05-08T18:54:27.936358+0000","last_fullsized":"2024-05-08T18:54:27.936358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:27.936220+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:27.936220+0000","last_clean_scrub_stamp":"2024-05-08T18:54:27.936220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:05.501650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:34.053283+0000","last_change":"2024-05-08T18:54:34.053307+0000","last_active":"2024-05-08T18:54:34.053283+0000","last_peered":"2024-05-08T18:54:34.053283+0000","last_clean":"2024-05-08T18:54:34.053283+0000","last_became_active":"2024-05-08T18:50:19.740835+0000","last_became_peered":"2024-05-08T18:50:19.740835+0000","last_unstale":"2024-05-08T18:54:34.053283+0000","last_undegraded":"2024-05-08T18:54:34.053283+0000","last_fullsized":"2024-05-08T18:54:34.053283+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:34.053190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:34.053190+0000","last_clean_scrub_stamp":"2024-05-08T18:54:34.053190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:01.858524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"27'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:37.821248+0000","last_change":"2024-05-08T18:54:37.821275+0000","last_active":"2024-05-08T18:54:37.821248+0000","last_peered":"2024-05-08T18:54:37.821248+0000","last_clean":"2024-05-08T18:54:37.821248+0000","last_became_active":"2024-05-08T18:51:15.083141+0000","last_became_peered":"2024-05-08T18:51:15.083141+0000","last_unstale":"2024-05-08T18:54:37.821248+0000","last_undegraded":"2024-05-08T18:54:37.821248+0000","last_fullsized":"2024-05-08T18:54:37.821248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:37.821165+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:37.821165+0000","last_clean_scrub_stamp":"2024-05-08T18:54:37.821165+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:46.122851+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"27'73","reported_seq":150,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.986211+0000","last_change":"2024-05-08T18:53:53.986211+0000","last_active":"2024-05-08T18:53:53.986211+0000","last_peered":"2024-05-08T18:53:53.986211+0000","last_clean":"2024-05-08T18:53:53.986211+0000","last_became_active":"2024-05-08T18:50:32.042046+0000","last_became_peered":"2024-05-08T18:50:32.042046+0000","last_unstale":"2024-05-08T18:53:53.986211+0000","last_undegraded":"2024-05-08T18:53:53.986211+0000","last_fullsized":"2024-05-08T18:53:53.986211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'73","last_scrub_stamp":"2024-05-08T18:53:53.986057+0000","last_deep_scrub":"27'73","last_deep_scrub_stamp":"2024-05-08T18:53:53.986057+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.986057+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:48:15.967078+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:48.999108+0000","last_change":"2024-05-08T18:53:48.999132+0000","last_active":"2024-05-08T18:53:48.999108+0000","last_peered":"2024-05-08T18:53:48.999108+0000","last_clean":"2024-05-08T18:53:48.999108+0000","last_became_active":"2024-05-08T18:50:34.044520+0000","last_became_peered":"2024-05-08T18:50:34.044520+0000","last_unstale":"2024-05-08T18:53:48.999108+0000","last_undegraded":"2024-05-08T18:53:48.999108+0000","last_fullsized":"2024-05-08T18:53:48.999108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:48.999007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:48.999007+0000","last_clean_scrub_stamp":"2024-05-08T18:53:48.999007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:21.742255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"27'9","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:11.060309+0000","last_change":"2024-05-08T18:54:11.060343+0000","last_active":"2024-05-08T18:54:11.060309+0000","last_peered":"2024-05-08T18:54:11.060309+0000","last_clean":"2024-05-08T18:54:11.060309+0000","last_became_active":"2024-05-08T18:50:36.046757+0000","last_became_peered":"2024-05-08T18:50:36.046757+0000","last_unstale":"2024-05-08T18:54:11.060309+0000","last_undegraded":"2024-05-08T18:54:11.060309+0000","last_fullsized":"2024-05-08T18:54:11.060309+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-08T18:54:11.060217+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-08T18:54:11.060217+0000","last_clean_scrub_stamp":"2024-05-08T18:54:11.060217+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:57:58.583230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"27'10","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:39.798553+0000","last_change":"2024-05-08T18:54:39.798579+0000","last_active":"2024-05-08T18:54:39.798553+0000","last_peered":"2024-05-08T18:54:39.798553+0000","last_clean":"2024-05-08T18:54:39.798553+0000","last_became_active":"2024-05-08T18:51:15.084151+0000","last_became_peered":"2024-05-08T18:51:15.084151+0000","last_unstale":"2024-05-08T18:54:39.798553+0000","last_undegraded":"2024-05-08T18:54:39.798553+0000","last_fullsized":"2024-05-08T18:54:39.798553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:39.798463+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:39.798463+0000","last_clean_scrub_stamp":"2024-05-08T18:54:39.798463+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:54.076319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:30.043791+0000","last_change":"2024-05-08T18:54:30.043791+0000","last_active":"2024-05-08T18:54:30.043791+0000","last_peered":"2024-05-08T18:54:30.043791+0000","last_clean":"2024-05-08T18:54:30.043791+0000","last_became_active":"2024-05-08T18:50:26.024894+0000","last_became_peered":"2024-05-08T18:50:26.024894+0000","last_unstale":"2024-05-08T18:54:30.043791+0000","last_undegraded":"2024-05-08T18:54:30.043791+0000","last_fullsized":"2024-05-08T18:54:30.043791+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:30.043668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:30.043668+0000","last_clean_scrub_stamp":"2024-05-08T18:54:30.043668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:40:02.169764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.862014+0000","last_change":"2024-05-08T18:50:19.739473+0000","last_active":"2024-05-08T18:53:45.862014+0000","last_peered":"2024-05-08T18:53:45.862014+0000","last_clean":"2024-05-08T18:53:45.862014+0000","last_became_active":"2024-05-08T18:50:19.739124+0000","last_became_peered":"2024-05-08T18:50:19.739124+0000","last_unstale":"2024-05-08T18:53:45.862014+0000","last_undegraded":"2024-05-08T18:53:45.862014+0000","last_fullsized":"2024-05-08T18:53:45.862014+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:54.073547+0000","last_change":"2024-05-08T18:53:54.073547+0000","last_active":"2024-05-08T18:53:54.073547+0000","last_peered":"2024-05-08T18:53:54.073547+0000","last_clean":"2024-05-08T18:53:54.073547+0000","last_became_active":"2024-05-08T18:50:30.032546+0000","last_became_peered":"2024-05-08T18:50:30.032546+0000","last_unstale":"2024-05-08T18:53:54.073547+0000","last_undegraded":"2024-05-08T18:53:54.073547+0000","last_fullsized":"2024-05-08T18:53:54.073547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:54.073430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:54.073430+0000","last_clean_scrub_stamp":"2024-05-08T18:53:54.073430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:08.017553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"27'21","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:49.087885+0000","last_change":"2024-05-08T18:53:49.087885+0000","last_active":"2024-05-08T18:53:49.087885+0000","last_peered":"2024-05-08T18:53:49.087885+0000","last_clean":"2024-05-08T18:53:49.087885+0000","last_became_active":"2024-05-08T18:50:32.040767+0000","last_became_peered":"2024-05-08T18:50:32.040767+0000","last_unstale":"2024-05-08T18:53:49.087885+0000","last_undegraded":"2024-05-08T18:53:49.087885+0000","last_fullsized":"2024-05-08T18:53:49.087885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-05-08T18:53:49.087754+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-05-08T18:53:49.087754+0000","last_clean_scrub_stamp":"2024-05-08T18:53:49.087754+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:00.700903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"27'285","reported_seq":387,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:48.068502+0000","last_change":"2024-05-08T18:53:48.068502+0000","last_active":"2024-05-08T18:53:48.068502+0000","last_peered":"2024-05-08T18:53:48.068502+0000","last_clean":"2024-05-08T18:53:48.068502+0000","last_became_active":"2024-05-08T18:50:34.043167+0000","last_became_peered":"2024-05-08T18:50:34.043167+0000","last_unstale":"2024-05-08T18:53:48.068502+0000","last_undegraded":"2024-05-08T18:53:48.068502+0000","last_fullsized":"2024-05-08T18:53:48.068502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:48.068390+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:48.068390+0000","last_clean_scrub_stamp":"2024-05-08T18:53:48.068390+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:09.168544+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.891908+0000","last_change":"2024-05-08T18:50:36.061014+0000","last_active":"2024-05-08T18:53:34.891908+0000","last_peered":"2024-05-08T18:53:34.891908+0000","last_clean":"2024-05-08T18:53:34.891908+0000","last_became_active":"2024-05-08T18:50:36.060727+0000","last_became_peered":"2024-05-08T18:50:36.060727+0000","last_unstale":"2024-05-08T18:53:34.891908+0000","last_undegraded":"2024-05-08T18:53:34.891908+0000","last_fullsized":"2024-05-08T18:53:34.891908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"27'22","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:38.804803+0000","last_change":"2024-05-08T18:54:38.804853+0000","last_active":"2024-05-08T18:54:38.804803+0000","last_peered":"2024-05-08T18:54:38.804803+0000","last_clean":"2024-05-08T18:54:38.804803+0000","last_became_active":"2024-05-08T18:51:15.083568+0000","last_became_peered":"2024-05-08T18:51:15.083568+0000","last_unstale":"2024-05-08T18:54:38.804803+0000","last_undegraded":"2024-05-08T18:54:38.804803+0000","last_fullsized":"2024-05-08T18:54:38.804803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-05-08T18:54:38.804700+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-05-08T18:54:38.804700+0000","last_clean_scrub_stamp":"2024-05-08T18:54:38.804700+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:37.707904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":68,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.885575+0000","last_change":"2024-05-08T18:50:26.016666+0000","last_active":"2024-05-08T18:53:34.885575+0000","last_peered":"2024-05-08T18:53:34.885575+0000","last_clean":"2024-05-08T18:53:34.885575+0000","last_became_active":"2024-05-08T18:50:26.016210+0000","last_became_peered":"2024-05-08T18:50:26.016210+0000","last_unstale":"2024-05-08T18:53:34.885575+0000","last_undegraded":"2024-05-08T18:53:34.885575+0000","last_fullsized":"2024-05-08T18:53:34.885575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:33.035194+0000","last_change":"2024-05-08T18:54:33.035194+0000","last_active":"2024-05-08T18:54:33.035194+0000","last_peered":"2024-05-08T18:54:33.035194+0000","last_clean":"2024-05-08T18:54:33.035194+0000","last_became_active":"2024-05-08T18:50:19.740355+0000","last_became_peered":"2024-05-08T18:50:19.740355+0000","last_unstale":"2024-05-08T18:54:33.035194+0000","last_undegraded":"2024-05-08T18:54:33.035194+0000","last_fullsized":"2024-05-08T18:54:33.035194+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:33.035076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:33.035076+0000","last_clean_scrub_stamp":"2024-05-08T18:54:33.035076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:38.299918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.055060+0000","last_change":"2024-05-08T18:53:53.055060+0000","last_active":"2024-05-08T18:53:53.055060+0000","last_peered":"2024-05-08T18:53:53.055060+0000","last_clean":"2024-05-08T18:53:53.055060+0000","last_became_active":"2024-05-08T18:50:30.031351+0000","last_became_peered":"2024-05-08T18:50:30.031351+0000","last_unstale":"2024-05-08T18:53:53.055060+0000","last_undegraded":"2024-05-08T18:53:53.055060+0000","last_fullsized":"2024-05-08T18:53:53.055060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:53.054930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:53.054930+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.054930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:23.805172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'15","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:15.083821+0000","last_change":"2024-05-08T18:54:15.083821+0000","last_active":"2024-05-08T18:54:15.083821+0000","last_peered":"2024-05-08T18:54:15.083821+0000","last_clean":"2024-05-08T18:54:15.083821+0000","last_became_active":"2024-05-08T18:50:32.041231+0000","last_became_peered":"2024-05-08T18:50:32.041231+0000","last_unstale":"2024-05-08T18:54:15.083821+0000","last_undegraded":"2024-05-08T18:54:15.083821+0000","last_fullsized":"2024-05-08T18:54:15.083821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-08T18:54:15.083708+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-08T18:54:15.083708+0000","last_clean_scrub_stamp":"2024-05-08T18:54:15.083708+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:23.385394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"27'285","reported_seq":401,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:50.993021+0000","last_change":"2024-05-08T18:53:50.993052+0000","last_active":"2024-05-08T18:53:50.993021+0000","last_peered":"2024-05-08T18:53:50.993021+0000","last_clean":"2024-05-08T18:53:50.993021+0000","last_became_active":"2024-05-08T18:50:34.047608+0000","last_became_peered":"2024-05-08T18:50:34.047608+0000","last_unstale":"2024-05-08T18:53:50.993021+0000","last_undegraded":"2024-05-08T18:53:50.993021+0000","last_fullsized":"2024-05-08T18:53:50.993021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:50.992925+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:50.992925+0000","last_clean_scrub_stamp":"2024-05-08T18:53:50.992925+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:17.318647+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"25'5","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:39.876432+0000","last_change":"2024-05-08T18:54:39.876473+0000","last_active":"2024-05-08T18:54:39.876432+0000","last_peered":"2024-05-08T18:54:39.876432+0000","last_clean":"2024-05-08T18:54:39.876432+0000","last_became_active":"2024-05-08T18:50:36.054747+0000","last_became_peered":"2024-05-08T18:50:36.054747+0000","last_unstale":"2024-05-08T18:54:39.876432+0000","last_undegraded":"2024-05-08T18:54:39.876432+0000","last_fullsized":"2024-05-08T18:54:39.876432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-08T18:54:39.876310+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-08T18:54:39.876310+0000","last_clean_scrub_stamp":"2024-05-08T18:54:39.876310+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:20.489072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:21.941842+0000","last_change":"2024-05-08T18:54:21.941842+0000","last_active":"2024-05-08T18:54:21.941842+0000","last_peered":"2024-05-08T18:54:21.941842+0000","last_clean":"2024-05-08T18:54:21.941842+0000","last_became_active":"2024-05-08T18:50:28.033163+0000","last_became_peered":"2024-05-08T18:50:28.033163+0000","last_unstale":"2024-05-08T18:54:21.941842+0000","last_undegraded":"2024-05-08T18:54:21.941842+0000","last_fullsized":"2024-05-08T18:54:21.941842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:21.941726+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:21.941726+0000","last_clean_scrub_stamp":"2024-05-08T18:54:21.941726+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:33.131935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:35.794451+0000","last_change":"2024-05-08T18:54:35.794473+0000","last_active":"2024-05-08T18:54:35.794451+0000","last_peered":"2024-05-08T18:54:35.794451+0000","last_clean":"2024-05-08T18:54:35.794451+0000","last_became_active":"2024-05-08T18:50:26.026719+0000","last_became_peered":"2024-05-08T18:50:26.026719+0000","last_unstale":"2024-05-08T18:54:35.794451+0000","last_undegraded":"2024-05-08T18:54:35.794451+0000","last_fullsized":"2024-05-08T18:54:35.794451+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:35.794356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:35.794356+0000","last_clean_scrub_stamp":"2024-05-08T18:54:35.794356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:32.011854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.862021+0000","last_change":"2024-05-08T18:50:19.739345+0000","last_active":"2024-05-08T18:53:45.862021+0000","last_peered":"2024-05-08T18:53:45.862021+0000","last_clean":"2024-05-08T18:53:45.862021+0000","last_became_active":"2024-05-08T18:50:19.738971+0000","last_became_peered":"2024-05-08T18:50:19.738971+0000","last_unstale":"2024-05-08T18:53:45.862021+0000","last_undegraded":"2024-05-08T18:53:45.862021+0000","last_fullsized":"2024-05-08T18:53:45.862021+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:18.730482+0000","last_clean_scrub_stamp":"2024-05-08T18:50:18.730482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:55.069024+0000","last_change":"2024-05-08T18:53:55.069024+0000","last_active":"2024-05-08T18:53:55.069024+0000","last_peered":"2024-05-08T18:53:55.069024+0000","last_clean":"2024-05-08T18:53:55.069024+0000","last_became_active":"2024-05-08T18:50:30.032197+0000","last_became_peered":"2024-05-08T18:50:30.032197+0000","last_unstale":"2024-05-08T18:53:55.069024+0000","last_undegraded":"2024-05-08T18:53:55.069024+0000","last_fullsized":"2024-05-08T18:53:55.069024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:55.068843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:55.068843+0000","last_clean_scrub_stamp":"2024-05-08T18:53:55.068843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:15.069363+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"27'96","reported_seq":190,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.979024+0000","last_change":"2024-05-08T18:53:53.979024+0000","last_active":"2024-05-08T18:53:53.979024+0000","last_peered":"2024-05-08T18:53:53.979024+0000","last_clean":"2024-05-08T18:53:53.979024+0000","last_became_active":"2024-05-08T18:50:32.043109+0000","last_became_peered":"2024-05-08T18:50:32.043109+0000","last_unstale":"2024-05-08T18:53:53.979024+0000","last_undegraded":"2024-05-08T18:53:53.979024+0000","last_fullsized":"2024-05-08T18:53:53.979024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'96","last_scrub_stamp":"2024-05-08T18:53:53.978862+0000","last_deep_scrub":"27'96","last_deep_scrub_stamp":"2024-05-08T18:53:53.978862+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.978862+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:02.797212+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:52.944796+0000","last_change":"2024-05-08T18:53:52.944818+0000","last_active":"2024-05-08T18:53:52.944796+0000","last_peered":"2024-05-08T18:53:52.944796+0000","last_clean":"2024-05-08T18:53:52.944796+0000","last_became_active":"2024-05-08T18:50:34.043495+0000","last_became_peered":"2024-05-08T18:50:34.043495+0000","last_unstale":"2024-05-08T18:53:52.944796+0000","last_undegraded":"2024-05-08T18:53:52.944796+0000","last_fullsized":"2024-05-08T18:53:52.944796+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:52.944707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:52.944707+0000","last_clean_scrub_stamp":"2024-05-08T18:53:52.944707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:51.657538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:59.972475+0000","last_change":"2024-05-08T18:53:59.972499+0000","last_active":"2024-05-08T18:53:59.972475+0000","last_peered":"2024-05-08T18:53:59.972475+0000","last_clean":"2024-05-08T18:53:59.972475+0000","last_became_active":"2024-05-08T18:50:36.044491+0000","last_became_peered":"2024-05-08T18:50:36.044491+0000","last_unstale":"2024-05-08T18:53:59.972475+0000","last_undegraded":"2024-05-08T18:53:59.972475+0000","last_fullsized":"2024-05-08T18:53:59.972475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:53:59.972386+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:53:59.972386+0000","last_clean_scrub_stamp":"2024-05-08T18:53:59.972386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:29.340986+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:35.862427+0000","last_change":"2024-05-08T18:54:35.862452+0000","last_active":"2024-05-08T18:54:35.862427+0000","last_peered":"2024-05-08T18:54:35.862427+0000","last_clean":"2024-05-08T18:54:35.862427+0000","last_became_active":"2024-05-08T18:50:36.050722+0000","last_became_peered":"2024-05-08T18:50:36.050722+0000","last_unstale":"2024-05-08T18:54:35.862427+0000","last_undegraded":"2024-05-08T18:54:35.862427+0000","last_fullsized":"2024-05-08T18:54:35.862427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:35.862340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:35.862340+0000","last_clean_scrub_stamp":"2024-05-08T18:54:35.862340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:40:20.606010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"27'10","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:17.952118+0000","last_change":"2024-05-08T18:54:17.952151+0000","last_active":"2024-05-08T18:54:17.952118+0000","last_peered":"2024-05-08T18:54:17.952118+0000","last_clean":"2024-05-08T18:54:17.952118+0000","last_became_active":"2024-05-08T18:50:28.033010+0000","last_became_peered":"2024-05-08T18:50:28.033010+0000","last_unstale":"2024-05-08T18:54:17.952118+0000","last_undegraded":"2024-05-08T18:54:17.952118+0000","last_fullsized":"2024-05-08T18:54:17.952118+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:17.952018+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:17.952018+0000","last_clean_scrub_stamp":"2024-05-08T18:54:17.952018+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:37.952538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007703+0000","last_change":"2024-05-08T18:50:26.027008+0000","last_active":"2024-05-08T18:52:48.007703+0000","last_peered":"2024-05-08T18:52:48.007703+0000","last_clean":"2024-05-08T18:52:48.007703+0000","last_became_active":"2024-05-08T18:50:26.025828+0000","last_became_peered":"2024-05-08T18:50:26.025828+0000","last_unstale":"2024-05-08T18:52:48.007703+0000","last_undegraded":"2024-05-08T18:52:48.007703+0000","last_fullsized":"2024-05-08T18:52:48.007703+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.007987+0000","last_change":"2024-05-08T18:51:15.082912+0000","last_active":"2024-05-08T18:52:53.007987+0000","last_peered":"2024-05-08T18:52:53.007987+0000","last_clean":"2024-05-08T18:52:53.007987+0000","last_became_active":"2024-05-08T18:51:15.082590+0000","last_became_peered":"2024-05-08T18:51:15.082590+0000","last_unstale":"2024-05-08T18:52:53.007987+0000","last_undegraded":"2024-05-08T18:52:53.007987+0000","last_fullsized":"2024-05-08T18:52:53.007987+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"27'40","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:50.089105+0000","last_change":"2024-05-08T18:53:50.089149+0000","last_active":"2024-05-08T18:53:50.089105+0000","last_peered":"2024-05-08T18:53:50.089105+0000","last_clean":"2024-05-08T18:53:50.089105+0000","last_became_active":"2024-05-08T18:50:32.038591+0000","last_became_peered":"2024-05-08T18:50:32.038591+0000","last_unstale":"2024-05-08T18:53:50.089105+0000","last_undegraded":"2024-05-08T18:53:50.089105+0000","last_fullsized":"2024-05-08T18:53:50.089105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-05-08T18:53:50.089008+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-05-08T18:53:50.089008+0000","last_clean_scrub_stamp":"2024-05-08T18:53:50.089008+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:59.963311+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:20.042995+0000","last_change":"2024-05-08T18:54:20.043031+0000","last_active":"2024-05-08T18:54:20.042995+0000","last_peered":"2024-05-08T18:54:20.042995+0000","last_clean":"2024-05-08T18:54:20.042995+0000","last_became_active":"2024-05-08T18:50:34.050749+0000","last_became_peered":"2024-05-08T18:50:34.050749+0000","last_unstale":"2024-05-08T18:54:20.042995+0000","last_undegraded":"2024-05-08T18:54:20.042995+0000","last_fullsized":"2024-05-08T18:54:20.042995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:20.042859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:20.042859+0000","last_clean_scrub_stamp":"2024-05-08T18:54:20.042859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:33.623374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"27'15","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:44.492234+0000","last_change":"2024-05-08T18:50:36.054332+0000","last_active":"2024-05-08T18:53:44.492234+0000","last_peered":"2024-05-08T18:53:44.492234+0000","last_clean":"2024-05-08T18:53:44.492234+0000","last_became_active":"2024-05-08T18:50:36.054102+0000","last_became_peered":"2024-05-08T18:50:36.054102+0000","last_unstale":"2024-05-08T18:53:44.492234+0000","last_undegraded":"2024-05-08T18:53:44.492234+0000","last_fullsized":"2024-05-08T18:53:44.492234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"27'6","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:08.935691+0000","last_change":"2024-05-08T18:54:08.935717+0000","last_active":"2024-05-08T18:54:08.935691+0000","last_peered":"2024-05-08T18:54:08.935691+0000","last_clean":"2024-05-08T18:54:08.935691+0000","last_became_active":"2024-05-08T18:50:28.038587+0000","last_became_peered":"2024-05-08T18:50:28.038587+0000","last_unstale":"2024-05-08T18:54:08.935691+0000","last_undegraded":"2024-05-08T18:54:08.935691+0000","last_fullsized":"2024-05-08T18:54:08.935691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:08.935594+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:08.935594+0000","last_clean_scrub_stamp":"2024-05-08T18:54:08.935594+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:39.685836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:18.918416+0000","last_change":"2024-05-08T18:54:18.918440+0000","last_active":"2024-05-08T18:54:18.918416+0000","last_peered":"2024-05-08T18:54:18.918416+0000","last_clean":"2024-05-08T18:54:18.918416+0000","last_became_active":"2024-05-08T18:50:26.031509+0000","last_became_peered":"2024-05-08T18:50:26.031509+0000","last_unstale":"2024-05-08T18:54:18.918416+0000","last_undegraded":"2024-05-08T18:54:18.918416+0000","last_fullsized":"2024-05-08T18:54:18.918416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:18.918312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:18.918312+0000","last_clean_scrub_stamp":"2024-05-08T18:54:18.918312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:54.297707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:51.065753+0000","last_change":"2024-05-08T18:53:51.065788+0000","last_active":"2024-05-08T18:53:51.065753+0000","last_peered":"2024-05-08T18:53:51.065753+0000","last_clean":"2024-05-08T18:53:51.065753+0000","last_became_active":"2024-05-08T18:50:30.034178+0000","last_became_peered":"2024-05-08T18:50:30.034178+0000","last_unstale":"2024-05-08T18:53:51.065753+0000","last_undegraded":"2024-05-08T18:53:51.065753+0000","last_fullsized":"2024-05-08T18:53:51.065753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:51.065645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:51.065645+0000","last_clean_scrub_stamp":"2024-05-08T18:53:51.065645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:42.592612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'9","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:00.016731+0000","last_change":"2024-05-08T18:54:00.016762+0000","last_active":"2024-05-08T18:54:00.016731+0000","last_peered":"2024-05-08T18:54:00.016731+0000","last_clean":"2024-05-08T18:54:00.016731+0000","last_became_active":"2024-05-08T18:50:32.036371+0000","last_became_peered":"2024-05-08T18:50:32.036371+0000","last_unstale":"2024-05-08T18:54:00.016731+0000","last_undegraded":"2024-05-08T18:54:00.016731+0000","last_fullsized":"2024-05-08T18:54:00.016731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-08T18:54:00.016634+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-08T18:54:00.016634+0000","last_clean_scrub_stamp":"2024-05-08T18:54:00.016634+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:07.475619+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:52.036037+0000","last_change":"2024-05-08T18:53:52.036087+0000","last_active":"2024-05-08T18:53:52.036037+0000","last_peered":"2024-05-08T18:53:52.036037+0000","last_clean":"2024-05-08T18:53:52.036037+0000","last_became_active":"2024-05-08T18:50:34.048434+0000","last_became_peered":"2024-05-08T18:50:34.048434+0000","last_unstale":"2024-05-08T18:53:52.036037+0000","last_undegraded":"2024-05-08T18:53:52.036037+0000","last_fullsized":"2024-05-08T18:53:52.036037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:52.035926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:52.035926+0000","last_clean_scrub_stamp":"2024-05-08T18:53:52.035926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:09.492022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:42.006706+0000","last_change":"2024-05-08T18:54:42.006750+0000","last_active":"2024-05-08T18:54:42.006706+0000","last_peered":"2024-05-08T18:54:42.006706+0000","last_clean":"2024-05-08T18:54:42.006706+0000","last_became_active":"2024-05-08T18:50:36.047379+0000","last_became_peered":"2024-05-08T18:50:36.047379+0000","last_unstale":"2024-05-08T18:54:42.006706+0000","last_undegraded":"2024-05-08T18:54:42.006706+0000","last_fullsized":"2024-05-08T18:54:42.006706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:42.006566+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:42.006566+0000","last_clean_scrub_stamp":"2024-05-08T18:54:42.006566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:59.612675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"27'6","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:19.140265+0000","last_change":"2024-05-08T18:54:19.140338+0000","last_active":"2024-05-08T18:54:19.140265+0000","last_peered":"2024-05-08T18:54:19.140265+0000","last_clean":"2024-05-08T18:54:19.140265+0000","last_became_active":"2024-05-08T18:50:28.022636+0000","last_became_peered":"2024-05-08T18:50:28.022636+0000","last_unstale":"2024-05-08T18:54:19.140265+0000","last_undegraded":"2024-05-08T18:54:19.140265+0000","last_fullsized":"2024-05-08T18:54:19.140265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:19.140160+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:19.140160+0000","last_clean_scrub_stamp":"2024-05-08T18:54:19.140160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:58:19.922822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"25'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:22.954334+0000","last_change":"2024-05-08T18:54:22.954361+0000","last_active":"2024-05-08T18:54:22.954334+0000","last_peered":"2024-05-08T18:54:22.954334+0000","last_clean":"2024-05-08T18:54:22.954334+0000","last_became_active":"2024-05-08T18:50:26.030884+0000","last_became_peered":"2024-05-08T18:50:26.030884+0000","last_unstale":"2024-05-08T18:54:22.954334+0000","last_undegraded":"2024-05-08T18:54:22.954334+0000","last_fullsized":"2024-05-08T18:54:22.954334+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:22.954247+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:22.954247+0000","last_clean_scrub_stamp":"2024-05-08T18:54:22.954247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:34.259820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:02.929650+0000","last_change":"2024-05-08T18:54:02.929688+0000","last_active":"2024-05-08T18:54:02.929650+0000","last_peered":"2024-05-08T18:54:02.929650+0000","last_clean":"2024-05-08T18:54:02.929650+0000","last_became_active":"2024-05-08T18:50:30.030773+0000","last_became_peered":"2024-05-08T18:50:30.030773+0000","last_unstale":"2024-05-08T18:54:02.929650+0000","last_undegraded":"2024-05-08T18:54:02.929650+0000","last_fullsized":"2024-05-08T18:54:02.929650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:02.929533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:02.929533+0000","last_clean_scrub_stamp":"2024-05-08T18:54:02.929533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:48:24.910553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"27'47","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:01.044939+0000","last_change":"2024-05-08T18:54:01.044974+0000","last_active":"2024-05-08T18:54:01.044939+0000","last_peered":"2024-05-08T18:54:01.044939+0000","last_clean":"2024-05-08T18:54:01.044939+0000","last_became_active":"2024-05-08T18:50:32.032289+0000","last_became_peered":"2024-05-08T18:50:32.032289+0000","last_unstale":"2024-05-08T18:54:01.044939+0000","last_undegraded":"2024-05-08T18:54:01.044939+0000","last_fullsized":"2024-05-08T18:54:01.044939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2024-05-08T18:54:01.044854+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2024-05-08T18:54:01.044854+0000","last_clean_scrub_stamp":"2024-05-08T18:54:01.044854+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:01.160239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.050696+0000","last_change":"2024-05-08T18:53:45.050721+0000","last_active":"2024-05-08T18:53:45.050696+0000","last_peered":"2024-05-08T18:53:45.050696+0000","last_clean":"2024-05-08T18:53:45.050696+0000","last_became_active":"2024-05-08T18:50:34.042903+0000","last_became_peered":"2024-05-08T18:50:34.042903+0000","last_unstale":"2024-05-08T18:53:45.050696+0000","last_undegraded":"2024-05-08T18:53:45.050696+0000","last_fullsized":"2024-05-08T18:53:45.050696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:45.050602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:45.050602+0000","last_clean_scrub_stamp":"2024-05-08T18:53:45.050602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:02.506698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:36.049041+0000","last_change":"2024-05-08T18:54:36.049066+0000","last_active":"2024-05-08T18:54:36.049041+0000","last_peered":"2024-05-08T18:54:36.049041+0000","last_clean":"2024-05-08T18:54:36.049041+0000","last_became_active":"2024-05-08T18:50:36.055855+0000","last_became_peered":"2024-05-08T18:50:36.055855+0000","last_unstale":"2024-05-08T18:54:36.049041+0000","last_undegraded":"2024-05-08T18:54:36.049041+0000","last_fullsized":"2024-05-08T18:54:36.049041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:36.048948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:36.048948+0000","last_clean_scrub_stamp":"2024-05-08T18:54:36.048948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:02.455091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"27'12","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:21.089048+0000","last_change":"2024-05-08T18:54:21.089082+0000","last_active":"2024-05-08T18:54:21.089048+0000","last_peered":"2024-05-08T18:54:21.089048+0000","last_clean":"2024-05-08T18:54:21.089048+0000","last_became_active":"2024-05-08T18:50:28.034819+0000","last_became_peered":"2024-05-08T18:50:28.034819+0000","last_unstale":"2024-05-08T18:54:21.089048+0000","last_undegraded":"2024-05-08T18:54:21.089048+0000","last_fullsized":"2024-05-08T18:54:21.089048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-08T18:54:21.088960+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-08T18:54:21.088960+0000","last_clean_scrub_stamp":"2024-05-08T18:54:21.088960+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:41.111340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:28.703724+0000","last_change":"2024-05-08T18:54:28.703748+0000","last_active":"2024-05-08T18:54:28.703724+0000","last_peered":"2024-05-08T18:54:28.703724+0000","last_clean":"2024-05-08T18:54:28.703724+0000","last_became_active":"2024-05-08T18:50:26.029211+0000","last_became_peered":"2024-05-08T18:50:26.029211+0000","last_unstale":"2024-05-08T18:54:28.703724+0000","last_undegraded":"2024-05-08T18:54:28.703724+0000","last_fullsized":"2024-05-08T18:54:28.703724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:28.703639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:28.703639+0000","last_clean_scrub_stamp":"2024-05-08T18:54:28.703639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:39.823439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:57.055070+0000","last_change":"2024-05-08T18:53:57.055135+0000","last_active":"2024-05-08T18:53:57.055070+0000","last_peered":"2024-05-08T18:53:57.055070+0000","last_clean":"2024-05-08T18:53:57.055070+0000","last_became_active":"2024-05-08T18:50:30.031588+0000","last_became_peered":"2024-05-08T18:50:30.031588+0000","last_unstale":"2024-05-08T18:53:57.055070+0000","last_undegraded":"2024-05-08T18:53:57.055070+0000","last_fullsized":"2024-05-08T18:53:57.055070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:57.054969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:57.054969+0000","last_clean_scrub_stamp":"2024-05-08T18:53:57.054969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:57:44.577983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"27'36","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:57.960934+0000","last_change":"2024-05-08T18:53:57.960966+0000","last_active":"2024-05-08T18:53:57.960934+0000","last_peered":"2024-05-08T18:53:57.960934+0000","last_clean":"2024-05-08T18:53:57.960934+0000","last_became_active":"2024-05-08T18:50:32.035181+0000","last_became_peered":"2024-05-08T18:50:32.035181+0000","last_unstale":"2024-05-08T18:53:57.960934+0000","last_undegraded":"2024-05-08T18:53:57.960934+0000","last_fullsized":"2024-05-08T18:53:57.960934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-05-08T18:53:57.960820+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-05-08T18:53:57.960820+0000","last_clean_scrub_stamp":"2024-05-08T18:53:57.960820+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:23.268890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:49.951155+0000","last_change":"2024-05-08T18:53:49.951177+0000","last_active":"2024-05-08T18:53:49.951155+0000","last_peered":"2024-05-08T18:53:49.951155+0000","last_clean":"2024-05-08T18:53:49.951155+0000","last_became_active":"2024-05-08T18:50:34.039668+0000","last_became_peered":"2024-05-08T18:50:34.039668+0000","last_unstale":"2024-05-08T18:53:49.951155+0000","last_undegraded":"2024-05-08T18:53:49.951155+0000","last_fullsized":"2024-05-08T18:53:49.951155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:49.951058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:49.951058+0000","last_clean_scrub_stamp":"2024-05-08T18:53:49.951058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:24.708273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:31.079781+0000","last_change":"2024-05-08T18:54:31.079781+0000","last_active":"2024-05-08T18:54:31.079781+0000","last_peered":"2024-05-08T18:54:31.079781+0000","last_clean":"2024-05-08T18:54:31.079781+0000","last_became_active":"2024-05-08T18:50:28.025862+0000","last_became_peered":"2024-05-08T18:50:28.025862+0000","last_unstale":"2024-05-08T18:54:31.079781+0000","last_undegraded":"2024-05-08T18:54:31.079781+0000","last_fullsized":"2024-05-08T18:54:31.079781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:31.079644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:31.079644+0000","last_clean_scrub_stamp":"2024-05-08T18:54:31.079644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:35.554801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.008366+0000","last_change":"2024-05-08T18:50:26.023167+0000","last_active":"2024-05-08T18:52:53.008366+0000","last_peered":"2024-05-08T18:52:53.008366+0000","last_clean":"2024-05-08T18:52:53.008366+0000","last_became_active":"2024-05-08T18:50:26.022874+0000","last_became_peered":"2024-05-08T18:50:26.022874+0000","last_unstale":"2024-05-08T18:52:53.008366+0000","last_undegraded":"2024-05-08T18:52:53.008366+0000","last_fullsized":"2024-05-08T18:52:53.008366+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:08.022479+0000","last_change":"2024-05-08T18:54:08.022479+0000","last_active":"2024-05-08T18:54:08.022479+0000","last_peered":"2024-05-08T18:54:08.022479+0000","last_clean":"2024-05-08T18:54:08.022479+0000","last_became_active":"2024-05-08T18:50:30.029570+0000","last_became_peered":"2024-05-08T18:50:30.029570+0000","last_unstale":"2024-05-08T18:54:08.022479+0000","last_undegraded":"2024-05-08T18:54:08.022479+0000","last_fullsized":"2024-05-08T18:54:08.022479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:08.022348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:08.022348+0000","last_clean_scrub_stamp":"2024-05-08T18:54:08.022348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:31.732172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"27'65","reported_seq":138,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.032557+0000","last_change":"2024-05-08T18:53:58.032598+0000","last_active":"2024-05-08T18:53:58.032557+0000","last_peered":"2024-05-08T18:53:58.032557+0000","last_clean":"2024-05-08T18:53:58.032557+0000","last_became_active":"2024-05-08T18:50:32.039293+0000","last_became_peered":"2024-05-08T18:50:32.039293+0000","last_unstale":"2024-05-08T18:53:58.032557+0000","last_undegraded":"2024-05-08T18:53:58.032557+0000","last_fullsized":"2024-05-08T18:53:58.032557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'65","last_scrub_stamp":"2024-05-08T18:53:58.032459+0000","last_deep_scrub":"27'65","last_deep_scrub_stamp":"2024-05-08T18:53:58.032459+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.032459+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:46.844977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:46.910687+0000","last_change":"2024-05-08T18:53:46.910709+0000","last_active":"2024-05-08T18:53:46.910687+0000","last_peered":"2024-05-08T18:53:46.910687+0000","last_clean":"2024-05-08T18:53:46.910687+0000","last_became_active":"2024-05-08T18:50:34.047111+0000","last_became_peered":"2024-05-08T18:50:34.047111+0000","last_unstale":"2024-05-08T18:53:46.910687+0000","last_undegraded":"2024-05-08T18:53:46.910687+0000","last_fullsized":"2024-05-08T18:53:46.910687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:46.910595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:46.910595+0000","last_clean_scrub_stamp":"2024-05-08T18:53:46.910595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:27.588782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"27'14","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:15.117084+0000","last_change":"2024-05-08T18:54:15.117146+0000","last_active":"2024-05-08T18:54:15.117084+0000","last_peered":"2024-05-08T18:54:15.117084+0000","last_clean":"2024-05-08T18:54:15.117084+0000","last_became_active":"2024-05-08T18:50:36.046834+0000","last_became_peered":"2024-05-08T18:50:36.046834+0000","last_unstale":"2024-05-08T18:54:15.117084+0000","last_undegraded":"2024-05-08T18:54:15.117084+0000","last_fullsized":"2024-05-08T18:54:15.117084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-05-08T18:54:15.116980+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-05-08T18:54:15.116980+0000","last_clean_scrub_stamp":"2024-05-08T18:54:15.116980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:44.747454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'6","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:23.073696+0000","last_change":"2024-05-08T18:54:23.073696+0000","last_active":"2024-05-08T18:54:23.073696+0000","last_peered":"2024-05-08T18:54:23.073696+0000","last_clean":"2024-05-08T18:54:23.073696+0000","last_became_active":"2024-05-08T18:50:28.023049+0000","last_became_peered":"2024-05-08T18:50:28.023049+0000","last_unstale":"2024-05-08T18:54:23.073696+0000","last_undegraded":"2024-05-08T18:54:23.073696+0000","last_fullsized":"2024-05-08T18:54:23.073696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:23.073500+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:23.073500+0000","last_clean_scrub_stamp":"2024-05-08T18:54:23.073500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:09.762958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:26.777022+0000","last_change":"2024-05-08T18:54:26.777050+0000","last_active":"2024-05-08T18:54:26.777022+0000","last_peered":"2024-05-08T18:54:26.777022+0000","last_clean":"2024-05-08T18:54:26.777022+0000","last_became_active":"2024-05-08T18:50:26.029008+0000","last_became_peered":"2024-05-08T18:50:26.029008+0000","last_unstale":"2024-05-08T18:54:26.777022+0000","last_undegraded":"2024-05-08T18:54:26.777022+0000","last_fullsized":"2024-05-08T18:54:26.777022+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:26.776921+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:26.776921+0000","last_clean_scrub_stamp":"2024-05-08T18:54:26.776921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:29.496417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:05.886628+0000","last_change":"2024-05-08T18:54:05.886628+0000","last_active":"2024-05-08T18:54:05.886628+0000","last_peered":"2024-05-08T18:54:05.886628+0000","last_clean":"2024-05-08T18:54:05.886628+0000","last_became_active":"2024-05-08T18:50:30.026853+0000","last_became_peered":"2024-05-08T18:50:30.026853+0000","last_unstale":"2024-05-08T18:54:05.886628+0000","last_undegraded":"2024-05-08T18:54:05.886628+0000","last_fullsized":"2024-05-08T18:54:05.886628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:05.886508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:05.886508+0000","last_clean_scrub_stamp":"2024-05-08T18:54:05.886508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:58.280018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"27'45","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.018036+0000","last_change":"2024-05-08T18:53:58.018103+0000","last_active":"2024-05-08T18:53:58.018036+0000","last_peered":"2024-05-08T18:53:58.018036+0000","last_clean":"2024-05-08T18:53:58.018036+0000","last_became_active":"2024-05-08T18:50:32.041208+0000","last_became_peered":"2024-05-08T18:50:32.041208+0000","last_unstale":"2024-05-08T18:53:58.018036+0000","last_undegraded":"2024-05-08T18:53:58.018036+0000","last_fullsized":"2024-05-08T18:53:58.018036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-05-08T18:53:58.017901+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-05-08T18:53:58.017901+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.017901+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:24:08.011328+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:56.078504+0000","last_change":"2024-05-08T18:53:56.078528+0000","last_active":"2024-05-08T18:53:56.078504+0000","last_peered":"2024-05-08T18:53:56.078504+0000","last_clean":"2024-05-08T18:53:56.078504+0000","last_became_active":"2024-05-08T18:50:34.048749+0000","last_became_peered":"2024-05-08T18:50:34.048749+0000","last_unstale":"2024-05-08T18:53:56.078504+0000","last_undegraded":"2024-05-08T18:53:56.078504+0000","last_fullsized":"2024-05-08T18:53:56.078504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:56.078418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:56.078418+0000","last_clean_scrub_stamp":"2024-05-08T18:53:56.078418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:48:18.059438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:58.009318+0000","last_change":"2024-05-08T18:50:36.057323+0000","last_active":"2024-05-08T18:52:58.009318+0000","last_peered":"2024-05-08T18:52:58.009318+0000","last_clean":"2024-05-08T18:52:58.009318+0000","last_became_active":"2024-05-08T18:50:36.056960+0000","last_became_peered":"2024-05-08T18:50:36.056960+0000","last_unstale":"2024-05-08T18:52:58.009318+0000","last_undegraded":"2024-05-08T18:52:58.009318+0000","last_fullsized":"2024-05-08T18:52:58.009318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"27'8","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:02.075651+0000","last_change":"2024-05-08T18:54:02.075677+0000","last_active":"2024-05-08T18:54:02.075651+0000","last_peered":"2024-05-08T18:54:02.075651+0000","last_clean":"2024-05-08T18:54:02.075651+0000","last_became_active":"2024-05-08T18:50:28.038364+0000","last_became_peered":"2024-05-08T18:50:28.038364+0000","last_unstale":"2024-05-08T18:54:02.075651+0000","last_undegraded":"2024-05-08T18:54:02.075651+0000","last_fullsized":"2024-05-08T18:54:02.075651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:02.075564+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:02.075564+0000","last_clean_scrub_stamp":"2024-05-08T18:54:02.075564+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:34.353002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'4","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:30.667850+0000","last_change":"2024-05-08T18:54:30.667876+0000","last_active":"2024-05-08T18:54:30.667850+0000","last_peered":"2024-05-08T18:54:30.667850+0000","last_clean":"2024-05-08T18:54:30.667850+0000","last_became_active":"2024-05-08T18:50:26.012506+0000","last_became_peered":"2024-05-08T18:50:26.012506+0000","last_unstale":"2024-05-08T18:54:30.667850+0000","last_undegraded":"2024-05-08T18:54:30.667850+0000","last_fullsized":"2024-05-08T18:54:30.667850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:30.667727+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:30.667727+0000","last_clean_scrub_stamp":"2024-05-08T18:54:30.667727+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:45.041891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:06.873106+0000","last_change":"2024-05-08T18:54:06.873131+0000","last_active":"2024-05-08T18:54:06.873106+0000","last_peered":"2024-05-08T18:54:06.873106+0000","last_clean":"2024-05-08T18:54:06.873106+0000","last_became_active":"2024-05-08T18:50:30.026445+0000","last_became_peered":"2024-05-08T18:50:30.026445+0000","last_unstale":"2024-05-08T18:54:06.873106+0000","last_undegraded":"2024-05-08T18:54:06.873106+0000","last_fullsized":"2024-05-08T18:54:06.873106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:06.873001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:06.873001+0000","last_clean_scrub_stamp":"2024-05-08T18:54:06.873001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:55.685519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"27'39","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:57.045805+0000","last_change":"2024-05-08T18:53:57.045805+0000","last_active":"2024-05-08T18:53:57.045805+0000","last_peered":"2024-05-08T18:53:57.045805+0000","last_clean":"2024-05-08T18:53:57.045805+0000","last_became_active":"2024-05-08T18:50:32.040745+0000","last_became_peered":"2024-05-08T18:50:32.040745+0000","last_unstale":"2024-05-08T18:53:57.045805+0000","last_undegraded":"2024-05-08T18:53:57.045805+0000","last_fullsized":"2024-05-08T18:53:57.045805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-05-08T18:53:57.045641+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-05-08T18:53:57.045641+0000","last_clean_scrub_stamp":"2024-05-08T18:53:57.045641+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:49.439151+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:46.999290+0000","last_change":"2024-05-08T18:53:46.999290+0000","last_active":"2024-05-08T18:53:46.999290+0000","last_peered":"2024-05-08T18:53:46.999290+0000","last_clean":"2024-05-08T18:53:46.999290+0000","last_became_active":"2024-05-08T18:50:34.047508+0000","last_became_peered":"2024-05-08T18:50:34.047508+0000","last_unstale":"2024-05-08T18:53:46.999290+0000","last_undegraded":"2024-05-08T18:53:46.999290+0000","last_fullsized":"2024-05-08T18:53:46.999290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:46.999168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:46.999168+0000","last_clean_scrub_stamp":"2024-05-08T18:53:46.999168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:21:10.901638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"27'9","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.610816+0000","last_change":"2024-05-08T18:50:36.058170+0000","last_active":"2024-05-08T18:53:34.610816+0000","last_peered":"2024-05-08T18:53:34.610816+0000","last_clean":"2024-05-08T18:53:34.610816+0000","last_became_active":"2024-05-08T18:50:36.057863+0000","last_became_peered":"2024-05-08T18:50:36.057863+0000","last_unstale":"2024-05-08T18:53:34.610816+0000","last_undegraded":"2024-05-08T18:53:34.610816+0000","last_fullsized":"2024-05-08T18:53:34.610816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"25'2","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:17.193780+0000","last_change":"2024-05-08T18:54:17.193805+0000","last_active":"2024-05-08T18:54:17.193780+0000","last_peered":"2024-05-08T18:54:17.193780+0000","last_clean":"2024-05-08T18:54:17.193780+0000","last_became_active":"2024-05-08T18:50:28.020441+0000","last_became_peered":"2024-05-08T18:50:28.020441+0000","last_unstale":"2024-05-08T18:54:17.193780+0000","last_undegraded":"2024-05-08T18:54:17.193780+0000","last_fullsized":"2024-05-08T18:54:17.193780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:17.193655+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:17.193655+0000","last_clean_scrub_stamp":"2024-05-08T18:54:17.193655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:19.480048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"25'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:39.101144+0000","last_change":"2024-05-08T18:54:39.101198+0000","last_active":"2024-05-08T18:54:39.101144+0000","last_peered":"2024-05-08T18:54:39.101144+0000","last_clean":"2024-05-08T18:54:39.101144+0000","last_became_active":"2024-05-08T18:50:26.024274+0000","last_became_peered":"2024-05-08T18:50:26.024274+0000","last_unstale":"2024-05-08T18:54:39.101144+0000","last_undegraded":"2024-05-08T18:54:39.101144+0000","last_fullsized":"2024-05-08T18:54:39.101144+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:39.101020+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:39.101020+0000","last_clean_scrub_stamp":"2024-05-08T18:54:39.101020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:40.877601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:01.042454+0000","last_change":"2024-05-08T18:54:01.042477+0000","last_active":"2024-05-08T18:54:01.042454+0000","last_peered":"2024-05-08T18:54:01.042454+0000","last_clean":"2024-05-08T18:54:01.042454+0000","last_became_active":"2024-05-08T18:50:30.028877+0000","last_became_peered":"2024-05-08T18:50:30.028877+0000","last_unstale":"2024-05-08T18:54:01.042454+0000","last_undegraded":"2024-05-08T18:54:01.042454+0000","last_fullsized":"2024-05-08T18:54:01.042454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:01.042364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:01.042364+0000","last_clean_scrub_stamp":"2024-05-08T18:54:01.042364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:56.888219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'15","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:17.120963+0000","last_change":"2024-05-08T18:54:17.120963+0000","last_active":"2024-05-08T18:54:17.120963+0000","last_peered":"2024-05-08T18:54:17.120963+0000","last_clean":"2024-05-08T18:54:17.120963+0000","last_became_active":"2024-05-08T18:50:32.041539+0000","last_became_peered":"2024-05-08T18:50:32.041539+0000","last_unstale":"2024-05-08T18:54:17.120963+0000","last_undegraded":"2024-05-08T18:54:17.120963+0000","last_fullsized":"2024-05-08T18:54:17.120963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-08T18:54:17.120821+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-08T18:54:17.120821+0000","last_clean_scrub_stamp":"2024-05-08T18:54:17.120821+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:31.398678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"27'285","reported_seq":418,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:47.959722+0000","last_change":"2024-05-08T18:53:47.959752+0000","last_active":"2024-05-08T18:53:47.959722+0000","last_peered":"2024-05-08T18:53:47.959722+0000","last_clean":"2024-05-08T18:53:47.959722+0000","last_became_active":"2024-05-08T18:50:34.048421+0000","last_became_peered":"2024-05-08T18:50:34.048421+0000","last_unstale":"2024-05-08T18:53:47.959722+0000","last_undegraded":"2024-05-08T18:53:47.959722+0000","last_fullsized":"2024-05-08T18:53:47.959722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:47.959631+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:47.959631+0000","last_clean_scrub_stamp":"2024-05-08T18:53:47.959631+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:52:13.795244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:32.125693+0000","last_change":"2024-05-08T18:54:32.125723+0000","last_active":"2024-05-08T18:54:32.125693+0000","last_peered":"2024-05-08T18:54:32.125693+0000","last_clean":"2024-05-08T18:54:32.125693+0000","last_became_active":"2024-05-08T18:50:36.055184+0000","last_became_peered":"2024-05-08T18:50:36.055184+0000","last_unstale":"2024-05-08T18:54:32.125693+0000","last_undegraded":"2024-05-08T18:54:32.125693+0000","last_fullsized":"2024-05-08T18:54:32.125693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-08T18:54:32.125611+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-08T18:54:32.125611+0000","last_clean_scrub_stamp":"2024-05-08T18:54:32.125611+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:20.547668+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:11.971785+0000","last_change":"2024-05-08T18:54:11.971848+0000","last_active":"2024-05-08T18:54:11.971785+0000","last_peered":"2024-05-08T18:54:11.971785+0000","last_clean":"2024-05-08T18:54:11.971785+0000","last_became_active":"2024-05-08T18:50:28.025313+0000","last_became_peered":"2024-05-08T18:50:28.025313+0000","last_unstale":"2024-05-08T18:54:11.971785+0000","last_undegraded":"2024-05-08T18:54:11.971785+0000","last_fullsized":"2024-05-08T18:54:11.971785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:11.971660+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:11.971660+0000","last_clean_scrub_stamp":"2024-05-08T18:54:11.971660+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:55.520240+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:24.786248+0000","last_change":"2024-05-08T18:54:24.786272+0000","last_active":"2024-05-08T18:54:24.786248+0000","last_peered":"2024-05-08T18:54:24.786248+0000","last_clean":"2024-05-08T18:54:24.786248+0000","last_became_active":"2024-05-08T18:50:26.030058+0000","last_became_peered":"2024-05-08T18:50:26.030058+0000","last_unstale":"2024-05-08T18:54:24.786248+0000","last_undegraded":"2024-05-08T18:54:24.786248+0000","last_fullsized":"2024-05-08T18:54:24.786248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:24.786142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:24.786142+0000","last_clean_scrub_stamp":"2024-05-08T18:54:24.786142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:14.186288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"27'2","reported_seq":230,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:03.029231+0000","last_change":"2024-05-08T18:54:03.029261+0000","last_active":"2024-05-08T18:54:03.029231+0000","last_peered":"2024-05-08T18:54:03.029231+0000","last_clean":"2024-05-08T18:54:03.029231+0000","last_became_active":"2024-05-08T18:50:30.024032+0000","last_became_peered":"2024-05-08T18:50:30.024032+0000","last_unstale":"2024-05-08T18:54:03.029231+0000","last_undegraded":"2024-05-08T18:54:03.029231+0000","last_fullsized":"2024-05-08T18:54:03.029231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:03.029144+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:03.029144+0000","last_clean_scrub_stamp":"2024-05-08T18:54:03.029144+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:03.144529+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"27'46","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:51.108219+0000","last_change":"2024-05-08T18:53:51.108258+0000","last_active":"2024-05-08T18:53:51.108219+0000","last_peered":"2024-05-08T18:53:51.108219+0000","last_clean":"2024-05-08T18:53:51.108219+0000","last_became_active":"2024-05-08T18:50:32.035792+0000","last_became_peered":"2024-05-08T18:50:32.035792+0000","last_unstale":"2024-05-08T18:53:51.108219+0000","last_undegraded":"2024-05-08T18:53:51.108219+0000","last_fullsized":"2024-05-08T18:53:51.108219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-05-08T18:53:51.108138+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-05-08T18:53:51.108138+0000","last_clean_scrub_stamp":"2024-05-08T18:53:51.108138+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:39.003860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:49.040915+0000","last_change":"2024-05-08T18:53:49.040955+0000","last_active":"2024-05-08T18:53:49.040915+0000","last_peered":"2024-05-08T18:53:49.040915+0000","last_clean":"2024-05-08T18:53:49.040915+0000","last_became_active":"2024-05-08T18:50:34.044586+0000","last_became_peered":"2024-05-08T18:50:34.044586+0000","last_unstale":"2024-05-08T18:53:49.040915+0000","last_undegraded":"2024-05-08T18:53:49.040915+0000","last_fullsized":"2024-05-08T18:53:49.040915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:49.040776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:49.040776+0000","last_clean_scrub_stamp":"2024-05-08T18:53:49.040776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:14.348846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"27'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:38.848199+0000","last_change":"2024-05-08T18:54:38.848225+0000","last_active":"2024-05-08T18:54:38.848199+0000","last_peered":"2024-05-08T18:54:38.848199+0000","last_clean":"2024-05-08T18:54:38.848199+0000","last_became_active":"2024-05-08T18:50:36.052885+0000","last_became_peered":"2024-05-08T18:50:36.052885+0000","last_unstale":"2024-05-08T18:54:38.848199+0000","last_undegraded":"2024-05-08T18:54:38.848199+0000","last_fullsized":"2024-05-08T18:54:38.848199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:38.848107+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:38.848107+0000","last_clean_scrub_stamp":"2024-05-08T18:54:38.848107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:16.741373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"27'28","reported_seq":123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:13.997393+0000","last_change":"2024-05-08T18:54:13.997440+0000","last_active":"2024-05-08T18:54:13.997393+0000","last_peered":"2024-05-08T18:54:13.997393+0000","last_clean":"2024-05-08T18:54:13.997393+0000","last_became_active":"2024-05-08T18:50:28.025162+0000","last_became_peered":"2024-05-08T18:50:28.025162+0000","last_unstale":"2024-05-08T18:54:13.997393+0000","last_undegraded":"2024-05-08T18:54:13.997393+0000","last_fullsized":"2024-05-08T18:54:13.997393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-05-08T18:54:13.997287+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-05-08T18:54:13.997287+0000","last_clean_scrub_stamp":"2024-05-08T18:54:13.997287+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:28:05.524254+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":112,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:37.042975+0000","last_change":"2024-05-08T18:54:37.042998+0000","last_active":"2024-05-08T18:54:37.042975+0000","last_peered":"2024-05-08T18:54:37.042975+0000","last_clean":"2024-05-08T18:54:37.042975+0000","last_became_active":"2024-05-08T18:50:26.027067+0000","last_became_peered":"2024-05-08T18:50:26.027067+0000","last_unstale":"2024-05-08T18:54:37.042975+0000","last_undegraded":"2024-05-08T18:54:37.042975+0000","last_fullsized":"2024-05-08T18:54:37.042975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:37.042885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:37.042885+0000","last_clean_scrub_stamp":"2024-05-08T18:54:37.042885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:44.061790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:00.968059+0000","last_change":"2024-05-08T18:54:00.968081+0000","last_active":"2024-05-08T18:54:00.968059+0000","last_peered":"2024-05-08T18:54:00.968059+0000","last_clean":"2024-05-08T18:54:00.968059+0000","last_became_active":"2024-05-08T18:50:30.034616+0000","last_became_peered":"2024-05-08T18:50:30.034616+0000","last_unstale":"2024-05-08T18:54:00.968059+0000","last_undegraded":"2024-05-08T18:54:00.968059+0000","last_fullsized":"2024-05-08T18:54:00.968059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:00.967968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:00.967968+0000","last_clean_scrub_stamp":"2024-05-08T18:54:00.967968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:09.724587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"27'38","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:56.013273+0000","last_change":"2024-05-08T18:53:56.013305+0000","last_active":"2024-05-08T18:53:56.013273+0000","last_peered":"2024-05-08T18:53:56.013273+0000","last_clean":"2024-05-08T18:53:56.013273+0000","last_became_active":"2024-05-08T18:50:32.041806+0000","last_became_peered":"2024-05-08T18:50:32.041806+0000","last_unstale":"2024-05-08T18:53:56.013273+0000","last_undegraded":"2024-05-08T18:53:56.013273+0000","last_fullsized":"2024-05-08T18:53:56.013273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2024-05-08T18:53:56.013183+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2024-05-08T18:53:56.013183+0000","last_clean_scrub_stamp":"2024-05-08T18:53:56.013183+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:02.069580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:16.072290+0000","last_change":"2024-05-08T18:54:16.072313+0000","last_active":"2024-05-08T18:54:16.072290+0000","last_peered":"2024-05-08T18:54:16.072290+0000","last_clean":"2024-05-08T18:54:16.072290+0000","last_became_active":"2024-05-08T18:50:34.050445+0000","last_became_peered":"2024-05-08T18:50:34.050445+0000","last_unstale":"2024-05-08T18:54:16.072290+0000","last_undegraded":"2024-05-08T18:54:16.072290+0000","last_fullsized":"2024-05-08T18:54:16.072290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:16.072191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:16.072191+0000","last_clean_scrub_stamp":"2024-05-08T18:54:16.072191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:14.975396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:03.010228+0000","last_change":"2024-05-08T18:50:36.060634+0000","last_active":"2024-05-08T18:53:03.010228+0000","last_peered":"2024-05-08T18:53:03.010228+0000","last_clean":"2024-05-08T18:53:03.010228+0000","last_became_active":"2024-05-08T18:50:36.060318+0000","last_became_peered":"2024-05-08T18:50:36.060318+0000","last_unstale":"2024-05-08T18:53:03.010228+0000","last_undegraded":"2024-05-08T18:53:03.010228+0000","last_fullsized":"2024-05-08T18:53:03.010228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'4","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:29.085988+0000","last_change":"2024-05-08T18:54:29.086012+0000","last_active":"2024-05-08T18:54:29.085988+0000","last_peered":"2024-05-08T18:54:29.085988+0000","last_clean":"2024-05-08T18:54:29.085988+0000","last_became_active":"2024-05-08T18:50:28.029624+0000","last_became_peered":"2024-05-08T18:50:28.029624+0000","last_unstale":"2024-05-08T18:54:29.085988+0000","last_undegraded":"2024-05-08T18:54:29.085988+0000","last_fullsized":"2024-05-08T18:54:29.085988+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:29.085887+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:29.085887+0000","last_clean_scrub_stamp":"2024-05-08T18:54:29.085887+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:18.818093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'4","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:28.018012+0000","last_change":"2024-05-08T18:54:28.018067+0000","last_active":"2024-05-08T18:54:28.018012+0000","last_peered":"2024-05-08T18:54:28.018012+0000","last_clean":"2024-05-08T18:54:28.018012+0000","last_became_active":"2024-05-08T18:50:26.028615+0000","last_became_peered":"2024-05-08T18:50:26.028615+0000","last_unstale":"2024-05-08T18:54:28.018012+0000","last_undegraded":"2024-05-08T18:54:28.018012+0000","last_fullsized":"2024-05-08T18:54:28.018012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:28.017906+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:28.017906+0000","last_clean_scrub_stamp":"2024-05-08T18:54:28.017906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:59.590604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.082251+0000","last_change":"2024-05-08T18:53:58.082277+0000","last_active":"2024-05-08T18:53:58.082251+0000","last_peered":"2024-05-08T18:53:58.082251+0000","last_clean":"2024-05-08T18:53:58.082251+0000","last_became_active":"2024-05-08T18:50:30.030295+0000","last_became_peered":"2024-05-08T18:50:30.030295+0000","last_unstale":"2024-05-08T18:53:58.082251+0000","last_undegraded":"2024-05-08T18:53:58.082251+0000","last_fullsized":"2024-05-08T18:53:58.082251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:58.082158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:58.082158+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.082158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:04.138554+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"27'30","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:52.080875+0000","last_change":"2024-05-08T18:53:52.080925+0000","last_active":"2024-05-08T18:53:52.080875+0000","last_peered":"2024-05-08T18:53:52.080875+0000","last_clean":"2024-05-08T18:53:52.080875+0000","last_became_active":"2024-05-08T18:50:32.040661+0000","last_became_peered":"2024-05-08T18:50:32.040661+0000","last_unstale":"2024-05-08T18:53:52.080875+0000","last_undegraded":"2024-05-08T18:53:52.080875+0000","last_fullsized":"2024-05-08T18:53:52.080875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-05-08T18:53:52.080762+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-05-08T18:53:52.080762+0000","last_clean_scrub_stamp":"2024-05-08T18:53:52.080762+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:00.849983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:06.079512+0000","last_change":"2024-05-08T18:54:06.079537+0000","last_active":"2024-05-08T18:54:06.079512+0000","last_peered":"2024-05-08T18:54:06.079512+0000","last_clean":"2024-05-08T18:54:06.079512+0000","last_became_active":"2024-05-08T18:50:34.045040+0000","last_became_peered":"2024-05-08T18:50:34.045040+0000","last_unstale":"2024-05-08T18:54:06.079512+0000","last_undegraded":"2024-05-08T18:54:06.079512+0000","last_fullsized":"2024-05-08T18:54:06.079512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:06.079413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:06.079413+0000","last_clean_scrub_stamp":"2024-05-08T18:54:06.079413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:18.824227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:03.010192+0000","last_change":"2024-05-08T18:50:36.060675+0000","last_active":"2024-05-08T18:53:03.010192+0000","last_peered":"2024-05-08T18:53:03.010192+0000","last_clean":"2024-05-08T18:53:03.010192+0000","last_became_active":"2024-05-08T18:50:36.060382+0000","last_became_peered":"2024-05-08T18:50:36.060382+0000","last_unstale":"2024-05-08T18:53:03.010192+0000","last_undegraded":"2024-05-08T18:53:03.010192+0000","last_fullsized":"2024-05-08T18:53:03.010192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'12","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:09.881128+0000","last_change":"2024-05-08T18:54:09.881161+0000","last_active":"2024-05-08T18:54:09.881128+0000","last_peered":"2024-05-08T18:54:09.881128+0000","last_clean":"2024-05-08T18:54:09.881128+0000","last_became_active":"2024-05-08T18:50:28.020421+0000","last_became_peered":"2024-05-08T18:50:28.020421+0000","last_unstale":"2024-05-08T18:54:09.881128+0000","last_undegraded":"2024-05-08T18:54:09.881128+0000","last_fullsized":"2024-05-08T18:54:09.881128+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-08T18:54:09.881030+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-08T18:54:09.881030+0000","last_clean_scrub_stamp":"2024-05-08T18:54:09.881030+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:09.996415+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"27'4","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:31.701515+0000","last_change":"2024-05-08T18:54:31.701515+0000","last_active":"2024-05-08T18:54:31.701515+0000","last_peered":"2024-05-08T18:54:31.701515+0000","last_clean":"2024-05-08T18:54:31.701515+0000","last_became_active":"2024-05-08T18:50:26.011299+0000","last_became_peered":"2024-05-08T18:50:26.011299+0000","last_unstale":"2024-05-08T18:54:31.701515+0000","last_undegraded":"2024-05-08T18:54:31.701515+0000","last_fullsized":"2024-05-08T18:54:31.701515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:31.701395+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:31.701395+0000","last_clean_scrub_stamp":"2024-05-08T18:54:31.701395+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:30.604600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:55.127436+0000","last_change":"2024-05-08T18:53:55.127480+0000","last_active":"2024-05-08T18:53:55.127436+0000","last_peered":"2024-05-08T18:53:55.127436+0000","last_clean":"2024-05-08T18:53:55.127436+0000","last_became_active":"2024-05-08T18:50:30.032578+0000","last_became_peered":"2024-05-08T18:50:30.032578+0000","last_unstale":"2024-05-08T18:53:55.127436+0000","last_undegraded":"2024-05-08T18:53:55.127436+0000","last_fullsized":"2024-05-08T18:53:55.127436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-08T18:53:55.127322+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-08T18:53:55.127322+0000","last_clean_scrub_stamp":"2024-05-08T18:53:55.127322+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:53.840153+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"27'42","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:13.094540+0000","last_change":"2024-05-08T18:54:13.094581+0000","last_active":"2024-05-08T18:54:13.094540+0000","last_peered":"2024-05-08T18:54:13.094540+0000","last_clean":"2024-05-08T18:54:13.094540+0000","last_became_active":"2024-05-08T18:50:32.042700+0000","last_became_peered":"2024-05-08T18:50:32.042700+0000","last_unstale":"2024-05-08T18:54:13.094540+0000","last_undegraded":"2024-05-08T18:54:13.094540+0000","last_fullsized":"2024-05-08T18:54:13.094540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-05-08T18:54:13.094441+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-05-08T18:54:13.094441+0000","last_clean_scrub_stamp":"2024-05-08T18:54:13.094441+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:24.214241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":49,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:48.036967+0000","last_change":"2024-05-08T18:53:48.036991+0000","last_active":"2024-05-08T18:53:48.036967+0000","last_peered":"2024-05-08T18:53:48.036967+0000","last_clean":"2024-05-08T18:53:48.036967+0000","last_became_active":"2024-05-08T18:50:34.044872+0000","last_became_peered":"2024-05-08T18:50:34.044872+0000","last_unstale":"2024-05-08T18:53:48.036967+0000","last_undegraded":"2024-05-08T18:53:48.036967+0000","last_fullsized":"2024-05-08T18:53:48.036967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:48.036872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:48.036872+0000","last_clean_scrub_stamp":"2024-05-08T18:53:48.036872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:38.478912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"27'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:24.131032+0000","last_change":"2024-05-08T18:54:24.131083+0000","last_active":"2024-05-08T18:54:24.131032+0000","last_peered":"2024-05-08T18:54:24.131032+0000","last_clean":"2024-05-08T18:54:24.131032+0000","last_became_active":"2024-05-08T18:50:36.055188+0000","last_became_peered":"2024-05-08T18:50:36.055188+0000","last_unstale":"2024-05-08T18:54:24.131032+0000","last_undegraded":"2024-05-08T18:54:24.131032+0000","last_fullsized":"2024-05-08T18:54:24.131032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:24.130900+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:24.130900+0000","last_clean_scrub_stamp":"2024-05-08T18:54:24.130900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:04.743662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"27'12","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:04.981856+0000","last_change":"2024-05-08T18:54:04.981908+0000","last_active":"2024-05-08T18:54:04.981856+0000","last_peered":"2024-05-08T18:54:04.981856+0000","last_clean":"2024-05-08T18:54:04.981856+0000","last_became_active":"2024-05-08T18:50:28.039290+0000","last_became_peered":"2024-05-08T18:50:28.039290+0000","last_unstale":"2024-05-08T18:54:04.981856+0000","last_undegraded":"2024-05-08T18:54:04.981856+0000","last_fullsized":"2024-05-08T18:54:04.981856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-08T18:54:04.981738+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-08T18:54:04.981738+0000","last_clean_scrub_stamp":"2024-05-08T18:54:04.981738+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:48.530318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"27'3","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:26.928401+0000","last_change":"2024-05-08T18:54:26.928401+0000","last_active":"2024-05-08T18:54:26.928401+0000","last_peered":"2024-05-08T18:54:26.928401+0000","last_clean":"2024-05-08T18:54:26.928401+0000","last_became_active":"2024-05-08T18:50:26.018713+0000","last_became_peered":"2024-05-08T18:50:26.018713+0000","last_unstale":"2024-05-08T18:54:26.928401+0000","last_undegraded":"2024-05-08T18:54:26.928401+0000","last_fullsized":"2024-05-08T18:54:26.928401+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-08T18:54:26.928285+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-08T18:54:26.928285+0000","last_clean_scrub_stamp":"2024-05-08T18:54:26.928285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:55.724493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"27'6","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:41.040031+0000","last_change":"2024-05-08T18:54:41.040093+0000","last_active":"2024-05-08T18:54:41.040031+0000","last_peered":"2024-05-08T18:54:41.040031+0000","last_clean":"2024-05-08T18:54:41.040031+0000","last_became_active":"2024-05-08T18:50:28.026292+0000","last_became_peered":"2024-05-08T18:50:28.026292+0000","last_unstale":"2024-05-08T18:54:41.040031+0000","last_undegraded":"2024-05-08T18:54:41.040031+0000","last_fullsized":"2024-05-08T18:54:41.040031+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:41.039929+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:41.039929+0000","last_clean_scrub_stamp":"2024-05-08T18:54:41.039929+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:43.220382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:35.034493+0000","last_change":"2024-05-08T18:54:35.034493+0000","last_active":"2024-05-08T18:54:35.034493+0000","last_peered":"2024-05-08T18:54:35.034493+0000","last_clean":"2024-05-08T18:54:35.034493+0000","last_became_active":"2024-05-08T18:50:26.012760+0000","last_became_peered":"2024-05-08T18:50:26.012760+0000","last_unstale":"2024-05-08T18:54:35.034493+0000","last_undegraded":"2024-05-08T18:54:35.034493+0000","last_fullsized":"2024-05-08T18:54:35.034493+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:35.034379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:35.034379+0000","last_clean_scrub_stamp":"2024-05-08T18:54:35.034379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:31.251876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'4","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.998032+0000","last_change":"2024-05-08T18:53:58.998059+0000","last_active":"2024-05-08T18:53:58.998032+0000","last_peered":"2024-05-08T18:53:58.998032+0000","last_clean":"2024-05-08T18:53:58.998032+0000","last_became_active":"2024-05-08T18:50:28.038785+0000","last_became_peered":"2024-05-08T18:50:28.038785+0000","last_unstale":"2024-05-08T18:53:58.998032+0000","last_undegraded":"2024-05-08T18:53:58.998032+0000","last_fullsized":"2024-05-08T18:53:58.998032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:53:58.997912+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:53:58.997912+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.997912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:10.188121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"25'2","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.862320+0000","last_change":"2024-05-08T18:50:26.026716+0000","last_active":"2024-05-08T18:53:45.862320+0000","last_peered":"2024-05-08T18:53:45.862320+0000","last_clean":"2024-05-08T18:53:45.862320+0000","last_became_active":"2024-05-08T18:50:26.025958+0000","last_became_peered":"2024-05-08T18:50:26.025958+0000","last_unstale":"2024-05-08T18:53:45.862320+0000","last_undegraded":"2024-05-08T18:53:45.862320+0000","last_fullsized":"2024-05-08T18:53:45.862320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"27'6","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:31.048679+0000","last_change":"2024-05-08T18:54:31.048707+0000","last_active":"2024-05-08T18:54:31.048679+0000","last_peered":"2024-05-08T18:54:31.048679+0000","last_clean":"2024-05-08T18:54:31.048679+0000","last_became_active":"2024-05-08T18:50:28.025866+0000","last_became_peered":"2024-05-08T18:50:28.025866+0000","last_unstale":"2024-05-08T18:54:31.048679+0000","last_undegraded":"2024-05-08T18:54:31.048679+0000","last_fullsized":"2024-05-08T18:54:31.048679+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:31.048578+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:31.048578+0000","last_clean_scrub_stamp":"2024-05-08T18:54:31.048578+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:45.326435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:32.065937+0000","last_change":"2024-05-08T18:54:32.065937+0000","last_active":"2024-05-08T18:54:32.065937+0000","last_peered":"2024-05-08T18:54:32.065937+0000","last_clean":"2024-05-08T18:54:32.065937+0000","last_became_active":"2024-05-08T18:50:26.025120+0000","last_became_peered":"2024-05-08T18:50:26.025120+0000","last_unstale":"2024-05-08T18:54:32.065937+0000","last_undegraded":"2024-05-08T18:54:32.065937+0000","last_fullsized":"2024-05-08T18:54:32.065937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:32.065765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:32.065765+0000","last_clean_scrub_stamp":"2024-05-08T18:54:32.065765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:36.467184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"27'8","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:27.030393+0000","last_change":"2024-05-08T18:54:27.030393+0000","last_active":"2024-05-08T18:54:27.030393+0000","last_peered":"2024-05-08T18:54:27.030393+0000","last_clean":"2024-05-08T18:54:27.030393+0000","last_became_active":"2024-05-08T18:50:28.025098+0000","last_became_peered":"2024-05-08T18:50:28.025098+0000","last_unstale":"2024-05-08T18:54:27.030393+0000","last_undegraded":"2024-05-08T18:54:27.030393+0000","last_fullsized":"2024-05-08T18:54:27.030393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:27.030232+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:27.030232+0000","last_clean_scrub_stamp":"2024-05-08T18:54:27.030232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:38.150032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:37.058312+0000","last_change":"2024-05-08T18:54:37.058337+0000","last_active":"2024-05-08T18:54:37.058312+0000","last_peered":"2024-05-08T18:54:37.058312+0000","last_clean":"2024-05-08T18:54:37.058312+0000","last_became_active":"2024-05-08T18:50:26.014434+0000","last_became_peered":"2024-05-08T18:50:26.014434+0000","last_unstale":"2024-05-08T18:54:37.058312+0000","last_undegraded":"2024-05-08T18:54:37.058312+0000","last_fullsized":"2024-05-08T18:54:37.058312+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:37.058211+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:37.058211+0000","last_clean_scrub_stamp":"2024-05-08T18:54:37.058211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:46.480736+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"27'10","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:10.981338+0000","last_change":"2024-05-08T18:54:10.981338+0000","last_active":"2024-05-08T18:54:10.981338+0000","last_peered":"2024-05-08T18:54:10.981338+0000","last_clean":"2024-05-08T18:54:10.981338+0000","last_became_active":"2024-05-08T18:50:28.037400+0000","last_became_peered":"2024-05-08T18:50:28.037400+0000","last_unstale":"2024-05-08T18:54:10.981338+0000","last_undegraded":"2024-05-08T18:54:10.981338+0000","last_fullsized":"2024-05-08T18:54:10.981338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:10.981224+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:10.981224+0000","last_clean_scrub_stamp":"2024-05-08T18:54:10.981224+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:30.981744+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"25'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:36.843380+0000","last_change":"2024-05-08T18:54:36.843406+0000","last_active":"2024-05-08T18:54:36.843380+0000","last_peered":"2024-05-08T18:54:36.843380+0000","last_clean":"2024-05-08T18:54:36.843380+0000","last_became_active":"2024-05-08T18:50:26.029047+0000","last_became_peered":"2024-05-08T18:50:26.029047+0000","last_unstale":"2024-05-08T18:54:36.843380+0000","last_undegraded":"2024-05-08T18:54:36.843380+0000","last_fullsized":"2024-05-08T18:54:36.843380+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:36.843271+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:36.843271+0000","last_clean_scrub_stamp":"2024-05-08T18:54:36.843271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:56.865651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"27'4","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:18.166245+0000","last_change":"2024-05-08T18:54:18.166245+0000","last_active":"2024-05-08T18:54:18.166245+0000","last_peered":"2024-05-08T18:54:18.166245+0000","last_clean":"2024-05-08T18:54:18.166245+0000","last_became_active":"2024-05-08T18:50:28.021140+0000","last_became_peered":"2024-05-08T18:50:28.021140+0000","last_unstale":"2024-05-08T18:54:18.166245+0000","last_undegraded":"2024-05-08T18:54:18.166245+0000","last_fullsized":"2024-05-08T18:54:18.166245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:18.166058+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:18.166058+0000","last_clean_scrub_stamp":"2024-05-08T18:54:18.166058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:46.962267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:16.964483+0000","last_change":"2024-05-08T18:54:16.964506+0000","last_active":"2024-05-08T18:54:16.964483+0000","last_peered":"2024-05-08T18:54:16.964483+0000","last_clean":"2024-05-08T18:54:16.964483+0000","last_became_active":"2024-05-08T18:50:26.031680+0000","last_became_peered":"2024-05-08T18:50:26.031680+0000","last_unstale":"2024-05-08T18:54:16.964483+0000","last_undegraded":"2024-05-08T18:54:16.964483+0000","last_fullsized":"2024-05-08T18:54:16.964483+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:16.964394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:16.964394+0000","last_clean_scrub_stamp":"2024-05-08T18:54:16.964394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:30.908518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"27'12","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:14.000877+0000","last_change":"2024-05-08T18:54:14.000877+0000","last_active":"2024-05-08T18:54:14.000877+0000","last_peered":"2024-05-08T18:54:14.000877+0000","last_clean":"2024-05-08T18:54:14.000877+0000","last_became_active":"2024-05-08T18:50:28.021588+0000","last_became_peered":"2024-05-08T18:50:28.021588+0000","last_unstale":"2024-05-08T18:54:14.000877+0000","last_undegraded":"2024-05-08T18:54:14.000877+0000","last_fullsized":"2024-05-08T18:54:14.000877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-08T18:54:14.000720+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-08T18:54:14.000720+0000","last_clean_scrub_stamp":"2024-05-08T18:54:14.000720+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:24:23.994147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:36.076608+0000","last_change":"2024-05-08T18:54:36.076633+0000","last_active":"2024-05-08T18:54:36.076608+0000","last_peered":"2024-05-08T18:54:36.076608+0000","last_clean":"2024-05-08T18:54:36.076608+0000","last_became_active":"2024-05-08T18:50:26.014383+0000","last_became_peered":"2024-05-08T18:50:26.014383+0000","last_unstale":"2024-05-08T18:54:36.076608+0000","last_undegraded":"2024-05-08T18:54:36.076608+0000","last_fullsized":"2024-05-08T18:54:36.076608+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:36.076512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:36.076512+0000","last_clean_scrub_stamp":"2024-05-08T18:54:36.076512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:35.442197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"27'6","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:37.878297+0000","last_change":"2024-05-08T18:54:37.878326+0000","last_active":"2024-05-08T18:54:37.878297+0000","last_peered":"2024-05-08T18:54:37.878297+0000","last_clean":"2024-05-08T18:54:37.878297+0000","last_became_active":"2024-05-08T18:50:28.032181+0000","last_became_peered":"2024-05-08T18:50:28.032181+0000","last_unstale":"2024-05-08T18:54:37.878297+0000","last_undegraded":"2024-05-08T18:54:37.878297+0000","last_fullsized":"2024-05-08T18:54:37.878297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:37.878213+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:37.878213+0000","last_clean_scrub_stamp":"2024-05-08T18:54:37.878213+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:19.061962+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"27'4","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:42.082622+0000","last_change":"2024-05-08T18:54:42.082664+0000","last_active":"2024-05-08T18:54:42.082622+0000","last_peered":"2024-05-08T18:54:42.082622+0000","last_clean":"2024-05-08T18:54:42.082622+0000","last_became_active":"2024-05-08T18:50:26.025473+0000","last_became_peered":"2024-05-08T18:50:26.025473+0000","last_unstale":"2024-05-08T18:54:42.082622+0000","last_undegraded":"2024-05-08T18:54:42.082622+0000","last_fullsized":"2024-05-08T18:54:42.082622+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:42.082508+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:42.082508+0000","last_clean_scrub_stamp":"2024-05-08T18:54:42.082508+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:31.609006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:26.110772+0000","last_change":"2024-05-08T18:54:26.110825+0000","last_active":"2024-05-08T18:54:26.110772+0000","last_peered":"2024-05-08T18:54:26.110772+0000","last_clean":"2024-05-08T18:54:26.110772+0000","last_became_active":"2024-05-08T18:50:28.032462+0000","last_became_peered":"2024-05-08T18:50:28.032462+0000","last_unstale":"2024-05-08T18:54:26.110772+0000","last_undegraded":"2024-05-08T18:54:26.110772+0000","last_fullsized":"2024-05-08T18:54:26.110772+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:26.110638+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:26.110638+0000","last_clean_scrub_stamp":"2024-05-08T18:54:26.110638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:35.721914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:38.067033+0000","last_change":"2024-05-08T18:54:38.067084+0000","last_active":"2024-05-08T18:54:38.067033+0000","last_peered":"2024-05-08T18:54:38.067033+0000","last_clean":"2024-05-08T18:54:38.067033+0000","last_became_active":"2024-05-08T18:50:26.019706+0000","last_became_peered":"2024-05-08T18:50:26.019706+0000","last_unstale":"2024-05-08T18:54:38.067033+0000","last_undegraded":"2024-05-08T18:54:38.067033+0000","last_fullsized":"2024-05-08T18:54:38.067033+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:38.066922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:38.066922+0000","last_clean_scrub_stamp":"2024-05-08T18:54:38.066922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:18.334160+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"27'2","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:14.148414+0000","last_change":"2024-05-08T18:54:14.148450+0000","last_active":"2024-05-08T18:54:14.148414+0000","last_peered":"2024-05-08T18:54:14.148414+0000","last_clean":"2024-05-08T18:54:14.148414+0000","last_became_active":"2024-05-08T18:50:28.031188+0000","last_became_peered":"2024-05-08T18:50:28.031188+0000","last_unstale":"2024-05-08T18:54:14.148414+0000","last_undegraded":"2024-05-08T18:54:14.148414+0000","last_fullsized":"2024-05-08T18:54:14.148414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:14.148328+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:14.148328+0000","last_clean_scrub_stamp":"2024-05-08T18:54:14.148328+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:04.976161+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:34.788267+0000","last_change":"2024-05-08T18:54:34.788291+0000","last_active":"2024-05-08T18:54:34.788267+0000","last_peered":"2024-05-08T18:54:34.788267+0000","last_clean":"2024-05-08T18:54:34.788267+0000","last_became_active":"2024-05-08T18:50:26.024808+0000","last_became_peered":"2024-05-08T18:50:26.024808+0000","last_unstale":"2024-05-08T18:54:34.788267+0000","last_undegraded":"2024-05-08T18:54:34.788267+0000","last_fullsized":"2024-05-08T18:54:34.788267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:34.788178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:34.788178+0000","last_clean_scrub_stamp":"2024-05-08T18:54:34.788178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:23.242735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"27'6","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:15.931056+0000","last_change":"2024-05-08T18:54:15.931086+0000","last_active":"2024-05-08T18:54:15.931056+0000","last_peered":"2024-05-08T18:54:15.931056+0000","last_clean":"2024-05-08T18:54:15.931056+0000","last_became_active":"2024-05-08T18:50:28.022905+0000","last_became_peered":"2024-05-08T18:50:28.022905+0000","last_unstale":"2024-05-08T18:54:15.931056+0000","last_undegraded":"2024-05-08T18:54:15.931056+0000","last_fullsized":"2024-05-08T18:54:15.931056+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:15.930946+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:15.930946+0000","last_clean_scrub_stamp":"2024-05-08T18:54:15.930946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:23.850615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:33.742898+0000","last_change":"2024-05-08T18:54:33.742923+0000","last_active":"2024-05-08T18:54:33.742898+0000","last_peered":"2024-05-08T18:54:33.742898+0000","last_clean":"2024-05-08T18:54:33.742898+0000","last_became_active":"2024-05-08T18:50:26.024977+0000","last_became_peered":"2024-05-08T18:50:26.024977+0000","last_unstale":"2024-05-08T18:54:33.742898+0000","last_undegraded":"2024-05-08T18:54:33.742898+0000","last_fullsized":"2024-05-08T18:54:33.742898+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:33.742808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:33.742808+0000","last_clean_scrub_stamp":"2024-05-08T18:54:33.742808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:38.144227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:13.006755+0000","last_change":"2024-05-08T18:54:13.006779+0000","last_active":"2024-05-08T18:54:13.006755+0000","last_peered":"2024-05-08T18:54:13.006755+0000","last_clean":"2024-05-08T18:54:13.006755+0000","last_became_active":"2024-05-08T18:50:28.037153+0000","last_became_peered":"2024-05-08T18:50:28.037153+0000","last_unstale":"2024-05-08T18:54:13.006755+0000","last_undegraded":"2024-05-08T18:54:13.006755+0000","last_fullsized":"2024-05-08T18:54:13.006755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:13.006667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:13.006667+0000","last_clean_scrub_stamp":"2024-05-08T18:54:13.006667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:00.529680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:43.006824+0000","last_change":"2024-05-08T18:50:26.012280+0000","last_active":"2024-05-08T18:52:43.006824+0000","last_peered":"2024-05-08T18:52:43.006824+0000","last_clean":"2024-05-08T18:52:43.006824+0000","last_became_active":"2024-05-08T18:50:26.011982+0000","last_became_peered":"2024-05-08T18:50:26.011982+0000","last_unstale":"2024-05-08T18:52:43.006824+0000","last_undegraded":"2024-05-08T18:52:43.006824+0000","last_fullsized":"2024-05-08T18:52:43.006824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"27'8","reported_seq":70,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:25.737913+0000","last_change":"2024-05-08T18:54:25.737967+0000","last_active":"2024-05-08T18:54:25.737913+0000","last_peered":"2024-05-08T18:54:25.737913+0000","last_clean":"2024-05-08T18:54:25.737913+0000","last_became_active":"2024-05-08T18:50:28.028405+0000","last_became_peered":"2024-05-08T18:50:28.028405+0000","last_unstale":"2024-05-08T18:54:25.737913+0000","last_undegraded":"2024-05-08T18:54:25.737913+0000","last_fullsized":"2024-05-08T18:54:25.737913+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:25.737811+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:25.737811+0000","last_clean_scrub_stamp":"2024-05-08T18:54:25.737811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:17:24.821299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"27'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:41.092840+0000","last_change":"2024-05-08T18:54:41.092864+0000","last_active":"2024-05-08T18:54:41.092840+0000","last_peered":"2024-05-08T18:54:41.092840+0000","last_clean":"2024-05-08T18:54:41.092840+0000","last_became_active":"2024-05-08T18:50:26.023658+0000","last_became_peered":"2024-05-08T18:50:26.023658+0000","last_unstale":"2024-05-08T18:54:41.092840+0000","last_undegraded":"2024-05-08T18:54:41.092840+0000","last_fullsized":"2024-05-08T18:54:41.092840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:41.092756+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:41.092756+0000","last_clean_scrub_stamp":"2024-05-08T18:54:41.092756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:24.283494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"25'4","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:25.145240+0000","last_change":"2024-05-08T18:54:25.145268+0000","last_active":"2024-05-08T18:54:25.145240+0000","last_peered":"2024-05-08T18:54:25.145240+0000","last_clean":"2024-05-08T18:54:25.145240+0000","last_became_active":"2024-05-08T18:50:28.032552+0000","last_became_peered":"2024-05-08T18:50:28.032552+0000","last_unstale":"2024-05-08T18:54:25.145240+0000","last_undegraded":"2024-05-08T18:54:25.145240+0000","last_fullsized":"2024-05-08T18:54:25.145240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-08T18:54:25.145141+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-08T18:54:25.145141+0000","last_clean_scrub_stamp":"2024-05-08T18:54:25.145141+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:31.782772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:12.958318+0000","last_change":"2024-05-08T18:54:12.958343+0000","last_active":"2024-05-08T18:54:12.958318+0000","last_peered":"2024-05-08T18:54:12.958318+0000","last_clean":"2024-05-08T18:54:12.958318+0000","last_became_active":"2024-05-08T18:50:26.032385+0000","last_became_peered":"2024-05-08T18:50:26.032385+0000","last_unstale":"2024-05-08T18:54:12.958318+0000","last_undegraded":"2024-05-08T18:54:12.958318+0000","last_fullsized":"2024-05-08T18:54:12.958318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:12.958227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:12.958227+0000","last_clean_scrub_stamp":"2024-05-08T18:54:12.958227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:22.832530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"27'6","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:19.850035+0000","last_change":"2024-05-08T18:54:19.850079+0000","last_active":"2024-05-08T18:54:19.850035+0000","last_peered":"2024-05-08T18:54:19.850035+0000","last_clean":"2024-05-08T18:54:19.850035+0000","last_became_active":"2024-05-08T18:50:28.023807+0000","last_became_peered":"2024-05-08T18:50:28.023807+0000","last_unstale":"2024-05-08T18:54:19.850035+0000","last_undegraded":"2024-05-08T18:54:19.850035+0000","last_fullsized":"2024-05-08T18:54:19.850035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:19.849922+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:19.849922+0000","last_clean_scrub_stamp":"2024-05-08T18:54:19.849922+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:48.646130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007840+0000","last_change":"2024-05-08T18:50:26.026065+0000","last_active":"2024-05-08T18:52:48.007840+0000","last_peered":"2024-05-08T18:52:48.007840+0000","last_clean":"2024-05-08T18:52:48.007840+0000","last_became_active":"2024-05-08T18:50:26.025023+0000","last_became_peered":"2024-05-08T18:50:26.025023+0000","last_unstale":"2024-05-08T18:52:48.007840+0000","last_undegraded":"2024-05-08T18:52:48.007840+0000","last_fullsized":"2024-05-08T18:52:48.007840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'6","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:48.007502+0000","last_change":"2024-05-08T18:50:26.026599+0000","last_active":"2024-05-08T18:52:48.007502+0000","last_peered":"2024-05-08T18:52:48.007502+0000","last_clean":"2024-05-08T18:52:48.007502+0000","last_became_active":"2024-05-08T18:50:26.026333+0000","last_became_peered":"2024-05-08T18:50:26.026333+0000","last_unstale":"2024-05-08T18:52:48.007502+0000","last_undegraded":"2024-05-08T18:52:48.007502+0000","last_fullsized":"2024-05-08T18:52:48.007502+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:24.995859+0000","last_clean_scrub_stamp":"2024-05-08T18:50:24.995859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"25'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:25.063862+0000","last_change":"2024-05-08T18:54:25.063893+0000","last_active":"2024-05-08T18:54:25.063862+0000","last_peered":"2024-05-08T18:54:25.063862+0000","last_clean":"2024-05-08T18:54:25.063862+0000","last_became_active":"2024-05-08T18:50:28.024627+0000","last_became_peered":"2024-05-08T18:50:28.024627+0000","last_unstale":"2024-05-08T18:54:25.063862+0000","last_undegraded":"2024-05-08T18:54:25.063862+0000","last_fullsized":"2024-05-08T18:54:25.063862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-08T18:54:25.063768+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-08T18:54:25.063768+0000","last_clean_scrub_stamp":"2024-05-08T18:54:25.063768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.140703+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'4","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:40.078061+0000","last_change":"2024-05-08T18:54:40.078087+0000","last_active":"2024-05-08T18:54:40.078061+0000","last_peered":"2024-05-08T18:54:40.078061+0000","last_clean":"2024-05-08T18:54:40.078061+0000","last_became_active":"2024-05-08T18:50:26.024839+0000","last_became_peered":"2024-05-08T18:50:26.024839+0000","last_unstale":"2024-05-08T18:54:40.078061+0000","last_undegraded":"2024-05-08T18:54:40.078061+0000","last_fullsized":"2024-05-08T18:54:40.078061+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:40.077968+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:40.077968+0000","last_clean_scrub_stamp":"2024-05-08T18:54:40.077968+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:49.689244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'8","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:09.980517+0000","last_change":"2024-05-08T18:54:09.980547+0000","last_active":"2024-05-08T18:54:09.980517+0000","last_peered":"2024-05-08T18:54:09.980517+0000","last_clean":"2024-05-08T18:54:09.980517+0000","last_became_active":"2024-05-08T18:50:28.038677+0000","last_became_peered":"2024-05-08T18:50:28.038677+0000","last_unstale":"2024-05-08T18:54:09.980517+0000","last_undegraded":"2024-05-08T18:54:09.980517+0000","last_fullsized":"2024-05-08T18:54:09.980517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:09.980433+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:09.980433+0000","last_clean_scrub_stamp":"2024-05-08T18:54:09.980433+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:23.924556+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1522,"ondisk_log_size":1522,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1601,"num_read_kb":1491,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705720,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39904,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331936,"statfs":{"total":96636764160,"available":96595902464,"internally_reserved":0,"allocated":417792,"data_stored":121043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705721,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36256,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335584,"statfs":{"total":96636764160,"available":96599638016,"internally_reserved":0,"allocated":942080,"data_stored":707921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705720,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36284,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335556,"statfs":{"total":96636764160,"available":96599609344,"internally_reserved":0,"allocated":970752,"data_stored":708927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705720,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":380928,"data_stored":119875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:54:47.412 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.412 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-08T18:50:27.002790+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.412 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.412 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.412 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.413 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.413 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.413 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.413 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.414 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.414 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.414 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.414 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.414 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.414 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.415 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.415 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.415 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.415 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.415 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.416 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.416 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.416 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T18:50:18.730482+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=18, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.416 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.416 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.416 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.417 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.417 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.417 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.418 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.418 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.418 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.418 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.419 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.419 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T18:50:24.995859+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=24, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:54:47.419 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T18:55:07.420 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:55:07.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.536+0000 7fc65fc40640 1 Processor -- start 2024-05-08T18:55:07.535 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.536+0000 7fc65fc40640 1 -- start start 2024-05-08T18:55:07.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.537+0000 7fc65fc40640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc658129560 0x7fc6581313d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:55:07.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.537+0000 7fc65fc40640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc658072dc0 con 0x7fc65806fe20 2024-05-08T18:55:07.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.537+0000 7fc65fc40640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7fc6581299f0 con 0x7fc658129560 2024-05-08T18:55:07.536 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.537+0000 7fc65d1db640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc658129560 0x7fc6581313d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:55:07.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.537+0000 7fc65d9dc640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fc65806fe20 0x7fc658128e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51596/0 (socket says 172.21.15.42:51596) 2024-05-08T18:55:07.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.537+0000 7fc65d9dc640 1 -- 172.21.15.42:0/3680142693 learned_addr learned my addr 172.21.15.42:0/3680142693 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:55:07.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.537+0000 7fc65d1db640 1 -- 172.21.15.42:0/3680142693 >> v1:172.21.15.42:6789/0 conn(0x7fc65806fe20 legacy=0x7fc658128e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:55:07.537 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.537+0000 7fc65d1db640 1 -- 172.21.15.42:0/3680142693 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc658128ad0 con 0x7fc658129560 2024-05-08T18:55:07.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.538+0000 7fc65d1db640 1 --2- 172.21.15.42:0/3680142693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc658129560 0x7fc6581313d0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc654009720 tx=0x7fc65402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23649fd938e2e754 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:55:07.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.538+0000 7fc65c9da640 1 -- 172.21.15.42:0/3680142693 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6540316d0 con 0x7fc658129560 2024-05-08T18:55:07.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.538+0000 7fc65c9da640 1 -- 172.21.15.42:0/3680142693 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc654037070 con 0x7fc658129560 2024-05-08T18:55:07.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.538+0000 7fc65c9da640 1 -- 172.21.15.42:0/3680142693 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6540319c0 con 0x7fc658129560 2024-05-08T18:55:07.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.539+0000 7fc65fc40640 1 -- 172.21.15.42:0/3680142693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc658129560 msgr2=0x7fc6581313d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:55:07.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.539+0000 7fc65fc40640 1 --2- 172.21.15.42:0/3680142693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc658129560 0x7fc6581313d0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc654009720 tx=0x7fc65402b840 comp rx=0 tx=0).stop 2024-05-08T18:55:07.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.539+0000 7fc65fc40640 1 -- 172.21.15.42:0/3680142693 shutdown_connections 2024-05-08T18:55:07.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.539+0000 7fc65fc40640 1 --2- 172.21.15.42:0/3680142693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc658129560 0x7fc6581313d0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:55:07.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.539+0000 7fc65fc40640 1 -- 172.21.15.42:0/3680142693 >> 172.21.15.42:0/3680142693 conn(0x7fc65809a910 msgr2=0x7fc65806e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:55:07.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.539+0000 7fc65fc40640 1 -- 172.21.15.42:0/3680142693 shutdown_connections 2024-05-08T18:55:07.539 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.539+0000 7fc65fc40640 1 -- 172.21.15.42:0/3680142693 wait complete. 2024-05-08T18:55:07.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.540+0000 7fc65fc40640 1 Processor -- start 2024-05-08T18:55:07.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.540+0000 7fc65fc40640 1 -- start start 2024-05-08T18:55:07.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.540+0000 7fc65fc40640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc65806fe20 0x7fc6581c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:55:07.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.540+0000 7fc65fc40640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7fc6580735a0 con 0x7fc65806fe20 2024-05-08T18:55:07.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.540+0000 7fc65d9dc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc65806fe20 0x7fc6581c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:55:07.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.540+0000 7fc65d9dc640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc65806fe20 0x7fc6581c4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:40638/0 (socket says 172.21.15.42:40638) 2024-05-08T18:55:07.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.540+0000 7fc65d9dc640 1 -- 172.21.15.42:0/479145865 learned_addr learned my addr 172.21.15.42:0/479145865 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:55:07.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.540+0000 7fc65d9dc640 1 -- 172.21.15.42:0/479145865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc65811ac70 con 0x7fc65806fe20 2024-05-08T18:55:07.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.541+0000 7fc65d9dc640 1 --2- 172.21.15.42:0/479145865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc65806fe20 0x7fc6581c4240 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc64c00c380 tx=0x7fc64c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:55:07.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.541+0000 7fc64a7fc640 1 -- 172.21.15.42:0/479145865 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc64c005c10 con 0x7fc65806fe20 2024-05-08T18:55:07.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.541+0000 7fc64a7fc640 1 -- 172.21.15.42:0/479145865 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc64c005db0 con 0x7fc65806fe20 2024-05-08T18:55:07.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.541+0000 7fc65fc40640 1 -- 172.21.15.42:0/479145865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc65811b200 con 0x7fc65806fe20 2024-05-08T18:55:07.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.541+0000 7fc64a7fc640 1 -- 172.21.15.42:0/479145865 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc64c004930 con 0x7fc65806fe20 2024-05-08T18:55:07.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.541+0000 7fc65fc40640 1 -- 172.21.15.42:0/479145865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6581c4780 con 0x7fc65806fe20 2024-05-08T18:55:07.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.542+0000 7fc64a7fc640 1 -- 172.21.15.42:0/479145865 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7fc64c01a020 con 0x7fc65806fe20 2024-05-08T18:55:07.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.542+0000 7fc65fc40640 1 -- 172.21.15.42:0/479145865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc658064010 con 0x7fc65806fe20 2024-05-08T18:55:07.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.542+0000 7fc64a7fc640 1 --2- 172.21.15.42:0/479145865 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc63c03d2b0 0x7fc63c03f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:55:07.542 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.542+0000 7fc64a7fc640 1 -- 172.21.15.42:0/479145865 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7fc64c051470 con 0x7fc65806fe20 2024-05-08T18:55:07.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.542+0000 7fc65d1db640 1 --2- 172.21.15.42:0/479145865 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc63c03d2b0 0x7fc63c03f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:55:07.543 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.543+0000 7fc65d1db640 1 --2- 172.21.15.42:0/479145865 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc63c03d2b0 0x7fc63c03f770 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc654036000 tx=0x7fc654008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:55:07.546 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.547+0000 7fc64a7fc640 1 -- 172.21.15.42:0/479145865 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7fc65811b200 con 0x7fc65806fe20 2024-05-08T18:55:07.732 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.733+0000 7fc65fc40640 1 -- 172.21.15.42:0/479145865 --> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc658075170 con 0x7fc63c03d2b0 2024-05-08T18:55:07.748 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.749+0000 7fc64a7fc640 1 -- 172.21.15.42:0/479145865 <== mgr.4102 v2:172.21.15.132:6824/2104266563 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665522 (secure 0 0 0) 0x7fc658075170 con 0x7fc63c03d2b0 2024-05-08T18:55:07.756 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:55:07.761 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-08T18:55:07.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.754+0000 7fc65fc40640 1 -- 172.21.15.42:0/479145865 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc63c03d2b0 msgr2=0x7fc63c03f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:55:07.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.754+0000 7fc65fc40640 1 --2- 172.21.15.42:0/479145865 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc63c03d2b0 0x7fc63c03f770 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc654036000 tx=0x7fc654008030 comp rx=0 tx=0).stop 2024-05-08T18:55:07.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.754+0000 7fc65fc40640 1 -- 172.21.15.42:0/479145865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc65806fe20 msgr2=0x7fc6581c4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:55:07.767 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.754+0000 7fc65fc40640 1 --2- 172.21.15.42:0/479145865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc65806fe20 0x7fc6581c4240 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fc64c00c380 tx=0x7fc64c00c840 comp rx=0 tx=0).stop 2024-05-08T18:55:07.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.755+0000 7fc65fc40640 1 -- 172.21.15.42:0/479145865 shutdown_connections 2024-05-08T18:55:07.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.755+0000 7fc65fc40640 1 --2- 172.21.15.42:0/479145865 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7fc63c03d2b0 0x7fc63c03f770 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:55:07.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.755+0000 7fc65fc40640 1 --2- 172.21.15.42:0/479145865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc65806fe20 0x7fc6581c4240 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:55:07.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.755+0000 7fc65fc40640 1 -- 172.21.15.42:0/479145865 >> 172.21.15.42:0/479145865 conn(0x7fc65809a910 msgr2=0x7fc6581228c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:55:07.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.755+0000 7fc65fc40640 1 -- 172.21.15.42:0/479145865 shutdown_connections 2024-05-08T18:55:07.768 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:07.755+0000 7fc65fc40640 1 -- 172.21.15.42:0/479145865 wait complete. 2024-05-08T18:55:07.768 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2024-05-08T18:55:06.013951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5031,"num_read_kb":4621,"num_write":2119,"num_write_kb":60585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4737,"ondisk_log_size":4737,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":143992,"kb_used_data":2648,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343368,"statfs":{"total":386547056640,"available":386399608832,"internally_reserved":0,"allocated":2711552,"data_stored":1657766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004286"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:20.917462+0000","last_change":"2024-05-08T18:54:20.917462+0000","last_active":"2024-05-08T18:54:20.917462+0000","last_peered":"2024-05-08T18:54:20.917462+0000","last_clean":"2024-05-08T18:54:20.917462+0000","last_became_active":"2024-05-08T18:50:26.031359+0000","last_became_peered":"2024-05-08T18:50:26.031359+0000","last_unstale":"2024-05-08T18:54:20.917462+0000","last_undegraded":"2024-05-08T18:54:20.917462+0000","last_fullsized":"2024-05-08T18:54:20.917462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:20.917335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:20.917335+0000","last_clean_scrub_stamp":"2024-05-08T18:54:20.917335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:04.286184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"27'8","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:23.788793+0000","last_change":"2024-05-08T18:54:23.788822+0000","last_active":"2024-05-08T18:54:23.788793+0000","last_peered":"2024-05-08T18:54:23.788793+0000","last_clean":"2024-05-08T18:54:23.788793+0000","last_became_active":"2024-05-08T18:50:28.028352+0000","last_became_peered":"2024-05-08T18:50:28.028352+0000","last_unstale":"2024-05-08T18:54:23.788793+0000","last_undegraded":"2024-05-08T18:54:23.788793+0000","last_fullsized":"2024-05-08T18:54:23.788793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:23.788707+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:23.788707+0000","last_clean_scrub_stamp":"2024-05-08T18:54:23.788707+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:30:26.936915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"27'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:26.036038+0000","last_change":"2024-05-08T18:54:26.036038+0000","last_active":"2024-05-08T18:54:26.036038+0000","last_peered":"2024-05-08T18:54:26.036038+0000","last_clean":"2024-05-08T18:54:26.036038+0000","last_became_active":"2024-05-08T18:50:26.028799+0000","last_became_peered":"2024-05-08T18:50:26.028799+0000","last_unstale":"2024-05-08T18:54:26.036038+0000","last_undegraded":"2024-05-08T18:54:26.036038+0000","last_fullsized":"2024-05-08T18:54:26.036038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:26.035863+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:26.035863+0000","last_clean_scrub_stamp":"2024-05-08T18:54:26.035863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:02.859884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"27'6","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:22.049106+0000","last_change":"2024-05-08T18:54:22.049138+0000","last_active":"2024-05-08T18:54:22.049106+0000","last_peered":"2024-05-08T18:54:22.049106+0000","last_clean":"2024-05-08T18:54:22.049106+0000","last_became_active":"2024-05-08T18:50:28.033466+0000","last_became_peered":"2024-05-08T18:50:28.033466+0000","last_unstale":"2024-05-08T18:54:22.049106+0000","last_undegraded":"2024-05-08T18:54:22.049106+0000","last_fullsized":"2024-05-08T18:54:22.049106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:22.049001+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:22.049001+0000","last_clean_scrub_stamp":"2024-05-08T18:54:22.049001+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:03.232750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:44.837869+0000","last_change":"2024-05-08T18:54:44.837895+0000","last_active":"2024-05-08T18:54:44.837869+0000","last_peered":"2024-05-08T18:54:44.837869+0000","last_clean":"2024-05-08T18:54:44.837869+0000","last_became_active":"2024-05-08T18:51:15.083809+0000","last_became_peered":"2024-05-08T18:51:15.083809+0000","last_unstale":"2024-05-08T18:54:44.837869+0000","last_undegraded":"2024-05-08T18:54:44.837869+0000","last_fullsized":"2024-05-08T18:54:44.837869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:44.837768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:44.837768+0000","last_clean_scrub_stamp":"2024-05-08T18:54:44.837768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:34.569974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"25'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:48.140723+0000","last_change":"2024-05-08T18:54:48.140794+0000","last_active":"2024-05-08T18:54:48.140723+0000","last_peered":"2024-05-08T18:54:48.140723+0000","last_clean":"2024-05-08T18:54:48.140723+0000","last_became_active":"2024-05-08T18:51:15.080716+0000","last_became_peered":"2024-05-08T18:51:15.080716+0000","last_unstale":"2024-05-08T18:54:48.140723+0000","last_undegraded":"2024-05-08T18:54:48.140723+0000","last_fullsized":"2024-05-08T18:54:48.140723+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:48.140610+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:48.140610+0000","last_clean_scrub_stamp":"2024-05-08T18:54:48.140610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:37.287821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:30.878537+0000","last_change":"2024-05-08T18:54:30.878562+0000","last_active":"2024-05-08T18:54:30.878537+0000","last_peered":"2024-05-08T18:54:30.878537+0000","last_clean":"2024-05-08T18:54:30.878537+0000","last_became_active":"2024-05-08T18:50:26.024243+0000","last_became_peered":"2024-05-08T18:50:26.024243+0000","last_unstale":"2024-05-08T18:54:30.878537+0000","last_undegraded":"2024-05-08T18:54:30.878537+0000","last_fullsized":"2024-05-08T18:54:30.878537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:30.878445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:30.878445+0000","last_clean_scrub_stamp":"2024-05-08T18:54:30.878445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:30:34.026653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"27'4","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:30.094768+0000","last_change":"2024-05-08T18:54:30.094795+0000","last_active":"2024-05-08T18:54:30.094768+0000","last_peered":"2024-05-08T18:54:30.094768+0000","last_clean":"2024-05-08T18:54:30.094768+0000","last_became_active":"2024-05-08T18:50:28.026380+0000","last_became_peered":"2024-05-08T18:50:28.026380+0000","last_unstale":"2024-05-08T18:54:30.094768+0000","last_undegraded":"2024-05-08T18:54:30.094768+0000","last_fullsized":"2024-05-08T18:54:30.094768+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:30.094665+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:30.094665+0000","last_clean_scrub_stamp":"2024-05-08T18:54:30.094665+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:30.168403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"25'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:45.040009+0000","last_change":"2024-05-08T18:54:45.040054+0000","last_active":"2024-05-08T18:54:45.040009+0000","last_peered":"2024-05-08T18:54:45.040009+0000","last_clean":"2024-05-08T18:54:45.040009+0000","last_became_active":"2024-05-08T18:50:26.022914+0000","last_became_peered":"2024-05-08T18:50:26.022914+0000","last_unstale":"2024-05-08T18:54:45.040009+0000","last_undegraded":"2024-05-08T18:54:45.040009+0000","last_fullsized":"2024-05-08T18:54:45.040009+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:45.039918+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:45.039918+0000","last_clean_scrub_stamp":"2024-05-08T18:54:45.039918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:49:57.647019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'6","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:17.878113+0000","last_change":"2024-05-08T18:54:17.878113+0000","last_active":"2024-05-08T18:54:17.878113+0000","last_peered":"2024-05-08T18:54:17.878113+0000","last_clean":"2024-05-08T18:54:17.878113+0000","last_became_active":"2024-05-08T18:50:28.023506+0000","last_became_peered":"2024-05-08T18:50:28.023506+0000","last_unstale":"2024-05-08T18:54:17.878113+0000","last_undegraded":"2024-05-08T18:54:17.878113+0000","last_fullsized":"2024-05-08T18:54:17.878113+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:17.877983+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:17.877983+0000","last_clean_scrub_stamp":"2024-05-08T18:54:17.877983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:50.155421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"25'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:31.877064+0000","last_change":"2024-05-08T18:54:31.877093+0000","last_active":"2024-05-08T18:54:31.877064+0000","last_peered":"2024-05-08T18:54:31.877064+0000","last_clean":"2024-05-08T18:54:31.877064+0000","last_became_active":"2024-05-08T18:50:26.024493+0000","last_became_peered":"2024-05-08T18:50:26.024493+0000","last_unstale":"2024-05-08T18:54:31.877064+0000","last_undegraded":"2024-05-08T18:54:31.877064+0000","last_fullsized":"2024-05-08T18:54:31.877064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:31.876973+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:31.876973+0000","last_clean_scrub_stamp":"2024-05-08T18:54:31.876973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:21.277118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"27'10","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:18.071888+0000","last_change":"2024-05-08T18:54:18.071888+0000","last_active":"2024-05-08T18:54:18.071888+0000","last_peered":"2024-05-08T18:54:18.071888+0000","last_clean":"2024-05-08T18:54:18.071888+0000","last_became_active":"2024-05-08T18:50:28.037266+0000","last_became_peered":"2024-05-08T18:50:28.037266+0000","last_unstale":"2024-05-08T18:54:18.071888+0000","last_undegraded":"2024-05-08T18:54:18.071888+0000","last_fullsized":"2024-05-08T18:54:18.071888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:18.071727+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:18.071727+0000","last_clean_scrub_stamp":"2024-05-08T18:54:18.071727+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:22.473146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:58.889272+0000","last_change":"2024-05-08T18:54:58.889299+0000","last_active":"2024-05-08T18:54:58.889272+0000","last_peered":"2024-05-08T18:54:58.889272+0000","last_clean":"2024-05-08T18:54:58.889272+0000","last_became_active":"2024-05-08T18:50:26.010734+0000","last_became_peered":"2024-05-08T18:50:26.010734+0000","last_unstale":"2024-05-08T18:54:58.889272+0000","last_undegraded":"2024-05-08T18:54:58.889272+0000","last_fullsized":"2024-05-08T18:54:58.889272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:58.889178+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:58.889178+0000","last_clean_scrub_stamp":"2024-05-08T18:54:58.889178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:53.905748+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:15.936164+0000","last_change":"2024-05-08T18:54:15.936164+0000","last_active":"2024-05-08T18:54:15.936164+0000","last_peered":"2024-05-08T18:54:15.936164+0000","last_clean":"2024-05-08T18:54:15.936164+0000","last_became_active":"2024-05-08T18:50:28.026028+0000","last_became_peered":"2024-05-08T18:50:28.026028+0000","last_unstale":"2024-05-08T18:54:15.936164+0000","last_undegraded":"2024-05-08T18:54:15.936164+0000","last_fullsized":"2024-05-08T18:54:15.936164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:15.936014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:15.936014+0000","last_clean_scrub_stamp":"2024-05-08T18:54:15.936014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:46.686256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"25'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:22.076100+0000","last_change":"2024-05-08T18:54:22.076129+0000","last_active":"2024-05-08T18:54:22.076100+0000","last_peered":"2024-05-08T18:54:22.076100+0000","last_clean":"2024-05-08T18:54:22.076100+0000","last_became_active":"2024-05-08T18:50:26.029435+0000","last_became_peered":"2024-05-08T18:50:26.029435+0000","last_unstale":"2024-05-08T18:54:22.076100+0000","last_undegraded":"2024-05-08T18:54:22.076100+0000","last_fullsized":"2024-05-08T18:54:22.076100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:22.076003+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:22.076003+0000","last_clean_scrub_stamp":"2024-05-08T18:54:22.076003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:28.517889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"27'6","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:23.929209+0000","last_change":"2024-05-08T18:54:23.929209+0000","last_active":"2024-05-08T18:54:23.929209+0000","last_peered":"2024-05-08T18:54:23.929209+0000","last_clean":"2024-05-08T18:54:23.929209+0000","last_became_active":"2024-05-08T18:50:28.033311+0000","last_became_peered":"2024-05-08T18:50:28.033311+0000","last_unstale":"2024-05-08T18:54:23.929209+0000","last_undegraded":"2024-05-08T18:54:23.929209+0000","last_fullsized":"2024-05-08T18:54:23.929209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:23.929088+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:23.929088+0000","last_clean_scrub_stamp":"2024-05-08T18:54:23.929088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:53.559562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"27'10","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:23.094201+0000","last_change":"2024-05-08T18:54:23.094231+0000","last_active":"2024-05-08T18:54:23.094201+0000","last_peered":"2024-05-08T18:54:23.094201+0000","last_clean":"2024-05-08T18:54:23.094201+0000","last_became_active":"2024-05-08T18:50:28.032951+0000","last_became_peered":"2024-05-08T18:50:28.032951+0000","last_unstale":"2024-05-08T18:54:23.094201+0000","last_undegraded":"2024-05-08T18:54:23.094201+0000","last_fullsized":"2024-05-08T18:54:23.094201+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:23.094109+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:23.094109+0000","last_clean_scrub_stamp":"2024-05-08T18:54:23.094109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:00.987376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'4","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:22.772336+0000","last_change":"2024-05-08T18:54:22.772365+0000","last_active":"2024-05-08T18:54:22.772336+0000","last_peered":"2024-05-08T18:54:22.772336+0000","last_clean":"2024-05-08T18:54:22.772336+0000","last_became_active":"2024-05-08T18:50:26.030437+0000","last_became_peered":"2024-05-08T18:50:26.030437+0000","last_unstale":"2024-05-08T18:54:22.772336+0000","last_undegraded":"2024-05-08T18:54:22.772336+0000","last_fullsized":"2024-05-08T18:54:22.772336+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-08T18:54:22.772232+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-08T18:54:22.772232+0000","last_clean_scrub_stamp":"2024-05-08T18:54:22.772232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:30.535173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'22","reported_seq":116,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:21.778508+0000","last_change":"2024-05-08T18:54:21.778559+0000","last_active":"2024-05-08T18:54:21.778508+0000","last_peered":"2024-05-08T18:54:21.778508+0000","last_clean":"2024-05-08T18:54:21.778508+0000","last_became_active":"2024-05-08T18:50:28.028184+0000","last_became_peered":"2024-05-08T18:50:28.028184+0000","last_unstale":"2024-05-08T18:54:21.778508+0000","last_undegraded":"2024-05-08T18:54:21.778508+0000","last_fullsized":"2024-05-08T18:54:21.778508+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-05-08T18:54:21.778405+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-05-08T18:54:21.778405+0000","last_clean_scrub_stamp":"2024-05-08T18:54:21.778405+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:34.523219+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":94,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"27'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:14.975181+0000","last_change":"2024-05-08T18:54:14.975221+0000","last_active":"2024-05-08T18:54:14.975181+0000","last_peered":"2024-05-08T18:54:14.975181+0000","last_clean":"2024-05-08T18:54:14.975181+0000","last_became_active":"2024-05-08T18:50:26.031768+0000","last_became_peered":"2024-05-08T18:50:26.031768+0000","last_unstale":"2024-05-08T18:54:14.975181+0000","last_undegraded":"2024-05-08T18:54:14.975181+0000","last_fullsized":"2024-05-08T18:54:14.975181+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:14.975072+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:14.975072+0000","last_clean_scrub_stamp":"2024-05-08T18:54:14.975072+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:23.744293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'8","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:27.735916+0000","last_change":"2024-05-08T18:54:27.735944+0000","last_active":"2024-05-08T18:54:27.735916+0000","last_peered":"2024-05-08T18:54:27.735916+0000","last_clean":"2024-05-08T18:54:27.735916+0000","last_became_active":"2024-05-08T18:50:28.029145+0000","last_became_peered":"2024-05-08T18:50:28.029145+0000","last_unstale":"2024-05-08T18:54:27.735916+0000","last_undegraded":"2024-05-08T18:54:27.735916+0000","last_fullsized":"2024-05-08T18:54:27.735916+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:27.735826+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:27.735826+0000","last_clean_scrub_stamp":"2024-05-08T18:54:27.735826+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:04.559847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"27'4","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:20.823534+0000","last_change":"2024-05-08T18:54:20.823562+0000","last_active":"2024-05-08T18:54:20.823534+0000","last_peered":"2024-05-08T18:54:20.823534+0000","last_clean":"2024-05-08T18:54:20.823534+0000","last_became_active":"2024-05-08T18:50:26.031545+0000","last_became_peered":"2024-05-08T18:50:26.031545+0000","last_unstale":"2024-05-08T18:54:20.823534+0000","last_undegraded":"2024-05-08T18:54:20.823534+0000","last_fullsized":"2024-05-08T18:54:20.823534+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:20.823443+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:20.823443+0000","last_clean_scrub_stamp":"2024-05-08T18:54:20.823443+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:58.388872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"27'16","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:21.125113+0000","last_change":"2024-05-08T18:54:21.125177+0000","last_active":"2024-05-08T18:54:21.125113+0000","last_peered":"2024-05-08T18:54:21.125113+0000","last_clean":"2024-05-08T18:54:21.125113+0000","last_became_active":"2024-05-08T18:50:28.022683+0000","last_became_peered":"2024-05-08T18:50:28.022683+0000","last_unstale":"2024-05-08T18:54:21.125113+0000","last_undegraded":"2024-05-08T18:54:21.125113+0000","last_fullsized":"2024-05-08T18:54:21.125113+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-05-08T18:54:21.125005+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-05-08T18:54:21.125005+0000","last_clean_scrub_stamp":"2024-05-08T18:54:21.125005+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.887946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:32.733387+0000","last_change":"2024-05-08T18:54:32.733415+0000","last_active":"2024-05-08T18:54:32.733387+0000","last_peered":"2024-05-08T18:54:32.733387+0000","last_clean":"2024-05-08T18:54:32.733387+0000","last_became_active":"2024-05-08T18:50:26.011512+0000","last_became_peered":"2024-05-08T18:50:26.011512+0000","last_unstale":"2024-05-08T18:54:32.733387+0000","last_undegraded":"2024-05-08T18:54:32.733387+0000","last_fullsized":"2024-05-08T18:54:32.733387+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:32.733293+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:32.733293+0000","last_clean_scrub_stamp":"2024-05-08T18:54:32.733293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:47.011150+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:19.891014+0000","last_change":"2024-05-08T18:54:19.891039+0000","last_active":"2024-05-08T18:54:19.891014+0000","last_peered":"2024-05-08T18:54:19.891014+0000","last_clean":"2024-05-08T18:54:19.891014+0000","last_became_active":"2024-05-08T18:50:28.032768+0000","last_became_peered":"2024-05-08T18:50:28.032768+0000","last_unstale":"2024-05-08T18:54:19.891014+0000","last_undegraded":"2024-05-08T18:54:19.891014+0000","last_fullsized":"2024-05-08T18:54:19.891014+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:19.890923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:19.890923+0000","last_clean_scrub_stamp":"2024-05-08T18:54:19.890923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:07.413936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:24.086723+0000","last_change":"2024-05-08T18:54:24.086794+0000","last_active":"2024-05-08T18:54:24.086723+0000","last_peered":"2024-05-08T18:54:24.086723+0000","last_clean":"2024-05-08T18:54:24.086723+0000","last_became_active":"2024-05-08T18:50:26.029015+0000","last_became_peered":"2024-05-08T18:50:26.029015+0000","last_unstale":"2024-05-08T18:54:24.086723+0000","last_undegraded":"2024-05-08T18:54:24.086723+0000","last_fullsized":"2024-05-08T18:54:24.086723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:24.086613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:24.086613+0000","last_clean_scrub_stamp":"2024-05-08T18:54:24.086613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:17:23.170101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"27'14","reported_seq":77,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:14.955599+0000","last_change":"2024-05-08T18:54:14.955626+0000","last_active":"2024-05-08T18:54:14.955599+0000","last_peered":"2024-05-08T18:54:14.955599+0000","last_clean":"2024-05-08T18:54:14.955599+0000","last_became_active":"2024-05-08T18:50:28.022359+0000","last_became_peered":"2024-05-08T18:50:28.022359+0000","last_unstale":"2024-05-08T18:54:14.955599+0000","last_undegraded":"2024-05-08T18:54:14.955599+0000","last_fullsized":"2024-05-08T18:54:14.955599+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-05-08T18:54:14.955510+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-05-08T18:54:14.955510+0000","last_clean_scrub_stamp":"2024-05-08T18:54:14.955510+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:26.145719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:50.958045+0000","last_change":"2024-05-08T18:54:50.958071+0000","last_active":"2024-05-08T18:54:50.958045+0000","last_peered":"2024-05-08T18:54:50.958045+0000","last_clean":"2024-05-08T18:54:50.958045+0000","last_became_active":"2024-05-08T18:50:26.016932+0000","last_became_peered":"2024-05-08T18:50:26.016932+0000","last_unstale":"2024-05-08T18:54:50.958045+0000","last_undegraded":"2024-05-08T18:54:50.958045+0000","last_fullsized":"2024-05-08T18:54:50.958045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:50.957937+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:50.957937+0000","last_clean_scrub_stamp":"2024-05-08T18:54:50.957937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:49.351414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"27'42","reported_seq":117,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:41.827668+0000","last_change":"2024-05-08T18:54:41.827705+0000","last_active":"2024-05-08T18:54:41.827668+0000","last_peered":"2024-05-08T18:54:41.827668+0000","last_clean":"2024-05-08T18:54:41.827668+0000","last_became_active":"2024-05-08T18:50:36.055045+0000","last_became_peered":"2024-05-08T18:50:36.055045+0000","last_unstale":"2024-05-08T18:54:41.827668+0000","last_undegraded":"2024-05-08T18:54:41.827668+0000","last_fullsized":"2024-05-08T18:54:41.827668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-05-08T18:54:41.827577+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-05-08T18:54:41.827577+0000","last_clean_scrub_stamp":"2024-05-08T18:54:41.827577+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:51.438853+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":182,"num_write":115,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'10","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:34.116133+0000","last_change":"2024-05-08T18:54:34.116165+0000","last_active":"2024-05-08T18:54:34.116133+0000","last_peered":"2024-05-08T18:54:34.116133+0000","last_clean":"2024-05-08T18:54:34.116133+0000","last_became_active":"2024-05-08T18:50:28.025239+0000","last_became_peered":"2024-05-08T18:50:28.025239+0000","last_unstale":"2024-05-08T18:54:34.116133+0000","last_undegraded":"2024-05-08T18:54:34.116133+0000","last_fullsized":"2024-05-08T18:54:34.116133+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:34.115992+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:34.115992+0000","last_clean_scrub_stamp":"2024-05-08T18:54:34.115992+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:07:15.486159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:49.931474+0000","last_change":"2024-05-08T18:54:49.931530+0000","last_active":"2024-05-08T18:54:49.931474+0000","last_peered":"2024-05-08T18:54:49.931474+0000","last_clean":"2024-05-08T18:54:49.931474+0000","last_became_active":"2024-05-08T18:50:26.026400+0000","last_became_peered":"2024-05-08T18:50:26.026400+0000","last_unstale":"2024-05-08T18:54:49.931474+0000","last_undegraded":"2024-05-08T18:54:49.931474+0000","last_fullsized":"2024-05-08T18:54:49.931474+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:49.931359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:49.931359+0000","last_clean_scrub_stamp":"2024-05-08T18:54:49.931359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:33.427227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:46.101267+0000","last_change":"2024-05-08T18:53:46.101302+0000","last_active":"2024-05-08T18:53:46.101267+0000","last_peered":"2024-05-08T18:53:46.101267+0000","last_clean":"2024-05-08T18:53:46.101267+0000","last_became_active":"2024-05-08T18:50:30.034832+0000","last_became_peered":"2024-05-08T18:50:30.034832+0000","last_unstale":"2024-05-08T18:53:46.101267+0000","last_undegraded":"2024-05-08T18:53:46.101267+0000","last_fullsized":"2024-05-08T18:53:46.101267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:46.101144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:46.101144+0000","last_clean_scrub_stamp":"2024-05-08T18:53:46.101144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:47.297905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"27'36","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:10.133225+0000","last_change":"2024-05-08T18:54:10.133267+0000","last_active":"2024-05-08T18:54:10.133225+0000","last_peered":"2024-05-08T18:54:10.133225+0000","last_clean":"2024-05-08T18:54:10.133225+0000","last_became_active":"2024-05-08T18:50:32.042432+0000","last_became_peered":"2024-05-08T18:50:32.042432+0000","last_unstale":"2024-05-08T18:54:10.133225+0000","last_undegraded":"2024-05-08T18:54:10.133225+0000","last_fullsized":"2024-05-08T18:54:10.133225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-05-08T18:54:10.133140+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-05-08T18:54:10.133140+0000","last_clean_scrub_stamp":"2024-05-08T18:54:10.133140+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:10:47.056279+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:52.079227+0000","last_change":"2024-05-08T18:53:52.079267+0000","last_active":"2024-05-08T18:53:52.079227+0000","last_peered":"2024-05-08T18:53:52.079227+0000","last_clean":"2024-05-08T18:53:52.079227+0000","last_became_active":"2024-05-08T18:50:34.048339+0000","last_became_peered":"2024-05-08T18:50:34.048339+0000","last_unstale":"2024-05-08T18:53:52.079227+0000","last_undegraded":"2024-05-08T18:53:52.079227+0000","last_fullsized":"2024-05-08T18:53:52.079227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:52.079130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:52.079130+0000","last_clean_scrub_stamp":"2024-05-08T18:53:52.079130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:45.266873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:40.839654+0000","last_change":"2024-05-08T18:54:40.839700+0000","last_active":"2024-05-08T18:54:40.839654+0000","last_peered":"2024-05-08T18:54:40.839654+0000","last_clean":"2024-05-08T18:54:40.839654+0000","last_became_active":"2024-05-08T18:50:36.055220+0000","last_became_peered":"2024-05-08T18:50:36.055220+0000","last_unstale":"2024-05-08T18:54:40.839654+0000","last_undegraded":"2024-05-08T18:54:40.839654+0000","last_fullsized":"2024-05-08T18:54:40.839654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-08T18:54:40.839542+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-08T18:54:40.839542+0000","last_clean_scrub_stamp":"2024-05-08T18:54:40.839542+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:47.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"25'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:03.039013+0000","last_change":"2024-05-08T18:54:03.039054+0000","last_active":"2024-05-08T18:54:03.039013+0000","last_peered":"2024-05-08T18:54:03.039013+0000","last_clean":"2024-05-08T18:54:03.039013+0000","last_became_active":"2024-05-08T18:50:28.038232+0000","last_became_peered":"2024-05-08T18:50:28.038232+0000","last_unstale":"2024-05-08T18:54:03.039013+0000","last_undegraded":"2024-05-08T18:54:03.039013+0000","last_fullsized":"2024-05-08T18:54:03.039013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:03.038905+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:03.038905+0000","last_clean_scrub_stamp":"2024-05-08T18:54:03.038905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:05.325298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:24.931975+0000","last_change":"2024-05-08T18:54:24.932026+0000","last_active":"2024-05-08T18:54:24.931975+0000","last_peered":"2024-05-08T18:54:24.931975+0000","last_clean":"2024-05-08T18:54:24.931975+0000","last_became_active":"2024-05-08T18:50:26.030986+0000","last_became_peered":"2024-05-08T18:50:26.030986+0000","last_unstale":"2024-05-08T18:54:24.931975+0000","last_undegraded":"2024-05-08T18:54:24.931975+0000","last_fullsized":"2024-05-08T18:54:24.931975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:24.931877+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:24.931877+0000","last_clean_scrub_stamp":"2024-05-08T18:54:24.931877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:57.209315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:12.104653+0000","last_change":"2024-05-08T18:54:12.104703+0000","last_active":"2024-05-08T18:54:12.104653+0000","last_peered":"2024-05-08T18:54:12.104653+0000","last_clean":"2024-05-08T18:54:12.104653+0000","last_became_active":"2024-05-08T18:50:30.026538+0000","last_became_peered":"2024-05-08T18:50:30.026538+0000","last_unstale":"2024-05-08T18:54:12.104653+0000","last_undegraded":"2024-05-08T18:54:12.104653+0000","last_fullsized":"2024-05-08T18:54:12.104653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:12.104549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:12.104549+0000","last_clean_scrub_stamp":"2024-05-08T18:54:12.104549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:24:22.097976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"27'9","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:50.126320+0000","last_change":"2024-05-08T18:53:50.126357+0000","last_active":"2024-05-08T18:53:50.126320+0000","last_peered":"2024-05-08T18:53:50.126320+0000","last_clean":"2024-05-08T18:53:50.126320+0000","last_became_active":"2024-05-08T18:50:32.039031+0000","last_became_peered":"2024-05-08T18:50:32.039031+0000","last_unstale":"2024-05-08T18:53:50.126320+0000","last_undegraded":"2024-05-08T18:53:50.126320+0000","last_fullsized":"2024-05-08T18:53:50.126320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-08T18:53:50.126231+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-08T18:53:50.126231+0000","last_clean_scrub_stamp":"2024-05-08T18:53:50.126231+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:49.044855+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:00.011377+0000","last_change":"2024-05-08T18:54:00.011405+0000","last_active":"2024-05-08T18:54:00.011377+0000","last_peered":"2024-05-08T18:54:00.011377+0000","last_clean":"2024-05-08T18:54:00.011377+0000","last_became_active":"2024-05-08T18:50:34.050512+0000","last_became_peered":"2024-05-08T18:50:34.050512+0000","last_unstale":"2024-05-08T18:54:00.011377+0000","last_undegraded":"2024-05-08T18:54:00.011377+0000","last_fullsized":"2024-05-08T18:54:00.011377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:00.011283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:00.011283+0000","last_clean_scrub_stamp":"2024-05-08T18:54:00.011283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:48.823802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"25'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:44.075715+0000","last_change":"2024-05-08T18:54:44.075746+0000","last_active":"2024-05-08T18:54:44.075715+0000","last_peered":"2024-05-08T18:54:44.075715+0000","last_clean":"2024-05-08T18:54:44.075715+0000","last_became_active":"2024-05-08T18:50:36.048075+0000","last_became_peered":"2024-05-08T18:50:36.048075+0000","last_unstale":"2024-05-08T18:54:44.075715+0000","last_undegraded":"2024-05-08T18:54:44.075715+0000","last_fullsized":"2024-05-08T18:54:44.075715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-08T18:54:44.075605+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-08T18:54:44.075605+0000","last_clean_scrub_stamp":"2024-05-08T18:54:44.075605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:44.149342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'10","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:33.160313+0000","last_change":"2024-05-08T18:54:33.160341+0000","last_active":"2024-05-08T18:54:33.160313+0000","last_peered":"2024-05-08T18:54:33.160313+0000","last_clean":"2024-05-08T18:54:33.160313+0000","last_became_active":"2024-05-08T18:50:28.025867+0000","last_became_peered":"2024-05-08T18:50:28.025867+0000","last_unstale":"2024-05-08T18:54:33.160313+0000","last_undegraded":"2024-05-08T18:54:33.160313+0000","last_fullsized":"2024-05-08T18:54:33.160313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:33.160215+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:33.160215+0000","last_clean_scrub_stamp":"2024-05-08T18:54:33.160215+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:35.162766+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"27'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:38.072350+0000","last_change":"2024-05-08T18:54:38.072376+0000","last_active":"2024-05-08T18:54:38.072350+0000","last_peered":"2024-05-08T18:54:38.072350+0000","last_clean":"2024-05-08T18:54:38.072350+0000","last_became_active":"2024-05-08T18:50:26.025410+0000","last_became_peered":"2024-05-08T18:50:26.025410+0000","last_unstale":"2024-05-08T18:54:38.072350+0000","last_undegraded":"2024-05-08T18:54:38.072350+0000","last_fullsized":"2024-05-08T18:54:38.072350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:38.072264+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:38.072264+0000","last_clean_scrub_stamp":"2024-05-08T18:54:38.072264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:02.503035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:09.051908+0000","last_change":"2024-05-08T18:54:09.051964+0000","last_active":"2024-05-08T18:54:09.051908+0000","last_peered":"2024-05-08T18:54:09.051908+0000","last_clean":"2024-05-08T18:54:09.051908+0000","last_became_active":"2024-05-08T18:50:30.029196+0000","last_became_peered":"2024-05-08T18:50:30.029196+0000","last_unstale":"2024-05-08T18:54:09.051908+0000","last_undegraded":"2024-05-08T18:54:09.051908+0000","last_fullsized":"2024-05-08T18:54:09.051908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:09.051799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:09.051799+0000","last_clean_scrub_stamp":"2024-05-08T18:54:09.051799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:04.437066+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"27'15","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:51.005744+0000","last_change":"2024-05-08T18:53:51.005796+0000","last_active":"2024-05-08T18:53:51.005744+0000","last_peered":"2024-05-08T18:53:51.005744+0000","last_clean":"2024-05-08T18:53:51.005744+0000","last_became_active":"2024-05-08T18:50:32.044056+0000","last_became_peered":"2024-05-08T18:50:32.044056+0000","last_unstale":"2024-05-08T18:53:51.005744+0000","last_undegraded":"2024-05-08T18:53:51.005744+0000","last_fullsized":"2024-05-08T18:53:51.005744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-08T18:53:51.005656+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-08T18:53:51.005656+0000","last_clean_scrub_stamp":"2024-05-08T18:53:51.005656+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:01:56.400586+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"27'285","reported_seq":402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:09.098897+0000","last_change":"2024-05-08T18:54:09.098926+0000","last_active":"2024-05-08T18:54:09.098897+0000","last_peered":"2024-05-08T18:54:09.098897+0000","last_clean":"2024-05-08T18:54:09.098897+0000","last_became_active":"2024-05-08T18:50:34.041872+0000","last_became_peered":"2024-05-08T18:50:34.041872+0000","last_unstale":"2024-05-08T18:54:09.098897+0000","last_undegraded":"2024-05-08T18:54:09.098897+0000","last_fullsized":"2024-05-08T18:54:09.098897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:54:09.098809+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:54:09.098809+0000","last_clean_scrub_stamp":"2024-05-08T18:54:09.098809+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:58.498954+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:34.867887+0000","last_change":"2024-05-08T18:54:34.867909+0000","last_active":"2024-05-08T18:54:34.867887+0000","last_peered":"2024-05-08T18:54:34.867887+0000","last_clean":"2024-05-08T18:54:34.867887+0000","last_became_active":"2024-05-08T18:50:36.049346+0000","last_became_peered":"2024-05-08T18:50:36.049346+0000","last_unstale":"2024-05-08T18:54:34.867887+0000","last_undegraded":"2024-05-08T18:54:34.867887+0000","last_fullsized":"2024-05-08T18:54:34.867887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:34.867765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:34.867765+0000","last_clean_scrub_stamp":"2024-05-08T18:54:34.867765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:11.691786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'6","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:13.114919+0000","last_change":"2024-05-08T18:54:13.114946+0000","last_active":"2024-05-08T18:54:13.114919+0000","last_peered":"2024-05-08T18:54:13.114919+0000","last_clean":"2024-05-08T18:54:13.114919+0000","last_became_active":"2024-05-08T18:50:28.031332+0000","last_became_peered":"2024-05-08T18:50:28.031332+0000","last_unstale":"2024-05-08T18:54:13.114919+0000","last_undegraded":"2024-05-08T18:54:13.114919+0000","last_fullsized":"2024-05-08T18:54:13.114919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:13.114824+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:13.114824+0000","last_clean_scrub_stamp":"2024-05-08T18:54:13.114824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:53:47.219370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:18.862259+0000","last_change":"2024-05-08T18:54:18.862299+0000","last_active":"2024-05-08T18:54:18.862259+0000","last_peered":"2024-05-08T18:54:18.862259+0000","last_clean":"2024-05-08T18:54:18.862259+0000","last_became_active":"2024-05-08T18:50:26.032155+0000","last_became_peered":"2024-05-08T18:50:26.032155+0000","last_unstale":"2024-05-08T18:54:18.862259+0000","last_undegraded":"2024-05-08T18:54:18.862259+0000","last_fullsized":"2024-05-08T18:54:18.862259+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:18.862147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:18.862147+0000","last_clean_scrub_stamp":"2024-05-08T18:54:18.862147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:21.148541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"27'5","reported_seq":238,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:49.069175+0000","last_change":"2024-05-08T18:53:49.069207+0000","last_active":"2024-05-08T18:53:49.069175+0000","last_peered":"2024-05-08T18:53:49.069175+0000","last_clean":"2024-05-08T18:53:49.069175+0000","last_became_active":"2024-05-08T18:50:30.034798+0000","last_became_peered":"2024-05-08T18:50:30.034798+0000","last_unstale":"2024-05-08T18:53:49.069175+0000","last_undegraded":"2024-05-08T18:53:49.069175+0000","last_fullsized":"2024-05-08T18:53:49.069175+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-08T18:53:49.069063+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-08T18:53:49.069063+0000","last_clean_scrub_stamp":"2024-05-08T18:53:49.069063+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:32.617643+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"27'36","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.006281+0000","last_change":"2024-05-08T18:53:53.006323+0000","last_active":"2024-05-08T18:53:53.006281+0000","last_peered":"2024-05-08T18:53:53.006281+0000","last_clean":"2024-05-08T18:53:53.006281+0000","last_became_active":"2024-05-08T18:50:32.043573+0000","last_became_peered":"2024-05-08T18:50:32.043573+0000","last_unstale":"2024-05-08T18:53:53.006281+0000","last_undegraded":"2024-05-08T18:53:53.006281+0000","last_fullsized":"2024-05-08T18:53:53.006281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-05-08T18:53:53.006187+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-05-08T18:53:53.006187+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.006187+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:39.343300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"27'285","reported_seq":413,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:03.005283+0000","last_change":"2024-05-08T18:54:03.005312+0000","last_active":"2024-05-08T18:54:03.005283+0000","last_peered":"2024-05-08T18:54:03.005283+0000","last_clean":"2024-05-08T18:54:03.005283+0000","last_became_active":"2024-05-08T18:50:34.050122+0000","last_became_peered":"2024-05-08T18:50:34.050122+0000","last_unstale":"2024-05-08T18:54:03.005283+0000","last_undegraded":"2024-05-08T18:54:03.005283+0000","last_fullsized":"2024-05-08T18:54:03.005283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:54:03.005191+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:54:03.005191+0000","last_clean_scrub_stamp":"2024-05-08T18:54:03.005191+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:17.903758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"27'6","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:19.034422+0000","last_change":"2024-05-08T18:54:19.034422+0000","last_active":"2024-05-08T18:54:19.034422+0000","last_peered":"2024-05-08T18:54:19.034422+0000","last_clean":"2024-05-08T18:54:19.034422+0000","last_became_active":"2024-05-08T18:50:28.034992+0000","last_became_peered":"2024-05-08T18:50:28.034992+0000","last_unstale":"2024-05-08T18:54:19.034422+0000","last_undegraded":"2024-05-08T18:54:19.034422+0000","last_fullsized":"2024-05-08T18:54:19.034422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:19.034312+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:19.034312+0000","last_clean_scrub_stamp":"2024-05-08T18:54:19.034312+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:24.299155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:28.954650+0000","last_change":"2024-05-08T18:54:28.954650+0000","last_active":"2024-05-08T18:54:28.954650+0000","last_peered":"2024-05-08T18:54:28.954650+0000","last_clean":"2024-05-08T18:54:28.954650+0000","last_became_active":"2024-05-08T18:50:26.023141+0000","last_became_peered":"2024-05-08T18:50:26.023141+0000","last_unstale":"2024-05-08T18:54:28.954650+0000","last_undegraded":"2024-05-08T18:54:28.954650+0000","last_fullsized":"2024-05-08T18:54:28.954650+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:28.954540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:28.954540+0000","last_clean_scrub_stamp":"2024-05-08T18:54:28.954540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:41.699354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:59.048754+0000","last_change":"2024-05-08T18:53:59.048754+0000","last_active":"2024-05-08T18:53:59.048754+0000","last_peered":"2024-05-08T18:53:59.048754+0000","last_clean":"2024-05-08T18:53:59.048754+0000","last_became_active":"2024-05-08T18:50:30.029482+0000","last_became_peered":"2024-05-08T18:50:30.029482+0000","last_unstale":"2024-05-08T18:53:59.048754+0000","last_undegraded":"2024-05-08T18:53:59.048754+0000","last_fullsized":"2024-05-08T18:53:59.048754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:59.048606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:59.048606+0000","last_clean_scrub_stamp":"2024-05-08T18:53:59.048606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:51.442116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"27'52","reported_seq":113,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:54.955673+0000","last_change":"2024-05-08T18:53:54.955673+0000","last_active":"2024-05-08T18:53:54.955673+0000","last_peered":"2024-05-08T18:53:54.955673+0000","last_clean":"2024-05-08T18:53:54.955673+0000","last_became_active":"2024-05-08T18:50:32.038121+0000","last_became_peered":"2024-05-08T18:50:32.038121+0000","last_unstale":"2024-05-08T18:53:54.955673+0000","last_undegraded":"2024-05-08T18:53:54.955673+0000","last_fullsized":"2024-05-08T18:53:54.955673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'52","last_scrub_stamp":"2024-05-08T18:53:54.955515+0000","last_deep_scrub":"27'52","last_deep_scrub_stamp":"2024-05-08T18:53:54.955515+0000","last_clean_scrub_stamp":"2024-05-08T18:53:54.955515+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:16.055669+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:44.931133+0000","last_change":"2024-05-08T18:53:44.931154+0000","last_active":"2024-05-08T18:53:44.931133+0000","last_peered":"2024-05-08T18:53:44.931133+0000","last_clean":"2024-05-08T18:53:44.931133+0000","last_became_active":"2024-05-08T18:50:34.047404+0000","last_became_peered":"2024-05-08T18:50:34.047404+0000","last_unstale":"2024-05-08T18:53:44.931133+0000","last_undegraded":"2024-05-08T18:53:44.931133+0000","last_fullsized":"2024-05-08T18:53:44.931133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:44.931063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:44.931063+0000","last_clean_scrub_stamp":"2024-05-08T18:53:44.931063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:50.136970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:36.818397+0000","last_change":"2024-05-08T18:54:36.818397+0000","last_active":"2024-05-08T18:54:36.818397+0000","last_peered":"2024-05-08T18:54:36.818397+0000","last_clean":"2024-05-08T18:54:36.818397+0000","last_became_active":"2024-05-08T18:50:36.051055+0000","last_became_peered":"2024-05-08T18:50:36.051055+0000","last_unstale":"2024-05-08T18:54:36.818397+0000","last_undegraded":"2024-05-08T18:54:36.818397+0000","last_fullsized":"2024-05-08T18:54:36.818397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-08T18:54:36.818220+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-08T18:54:36.818220+0000","last_clean_scrub_stamp":"2024-05-08T18:54:36.818220+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:36.666898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"27'8","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:16.905203+0000","last_change":"2024-05-08T18:54:16.905203+0000","last_active":"2024-05-08T18:54:16.905203+0000","last_peered":"2024-05-08T18:54:16.905203+0000","last_clean":"2024-05-08T18:54:16.905203+0000","last_became_active":"2024-05-08T18:50:28.018022+0000","last_became_peered":"2024-05-08T18:50:28.018022+0000","last_unstale":"2024-05-08T18:54:16.905203+0000","last_undegraded":"2024-05-08T18:54:16.905203+0000","last_fullsized":"2024-05-08T18:54:16.905203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:16.905016+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:16.905016+0000","last_clean_scrub_stamp":"2024-05-08T18:54:16.905016+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:46.535490+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:32.845560+0000","last_change":"2024-05-08T18:54:32.845560+0000","last_active":"2024-05-08T18:54:32.845560+0000","last_peered":"2024-05-08T18:54:32.845560+0000","last_clean":"2024-05-08T18:54:32.845560+0000","last_became_active":"2024-05-08T18:50:26.025028+0000","last_became_peered":"2024-05-08T18:50:26.025028+0000","last_unstale":"2024-05-08T18:54:32.845560+0000","last_undegraded":"2024-05-08T18:54:32.845560+0000","last_fullsized":"2024-05-08T18:54:32.845560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:32.845406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:32.845406+0000","last_clean_scrub_stamp":"2024-05-08T18:54:32.845406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:09.768544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:05.046379+0000","last_change":"2024-05-08T18:54:05.046379+0000","last_active":"2024-05-08T18:54:05.046379+0000","last_peered":"2024-05-08T18:54:05.046379+0000","last_clean":"2024-05-08T18:54:05.046379+0000","last_became_active":"2024-05-08T18:50:30.031574+0000","last_became_peered":"2024-05-08T18:50:30.031574+0000","last_unstale":"2024-05-08T18:54:05.046379+0000","last_undegraded":"2024-05-08T18:54:05.046379+0000","last_fullsized":"2024-05-08T18:54:05.046379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:05.046264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:05.046264+0000","last_clean_scrub_stamp":"2024-05-08T18:54:05.046264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:56.573231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"27'38","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:04.084045+0000","last_change":"2024-05-08T18:54:04.084045+0000","last_active":"2024-05-08T18:54:04.084045+0000","last_peered":"2024-05-08T18:54:04.084045+0000","last_clean":"2024-05-08T18:54:04.084045+0000","last_became_active":"2024-05-08T18:50:32.041239+0000","last_became_peered":"2024-05-08T18:50:32.041239+0000","last_unstale":"2024-05-08T18:54:04.084045+0000","last_undegraded":"2024-05-08T18:54:04.084045+0000","last_fullsized":"2024-05-08T18:54:04.084045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2024-05-08T18:54:04.083924+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2024-05-08T18:54:04.083924+0000","last_clean_scrub_stamp":"2024-05-08T18:54:04.083924+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:32.880132+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:50.038945+0000","last_change":"2024-05-08T18:53:50.038945+0000","last_active":"2024-05-08T18:53:50.038945+0000","last_peered":"2024-05-08T18:53:50.038945+0000","last_clean":"2024-05-08T18:53:50.038945+0000","last_became_active":"2024-05-08T18:50:34.044487+0000","last_became_peered":"2024-05-08T18:50:34.044487+0000","last_unstale":"2024-05-08T18:53:50.038945+0000","last_undegraded":"2024-05-08T18:53:50.038945+0000","last_fullsized":"2024-05-08T18:53:50.038945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:50.038762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:50.038762+0000","last_clean_scrub_stamp":"2024-05-08T18:53:50.038762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.226504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"27'8","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:12.011630+0000","last_change":"2024-05-08T18:54:12.011630+0000","last_active":"2024-05-08T18:54:12.011630+0000","last_peered":"2024-05-08T18:54:12.011630+0000","last_clean":"2024-05-08T18:54:12.011630+0000","last_became_active":"2024-05-08T18:50:36.050379+0000","last_became_peered":"2024-05-08T18:50:36.050379+0000","last_unstale":"2024-05-08T18:54:12.011630+0000","last_undegraded":"2024-05-08T18:54:12.011630+0000","last_fullsized":"2024-05-08T18:54:12.011630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:12.011510+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:12.011510+0000","last_clean_scrub_stamp":"2024-05-08T18:54:12.011510+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:47.390905+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"27'6","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:33.819673+0000","last_change":"2024-05-08T18:54:33.819673+0000","last_active":"2024-05-08T18:54:33.819673+0000","last_peered":"2024-05-08T18:54:33.819673+0000","last_clean":"2024-05-08T18:54:33.819673+0000","last_became_active":"2024-05-08T18:50:28.036821+0000","last_became_peered":"2024-05-08T18:50:28.036821+0000","last_unstale":"2024-05-08T18:54:33.819673+0000","last_undegraded":"2024-05-08T18:54:33.819673+0000","last_fullsized":"2024-05-08T18:54:33.819673+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:33.819529+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:33.819529+0000","last_clean_scrub_stamp":"2024-05-08T18:54:33.819529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:42.896465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:43.071690+0000","last_change":"2024-05-08T18:54:43.071690+0000","last_active":"2024-05-08T18:54:43.071690+0000","last_peered":"2024-05-08T18:54:43.071690+0000","last_clean":"2024-05-08T18:54:43.071690+0000","last_became_active":"2024-05-08T18:50:26.022938+0000","last_became_peered":"2024-05-08T18:50:26.022938+0000","last_unstale":"2024-05-08T18:54:43.071690+0000","last_undegraded":"2024-05-08T18:54:43.071690+0000","last_fullsized":"2024-05-08T18:54:43.071690+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:43.071570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:43.071570+0000","last_clean_scrub_stamp":"2024-05-08T18:54:43.071570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:15.591502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:10.062412+0000","last_change":"2024-05-08T18:54:10.062412+0000","last_active":"2024-05-08T18:54:10.062412+0000","last_peered":"2024-05-08T18:54:10.062412+0000","last_clean":"2024-05-08T18:54:10.062412+0000","last_became_active":"2024-05-08T18:50:30.029134+0000","last_became_peered":"2024-05-08T18:50:30.029134+0000","last_unstale":"2024-05-08T18:54:10.062412+0000","last_undegraded":"2024-05-08T18:54:10.062412+0000","last_fullsized":"2024-05-08T18:54:10.062412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:10.062263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:10.062263+0000","last_clean_scrub_stamp":"2024-05-08T18:54:10.062263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:53.020523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"27'46","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:48.046823+0000","last_change":"2024-05-08T18:53:48.046823+0000","last_active":"2024-05-08T18:53:48.046823+0000","last_peered":"2024-05-08T18:53:48.046823+0000","last_clean":"2024-05-08T18:53:48.046823+0000","last_became_active":"2024-05-08T18:50:32.035189+0000","last_became_peered":"2024-05-08T18:50:32.035189+0000","last_unstale":"2024-05-08T18:53:48.046823+0000","last_undegraded":"2024-05-08T18:53:48.046823+0000","last_fullsized":"2024-05-08T18:53:48.046823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-05-08T18:53:48.046702+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-05-08T18:53:48.046702+0000","last_clean_scrub_stamp":"2024-05-08T18:53:48.046702+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:09.757527+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"27'285","reported_seq":367,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:54.987120+0000","last_change":"2024-05-08T18:53:54.987120+0000","last_active":"2024-05-08T18:53:54.987120+0000","last_peered":"2024-05-08T18:53:54.987120+0000","last_clean":"2024-05-08T18:53:54.987120+0000","last_became_active":"2024-05-08T18:50:34.047999+0000","last_became_peered":"2024-05-08T18:50:34.047999+0000","last_unstale":"2024-05-08T18:53:54.987120+0000","last_undegraded":"2024-05-08T18:53:54.987120+0000","last_fullsized":"2024-05-08T18:53:54.987120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:54.986938+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:54.986938+0000","last_clean_scrub_stamp":"2024-05-08T18:53:54.986938+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:56.968910+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:43.038137+0000","last_change":"2024-05-08T18:54:43.038137+0000","last_active":"2024-05-08T18:54:43.038137+0000","last_peered":"2024-05-08T18:54:43.038137+0000","last_clean":"2024-05-08T18:54:43.038137+0000","last_became_active":"2024-05-08T18:50:36.047981+0000","last_became_peered":"2024-05-08T18:50:36.047981+0000","last_unstale":"2024-05-08T18:54:43.038137+0000","last_undegraded":"2024-05-08T18:54:43.038137+0000","last_fullsized":"2024-05-08T18:54:43.038137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:43.038023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:43.038023+0000","last_clean_scrub_stamp":"2024-05-08T18:54:43.038023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:32.770228+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"27'8","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:10.920922+0000","last_change":"2024-05-08T18:54:10.920922+0000","last_active":"2024-05-08T18:54:10.920922+0000","last_peered":"2024-05-08T18:54:10.920922+0000","last_clean":"2024-05-08T18:54:10.920922+0000","last_became_active":"2024-05-08T18:50:28.020004+0000","last_became_peered":"2024-05-08T18:50:28.020004+0000","last_unstale":"2024-05-08T18:54:10.920922+0000","last_undegraded":"2024-05-08T18:54:10.920922+0000","last_fullsized":"2024-05-08T18:54:10.920922+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:10.920810+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:10.920810+0000","last_clean_scrub_stamp":"2024-05-08T18:54:10.920810+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:32.631635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:48.979774+0000","last_change":"2024-05-08T18:54:48.979774+0000","last_active":"2024-05-08T18:54:48.979774+0000","last_peered":"2024-05-08T18:54:48.979774+0000","last_clean":"2024-05-08T18:54:48.979774+0000","last_became_active":"2024-05-08T18:50:26.015955+0000","last_became_peered":"2024-05-08T18:50:26.015955+0000","last_unstale":"2024-05-08T18:54:48.979774+0000","last_undegraded":"2024-05-08T18:54:48.979774+0000","last_fullsized":"2024-05-08T18:54:48.979774+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:48.979630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:48.979630+0000","last_clean_scrub_stamp":"2024-05-08T18:54:48.979630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:14.682378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:06.010199+0000","last_change":"2024-05-08T18:54:06.010199+0000","last_active":"2024-05-08T18:54:06.010199+0000","last_peered":"2024-05-08T18:54:06.010199+0000","last_clean":"2024-05-08T18:54:06.010199+0000","last_became_active":"2024-05-08T18:50:30.030140+0000","last_became_peered":"2024-05-08T18:50:30.030140+0000","last_unstale":"2024-05-08T18:54:06.010199+0000","last_undegraded":"2024-05-08T18:54:06.010199+0000","last_fullsized":"2024-05-08T18:54:06.010199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:06.010052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:06.010052+0000","last_clean_scrub_stamp":"2024-05-08T18:54:06.010052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:14.779273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"27'64","reported_seq":138,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:56.075427+0000","last_change":"2024-05-08T18:53:56.075427+0000","last_active":"2024-05-08T18:53:56.075427+0000","last_peered":"2024-05-08T18:53:56.075427+0000","last_clean":"2024-05-08T18:53:56.075427+0000","last_became_active":"2024-05-08T18:50:32.040633+0000","last_became_peered":"2024-05-08T18:50:32.040633+0000","last_unstale":"2024-05-08T18:53:56.075427+0000","last_undegraded":"2024-05-08T18:53:56.075427+0000","last_fullsized":"2024-05-08T18:53:56.075427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'64","last_scrub_stamp":"2024-05-08T18:53:56.075259+0000","last_deep_scrub":"27'64","last_deep_scrub_stamp":"2024-05-08T18:53:56.075259+0000","last_clean_scrub_stamp":"2024-05-08T18:53:56.075259+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:31.454654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:51.968305+0000","last_change":"2024-05-08T18:53:51.968305+0000","last_active":"2024-05-08T18:53:51.968305+0000","last_peered":"2024-05-08T18:53:51.968305+0000","last_clean":"2024-05-08T18:53:51.968305+0000","last_became_active":"2024-05-08T18:50:34.043817+0000","last_became_peered":"2024-05-08T18:50:34.043817+0000","last_unstale":"2024-05-08T18:53:51.968305+0000","last_undegraded":"2024-05-08T18:53:51.968305+0000","last_fullsized":"2024-05-08T18:53:51.968305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:51.968195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:51.968195+0000","last_clean_scrub_stamp":"2024-05-08T18:53:51.968195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:00.724814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"27'21","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:46.081031+0000","last_change":"2024-05-08T18:54:46.081031+0000","last_active":"2024-05-08T18:54:46.081031+0000","last_peered":"2024-05-08T18:54:46.081031+0000","last_clean":"2024-05-08T18:54:46.081031+0000","last_became_active":"2024-05-08T18:50:36.054237+0000","last_became_peered":"2024-05-08T18:50:36.054237+0000","last_unstale":"2024-05-08T18:54:46.081031+0000","last_undegraded":"2024-05-08T18:54:46.081031+0000","last_fullsized":"2024-05-08T18:54:46.081031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-05-08T18:54:46.080904+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-05-08T18:54:46.080904+0000","last_clean_scrub_stamp":"2024-05-08T18:54:46.080904+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:34.502961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"27'10","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:40.754428+0000","last_change":"2024-05-08T18:54:40.754452+0000","last_active":"2024-05-08T18:54:40.754428+0000","last_peered":"2024-05-08T18:54:40.754428+0000","last_clean":"2024-05-08T18:54:40.754428+0000","last_became_active":"2024-05-08T18:51:15.085560+0000","last_became_peered":"2024-05-08T18:51:15.085560+0000","last_unstale":"2024-05-08T18:54:40.754428+0000","last_undegraded":"2024-05-08T18:54:40.754428+0000","last_fullsized":"2024-05-08T18:54:40.754428+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:40.754335+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:40.754335+0000","last_clean_scrub_stamp":"2024-05-08T18:54:40.754335+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:45.155754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:47.117279+0000","last_change":"2024-05-08T18:54:47.117279+0000","last_active":"2024-05-08T18:54:47.117279+0000","last_peered":"2024-05-08T18:54:47.117279+0000","last_clean":"2024-05-08T18:54:47.117279+0000","last_became_active":"2024-05-08T18:51:15.080071+0000","last_became_peered":"2024-05-08T18:51:15.080071+0000","last_unstale":"2024-05-08T18:54:47.117279+0000","last_undegraded":"2024-05-08T18:54:47.117279+0000","last_fullsized":"2024-05-08T18:54:47.117279+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:47.117151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:47.117151+0000","last_clean_scrub_stamp":"2024-05-08T18:54:47.117151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:33.993046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:01.928071+0000","last_change":"2024-05-08T18:54:01.928071+0000","last_active":"2024-05-08T18:54:01.928071+0000","last_peered":"2024-05-08T18:54:01.928071+0000","last_clean":"2024-05-08T18:54:01.928071+0000","last_became_active":"2024-05-08T18:50:30.033318+0000","last_became_peered":"2024-05-08T18:50:30.033318+0000","last_unstale":"2024-05-08T18:54:01.928071+0000","last_undegraded":"2024-05-08T18:54:01.928071+0000","last_fullsized":"2024-05-08T18:54:01.928071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:01.927918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:01.927918+0000","last_clean_scrub_stamp":"2024-05-08T18:54:01.927918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:00.640748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"27'40","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.113321+0000","last_change":"2024-05-08T18:53:53.113321+0000","last_active":"2024-05-08T18:53:53.113321+0000","last_peered":"2024-05-08T18:53:53.113321+0000","last_clean":"2024-05-08T18:53:53.113321+0000","last_became_active":"2024-05-08T18:50:32.034914+0000","last_became_peered":"2024-05-08T18:50:32.034914+0000","last_unstale":"2024-05-08T18:53:53.113321+0000","last_undegraded":"2024-05-08T18:53:53.113321+0000","last_fullsized":"2024-05-08T18:53:53.113321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-05-08T18:53:53.113190+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-05-08T18:53:53.113190+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.113190+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:19.438913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:12.112019+0000","last_change":"2024-05-08T18:54:12.112046+0000","last_active":"2024-05-08T18:54:12.112019+0000","last_peered":"2024-05-08T18:54:12.112019+0000","last_clean":"2024-05-08T18:54:12.112019+0000","last_became_active":"2024-05-08T18:50:34.047075+0000","last_became_peered":"2024-05-08T18:50:34.047075+0000","last_unstale":"2024-05-08T18:54:12.112019+0000","last_undegraded":"2024-05-08T18:54:12.112019+0000","last_fullsized":"2024-05-08T18:54:12.112019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:12.111934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:12.111934+0000","last_clean_scrub_stamp":"2024-05-08T18:54:12.111934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.935955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:28.106620+0000","last_change":"2024-05-08T18:54:28.106620+0000","last_active":"2024-05-08T18:54:28.106620+0000","last_peered":"2024-05-08T18:54:28.106620+0000","last_clean":"2024-05-08T18:54:28.106620+0000","last_became_active":"2024-05-08T18:50:36.055385+0000","last_became_peered":"2024-05-08T18:50:36.055385+0000","last_unstale":"2024-05-08T18:54:28.106620+0000","last_undegraded":"2024-05-08T18:54:28.106620+0000","last_fullsized":"2024-05-08T18:54:28.106620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:28.106488+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:28.106488+0000","last_clean_scrub_stamp":"2024-05-08T18:54:28.106488+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:44.661104+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'4","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:01.045321+0000","last_change":"2024-05-08T18:54:01.045321+0000","last_active":"2024-05-08T18:54:01.045321+0000","last_peered":"2024-05-08T18:54:01.045321+0000","last_clean":"2024-05-08T18:54:01.045321+0000","last_became_active":"2024-05-08T18:50:28.038633+0000","last_became_peered":"2024-05-08T18:50:28.038633+0000","last_unstale":"2024-05-08T18:54:01.045321+0000","last_undegraded":"2024-05-08T18:54:01.045321+0000","last_fullsized":"2024-05-08T18:54:01.045321+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:01.045175+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:01.045175+0000","last_clean_scrub_stamp":"2024-05-08T18:54:01.045175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:30.675649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:55:00.915585+0000","last_change":"2024-05-08T18:55:00.915629+0000","last_active":"2024-05-08T18:55:00.915585+0000","last_peered":"2024-05-08T18:55:00.915585+0000","last_clean":"2024-05-08T18:55:00.915585+0000","last_became_active":"2024-05-08T18:50:26.016308+0000","last_became_peered":"2024-05-08T18:50:26.016308+0000","last_unstale":"2024-05-08T18:55:00.915585+0000","last_undegraded":"2024-05-08T18:55:00.915585+0000","last_fullsized":"2024-05-08T18:55:00.915585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:55:00.915463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:55:00.915463+0000","last_clean_scrub_stamp":"2024-05-08T18:55:00.915463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:26.830853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:04.039242+0000","last_change":"2024-05-08T18:54:04.039242+0000","last_active":"2024-05-08T18:54:04.039242+0000","last_peered":"2024-05-08T18:54:04.039242+0000","last_clean":"2024-05-08T18:54:04.039242+0000","last_became_active":"2024-05-08T18:50:30.031765+0000","last_became_peered":"2024-05-08T18:50:30.031765+0000","last_unstale":"2024-05-08T18:54:04.039242+0000","last_undegraded":"2024-05-08T18:54:04.039242+0000","last_fullsized":"2024-05-08T18:54:04.039242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:04.039072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:04.039072+0000","last_clean_scrub_stamp":"2024-05-08T18:54:04.039072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:13.913375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"27'45","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.930760+0000","last_change":"2024-05-08T18:53:58.930760+0000","last_active":"2024-05-08T18:53:58.930760+0000","last_peered":"2024-05-08T18:53:58.930760+0000","last_clean":"2024-05-08T18:53:58.930760+0000","last_became_active":"2024-05-08T18:50:32.035131+0000","last_became_peered":"2024-05-08T18:50:32.035131+0000","last_unstale":"2024-05-08T18:53:58.930760+0000","last_undegraded":"2024-05-08T18:53:58.930760+0000","last_fullsized":"2024-05-08T18:53:58.930760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-05-08T18:53:58.930638+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-05-08T18:53:58.930638+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.930638+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:52.118381+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"27'285","reported_seq":442,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.946293+0000","last_change":"2024-05-08T18:53:45.946321+0000","last_active":"2024-05-08T18:53:45.946293+0000","last_peered":"2024-05-08T18:53:45.946293+0000","last_clean":"2024-05-08T18:53:45.946293+0000","last_became_active":"2024-05-08T18:50:34.047184+0000","last_became_peered":"2024-05-08T18:50:34.047184+0000","last_unstale":"2024-05-08T18:53:45.946293+0000","last_undegraded":"2024-05-08T18:53:45.946293+0000","last_fullsized":"2024-05-08T18:53:45.946293+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:45.946195+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:45.946195+0000","last_clean_scrub_stamp":"2024-05-08T18:53:45.946195+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:08:51.238216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"27'13","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:07.061529+0000","last_change":"2024-05-08T18:54:07.061529+0000","last_active":"2024-05-08T18:54:07.061529+0000","last_peered":"2024-05-08T18:54:07.061529+0000","last_clean":"2024-05-08T18:54:07.061529+0000","last_became_active":"2024-05-08T18:50:36.046209+0000","last_became_peered":"2024-05-08T18:50:36.046209+0000","last_unstale":"2024-05-08T18:54:07.061529+0000","last_undegraded":"2024-05-08T18:54:07.061529+0000","last_fullsized":"2024-05-08T18:54:07.061529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-05-08T18:54:07.061418+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-05-08T18:54:07.061418+0000","last_clean_scrub_stamp":"2024-05-08T18:54:07.061418+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:19.023570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'6","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:08.865151+0000","last_change":"2024-05-08T18:54:08.865151+0000","last_active":"2024-05-08T18:54:08.865151+0000","last_peered":"2024-05-08T18:54:08.865151+0000","last_clean":"2024-05-08T18:54:08.865151+0000","last_became_active":"2024-05-08T18:50:28.036946+0000","last_became_peered":"2024-05-08T18:50:28.036946+0000","last_unstale":"2024-05-08T18:54:08.865151+0000","last_undegraded":"2024-05-08T18:54:08.865151+0000","last_fullsized":"2024-05-08T18:54:08.865151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:08.864977+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:08.864977+0000","last_clean_scrub_stamp":"2024-05-08T18:54:08.864977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:16.323961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:35.088964+0000","last_change":"2024-05-08T18:54:35.088964+0000","last_active":"2024-05-08T18:54:35.088964+0000","last_peered":"2024-05-08T18:54:35.088964+0000","last_clean":"2024-05-08T18:54:35.088964+0000","last_became_active":"2024-05-08T18:50:26.027657+0000","last_became_peered":"2024-05-08T18:50:26.027657+0000","last_unstale":"2024-05-08T18:54:35.088964+0000","last_undegraded":"2024-05-08T18:54:35.088964+0000","last_fullsized":"2024-05-08T18:54:35.088964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:35.088831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:35.088831+0000","last_clean_scrub_stamp":"2024-05-08T18:54:35.088831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:07:23.601707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"27'5","reported_seq":429,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:02.003952+0000","last_change":"2024-05-08T18:54:02.003952+0000","last_active":"2024-05-08T18:54:02.003952+0000","last_peered":"2024-05-08T18:54:02.003952+0000","last_clean":"2024-05-08T18:54:02.003952+0000","last_became_active":"2024-05-08T18:50:30.027420+0000","last_became_peered":"2024-05-08T18:50:30.027420+0000","last_unstale":"2024-05-08T18:54:02.003952+0000","last_undegraded":"2024-05-08T18:54:02.003952+0000","last_fullsized":"2024-05-08T18:54:02.003952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-08T18:54:02.003784+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-08T18:54:02.003784+0000","last_clean_scrub_stamp":"2024-05-08T18:54:02.003784+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:09.462769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'16","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:00.007874+0000","last_change":"2024-05-08T18:54:00.007874+0000","last_active":"2024-05-08T18:54:00.007874+0000","last_peered":"2024-05-08T18:54:00.007874+0000","last_clean":"2024-05-08T18:54:00.007874+0000","last_became_active":"2024-05-08T18:50:32.040988+0000","last_became_peered":"2024-05-08T18:50:32.040988+0000","last_unstale":"2024-05-08T18:54:00.007874+0000","last_undegraded":"2024-05-08T18:54:00.007874+0000","last_fullsized":"2024-05-08T18:54:00.007874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-05-08T18:54:00.007737+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-05-08T18:54:00.007737+0000","last_clean_scrub_stamp":"2024-05-08T18:54:00.007737+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:07.927405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"27'285","reported_seq":471,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:46.055717+0000","last_change":"2024-05-08T18:53:46.055745+0000","last_active":"2024-05-08T18:53:46.055717+0000","last_peered":"2024-05-08T18:53:46.055717+0000","last_clean":"2024-05-08T18:53:46.055717+0000","last_became_active":"2024-05-08T18:50:34.040477+0000","last_became_peered":"2024-05-08T18:50:34.040477+0000","last_unstale":"2024-05-08T18:53:46.055717+0000","last_undegraded":"2024-05-08T18:53:46.055717+0000","last_fullsized":"2024-05-08T18:53:46.055717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:46.055625+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:46.055625+0000","last_clean_scrub_stamp":"2024-05-08T18:53:46.055625+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:55:05.788331+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:07.875651+0000","last_change":"2024-05-08T18:54:07.875651+0000","last_active":"2024-05-08T18:54:07.875651+0000","last_peered":"2024-05-08T18:54:07.875651+0000","last_clean":"2024-05-08T18:54:07.875651+0000","last_became_active":"2024-05-08T18:50:36.045976+0000","last_became_peered":"2024-05-08T18:50:36.045976+0000","last_unstale":"2024-05-08T18:54:07.875651+0000","last_undegraded":"2024-05-08T18:54:07.875651+0000","last_fullsized":"2024-05-08T18:54:07.875651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:07.875523+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:07.875523+0000","last_clean_scrub_stamp":"2024-05-08T18:54:07.875523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:03.721378+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"27'4","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:05.968970+0000","last_change":"2024-05-08T18:54:05.968970+0000","last_active":"2024-05-08T18:54:05.968970+0000","last_peered":"2024-05-08T18:54:05.968970+0000","last_clean":"2024-05-08T18:54:05.968970+0000","last_became_active":"2024-05-08T18:50:28.038871+0000","last_became_peered":"2024-05-08T18:50:28.038871+0000","last_unstale":"2024-05-08T18:54:05.968970+0000","last_undegraded":"2024-05-08T18:54:05.968970+0000","last_fullsized":"2024-05-08T18:54:05.968970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:05.968831+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:05.968831+0000","last_clean_scrub_stamp":"2024-05-08T18:54:05.968831+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:15.843134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:40.064360+0000","last_change":"2024-05-08T18:54:40.064360+0000","last_active":"2024-05-08T18:54:40.064360+0000","last_peered":"2024-05-08T18:54:40.064360+0000","last_clean":"2024-05-08T18:54:40.064360+0000","last_became_active":"2024-05-08T18:50:26.025547+0000","last_became_peered":"2024-05-08T18:50:26.025547+0000","last_unstale":"2024-05-08T18:54:40.064360+0000","last_undegraded":"2024-05-08T18:54:40.064360+0000","last_fullsized":"2024-05-08T18:54:40.064360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:40.064223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:40.064223+0000","last_clean_scrub_stamp":"2024-05-08T18:54:40.064223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:21:06.700344+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:47.057018+0000","last_change":"2024-05-08T18:53:47.057018+0000","last_active":"2024-05-08T18:53:47.057018+0000","last_peered":"2024-05-08T18:53:47.057018+0000","last_clean":"2024-05-08T18:53:47.057018+0000","last_became_active":"2024-05-08T18:50:30.035734+0000","last_became_peered":"2024-05-08T18:50:30.035734+0000","last_unstale":"2024-05-08T18:53:47.057018+0000","last_undegraded":"2024-05-08T18:53:47.057018+0000","last_fullsized":"2024-05-08T18:53:47.057018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:47.056868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:47.056868+0000","last_clean_scrub_stamp":"2024-05-08T18:53:47.056868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:03:47.172253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"27'48","reported_seq":108,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:54.094067+0000","last_change":"2024-05-08T18:53:54.094067+0000","last_active":"2024-05-08T18:53:54.094067+0000","last_peered":"2024-05-08T18:53:54.094067+0000","last_clean":"2024-05-08T18:53:54.094067+0000","last_became_active":"2024-05-08T18:50:32.034769+0000","last_became_peered":"2024-05-08T18:50:32.034769+0000","last_unstale":"2024-05-08T18:53:54.094067+0000","last_undegraded":"2024-05-08T18:53:54.094067+0000","last_fullsized":"2024-05-08T18:53:54.094067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-05-08T18:53:54.093941+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-05-08T18:53:54.093941+0000","last_clean_scrub_stamp":"2024-05-08T18:53:54.093941+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:02.850561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:55.963122+0000","last_change":"2024-05-08T18:53:55.963149+0000","last_active":"2024-05-08T18:53:55.963122+0000","last_peered":"2024-05-08T18:53:55.963122+0000","last_clean":"2024-05-08T18:53:55.963122+0000","last_became_active":"2024-05-08T18:50:34.050018+0000","last_became_peered":"2024-05-08T18:50:34.050018+0000","last_unstale":"2024-05-08T18:53:55.963122+0000","last_undegraded":"2024-05-08T18:53:55.963122+0000","last_fullsized":"2024-05-08T18:53:55.963122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:55.963020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:55.963020+0000","last_clean_scrub_stamp":"2024-05-08T18:53:55.963020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:07.576169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"27'8","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:04.012454+0000","last_change":"2024-05-08T18:54:04.012454+0000","last_active":"2024-05-08T18:54:04.012454+0000","last_peered":"2024-05-08T18:54:04.012454+0000","last_clean":"2024-05-08T18:54:04.012454+0000","last_became_active":"2024-05-08T18:50:36.049274+0000","last_became_peered":"2024-05-08T18:50:36.049274+0000","last_unstale":"2024-05-08T18:54:04.012454+0000","last_undegraded":"2024-05-08T18:54:04.012454+0000","last_fullsized":"2024-05-08T18:54:04.012454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:04.012274+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:04.012274+0000","last_clean_scrub_stamp":"2024-05-08T18:54:04.012274+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:25.723099+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'8","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:05.082216+0000","last_change":"2024-05-08T18:54:05.082216+0000","last_active":"2024-05-08T18:54:05.082216+0000","last_peered":"2024-05-08T18:54:05.082216+0000","last_clean":"2024-05-08T18:54:05.082216+0000","last_became_active":"2024-05-08T18:50:28.037545+0000","last_became_peered":"2024-05-08T18:50:28.037545+0000","last_unstale":"2024-05-08T18:54:05.082216+0000","last_undegraded":"2024-05-08T18:54:05.082216+0000","last_fullsized":"2024-05-08T18:54:05.082216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:05.082102+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:05.082102+0000","last_clean_scrub_stamp":"2024-05-08T18:54:05.082102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:42.647531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'74","reported_seq":145,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:29.684035+0000","last_change":"2024-05-08T18:54:29.684064+0000","last_active":"2024-05-08T18:54:29.684035+0000","last_peered":"2024-05-08T18:54:29.684035+0000","last_clean":"2024-05-08T18:54:29.684035+0000","last_became_active":"2024-05-08T18:50:19.739986+0000","last_became_peered":"2024-05-08T18:50:19.739986+0000","last_unstale":"2024-05-08T18:54:29.684035+0000","last_undegraded":"2024-05-08T18:54:29.684035+0000","last_fullsized":"2024-05-08T18:54:29.684035+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'74","last_scrub_stamp":"2024-05-08T18:54:29.683948+0000","last_deep_scrub":"27'74","last_deep_scrub_stamp":"2024-05-08T18:54:29.683948+0000","last_clean_scrub_stamp":"2024-05-08T18:54:29.683948+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:01.256645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:57.916566+0000","last_change":"2024-05-08T18:54:57.916588+0000","last_active":"2024-05-08T18:54:57.916566+0000","last_peered":"2024-05-08T18:54:57.916566+0000","last_clean":"2024-05-08T18:54:57.916566+0000","last_became_active":"2024-05-08T18:50:19.739403+0000","last_became_peered":"2024-05-08T18:50:19.739403+0000","last_unstale":"2024-05-08T18:54:57.916566+0000","last_undegraded":"2024-05-08T18:54:57.916566+0000","last_fullsized":"2024-05-08T18:54:57.916566+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:57.916480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:57.916480+0000","last_clean_scrub_stamp":"2024-05-08T18:54:57.916480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:43.495711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:46.029616+0000","last_change":"2024-05-08T18:54:46.029640+0000","last_active":"2024-05-08T18:54:46.029616+0000","last_peered":"2024-05-08T18:54:46.029616+0000","last_clean":"2024-05-08T18:54:46.029616+0000","last_became_active":"2024-05-08T18:50:26.024249+0000","last_became_peered":"2024-05-08T18:50:26.024249+0000","last_unstale":"2024-05-08T18:54:46.029616+0000","last_undegraded":"2024-05-08T18:54:46.029616+0000","last_fullsized":"2024-05-08T18:54:46.029616+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:46.029527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:46.029527+0000","last_clean_scrub_stamp":"2024-05-08T18:54:46.029527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:44:45.512523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:57.039225+0000","last_change":"2024-05-08T18:53:57.039225+0000","last_active":"2024-05-08T18:53:57.039225+0000","last_peered":"2024-05-08T18:53:57.039225+0000","last_clean":"2024-05-08T18:53:57.039225+0000","last_became_active":"2024-05-08T18:50:30.029744+0000","last_became_peered":"2024-05-08T18:50:30.029744+0000","last_unstale":"2024-05-08T18:53:57.039225+0000","last_undegraded":"2024-05-08T18:53:57.039225+0000","last_fullsized":"2024-05-08T18:53:57.039225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:57.039062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:57.039062+0000","last_clean_scrub_stamp":"2024-05-08T18:53:57.039062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:59.021034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"27'87","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:11.115165+0000","last_change":"2024-05-08T18:54:11.115165+0000","last_active":"2024-05-08T18:54:11.115165+0000","last_peered":"2024-05-08T18:54:11.115165+0000","last_clean":"2024-05-08T18:54:11.115165+0000","last_became_active":"2024-05-08T18:50:32.043533+0000","last_became_peered":"2024-05-08T18:50:32.043533+0000","last_unstale":"2024-05-08T18:54:11.115165+0000","last_undegraded":"2024-05-08T18:54:11.115165+0000","last_fullsized":"2024-05-08T18:54:11.115165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'87","last_scrub_stamp":"2024-05-08T18:54:11.115039+0000","last_deep_scrub":"27'87","last_deep_scrub_stamp":"2024-05-08T18:54:11.115039+0000","last_clean_scrub_stamp":"2024-05-08T18:54:11.115039+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:20.191974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.995677+0000","last_change":"2024-05-08T18:53:58.995677+0000","last_active":"2024-05-08T18:53:58.995677+0000","last_peered":"2024-05-08T18:53:58.995677+0000","last_clean":"2024-05-08T18:53:58.995677+0000","last_became_active":"2024-05-08T18:50:34.048859+0000","last_became_peered":"2024-05-08T18:50:34.048859+0000","last_unstale":"2024-05-08T18:53:58.995677+0000","last_undegraded":"2024-05-08T18:53:58.995677+0000","last_fullsized":"2024-05-08T18:53:58.995677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:58.995550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:58.995550+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.995550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:54.841405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"27'81","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:03.892330+0000","last_change":"2024-05-08T18:54:03.892330+0000","last_active":"2024-05-08T18:54:03.892330+0000","last_peered":"2024-05-08T18:54:03.892330+0000","last_clean":"2024-05-08T18:54:03.892330+0000","last_became_active":"2024-05-08T18:50:36.044928+0000","last_became_peered":"2024-05-08T18:50:36.044928+0000","last_unstale":"2024-05-08T18:54:03.892330+0000","last_undegraded":"2024-05-08T18:54:03.892330+0000","last_fullsized":"2024-05-08T18:54:03.892330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'81","last_scrub_stamp":"2024-05-08T18:54:03.892165+0000","last_deep_scrub":"27'81","last_deep_scrub_stamp":"2024-05-08T18:54:03.892165+0000","last_clean_scrub_stamp":"2024-05-08T18:54:03.892165+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:34:05.874137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"27'4","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:27.108387+0000","last_change":"2024-05-08T18:54:27.108387+0000","last_active":"2024-05-08T18:54:27.108387+0000","last_peered":"2024-05-08T18:54:27.108387+0000","last_clean":"2024-05-08T18:54:27.108387+0000","last_became_active":"2024-05-08T18:50:28.030761+0000","last_became_peered":"2024-05-08T18:50:28.030761+0000","last_unstale":"2024-05-08T18:54:27.108387+0000","last_undegraded":"2024-05-08T18:54:27.108387+0000","last_fullsized":"2024-05-08T18:54:27.108387+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:27.108273+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:27.108273+0000","last_clean_scrub_stamp":"2024-05-08T18:54:27.108273+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:08.292247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:53.933192+0000","last_change":"2024-05-08T18:54:53.933216+0000","last_active":"2024-05-08T18:54:53.933192+0000","last_peered":"2024-05-08T18:54:53.933192+0000","last_clean":"2024-05-08T18:54:53.933192+0000","last_became_active":"2024-05-08T18:50:19.738872+0000","last_became_peered":"2024-05-08T18:50:19.738872+0000","last_unstale":"2024-05-08T18:54:53.933192+0000","last_undegraded":"2024-05-08T18:54:53.933192+0000","last_fullsized":"2024-05-08T18:54:53.933192+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:53.933052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:53.933052+0000","last_clean_scrub_stamp":"2024-05-08T18:54:53.933052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:38:37.063625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:39.101053+0000","last_change":"2024-05-08T18:54:39.101078+0000","last_active":"2024-05-08T18:54:39.101053+0000","last_peered":"2024-05-08T18:54:39.101053+0000","last_clean":"2024-05-08T18:54:39.101053+0000","last_became_active":"2024-05-08T18:50:26.024549+0000","last_became_peered":"2024-05-08T18:50:26.024549+0000","last_unstale":"2024-05-08T18:54:39.101053+0000","last_undegraded":"2024-05-08T18:54:39.101053+0000","last_fullsized":"2024-05-08T18:54:39.101053+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:39.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:39.100939+0000","last_clean_scrub_stamp":"2024-05-08T18:54:39.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:34:28.445091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.862858+0000","last_change":"2024-05-08T18:51:15.084930+0000","last_active":"2024-05-08T18:53:45.862858+0000","last_peered":"2024-05-08T18:53:45.862858+0000","last_clean":"2024-05-08T18:53:45.862858+0000","last_became_active":"2024-05-08T18:51:15.084599+0000","last_became_peered":"2024-05-08T18:51:15.084599+0000","last_unstale":"2024-05-08T18:53:45.862858+0000","last_undegraded":"2024-05-08T18:53:45.862858+0000","last_fullsized":"2024-05-08T18:53:45.862858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:29.009777+0000","last_clean_scrub_stamp":"2024-05-08T18:50:29.009777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"27'290","reported_seq":516,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:47.103048+0000","last_change":"2024-05-08T18:53:47.103048+0000","last_active":"2024-05-08T18:53:47.103048+0000","last_peered":"2024-05-08T18:53:47.103048+0000","last_clean":"2024-05-08T18:53:47.103048+0000","last_became_active":"2024-05-08T18:50:32.044539+0000","last_became_peered":"2024-05-08T18:50:32.044539+0000","last_unstale":"2024-05-08T18:53:47.103048+0000","last_undegraded":"2024-05-08T18:53:47.103048+0000","last_fullsized":"2024-05-08T18:53:47.103048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'290","last_scrub_stamp":"2024-05-08T18:53:47.102914+0000","last_deep_scrub":"27'290","last_deep_scrub_stamp":"2024-05-08T18:53:47.102914+0000","last_clean_scrub_stamp":"2024-05-08T18:53:47.102914+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:52.308821+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:07.076608+0000","last_change":"2024-05-08T18:54:07.076608+0000","last_active":"2024-05-08T18:54:07.076608+0000","last_peered":"2024-05-08T18:54:07.076608+0000","last_clean":"2024-05-08T18:54:07.076608+0000","last_became_active":"2024-05-08T18:50:34.043966+0000","last_became_peered":"2024-05-08T18:50:34.043966+0000","last_unstale":"2024-05-08T18:54:07.076608+0000","last_undegraded":"2024-05-08T18:54:07.076608+0000","last_fullsized":"2024-05-08T18:54:07.076608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:07.076486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:07.076486+0000","last_clean_scrub_stamp":"2024-05-08T18:54:07.076486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:33.765444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"27'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:07.937032+0000","last_change":"2024-05-08T18:54:07.937032+0000","last_active":"2024-05-08T18:54:07.937032+0000","last_peered":"2024-05-08T18:54:07.937032+0000","last_clean":"2024-05-08T18:54:07.937032+0000","last_became_active":"2024-05-08T18:50:36.050573+0000","last_became_peered":"2024-05-08T18:50:36.050573+0000","last_unstale":"2024-05-08T18:54:07.937032+0000","last_undegraded":"2024-05-08T18:54:07.937032+0000","last_fullsized":"2024-05-08T18:54:07.937032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-08T18:54:07.936918+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-08T18:54:07.936918+0000","last_clean_scrub_stamp":"2024-05-08T18:54:07.936918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:16.706139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'4","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:16.165554+0000","last_change":"2024-05-08T18:54:16.165554+0000","last_active":"2024-05-08T18:54:16.165554+0000","last_peered":"2024-05-08T18:54:16.165554+0000","last_clean":"2024-05-08T18:54:16.165554+0000","last_became_active":"2024-05-08T18:50:28.027492+0000","last_became_peered":"2024-05-08T18:50:28.027492+0000","last_unstale":"2024-05-08T18:54:16.165554+0000","last_undegraded":"2024-05-08T18:54:16.165554+0000","last_fullsized":"2024-05-08T18:54:16.165554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:16.165359+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:16.165359+0000","last_clean_scrub_stamp":"2024-05-08T18:54:16.165359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:48.442797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:25.899694+0000","last_change":"2024-05-08T18:54:25.899694+0000","last_active":"2024-05-08T18:54:25.899694+0000","last_peered":"2024-05-08T18:54:25.899694+0000","last_clean":"2024-05-08T18:54:25.899694+0000","last_became_active":"2024-05-08T18:50:19.738788+0000","last_became_peered":"2024-05-08T18:50:19.738788+0000","last_unstale":"2024-05-08T18:54:25.899694+0000","last_undegraded":"2024-05-08T18:54:25.899694+0000","last_fullsized":"2024-05-08T18:54:25.899694+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:25.899584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:25.899584+0000","last_clean_scrub_stamp":"2024-05-08T18:54:25.899584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:28.185977+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'4","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:20.096976+0000","last_change":"2024-05-08T18:54:20.096976+0000","last_active":"2024-05-08T18:54:20.096976+0000","last_peered":"2024-05-08T18:54:20.096976+0000","last_clean":"2024-05-08T18:54:20.096976+0000","last_became_active":"2024-05-08T18:50:26.029197+0000","last_became_peered":"2024-05-08T18:50:26.029197+0000","last_unstale":"2024-05-08T18:54:20.096976+0000","last_undegraded":"2024-05-08T18:54:20.096976+0000","last_fullsized":"2024-05-08T18:54:20.096976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-08T18:54:20.096851+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-08T18:54:20.096851+0000","last_clean_scrub_stamp":"2024-05-08T18:54:20.096851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:32.841665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:04.894272+0000","last_change":"2024-05-08T18:54:04.894272+0000","last_active":"2024-05-08T18:54:04.894272+0000","last_peered":"2024-05-08T18:54:04.894272+0000","last_clean":"2024-05-08T18:54:04.894272+0000","last_became_active":"2024-05-08T18:50:30.028028+0000","last_became_peered":"2024-05-08T18:50:30.028028+0000","last_unstale":"2024-05-08T18:54:04.894272+0000","last_undegraded":"2024-05-08T18:54:04.894272+0000","last_fullsized":"2024-05-08T18:54:04.894272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:04.894146+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:04.894146+0000","last_clean_scrub_stamp":"2024-05-08T18:54:04.894146+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:10.950542+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"27'23","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:56.984125+0000","last_change":"2024-05-08T18:53:56.984125+0000","last_active":"2024-05-08T18:53:56.984125+0000","last_peered":"2024-05-08T18:53:56.984125+0000","last_clean":"2024-05-08T18:53:56.984125+0000","last_became_active":"2024-05-08T18:50:32.036051+0000","last_became_peered":"2024-05-08T18:50:32.036051+0000","last_unstale":"2024-05-08T18:53:56.984125+0000","last_undegraded":"2024-05-08T18:53:56.984125+0000","last_fullsized":"2024-05-08T18:53:56.984125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-05-08T18:53:56.983946+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-05-08T18:53:56.983946+0000","last_clean_scrub_stamp":"2024-05-08T18:53:56.983946+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:47.425987+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.955616+0000","last_change":"2024-05-08T18:53:45.955616+0000","last_active":"2024-05-08T18:53:45.955616+0000","last_peered":"2024-05-08T18:53:45.955616+0000","last_clean":"2024-05-08T18:53:45.955616+0000","last_became_active":"2024-05-08T18:50:34.045541+0000","last_became_peered":"2024-05-08T18:50:34.045541+0000","last_unstale":"2024-05-08T18:53:45.955616+0000","last_undegraded":"2024-05-08T18:53:45.955616+0000","last_fullsized":"2024-05-08T18:53:45.955616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:45.955524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:45.955524+0000","last_clean_scrub_stamp":"2024-05-08T18:53:45.955524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:07.055678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:52:53.008500+0000","last_change":"2024-05-08T18:50:36.058086+0000","last_active":"2024-05-08T18:52:53.008500+0000","last_peered":"2024-05-08T18:52:53.008500+0000","last_clean":"2024-05-08T18:52:53.008500+0000","last_became_active":"2024-05-08T18:50:36.057093+0000","last_became_peered":"2024-05-08T18:50:36.057093+0000","last_unstale":"2024-05-08T18:52:53.008500+0000","last_undegraded":"2024-05-08T18:52:53.008500+0000","last_fullsized":"2024-05-08T18:52:53.008500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'22","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:29.058250+0000","last_change":"2024-05-08T18:54:29.058250+0000","last_active":"2024-05-08T18:54:29.058250+0000","last_peered":"2024-05-08T18:54:29.058250+0000","last_clean":"2024-05-08T18:54:29.058250+0000","last_became_active":"2024-05-08T18:50:28.025645+0000","last_became_peered":"2024-05-08T18:50:28.025645+0000","last_unstale":"2024-05-08T18:54:29.058250+0000","last_undegraded":"2024-05-08T18:54:29.058250+0000","last_fullsized":"2024-05-08T18:54:29.058250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-05-08T18:54:29.058118+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-05-08T18:54:29.058118+0000","last_clean_scrub_stamp":"2024-05-08T18:54:29.058118+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:43.432282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:56.927057+0000","last_change":"2024-05-08T18:54:56.927078+0000","last_active":"2024-05-08T18:54:56.927057+0000","last_peered":"2024-05-08T18:54:56.927057+0000","last_clean":"2024-05-08T18:54:56.927057+0000","last_became_active":"2024-05-08T18:50:19.739620+0000","last_became_peered":"2024-05-08T18:50:19.739620+0000","last_unstale":"2024-05-08T18:54:56.927057+0000","last_undegraded":"2024-05-08T18:54:56.927057+0000","last_fullsized":"2024-05-08T18:54:56.927057+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:56.926965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:56.926965+0000","last_clean_scrub_stamp":"2024-05-08T18:54:56.926965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:52.673639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:29.908194+0000","last_change":"2024-05-08T18:54:29.908194+0000","last_active":"2024-05-08T18:54:29.908194+0000","last_peered":"2024-05-08T18:54:29.908194+0000","last_clean":"2024-05-08T18:54:29.908194+0000","last_became_active":"2024-05-08T18:50:26.023522+0000","last_became_peered":"2024-05-08T18:50:26.023522+0000","last_unstale":"2024-05-08T18:54:29.908194+0000","last_undegraded":"2024-05-08T18:54:29.908194+0000","last_fullsized":"2024-05-08T18:54:29.908194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:29.908070+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:29.908070+0000","last_clean_scrub_stamp":"2024-05-08T18:54:29.908070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:56.597028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:02.050063+0000","last_change":"2024-05-08T18:54:02.050063+0000","last_active":"2024-05-08T18:54:02.050063+0000","last_peered":"2024-05-08T18:54:02.050063+0000","last_clean":"2024-05-08T18:54:02.050063+0000","last_became_active":"2024-05-08T18:50:30.034806+0000","last_became_peered":"2024-05-08T18:50:30.034806+0000","last_unstale":"2024-05-08T18:54:02.050063+0000","last_undegraded":"2024-05-08T18:54:02.050063+0000","last_fullsized":"2024-05-08T18:54:02.050063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:02.049920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:02.049920+0000","last_clean_scrub_stamp":"2024-05-08T18:54:02.049920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:23.760745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"27'20","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:14.126033+0000","last_change":"2024-05-08T18:54:14.126033+0000","last_active":"2024-05-08T18:54:14.126033+0000","last_peered":"2024-05-08T18:54:14.126033+0000","last_clean":"2024-05-08T18:54:14.126033+0000","last_became_active":"2024-05-08T18:50:32.042183+0000","last_became_peered":"2024-05-08T18:50:32.042183+0000","last_unstale":"2024-05-08T18:54:14.126033+0000","last_undegraded":"2024-05-08T18:54:14.126033+0000","last_fullsized":"2024-05-08T18:54:14.126033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-05-08T18:54:14.125910+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-05-08T18:54:14.125910+0000","last_clean_scrub_stamp":"2024-05-08T18:54:14.125910+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:13.974588+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:08.066476+0000","last_change":"2024-05-08T18:54:08.066476+0000","last_active":"2024-05-08T18:54:08.066476+0000","last_peered":"2024-05-08T18:54:08.066476+0000","last_clean":"2024-05-08T18:54:08.066476+0000","last_became_active":"2024-05-08T18:50:34.044358+0000","last_became_peered":"2024-05-08T18:50:34.044358+0000","last_unstale":"2024-05-08T18:54:08.066476+0000","last_undegraded":"2024-05-08T18:54:08.066476+0000","last_fullsized":"2024-05-08T18:54:08.066476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:08.066352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:08.066352+0000","last_clean_scrub_stamp":"2024-05-08T18:54:08.066352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:30:11.214559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:42.847487+0000","last_change":"2024-05-08T18:54:42.847487+0000","last_active":"2024-05-08T18:54:42.847487+0000","last_peered":"2024-05-08T18:54:42.847487+0000","last_clean":"2024-05-08T18:54:42.847487+0000","last_became_active":"2024-05-08T18:50:36.058267+0000","last_became_peered":"2024-05-08T18:50:36.058267+0000","last_unstale":"2024-05-08T18:54:42.847487+0000","last_undegraded":"2024-05-08T18:54:42.847487+0000","last_fullsized":"2024-05-08T18:54:42.847487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:42.847331+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:42.847331+0000","last_clean_scrub_stamp":"2024-05-08T18:54:42.847331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:24.031305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'12","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:06.982247+0000","last_change":"2024-05-08T18:54:06.982247+0000","last_active":"2024-05-08T18:54:06.982247+0000","last_peered":"2024-05-08T18:54:06.982247+0000","last_clean":"2024-05-08T18:54:06.982247+0000","last_became_active":"2024-05-08T18:50:28.038935+0000","last_became_peered":"2024-05-08T18:50:28.038935+0000","last_unstale":"2024-05-08T18:54:06.982247+0000","last_undegraded":"2024-05-08T18:54:06.982247+0000","last_fullsized":"2024-05-08T18:54:06.982247+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-08T18:54:06.982117+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-08T18:54:06.982117+0000","last_clean_scrub_stamp":"2024-05-08T18:54:06.982117+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:58.509084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:27.936358+0000","last_change":"2024-05-08T18:54:27.936358+0000","last_active":"2024-05-08T18:54:27.936358+0000","last_peered":"2024-05-08T18:54:27.936358+0000","last_clean":"2024-05-08T18:54:27.936358+0000","last_became_active":"2024-05-08T18:50:26.018739+0000","last_became_peered":"2024-05-08T18:50:26.018739+0000","last_unstale":"2024-05-08T18:54:27.936358+0000","last_undegraded":"2024-05-08T18:54:27.936358+0000","last_fullsized":"2024-05-08T18:54:27.936358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:27.936220+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:27.936220+0000","last_clean_scrub_stamp":"2024-05-08T18:54:27.936220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:05.501650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:34.053283+0000","last_change":"2024-05-08T18:54:34.053307+0000","last_active":"2024-05-08T18:54:34.053283+0000","last_peered":"2024-05-08T18:54:34.053283+0000","last_clean":"2024-05-08T18:54:34.053283+0000","last_became_active":"2024-05-08T18:50:19.740835+0000","last_became_peered":"2024-05-08T18:50:19.740835+0000","last_unstale":"2024-05-08T18:54:34.053283+0000","last_undegraded":"2024-05-08T18:54:34.053283+0000","last_fullsized":"2024-05-08T18:54:34.053283+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:34.053190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:34.053190+0000","last_clean_scrub_stamp":"2024-05-08T18:54:34.053190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:01.858524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"27'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:37.821248+0000","last_change":"2024-05-08T18:54:37.821275+0000","last_active":"2024-05-08T18:54:37.821248+0000","last_peered":"2024-05-08T18:54:37.821248+0000","last_clean":"2024-05-08T18:54:37.821248+0000","last_became_active":"2024-05-08T18:51:15.083141+0000","last_became_peered":"2024-05-08T18:51:15.083141+0000","last_unstale":"2024-05-08T18:54:37.821248+0000","last_undegraded":"2024-05-08T18:54:37.821248+0000","last_fullsized":"2024-05-08T18:54:37.821248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:37.821165+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:37.821165+0000","last_clean_scrub_stamp":"2024-05-08T18:54:37.821165+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:46.122851+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"27'73","reported_seq":150,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.986211+0000","last_change":"2024-05-08T18:53:53.986211+0000","last_active":"2024-05-08T18:53:53.986211+0000","last_peered":"2024-05-08T18:53:53.986211+0000","last_clean":"2024-05-08T18:53:53.986211+0000","last_became_active":"2024-05-08T18:50:32.042046+0000","last_became_peered":"2024-05-08T18:50:32.042046+0000","last_unstale":"2024-05-08T18:53:53.986211+0000","last_undegraded":"2024-05-08T18:53:53.986211+0000","last_fullsized":"2024-05-08T18:53:53.986211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'73","last_scrub_stamp":"2024-05-08T18:53:53.986057+0000","last_deep_scrub":"27'73","last_deep_scrub_stamp":"2024-05-08T18:53:53.986057+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.986057+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:48:15.967078+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:48.999132+0000","last_change":"2024-05-08T18:53:48.999132+0000","last_active":"2024-05-08T18:53:48.999132+0000","last_peered":"2024-05-08T18:53:48.999132+0000","last_clean":"2024-05-08T18:53:48.999132+0000","last_became_active":"2024-05-08T18:50:34.044520+0000","last_became_peered":"2024-05-08T18:50:34.044520+0000","last_unstale":"2024-05-08T18:53:48.999132+0000","last_undegraded":"2024-05-08T18:53:48.999132+0000","last_fullsized":"2024-05-08T18:53:48.999132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:48.999007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:48.999007+0000","last_clean_scrub_stamp":"2024-05-08T18:53:48.999007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:21.742255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"27'9","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:11.060309+0000","last_change":"2024-05-08T18:54:11.060343+0000","last_active":"2024-05-08T18:54:11.060309+0000","last_peered":"2024-05-08T18:54:11.060309+0000","last_clean":"2024-05-08T18:54:11.060309+0000","last_became_active":"2024-05-08T18:50:36.046757+0000","last_became_peered":"2024-05-08T18:50:36.046757+0000","last_unstale":"2024-05-08T18:54:11.060309+0000","last_undegraded":"2024-05-08T18:54:11.060309+0000","last_fullsized":"2024-05-08T18:54:11.060309+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-08T18:54:11.060217+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-08T18:54:11.060217+0000","last_clean_scrub_stamp":"2024-05-08T18:54:11.060217+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:57:58.583230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"27'10","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:39.798553+0000","last_change":"2024-05-08T18:54:39.798579+0000","last_active":"2024-05-08T18:54:39.798553+0000","last_peered":"2024-05-08T18:54:39.798553+0000","last_clean":"2024-05-08T18:54:39.798553+0000","last_became_active":"2024-05-08T18:51:15.084151+0000","last_became_peered":"2024-05-08T18:51:15.084151+0000","last_unstale":"2024-05-08T18:54:39.798553+0000","last_undegraded":"2024-05-08T18:54:39.798553+0000","last_fullsized":"2024-05-08T18:54:39.798553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:39.798463+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:39.798463+0000","last_clean_scrub_stamp":"2024-05-08T18:54:39.798463+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:54.076319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:30.043791+0000","last_change":"2024-05-08T18:54:30.043791+0000","last_active":"2024-05-08T18:54:30.043791+0000","last_peered":"2024-05-08T18:54:30.043791+0000","last_clean":"2024-05-08T18:54:30.043791+0000","last_became_active":"2024-05-08T18:50:26.024894+0000","last_became_peered":"2024-05-08T18:50:26.024894+0000","last_unstale":"2024-05-08T18:54:30.043791+0000","last_undegraded":"2024-05-08T18:54:30.043791+0000","last_fullsized":"2024-05-08T18:54:30.043791+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:30.043668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:30.043668+0000","last_clean_scrub_stamp":"2024-05-08T18:54:30.043668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:40:02.169764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:55.976538+0000","last_change":"2024-05-08T18:54:55.976563+0000","last_active":"2024-05-08T18:54:55.976538+0000","last_peered":"2024-05-08T18:54:55.976538+0000","last_clean":"2024-05-08T18:54:55.976538+0000","last_became_active":"2024-05-08T18:50:19.739124+0000","last_became_peered":"2024-05-08T18:50:19.739124+0000","last_unstale":"2024-05-08T18:54:55.976538+0000","last_undegraded":"2024-05-08T18:54:55.976538+0000","last_fullsized":"2024-05-08T18:54:55.976538+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:55.976431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:55.976431+0000","last_clean_scrub_stamp":"2024-05-08T18:54:55.976431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:09.917351+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:54.073547+0000","last_change":"2024-05-08T18:53:54.073547+0000","last_active":"2024-05-08T18:53:54.073547+0000","last_peered":"2024-05-08T18:53:54.073547+0000","last_clean":"2024-05-08T18:53:54.073547+0000","last_became_active":"2024-05-08T18:50:30.032546+0000","last_became_peered":"2024-05-08T18:50:30.032546+0000","last_unstale":"2024-05-08T18:53:54.073547+0000","last_undegraded":"2024-05-08T18:53:54.073547+0000","last_fullsized":"2024-05-08T18:53:54.073547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:54.073430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:54.073430+0000","last_clean_scrub_stamp":"2024-05-08T18:53:54.073430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:08.017553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"27'21","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:49.087885+0000","last_change":"2024-05-08T18:53:49.087885+0000","last_active":"2024-05-08T18:53:49.087885+0000","last_peered":"2024-05-08T18:53:49.087885+0000","last_clean":"2024-05-08T18:53:49.087885+0000","last_became_active":"2024-05-08T18:50:32.040767+0000","last_became_peered":"2024-05-08T18:50:32.040767+0000","last_unstale":"2024-05-08T18:53:49.087885+0000","last_undegraded":"2024-05-08T18:53:49.087885+0000","last_fullsized":"2024-05-08T18:53:49.087885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-05-08T18:53:49.087754+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-05-08T18:53:49.087754+0000","last_clean_scrub_stamp":"2024-05-08T18:53:49.087754+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:00.700903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"27'285","reported_seq":387,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:48.068502+0000","last_change":"2024-05-08T18:53:48.068502+0000","last_active":"2024-05-08T18:53:48.068502+0000","last_peered":"2024-05-08T18:53:48.068502+0000","last_clean":"2024-05-08T18:53:48.068502+0000","last_became_active":"2024-05-08T18:50:34.043167+0000","last_became_peered":"2024-05-08T18:50:34.043167+0000","last_unstale":"2024-05-08T18:53:48.068502+0000","last_undegraded":"2024-05-08T18:53:48.068502+0000","last_fullsized":"2024-05-08T18:53:48.068502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:48.068390+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:48.068390+0000","last_clean_scrub_stamp":"2024-05-08T18:53:48.068390+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:09.168544+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.891908+0000","last_change":"2024-05-08T18:50:36.061014+0000","last_active":"2024-05-08T18:53:34.891908+0000","last_peered":"2024-05-08T18:53:34.891908+0000","last_clean":"2024-05-08T18:53:34.891908+0000","last_became_active":"2024-05-08T18:50:36.060727+0000","last_became_peered":"2024-05-08T18:50:36.060727+0000","last_unstale":"2024-05-08T18:53:34.891908+0000","last_undegraded":"2024-05-08T18:53:34.891908+0000","last_fullsized":"2024-05-08T18:53:34.891908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"27'22","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:38.804803+0000","last_change":"2024-05-08T18:54:38.804853+0000","last_active":"2024-05-08T18:54:38.804803+0000","last_peered":"2024-05-08T18:54:38.804803+0000","last_clean":"2024-05-08T18:54:38.804803+0000","last_became_active":"2024-05-08T18:51:15.083568+0000","last_became_peered":"2024-05-08T18:51:15.083568+0000","last_unstale":"2024-05-08T18:54:38.804803+0000","last_undegraded":"2024-05-08T18:54:38.804803+0000","last_fullsized":"2024-05-08T18:54:38.804803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-05-08T18:54:38.804700+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-05-08T18:54:38.804700+0000","last_clean_scrub_stamp":"2024-05-08T18:54:38.804700+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:37.707904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":68,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:52.933354+0000","last_change":"2024-05-08T18:54:52.933384+0000","last_active":"2024-05-08T18:54:52.933354+0000","last_peered":"2024-05-08T18:54:52.933354+0000","last_clean":"2024-05-08T18:54:52.933354+0000","last_became_active":"2024-05-08T18:50:26.016210+0000","last_became_peered":"2024-05-08T18:50:26.016210+0000","last_unstale":"2024-05-08T18:54:52.933354+0000","last_undegraded":"2024-05-08T18:54:52.933354+0000","last_fullsized":"2024-05-08T18:54:52.933354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:52.933260+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:52.933260+0000","last_clean_scrub_stamp":"2024-05-08T18:54:52.933260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:43.048061+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:33.035194+0000","last_change":"2024-05-08T18:54:33.035194+0000","last_active":"2024-05-08T18:54:33.035194+0000","last_peered":"2024-05-08T18:54:33.035194+0000","last_clean":"2024-05-08T18:54:33.035194+0000","last_became_active":"2024-05-08T18:50:19.740355+0000","last_became_peered":"2024-05-08T18:50:19.740355+0000","last_unstale":"2024-05-08T18:54:33.035194+0000","last_undegraded":"2024-05-08T18:54:33.035194+0000","last_fullsized":"2024-05-08T18:54:33.035194+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:33.035076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:33.035076+0000","last_clean_scrub_stamp":"2024-05-08T18:54:33.035076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:38.299918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.055060+0000","last_change":"2024-05-08T18:53:53.055060+0000","last_active":"2024-05-08T18:53:53.055060+0000","last_peered":"2024-05-08T18:53:53.055060+0000","last_clean":"2024-05-08T18:53:53.055060+0000","last_became_active":"2024-05-08T18:50:30.031351+0000","last_became_peered":"2024-05-08T18:50:30.031351+0000","last_unstale":"2024-05-08T18:53:53.055060+0000","last_undegraded":"2024-05-08T18:53:53.055060+0000","last_fullsized":"2024-05-08T18:53:53.055060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:53.054930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:53.054930+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.054930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:23.805172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'15","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:15.083821+0000","last_change":"2024-05-08T18:54:15.083821+0000","last_active":"2024-05-08T18:54:15.083821+0000","last_peered":"2024-05-08T18:54:15.083821+0000","last_clean":"2024-05-08T18:54:15.083821+0000","last_became_active":"2024-05-08T18:50:32.041231+0000","last_became_peered":"2024-05-08T18:50:32.041231+0000","last_unstale":"2024-05-08T18:54:15.083821+0000","last_undegraded":"2024-05-08T18:54:15.083821+0000","last_fullsized":"2024-05-08T18:54:15.083821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-08T18:54:15.083708+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-08T18:54:15.083708+0000","last_clean_scrub_stamp":"2024-05-08T18:54:15.083708+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:23.385394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"27'285","reported_seq":402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:50.993052+0000","last_change":"2024-05-08T18:53:50.993052+0000","last_active":"2024-05-08T18:53:50.993052+0000","last_peered":"2024-05-08T18:53:50.993052+0000","last_clean":"2024-05-08T18:53:50.993052+0000","last_became_active":"2024-05-08T18:50:34.047608+0000","last_became_peered":"2024-05-08T18:50:34.047608+0000","last_unstale":"2024-05-08T18:53:50.993052+0000","last_undegraded":"2024-05-08T18:53:50.993052+0000","last_fullsized":"2024-05-08T18:53:50.993052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:50.992925+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:50.992925+0000","last_clean_scrub_stamp":"2024-05-08T18:53:50.992925+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:17.318647+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"25'5","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:39.876432+0000","last_change":"2024-05-08T18:54:39.876473+0000","last_active":"2024-05-08T18:54:39.876432+0000","last_peered":"2024-05-08T18:54:39.876432+0000","last_clean":"2024-05-08T18:54:39.876432+0000","last_became_active":"2024-05-08T18:50:36.054747+0000","last_became_peered":"2024-05-08T18:50:36.054747+0000","last_unstale":"2024-05-08T18:54:39.876432+0000","last_undegraded":"2024-05-08T18:54:39.876432+0000","last_fullsized":"2024-05-08T18:54:39.876432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-08T18:54:39.876310+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-08T18:54:39.876310+0000","last_clean_scrub_stamp":"2024-05-08T18:54:39.876310+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:20.489072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:21.941842+0000","last_change":"2024-05-08T18:54:21.941842+0000","last_active":"2024-05-08T18:54:21.941842+0000","last_peered":"2024-05-08T18:54:21.941842+0000","last_clean":"2024-05-08T18:54:21.941842+0000","last_became_active":"2024-05-08T18:50:28.033163+0000","last_became_peered":"2024-05-08T18:50:28.033163+0000","last_unstale":"2024-05-08T18:54:21.941842+0000","last_undegraded":"2024-05-08T18:54:21.941842+0000","last_fullsized":"2024-05-08T18:54:21.941842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:21.941726+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:21.941726+0000","last_clean_scrub_stamp":"2024-05-08T18:54:21.941726+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:33.131935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:35.794473+0000","last_change":"2024-05-08T18:54:35.794473+0000","last_active":"2024-05-08T18:54:35.794473+0000","last_peered":"2024-05-08T18:54:35.794473+0000","last_clean":"2024-05-08T18:54:35.794473+0000","last_became_active":"2024-05-08T18:50:26.026719+0000","last_became_peered":"2024-05-08T18:50:26.026719+0000","last_unstale":"2024-05-08T18:54:35.794473+0000","last_undegraded":"2024-05-08T18:54:35.794473+0000","last_fullsized":"2024-05-08T18:54:35.794473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:35.794356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:35.794356+0000","last_clean_scrub_stamp":"2024-05-08T18:54:35.794356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:32.011854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:54.960867+0000","last_change":"2024-05-08T18:54:54.960894+0000","last_active":"2024-05-08T18:54:54.960867+0000","last_peered":"2024-05-08T18:54:54.960867+0000","last_clean":"2024-05-08T18:54:54.960867+0000","last_became_active":"2024-05-08T18:50:19.738971+0000","last_became_peered":"2024-05-08T18:50:19.738971+0000","last_unstale":"2024-05-08T18:54:54.960867+0000","last_undegraded":"2024-05-08T18:54:54.960867+0000","last_fullsized":"2024-05-08T18:54:54.960867+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:54.960774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:54.960774+0000","last_clean_scrub_stamp":"2024-05-08T18:54:54.960774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:10.537541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:55.069024+0000","last_change":"2024-05-08T18:53:55.069024+0000","last_active":"2024-05-08T18:53:55.069024+0000","last_peered":"2024-05-08T18:53:55.069024+0000","last_clean":"2024-05-08T18:53:55.069024+0000","last_became_active":"2024-05-08T18:50:30.032197+0000","last_became_peered":"2024-05-08T18:50:30.032197+0000","last_unstale":"2024-05-08T18:53:55.069024+0000","last_undegraded":"2024-05-08T18:53:55.069024+0000","last_fullsized":"2024-05-08T18:53:55.069024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:55.068843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:55.068843+0000","last_clean_scrub_stamp":"2024-05-08T18:53:55.068843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:15.069363+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"27'96","reported_seq":190,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.979024+0000","last_change":"2024-05-08T18:53:53.979024+0000","last_active":"2024-05-08T18:53:53.979024+0000","last_peered":"2024-05-08T18:53:53.979024+0000","last_clean":"2024-05-08T18:53:53.979024+0000","last_became_active":"2024-05-08T18:50:32.043109+0000","last_became_peered":"2024-05-08T18:50:32.043109+0000","last_unstale":"2024-05-08T18:53:53.979024+0000","last_undegraded":"2024-05-08T18:53:53.979024+0000","last_fullsized":"2024-05-08T18:53:53.979024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'96","last_scrub_stamp":"2024-05-08T18:53:53.978862+0000","last_deep_scrub":"27'96","last_deep_scrub_stamp":"2024-05-08T18:53:53.978862+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.978862+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:02.797212+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:52.944818+0000","last_change":"2024-05-08T18:53:52.944818+0000","last_active":"2024-05-08T18:53:52.944818+0000","last_peered":"2024-05-08T18:53:52.944818+0000","last_clean":"2024-05-08T18:53:52.944818+0000","last_became_active":"2024-05-08T18:50:34.043495+0000","last_became_peered":"2024-05-08T18:50:34.043495+0000","last_unstale":"2024-05-08T18:53:52.944818+0000","last_undegraded":"2024-05-08T18:53:52.944818+0000","last_fullsized":"2024-05-08T18:53:52.944818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:52.944707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:52.944707+0000","last_clean_scrub_stamp":"2024-05-08T18:53:52.944707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:51.657538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:59.972475+0000","last_change":"2024-05-08T18:53:59.972499+0000","last_active":"2024-05-08T18:53:59.972475+0000","last_peered":"2024-05-08T18:53:59.972475+0000","last_clean":"2024-05-08T18:53:59.972475+0000","last_became_active":"2024-05-08T18:50:36.044491+0000","last_became_peered":"2024-05-08T18:50:36.044491+0000","last_unstale":"2024-05-08T18:53:59.972475+0000","last_undegraded":"2024-05-08T18:53:59.972475+0000","last_fullsized":"2024-05-08T18:53:59.972475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:53:59.972386+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:53:59.972386+0000","last_clean_scrub_stamp":"2024-05-08T18:53:59.972386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:29.340986+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:35.862452+0000","last_change":"2024-05-08T18:54:35.862452+0000","last_active":"2024-05-08T18:54:35.862452+0000","last_peered":"2024-05-08T18:54:35.862452+0000","last_clean":"2024-05-08T18:54:35.862452+0000","last_became_active":"2024-05-08T18:50:36.050722+0000","last_became_peered":"2024-05-08T18:50:36.050722+0000","last_unstale":"2024-05-08T18:54:35.862452+0000","last_undegraded":"2024-05-08T18:54:35.862452+0000","last_fullsized":"2024-05-08T18:54:35.862452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:35.862340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:35.862340+0000","last_clean_scrub_stamp":"2024-05-08T18:54:35.862340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:40:20.606010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"27'10","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:17.952118+0000","last_change":"2024-05-08T18:54:17.952151+0000","last_active":"2024-05-08T18:54:17.952118+0000","last_peered":"2024-05-08T18:54:17.952118+0000","last_clean":"2024-05-08T18:54:17.952118+0000","last_became_active":"2024-05-08T18:50:28.033010+0000","last_became_peered":"2024-05-08T18:50:28.033010+0000","last_unstale":"2024-05-08T18:54:17.952118+0000","last_undegraded":"2024-05-08T18:54:17.952118+0000","last_fullsized":"2024-05-08T18:54:17.952118+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:17.952018+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:17.952018+0000","last_clean_scrub_stamp":"2024-05-08T18:54:17.952018+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:37.952538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:55:01.915551+0000","last_change":"2024-05-08T18:55:01.915574+0000","last_active":"2024-05-08T18:55:01.915551+0000","last_peered":"2024-05-08T18:55:01.915551+0000","last_clean":"2024-05-08T18:55:01.915551+0000","last_became_active":"2024-05-08T18:50:26.025828+0000","last_became_peered":"2024-05-08T18:50:26.025828+0000","last_unstale":"2024-05-08T18:55:01.915551+0000","last_undegraded":"2024-05-08T18:55:01.915551+0000","last_fullsized":"2024-05-08T18:55:01.915551+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:55:01.915463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:55:01.915463+0000","last_clean_scrub_stamp":"2024-05-08T18:55:01.915463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:31.237891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:43.813650+0000","last_change":"2024-05-08T18:54:43.813690+0000","last_active":"2024-05-08T18:54:43.813650+0000","last_peered":"2024-05-08T18:54:43.813650+0000","last_clean":"2024-05-08T18:54:43.813650+0000","last_became_active":"2024-05-08T18:51:15.082590+0000","last_became_peered":"2024-05-08T18:51:15.082590+0000","last_unstale":"2024-05-08T18:54:43.813650+0000","last_undegraded":"2024-05-08T18:54:43.813650+0000","last_fullsized":"2024-05-08T18:54:43.813650+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:43.813554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:43.813554+0000","last_clean_scrub_stamp":"2024-05-08T18:54:43.813554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:33:00.368170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"27'40","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:50.089105+0000","last_change":"2024-05-08T18:53:50.089149+0000","last_active":"2024-05-08T18:53:50.089105+0000","last_peered":"2024-05-08T18:53:50.089105+0000","last_clean":"2024-05-08T18:53:50.089105+0000","last_became_active":"2024-05-08T18:50:32.038591+0000","last_became_peered":"2024-05-08T18:50:32.038591+0000","last_unstale":"2024-05-08T18:53:50.089105+0000","last_undegraded":"2024-05-08T18:53:50.089105+0000","last_fullsized":"2024-05-08T18:53:50.089105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-05-08T18:53:50.089008+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-05-08T18:53:50.089008+0000","last_clean_scrub_stamp":"2024-05-08T18:53:50.089008+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:59.963311+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:20.042995+0000","last_change":"2024-05-08T18:54:20.043031+0000","last_active":"2024-05-08T18:54:20.042995+0000","last_peered":"2024-05-08T18:54:20.042995+0000","last_clean":"2024-05-08T18:54:20.042995+0000","last_became_active":"2024-05-08T18:50:34.050749+0000","last_became_peered":"2024-05-08T18:50:34.050749+0000","last_unstale":"2024-05-08T18:54:20.042995+0000","last_undegraded":"2024-05-08T18:54:20.042995+0000","last_fullsized":"2024-05-08T18:54:20.042995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:20.042859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:20.042859+0000","last_clean_scrub_stamp":"2024-05-08T18:54:20.042859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:33.623374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"27'15","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:45.105436+0000","last_change":"2024-05-08T18:54:45.105461+0000","last_active":"2024-05-08T18:54:45.105436+0000","last_peered":"2024-05-08T18:54:45.105436+0000","last_clean":"2024-05-08T18:54:45.105436+0000","last_became_active":"2024-05-08T18:50:36.054102+0000","last_became_peered":"2024-05-08T18:50:36.054102+0000","last_unstale":"2024-05-08T18:54:45.105436+0000","last_undegraded":"2024-05-08T18:54:45.105436+0000","last_fullsized":"2024-05-08T18:54:45.105436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-08T18:54:45.105346+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-08T18:54:45.105346+0000","last_clean_scrub_stamp":"2024-05-08T18:54:45.105346+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:28.262580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"27'6","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:08.935691+0000","last_change":"2024-05-08T18:54:08.935717+0000","last_active":"2024-05-08T18:54:08.935691+0000","last_peered":"2024-05-08T18:54:08.935691+0000","last_clean":"2024-05-08T18:54:08.935691+0000","last_became_active":"2024-05-08T18:50:28.038587+0000","last_became_peered":"2024-05-08T18:50:28.038587+0000","last_unstale":"2024-05-08T18:54:08.935691+0000","last_undegraded":"2024-05-08T18:54:08.935691+0000","last_fullsized":"2024-05-08T18:54:08.935691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:08.935594+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:08.935594+0000","last_clean_scrub_stamp":"2024-05-08T18:54:08.935594+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:39.685836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:18.918416+0000","last_change":"2024-05-08T18:54:18.918440+0000","last_active":"2024-05-08T18:54:18.918416+0000","last_peered":"2024-05-08T18:54:18.918416+0000","last_clean":"2024-05-08T18:54:18.918416+0000","last_became_active":"2024-05-08T18:50:26.031509+0000","last_became_peered":"2024-05-08T18:50:26.031509+0000","last_unstale":"2024-05-08T18:54:18.918416+0000","last_undegraded":"2024-05-08T18:54:18.918416+0000","last_fullsized":"2024-05-08T18:54:18.918416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:18.918312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:18.918312+0000","last_clean_scrub_stamp":"2024-05-08T18:54:18.918312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:54.297707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:51.065753+0000","last_change":"2024-05-08T18:53:51.065788+0000","last_active":"2024-05-08T18:53:51.065753+0000","last_peered":"2024-05-08T18:53:51.065753+0000","last_clean":"2024-05-08T18:53:51.065753+0000","last_became_active":"2024-05-08T18:50:30.034178+0000","last_became_peered":"2024-05-08T18:50:30.034178+0000","last_unstale":"2024-05-08T18:53:51.065753+0000","last_undegraded":"2024-05-08T18:53:51.065753+0000","last_fullsized":"2024-05-08T18:53:51.065753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:51.065645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:51.065645+0000","last_clean_scrub_stamp":"2024-05-08T18:53:51.065645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:42.592612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'9","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:00.016731+0000","last_change":"2024-05-08T18:54:00.016762+0000","last_active":"2024-05-08T18:54:00.016731+0000","last_peered":"2024-05-08T18:54:00.016731+0000","last_clean":"2024-05-08T18:54:00.016731+0000","last_became_active":"2024-05-08T18:50:32.036371+0000","last_became_peered":"2024-05-08T18:50:32.036371+0000","last_unstale":"2024-05-08T18:54:00.016731+0000","last_undegraded":"2024-05-08T18:54:00.016731+0000","last_fullsized":"2024-05-08T18:54:00.016731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-08T18:54:00.016634+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-08T18:54:00.016634+0000","last_clean_scrub_stamp":"2024-05-08T18:54:00.016634+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:07.475619+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:52.036037+0000","last_change":"2024-05-08T18:53:52.036087+0000","last_active":"2024-05-08T18:53:52.036037+0000","last_peered":"2024-05-08T18:53:52.036037+0000","last_clean":"2024-05-08T18:53:52.036037+0000","last_became_active":"2024-05-08T18:50:34.048434+0000","last_became_peered":"2024-05-08T18:50:34.048434+0000","last_unstale":"2024-05-08T18:53:52.036037+0000","last_undegraded":"2024-05-08T18:53:52.036037+0000","last_fullsized":"2024-05-08T18:53:52.036037+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:52.035926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:52.035926+0000","last_clean_scrub_stamp":"2024-05-08T18:53:52.035926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:09.492022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:42.006706+0000","last_change":"2024-05-08T18:54:42.006750+0000","last_active":"2024-05-08T18:54:42.006706+0000","last_peered":"2024-05-08T18:54:42.006706+0000","last_clean":"2024-05-08T18:54:42.006706+0000","last_became_active":"2024-05-08T18:50:36.047379+0000","last_became_peered":"2024-05-08T18:50:36.047379+0000","last_unstale":"2024-05-08T18:54:42.006706+0000","last_undegraded":"2024-05-08T18:54:42.006706+0000","last_fullsized":"2024-05-08T18:54:42.006706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:42.006566+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:42.006566+0000","last_clean_scrub_stamp":"2024-05-08T18:54:42.006566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:59.612675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"27'6","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:19.140265+0000","last_change":"2024-05-08T18:54:19.140338+0000","last_active":"2024-05-08T18:54:19.140265+0000","last_peered":"2024-05-08T18:54:19.140265+0000","last_clean":"2024-05-08T18:54:19.140265+0000","last_became_active":"2024-05-08T18:50:28.022636+0000","last_became_peered":"2024-05-08T18:50:28.022636+0000","last_unstale":"2024-05-08T18:54:19.140265+0000","last_undegraded":"2024-05-08T18:54:19.140265+0000","last_fullsized":"2024-05-08T18:54:19.140265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:19.140160+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:19.140160+0000","last_clean_scrub_stamp":"2024-05-08T18:54:19.140160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:58:19.922822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"25'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:22.954334+0000","last_change":"2024-05-08T18:54:22.954361+0000","last_active":"2024-05-08T18:54:22.954334+0000","last_peered":"2024-05-08T18:54:22.954334+0000","last_clean":"2024-05-08T18:54:22.954334+0000","last_became_active":"2024-05-08T18:50:26.030884+0000","last_became_peered":"2024-05-08T18:50:26.030884+0000","last_unstale":"2024-05-08T18:54:22.954334+0000","last_undegraded":"2024-05-08T18:54:22.954334+0000","last_fullsized":"2024-05-08T18:54:22.954334+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:22.954247+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:22.954247+0000","last_clean_scrub_stamp":"2024-05-08T18:54:22.954247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:34.259820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:02.929650+0000","last_change":"2024-05-08T18:54:02.929688+0000","last_active":"2024-05-08T18:54:02.929650+0000","last_peered":"2024-05-08T18:54:02.929650+0000","last_clean":"2024-05-08T18:54:02.929650+0000","last_became_active":"2024-05-08T18:50:30.030773+0000","last_became_peered":"2024-05-08T18:50:30.030773+0000","last_unstale":"2024-05-08T18:54:02.929650+0000","last_undegraded":"2024-05-08T18:54:02.929650+0000","last_fullsized":"2024-05-08T18:54:02.929650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:02.929533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:02.929533+0000","last_clean_scrub_stamp":"2024-05-08T18:54:02.929533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:48:24.910553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"27'47","reported_seq":119,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:01.044939+0000","last_change":"2024-05-08T18:54:01.044974+0000","last_active":"2024-05-08T18:54:01.044939+0000","last_peered":"2024-05-08T18:54:01.044939+0000","last_clean":"2024-05-08T18:54:01.044939+0000","last_became_active":"2024-05-08T18:50:32.032289+0000","last_became_peered":"2024-05-08T18:50:32.032289+0000","last_unstale":"2024-05-08T18:54:01.044939+0000","last_undegraded":"2024-05-08T18:54:01.044939+0000","last_fullsized":"2024-05-08T18:54:01.044939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2024-05-08T18:54:01.044854+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2024-05-08T18:54:01.044854+0000","last_clean_scrub_stamp":"2024-05-08T18:54:01.044854+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:01.160239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.050696+0000","last_change":"2024-05-08T18:53:45.050721+0000","last_active":"2024-05-08T18:53:45.050696+0000","last_peered":"2024-05-08T18:53:45.050696+0000","last_clean":"2024-05-08T18:53:45.050696+0000","last_became_active":"2024-05-08T18:50:34.042903+0000","last_became_peered":"2024-05-08T18:50:34.042903+0000","last_unstale":"2024-05-08T18:53:45.050696+0000","last_undegraded":"2024-05-08T18:53:45.050696+0000","last_fullsized":"2024-05-08T18:53:45.050696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:45.050602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:45.050602+0000","last_clean_scrub_stamp":"2024-05-08T18:53:45.050602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:02.506698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:36.049041+0000","last_change":"2024-05-08T18:54:36.049066+0000","last_active":"2024-05-08T18:54:36.049041+0000","last_peered":"2024-05-08T18:54:36.049041+0000","last_clean":"2024-05-08T18:54:36.049041+0000","last_became_active":"2024-05-08T18:50:36.055855+0000","last_became_peered":"2024-05-08T18:50:36.055855+0000","last_unstale":"2024-05-08T18:54:36.049041+0000","last_undegraded":"2024-05-08T18:54:36.049041+0000","last_fullsized":"2024-05-08T18:54:36.049041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:36.048948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:36.048948+0000","last_clean_scrub_stamp":"2024-05-08T18:54:36.048948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:02.455091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"27'12","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:21.089048+0000","last_change":"2024-05-08T18:54:21.089082+0000","last_active":"2024-05-08T18:54:21.089048+0000","last_peered":"2024-05-08T18:54:21.089048+0000","last_clean":"2024-05-08T18:54:21.089048+0000","last_became_active":"2024-05-08T18:50:28.034819+0000","last_became_peered":"2024-05-08T18:50:28.034819+0000","last_unstale":"2024-05-08T18:54:21.089048+0000","last_undegraded":"2024-05-08T18:54:21.089048+0000","last_fullsized":"2024-05-08T18:54:21.089048+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-08T18:54:21.088960+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-08T18:54:21.088960+0000","last_clean_scrub_stamp":"2024-05-08T18:54:21.088960+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:41.111340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:28.703724+0000","last_change":"2024-05-08T18:54:28.703748+0000","last_active":"2024-05-08T18:54:28.703724+0000","last_peered":"2024-05-08T18:54:28.703724+0000","last_clean":"2024-05-08T18:54:28.703724+0000","last_became_active":"2024-05-08T18:50:26.029211+0000","last_became_peered":"2024-05-08T18:50:26.029211+0000","last_unstale":"2024-05-08T18:54:28.703724+0000","last_undegraded":"2024-05-08T18:54:28.703724+0000","last_fullsized":"2024-05-08T18:54:28.703724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:28.703639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:28.703639+0000","last_clean_scrub_stamp":"2024-05-08T18:54:28.703639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:39.823439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:57.055070+0000","last_change":"2024-05-08T18:53:57.055135+0000","last_active":"2024-05-08T18:53:57.055070+0000","last_peered":"2024-05-08T18:53:57.055070+0000","last_clean":"2024-05-08T18:53:57.055070+0000","last_became_active":"2024-05-08T18:50:30.031588+0000","last_became_peered":"2024-05-08T18:50:30.031588+0000","last_unstale":"2024-05-08T18:53:57.055070+0000","last_undegraded":"2024-05-08T18:53:57.055070+0000","last_fullsized":"2024-05-08T18:53:57.055070+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:57.054969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:57.054969+0000","last_clean_scrub_stamp":"2024-05-08T18:53:57.054969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:57:44.577983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"27'36","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:57.960934+0000","last_change":"2024-05-08T18:53:57.960966+0000","last_active":"2024-05-08T18:53:57.960934+0000","last_peered":"2024-05-08T18:53:57.960934+0000","last_clean":"2024-05-08T18:53:57.960934+0000","last_became_active":"2024-05-08T18:50:32.035181+0000","last_became_peered":"2024-05-08T18:50:32.035181+0000","last_unstale":"2024-05-08T18:53:57.960934+0000","last_undegraded":"2024-05-08T18:53:57.960934+0000","last_fullsized":"2024-05-08T18:53:57.960934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-05-08T18:53:57.960820+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-05-08T18:53:57.960820+0000","last_clean_scrub_stamp":"2024-05-08T18:53:57.960820+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:23.268890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:49.951155+0000","last_change":"2024-05-08T18:53:49.951177+0000","last_active":"2024-05-08T18:53:49.951155+0000","last_peered":"2024-05-08T18:53:49.951155+0000","last_clean":"2024-05-08T18:53:49.951155+0000","last_became_active":"2024-05-08T18:50:34.039668+0000","last_became_peered":"2024-05-08T18:50:34.039668+0000","last_unstale":"2024-05-08T18:53:49.951155+0000","last_undegraded":"2024-05-08T18:53:49.951155+0000","last_fullsized":"2024-05-08T18:53:49.951155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:49.951058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:49.951058+0000","last_clean_scrub_stamp":"2024-05-08T18:53:49.951058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:24.708273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:31.079781+0000","last_change":"2024-05-08T18:54:31.079781+0000","last_active":"2024-05-08T18:54:31.079781+0000","last_peered":"2024-05-08T18:54:31.079781+0000","last_clean":"2024-05-08T18:54:31.079781+0000","last_became_active":"2024-05-08T18:50:28.025862+0000","last_became_peered":"2024-05-08T18:50:28.025862+0000","last_unstale":"2024-05-08T18:54:31.079781+0000","last_undegraded":"2024-05-08T18:54:31.079781+0000","last_fullsized":"2024-05-08T18:54:31.079781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:31.079644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:31.079644+0000","last_clean_scrub_stamp":"2024-05-08T18:54:31.079644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:35.554801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:46.989834+0000","last_change":"2024-05-08T18:54:46.989856+0000","last_active":"2024-05-08T18:54:46.989834+0000","last_peered":"2024-05-08T18:54:46.989834+0000","last_clean":"2024-05-08T18:54:46.989834+0000","last_became_active":"2024-05-08T18:50:26.022874+0000","last_became_peered":"2024-05-08T18:50:26.022874+0000","last_unstale":"2024-05-08T18:54:46.989834+0000","last_undegraded":"2024-05-08T18:54:46.989834+0000","last_fullsized":"2024-05-08T18:54:46.989834+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:46.989745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:46.989745+0000","last_clean_scrub_stamp":"2024-05-08T18:54:46.989745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:06.061717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:08.022479+0000","last_change":"2024-05-08T18:54:08.022479+0000","last_active":"2024-05-08T18:54:08.022479+0000","last_peered":"2024-05-08T18:54:08.022479+0000","last_clean":"2024-05-08T18:54:08.022479+0000","last_became_active":"2024-05-08T18:50:30.029570+0000","last_became_peered":"2024-05-08T18:50:30.029570+0000","last_unstale":"2024-05-08T18:54:08.022479+0000","last_undegraded":"2024-05-08T18:54:08.022479+0000","last_fullsized":"2024-05-08T18:54:08.022479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:08.022348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:08.022348+0000","last_clean_scrub_stamp":"2024-05-08T18:54:08.022348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:31.732172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"27'65","reported_seq":138,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.032557+0000","last_change":"2024-05-08T18:53:58.032598+0000","last_active":"2024-05-08T18:53:58.032557+0000","last_peered":"2024-05-08T18:53:58.032557+0000","last_clean":"2024-05-08T18:53:58.032557+0000","last_became_active":"2024-05-08T18:50:32.039293+0000","last_became_peered":"2024-05-08T18:50:32.039293+0000","last_unstale":"2024-05-08T18:53:58.032557+0000","last_undegraded":"2024-05-08T18:53:58.032557+0000","last_fullsized":"2024-05-08T18:53:58.032557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'65","last_scrub_stamp":"2024-05-08T18:53:58.032459+0000","last_deep_scrub":"27'65","last_deep_scrub_stamp":"2024-05-08T18:53:58.032459+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.032459+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:46.844977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:46.910687+0000","last_change":"2024-05-08T18:53:46.910709+0000","last_active":"2024-05-08T18:53:46.910687+0000","last_peered":"2024-05-08T18:53:46.910687+0000","last_clean":"2024-05-08T18:53:46.910687+0000","last_became_active":"2024-05-08T18:50:34.047111+0000","last_became_peered":"2024-05-08T18:50:34.047111+0000","last_unstale":"2024-05-08T18:53:46.910687+0000","last_undegraded":"2024-05-08T18:53:46.910687+0000","last_fullsized":"2024-05-08T18:53:46.910687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:46.910595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:46.910595+0000","last_clean_scrub_stamp":"2024-05-08T18:53:46.910595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:27.588782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"27'14","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:15.117084+0000","last_change":"2024-05-08T18:54:15.117146+0000","last_active":"2024-05-08T18:54:15.117084+0000","last_peered":"2024-05-08T18:54:15.117084+0000","last_clean":"2024-05-08T18:54:15.117084+0000","last_became_active":"2024-05-08T18:50:36.046834+0000","last_became_peered":"2024-05-08T18:50:36.046834+0000","last_unstale":"2024-05-08T18:54:15.117084+0000","last_undegraded":"2024-05-08T18:54:15.117084+0000","last_fullsized":"2024-05-08T18:54:15.117084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-05-08T18:54:15.116980+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-05-08T18:54:15.116980+0000","last_clean_scrub_stamp":"2024-05-08T18:54:15.116980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:44.747454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'6","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:23.073696+0000","last_change":"2024-05-08T18:54:23.073696+0000","last_active":"2024-05-08T18:54:23.073696+0000","last_peered":"2024-05-08T18:54:23.073696+0000","last_clean":"2024-05-08T18:54:23.073696+0000","last_became_active":"2024-05-08T18:50:28.023049+0000","last_became_peered":"2024-05-08T18:50:28.023049+0000","last_unstale":"2024-05-08T18:54:23.073696+0000","last_undegraded":"2024-05-08T18:54:23.073696+0000","last_fullsized":"2024-05-08T18:54:23.073696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:23.073500+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:23.073500+0000","last_clean_scrub_stamp":"2024-05-08T18:54:23.073500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:09.762958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:26.777022+0000","last_change":"2024-05-08T18:54:26.777050+0000","last_active":"2024-05-08T18:54:26.777022+0000","last_peered":"2024-05-08T18:54:26.777022+0000","last_clean":"2024-05-08T18:54:26.777022+0000","last_became_active":"2024-05-08T18:50:26.029008+0000","last_became_peered":"2024-05-08T18:50:26.029008+0000","last_unstale":"2024-05-08T18:54:26.777022+0000","last_undegraded":"2024-05-08T18:54:26.777022+0000","last_fullsized":"2024-05-08T18:54:26.777022+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:26.776921+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:26.776921+0000","last_clean_scrub_stamp":"2024-05-08T18:54:26.776921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:29.496417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:05.886628+0000","last_change":"2024-05-08T18:54:05.886628+0000","last_active":"2024-05-08T18:54:05.886628+0000","last_peered":"2024-05-08T18:54:05.886628+0000","last_clean":"2024-05-08T18:54:05.886628+0000","last_became_active":"2024-05-08T18:50:30.026853+0000","last_became_peered":"2024-05-08T18:50:30.026853+0000","last_unstale":"2024-05-08T18:54:05.886628+0000","last_undegraded":"2024-05-08T18:54:05.886628+0000","last_fullsized":"2024-05-08T18:54:05.886628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:05.886508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:05.886508+0000","last_clean_scrub_stamp":"2024-05-08T18:54:05.886508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:58.280018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"27'45","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.018036+0000","last_change":"2024-05-08T18:53:58.018103+0000","last_active":"2024-05-08T18:53:58.018036+0000","last_peered":"2024-05-08T18:53:58.018036+0000","last_clean":"2024-05-08T18:53:58.018036+0000","last_became_active":"2024-05-08T18:50:32.041208+0000","last_became_peered":"2024-05-08T18:50:32.041208+0000","last_unstale":"2024-05-08T18:53:58.018036+0000","last_undegraded":"2024-05-08T18:53:58.018036+0000","last_fullsized":"2024-05-08T18:53:58.018036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-05-08T18:53:58.017901+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-05-08T18:53:58.017901+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.017901+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:24:08.011328+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:56.078504+0000","last_change":"2024-05-08T18:53:56.078528+0000","last_active":"2024-05-08T18:53:56.078504+0000","last_peered":"2024-05-08T18:53:56.078504+0000","last_clean":"2024-05-08T18:53:56.078504+0000","last_became_active":"2024-05-08T18:50:34.048749+0000","last_became_peered":"2024-05-08T18:50:34.048749+0000","last_unstale":"2024-05-08T18:53:56.078504+0000","last_undegraded":"2024-05-08T18:53:56.078504+0000","last_fullsized":"2024-05-08T18:53:56.078504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:56.078418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:56.078418+0000","last_clean_scrub_stamp":"2024-05-08T18:53:56.078418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:48:18.059438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:55:02.877454+0000","last_change":"2024-05-08T18:55:02.877478+0000","last_active":"2024-05-08T18:55:02.877454+0000","last_peered":"2024-05-08T18:55:02.877454+0000","last_clean":"2024-05-08T18:55:02.877454+0000","last_became_active":"2024-05-08T18:50:36.056960+0000","last_became_peered":"2024-05-08T18:50:36.056960+0000","last_unstale":"2024-05-08T18:55:02.877454+0000","last_undegraded":"2024-05-08T18:55:02.877454+0000","last_fullsized":"2024-05-08T18:55:02.877454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:55:02.877365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:55:02.877365+0000","last_clean_scrub_stamp":"2024-05-08T18:55:02.877365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:52:58.541728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"27'8","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:02.075651+0000","last_change":"2024-05-08T18:54:02.075677+0000","last_active":"2024-05-08T18:54:02.075651+0000","last_peered":"2024-05-08T18:54:02.075651+0000","last_clean":"2024-05-08T18:54:02.075651+0000","last_became_active":"2024-05-08T18:50:28.038364+0000","last_became_peered":"2024-05-08T18:50:28.038364+0000","last_unstale":"2024-05-08T18:54:02.075651+0000","last_undegraded":"2024-05-08T18:54:02.075651+0000","last_fullsized":"2024-05-08T18:54:02.075651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:02.075564+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:02.075564+0000","last_clean_scrub_stamp":"2024-05-08T18:54:02.075564+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:34.353002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'4","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:30.667850+0000","last_change":"2024-05-08T18:54:30.667876+0000","last_active":"2024-05-08T18:54:30.667850+0000","last_peered":"2024-05-08T18:54:30.667850+0000","last_clean":"2024-05-08T18:54:30.667850+0000","last_became_active":"2024-05-08T18:50:26.012506+0000","last_became_peered":"2024-05-08T18:50:26.012506+0000","last_unstale":"2024-05-08T18:54:30.667850+0000","last_undegraded":"2024-05-08T18:54:30.667850+0000","last_fullsized":"2024-05-08T18:54:30.667850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:30.667727+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:30.667727+0000","last_clean_scrub_stamp":"2024-05-08T18:54:30.667727+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:45.041891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:06.873106+0000","last_change":"2024-05-08T18:54:06.873131+0000","last_active":"2024-05-08T18:54:06.873106+0000","last_peered":"2024-05-08T18:54:06.873106+0000","last_clean":"2024-05-08T18:54:06.873106+0000","last_became_active":"2024-05-08T18:50:30.026445+0000","last_became_peered":"2024-05-08T18:50:30.026445+0000","last_unstale":"2024-05-08T18:54:06.873106+0000","last_undegraded":"2024-05-08T18:54:06.873106+0000","last_fullsized":"2024-05-08T18:54:06.873106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:06.873001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:06.873001+0000","last_clean_scrub_stamp":"2024-05-08T18:54:06.873001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:55.685519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"27'39","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:57.045805+0000","last_change":"2024-05-08T18:53:57.045805+0000","last_active":"2024-05-08T18:53:57.045805+0000","last_peered":"2024-05-08T18:53:57.045805+0000","last_clean":"2024-05-08T18:53:57.045805+0000","last_became_active":"2024-05-08T18:50:32.040745+0000","last_became_peered":"2024-05-08T18:50:32.040745+0000","last_unstale":"2024-05-08T18:53:57.045805+0000","last_undegraded":"2024-05-08T18:53:57.045805+0000","last_fullsized":"2024-05-08T18:53:57.045805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-05-08T18:53:57.045641+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-05-08T18:53:57.045641+0000","last_clean_scrub_stamp":"2024-05-08T18:53:57.045641+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:49.439151+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:46.999290+0000","last_change":"2024-05-08T18:53:46.999290+0000","last_active":"2024-05-08T18:53:46.999290+0000","last_peered":"2024-05-08T18:53:46.999290+0000","last_clean":"2024-05-08T18:53:46.999290+0000","last_became_active":"2024-05-08T18:50:34.047508+0000","last_became_peered":"2024-05-08T18:50:34.047508+0000","last_unstale":"2024-05-08T18:53:46.999290+0000","last_undegraded":"2024-05-08T18:53:46.999290+0000","last_fullsized":"2024-05-08T18:53:46.999290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:46.999168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:46.999168+0000","last_clean_scrub_stamp":"2024-05-08T18:53:46.999168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:21:10.901638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"27'9","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:34.610816+0000","last_change":"2024-05-08T18:50:36.058170+0000","last_active":"2024-05-08T18:53:34.610816+0000","last_peered":"2024-05-08T18:53:34.610816+0000","last_clean":"2024-05-08T18:53:34.610816+0000","last_became_active":"2024-05-08T18:50:36.057863+0000","last_became_peered":"2024-05-08T18:50:36.057863+0000","last_unstale":"2024-05-08T18:53:34.610816+0000","last_undegraded":"2024-05-08T18:53:34.610816+0000","last_fullsized":"2024-05-08T18:53:34.610816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"25'2","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:17.193780+0000","last_change":"2024-05-08T18:54:17.193805+0000","last_active":"2024-05-08T18:54:17.193780+0000","last_peered":"2024-05-08T18:54:17.193780+0000","last_clean":"2024-05-08T18:54:17.193780+0000","last_became_active":"2024-05-08T18:50:28.020441+0000","last_became_peered":"2024-05-08T18:50:28.020441+0000","last_unstale":"2024-05-08T18:54:17.193780+0000","last_undegraded":"2024-05-08T18:54:17.193780+0000","last_fullsized":"2024-05-08T18:54:17.193780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:17.193655+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:17.193655+0000","last_clean_scrub_stamp":"2024-05-08T18:54:17.193655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:19.480048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"25'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:39.101144+0000","last_change":"2024-05-08T18:54:39.101198+0000","last_active":"2024-05-08T18:54:39.101144+0000","last_peered":"2024-05-08T18:54:39.101144+0000","last_clean":"2024-05-08T18:54:39.101144+0000","last_became_active":"2024-05-08T18:50:26.024274+0000","last_became_peered":"2024-05-08T18:50:26.024274+0000","last_unstale":"2024-05-08T18:54:39.101144+0000","last_undegraded":"2024-05-08T18:54:39.101144+0000","last_fullsized":"2024-05-08T18:54:39.101144+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:39.101020+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:39.101020+0000","last_clean_scrub_stamp":"2024-05-08T18:54:39.101020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:40.877601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:01.042454+0000","last_change":"2024-05-08T18:54:01.042477+0000","last_active":"2024-05-08T18:54:01.042454+0000","last_peered":"2024-05-08T18:54:01.042454+0000","last_clean":"2024-05-08T18:54:01.042454+0000","last_became_active":"2024-05-08T18:50:30.028877+0000","last_became_peered":"2024-05-08T18:50:30.028877+0000","last_unstale":"2024-05-08T18:54:01.042454+0000","last_undegraded":"2024-05-08T18:54:01.042454+0000","last_fullsized":"2024-05-08T18:54:01.042454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:01.042364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:01.042364+0000","last_clean_scrub_stamp":"2024-05-08T18:54:01.042364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:56.888219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'15","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:17.120963+0000","last_change":"2024-05-08T18:54:17.120963+0000","last_active":"2024-05-08T18:54:17.120963+0000","last_peered":"2024-05-08T18:54:17.120963+0000","last_clean":"2024-05-08T18:54:17.120963+0000","last_became_active":"2024-05-08T18:50:32.041539+0000","last_became_peered":"2024-05-08T18:50:32.041539+0000","last_unstale":"2024-05-08T18:54:17.120963+0000","last_undegraded":"2024-05-08T18:54:17.120963+0000","last_fullsized":"2024-05-08T18:54:17.120963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-08T18:54:17.120821+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-08T18:54:17.120821+0000","last_clean_scrub_stamp":"2024-05-08T18:54:17.120821+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:31.398678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"27'285","reported_seq":419,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:47.959752+0000","last_change":"2024-05-08T18:53:47.959752+0000","last_active":"2024-05-08T18:53:47.959752+0000","last_peered":"2024-05-08T18:53:47.959752+0000","last_clean":"2024-05-08T18:53:47.959752+0000","last_became_active":"2024-05-08T18:50:34.048421+0000","last_became_peered":"2024-05-08T18:50:34.048421+0000","last_unstale":"2024-05-08T18:53:47.959752+0000","last_undegraded":"2024-05-08T18:53:47.959752+0000","last_fullsized":"2024-05-08T18:53:47.959752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:47.959631+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:47.959631+0000","last_clean_scrub_stamp":"2024-05-08T18:53:47.959631+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:52:13.795244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:32.125693+0000","last_change":"2024-05-08T18:54:32.125723+0000","last_active":"2024-05-08T18:54:32.125693+0000","last_peered":"2024-05-08T18:54:32.125693+0000","last_clean":"2024-05-08T18:54:32.125693+0000","last_became_active":"2024-05-08T18:50:36.055184+0000","last_became_peered":"2024-05-08T18:50:36.055184+0000","last_unstale":"2024-05-08T18:54:32.125693+0000","last_undegraded":"2024-05-08T18:54:32.125693+0000","last_fullsized":"2024-05-08T18:54:32.125693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-08T18:54:32.125611+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-08T18:54:32.125611+0000","last_clean_scrub_stamp":"2024-05-08T18:54:32.125611+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:20.547668+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:11.971785+0000","last_change":"2024-05-08T18:54:11.971848+0000","last_active":"2024-05-08T18:54:11.971785+0000","last_peered":"2024-05-08T18:54:11.971785+0000","last_clean":"2024-05-08T18:54:11.971785+0000","last_became_active":"2024-05-08T18:50:28.025313+0000","last_became_peered":"2024-05-08T18:50:28.025313+0000","last_unstale":"2024-05-08T18:54:11.971785+0000","last_undegraded":"2024-05-08T18:54:11.971785+0000","last_fullsized":"2024-05-08T18:54:11.971785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:11.971660+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:11.971660+0000","last_clean_scrub_stamp":"2024-05-08T18:54:11.971660+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:55.520240+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:24.786248+0000","last_change":"2024-05-08T18:54:24.786272+0000","last_active":"2024-05-08T18:54:24.786248+0000","last_peered":"2024-05-08T18:54:24.786248+0000","last_clean":"2024-05-08T18:54:24.786248+0000","last_became_active":"2024-05-08T18:50:26.030058+0000","last_became_peered":"2024-05-08T18:50:26.030058+0000","last_unstale":"2024-05-08T18:54:24.786248+0000","last_undegraded":"2024-05-08T18:54:24.786248+0000","last_fullsized":"2024-05-08T18:54:24.786248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:24.786142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:24.786142+0000","last_clean_scrub_stamp":"2024-05-08T18:54:24.786142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:14.186288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"27'2","reported_seq":230,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:03.029231+0000","last_change":"2024-05-08T18:54:03.029261+0000","last_active":"2024-05-08T18:54:03.029231+0000","last_peered":"2024-05-08T18:54:03.029231+0000","last_clean":"2024-05-08T18:54:03.029231+0000","last_became_active":"2024-05-08T18:50:30.024032+0000","last_became_peered":"2024-05-08T18:50:30.024032+0000","last_unstale":"2024-05-08T18:54:03.029231+0000","last_undegraded":"2024-05-08T18:54:03.029231+0000","last_fullsized":"2024-05-08T18:54:03.029231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:03.029144+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:03.029144+0000","last_clean_scrub_stamp":"2024-05-08T18:54:03.029144+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:03.144529+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"27'46","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:51.108219+0000","last_change":"2024-05-08T18:53:51.108258+0000","last_active":"2024-05-08T18:53:51.108219+0000","last_peered":"2024-05-08T18:53:51.108219+0000","last_clean":"2024-05-08T18:53:51.108219+0000","last_became_active":"2024-05-08T18:50:32.035792+0000","last_became_peered":"2024-05-08T18:50:32.035792+0000","last_unstale":"2024-05-08T18:53:51.108219+0000","last_undegraded":"2024-05-08T18:53:51.108219+0000","last_fullsized":"2024-05-08T18:53:51.108219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-05-08T18:53:51.108138+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-05-08T18:53:51.108138+0000","last_clean_scrub_stamp":"2024-05-08T18:53:51.108138+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:39.003860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:49.040915+0000","last_change":"2024-05-08T18:53:49.040955+0000","last_active":"2024-05-08T18:53:49.040915+0000","last_peered":"2024-05-08T18:53:49.040915+0000","last_clean":"2024-05-08T18:53:49.040915+0000","last_became_active":"2024-05-08T18:50:34.044586+0000","last_became_peered":"2024-05-08T18:50:34.044586+0000","last_unstale":"2024-05-08T18:53:49.040915+0000","last_undegraded":"2024-05-08T18:53:49.040915+0000","last_fullsized":"2024-05-08T18:53:49.040915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:49.040776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:49.040776+0000","last_clean_scrub_stamp":"2024-05-08T18:53:49.040776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:14.348846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"27'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:38.848199+0000","last_change":"2024-05-08T18:54:38.848225+0000","last_active":"2024-05-08T18:54:38.848199+0000","last_peered":"2024-05-08T18:54:38.848199+0000","last_clean":"2024-05-08T18:54:38.848199+0000","last_became_active":"2024-05-08T18:50:36.052885+0000","last_became_peered":"2024-05-08T18:50:36.052885+0000","last_unstale":"2024-05-08T18:54:38.848199+0000","last_undegraded":"2024-05-08T18:54:38.848199+0000","last_fullsized":"2024-05-08T18:54:38.848199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:38.848107+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:38.848107+0000","last_clean_scrub_stamp":"2024-05-08T18:54:38.848107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:16.741373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"27'28","reported_seq":123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:13.997393+0000","last_change":"2024-05-08T18:54:13.997440+0000","last_active":"2024-05-08T18:54:13.997393+0000","last_peered":"2024-05-08T18:54:13.997393+0000","last_clean":"2024-05-08T18:54:13.997393+0000","last_became_active":"2024-05-08T18:50:28.025162+0000","last_became_peered":"2024-05-08T18:50:28.025162+0000","last_unstale":"2024-05-08T18:54:13.997393+0000","last_undegraded":"2024-05-08T18:54:13.997393+0000","last_fullsized":"2024-05-08T18:54:13.997393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-05-08T18:54:13.997287+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-05-08T18:54:13.997287+0000","last_clean_scrub_stamp":"2024-05-08T18:54:13.997287+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:28:05.524254+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":112,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:37.042975+0000","last_change":"2024-05-08T18:54:37.042998+0000","last_active":"2024-05-08T18:54:37.042975+0000","last_peered":"2024-05-08T18:54:37.042975+0000","last_clean":"2024-05-08T18:54:37.042975+0000","last_became_active":"2024-05-08T18:50:26.027067+0000","last_became_peered":"2024-05-08T18:50:26.027067+0000","last_unstale":"2024-05-08T18:54:37.042975+0000","last_undegraded":"2024-05-08T18:54:37.042975+0000","last_fullsized":"2024-05-08T18:54:37.042975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:37.042885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:37.042885+0000","last_clean_scrub_stamp":"2024-05-08T18:54:37.042885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:44.061790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:00.968059+0000","last_change":"2024-05-08T18:54:00.968081+0000","last_active":"2024-05-08T18:54:00.968059+0000","last_peered":"2024-05-08T18:54:00.968059+0000","last_clean":"2024-05-08T18:54:00.968059+0000","last_became_active":"2024-05-08T18:50:30.034616+0000","last_became_peered":"2024-05-08T18:50:30.034616+0000","last_unstale":"2024-05-08T18:54:00.968059+0000","last_undegraded":"2024-05-08T18:54:00.968059+0000","last_fullsized":"2024-05-08T18:54:00.968059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:00.967968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:00.967968+0000","last_clean_scrub_stamp":"2024-05-08T18:54:00.967968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:09.724587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"27'38","reported_seq":93,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:56.013273+0000","last_change":"2024-05-08T18:53:56.013305+0000","last_active":"2024-05-08T18:53:56.013273+0000","last_peered":"2024-05-08T18:53:56.013273+0000","last_clean":"2024-05-08T18:53:56.013273+0000","last_became_active":"2024-05-08T18:50:32.041806+0000","last_became_peered":"2024-05-08T18:50:32.041806+0000","last_unstale":"2024-05-08T18:53:56.013273+0000","last_undegraded":"2024-05-08T18:53:56.013273+0000","last_fullsized":"2024-05-08T18:53:56.013273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2024-05-08T18:53:56.013183+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2024-05-08T18:53:56.013183+0000","last_clean_scrub_stamp":"2024-05-08T18:53:56.013183+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:02.069580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:16.072290+0000","last_change":"2024-05-08T18:54:16.072313+0000","last_active":"2024-05-08T18:54:16.072290+0000","last_peered":"2024-05-08T18:54:16.072290+0000","last_clean":"2024-05-08T18:54:16.072290+0000","last_became_active":"2024-05-08T18:50:34.050445+0000","last_became_peered":"2024-05-08T18:50:34.050445+0000","last_unstale":"2024-05-08T18:54:16.072290+0000","last_undegraded":"2024-05-08T18:54:16.072290+0000","last_fullsized":"2024-05-08T18:54:16.072290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:16.072191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:16.072191+0000","last_clean_scrub_stamp":"2024-05-08T18:54:16.072191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:14.975396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:03.010228+0000","last_change":"2024-05-08T18:50:36.060634+0000","last_active":"2024-05-08T18:53:03.010228+0000","last_peered":"2024-05-08T18:53:03.010228+0000","last_clean":"2024-05-08T18:53:03.010228+0000","last_became_active":"2024-05-08T18:50:36.060318+0000","last_became_peered":"2024-05-08T18:50:36.060318+0000","last_unstale":"2024-05-08T18:53:03.010228+0000","last_undegraded":"2024-05-08T18:53:03.010228+0000","last_fullsized":"2024-05-08T18:53:03.010228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'4","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:29.085988+0000","last_change":"2024-05-08T18:54:29.086012+0000","last_active":"2024-05-08T18:54:29.085988+0000","last_peered":"2024-05-08T18:54:29.085988+0000","last_clean":"2024-05-08T18:54:29.085988+0000","last_became_active":"2024-05-08T18:50:28.029624+0000","last_became_peered":"2024-05-08T18:50:28.029624+0000","last_unstale":"2024-05-08T18:54:29.085988+0000","last_undegraded":"2024-05-08T18:54:29.085988+0000","last_fullsized":"2024-05-08T18:54:29.085988+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:29.085887+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:29.085887+0000","last_clean_scrub_stamp":"2024-05-08T18:54:29.085887+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:18.818093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'4","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:28.018012+0000","last_change":"2024-05-08T18:54:28.018067+0000","last_active":"2024-05-08T18:54:28.018012+0000","last_peered":"2024-05-08T18:54:28.018012+0000","last_clean":"2024-05-08T18:54:28.018012+0000","last_became_active":"2024-05-08T18:50:26.028615+0000","last_became_peered":"2024-05-08T18:50:26.028615+0000","last_unstale":"2024-05-08T18:54:28.018012+0000","last_undegraded":"2024-05-08T18:54:28.018012+0000","last_fullsized":"2024-05-08T18:54:28.018012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:28.017906+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:28.017906+0000","last_clean_scrub_stamp":"2024-05-08T18:54:28.017906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:59.590604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.082251+0000","last_change":"2024-05-08T18:53:58.082277+0000","last_active":"2024-05-08T18:53:58.082251+0000","last_peered":"2024-05-08T18:53:58.082251+0000","last_clean":"2024-05-08T18:53:58.082251+0000","last_became_active":"2024-05-08T18:50:30.030295+0000","last_became_peered":"2024-05-08T18:50:30.030295+0000","last_unstale":"2024-05-08T18:53:58.082251+0000","last_undegraded":"2024-05-08T18:53:58.082251+0000","last_fullsized":"2024-05-08T18:53:58.082251+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:58.082158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:58.082158+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.082158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:04.138554+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"27'30","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:52.080875+0000","last_change":"2024-05-08T18:53:52.080925+0000","last_active":"2024-05-08T18:53:52.080875+0000","last_peered":"2024-05-08T18:53:52.080875+0000","last_clean":"2024-05-08T18:53:52.080875+0000","last_became_active":"2024-05-08T18:50:32.040661+0000","last_became_peered":"2024-05-08T18:50:32.040661+0000","last_unstale":"2024-05-08T18:53:52.080875+0000","last_undegraded":"2024-05-08T18:53:52.080875+0000","last_fullsized":"2024-05-08T18:53:52.080875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-05-08T18:53:52.080762+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-05-08T18:53:52.080762+0000","last_clean_scrub_stamp":"2024-05-08T18:53:52.080762+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:00.849983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:06.079512+0000","last_change":"2024-05-08T18:54:06.079537+0000","last_active":"2024-05-08T18:54:06.079512+0000","last_peered":"2024-05-08T18:54:06.079512+0000","last_clean":"2024-05-08T18:54:06.079512+0000","last_became_active":"2024-05-08T18:50:34.045040+0000","last_became_peered":"2024-05-08T18:50:34.045040+0000","last_unstale":"2024-05-08T18:54:06.079512+0000","last_undegraded":"2024-05-08T18:54:06.079512+0000","last_fullsized":"2024-05-08T18:54:06.079512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:06.079413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:06.079413+0000","last_clean_scrub_stamp":"2024-05-08T18:54:06.079413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:18.824227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:03.010192+0000","last_change":"2024-05-08T18:50:36.060675+0000","last_active":"2024-05-08T18:53:03.010192+0000","last_peered":"2024-05-08T18:53:03.010192+0000","last_clean":"2024-05-08T18:53:03.010192+0000","last_became_active":"2024-05-08T18:50:36.060382+0000","last_became_peered":"2024-05-08T18:50:36.060382+0000","last_unstale":"2024-05-08T18:53:03.010192+0000","last_undegraded":"2024-05-08T18:53:03.010192+0000","last_fullsized":"2024-05-08T18:53:03.010192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:50:35.031132+0000","last_clean_scrub_stamp":"2024-05-08T18:50:35.031132+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'12","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:09.881128+0000","last_change":"2024-05-08T18:54:09.881161+0000","last_active":"2024-05-08T18:54:09.881128+0000","last_peered":"2024-05-08T18:54:09.881128+0000","last_clean":"2024-05-08T18:54:09.881128+0000","last_became_active":"2024-05-08T18:50:28.020421+0000","last_became_peered":"2024-05-08T18:50:28.020421+0000","last_unstale":"2024-05-08T18:54:09.881128+0000","last_undegraded":"2024-05-08T18:54:09.881128+0000","last_fullsized":"2024-05-08T18:54:09.881128+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-08T18:54:09.881030+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-08T18:54:09.881030+0000","last_clean_scrub_stamp":"2024-05-08T18:54:09.881030+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:09.996415+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"27'4","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:31.701515+0000","last_change":"2024-05-08T18:54:31.701515+0000","last_active":"2024-05-08T18:54:31.701515+0000","last_peered":"2024-05-08T18:54:31.701515+0000","last_clean":"2024-05-08T18:54:31.701515+0000","last_became_active":"2024-05-08T18:50:26.011299+0000","last_became_peered":"2024-05-08T18:50:26.011299+0000","last_unstale":"2024-05-08T18:54:31.701515+0000","last_undegraded":"2024-05-08T18:54:31.701515+0000","last_fullsized":"2024-05-08T18:54:31.701515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:31.701395+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:31.701395+0000","last_clean_scrub_stamp":"2024-05-08T18:54:31.701395+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:30.604600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:55.127436+0000","last_change":"2024-05-08T18:53:55.127480+0000","last_active":"2024-05-08T18:53:55.127436+0000","last_peered":"2024-05-08T18:53:55.127436+0000","last_clean":"2024-05-08T18:53:55.127436+0000","last_became_active":"2024-05-08T18:50:30.032578+0000","last_became_peered":"2024-05-08T18:50:30.032578+0000","last_unstale":"2024-05-08T18:53:55.127436+0000","last_undegraded":"2024-05-08T18:53:55.127436+0000","last_fullsized":"2024-05-08T18:53:55.127436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-08T18:53:55.127322+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-08T18:53:55.127322+0000","last_clean_scrub_stamp":"2024-05-08T18:53:55.127322+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:53.840153+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"27'42","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:13.094540+0000","last_change":"2024-05-08T18:54:13.094581+0000","last_active":"2024-05-08T18:54:13.094540+0000","last_peered":"2024-05-08T18:54:13.094540+0000","last_clean":"2024-05-08T18:54:13.094540+0000","last_became_active":"2024-05-08T18:50:32.042700+0000","last_became_peered":"2024-05-08T18:50:32.042700+0000","last_unstale":"2024-05-08T18:54:13.094540+0000","last_undegraded":"2024-05-08T18:54:13.094540+0000","last_fullsized":"2024-05-08T18:54:13.094540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-05-08T18:54:13.094441+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-05-08T18:54:13.094441+0000","last_clean_scrub_stamp":"2024-05-08T18:54:13.094441+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:24.214241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":49,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:48.036967+0000","last_change":"2024-05-08T18:53:48.036991+0000","last_active":"2024-05-08T18:53:48.036967+0000","last_peered":"2024-05-08T18:53:48.036967+0000","last_clean":"2024-05-08T18:53:48.036967+0000","last_became_active":"2024-05-08T18:50:34.044872+0000","last_became_peered":"2024-05-08T18:50:34.044872+0000","last_unstale":"2024-05-08T18:53:48.036967+0000","last_undegraded":"2024-05-08T18:53:48.036967+0000","last_fullsized":"2024-05-08T18:53:48.036967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:48.036872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:48.036872+0000","last_clean_scrub_stamp":"2024-05-08T18:53:48.036872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:38.478912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"27'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:24.131032+0000","last_change":"2024-05-08T18:54:24.131083+0000","last_active":"2024-05-08T18:54:24.131032+0000","last_peered":"2024-05-08T18:54:24.131032+0000","last_clean":"2024-05-08T18:54:24.131032+0000","last_became_active":"2024-05-08T18:50:36.055188+0000","last_became_peered":"2024-05-08T18:50:36.055188+0000","last_unstale":"2024-05-08T18:54:24.131032+0000","last_undegraded":"2024-05-08T18:54:24.131032+0000","last_fullsized":"2024-05-08T18:54:24.131032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:24.130900+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:24.130900+0000","last_clean_scrub_stamp":"2024-05-08T18:54:24.130900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:04.743662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"27'12","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:04.981908+0000","last_change":"2024-05-08T18:54:04.981908+0000","last_active":"2024-05-08T18:54:04.981908+0000","last_peered":"2024-05-08T18:54:04.981908+0000","last_clean":"2024-05-08T18:54:04.981908+0000","last_became_active":"2024-05-08T18:50:28.039290+0000","last_became_peered":"2024-05-08T18:50:28.039290+0000","last_unstale":"2024-05-08T18:54:04.981908+0000","last_undegraded":"2024-05-08T18:54:04.981908+0000","last_fullsized":"2024-05-08T18:54:04.981908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-08T18:54:04.981738+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-08T18:54:04.981738+0000","last_clean_scrub_stamp":"2024-05-08T18:54:04.981738+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:48.530318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"27'3","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:26.928401+0000","last_change":"2024-05-08T18:54:26.928401+0000","last_active":"2024-05-08T18:54:26.928401+0000","last_peered":"2024-05-08T18:54:26.928401+0000","last_clean":"2024-05-08T18:54:26.928401+0000","last_became_active":"2024-05-08T18:50:26.018713+0000","last_became_peered":"2024-05-08T18:50:26.018713+0000","last_unstale":"2024-05-08T18:54:26.928401+0000","last_undegraded":"2024-05-08T18:54:26.928401+0000","last_fullsized":"2024-05-08T18:54:26.928401+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-08T18:54:26.928285+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-08T18:54:26.928285+0000","last_clean_scrub_stamp":"2024-05-08T18:54:26.928285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:55.724493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"27'6","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:41.040093+0000","last_change":"2024-05-08T18:54:41.040093+0000","last_active":"2024-05-08T18:54:41.040093+0000","last_peered":"2024-05-08T18:54:41.040093+0000","last_clean":"2024-05-08T18:54:41.040093+0000","last_became_active":"2024-05-08T18:50:28.026292+0000","last_became_peered":"2024-05-08T18:50:28.026292+0000","last_unstale":"2024-05-08T18:54:41.040093+0000","last_undegraded":"2024-05-08T18:54:41.040093+0000","last_fullsized":"2024-05-08T18:54:41.040093+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:41.039929+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:41.039929+0000","last_clean_scrub_stamp":"2024-05-08T18:54:41.039929+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:43.220382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:35.034493+0000","last_change":"2024-05-08T18:54:35.034493+0000","last_active":"2024-05-08T18:54:35.034493+0000","last_peered":"2024-05-08T18:54:35.034493+0000","last_clean":"2024-05-08T18:54:35.034493+0000","last_became_active":"2024-05-08T18:50:26.012760+0000","last_became_peered":"2024-05-08T18:50:26.012760+0000","last_unstale":"2024-05-08T18:54:35.034493+0000","last_undegraded":"2024-05-08T18:54:35.034493+0000","last_fullsized":"2024-05-08T18:54:35.034493+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:35.034379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:35.034379+0000","last_clean_scrub_stamp":"2024-05-08T18:54:35.034379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:31.251876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'4","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.998059+0000","last_change":"2024-05-08T18:53:58.998059+0000","last_active":"2024-05-08T18:53:58.998059+0000","last_peered":"2024-05-08T18:53:58.998059+0000","last_clean":"2024-05-08T18:53:58.998059+0000","last_became_active":"2024-05-08T18:50:28.038785+0000","last_became_peered":"2024-05-08T18:50:28.038785+0000","last_unstale":"2024-05-08T18:53:58.998059+0000","last_undegraded":"2024-05-08T18:53:58.998059+0000","last_fullsized":"2024-05-08T18:53:58.998059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:53:58.997912+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:53:58.997912+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.997912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:10.188121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"25'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:51.930223+0000","last_change":"2024-05-08T18:54:51.930282+0000","last_active":"2024-05-08T18:54:51.930223+0000","last_peered":"2024-05-08T18:54:51.930223+0000","last_clean":"2024-05-08T18:54:51.930223+0000","last_became_active":"2024-05-08T18:50:26.025958+0000","last_became_peered":"2024-05-08T18:50:26.025958+0000","last_unstale":"2024-05-08T18:54:51.930223+0000","last_undegraded":"2024-05-08T18:54:51.930223+0000","last_fullsized":"2024-05-08T18:54:51.930223+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:51.930085+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:51.930085+0000","last_clean_scrub_stamp":"2024-05-08T18:54:51.930085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:59:57.395628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"27'6","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:31.048707+0000","last_change":"2024-05-08T18:54:31.048707+0000","last_active":"2024-05-08T18:54:31.048707+0000","last_peered":"2024-05-08T18:54:31.048707+0000","last_clean":"2024-05-08T18:54:31.048707+0000","last_became_active":"2024-05-08T18:50:28.025866+0000","last_became_peered":"2024-05-08T18:50:28.025866+0000","last_unstale":"2024-05-08T18:54:31.048707+0000","last_undegraded":"2024-05-08T18:54:31.048707+0000","last_fullsized":"2024-05-08T18:54:31.048707+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:31.048578+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:31.048578+0000","last_clean_scrub_stamp":"2024-05-08T18:54:31.048578+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:45.326435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:32.065937+0000","last_change":"2024-05-08T18:54:32.065937+0000","last_active":"2024-05-08T18:54:32.065937+0000","last_peered":"2024-05-08T18:54:32.065937+0000","last_clean":"2024-05-08T18:54:32.065937+0000","last_became_active":"2024-05-08T18:50:26.025120+0000","last_became_peered":"2024-05-08T18:50:26.025120+0000","last_unstale":"2024-05-08T18:54:32.065937+0000","last_undegraded":"2024-05-08T18:54:32.065937+0000","last_fullsized":"2024-05-08T18:54:32.065937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:32.065765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:32.065765+0000","last_clean_scrub_stamp":"2024-05-08T18:54:32.065765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:36.467184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"27'8","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:27.030393+0000","last_change":"2024-05-08T18:54:27.030393+0000","last_active":"2024-05-08T18:54:27.030393+0000","last_peered":"2024-05-08T18:54:27.030393+0000","last_clean":"2024-05-08T18:54:27.030393+0000","last_became_active":"2024-05-08T18:50:28.025098+0000","last_became_peered":"2024-05-08T18:50:28.025098+0000","last_unstale":"2024-05-08T18:54:27.030393+0000","last_undegraded":"2024-05-08T18:54:27.030393+0000","last_fullsized":"2024-05-08T18:54:27.030393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:27.030232+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:27.030232+0000","last_clean_scrub_stamp":"2024-05-08T18:54:27.030232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:38.150032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:37.058337+0000","last_change":"2024-05-08T18:54:37.058337+0000","last_active":"2024-05-08T18:54:37.058337+0000","last_peered":"2024-05-08T18:54:37.058337+0000","last_clean":"2024-05-08T18:54:37.058337+0000","last_became_active":"2024-05-08T18:50:26.014434+0000","last_became_peered":"2024-05-08T18:50:26.014434+0000","last_unstale":"2024-05-08T18:54:37.058337+0000","last_undegraded":"2024-05-08T18:54:37.058337+0000","last_fullsized":"2024-05-08T18:54:37.058337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:37.058211+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:37.058211+0000","last_clean_scrub_stamp":"2024-05-08T18:54:37.058211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:46.480736+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"27'10","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:10.981338+0000","last_change":"2024-05-08T18:54:10.981338+0000","last_active":"2024-05-08T18:54:10.981338+0000","last_peered":"2024-05-08T18:54:10.981338+0000","last_clean":"2024-05-08T18:54:10.981338+0000","last_became_active":"2024-05-08T18:50:28.037400+0000","last_became_peered":"2024-05-08T18:50:28.037400+0000","last_unstale":"2024-05-08T18:54:10.981338+0000","last_undegraded":"2024-05-08T18:54:10.981338+0000","last_fullsized":"2024-05-08T18:54:10.981338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:10.981224+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:10.981224+0000","last_clean_scrub_stamp":"2024-05-08T18:54:10.981224+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:30.981744+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"25'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:36.843406+0000","last_change":"2024-05-08T18:54:36.843406+0000","last_active":"2024-05-08T18:54:36.843406+0000","last_peered":"2024-05-08T18:54:36.843406+0000","last_clean":"2024-05-08T18:54:36.843406+0000","last_became_active":"2024-05-08T18:50:26.029047+0000","last_became_peered":"2024-05-08T18:50:26.029047+0000","last_unstale":"2024-05-08T18:54:36.843406+0000","last_undegraded":"2024-05-08T18:54:36.843406+0000","last_fullsized":"2024-05-08T18:54:36.843406+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:36.843271+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:36.843271+0000","last_clean_scrub_stamp":"2024-05-08T18:54:36.843271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:56.865651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"27'4","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:18.166245+0000","last_change":"2024-05-08T18:54:18.166245+0000","last_active":"2024-05-08T18:54:18.166245+0000","last_peered":"2024-05-08T18:54:18.166245+0000","last_clean":"2024-05-08T18:54:18.166245+0000","last_became_active":"2024-05-08T18:50:28.021140+0000","last_became_peered":"2024-05-08T18:50:28.021140+0000","last_unstale":"2024-05-08T18:54:18.166245+0000","last_undegraded":"2024-05-08T18:54:18.166245+0000","last_fullsized":"2024-05-08T18:54:18.166245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:18.166058+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:18.166058+0000","last_clean_scrub_stamp":"2024-05-08T18:54:18.166058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:46.962267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:16.964506+0000","last_change":"2024-05-08T18:54:16.964506+0000","last_active":"2024-05-08T18:54:16.964506+0000","last_peered":"2024-05-08T18:54:16.964506+0000","last_clean":"2024-05-08T18:54:16.964506+0000","last_became_active":"2024-05-08T18:50:26.031680+0000","last_became_peered":"2024-05-08T18:50:26.031680+0000","last_unstale":"2024-05-08T18:54:16.964506+0000","last_undegraded":"2024-05-08T18:54:16.964506+0000","last_fullsized":"2024-05-08T18:54:16.964506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:16.964394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:16.964394+0000","last_clean_scrub_stamp":"2024-05-08T18:54:16.964394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:30.908518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"27'12","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:14.000877+0000","last_change":"2024-05-08T18:54:14.000877+0000","last_active":"2024-05-08T18:54:14.000877+0000","last_peered":"2024-05-08T18:54:14.000877+0000","last_clean":"2024-05-08T18:54:14.000877+0000","last_became_active":"2024-05-08T18:50:28.021588+0000","last_became_peered":"2024-05-08T18:50:28.021588+0000","last_unstale":"2024-05-08T18:54:14.000877+0000","last_undegraded":"2024-05-08T18:54:14.000877+0000","last_fullsized":"2024-05-08T18:54:14.000877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-08T18:54:14.000720+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-08T18:54:14.000720+0000","last_clean_scrub_stamp":"2024-05-08T18:54:14.000720+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:24:23.994147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:36.076633+0000","last_change":"2024-05-08T18:54:36.076633+0000","last_active":"2024-05-08T18:54:36.076633+0000","last_peered":"2024-05-08T18:54:36.076633+0000","last_clean":"2024-05-08T18:54:36.076633+0000","last_became_active":"2024-05-08T18:50:26.014383+0000","last_became_peered":"2024-05-08T18:50:26.014383+0000","last_unstale":"2024-05-08T18:54:36.076633+0000","last_undegraded":"2024-05-08T18:54:36.076633+0000","last_fullsized":"2024-05-08T18:54:36.076633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:36.076512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:36.076512+0000","last_clean_scrub_stamp":"2024-05-08T18:54:36.076512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:35.442197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"27'6","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:37.878297+0000","last_change":"2024-05-08T18:54:37.878326+0000","last_active":"2024-05-08T18:54:37.878297+0000","last_peered":"2024-05-08T18:54:37.878297+0000","last_clean":"2024-05-08T18:54:37.878297+0000","last_became_active":"2024-05-08T18:50:28.032181+0000","last_became_peered":"2024-05-08T18:50:28.032181+0000","last_unstale":"2024-05-08T18:54:37.878297+0000","last_undegraded":"2024-05-08T18:54:37.878297+0000","last_fullsized":"2024-05-08T18:54:37.878297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:37.878213+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:37.878213+0000","last_clean_scrub_stamp":"2024-05-08T18:54:37.878213+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:19.061962+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"27'4","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:42.082664+0000","last_change":"2024-05-08T18:54:42.082664+0000","last_active":"2024-05-08T18:54:42.082664+0000","last_peered":"2024-05-08T18:54:42.082664+0000","last_clean":"2024-05-08T18:54:42.082664+0000","last_became_active":"2024-05-08T18:50:26.025473+0000","last_became_peered":"2024-05-08T18:50:26.025473+0000","last_unstale":"2024-05-08T18:54:42.082664+0000","last_undegraded":"2024-05-08T18:54:42.082664+0000","last_fullsized":"2024-05-08T18:54:42.082664+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:42.082508+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:42.082508+0000","last_clean_scrub_stamp":"2024-05-08T18:54:42.082508+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:31.609006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:26.110772+0000","last_change":"2024-05-08T18:54:26.110825+0000","last_active":"2024-05-08T18:54:26.110772+0000","last_peered":"2024-05-08T18:54:26.110772+0000","last_clean":"2024-05-08T18:54:26.110772+0000","last_became_active":"2024-05-08T18:50:28.032462+0000","last_became_peered":"2024-05-08T18:50:28.032462+0000","last_unstale":"2024-05-08T18:54:26.110772+0000","last_undegraded":"2024-05-08T18:54:26.110772+0000","last_fullsized":"2024-05-08T18:54:26.110772+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:26.110638+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:26.110638+0000","last_clean_scrub_stamp":"2024-05-08T18:54:26.110638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:35.721914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:38.067084+0000","last_change":"2024-05-08T18:54:38.067084+0000","last_active":"2024-05-08T18:54:38.067084+0000","last_peered":"2024-05-08T18:54:38.067084+0000","last_clean":"2024-05-08T18:54:38.067084+0000","last_became_active":"2024-05-08T18:50:26.019706+0000","last_became_peered":"2024-05-08T18:50:26.019706+0000","last_unstale":"2024-05-08T18:54:38.067084+0000","last_undegraded":"2024-05-08T18:54:38.067084+0000","last_fullsized":"2024-05-08T18:54:38.067084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:38.066922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:38.066922+0000","last_clean_scrub_stamp":"2024-05-08T18:54:38.066922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:18.334160+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"27'2","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:14.148450+0000","last_change":"2024-05-08T18:54:14.148450+0000","last_active":"2024-05-08T18:54:14.148450+0000","last_peered":"2024-05-08T18:54:14.148450+0000","last_clean":"2024-05-08T18:54:14.148450+0000","last_became_active":"2024-05-08T18:50:28.031188+0000","last_became_peered":"2024-05-08T18:50:28.031188+0000","last_unstale":"2024-05-08T18:54:14.148450+0000","last_undegraded":"2024-05-08T18:54:14.148450+0000","last_fullsized":"2024-05-08T18:54:14.148450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:14.148328+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:14.148328+0000","last_clean_scrub_stamp":"2024-05-08T18:54:14.148328+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:04.976161+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:34.788291+0000","last_change":"2024-05-08T18:54:34.788291+0000","last_active":"2024-05-08T18:54:34.788291+0000","last_peered":"2024-05-08T18:54:34.788291+0000","last_clean":"2024-05-08T18:54:34.788291+0000","last_became_active":"2024-05-08T18:50:26.024808+0000","last_became_peered":"2024-05-08T18:50:26.024808+0000","last_unstale":"2024-05-08T18:54:34.788291+0000","last_undegraded":"2024-05-08T18:54:34.788291+0000","last_fullsized":"2024-05-08T18:54:34.788291+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:34.788178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:34.788178+0000","last_clean_scrub_stamp":"2024-05-08T18:54:34.788178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:23.242735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"27'6","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:15.931086+0000","last_change":"2024-05-08T18:54:15.931086+0000","last_active":"2024-05-08T18:54:15.931086+0000","last_peered":"2024-05-08T18:54:15.931086+0000","last_clean":"2024-05-08T18:54:15.931086+0000","last_became_active":"2024-05-08T18:50:28.022905+0000","last_became_peered":"2024-05-08T18:50:28.022905+0000","last_unstale":"2024-05-08T18:54:15.931086+0000","last_undegraded":"2024-05-08T18:54:15.931086+0000","last_fullsized":"2024-05-08T18:54:15.931086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:15.930946+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:15.930946+0000","last_clean_scrub_stamp":"2024-05-08T18:54:15.930946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:23.850615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:33.742923+0000","last_change":"2024-05-08T18:54:33.742923+0000","last_active":"2024-05-08T18:54:33.742923+0000","last_peered":"2024-05-08T18:54:33.742923+0000","last_clean":"2024-05-08T18:54:33.742923+0000","last_became_active":"2024-05-08T18:50:26.024977+0000","last_became_peered":"2024-05-08T18:50:26.024977+0000","last_unstale":"2024-05-08T18:54:33.742923+0000","last_undegraded":"2024-05-08T18:54:33.742923+0000","last_fullsized":"2024-05-08T18:54:33.742923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:33.742808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:33.742808+0000","last_clean_scrub_stamp":"2024-05-08T18:54:33.742808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:38.144227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:13.006779+0000","last_change":"2024-05-08T18:54:13.006779+0000","last_active":"2024-05-08T18:54:13.006779+0000","last_peered":"2024-05-08T18:54:13.006779+0000","last_clean":"2024-05-08T18:54:13.006779+0000","last_became_active":"2024-05-08T18:50:28.037153+0000","last_became_peered":"2024-05-08T18:50:28.037153+0000","last_unstale":"2024-05-08T18:54:13.006779+0000","last_undegraded":"2024-05-08T18:54:13.006779+0000","last_fullsized":"2024-05-08T18:54:13.006779+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:13.006667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:13.006667+0000","last_clean_scrub_stamp":"2024-05-08T18:54:13.006667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:00.529680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:59.872452+0000","last_change":"2024-05-08T18:54:59.872479+0000","last_active":"2024-05-08T18:54:59.872452+0000","last_peered":"2024-05-08T18:54:59.872452+0000","last_clean":"2024-05-08T18:54:59.872452+0000","last_became_active":"2024-05-08T18:50:26.011982+0000","last_became_peered":"2024-05-08T18:50:26.011982+0000","last_unstale":"2024-05-08T18:54:59.872452+0000","last_undegraded":"2024-05-08T18:54:59.872452+0000","last_fullsized":"2024-05-08T18:54:59.872452+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:59.872358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:59.872358+0000","last_clean_scrub_stamp":"2024-05-08T18:54:59.872358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:58.077182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"27'8","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:25.737967+0000","last_change":"2024-05-08T18:54:25.737967+0000","last_active":"2024-05-08T18:54:25.737967+0000","last_peered":"2024-05-08T18:54:25.737967+0000","last_clean":"2024-05-08T18:54:25.737967+0000","last_became_active":"2024-05-08T18:50:28.028405+0000","last_became_peered":"2024-05-08T18:50:28.028405+0000","last_unstale":"2024-05-08T18:54:25.737967+0000","last_undegraded":"2024-05-08T18:54:25.737967+0000","last_fullsized":"2024-05-08T18:54:25.737967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:25.737811+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:25.737811+0000","last_clean_scrub_stamp":"2024-05-08T18:54:25.737811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:17:24.821299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"27'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:41.092864+0000","last_change":"2024-05-08T18:54:41.092864+0000","last_active":"2024-05-08T18:54:41.092864+0000","last_peered":"2024-05-08T18:54:41.092864+0000","last_clean":"2024-05-08T18:54:41.092864+0000","last_became_active":"2024-05-08T18:50:26.023658+0000","last_became_peered":"2024-05-08T18:50:26.023658+0000","last_unstale":"2024-05-08T18:54:41.092864+0000","last_undegraded":"2024-05-08T18:54:41.092864+0000","last_fullsized":"2024-05-08T18:54:41.092864+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:41.092756+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:41.092756+0000","last_clean_scrub_stamp":"2024-05-08T18:54:41.092756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:24.283494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"25'4","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:25.145268+0000","last_change":"2024-05-08T18:54:25.145268+0000","last_active":"2024-05-08T18:54:25.145268+0000","last_peered":"2024-05-08T18:54:25.145268+0000","last_clean":"2024-05-08T18:54:25.145268+0000","last_became_active":"2024-05-08T18:50:28.032552+0000","last_became_peered":"2024-05-08T18:50:28.032552+0000","last_unstale":"2024-05-08T18:54:25.145268+0000","last_undegraded":"2024-05-08T18:54:25.145268+0000","last_fullsized":"2024-05-08T18:54:25.145268+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-08T18:54:25.145141+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-08T18:54:25.145141+0000","last_clean_scrub_stamp":"2024-05-08T18:54:25.145141+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:31.782772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:12.958318+0000","last_change":"2024-05-08T18:54:12.958343+0000","last_active":"2024-05-08T18:54:12.958318+0000","last_peered":"2024-05-08T18:54:12.958318+0000","last_clean":"2024-05-08T18:54:12.958318+0000","last_became_active":"2024-05-08T18:50:26.032385+0000","last_became_peered":"2024-05-08T18:50:26.032385+0000","last_unstale":"2024-05-08T18:54:12.958318+0000","last_undegraded":"2024-05-08T18:54:12.958318+0000","last_fullsized":"2024-05-08T18:54:12.958318+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:12.958227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:12.958227+0000","last_clean_scrub_stamp":"2024-05-08T18:54:12.958227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:22.832530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"27'6","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:19.850079+0000","last_change":"2024-05-08T18:54:19.850079+0000","last_active":"2024-05-08T18:54:19.850079+0000","last_peered":"2024-05-08T18:54:19.850079+0000","last_clean":"2024-05-08T18:54:19.850079+0000","last_became_active":"2024-05-08T18:50:28.023807+0000","last_became_peered":"2024-05-08T18:50:28.023807+0000","last_unstale":"2024-05-08T18:54:19.850079+0000","last_undegraded":"2024-05-08T18:54:19.850079+0000","last_fullsized":"2024-05-08T18:54:19.850079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:19.849922+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:19.849922+0000","last_clean_scrub_stamp":"2024-05-08T18:54:19.849922+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:48.646130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"27'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:44.082166+0000","last_change":"2024-05-08T18:54:44.082193+0000","last_active":"2024-05-08T18:54:44.082166+0000","last_peered":"2024-05-08T18:54:44.082166+0000","last_clean":"2024-05-08T18:54:44.082166+0000","last_became_active":"2024-05-08T18:50:26.025023+0000","last_became_peered":"2024-05-08T18:50:26.025023+0000","last_unstale":"2024-05-08T18:54:44.082166+0000","last_undegraded":"2024-05-08T18:54:44.082166+0000","last_fullsized":"2024-05-08T18:54:44.082166+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:44.082062+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:44.082062+0000","last_clean_scrub_stamp":"2024-05-08T18:54:44.082062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:25.887815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'6","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:47.974836+0000","last_change":"2024-05-08T18:54:47.974865+0000","last_active":"2024-05-08T18:54:47.974836+0000","last_peered":"2024-05-08T18:54:47.974836+0000","last_clean":"2024-05-08T18:54:47.974836+0000","last_became_active":"2024-05-08T18:50:26.026333+0000","last_became_peered":"2024-05-08T18:50:26.026333+0000","last_unstale":"2024-05-08T18:54:47.974836+0000","last_undegraded":"2024-05-08T18:54:47.974836+0000","last_fullsized":"2024-05-08T18:54:47.974836+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:47.974728+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:47.974728+0000","last_clean_scrub_stamp":"2024-05-08T18:54:47.974728+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:42.230020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"25'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:25.063862+0000","last_change":"2024-05-08T18:54:25.063893+0000","last_active":"2024-05-08T18:54:25.063862+0000","last_peered":"2024-05-08T18:54:25.063862+0000","last_clean":"2024-05-08T18:54:25.063862+0000","last_became_active":"2024-05-08T18:50:28.024627+0000","last_became_peered":"2024-05-08T18:50:28.024627+0000","last_unstale":"2024-05-08T18:54:25.063862+0000","last_undegraded":"2024-05-08T18:54:25.063862+0000","last_fullsized":"2024-05-08T18:54:25.063862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-08T18:54:25.063768+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-08T18:54:25.063768+0000","last_clean_scrub_stamp":"2024-05-08T18:54:25.063768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.140703+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'4","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:40.078061+0000","last_change":"2024-05-08T18:54:40.078087+0000","last_active":"2024-05-08T18:54:40.078061+0000","last_peered":"2024-05-08T18:54:40.078061+0000","last_clean":"2024-05-08T18:54:40.078061+0000","last_became_active":"2024-05-08T18:50:26.024839+0000","last_became_peered":"2024-05-08T18:50:26.024839+0000","last_unstale":"2024-05-08T18:54:40.078061+0000","last_undegraded":"2024-05-08T18:54:40.078061+0000","last_fullsized":"2024-05-08T18:54:40.078061+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:40.077968+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:40.077968+0000","last_clean_scrub_stamp":"2024-05-08T18:54:40.077968+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:49.689244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'8","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:09.980517+0000","last_change":"2024-05-08T18:54:09.980547+0000","last_active":"2024-05-08T18:54:09.980517+0000","last_peered":"2024-05-08T18:54:09.980517+0000","last_clean":"2024-05-08T18:54:09.980517+0000","last_became_active":"2024-05-08T18:50:28.038677+0000","last_became_peered":"2024-05-08T18:50:28.038677+0000","last_unstale":"2024-05-08T18:54:09.980517+0000","last_undegraded":"2024-05-08T18:54:09.980517+0000","last_fullsized":"2024-05-08T18:54:09.980517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:09.980433+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:09.980433+0000","last_clean_scrub_stamp":"2024-05-08T18:54:09.980433+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:23.924556+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1522,"ondisk_log_size":1522,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1601,"num_read_kb":1491,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705724,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39904,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331936,"statfs":{"total":96636764160,"available":96595902464,"internally_reserved":0,"allocated":417792,"data_stored":121043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705725,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36256,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335584,"statfs":{"total":96636764160,"available":96599638016,"internally_reserved":0,"allocated":942080,"data_stored":707921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705724,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36284,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335556,"statfs":{"total":96636764160,"available":96599609344,"internally_reserved":0,"allocated":970752,"data_stored":708927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705724,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":380928,"data_stored":119875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:55:07.780 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-08T18:50:29.009777+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:55:07.780 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:55:07.781 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:55:07.781 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:55:07.782 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:55:07.782 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T18:50:35.031132+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=50, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=53, tm_sec=43, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:55:07.782 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T18:55:27.784 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:55:27.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.900+0000 7f8400c74640 1 Processor -- start 2024-05-08T18:55:27.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.900+0000 7f8400c74640 1 -- start start 2024-05-08T18:55:27.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.901+0000 7f8400c74640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f83fc12c4e0 0x7f83fc131cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:55:27.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.901+0000 7f8400c74640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83fc0719e0 con 0x7f83fc06fe20 2024-05-08T18:55:27.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.901+0000 7f8400c74640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f83fc12b9a0 con 0x7f83fc12c4e0 2024-05-08T18:55:27.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.901+0000 7f83f3fff640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f83fc12c4e0 0x7f83fc131cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:55:27.900 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.901+0000 7f83fa59c640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f83fc06fe20 0x7f83fc12bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:42582/0 (socket says 172.21.15.42:42582) 2024-05-08T18:55:27.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.901+0000 7f83fa59c640 1 -- 172.21.15.42:0/1225968007 learned_addr learned my addr 172.21.15.42:0/1225968007 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:55:27.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.901+0000 7f83f3fff640 1 -- 172.21.15.42:0/1225968007 >> v1:172.21.15.42:6789/0 conn(0x7f83fc06fe20 legacy=0x7f83fc12bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:55:27.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.901+0000 7f83f3fff640 1 -- 172.21.15.42:0/1225968007 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83fc072330 con 0x7f83fc12c4e0 2024-05-08T18:55:27.901 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.901+0000 7f83f9d9b640 1 -- 172.21.15.42:0/1225968007 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3590517760 0 0) 0x7f83fc0719e0 con 0x7f83fc06fe20 2024-05-08T18:55:27.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.902+0000 7f83f3fff640 1 --2- 172.21.15.42:0/1225968007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83fc12c4e0 0x7f83fc131cb0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f83e4009720 tx=0x7f83e402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4decf306c6dba85 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:55:27.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.902+0000 7f83f9d9b640 1 -- 172.21.15.42:0/1225968007 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e40316d0 con 0x7f83fc12c4e0 2024-05-08T18:55:27.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.902+0000 7f83f9d9b640 1 -- 172.21.15.42:0/1225968007 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e4037070 con 0x7f83fc12c4e0 2024-05-08T18:55:27.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.902+0000 7f83f9d9b640 1 -- 172.21.15.42:0/1225968007 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e40319c0 con 0x7f83fc12c4e0 2024-05-08T18:55:27.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.903+0000 7f8400c74640 1 -- 172.21.15.42:0/1225968007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83fc12c4e0 msgr2=0x7f83fc131cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:55:27.902 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.903+0000 7f8400c74640 1 --2- 172.21.15.42:0/1225968007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83fc12c4e0 0x7f83fc131cb0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f83e4009720 tx=0x7f83e402b840 comp rx=0 tx=0).stop 2024-05-08T18:55:27.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.903+0000 7f8400c74640 1 -- 172.21.15.42:0/1225968007 shutdown_connections 2024-05-08T18:55:27.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.903+0000 7f8400c74640 1 --2- 172.21.15.42:0/1225968007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83fc12c4e0 0x7f83fc131cb0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:55:27.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.903+0000 7f8400c74640 1 -- 172.21.15.42:0/1225968007 >> 172.21.15.42:0/1225968007 conn(0x7f83fc09a910 msgr2=0x7f83fc06e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:55:27.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.903+0000 7f8400c74640 1 -- 172.21.15.42:0/1225968007 shutdown_connections 2024-05-08T18:55:27.903 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.903+0000 7f8400c74640 1 -- 172.21.15.42:0/1225968007 wait complete. 2024-05-08T18:55:27.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.904+0000 7f8400c74640 1 Processor -- start 2024-05-08T18:55:27.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.904+0000 7f8400c74640 1 -- start start 2024-05-08T18:55:27.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.904+0000 7f8400c74640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83fc06fe20 0x7f83fc116b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:55:27.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.904+0000 7f8400c74640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f83fc073290 con 0x7f83fc06fe20 2024-05-08T18:55:27.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.904+0000 7f83fa59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83fc06fe20 0x7f83fc116b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:55:27.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.904+0000 7f83fa59c640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83fc06fe20 0x7f83fc116b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37912/0 (socket says 172.21.15.42:37912) 2024-05-08T18:55:27.905 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.904+0000 7f83fa59c640 1 -- 172.21.15.42:0/2522074441 learned_addr learned my addr 172.21.15.42:0/2522074441 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:55:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.905+0000 7f83fa59c640 1 -- 172.21.15.42:0/2522074441 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83fc09cce0 con 0x7f83fc06fe20 2024-05-08T18:55:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.905+0000 7f83fa59c640 1 --2- 172.21.15.42:0/2522074441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83fc06fe20 0x7f83fc116b20 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f83ec00c420 tx=0x7f83ec00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:55:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.905+0000 7f83f2ffd640 1 -- 172.21.15.42:0/2522074441 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ec018070 con 0x7f83fc06fe20 2024-05-08T18:55:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.905+0000 7f83f2ffd640 1 -- 172.21.15.42:0/2522074441 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ec0074d0 con 0x7f83fc06fe20 2024-05-08T18:55:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.905+0000 7f8400c74640 1 -- 172.21.15.42:0/2522074441 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83fc118f80 con 0x7f83fc06fe20 2024-05-08T18:55:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.905+0000 7f83f2ffd640 1 -- 172.21.15.42:0/2522074441 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83ec004950 con 0x7f83fc06fe20 2024-05-08T18:55:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.905+0000 7f8400c74640 1 -- 172.21.15.42:0/2522074441 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83fc119620 con 0x7f83fc06fe20 2024-05-08T18:55:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.906+0000 7f83f2ffd640 1 -- 172.21.15.42:0/2522074441 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f83ec01b070 con 0x7f83fc06fe20 2024-05-08T18:55:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.906+0000 7f8400c74640 1 -- 172.21.15.42:0/2522074441 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83fc117c10 con 0x7f83fc06fe20 2024-05-08T18:55:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.906+0000 7f83f2ffd640 1 --2- 172.21.15.42:0/2522074441 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f83dc03d2b0 0x7f83dc03f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:55:27.906 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.906+0000 7f83f2ffd640 1 -- 172.21.15.42:0/2522074441 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f83ec0510d0 con 0x7f83fc06fe20 2024-05-08T18:55:27.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.907+0000 7f83f3fff640 1 --2- 172.21.15.42:0/2522074441 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f83dc03d2b0 0x7f83dc03f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:55:27.907 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.907+0000 7f83f3fff640 1 --2- 172.21.15.42:0/2522074441 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f83dc03d2b0 0x7f83dc03f770 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f83e4036000 tx=0x7f83e4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:55:27.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:27.911+0000 7f83f2ffd640 1 -- 172.21.15.42:0/2522074441 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f83ec010300 con 0x7f83fc06fe20 2024-05-08T18:55:28.102 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.103+0000 7f8400c74640 1 -- 172.21.15.42:0/2522074441 --> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f83fc118310 con 0x7f83dc03d2b0 2024-05-08T18:55:28.118 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.119+0000 7f83f2ffd640 1 -- 172.21.15.42:0/2522074441 <== mgr.4102 v2:172.21.15.132:6824/2104266563 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665750 (secure 0 0 0) 0x7f83fc118310 con 0x7f83dc03d2b0 2024-05-08T18:55:28.125 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-05-08T18:55:28.131 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2024-05-08T18:55:28.133 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.123+0000 7f8400c74640 1 -- 172.21.15.42:0/2522074441 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f83dc03d2b0 msgr2=0x7f83dc03f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:55:28.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.123+0000 7f8400c74640 1 --2- 172.21.15.42:0/2522074441 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f83dc03d2b0 0x7f83dc03f770 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f83e4036000 tx=0x7f83e4008030 comp rx=0 tx=0).stop 2024-05-08T18:55:28.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.123+0000 7f8400c74640 1 -- 172.21.15.42:0/2522074441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83fc06fe20 msgr2=0x7f83fc116b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:55:28.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.123+0000 7f8400c74640 1 --2- 172.21.15.42:0/2522074441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83fc06fe20 0x7f83fc116b20 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f83ec00c420 tx=0x7f83ec00c8e0 comp rx=0 tx=0).stop 2024-05-08T18:55:28.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.123+0000 7f8400c74640 1 -- 172.21.15.42:0/2522074441 shutdown_connections 2024-05-08T18:55:28.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.123+0000 7f8400c74640 1 --2- 172.21.15.42:0/2522074441 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f83dc03d2b0 0x7f83dc03f770 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:55:28.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.123+0000 7f8400c74640 1 --2- 172.21.15.42:0/2522074441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83fc06fe20 0x7f83fc116b20 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:55:28.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.124+0000 7f8400c74640 1 -- 172.21.15.42:0/2522074441 >> 172.21.15.42:0/2522074441 conn(0x7f83fc09a910 msgr2=0x7f83fc124f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:55:28.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.124+0000 7f8400c74640 1 -- 172.21.15.42:0/2522074441 shutdown_connections 2024-05-08T18:55:28.134 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.124+0000 7f8400c74640 1 -- 172.21.15.42:0/2522074441 wait complete. 2024-05-08T18:55:28.135 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-05-08T18:55:28.021053+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5031,"num_read_kb":4621,"num_write":2119,"num_write_kb":60585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4737,"ondisk_log_size":4737,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":143992,"kb_used_data":2648,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343368,"statfs":{"total":386547056640,"available":386399608832,"internally_reserved":0,"allocated":2711552,"data_stored":1657766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003867"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:20.917462+0000","last_change":"2024-05-08T18:54:20.917462+0000","last_active":"2024-05-08T18:54:20.917462+0000","last_peered":"2024-05-08T18:54:20.917462+0000","last_clean":"2024-05-08T18:54:20.917462+0000","last_became_active":"2024-05-08T18:50:26.031359+0000","last_became_peered":"2024-05-08T18:50:26.031359+0000","last_unstale":"2024-05-08T18:54:20.917462+0000","last_undegraded":"2024-05-08T18:54:20.917462+0000","last_fullsized":"2024-05-08T18:54:20.917462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:20.917335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:20.917335+0000","last_clean_scrub_stamp":"2024-05-08T18:54:20.917335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:39:04.286184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"27'8","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:23.788793+0000","last_change":"2024-05-08T18:54:23.788822+0000","last_active":"2024-05-08T18:54:23.788793+0000","last_peered":"2024-05-08T18:54:23.788793+0000","last_clean":"2024-05-08T18:54:23.788793+0000","last_became_active":"2024-05-08T18:50:28.028352+0000","last_became_peered":"2024-05-08T18:50:28.028352+0000","last_unstale":"2024-05-08T18:54:23.788793+0000","last_undegraded":"2024-05-08T18:54:23.788793+0000","last_fullsized":"2024-05-08T18:54:23.788793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:23.788707+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:23.788707+0000","last_clean_scrub_stamp":"2024-05-08T18:54:23.788707+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:30:26.936915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"27'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:26.036038+0000","last_change":"2024-05-08T18:54:26.036038+0000","last_active":"2024-05-08T18:54:26.036038+0000","last_peered":"2024-05-08T18:54:26.036038+0000","last_clean":"2024-05-08T18:54:26.036038+0000","last_became_active":"2024-05-08T18:50:26.028799+0000","last_became_peered":"2024-05-08T18:50:26.028799+0000","last_unstale":"2024-05-08T18:54:26.036038+0000","last_undegraded":"2024-05-08T18:54:26.036038+0000","last_fullsized":"2024-05-08T18:54:26.036038+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:26.035863+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:26.035863+0000","last_clean_scrub_stamp":"2024-05-08T18:54:26.035863+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:02.859884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"27'6","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:22.049106+0000","last_change":"2024-05-08T18:54:22.049138+0000","last_active":"2024-05-08T18:54:22.049106+0000","last_peered":"2024-05-08T18:54:22.049106+0000","last_clean":"2024-05-08T18:54:22.049106+0000","last_became_active":"2024-05-08T18:50:28.033466+0000","last_became_peered":"2024-05-08T18:50:28.033466+0000","last_unstale":"2024-05-08T18:54:22.049106+0000","last_undegraded":"2024-05-08T18:54:22.049106+0000","last_fullsized":"2024-05-08T18:54:22.049106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:22.049001+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:22.049001+0000","last_clean_scrub_stamp":"2024-05-08T18:54:22.049001+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:03.232750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:44.837869+0000","last_change":"2024-05-08T18:54:44.837895+0000","last_active":"2024-05-08T18:54:44.837869+0000","last_peered":"2024-05-08T18:54:44.837869+0000","last_clean":"2024-05-08T18:54:44.837869+0000","last_became_active":"2024-05-08T18:51:15.083809+0000","last_became_peered":"2024-05-08T18:51:15.083809+0000","last_unstale":"2024-05-08T18:54:44.837869+0000","last_undegraded":"2024-05-08T18:54:44.837869+0000","last_fullsized":"2024-05-08T18:54:44.837869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:44.837768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:44.837768+0000","last_clean_scrub_stamp":"2024-05-08T18:54:44.837768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:34.569974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"25'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:48.140723+0000","last_change":"2024-05-08T18:54:48.140794+0000","last_active":"2024-05-08T18:54:48.140723+0000","last_peered":"2024-05-08T18:54:48.140723+0000","last_clean":"2024-05-08T18:54:48.140723+0000","last_became_active":"2024-05-08T18:51:15.080716+0000","last_became_peered":"2024-05-08T18:51:15.080716+0000","last_unstale":"2024-05-08T18:54:48.140723+0000","last_undegraded":"2024-05-08T18:54:48.140723+0000","last_fullsized":"2024-05-08T18:54:48.140723+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:48.140610+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:48.140610+0000","last_clean_scrub_stamp":"2024-05-08T18:54:48.140610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:37.287821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:30.878537+0000","last_change":"2024-05-08T18:54:30.878562+0000","last_active":"2024-05-08T18:54:30.878537+0000","last_peered":"2024-05-08T18:54:30.878537+0000","last_clean":"2024-05-08T18:54:30.878537+0000","last_became_active":"2024-05-08T18:50:26.024243+0000","last_became_peered":"2024-05-08T18:50:26.024243+0000","last_unstale":"2024-05-08T18:54:30.878537+0000","last_undegraded":"2024-05-08T18:54:30.878537+0000","last_fullsized":"2024-05-08T18:54:30.878537+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:30.878445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:30.878445+0000","last_clean_scrub_stamp":"2024-05-08T18:54:30.878445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:30:34.026653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"27'4","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:30.094768+0000","last_change":"2024-05-08T18:54:30.094795+0000","last_active":"2024-05-08T18:54:30.094768+0000","last_peered":"2024-05-08T18:54:30.094768+0000","last_clean":"2024-05-08T18:54:30.094768+0000","last_became_active":"2024-05-08T18:50:28.026380+0000","last_became_peered":"2024-05-08T18:50:28.026380+0000","last_unstale":"2024-05-08T18:54:30.094768+0000","last_undegraded":"2024-05-08T18:54:30.094768+0000","last_fullsized":"2024-05-08T18:54:30.094768+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:30.094665+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:30.094665+0000","last_clean_scrub_stamp":"2024-05-08T18:54:30.094665+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:30.168403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"25'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:45.040009+0000","last_change":"2024-05-08T18:54:45.040054+0000","last_active":"2024-05-08T18:54:45.040009+0000","last_peered":"2024-05-08T18:54:45.040009+0000","last_clean":"2024-05-08T18:54:45.040009+0000","last_became_active":"2024-05-08T18:50:26.022914+0000","last_became_peered":"2024-05-08T18:50:26.022914+0000","last_unstale":"2024-05-08T18:54:45.040009+0000","last_undegraded":"2024-05-08T18:54:45.040009+0000","last_fullsized":"2024-05-08T18:54:45.040009+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:45.039918+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:45.039918+0000","last_clean_scrub_stamp":"2024-05-08T18:54:45.039918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:49:57.647019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"27'6","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:17.878113+0000","last_change":"2024-05-08T18:54:17.878113+0000","last_active":"2024-05-08T18:54:17.878113+0000","last_peered":"2024-05-08T18:54:17.878113+0000","last_clean":"2024-05-08T18:54:17.878113+0000","last_became_active":"2024-05-08T18:50:28.023506+0000","last_became_peered":"2024-05-08T18:50:28.023506+0000","last_unstale":"2024-05-08T18:54:17.878113+0000","last_undegraded":"2024-05-08T18:54:17.878113+0000","last_fullsized":"2024-05-08T18:54:17.878113+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:17.877983+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:17.877983+0000","last_clean_scrub_stamp":"2024-05-08T18:54:17.877983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:50.155421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"25'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:31.877064+0000","last_change":"2024-05-08T18:54:31.877093+0000","last_active":"2024-05-08T18:54:31.877064+0000","last_peered":"2024-05-08T18:54:31.877064+0000","last_clean":"2024-05-08T18:54:31.877064+0000","last_became_active":"2024-05-08T18:50:26.024493+0000","last_became_peered":"2024-05-08T18:50:26.024493+0000","last_unstale":"2024-05-08T18:54:31.877064+0000","last_undegraded":"2024-05-08T18:54:31.877064+0000","last_fullsized":"2024-05-08T18:54:31.877064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:31.876973+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:31.876973+0000","last_clean_scrub_stamp":"2024-05-08T18:54:31.876973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:21.277118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"27'10","reported_seq":79,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:18.071888+0000","last_change":"2024-05-08T18:54:18.071888+0000","last_active":"2024-05-08T18:54:18.071888+0000","last_peered":"2024-05-08T18:54:18.071888+0000","last_clean":"2024-05-08T18:54:18.071888+0000","last_became_active":"2024-05-08T18:50:28.037266+0000","last_became_peered":"2024-05-08T18:50:28.037266+0000","last_unstale":"2024-05-08T18:54:18.071888+0000","last_undegraded":"2024-05-08T18:54:18.071888+0000","last_fullsized":"2024-05-08T18:54:18.071888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:18.071727+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:18.071727+0000","last_clean_scrub_stamp":"2024-05-08T18:54:18.071727+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:22.473146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:58.889272+0000","last_change":"2024-05-08T18:54:58.889299+0000","last_active":"2024-05-08T18:54:58.889272+0000","last_peered":"2024-05-08T18:54:58.889272+0000","last_clean":"2024-05-08T18:54:58.889272+0000","last_became_active":"2024-05-08T18:50:26.010734+0000","last_became_peered":"2024-05-08T18:50:26.010734+0000","last_unstale":"2024-05-08T18:54:58.889272+0000","last_undegraded":"2024-05-08T18:54:58.889272+0000","last_fullsized":"2024-05-08T18:54:58.889272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:58.889178+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:58.889178+0000","last_clean_scrub_stamp":"2024-05-08T18:54:58.889178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:20:53.905748+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:15.936164+0000","last_change":"2024-05-08T18:54:15.936164+0000","last_active":"2024-05-08T18:54:15.936164+0000","last_peered":"2024-05-08T18:54:15.936164+0000","last_clean":"2024-05-08T18:54:15.936164+0000","last_became_active":"2024-05-08T18:50:28.026028+0000","last_became_peered":"2024-05-08T18:50:28.026028+0000","last_unstale":"2024-05-08T18:54:15.936164+0000","last_undegraded":"2024-05-08T18:54:15.936164+0000","last_fullsized":"2024-05-08T18:54:15.936164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:15.936014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:15.936014+0000","last_clean_scrub_stamp":"2024-05-08T18:54:15.936014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:46.686256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"25'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:22.076100+0000","last_change":"2024-05-08T18:54:22.076129+0000","last_active":"2024-05-08T18:54:22.076100+0000","last_peered":"2024-05-08T18:54:22.076100+0000","last_clean":"2024-05-08T18:54:22.076100+0000","last_became_active":"2024-05-08T18:50:26.029435+0000","last_became_peered":"2024-05-08T18:50:26.029435+0000","last_unstale":"2024-05-08T18:54:22.076100+0000","last_undegraded":"2024-05-08T18:54:22.076100+0000","last_fullsized":"2024-05-08T18:54:22.076100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:22.076003+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:22.076003+0000","last_clean_scrub_stamp":"2024-05-08T18:54:22.076003+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:00:28.517889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"27'6","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:23.929209+0000","last_change":"2024-05-08T18:54:23.929209+0000","last_active":"2024-05-08T18:54:23.929209+0000","last_peered":"2024-05-08T18:54:23.929209+0000","last_clean":"2024-05-08T18:54:23.929209+0000","last_became_active":"2024-05-08T18:50:28.033311+0000","last_became_peered":"2024-05-08T18:50:28.033311+0000","last_unstale":"2024-05-08T18:54:23.929209+0000","last_undegraded":"2024-05-08T18:54:23.929209+0000","last_fullsized":"2024-05-08T18:54:23.929209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:23.929088+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:23.929088+0000","last_clean_scrub_stamp":"2024-05-08T18:54:23.929088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:53.559562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"27'10","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:23.094231+0000","last_change":"2024-05-08T18:54:23.094231+0000","last_active":"2024-05-08T18:54:23.094231+0000","last_peered":"2024-05-08T18:54:23.094231+0000","last_clean":"2024-05-08T18:54:23.094231+0000","last_became_active":"2024-05-08T18:50:28.032951+0000","last_became_peered":"2024-05-08T18:50:28.032951+0000","last_unstale":"2024-05-08T18:54:23.094231+0000","last_undegraded":"2024-05-08T18:54:23.094231+0000","last_fullsized":"2024-05-08T18:54:23.094231+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:23.094109+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:23.094109+0000","last_clean_scrub_stamp":"2024-05-08T18:54:23.094109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:00.987376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'4","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:22.772365+0000","last_change":"2024-05-08T18:54:22.772365+0000","last_active":"2024-05-08T18:54:22.772365+0000","last_peered":"2024-05-08T18:54:22.772365+0000","last_clean":"2024-05-08T18:54:22.772365+0000","last_became_active":"2024-05-08T18:50:26.030437+0000","last_became_peered":"2024-05-08T18:50:26.030437+0000","last_unstale":"2024-05-08T18:54:22.772365+0000","last_undegraded":"2024-05-08T18:54:22.772365+0000","last_fullsized":"2024-05-08T18:54:22.772365+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-08T18:54:22.772232+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-08T18:54:22.772232+0000","last_clean_scrub_stamp":"2024-05-08T18:54:22.772232+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:30.535173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"27'22","reported_seq":117,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:21.778559+0000","last_change":"2024-05-08T18:54:21.778559+0000","last_active":"2024-05-08T18:54:21.778559+0000","last_peered":"2024-05-08T18:54:21.778559+0000","last_clean":"2024-05-08T18:54:21.778559+0000","last_became_active":"2024-05-08T18:50:28.028184+0000","last_became_peered":"2024-05-08T18:50:28.028184+0000","last_unstale":"2024-05-08T18:54:21.778559+0000","last_undegraded":"2024-05-08T18:54:21.778559+0000","last_fullsized":"2024-05-08T18:54:21.778559+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-05-08T18:54:21.778405+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-05-08T18:54:21.778405+0000","last_clean_scrub_stamp":"2024-05-08T18:54:21.778405+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:34.523219+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":94,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"27'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:14.975221+0000","last_change":"2024-05-08T18:54:14.975221+0000","last_active":"2024-05-08T18:54:14.975221+0000","last_peered":"2024-05-08T18:54:14.975221+0000","last_clean":"2024-05-08T18:54:14.975221+0000","last_became_active":"2024-05-08T18:50:26.031768+0000","last_became_peered":"2024-05-08T18:50:26.031768+0000","last_unstale":"2024-05-08T18:54:14.975221+0000","last_undegraded":"2024-05-08T18:54:14.975221+0000","last_fullsized":"2024-05-08T18:54:14.975221+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:14.975072+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:14.975072+0000","last_clean_scrub_stamp":"2024-05-08T18:54:14.975072+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:23.744293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"27'8","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:27.735944+0000","last_change":"2024-05-08T18:54:27.735944+0000","last_active":"2024-05-08T18:54:27.735944+0000","last_peered":"2024-05-08T18:54:27.735944+0000","last_clean":"2024-05-08T18:54:27.735944+0000","last_became_active":"2024-05-08T18:50:28.029145+0000","last_became_peered":"2024-05-08T18:50:28.029145+0000","last_unstale":"2024-05-08T18:54:27.735944+0000","last_undegraded":"2024-05-08T18:54:27.735944+0000","last_fullsized":"2024-05-08T18:54:27.735944+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:27.735826+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:27.735826+0000","last_clean_scrub_stamp":"2024-05-08T18:54:27.735826+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:04.559847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"27'4","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:20.823562+0000","last_change":"2024-05-08T18:54:20.823562+0000","last_active":"2024-05-08T18:54:20.823562+0000","last_peered":"2024-05-08T18:54:20.823562+0000","last_clean":"2024-05-08T18:54:20.823562+0000","last_became_active":"2024-05-08T18:50:26.031545+0000","last_became_peered":"2024-05-08T18:50:26.031545+0000","last_unstale":"2024-05-08T18:54:20.823562+0000","last_undegraded":"2024-05-08T18:54:20.823562+0000","last_fullsized":"2024-05-08T18:54:20.823562+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:20.823443+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:20.823443+0000","last_clean_scrub_stamp":"2024-05-08T18:54:20.823443+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:58.388872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"27'16","reported_seq":84,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:21.125177+0000","last_change":"2024-05-08T18:54:21.125177+0000","last_active":"2024-05-08T18:54:21.125177+0000","last_peered":"2024-05-08T18:54:21.125177+0000","last_clean":"2024-05-08T18:54:21.125177+0000","last_became_active":"2024-05-08T18:50:28.022683+0000","last_became_peered":"2024-05-08T18:50:28.022683+0000","last_unstale":"2024-05-08T18:54:21.125177+0000","last_undegraded":"2024-05-08T18:54:21.125177+0000","last_fullsized":"2024-05-08T18:54:21.125177+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-05-08T18:54:21.125005+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-05-08T18:54:21.125005+0000","last_clean_scrub_stamp":"2024-05-08T18:54:21.125005+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:40:28.887946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"27'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:32.733415+0000","last_change":"2024-05-08T18:54:32.733415+0000","last_active":"2024-05-08T18:54:32.733415+0000","last_peered":"2024-05-08T18:54:32.733415+0000","last_clean":"2024-05-08T18:54:32.733415+0000","last_became_active":"2024-05-08T18:50:26.011512+0000","last_became_peered":"2024-05-08T18:50:26.011512+0000","last_unstale":"2024-05-08T18:54:32.733415+0000","last_undegraded":"2024-05-08T18:54:32.733415+0000","last_fullsized":"2024-05-08T18:54:32.733415+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:32.733293+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:32.733293+0000","last_clean_scrub_stamp":"2024-05-08T18:54:32.733293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:47.011150+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:19.891039+0000","last_change":"2024-05-08T18:54:19.891039+0000","last_active":"2024-05-08T18:54:19.891039+0000","last_peered":"2024-05-08T18:54:19.891039+0000","last_clean":"2024-05-08T18:54:19.891039+0000","last_became_active":"2024-05-08T18:50:28.032768+0000","last_became_peered":"2024-05-08T18:50:28.032768+0000","last_unstale":"2024-05-08T18:54:19.891039+0000","last_undegraded":"2024-05-08T18:54:19.891039+0000","last_fullsized":"2024-05-08T18:54:19.891039+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:19.890923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:19.890923+0000","last_clean_scrub_stamp":"2024-05-08T18:54:19.890923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:07.413936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:24.086794+0000","last_change":"2024-05-08T18:54:24.086794+0000","last_active":"2024-05-08T18:54:24.086794+0000","last_peered":"2024-05-08T18:54:24.086794+0000","last_clean":"2024-05-08T18:54:24.086794+0000","last_became_active":"2024-05-08T18:50:26.029015+0000","last_became_peered":"2024-05-08T18:50:26.029015+0000","last_unstale":"2024-05-08T18:54:24.086794+0000","last_undegraded":"2024-05-08T18:54:24.086794+0000","last_fullsized":"2024-05-08T18:54:24.086794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:24.086613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:24.086613+0000","last_clean_scrub_stamp":"2024-05-08T18:54:24.086613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:17:23.170101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"27'14","reported_seq":78,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:14.955626+0000","last_change":"2024-05-08T18:54:14.955626+0000","last_active":"2024-05-08T18:54:14.955626+0000","last_peered":"2024-05-08T18:54:14.955626+0000","last_clean":"2024-05-08T18:54:14.955626+0000","last_became_active":"2024-05-08T18:50:28.022359+0000","last_became_peered":"2024-05-08T18:50:28.022359+0000","last_unstale":"2024-05-08T18:54:14.955626+0000","last_undegraded":"2024-05-08T18:54:14.955626+0000","last_fullsized":"2024-05-08T18:54:14.955626+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-05-08T18:54:14.955510+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-05-08T18:54:14.955510+0000","last_clean_scrub_stamp":"2024-05-08T18:54:14.955510+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:26.145719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"27'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:50.958071+0000","last_change":"2024-05-08T18:54:50.958071+0000","last_active":"2024-05-08T18:54:50.958071+0000","last_peered":"2024-05-08T18:54:50.958071+0000","last_clean":"2024-05-08T18:54:50.958071+0000","last_became_active":"2024-05-08T18:50:26.016932+0000","last_became_peered":"2024-05-08T18:50:26.016932+0000","last_unstale":"2024-05-08T18:54:50.958071+0000","last_undegraded":"2024-05-08T18:54:50.958071+0000","last_fullsized":"2024-05-08T18:54:50.958071+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:50.957937+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:50.957937+0000","last_clean_scrub_stamp":"2024-05-08T18:54:50.957937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:59:49.351414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"27'42","reported_seq":117,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:41.827668+0000","last_change":"2024-05-08T18:54:41.827705+0000","last_active":"2024-05-08T18:54:41.827668+0000","last_peered":"2024-05-08T18:54:41.827668+0000","last_clean":"2024-05-08T18:54:41.827668+0000","last_became_active":"2024-05-08T18:50:36.055045+0000","last_became_peered":"2024-05-08T18:50:36.055045+0000","last_unstale":"2024-05-08T18:54:41.827668+0000","last_undegraded":"2024-05-08T18:54:41.827668+0000","last_fullsized":"2024-05-08T18:54:41.827668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-05-08T18:54:41.827577+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-05-08T18:54:41.827577+0000","last_clean_scrub_stamp":"2024-05-08T18:54:41.827577+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:51.438853+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":182,"num_write":115,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"27'10","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:34.116165+0000","last_change":"2024-05-08T18:54:34.116165+0000","last_active":"2024-05-08T18:54:34.116165+0000","last_peered":"2024-05-08T18:54:34.116165+0000","last_clean":"2024-05-08T18:54:34.116165+0000","last_became_active":"2024-05-08T18:50:28.025239+0000","last_became_peered":"2024-05-08T18:50:28.025239+0000","last_unstale":"2024-05-08T18:54:34.116165+0000","last_undegraded":"2024-05-08T18:54:34.116165+0000","last_fullsized":"2024-05-08T18:54:34.116165+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:34.115992+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:34.115992+0000","last_clean_scrub_stamp":"2024-05-08T18:54:34.115992+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:07:15.486159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":29,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:49.931530+0000","last_change":"2024-05-08T18:54:49.931530+0000","last_active":"2024-05-08T18:54:49.931530+0000","last_peered":"2024-05-08T18:54:49.931530+0000","last_clean":"2024-05-08T18:54:49.931530+0000","last_became_active":"2024-05-08T18:50:26.026400+0000","last_became_peered":"2024-05-08T18:50:26.026400+0000","last_unstale":"2024-05-08T18:54:49.931530+0000","last_undegraded":"2024-05-08T18:54:49.931530+0000","last_fullsized":"2024-05-08T18:54:49.931530+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:49.931359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:49.931359+0000","last_clean_scrub_stamp":"2024-05-08T18:54:49.931359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:33.427227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:46.101302+0000","last_change":"2024-05-08T18:53:46.101302+0000","last_active":"2024-05-08T18:53:46.101302+0000","last_peered":"2024-05-08T18:53:46.101302+0000","last_clean":"2024-05-08T18:53:46.101302+0000","last_became_active":"2024-05-08T18:50:30.034832+0000","last_became_peered":"2024-05-08T18:50:30.034832+0000","last_unstale":"2024-05-08T18:53:46.101302+0000","last_undegraded":"2024-05-08T18:53:46.101302+0000","last_fullsized":"2024-05-08T18:53:46.101302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:46.101144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:46.101144+0000","last_clean_scrub_stamp":"2024-05-08T18:53:46.101144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:47.297905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"27'36","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:10.133267+0000","last_change":"2024-05-08T18:54:10.133267+0000","last_active":"2024-05-08T18:54:10.133267+0000","last_peered":"2024-05-08T18:54:10.133267+0000","last_clean":"2024-05-08T18:54:10.133267+0000","last_became_active":"2024-05-08T18:50:32.042432+0000","last_became_peered":"2024-05-08T18:50:32.042432+0000","last_unstale":"2024-05-08T18:54:10.133267+0000","last_undegraded":"2024-05-08T18:54:10.133267+0000","last_fullsized":"2024-05-08T18:54:10.133267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-05-08T18:54:10.133140+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-05-08T18:54:10.133140+0000","last_clean_scrub_stamp":"2024-05-08T18:54:10.133140+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:10:47.056279+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:52.079227+0000","last_change":"2024-05-08T18:53:52.079267+0000","last_active":"2024-05-08T18:53:52.079227+0000","last_peered":"2024-05-08T18:53:52.079227+0000","last_clean":"2024-05-08T18:53:52.079227+0000","last_became_active":"2024-05-08T18:50:34.048339+0000","last_became_peered":"2024-05-08T18:50:34.048339+0000","last_unstale":"2024-05-08T18:53:52.079227+0000","last_undegraded":"2024-05-08T18:53:52.079227+0000","last_fullsized":"2024-05-08T18:53:52.079227+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:52.079130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:52.079130+0000","last_clean_scrub_stamp":"2024-05-08T18:53:52.079130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:45.266873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:40.839654+0000","last_change":"2024-05-08T18:54:40.839700+0000","last_active":"2024-05-08T18:54:40.839654+0000","last_peered":"2024-05-08T18:54:40.839654+0000","last_clean":"2024-05-08T18:54:40.839654+0000","last_became_active":"2024-05-08T18:50:36.055220+0000","last_became_peered":"2024-05-08T18:50:36.055220+0000","last_unstale":"2024-05-08T18:54:40.839654+0000","last_undegraded":"2024-05-08T18:54:40.839654+0000","last_fullsized":"2024-05-08T18:54:40.839654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-08T18:54:40.839542+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-08T18:54:40.839542+0000","last_clean_scrub_stamp":"2024-05-08T18:54:40.839542+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:47.477173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"25'2","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:03.039054+0000","last_change":"2024-05-08T18:54:03.039054+0000","last_active":"2024-05-08T18:54:03.039054+0000","last_peered":"2024-05-08T18:54:03.039054+0000","last_clean":"2024-05-08T18:54:03.039054+0000","last_became_active":"2024-05-08T18:50:28.038232+0000","last_became_peered":"2024-05-08T18:50:28.038232+0000","last_unstale":"2024-05-08T18:54:03.039054+0000","last_undegraded":"2024-05-08T18:54:03.039054+0000","last_fullsized":"2024-05-08T18:54:03.039054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:03.038905+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:03.038905+0000","last_clean_scrub_stamp":"2024-05-08T18:54:03.038905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:05.325298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"27'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:24.932026+0000","last_change":"2024-05-08T18:54:24.932026+0000","last_active":"2024-05-08T18:54:24.932026+0000","last_peered":"2024-05-08T18:54:24.932026+0000","last_clean":"2024-05-08T18:54:24.932026+0000","last_became_active":"2024-05-08T18:50:26.030986+0000","last_became_peered":"2024-05-08T18:50:26.030986+0000","last_unstale":"2024-05-08T18:54:24.932026+0000","last_undegraded":"2024-05-08T18:54:24.932026+0000","last_fullsized":"2024-05-08T18:54:24.932026+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:24.931877+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:24.931877+0000","last_clean_scrub_stamp":"2024-05-08T18:54:24.931877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:57.209315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:12.104703+0000","last_change":"2024-05-08T18:54:12.104703+0000","last_active":"2024-05-08T18:54:12.104703+0000","last_peered":"2024-05-08T18:54:12.104703+0000","last_clean":"2024-05-08T18:54:12.104703+0000","last_became_active":"2024-05-08T18:50:30.026538+0000","last_became_peered":"2024-05-08T18:50:30.026538+0000","last_unstale":"2024-05-08T18:54:12.104703+0000","last_undegraded":"2024-05-08T18:54:12.104703+0000","last_fullsized":"2024-05-08T18:54:12.104703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:12.104549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:12.104549+0000","last_clean_scrub_stamp":"2024-05-08T18:54:12.104549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:24:22.097976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"27'9","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:50.126357+0000","last_change":"2024-05-08T18:53:50.126357+0000","last_active":"2024-05-08T18:53:50.126357+0000","last_peered":"2024-05-08T18:53:50.126357+0000","last_clean":"2024-05-08T18:53:50.126357+0000","last_became_active":"2024-05-08T18:50:32.039031+0000","last_became_peered":"2024-05-08T18:50:32.039031+0000","last_unstale":"2024-05-08T18:53:50.126357+0000","last_undegraded":"2024-05-08T18:53:50.126357+0000","last_fullsized":"2024-05-08T18:53:50.126357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-08T18:53:50.126231+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-08T18:53:50.126231+0000","last_clean_scrub_stamp":"2024-05-08T18:53:50.126231+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:49.044855+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:00.011377+0000","last_change":"2024-05-08T18:54:00.011405+0000","last_active":"2024-05-08T18:54:00.011377+0000","last_peered":"2024-05-08T18:54:00.011377+0000","last_clean":"2024-05-08T18:54:00.011377+0000","last_became_active":"2024-05-08T18:50:34.050512+0000","last_became_peered":"2024-05-08T18:50:34.050512+0000","last_unstale":"2024-05-08T18:54:00.011377+0000","last_undegraded":"2024-05-08T18:54:00.011377+0000","last_fullsized":"2024-05-08T18:54:00.011377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:00.011283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:00.011283+0000","last_clean_scrub_stamp":"2024-05-08T18:54:00.011283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:48.823802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"25'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:44.075715+0000","last_change":"2024-05-08T18:54:44.075746+0000","last_active":"2024-05-08T18:54:44.075715+0000","last_peered":"2024-05-08T18:54:44.075715+0000","last_clean":"2024-05-08T18:54:44.075715+0000","last_became_active":"2024-05-08T18:50:36.048075+0000","last_became_peered":"2024-05-08T18:50:36.048075+0000","last_unstale":"2024-05-08T18:54:44.075715+0000","last_undegraded":"2024-05-08T18:54:44.075715+0000","last_fullsized":"2024-05-08T18:54:44.075715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-08T18:54:44.075605+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-08T18:54:44.075605+0000","last_clean_scrub_stamp":"2024-05-08T18:54:44.075605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:17:44.149342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"27'10","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:33.160341+0000","last_change":"2024-05-08T18:54:33.160341+0000","last_active":"2024-05-08T18:54:33.160341+0000","last_peered":"2024-05-08T18:54:33.160341+0000","last_clean":"2024-05-08T18:54:33.160341+0000","last_became_active":"2024-05-08T18:50:28.025867+0000","last_became_peered":"2024-05-08T18:50:28.025867+0000","last_unstale":"2024-05-08T18:54:33.160341+0000","last_undegraded":"2024-05-08T18:54:33.160341+0000","last_fullsized":"2024-05-08T18:54:33.160341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:33.160215+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:33.160215+0000","last_clean_scrub_stamp":"2024-05-08T18:54:33.160215+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:35.162766+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"27'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:38.072376+0000","last_change":"2024-05-08T18:54:38.072376+0000","last_active":"2024-05-08T18:54:38.072376+0000","last_peered":"2024-05-08T18:54:38.072376+0000","last_clean":"2024-05-08T18:54:38.072376+0000","last_became_active":"2024-05-08T18:50:26.025410+0000","last_became_peered":"2024-05-08T18:50:26.025410+0000","last_unstale":"2024-05-08T18:54:38.072376+0000","last_undegraded":"2024-05-08T18:54:38.072376+0000","last_fullsized":"2024-05-08T18:54:38.072376+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:38.072264+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:38.072264+0000","last_clean_scrub_stamp":"2024-05-08T18:54:38.072264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:02.503035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:09.051964+0000","last_change":"2024-05-08T18:54:09.051964+0000","last_active":"2024-05-08T18:54:09.051964+0000","last_peered":"2024-05-08T18:54:09.051964+0000","last_clean":"2024-05-08T18:54:09.051964+0000","last_became_active":"2024-05-08T18:50:30.029196+0000","last_became_peered":"2024-05-08T18:50:30.029196+0000","last_unstale":"2024-05-08T18:54:09.051964+0000","last_undegraded":"2024-05-08T18:54:09.051964+0000","last_fullsized":"2024-05-08T18:54:09.051964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:09.051799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:09.051799+0000","last_clean_scrub_stamp":"2024-05-08T18:54:09.051799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:04.437066+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"27'15","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:51.005796+0000","last_change":"2024-05-08T18:53:51.005796+0000","last_active":"2024-05-08T18:53:51.005796+0000","last_peered":"2024-05-08T18:53:51.005796+0000","last_clean":"2024-05-08T18:53:51.005796+0000","last_became_active":"2024-05-08T18:50:32.044056+0000","last_became_peered":"2024-05-08T18:50:32.044056+0000","last_unstale":"2024-05-08T18:53:51.005796+0000","last_undegraded":"2024-05-08T18:53:51.005796+0000","last_fullsized":"2024-05-08T18:53:51.005796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-08T18:53:51.005656+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-08T18:53:51.005656+0000","last_clean_scrub_stamp":"2024-05-08T18:53:51.005656+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:01:56.400586+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"27'285","reported_seq":402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:09.098897+0000","last_change":"2024-05-08T18:54:09.098926+0000","last_active":"2024-05-08T18:54:09.098897+0000","last_peered":"2024-05-08T18:54:09.098897+0000","last_clean":"2024-05-08T18:54:09.098897+0000","last_became_active":"2024-05-08T18:50:34.041872+0000","last_became_peered":"2024-05-08T18:50:34.041872+0000","last_unstale":"2024-05-08T18:54:09.098897+0000","last_undegraded":"2024-05-08T18:54:09.098897+0000","last_fullsized":"2024-05-08T18:54:09.098897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:54:09.098809+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:54:09.098809+0000","last_clean_scrub_stamp":"2024-05-08T18:54:09.098809+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:06:58.498954+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:34.867887+0000","last_change":"2024-05-08T18:54:34.867909+0000","last_active":"2024-05-08T18:54:34.867887+0000","last_peered":"2024-05-08T18:54:34.867887+0000","last_clean":"2024-05-08T18:54:34.867887+0000","last_became_active":"2024-05-08T18:50:36.049346+0000","last_became_peered":"2024-05-08T18:50:36.049346+0000","last_unstale":"2024-05-08T18:54:34.867887+0000","last_undegraded":"2024-05-08T18:54:34.867887+0000","last_fullsized":"2024-05-08T18:54:34.867887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:34.867765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:34.867765+0000","last_clean_scrub_stamp":"2024-05-08T18:54:34.867765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:11.691786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"27'6","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:13.114946+0000","last_change":"2024-05-08T18:54:13.114946+0000","last_active":"2024-05-08T18:54:13.114946+0000","last_peered":"2024-05-08T18:54:13.114946+0000","last_clean":"2024-05-08T18:54:13.114946+0000","last_became_active":"2024-05-08T18:50:28.031332+0000","last_became_peered":"2024-05-08T18:50:28.031332+0000","last_unstale":"2024-05-08T18:54:13.114946+0000","last_undegraded":"2024-05-08T18:54:13.114946+0000","last_fullsized":"2024-05-08T18:54:13.114946+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:13.114824+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:13.114824+0000","last_clean_scrub_stamp":"2024-05-08T18:54:13.114824+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:53:47.219370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:18.862299+0000","last_change":"2024-05-08T18:54:18.862299+0000","last_active":"2024-05-08T18:54:18.862299+0000","last_peered":"2024-05-08T18:54:18.862299+0000","last_clean":"2024-05-08T18:54:18.862299+0000","last_became_active":"2024-05-08T18:50:26.032155+0000","last_became_peered":"2024-05-08T18:50:26.032155+0000","last_unstale":"2024-05-08T18:54:18.862299+0000","last_undegraded":"2024-05-08T18:54:18.862299+0000","last_fullsized":"2024-05-08T18:54:18.862299+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:18.862147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:18.862147+0000","last_clean_scrub_stamp":"2024-05-08T18:54:18.862147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:21.148541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"27'5","reported_seq":239,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:49.069207+0000","last_change":"2024-05-08T18:53:49.069207+0000","last_active":"2024-05-08T18:53:49.069207+0000","last_peered":"2024-05-08T18:53:49.069207+0000","last_clean":"2024-05-08T18:53:49.069207+0000","last_became_active":"2024-05-08T18:50:30.034798+0000","last_became_peered":"2024-05-08T18:50:30.034798+0000","last_unstale":"2024-05-08T18:53:49.069207+0000","last_undegraded":"2024-05-08T18:53:49.069207+0000","last_fullsized":"2024-05-08T18:53:49.069207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-08T18:53:49.069063+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-08T18:53:49.069063+0000","last_clean_scrub_stamp":"2024-05-08T18:53:49.069063+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:32.617643+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"27'36","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.006323+0000","last_change":"2024-05-08T18:53:53.006323+0000","last_active":"2024-05-08T18:53:53.006323+0000","last_peered":"2024-05-08T18:53:53.006323+0000","last_clean":"2024-05-08T18:53:53.006323+0000","last_became_active":"2024-05-08T18:50:32.043573+0000","last_became_peered":"2024-05-08T18:50:32.043573+0000","last_unstale":"2024-05-08T18:53:53.006323+0000","last_undegraded":"2024-05-08T18:53:53.006323+0000","last_fullsized":"2024-05-08T18:53:53.006323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-05-08T18:53:53.006187+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-05-08T18:53:53.006187+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.006187+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:39.343300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"27'285","reported_seq":414,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:03.005312+0000","last_change":"2024-05-08T18:54:03.005312+0000","last_active":"2024-05-08T18:54:03.005312+0000","last_peered":"2024-05-08T18:54:03.005312+0000","last_clean":"2024-05-08T18:54:03.005312+0000","last_became_active":"2024-05-08T18:50:34.050122+0000","last_became_peered":"2024-05-08T18:50:34.050122+0000","last_unstale":"2024-05-08T18:54:03.005312+0000","last_undegraded":"2024-05-08T18:54:03.005312+0000","last_fullsized":"2024-05-08T18:54:03.005312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:54:03.005191+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:54:03.005191+0000","last_clean_scrub_stamp":"2024-05-08T18:54:03.005191+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:17.903758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"27'6","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:19.034422+0000","last_change":"2024-05-08T18:54:19.034422+0000","last_active":"2024-05-08T18:54:19.034422+0000","last_peered":"2024-05-08T18:54:19.034422+0000","last_clean":"2024-05-08T18:54:19.034422+0000","last_became_active":"2024-05-08T18:50:28.034992+0000","last_became_peered":"2024-05-08T18:50:28.034992+0000","last_unstale":"2024-05-08T18:54:19.034422+0000","last_undegraded":"2024-05-08T18:54:19.034422+0000","last_fullsized":"2024-05-08T18:54:19.034422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:19.034312+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:19.034312+0000","last_clean_scrub_stamp":"2024-05-08T18:54:19.034312+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:24.299155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:28.954650+0000","last_change":"2024-05-08T18:54:28.954650+0000","last_active":"2024-05-08T18:54:28.954650+0000","last_peered":"2024-05-08T18:54:28.954650+0000","last_clean":"2024-05-08T18:54:28.954650+0000","last_became_active":"2024-05-08T18:50:26.023141+0000","last_became_peered":"2024-05-08T18:50:26.023141+0000","last_unstale":"2024-05-08T18:54:28.954650+0000","last_undegraded":"2024-05-08T18:54:28.954650+0000","last_fullsized":"2024-05-08T18:54:28.954650+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:28.954540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:28.954540+0000","last_clean_scrub_stamp":"2024-05-08T18:54:28.954540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:41.699354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:59.048754+0000","last_change":"2024-05-08T18:53:59.048754+0000","last_active":"2024-05-08T18:53:59.048754+0000","last_peered":"2024-05-08T18:53:59.048754+0000","last_clean":"2024-05-08T18:53:59.048754+0000","last_became_active":"2024-05-08T18:50:30.029482+0000","last_became_peered":"2024-05-08T18:50:30.029482+0000","last_unstale":"2024-05-08T18:53:59.048754+0000","last_undegraded":"2024-05-08T18:53:59.048754+0000","last_fullsized":"2024-05-08T18:53:59.048754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:59.048606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:59.048606+0000","last_clean_scrub_stamp":"2024-05-08T18:53:59.048606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:51.442116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"27'52","reported_seq":113,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:54.955673+0000","last_change":"2024-05-08T18:53:54.955673+0000","last_active":"2024-05-08T18:53:54.955673+0000","last_peered":"2024-05-08T18:53:54.955673+0000","last_clean":"2024-05-08T18:53:54.955673+0000","last_became_active":"2024-05-08T18:50:32.038121+0000","last_became_peered":"2024-05-08T18:50:32.038121+0000","last_unstale":"2024-05-08T18:53:54.955673+0000","last_undegraded":"2024-05-08T18:53:54.955673+0000","last_fullsized":"2024-05-08T18:53:54.955673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'52","last_scrub_stamp":"2024-05-08T18:53:54.955515+0000","last_deep_scrub":"27'52","last_deep_scrub_stamp":"2024-05-08T18:53:54.955515+0000","last_clean_scrub_stamp":"2024-05-08T18:53:54.955515+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:16.055669+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:44.931154+0000","last_change":"2024-05-08T18:53:44.931154+0000","last_active":"2024-05-08T18:53:44.931154+0000","last_peered":"2024-05-08T18:53:44.931154+0000","last_clean":"2024-05-08T18:53:44.931154+0000","last_became_active":"2024-05-08T18:50:34.047404+0000","last_became_peered":"2024-05-08T18:50:34.047404+0000","last_unstale":"2024-05-08T18:53:44.931154+0000","last_undegraded":"2024-05-08T18:53:44.931154+0000","last_fullsized":"2024-05-08T18:53:44.931154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:44.931063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:44.931063+0000","last_clean_scrub_stamp":"2024-05-08T18:53:44.931063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:50.136970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:36.818397+0000","last_change":"2024-05-08T18:54:36.818397+0000","last_active":"2024-05-08T18:54:36.818397+0000","last_peered":"2024-05-08T18:54:36.818397+0000","last_clean":"2024-05-08T18:54:36.818397+0000","last_became_active":"2024-05-08T18:50:36.051055+0000","last_became_peered":"2024-05-08T18:50:36.051055+0000","last_unstale":"2024-05-08T18:54:36.818397+0000","last_undegraded":"2024-05-08T18:54:36.818397+0000","last_fullsized":"2024-05-08T18:54:36.818397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-08T18:54:36.818220+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-08T18:54:36.818220+0000","last_clean_scrub_stamp":"2024-05-08T18:54:36.818220+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:36.666898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"27'8","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:16.905203+0000","last_change":"2024-05-08T18:54:16.905203+0000","last_active":"2024-05-08T18:54:16.905203+0000","last_peered":"2024-05-08T18:54:16.905203+0000","last_clean":"2024-05-08T18:54:16.905203+0000","last_became_active":"2024-05-08T18:50:28.018022+0000","last_became_peered":"2024-05-08T18:50:28.018022+0000","last_unstale":"2024-05-08T18:54:16.905203+0000","last_undegraded":"2024-05-08T18:54:16.905203+0000","last_fullsized":"2024-05-08T18:54:16.905203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:16.905016+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:16.905016+0000","last_clean_scrub_stamp":"2024-05-08T18:54:16.905016+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:46.535490+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:32.845560+0000","last_change":"2024-05-08T18:54:32.845560+0000","last_active":"2024-05-08T18:54:32.845560+0000","last_peered":"2024-05-08T18:54:32.845560+0000","last_clean":"2024-05-08T18:54:32.845560+0000","last_became_active":"2024-05-08T18:50:26.025028+0000","last_became_peered":"2024-05-08T18:50:26.025028+0000","last_unstale":"2024-05-08T18:54:32.845560+0000","last_undegraded":"2024-05-08T18:54:32.845560+0000","last_fullsized":"2024-05-08T18:54:32.845560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:32.845406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:32.845406+0000","last_clean_scrub_stamp":"2024-05-08T18:54:32.845406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:09.768544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:05.046379+0000","last_change":"2024-05-08T18:54:05.046379+0000","last_active":"2024-05-08T18:54:05.046379+0000","last_peered":"2024-05-08T18:54:05.046379+0000","last_clean":"2024-05-08T18:54:05.046379+0000","last_became_active":"2024-05-08T18:50:30.031574+0000","last_became_peered":"2024-05-08T18:50:30.031574+0000","last_unstale":"2024-05-08T18:54:05.046379+0000","last_undegraded":"2024-05-08T18:54:05.046379+0000","last_fullsized":"2024-05-08T18:54:05.046379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:05.046264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:05.046264+0000","last_clean_scrub_stamp":"2024-05-08T18:54:05.046264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:56.573231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"27'38","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:04.084045+0000","last_change":"2024-05-08T18:54:04.084045+0000","last_active":"2024-05-08T18:54:04.084045+0000","last_peered":"2024-05-08T18:54:04.084045+0000","last_clean":"2024-05-08T18:54:04.084045+0000","last_became_active":"2024-05-08T18:50:32.041239+0000","last_became_peered":"2024-05-08T18:50:32.041239+0000","last_unstale":"2024-05-08T18:54:04.084045+0000","last_undegraded":"2024-05-08T18:54:04.084045+0000","last_fullsized":"2024-05-08T18:54:04.084045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2024-05-08T18:54:04.083924+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2024-05-08T18:54:04.083924+0000","last_clean_scrub_stamp":"2024-05-08T18:54:04.083924+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:32.880132+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:50.038945+0000","last_change":"2024-05-08T18:53:50.038945+0000","last_active":"2024-05-08T18:53:50.038945+0000","last_peered":"2024-05-08T18:53:50.038945+0000","last_clean":"2024-05-08T18:53:50.038945+0000","last_became_active":"2024-05-08T18:50:34.044487+0000","last_became_peered":"2024-05-08T18:50:34.044487+0000","last_unstale":"2024-05-08T18:53:50.038945+0000","last_undegraded":"2024-05-08T18:53:50.038945+0000","last_fullsized":"2024-05-08T18:53:50.038945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:50.038762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:50.038762+0000","last_clean_scrub_stamp":"2024-05-08T18:53:50.038762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:43.226504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"27'8","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:12.011630+0000","last_change":"2024-05-08T18:54:12.011630+0000","last_active":"2024-05-08T18:54:12.011630+0000","last_peered":"2024-05-08T18:54:12.011630+0000","last_clean":"2024-05-08T18:54:12.011630+0000","last_became_active":"2024-05-08T18:50:36.050379+0000","last_became_peered":"2024-05-08T18:50:36.050379+0000","last_unstale":"2024-05-08T18:54:12.011630+0000","last_undegraded":"2024-05-08T18:54:12.011630+0000","last_fullsized":"2024-05-08T18:54:12.011630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:12.011510+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:12.011510+0000","last_clean_scrub_stamp":"2024-05-08T18:54:12.011510+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:47.390905+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"27'6","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:33.819673+0000","last_change":"2024-05-08T18:54:33.819673+0000","last_active":"2024-05-08T18:54:33.819673+0000","last_peered":"2024-05-08T18:54:33.819673+0000","last_clean":"2024-05-08T18:54:33.819673+0000","last_became_active":"2024-05-08T18:50:28.036821+0000","last_became_peered":"2024-05-08T18:50:28.036821+0000","last_unstale":"2024-05-08T18:54:33.819673+0000","last_undegraded":"2024-05-08T18:54:33.819673+0000","last_fullsized":"2024-05-08T18:54:33.819673+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:33.819529+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:33.819529+0000","last_clean_scrub_stamp":"2024-05-08T18:54:33.819529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:42.896465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:43.071690+0000","last_change":"2024-05-08T18:54:43.071690+0000","last_active":"2024-05-08T18:54:43.071690+0000","last_peered":"2024-05-08T18:54:43.071690+0000","last_clean":"2024-05-08T18:54:43.071690+0000","last_became_active":"2024-05-08T18:50:26.022938+0000","last_became_peered":"2024-05-08T18:50:26.022938+0000","last_unstale":"2024-05-08T18:54:43.071690+0000","last_undegraded":"2024-05-08T18:54:43.071690+0000","last_fullsized":"2024-05-08T18:54:43.071690+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:43.071570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:43.071570+0000","last_clean_scrub_stamp":"2024-05-08T18:54:43.071570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:15.591502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:10.062412+0000","last_change":"2024-05-08T18:54:10.062412+0000","last_active":"2024-05-08T18:54:10.062412+0000","last_peered":"2024-05-08T18:54:10.062412+0000","last_clean":"2024-05-08T18:54:10.062412+0000","last_became_active":"2024-05-08T18:50:30.029134+0000","last_became_peered":"2024-05-08T18:50:30.029134+0000","last_unstale":"2024-05-08T18:54:10.062412+0000","last_undegraded":"2024-05-08T18:54:10.062412+0000","last_fullsized":"2024-05-08T18:54:10.062412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:10.062263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:10.062263+0000","last_clean_scrub_stamp":"2024-05-08T18:54:10.062263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:53.020523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"27'46","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:48.046823+0000","last_change":"2024-05-08T18:53:48.046823+0000","last_active":"2024-05-08T18:53:48.046823+0000","last_peered":"2024-05-08T18:53:48.046823+0000","last_clean":"2024-05-08T18:53:48.046823+0000","last_became_active":"2024-05-08T18:50:32.035189+0000","last_became_peered":"2024-05-08T18:50:32.035189+0000","last_unstale":"2024-05-08T18:53:48.046823+0000","last_undegraded":"2024-05-08T18:53:48.046823+0000","last_fullsized":"2024-05-08T18:53:48.046823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-05-08T18:53:48.046702+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-05-08T18:53:48.046702+0000","last_clean_scrub_stamp":"2024-05-08T18:53:48.046702+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:09.757527+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"27'285","reported_seq":367,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:54.987120+0000","last_change":"2024-05-08T18:53:54.987120+0000","last_active":"2024-05-08T18:53:54.987120+0000","last_peered":"2024-05-08T18:53:54.987120+0000","last_clean":"2024-05-08T18:53:54.987120+0000","last_became_active":"2024-05-08T18:50:34.047999+0000","last_became_peered":"2024-05-08T18:50:34.047999+0000","last_unstale":"2024-05-08T18:53:54.987120+0000","last_undegraded":"2024-05-08T18:53:54.987120+0000","last_fullsized":"2024-05-08T18:53:54.987120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:54.986938+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:54.986938+0000","last_clean_scrub_stamp":"2024-05-08T18:53:54.986938+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:56.968910+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:43.038137+0000","last_change":"2024-05-08T18:54:43.038137+0000","last_active":"2024-05-08T18:54:43.038137+0000","last_peered":"2024-05-08T18:54:43.038137+0000","last_clean":"2024-05-08T18:54:43.038137+0000","last_became_active":"2024-05-08T18:50:36.047981+0000","last_became_peered":"2024-05-08T18:50:36.047981+0000","last_unstale":"2024-05-08T18:54:43.038137+0000","last_undegraded":"2024-05-08T18:54:43.038137+0000","last_fullsized":"2024-05-08T18:54:43.038137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:43.038023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:43.038023+0000","last_clean_scrub_stamp":"2024-05-08T18:54:43.038023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:32.770228+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"27'8","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:10.920922+0000","last_change":"2024-05-08T18:54:10.920922+0000","last_active":"2024-05-08T18:54:10.920922+0000","last_peered":"2024-05-08T18:54:10.920922+0000","last_clean":"2024-05-08T18:54:10.920922+0000","last_became_active":"2024-05-08T18:50:28.020004+0000","last_became_peered":"2024-05-08T18:50:28.020004+0000","last_unstale":"2024-05-08T18:54:10.920922+0000","last_undegraded":"2024-05-08T18:54:10.920922+0000","last_fullsized":"2024-05-08T18:54:10.920922+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:10.920810+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:10.920810+0000","last_clean_scrub_stamp":"2024-05-08T18:54:10.920810+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:32.631635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:48.979774+0000","last_change":"2024-05-08T18:54:48.979774+0000","last_active":"2024-05-08T18:54:48.979774+0000","last_peered":"2024-05-08T18:54:48.979774+0000","last_clean":"2024-05-08T18:54:48.979774+0000","last_became_active":"2024-05-08T18:50:26.015955+0000","last_became_peered":"2024-05-08T18:50:26.015955+0000","last_unstale":"2024-05-08T18:54:48.979774+0000","last_undegraded":"2024-05-08T18:54:48.979774+0000","last_fullsized":"2024-05-08T18:54:48.979774+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:48.979630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:48.979630+0000","last_clean_scrub_stamp":"2024-05-08T18:54:48.979630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:26:14.682378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:06.010199+0000","last_change":"2024-05-08T18:54:06.010199+0000","last_active":"2024-05-08T18:54:06.010199+0000","last_peered":"2024-05-08T18:54:06.010199+0000","last_clean":"2024-05-08T18:54:06.010199+0000","last_became_active":"2024-05-08T18:50:30.030140+0000","last_became_peered":"2024-05-08T18:50:30.030140+0000","last_unstale":"2024-05-08T18:54:06.010199+0000","last_undegraded":"2024-05-08T18:54:06.010199+0000","last_fullsized":"2024-05-08T18:54:06.010199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:06.010052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:06.010052+0000","last_clean_scrub_stamp":"2024-05-08T18:54:06.010052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:14.779273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"27'64","reported_seq":138,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:56.075427+0000","last_change":"2024-05-08T18:53:56.075427+0000","last_active":"2024-05-08T18:53:56.075427+0000","last_peered":"2024-05-08T18:53:56.075427+0000","last_clean":"2024-05-08T18:53:56.075427+0000","last_became_active":"2024-05-08T18:50:32.040633+0000","last_became_peered":"2024-05-08T18:50:32.040633+0000","last_unstale":"2024-05-08T18:53:56.075427+0000","last_undegraded":"2024-05-08T18:53:56.075427+0000","last_fullsized":"2024-05-08T18:53:56.075427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'64","last_scrub_stamp":"2024-05-08T18:53:56.075259+0000","last_deep_scrub":"27'64","last_deep_scrub_stamp":"2024-05-08T18:53:56.075259+0000","last_clean_scrub_stamp":"2024-05-08T18:53:56.075259+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:31.454654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:51.968305+0000","last_change":"2024-05-08T18:53:51.968305+0000","last_active":"2024-05-08T18:53:51.968305+0000","last_peered":"2024-05-08T18:53:51.968305+0000","last_clean":"2024-05-08T18:53:51.968305+0000","last_became_active":"2024-05-08T18:50:34.043817+0000","last_became_peered":"2024-05-08T18:50:34.043817+0000","last_unstale":"2024-05-08T18:53:51.968305+0000","last_undegraded":"2024-05-08T18:53:51.968305+0000","last_fullsized":"2024-05-08T18:53:51.968305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:51.968195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:51.968195+0000","last_clean_scrub_stamp":"2024-05-08T18:53:51.968195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:00.724814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"27'21","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:46.081031+0000","last_change":"2024-05-08T18:54:46.081031+0000","last_active":"2024-05-08T18:54:46.081031+0000","last_peered":"2024-05-08T18:54:46.081031+0000","last_clean":"2024-05-08T18:54:46.081031+0000","last_became_active":"2024-05-08T18:50:36.054237+0000","last_became_peered":"2024-05-08T18:50:36.054237+0000","last_unstale":"2024-05-08T18:54:46.081031+0000","last_undegraded":"2024-05-08T18:54:46.081031+0000","last_fullsized":"2024-05-08T18:54:46.081031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-05-08T18:54:46.080904+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-05-08T18:54:46.080904+0000","last_clean_scrub_stamp":"2024-05-08T18:54:46.080904+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:34.502961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"27'10","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:40.754428+0000","last_change":"2024-05-08T18:54:40.754452+0000","last_active":"2024-05-08T18:54:40.754428+0000","last_peered":"2024-05-08T18:54:40.754428+0000","last_clean":"2024-05-08T18:54:40.754428+0000","last_became_active":"2024-05-08T18:51:15.085560+0000","last_became_peered":"2024-05-08T18:51:15.085560+0000","last_unstale":"2024-05-08T18:54:40.754428+0000","last_undegraded":"2024-05-08T18:54:40.754428+0000","last_fullsized":"2024-05-08T18:54:40.754428+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:40.754335+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:40.754335+0000","last_clean_scrub_stamp":"2024-05-08T18:54:40.754335+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:45.155754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:47.117279+0000","last_change":"2024-05-08T18:54:47.117279+0000","last_active":"2024-05-08T18:54:47.117279+0000","last_peered":"2024-05-08T18:54:47.117279+0000","last_clean":"2024-05-08T18:54:47.117279+0000","last_became_active":"2024-05-08T18:51:15.080071+0000","last_became_peered":"2024-05-08T18:51:15.080071+0000","last_unstale":"2024-05-08T18:54:47.117279+0000","last_undegraded":"2024-05-08T18:54:47.117279+0000","last_fullsized":"2024-05-08T18:54:47.117279+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:47.117151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:47.117151+0000","last_clean_scrub_stamp":"2024-05-08T18:54:47.117151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:49:33.993046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:01.928071+0000","last_change":"2024-05-08T18:54:01.928071+0000","last_active":"2024-05-08T18:54:01.928071+0000","last_peered":"2024-05-08T18:54:01.928071+0000","last_clean":"2024-05-08T18:54:01.928071+0000","last_became_active":"2024-05-08T18:50:30.033318+0000","last_became_peered":"2024-05-08T18:50:30.033318+0000","last_unstale":"2024-05-08T18:54:01.928071+0000","last_undegraded":"2024-05-08T18:54:01.928071+0000","last_fullsized":"2024-05-08T18:54:01.928071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:01.927918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:01.927918+0000","last_clean_scrub_stamp":"2024-05-08T18:54:01.927918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:00.640748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"27'40","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.113321+0000","last_change":"2024-05-08T18:53:53.113321+0000","last_active":"2024-05-08T18:53:53.113321+0000","last_peered":"2024-05-08T18:53:53.113321+0000","last_clean":"2024-05-08T18:53:53.113321+0000","last_became_active":"2024-05-08T18:50:32.034914+0000","last_became_peered":"2024-05-08T18:50:32.034914+0000","last_unstale":"2024-05-08T18:53:53.113321+0000","last_undegraded":"2024-05-08T18:53:53.113321+0000","last_fullsized":"2024-05-08T18:53:53.113321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-05-08T18:53:53.113190+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-05-08T18:53:53.113190+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.113190+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:19.438913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:12.112046+0000","last_change":"2024-05-08T18:54:12.112046+0000","last_active":"2024-05-08T18:54:12.112046+0000","last_peered":"2024-05-08T18:54:12.112046+0000","last_clean":"2024-05-08T18:54:12.112046+0000","last_became_active":"2024-05-08T18:50:34.047075+0000","last_became_peered":"2024-05-08T18:50:34.047075+0000","last_unstale":"2024-05-08T18:54:12.112046+0000","last_undegraded":"2024-05-08T18:54:12.112046+0000","last_fullsized":"2024-05-08T18:54:12.112046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:12.111934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:12.111934+0000","last_clean_scrub_stamp":"2024-05-08T18:54:12.111934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:43:48.935955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:28.106620+0000","last_change":"2024-05-08T18:54:28.106620+0000","last_active":"2024-05-08T18:54:28.106620+0000","last_peered":"2024-05-08T18:54:28.106620+0000","last_clean":"2024-05-08T18:54:28.106620+0000","last_became_active":"2024-05-08T18:50:36.055385+0000","last_became_peered":"2024-05-08T18:50:36.055385+0000","last_unstale":"2024-05-08T18:54:28.106620+0000","last_undegraded":"2024-05-08T18:54:28.106620+0000","last_fullsized":"2024-05-08T18:54:28.106620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:28.106488+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:28.106488+0000","last_clean_scrub_stamp":"2024-05-08T18:54:28.106488+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:32:44.661104+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'4","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:01.045321+0000","last_change":"2024-05-08T18:54:01.045321+0000","last_active":"2024-05-08T18:54:01.045321+0000","last_peered":"2024-05-08T18:54:01.045321+0000","last_clean":"2024-05-08T18:54:01.045321+0000","last_became_active":"2024-05-08T18:50:28.038633+0000","last_became_peered":"2024-05-08T18:50:28.038633+0000","last_unstale":"2024-05-08T18:54:01.045321+0000","last_undegraded":"2024-05-08T18:54:01.045321+0000","last_fullsized":"2024-05-08T18:54:01.045321+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:01.045175+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:01.045175+0000","last_clean_scrub_stamp":"2024-05-08T18:54:01.045175+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:30.675649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:55:00.915585+0000","last_change":"2024-05-08T18:55:00.915629+0000","last_active":"2024-05-08T18:55:00.915585+0000","last_peered":"2024-05-08T18:55:00.915585+0000","last_clean":"2024-05-08T18:55:00.915585+0000","last_became_active":"2024-05-08T18:50:26.016308+0000","last_became_peered":"2024-05-08T18:50:26.016308+0000","last_unstale":"2024-05-08T18:55:00.915585+0000","last_undegraded":"2024-05-08T18:55:00.915585+0000","last_fullsized":"2024-05-08T18:55:00.915585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:55:00.915463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:55:00.915463+0000","last_clean_scrub_stamp":"2024-05-08T18:55:00.915463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:30:26.830853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:04.039242+0000","last_change":"2024-05-08T18:54:04.039242+0000","last_active":"2024-05-08T18:54:04.039242+0000","last_peered":"2024-05-08T18:54:04.039242+0000","last_clean":"2024-05-08T18:54:04.039242+0000","last_became_active":"2024-05-08T18:50:30.031765+0000","last_became_peered":"2024-05-08T18:50:30.031765+0000","last_unstale":"2024-05-08T18:54:04.039242+0000","last_undegraded":"2024-05-08T18:54:04.039242+0000","last_fullsized":"2024-05-08T18:54:04.039242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:04.039072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:04.039072+0000","last_clean_scrub_stamp":"2024-05-08T18:54:04.039072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:13.913375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"27'45","reported_seq":104,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.930760+0000","last_change":"2024-05-08T18:53:58.930760+0000","last_active":"2024-05-08T18:53:58.930760+0000","last_peered":"2024-05-08T18:53:58.930760+0000","last_clean":"2024-05-08T18:53:58.930760+0000","last_became_active":"2024-05-08T18:50:32.035131+0000","last_became_peered":"2024-05-08T18:50:32.035131+0000","last_unstale":"2024-05-08T18:53:58.930760+0000","last_undegraded":"2024-05-08T18:53:58.930760+0000","last_fullsized":"2024-05-08T18:53:58.930760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-05-08T18:53:58.930638+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-05-08T18:53:58.930638+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.930638+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:08:52.118381+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"27'285","reported_seq":443,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.946321+0000","last_change":"2024-05-08T18:53:45.946321+0000","last_active":"2024-05-08T18:53:45.946321+0000","last_peered":"2024-05-08T18:53:45.946321+0000","last_clean":"2024-05-08T18:53:45.946321+0000","last_became_active":"2024-05-08T18:50:34.047184+0000","last_became_peered":"2024-05-08T18:50:34.047184+0000","last_unstale":"2024-05-08T18:53:45.946321+0000","last_undegraded":"2024-05-08T18:53:45.946321+0000","last_fullsized":"2024-05-08T18:53:45.946321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:45.946195+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:45.946195+0000","last_clean_scrub_stamp":"2024-05-08T18:53:45.946195+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:08:51.238216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"27'13","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:07.061529+0000","last_change":"2024-05-08T18:54:07.061529+0000","last_active":"2024-05-08T18:54:07.061529+0000","last_peered":"2024-05-08T18:54:07.061529+0000","last_clean":"2024-05-08T18:54:07.061529+0000","last_became_active":"2024-05-08T18:50:36.046209+0000","last_became_peered":"2024-05-08T18:50:36.046209+0000","last_unstale":"2024-05-08T18:54:07.061529+0000","last_undegraded":"2024-05-08T18:54:07.061529+0000","last_fullsized":"2024-05-08T18:54:07.061529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-05-08T18:54:07.061418+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-05-08T18:54:07.061418+0000","last_clean_scrub_stamp":"2024-05-08T18:54:07.061418+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:19.023570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'6","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:08.865151+0000","last_change":"2024-05-08T18:54:08.865151+0000","last_active":"2024-05-08T18:54:08.865151+0000","last_peered":"2024-05-08T18:54:08.865151+0000","last_clean":"2024-05-08T18:54:08.865151+0000","last_became_active":"2024-05-08T18:50:28.036946+0000","last_became_peered":"2024-05-08T18:50:28.036946+0000","last_unstale":"2024-05-08T18:54:08.865151+0000","last_undegraded":"2024-05-08T18:54:08.865151+0000","last_fullsized":"2024-05-08T18:54:08.865151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:08.864977+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:08.864977+0000","last_clean_scrub_stamp":"2024-05-08T18:54:08.864977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:16.323961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:35.088964+0000","last_change":"2024-05-08T18:54:35.088964+0000","last_active":"2024-05-08T18:54:35.088964+0000","last_peered":"2024-05-08T18:54:35.088964+0000","last_clean":"2024-05-08T18:54:35.088964+0000","last_became_active":"2024-05-08T18:50:26.027657+0000","last_became_peered":"2024-05-08T18:50:26.027657+0000","last_unstale":"2024-05-08T18:54:35.088964+0000","last_undegraded":"2024-05-08T18:54:35.088964+0000","last_fullsized":"2024-05-08T18:54:35.088964+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:35.088831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:35.088831+0000","last_clean_scrub_stamp":"2024-05-08T18:54:35.088831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:07:23.601707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"27'5","reported_seq":429,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:02.003952+0000","last_change":"2024-05-08T18:54:02.003952+0000","last_active":"2024-05-08T18:54:02.003952+0000","last_peered":"2024-05-08T18:54:02.003952+0000","last_clean":"2024-05-08T18:54:02.003952+0000","last_became_active":"2024-05-08T18:50:30.027420+0000","last_became_peered":"2024-05-08T18:50:30.027420+0000","last_unstale":"2024-05-08T18:54:02.003952+0000","last_undegraded":"2024-05-08T18:54:02.003952+0000","last_fullsized":"2024-05-08T18:54:02.003952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-08T18:54:02.003784+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-08T18:54:02.003784+0000","last_clean_scrub_stamp":"2024-05-08T18:54:02.003784+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:09.462769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'16","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:00.007874+0000","last_change":"2024-05-08T18:54:00.007874+0000","last_active":"2024-05-08T18:54:00.007874+0000","last_peered":"2024-05-08T18:54:00.007874+0000","last_clean":"2024-05-08T18:54:00.007874+0000","last_became_active":"2024-05-08T18:50:32.040988+0000","last_became_peered":"2024-05-08T18:50:32.040988+0000","last_unstale":"2024-05-08T18:54:00.007874+0000","last_undegraded":"2024-05-08T18:54:00.007874+0000","last_fullsized":"2024-05-08T18:54:00.007874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-05-08T18:54:00.007737+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-05-08T18:54:00.007737+0000","last_clean_scrub_stamp":"2024-05-08T18:54:00.007737+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:07.927405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"27'285","reported_seq":472,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:46.055745+0000","last_change":"2024-05-08T18:53:46.055745+0000","last_active":"2024-05-08T18:53:46.055745+0000","last_peered":"2024-05-08T18:53:46.055745+0000","last_clean":"2024-05-08T18:53:46.055745+0000","last_became_active":"2024-05-08T18:50:34.040477+0000","last_became_peered":"2024-05-08T18:50:34.040477+0000","last_unstale":"2024-05-08T18:53:46.055745+0000","last_undegraded":"2024-05-08T18:53:46.055745+0000","last_fullsized":"2024-05-08T18:53:46.055745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:46.055625+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:46.055625+0000","last_clean_scrub_stamp":"2024-05-08T18:53:46.055625+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:55:05.788331+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:07.875651+0000","last_change":"2024-05-08T18:54:07.875651+0000","last_active":"2024-05-08T18:54:07.875651+0000","last_peered":"2024-05-08T18:54:07.875651+0000","last_clean":"2024-05-08T18:54:07.875651+0000","last_became_active":"2024-05-08T18:50:36.045976+0000","last_became_peered":"2024-05-08T18:50:36.045976+0000","last_unstale":"2024-05-08T18:54:07.875651+0000","last_undegraded":"2024-05-08T18:54:07.875651+0000","last_fullsized":"2024-05-08T18:54:07.875651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:07.875523+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:07.875523+0000","last_clean_scrub_stamp":"2024-05-08T18:54:07.875523+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:35:03.721378+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"27'4","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:05.968970+0000","last_change":"2024-05-08T18:54:05.968970+0000","last_active":"2024-05-08T18:54:05.968970+0000","last_peered":"2024-05-08T18:54:05.968970+0000","last_clean":"2024-05-08T18:54:05.968970+0000","last_became_active":"2024-05-08T18:50:28.038871+0000","last_became_peered":"2024-05-08T18:50:28.038871+0000","last_unstale":"2024-05-08T18:54:05.968970+0000","last_undegraded":"2024-05-08T18:54:05.968970+0000","last_fullsized":"2024-05-08T18:54:05.968970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:05.968831+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:05.968831+0000","last_clean_scrub_stamp":"2024-05-08T18:54:05.968831+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:15.843134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:40.064360+0000","last_change":"2024-05-08T18:54:40.064360+0000","last_active":"2024-05-08T18:54:40.064360+0000","last_peered":"2024-05-08T18:54:40.064360+0000","last_clean":"2024-05-08T18:54:40.064360+0000","last_became_active":"2024-05-08T18:50:26.025547+0000","last_became_peered":"2024-05-08T18:50:26.025547+0000","last_unstale":"2024-05-08T18:54:40.064360+0000","last_undegraded":"2024-05-08T18:54:40.064360+0000","last_fullsized":"2024-05-08T18:54:40.064360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:40.064223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:40.064223+0000","last_clean_scrub_stamp":"2024-05-08T18:54:40.064223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:21:06.700344+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:47.057018+0000","last_change":"2024-05-08T18:53:47.057018+0000","last_active":"2024-05-08T18:53:47.057018+0000","last_peered":"2024-05-08T18:53:47.057018+0000","last_clean":"2024-05-08T18:53:47.057018+0000","last_became_active":"2024-05-08T18:50:30.035734+0000","last_became_peered":"2024-05-08T18:50:30.035734+0000","last_unstale":"2024-05-08T18:53:47.057018+0000","last_undegraded":"2024-05-08T18:53:47.057018+0000","last_fullsized":"2024-05-08T18:53:47.057018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:47.056868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:47.056868+0000","last_clean_scrub_stamp":"2024-05-08T18:53:47.056868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:03:47.172253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"27'48","reported_seq":108,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:54.094067+0000","last_change":"2024-05-08T18:53:54.094067+0000","last_active":"2024-05-08T18:53:54.094067+0000","last_peered":"2024-05-08T18:53:54.094067+0000","last_clean":"2024-05-08T18:53:54.094067+0000","last_became_active":"2024-05-08T18:50:32.034769+0000","last_became_peered":"2024-05-08T18:50:32.034769+0000","last_unstale":"2024-05-08T18:53:54.094067+0000","last_undegraded":"2024-05-08T18:53:54.094067+0000","last_fullsized":"2024-05-08T18:53:54.094067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'48","last_scrub_stamp":"2024-05-08T18:53:54.093941+0000","last_deep_scrub":"27'48","last_deep_scrub_stamp":"2024-05-08T18:53:54.093941+0000","last_clean_scrub_stamp":"2024-05-08T18:53:54.093941+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:02.850561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:55.963149+0000","last_change":"2024-05-08T18:53:55.963149+0000","last_active":"2024-05-08T18:53:55.963149+0000","last_peered":"2024-05-08T18:53:55.963149+0000","last_clean":"2024-05-08T18:53:55.963149+0000","last_became_active":"2024-05-08T18:50:34.050018+0000","last_became_peered":"2024-05-08T18:50:34.050018+0000","last_unstale":"2024-05-08T18:53:55.963149+0000","last_undegraded":"2024-05-08T18:53:55.963149+0000","last_fullsized":"2024-05-08T18:53:55.963149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:55.963020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:55.963020+0000","last_clean_scrub_stamp":"2024-05-08T18:53:55.963020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:07.576169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"27'8","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:04.012454+0000","last_change":"2024-05-08T18:54:04.012454+0000","last_active":"2024-05-08T18:54:04.012454+0000","last_peered":"2024-05-08T18:54:04.012454+0000","last_clean":"2024-05-08T18:54:04.012454+0000","last_became_active":"2024-05-08T18:50:36.049274+0000","last_became_peered":"2024-05-08T18:50:36.049274+0000","last_unstale":"2024-05-08T18:54:04.012454+0000","last_undegraded":"2024-05-08T18:54:04.012454+0000","last_fullsized":"2024-05-08T18:54:04.012454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:04.012274+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:04.012274+0000","last_clean_scrub_stamp":"2024-05-08T18:54:04.012274+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:25.723099+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'8","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:05.082216+0000","last_change":"2024-05-08T18:54:05.082216+0000","last_active":"2024-05-08T18:54:05.082216+0000","last_peered":"2024-05-08T18:54:05.082216+0000","last_clean":"2024-05-08T18:54:05.082216+0000","last_became_active":"2024-05-08T18:50:28.037545+0000","last_became_peered":"2024-05-08T18:50:28.037545+0000","last_unstale":"2024-05-08T18:54:05.082216+0000","last_undegraded":"2024-05-08T18:54:05.082216+0000","last_fullsized":"2024-05-08T18:54:05.082216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:05.082102+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:05.082102+0000","last_clean_scrub_stamp":"2024-05-08T18:54:05.082102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:40:42.647531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'74","reported_seq":145,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:29.684035+0000","last_change":"2024-05-08T18:54:29.684064+0000","last_active":"2024-05-08T18:54:29.684035+0000","last_peered":"2024-05-08T18:54:29.684035+0000","last_clean":"2024-05-08T18:54:29.684035+0000","last_became_active":"2024-05-08T18:50:19.739986+0000","last_became_peered":"2024-05-08T18:50:19.739986+0000","last_unstale":"2024-05-08T18:54:29.684035+0000","last_undegraded":"2024-05-08T18:54:29.684035+0000","last_fullsized":"2024-05-08T18:54:29.684035+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'74","last_scrub_stamp":"2024-05-08T18:54:29.683948+0000","last_deep_scrub":"27'74","last_deep_scrub_stamp":"2024-05-08T18:54:29.683948+0000","last_clean_scrub_stamp":"2024-05-08T18:54:29.683948+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:42:01.256645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:57.916566+0000","last_change":"2024-05-08T18:54:57.916588+0000","last_active":"2024-05-08T18:54:57.916566+0000","last_peered":"2024-05-08T18:54:57.916566+0000","last_clean":"2024-05-08T18:54:57.916566+0000","last_became_active":"2024-05-08T18:50:19.739403+0000","last_became_peered":"2024-05-08T18:50:19.739403+0000","last_unstale":"2024-05-08T18:54:57.916566+0000","last_undegraded":"2024-05-08T18:54:57.916566+0000","last_fullsized":"2024-05-08T18:54:57.916566+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:57.916480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:57.916480+0000","last_clean_scrub_stamp":"2024-05-08T18:54:57.916480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:43.495711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:46.029616+0000","last_change":"2024-05-08T18:54:46.029640+0000","last_active":"2024-05-08T18:54:46.029616+0000","last_peered":"2024-05-08T18:54:46.029616+0000","last_clean":"2024-05-08T18:54:46.029616+0000","last_became_active":"2024-05-08T18:50:26.024249+0000","last_became_peered":"2024-05-08T18:50:26.024249+0000","last_unstale":"2024-05-08T18:54:46.029616+0000","last_undegraded":"2024-05-08T18:54:46.029616+0000","last_fullsized":"2024-05-08T18:54:46.029616+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:46.029527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:46.029527+0000","last_clean_scrub_stamp":"2024-05-08T18:54:46.029527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:44:45.512523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:57.039225+0000","last_change":"2024-05-08T18:53:57.039225+0000","last_active":"2024-05-08T18:53:57.039225+0000","last_peered":"2024-05-08T18:53:57.039225+0000","last_clean":"2024-05-08T18:53:57.039225+0000","last_became_active":"2024-05-08T18:50:30.029744+0000","last_became_peered":"2024-05-08T18:50:30.029744+0000","last_unstale":"2024-05-08T18:53:57.039225+0000","last_undegraded":"2024-05-08T18:53:57.039225+0000","last_fullsized":"2024-05-08T18:53:57.039225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:57.039062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:57.039062+0000","last_clean_scrub_stamp":"2024-05-08T18:53:57.039062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:59.021034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"27'87","reported_seq":178,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:11.115165+0000","last_change":"2024-05-08T18:54:11.115165+0000","last_active":"2024-05-08T18:54:11.115165+0000","last_peered":"2024-05-08T18:54:11.115165+0000","last_clean":"2024-05-08T18:54:11.115165+0000","last_became_active":"2024-05-08T18:50:32.043533+0000","last_became_peered":"2024-05-08T18:50:32.043533+0000","last_unstale":"2024-05-08T18:54:11.115165+0000","last_undegraded":"2024-05-08T18:54:11.115165+0000","last_fullsized":"2024-05-08T18:54:11.115165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'87","last_scrub_stamp":"2024-05-08T18:54:11.115039+0000","last_deep_scrub":"27'87","last_deep_scrub_stamp":"2024-05-08T18:54:11.115039+0000","last_clean_scrub_stamp":"2024-05-08T18:54:11.115039+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:20.191974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.995677+0000","last_change":"2024-05-08T18:53:58.995677+0000","last_active":"2024-05-08T18:53:58.995677+0000","last_peered":"2024-05-08T18:53:58.995677+0000","last_clean":"2024-05-08T18:53:58.995677+0000","last_became_active":"2024-05-08T18:50:34.048859+0000","last_became_peered":"2024-05-08T18:50:34.048859+0000","last_unstale":"2024-05-08T18:53:58.995677+0000","last_undegraded":"2024-05-08T18:53:58.995677+0000","last_fullsized":"2024-05-08T18:53:58.995677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:58.995550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:58.995550+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.995550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:54.841405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"27'81","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:03.892330+0000","last_change":"2024-05-08T18:54:03.892330+0000","last_active":"2024-05-08T18:54:03.892330+0000","last_peered":"2024-05-08T18:54:03.892330+0000","last_clean":"2024-05-08T18:54:03.892330+0000","last_became_active":"2024-05-08T18:50:36.044928+0000","last_became_peered":"2024-05-08T18:50:36.044928+0000","last_unstale":"2024-05-08T18:54:03.892330+0000","last_undegraded":"2024-05-08T18:54:03.892330+0000","last_fullsized":"2024-05-08T18:54:03.892330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'81","last_scrub_stamp":"2024-05-08T18:54:03.892165+0000","last_deep_scrub":"27'81","last_deep_scrub_stamp":"2024-05-08T18:54:03.892165+0000","last_clean_scrub_stamp":"2024-05-08T18:54:03.892165+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:34:05.874137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"27'4","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:27.108387+0000","last_change":"2024-05-08T18:54:27.108387+0000","last_active":"2024-05-08T18:54:27.108387+0000","last_peered":"2024-05-08T18:54:27.108387+0000","last_clean":"2024-05-08T18:54:27.108387+0000","last_became_active":"2024-05-08T18:50:28.030761+0000","last_became_peered":"2024-05-08T18:50:28.030761+0000","last_unstale":"2024-05-08T18:54:27.108387+0000","last_undegraded":"2024-05-08T18:54:27.108387+0000","last_fullsized":"2024-05-08T18:54:27.108387+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:27.108273+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:27.108273+0000","last_clean_scrub_stamp":"2024-05-08T18:54:27.108273+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:08.292247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:53.933192+0000","last_change":"2024-05-08T18:54:53.933216+0000","last_active":"2024-05-08T18:54:53.933192+0000","last_peered":"2024-05-08T18:54:53.933192+0000","last_clean":"2024-05-08T18:54:53.933192+0000","last_became_active":"2024-05-08T18:50:19.738872+0000","last_became_peered":"2024-05-08T18:50:19.738872+0000","last_unstale":"2024-05-08T18:54:53.933192+0000","last_undegraded":"2024-05-08T18:54:53.933192+0000","last_fullsized":"2024-05-08T18:54:53.933192+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:53.933052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:53.933052+0000","last_clean_scrub_stamp":"2024-05-08T18:54:53.933052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:38:37.063625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:39.101053+0000","last_change":"2024-05-08T18:54:39.101078+0000","last_active":"2024-05-08T18:54:39.101053+0000","last_peered":"2024-05-08T18:54:39.101053+0000","last_clean":"2024-05-08T18:54:39.101053+0000","last_became_active":"2024-05-08T18:50:26.024549+0000","last_became_peered":"2024-05-08T18:50:26.024549+0000","last_unstale":"2024-05-08T18:54:39.101053+0000","last_undegraded":"2024-05-08T18:54:39.101053+0000","last_fullsized":"2024-05-08T18:54:39.101053+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:39.100939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:39.100939+0000","last_clean_scrub_stamp":"2024-05-08T18:54:39.100939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:34:28.445091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:55:08.910903+0000","last_change":"2024-05-08T18:55:08.910932+0000","last_active":"2024-05-08T18:55:08.910903+0000","last_peered":"2024-05-08T18:55:08.910903+0000","last_clean":"2024-05-08T18:55:08.910903+0000","last_became_active":"2024-05-08T18:51:15.084599+0000","last_became_peered":"2024-05-08T18:51:15.084599+0000","last_unstale":"2024-05-08T18:55:08.910903+0000","last_undegraded":"2024-05-08T18:55:08.910903+0000","last_fullsized":"2024-05-08T18:55:08.910903+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:55:08.910794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:55:08.910794+0000","last_clean_scrub_stamp":"2024-05-08T18:55:08.910794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:37.955630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"27'290","reported_seq":516,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:47.103048+0000","last_change":"2024-05-08T18:53:47.103048+0000","last_active":"2024-05-08T18:53:47.103048+0000","last_peered":"2024-05-08T18:53:47.103048+0000","last_clean":"2024-05-08T18:53:47.103048+0000","last_became_active":"2024-05-08T18:50:32.044539+0000","last_became_peered":"2024-05-08T18:50:32.044539+0000","last_unstale":"2024-05-08T18:53:47.103048+0000","last_undegraded":"2024-05-08T18:53:47.103048+0000","last_fullsized":"2024-05-08T18:53:47.103048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'290","last_scrub_stamp":"2024-05-08T18:53:47.102914+0000","last_deep_scrub":"27'290","last_deep_scrub_stamp":"2024-05-08T18:53:47.102914+0000","last_clean_scrub_stamp":"2024-05-08T18:53:47.102914+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:52.308821+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:07.076608+0000","last_change":"2024-05-08T18:54:07.076608+0000","last_active":"2024-05-08T18:54:07.076608+0000","last_peered":"2024-05-08T18:54:07.076608+0000","last_clean":"2024-05-08T18:54:07.076608+0000","last_became_active":"2024-05-08T18:50:34.043966+0000","last_became_peered":"2024-05-08T18:50:34.043966+0000","last_unstale":"2024-05-08T18:54:07.076608+0000","last_undegraded":"2024-05-08T18:54:07.076608+0000","last_fullsized":"2024-05-08T18:54:07.076608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:07.076486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:07.076486+0000","last_clean_scrub_stamp":"2024-05-08T18:54:07.076486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:33.765444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"27'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:07.937032+0000","last_change":"2024-05-08T18:54:07.937032+0000","last_active":"2024-05-08T18:54:07.937032+0000","last_peered":"2024-05-08T18:54:07.937032+0000","last_clean":"2024-05-08T18:54:07.937032+0000","last_became_active":"2024-05-08T18:50:36.050573+0000","last_became_peered":"2024-05-08T18:50:36.050573+0000","last_unstale":"2024-05-08T18:54:07.937032+0000","last_undegraded":"2024-05-08T18:54:07.937032+0000","last_fullsized":"2024-05-08T18:54:07.937032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-08T18:54:07.936918+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-08T18:54:07.936918+0000","last_clean_scrub_stamp":"2024-05-08T18:54:07.936918+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:16.706139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"27'4","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:16.165554+0000","last_change":"2024-05-08T18:54:16.165554+0000","last_active":"2024-05-08T18:54:16.165554+0000","last_peered":"2024-05-08T18:54:16.165554+0000","last_clean":"2024-05-08T18:54:16.165554+0000","last_became_active":"2024-05-08T18:50:28.027492+0000","last_became_peered":"2024-05-08T18:50:28.027492+0000","last_unstale":"2024-05-08T18:54:16.165554+0000","last_undegraded":"2024-05-08T18:54:16.165554+0000","last_fullsized":"2024-05-08T18:54:16.165554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:16.165359+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:16.165359+0000","last_clean_scrub_stamp":"2024-05-08T18:54:16.165359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:48.442797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:25.899694+0000","last_change":"2024-05-08T18:54:25.899694+0000","last_active":"2024-05-08T18:54:25.899694+0000","last_peered":"2024-05-08T18:54:25.899694+0000","last_clean":"2024-05-08T18:54:25.899694+0000","last_became_active":"2024-05-08T18:50:19.738788+0000","last_became_peered":"2024-05-08T18:50:19.738788+0000","last_unstale":"2024-05-08T18:54:25.899694+0000","last_undegraded":"2024-05-08T18:54:25.899694+0000","last_fullsized":"2024-05-08T18:54:25.899694+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:25.899584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:25.899584+0000","last_clean_scrub_stamp":"2024-05-08T18:54:25.899584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:28.185977+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'4","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:20.096976+0000","last_change":"2024-05-08T18:54:20.096976+0000","last_active":"2024-05-08T18:54:20.096976+0000","last_peered":"2024-05-08T18:54:20.096976+0000","last_clean":"2024-05-08T18:54:20.096976+0000","last_became_active":"2024-05-08T18:50:26.029197+0000","last_became_peered":"2024-05-08T18:50:26.029197+0000","last_unstale":"2024-05-08T18:54:20.096976+0000","last_undegraded":"2024-05-08T18:54:20.096976+0000","last_fullsized":"2024-05-08T18:54:20.096976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-08T18:54:20.096851+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-08T18:54:20.096851+0000","last_clean_scrub_stamp":"2024-05-08T18:54:20.096851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:32.841665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"27'2","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:04.894272+0000","last_change":"2024-05-08T18:54:04.894272+0000","last_active":"2024-05-08T18:54:04.894272+0000","last_peered":"2024-05-08T18:54:04.894272+0000","last_clean":"2024-05-08T18:54:04.894272+0000","last_became_active":"2024-05-08T18:50:30.028028+0000","last_became_peered":"2024-05-08T18:50:30.028028+0000","last_unstale":"2024-05-08T18:54:04.894272+0000","last_undegraded":"2024-05-08T18:54:04.894272+0000","last_fullsized":"2024-05-08T18:54:04.894272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:04.894146+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:04.894146+0000","last_clean_scrub_stamp":"2024-05-08T18:54:04.894146+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:10.950542+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"27'23","reported_seq":100,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:56.984125+0000","last_change":"2024-05-08T18:53:56.984125+0000","last_active":"2024-05-08T18:53:56.984125+0000","last_peered":"2024-05-08T18:53:56.984125+0000","last_clean":"2024-05-08T18:53:56.984125+0000","last_became_active":"2024-05-08T18:50:32.036051+0000","last_became_peered":"2024-05-08T18:50:32.036051+0000","last_unstale":"2024-05-08T18:53:56.984125+0000","last_undegraded":"2024-05-08T18:53:56.984125+0000","last_fullsized":"2024-05-08T18:53:56.984125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-05-08T18:53:56.983946+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-05-08T18:53:56.983946+0000","last_clean_scrub_stamp":"2024-05-08T18:53:56.983946+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:47.425987+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.955616+0000","last_change":"2024-05-08T18:53:45.955616+0000","last_active":"2024-05-08T18:53:45.955616+0000","last_peered":"2024-05-08T18:53:45.955616+0000","last_clean":"2024-05-08T18:53:45.955616+0000","last_became_active":"2024-05-08T18:50:34.045541+0000","last_became_peered":"2024-05-08T18:50:34.045541+0000","last_unstale":"2024-05-08T18:53:45.955616+0000","last_undegraded":"2024-05-08T18:53:45.955616+0000","last_fullsized":"2024-05-08T18:53:45.955616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:45.955524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:45.955524+0000","last_clean_scrub_stamp":"2024-05-08T18:53:45.955524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:07.055678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:55:03.871883+0000","last_change":"2024-05-08T18:55:03.871883+0000","last_active":"2024-05-08T18:55:03.871883+0000","last_peered":"2024-05-08T18:55:03.871883+0000","last_clean":"2024-05-08T18:55:03.871883+0000","last_became_active":"2024-05-08T18:50:36.057093+0000","last_became_peered":"2024-05-08T18:50:36.057093+0000","last_unstale":"2024-05-08T18:55:03.871883+0000","last_undegraded":"2024-05-08T18:55:03.871883+0000","last_fullsized":"2024-05-08T18:55:03.871883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:55:03.871757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:55:03.871757+0000","last_clean_scrub_stamp":"2024-05-08T18:55:03.871757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:05.530489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'22","reported_seq":91,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:29.058250+0000","last_change":"2024-05-08T18:54:29.058250+0000","last_active":"2024-05-08T18:54:29.058250+0000","last_peered":"2024-05-08T18:54:29.058250+0000","last_clean":"2024-05-08T18:54:29.058250+0000","last_became_active":"2024-05-08T18:50:28.025645+0000","last_became_peered":"2024-05-08T18:50:28.025645+0000","last_unstale":"2024-05-08T18:54:29.058250+0000","last_undegraded":"2024-05-08T18:54:29.058250+0000","last_fullsized":"2024-05-08T18:54:29.058250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-05-08T18:54:29.058118+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-05-08T18:54:29.058118+0000","last_clean_scrub_stamp":"2024-05-08T18:54:29.058118+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:43.432282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:56.927057+0000","last_change":"2024-05-08T18:54:56.927078+0000","last_active":"2024-05-08T18:54:56.927057+0000","last_peered":"2024-05-08T18:54:56.927057+0000","last_clean":"2024-05-08T18:54:56.927057+0000","last_became_active":"2024-05-08T18:50:19.739620+0000","last_became_peered":"2024-05-08T18:50:19.739620+0000","last_unstale":"2024-05-08T18:54:56.927057+0000","last_undegraded":"2024-05-08T18:54:56.927057+0000","last_fullsized":"2024-05-08T18:54:56.927057+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:56.926965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:56.926965+0000","last_clean_scrub_stamp":"2024-05-08T18:54:56.926965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:52.673639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:29.908194+0000","last_change":"2024-05-08T18:54:29.908194+0000","last_active":"2024-05-08T18:54:29.908194+0000","last_peered":"2024-05-08T18:54:29.908194+0000","last_clean":"2024-05-08T18:54:29.908194+0000","last_became_active":"2024-05-08T18:50:26.023522+0000","last_became_peered":"2024-05-08T18:50:26.023522+0000","last_unstale":"2024-05-08T18:54:29.908194+0000","last_undegraded":"2024-05-08T18:54:29.908194+0000","last_fullsized":"2024-05-08T18:54:29.908194+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:29.908070+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:29.908070+0000","last_clean_scrub_stamp":"2024-05-08T18:54:29.908070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:56.597028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:02.050063+0000","last_change":"2024-05-08T18:54:02.050063+0000","last_active":"2024-05-08T18:54:02.050063+0000","last_peered":"2024-05-08T18:54:02.050063+0000","last_clean":"2024-05-08T18:54:02.050063+0000","last_became_active":"2024-05-08T18:50:30.034806+0000","last_became_peered":"2024-05-08T18:50:30.034806+0000","last_unstale":"2024-05-08T18:54:02.050063+0000","last_undegraded":"2024-05-08T18:54:02.050063+0000","last_fullsized":"2024-05-08T18:54:02.050063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:02.049920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:02.049920+0000","last_clean_scrub_stamp":"2024-05-08T18:54:02.049920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:50:23.760745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"27'20","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:14.126033+0000","last_change":"2024-05-08T18:54:14.126033+0000","last_active":"2024-05-08T18:54:14.126033+0000","last_peered":"2024-05-08T18:54:14.126033+0000","last_clean":"2024-05-08T18:54:14.126033+0000","last_became_active":"2024-05-08T18:50:32.042183+0000","last_became_peered":"2024-05-08T18:50:32.042183+0000","last_unstale":"2024-05-08T18:54:14.126033+0000","last_undegraded":"2024-05-08T18:54:14.126033+0000","last_fullsized":"2024-05-08T18:54:14.126033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'20","last_scrub_stamp":"2024-05-08T18:54:14.125910+0000","last_deep_scrub":"27'20","last_deep_scrub_stamp":"2024-05-08T18:54:14.125910+0000","last_clean_scrub_stamp":"2024-05-08T18:54:14.125910+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:28:13.974588+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:08.066476+0000","last_change":"2024-05-08T18:54:08.066476+0000","last_active":"2024-05-08T18:54:08.066476+0000","last_peered":"2024-05-08T18:54:08.066476+0000","last_clean":"2024-05-08T18:54:08.066476+0000","last_became_active":"2024-05-08T18:50:34.044358+0000","last_became_peered":"2024-05-08T18:50:34.044358+0000","last_unstale":"2024-05-08T18:54:08.066476+0000","last_undegraded":"2024-05-08T18:54:08.066476+0000","last_fullsized":"2024-05-08T18:54:08.066476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:08.066352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:08.066352+0000","last_clean_scrub_stamp":"2024-05-08T18:54:08.066352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:30:11.214559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:42.847487+0000","last_change":"2024-05-08T18:54:42.847487+0000","last_active":"2024-05-08T18:54:42.847487+0000","last_peered":"2024-05-08T18:54:42.847487+0000","last_clean":"2024-05-08T18:54:42.847487+0000","last_became_active":"2024-05-08T18:50:36.058267+0000","last_became_peered":"2024-05-08T18:50:36.058267+0000","last_unstale":"2024-05-08T18:54:42.847487+0000","last_undegraded":"2024-05-08T18:54:42.847487+0000","last_fullsized":"2024-05-08T18:54:42.847487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:42.847331+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:42.847331+0000","last_clean_scrub_stamp":"2024-05-08T18:54:42.847331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:24.031305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"27'12","reported_seq":81,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:06.982247+0000","last_change":"2024-05-08T18:54:06.982247+0000","last_active":"2024-05-08T18:54:06.982247+0000","last_peered":"2024-05-08T18:54:06.982247+0000","last_clean":"2024-05-08T18:54:06.982247+0000","last_became_active":"2024-05-08T18:50:28.038935+0000","last_became_peered":"2024-05-08T18:50:28.038935+0000","last_unstale":"2024-05-08T18:54:06.982247+0000","last_undegraded":"2024-05-08T18:54:06.982247+0000","last_fullsized":"2024-05-08T18:54:06.982247+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-08T18:54:06.982117+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-08T18:54:06.982117+0000","last_clean_scrub_stamp":"2024-05-08T18:54:06.982117+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:58.509084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":57,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:27.936358+0000","last_change":"2024-05-08T18:54:27.936358+0000","last_active":"2024-05-08T18:54:27.936358+0000","last_peered":"2024-05-08T18:54:27.936358+0000","last_clean":"2024-05-08T18:54:27.936358+0000","last_became_active":"2024-05-08T18:50:26.018739+0000","last_became_peered":"2024-05-08T18:50:26.018739+0000","last_unstale":"2024-05-08T18:54:27.936358+0000","last_undegraded":"2024-05-08T18:54:27.936358+0000","last_fullsized":"2024-05-08T18:54:27.936358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:27.936220+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:27.936220+0000","last_clean_scrub_stamp":"2024-05-08T18:54:27.936220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:05.501650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:34.053283+0000","last_change":"2024-05-08T18:54:34.053307+0000","last_active":"2024-05-08T18:54:34.053283+0000","last_peered":"2024-05-08T18:54:34.053283+0000","last_clean":"2024-05-08T18:54:34.053283+0000","last_became_active":"2024-05-08T18:50:19.740835+0000","last_became_peered":"2024-05-08T18:50:19.740835+0000","last_unstale":"2024-05-08T18:54:34.053283+0000","last_undegraded":"2024-05-08T18:54:34.053283+0000","last_fullsized":"2024-05-08T18:54:34.053283+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:34.053190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:34.053190+0000","last_clean_scrub_stamp":"2024-05-08T18:54:34.053190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:01.858524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"27'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:37.821248+0000","last_change":"2024-05-08T18:54:37.821275+0000","last_active":"2024-05-08T18:54:37.821248+0000","last_peered":"2024-05-08T18:54:37.821248+0000","last_clean":"2024-05-08T18:54:37.821248+0000","last_became_active":"2024-05-08T18:51:15.083141+0000","last_became_peered":"2024-05-08T18:51:15.083141+0000","last_unstale":"2024-05-08T18:54:37.821248+0000","last_undegraded":"2024-05-08T18:54:37.821248+0000","last_fullsized":"2024-05-08T18:54:37.821248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:37.821165+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:37.821165+0000","last_clean_scrub_stamp":"2024-05-08T18:54:37.821165+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:46.122851+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"27'73","reported_seq":150,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.986211+0000","last_change":"2024-05-08T18:53:53.986211+0000","last_active":"2024-05-08T18:53:53.986211+0000","last_peered":"2024-05-08T18:53:53.986211+0000","last_clean":"2024-05-08T18:53:53.986211+0000","last_became_active":"2024-05-08T18:50:32.042046+0000","last_became_peered":"2024-05-08T18:50:32.042046+0000","last_unstale":"2024-05-08T18:53:53.986211+0000","last_undegraded":"2024-05-08T18:53:53.986211+0000","last_fullsized":"2024-05-08T18:53:53.986211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'73","last_scrub_stamp":"2024-05-08T18:53:53.986057+0000","last_deep_scrub":"27'73","last_deep_scrub_stamp":"2024-05-08T18:53:53.986057+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.986057+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:48:15.967078+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:48.999132+0000","last_change":"2024-05-08T18:53:48.999132+0000","last_active":"2024-05-08T18:53:48.999132+0000","last_peered":"2024-05-08T18:53:48.999132+0000","last_clean":"2024-05-08T18:53:48.999132+0000","last_became_active":"2024-05-08T18:50:34.044520+0000","last_became_peered":"2024-05-08T18:50:34.044520+0000","last_unstale":"2024-05-08T18:53:48.999132+0000","last_undegraded":"2024-05-08T18:53:48.999132+0000","last_fullsized":"2024-05-08T18:53:48.999132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:48.999007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:48.999007+0000","last_clean_scrub_stamp":"2024-05-08T18:53:48.999007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:52:21.742255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"27'9","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:11.060343+0000","last_change":"2024-05-08T18:54:11.060343+0000","last_active":"2024-05-08T18:54:11.060343+0000","last_peered":"2024-05-08T18:54:11.060343+0000","last_clean":"2024-05-08T18:54:11.060343+0000","last_became_active":"2024-05-08T18:50:36.046757+0000","last_became_peered":"2024-05-08T18:50:36.046757+0000","last_unstale":"2024-05-08T18:54:11.060343+0000","last_undegraded":"2024-05-08T18:54:11.060343+0000","last_fullsized":"2024-05-08T18:54:11.060343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-08T18:54:11.060217+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-08T18:54:11.060217+0000","last_clean_scrub_stamp":"2024-05-08T18:54:11.060217+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:57:58.583230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"27'10","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:39.798553+0000","last_change":"2024-05-08T18:54:39.798579+0000","last_active":"2024-05-08T18:54:39.798553+0000","last_peered":"2024-05-08T18:54:39.798553+0000","last_clean":"2024-05-08T18:54:39.798553+0000","last_became_active":"2024-05-08T18:51:15.084151+0000","last_became_peered":"2024-05-08T18:51:15.084151+0000","last_unstale":"2024-05-08T18:54:39.798553+0000","last_undegraded":"2024-05-08T18:54:39.798553+0000","last_fullsized":"2024-05-08T18:54:39.798553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:39.798463+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:39.798463+0000","last_clean_scrub_stamp":"2024-05-08T18:54:39.798463+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:54.076319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:30.043791+0000","last_change":"2024-05-08T18:54:30.043791+0000","last_active":"2024-05-08T18:54:30.043791+0000","last_peered":"2024-05-08T18:54:30.043791+0000","last_clean":"2024-05-08T18:54:30.043791+0000","last_became_active":"2024-05-08T18:50:26.024894+0000","last_became_peered":"2024-05-08T18:50:26.024894+0000","last_unstale":"2024-05-08T18:54:30.043791+0000","last_undegraded":"2024-05-08T18:54:30.043791+0000","last_fullsized":"2024-05-08T18:54:30.043791+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:30.043668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:30.043668+0000","last_clean_scrub_stamp":"2024-05-08T18:54:30.043668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:40:02.169764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:55.976538+0000","last_change":"2024-05-08T18:54:55.976563+0000","last_active":"2024-05-08T18:54:55.976538+0000","last_peered":"2024-05-08T18:54:55.976538+0000","last_clean":"2024-05-08T18:54:55.976538+0000","last_became_active":"2024-05-08T18:50:19.739124+0000","last_became_peered":"2024-05-08T18:50:19.739124+0000","last_unstale":"2024-05-08T18:54:55.976538+0000","last_undegraded":"2024-05-08T18:54:55.976538+0000","last_fullsized":"2024-05-08T18:54:55.976538+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:55.976431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:55.976431+0000","last_clean_scrub_stamp":"2024-05-08T18:54:55.976431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:56:09.917351+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:54.073547+0000","last_change":"2024-05-08T18:53:54.073547+0000","last_active":"2024-05-08T18:53:54.073547+0000","last_peered":"2024-05-08T18:53:54.073547+0000","last_clean":"2024-05-08T18:53:54.073547+0000","last_became_active":"2024-05-08T18:50:30.032546+0000","last_became_peered":"2024-05-08T18:50:30.032546+0000","last_unstale":"2024-05-08T18:53:54.073547+0000","last_undegraded":"2024-05-08T18:53:54.073547+0000","last_fullsized":"2024-05-08T18:53:54.073547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:54.073430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:54.073430+0000","last_clean_scrub_stamp":"2024-05-08T18:53:54.073430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:08.017553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"27'21","reported_seq":63,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:49.087885+0000","last_change":"2024-05-08T18:53:49.087885+0000","last_active":"2024-05-08T18:53:49.087885+0000","last_peered":"2024-05-08T18:53:49.087885+0000","last_clean":"2024-05-08T18:53:49.087885+0000","last_became_active":"2024-05-08T18:50:32.040767+0000","last_became_peered":"2024-05-08T18:50:32.040767+0000","last_unstale":"2024-05-08T18:53:49.087885+0000","last_undegraded":"2024-05-08T18:53:49.087885+0000","last_fullsized":"2024-05-08T18:53:49.087885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'21","last_scrub_stamp":"2024-05-08T18:53:49.087754+0000","last_deep_scrub":"27'21","last_deep_scrub_stamp":"2024-05-08T18:53:49.087754+0000","last_clean_scrub_stamp":"2024-05-08T18:53:49.087754+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:00.700903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"27'285","reported_seq":387,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:48.068502+0000","last_change":"2024-05-08T18:53:48.068502+0000","last_active":"2024-05-08T18:53:48.068502+0000","last_peered":"2024-05-08T18:53:48.068502+0000","last_clean":"2024-05-08T18:53:48.068502+0000","last_became_active":"2024-05-08T18:50:34.043167+0000","last_became_peered":"2024-05-08T18:50:34.043167+0000","last_unstale":"2024-05-08T18:53:48.068502+0000","last_undegraded":"2024-05-08T18:53:48.068502+0000","last_fullsized":"2024-05-08T18:53:48.068502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:48.068390+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:48.068390+0000","last_clean_scrub_stamp":"2024-05-08T18:53:48.068390+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:36:09.168544+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:55:07.915412+0000","last_change":"2024-05-08T18:55:07.915412+0000","last_active":"2024-05-08T18:55:07.915412+0000","last_peered":"2024-05-08T18:55:07.915412+0000","last_clean":"2024-05-08T18:55:07.915412+0000","last_became_active":"2024-05-08T18:50:36.060727+0000","last_became_peered":"2024-05-08T18:50:36.060727+0000","last_unstale":"2024-05-08T18:55:07.915412+0000","last_undegraded":"2024-05-08T18:55:07.915412+0000","last_fullsized":"2024-05-08T18:55:07.915412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:55:07.915234+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:55:07.915234+0000","last_clean_scrub_stamp":"2024-05-08T18:55:07.915234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:56:57.524500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"27'22","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:38.804853+0000","last_change":"2024-05-08T18:54:38.804853+0000","last_active":"2024-05-08T18:54:38.804853+0000","last_peered":"2024-05-08T18:54:38.804853+0000","last_clean":"2024-05-08T18:54:38.804853+0000","last_became_active":"2024-05-08T18:51:15.083568+0000","last_became_peered":"2024-05-08T18:51:15.083568+0000","last_unstale":"2024-05-08T18:54:38.804853+0000","last_undegraded":"2024-05-08T18:54:38.804853+0000","last_fullsized":"2024-05-08T18:54:38.804853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'22","last_scrub_stamp":"2024-05-08T18:54:38.804700+0000","last_deep_scrub":"27'22","last_deep_scrub_stamp":"2024-05-08T18:54:38.804700+0000","last_clean_scrub_stamp":"2024-05-08T18:54:38.804700+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:37.707904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":68,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:52.933354+0000","last_change":"2024-05-08T18:54:52.933384+0000","last_active":"2024-05-08T18:54:52.933354+0000","last_peered":"2024-05-08T18:54:52.933354+0000","last_clean":"2024-05-08T18:54:52.933354+0000","last_became_active":"2024-05-08T18:50:26.016210+0000","last_became_peered":"2024-05-08T18:50:26.016210+0000","last_unstale":"2024-05-08T18:54:52.933354+0000","last_undegraded":"2024-05-08T18:54:52.933354+0000","last_fullsized":"2024-05-08T18:54:52.933354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:52.933260+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:52.933260+0000","last_clean_scrub_stamp":"2024-05-08T18:54:52.933260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:43.048061+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:33.035194+0000","last_change":"2024-05-08T18:54:33.035194+0000","last_active":"2024-05-08T18:54:33.035194+0000","last_peered":"2024-05-08T18:54:33.035194+0000","last_clean":"2024-05-08T18:54:33.035194+0000","last_became_active":"2024-05-08T18:50:19.740355+0000","last_became_peered":"2024-05-08T18:50:19.740355+0000","last_unstale":"2024-05-08T18:54:33.035194+0000","last_undegraded":"2024-05-08T18:54:33.035194+0000","last_fullsized":"2024-05-08T18:54:33.035194+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:33.035076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:33.035076+0000","last_clean_scrub_stamp":"2024-05-08T18:54:33.035076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:55:38.299918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.055060+0000","last_change":"2024-05-08T18:53:53.055060+0000","last_active":"2024-05-08T18:53:53.055060+0000","last_peered":"2024-05-08T18:53:53.055060+0000","last_clean":"2024-05-08T18:53:53.055060+0000","last_became_active":"2024-05-08T18:50:30.031351+0000","last_became_peered":"2024-05-08T18:50:30.031351+0000","last_unstale":"2024-05-08T18:53:53.055060+0000","last_undegraded":"2024-05-08T18:53:53.055060+0000","last_fullsized":"2024-05-08T18:53:53.055060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:53.054930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:53.054930+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.054930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:23.805172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'15","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:15.083821+0000","last_change":"2024-05-08T18:54:15.083821+0000","last_active":"2024-05-08T18:54:15.083821+0000","last_peered":"2024-05-08T18:54:15.083821+0000","last_clean":"2024-05-08T18:54:15.083821+0000","last_became_active":"2024-05-08T18:50:32.041231+0000","last_became_peered":"2024-05-08T18:50:32.041231+0000","last_unstale":"2024-05-08T18:54:15.083821+0000","last_undegraded":"2024-05-08T18:54:15.083821+0000","last_fullsized":"2024-05-08T18:54:15.083821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-08T18:54:15.083708+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-08T18:54:15.083708+0000","last_clean_scrub_stamp":"2024-05-08T18:54:15.083708+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:23.385394+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"27'285","reported_seq":402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:50.993052+0000","last_change":"2024-05-08T18:53:50.993052+0000","last_active":"2024-05-08T18:53:50.993052+0000","last_peered":"2024-05-08T18:53:50.993052+0000","last_clean":"2024-05-08T18:53:50.993052+0000","last_became_active":"2024-05-08T18:50:34.047608+0000","last_became_peered":"2024-05-08T18:50:34.047608+0000","last_unstale":"2024-05-08T18:53:50.993052+0000","last_undegraded":"2024-05-08T18:53:50.993052+0000","last_fullsized":"2024-05-08T18:53:50.993052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:50.992925+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:50.992925+0000","last_clean_scrub_stamp":"2024-05-08T18:53:50.992925+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:17.318647+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"25'5","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:39.876473+0000","last_change":"2024-05-08T18:54:39.876473+0000","last_active":"2024-05-08T18:54:39.876473+0000","last_peered":"2024-05-08T18:54:39.876473+0000","last_clean":"2024-05-08T18:54:39.876473+0000","last_became_active":"2024-05-08T18:50:36.054747+0000","last_became_peered":"2024-05-08T18:50:36.054747+0000","last_unstale":"2024-05-08T18:54:39.876473+0000","last_undegraded":"2024-05-08T18:54:39.876473+0000","last_fullsized":"2024-05-08T18:54:39.876473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-08T18:54:39.876310+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-08T18:54:39.876310+0000","last_clean_scrub_stamp":"2024-05-08T18:54:39.876310+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:20.489072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:21.941842+0000","last_change":"2024-05-08T18:54:21.941842+0000","last_active":"2024-05-08T18:54:21.941842+0000","last_peered":"2024-05-08T18:54:21.941842+0000","last_clean":"2024-05-08T18:54:21.941842+0000","last_became_active":"2024-05-08T18:50:28.033163+0000","last_became_peered":"2024-05-08T18:50:28.033163+0000","last_unstale":"2024-05-08T18:54:21.941842+0000","last_undegraded":"2024-05-08T18:54:21.941842+0000","last_fullsized":"2024-05-08T18:54:21.941842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:21.941726+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:21.941726+0000","last_clean_scrub_stamp":"2024-05-08T18:54:21.941726+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:33.131935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:35.794473+0000","last_change":"2024-05-08T18:54:35.794473+0000","last_active":"2024-05-08T18:54:35.794473+0000","last_peered":"2024-05-08T18:54:35.794473+0000","last_clean":"2024-05-08T18:54:35.794473+0000","last_became_active":"2024-05-08T18:50:26.026719+0000","last_became_peered":"2024-05-08T18:50:26.026719+0000","last_unstale":"2024-05-08T18:54:35.794473+0000","last_undegraded":"2024-05-08T18:54:35.794473+0000","last_fullsized":"2024-05-08T18:54:35.794473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:35.794356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:35.794356+0000","last_clean_scrub_stamp":"2024-05-08T18:54:35.794356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:32.011854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:54.960867+0000","last_change":"2024-05-08T18:54:54.960894+0000","last_active":"2024-05-08T18:54:54.960867+0000","last_peered":"2024-05-08T18:54:54.960867+0000","last_clean":"2024-05-08T18:54:54.960867+0000","last_became_active":"2024-05-08T18:50:19.738971+0000","last_became_peered":"2024-05-08T18:50:19.738971+0000","last_unstale":"2024-05-08T18:54:54.960867+0000","last_undegraded":"2024-05-08T18:54:54.960867+0000","last_fullsized":"2024-05-08T18:54:54.960867+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:54.960774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:54.960774+0000","last_clean_scrub_stamp":"2024-05-08T18:54:54.960774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:10.537541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:55.069024+0000","last_change":"2024-05-08T18:53:55.069024+0000","last_active":"2024-05-08T18:53:55.069024+0000","last_peered":"2024-05-08T18:53:55.069024+0000","last_clean":"2024-05-08T18:53:55.069024+0000","last_became_active":"2024-05-08T18:50:30.032197+0000","last_became_peered":"2024-05-08T18:50:30.032197+0000","last_unstale":"2024-05-08T18:53:55.069024+0000","last_undegraded":"2024-05-08T18:53:55.069024+0000","last_fullsized":"2024-05-08T18:53:55.069024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:55.068843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:55.068843+0000","last_clean_scrub_stamp":"2024-05-08T18:53:55.068843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:15.069363+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"27'96","reported_seq":190,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:53.979024+0000","last_change":"2024-05-08T18:53:53.979024+0000","last_active":"2024-05-08T18:53:53.979024+0000","last_peered":"2024-05-08T18:53:53.979024+0000","last_clean":"2024-05-08T18:53:53.979024+0000","last_became_active":"2024-05-08T18:50:32.043109+0000","last_became_peered":"2024-05-08T18:50:32.043109+0000","last_unstale":"2024-05-08T18:53:53.979024+0000","last_undegraded":"2024-05-08T18:53:53.979024+0000","last_fullsized":"2024-05-08T18:53:53.979024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'96","last_scrub_stamp":"2024-05-08T18:53:53.978862+0000","last_deep_scrub":"27'96","last_deep_scrub_stamp":"2024-05-08T18:53:53.978862+0000","last_clean_scrub_stamp":"2024-05-08T18:53:53.978862+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:02.797212+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:52.944818+0000","last_change":"2024-05-08T18:53:52.944818+0000","last_active":"2024-05-08T18:53:52.944818+0000","last_peered":"2024-05-08T18:53:52.944818+0000","last_clean":"2024-05-08T18:53:52.944818+0000","last_became_active":"2024-05-08T18:50:34.043495+0000","last_became_peered":"2024-05-08T18:50:34.043495+0000","last_unstale":"2024-05-08T18:53:52.944818+0000","last_undegraded":"2024-05-08T18:53:52.944818+0000","last_fullsized":"2024-05-08T18:53:52.944818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:52.944707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:52.944707+0000","last_clean_scrub_stamp":"2024-05-08T18:53:52.944707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:51.657538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:59.972499+0000","last_change":"2024-05-08T18:53:59.972499+0000","last_active":"2024-05-08T18:53:59.972499+0000","last_peered":"2024-05-08T18:53:59.972499+0000","last_clean":"2024-05-08T18:53:59.972499+0000","last_became_active":"2024-05-08T18:50:36.044491+0000","last_became_peered":"2024-05-08T18:50:36.044491+0000","last_unstale":"2024-05-08T18:53:59.972499+0000","last_undegraded":"2024-05-08T18:53:59.972499+0000","last_fullsized":"2024-05-08T18:53:59.972499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:53:59.972386+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:53:59.972386+0000","last_clean_scrub_stamp":"2024-05-08T18:53:59.972386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:29.340986+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:35.862452+0000","last_change":"2024-05-08T18:54:35.862452+0000","last_active":"2024-05-08T18:54:35.862452+0000","last_peered":"2024-05-08T18:54:35.862452+0000","last_clean":"2024-05-08T18:54:35.862452+0000","last_became_active":"2024-05-08T18:50:36.050722+0000","last_became_peered":"2024-05-08T18:50:36.050722+0000","last_unstale":"2024-05-08T18:54:35.862452+0000","last_undegraded":"2024-05-08T18:54:35.862452+0000","last_fullsized":"2024-05-08T18:54:35.862452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:35.862340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:35.862340+0000","last_clean_scrub_stamp":"2024-05-08T18:54:35.862340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:40:20.606010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"27'10","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:17.952151+0000","last_change":"2024-05-08T18:54:17.952151+0000","last_active":"2024-05-08T18:54:17.952151+0000","last_peered":"2024-05-08T18:54:17.952151+0000","last_clean":"2024-05-08T18:54:17.952151+0000","last_became_active":"2024-05-08T18:50:28.033010+0000","last_became_peered":"2024-05-08T18:50:28.033010+0000","last_unstale":"2024-05-08T18:54:17.952151+0000","last_undegraded":"2024-05-08T18:54:17.952151+0000","last_fullsized":"2024-05-08T18:54:17.952151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:17.952018+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:17.952018+0000","last_clean_scrub_stamp":"2024-05-08T18:54:17.952018+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:37.952538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:55:01.915574+0000","last_change":"2024-05-08T18:55:01.915574+0000","last_active":"2024-05-08T18:55:01.915574+0000","last_peered":"2024-05-08T18:55:01.915574+0000","last_clean":"2024-05-08T18:55:01.915574+0000","last_became_active":"2024-05-08T18:50:26.025828+0000","last_became_peered":"2024-05-08T18:50:26.025828+0000","last_unstale":"2024-05-08T18:55:01.915574+0000","last_undegraded":"2024-05-08T18:55:01.915574+0000","last_fullsized":"2024-05-08T18:55:01.915574+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:55:01.915463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:55:01.915463+0000","last_clean_scrub_stamp":"2024-05-08T18:55:01.915463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:09:31.237891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:43.813690+0000","last_change":"2024-05-08T18:54:43.813690+0000","last_active":"2024-05-08T18:54:43.813690+0000","last_peered":"2024-05-08T18:54:43.813690+0000","last_clean":"2024-05-08T18:54:43.813690+0000","last_became_active":"2024-05-08T18:51:15.082590+0000","last_became_peered":"2024-05-08T18:51:15.082590+0000","last_unstale":"2024-05-08T18:54:43.813690+0000","last_undegraded":"2024-05-08T18:54:43.813690+0000","last_fullsized":"2024-05-08T18:54:43.813690+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:43.813554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:43.813554+0000","last_clean_scrub_stamp":"2024-05-08T18:54:43.813554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:33:00.368170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"27'40","reported_seq":97,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:50.089149+0000","last_change":"2024-05-08T18:53:50.089149+0000","last_active":"2024-05-08T18:53:50.089149+0000","last_peered":"2024-05-08T18:53:50.089149+0000","last_clean":"2024-05-08T18:53:50.089149+0000","last_became_active":"2024-05-08T18:50:32.038591+0000","last_became_peered":"2024-05-08T18:50:32.038591+0000","last_unstale":"2024-05-08T18:53:50.089149+0000","last_undegraded":"2024-05-08T18:53:50.089149+0000","last_fullsized":"2024-05-08T18:53:50.089149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'40","last_scrub_stamp":"2024-05-08T18:53:50.089008+0000","last_deep_scrub":"27'40","last_deep_scrub_stamp":"2024-05-08T18:53:50.089008+0000","last_clean_scrub_stamp":"2024-05-08T18:53:50.089008+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:45:59.963311+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:20.043031+0000","last_change":"2024-05-08T18:54:20.043031+0000","last_active":"2024-05-08T18:54:20.043031+0000","last_peered":"2024-05-08T18:54:20.043031+0000","last_clean":"2024-05-08T18:54:20.043031+0000","last_became_active":"2024-05-08T18:50:34.050749+0000","last_became_peered":"2024-05-08T18:50:34.050749+0000","last_unstale":"2024-05-08T18:54:20.043031+0000","last_undegraded":"2024-05-08T18:54:20.043031+0000","last_fullsized":"2024-05-08T18:54:20.043031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:20.042859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:20.042859+0000","last_clean_scrub_stamp":"2024-05-08T18:54:20.042859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:33.623374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"27'15","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:45.105436+0000","last_change":"2024-05-08T18:54:45.105461+0000","last_active":"2024-05-08T18:54:45.105436+0000","last_peered":"2024-05-08T18:54:45.105436+0000","last_clean":"2024-05-08T18:54:45.105436+0000","last_became_active":"2024-05-08T18:50:36.054102+0000","last_became_peered":"2024-05-08T18:50:36.054102+0000","last_unstale":"2024-05-08T18:54:45.105436+0000","last_undegraded":"2024-05-08T18:54:45.105436+0000","last_fullsized":"2024-05-08T18:54:45.105436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-08T18:54:45.105346+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-08T18:54:45.105346+0000","last_clean_scrub_stamp":"2024-05-08T18:54:45.105346+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:28.262580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":66,"num_write":41,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"27'6","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:08.935717+0000","last_change":"2024-05-08T18:54:08.935717+0000","last_active":"2024-05-08T18:54:08.935717+0000","last_peered":"2024-05-08T18:54:08.935717+0000","last_clean":"2024-05-08T18:54:08.935717+0000","last_became_active":"2024-05-08T18:50:28.038587+0000","last_became_peered":"2024-05-08T18:50:28.038587+0000","last_unstale":"2024-05-08T18:54:08.935717+0000","last_undegraded":"2024-05-08T18:54:08.935717+0000","last_fullsized":"2024-05-08T18:54:08.935717+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:08.935594+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:08.935594+0000","last_clean_scrub_stamp":"2024-05-08T18:54:08.935594+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:39.685836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:18.918440+0000","last_change":"2024-05-08T18:54:18.918440+0000","last_active":"2024-05-08T18:54:18.918440+0000","last_peered":"2024-05-08T18:54:18.918440+0000","last_clean":"2024-05-08T18:54:18.918440+0000","last_became_active":"2024-05-08T18:50:26.031509+0000","last_became_peered":"2024-05-08T18:50:26.031509+0000","last_unstale":"2024-05-08T18:54:18.918440+0000","last_undegraded":"2024-05-08T18:54:18.918440+0000","last_fullsized":"2024-05-08T18:54:18.918440+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:18.918312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:18.918312+0000","last_clean_scrub_stamp":"2024-05-08T18:54:18.918312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:54.297707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:51.065788+0000","last_change":"2024-05-08T18:53:51.065788+0000","last_active":"2024-05-08T18:53:51.065788+0000","last_peered":"2024-05-08T18:53:51.065788+0000","last_clean":"2024-05-08T18:53:51.065788+0000","last_became_active":"2024-05-08T18:50:30.034178+0000","last_became_peered":"2024-05-08T18:50:30.034178+0000","last_unstale":"2024-05-08T18:53:51.065788+0000","last_undegraded":"2024-05-08T18:53:51.065788+0000","last_fullsized":"2024-05-08T18:53:51.065788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:51.065645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:51.065645+0000","last_clean_scrub_stamp":"2024-05-08T18:53:51.065645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:42.592612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'9","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:00.016762+0000","last_change":"2024-05-08T18:54:00.016762+0000","last_active":"2024-05-08T18:54:00.016762+0000","last_peered":"2024-05-08T18:54:00.016762+0000","last_clean":"2024-05-08T18:54:00.016762+0000","last_became_active":"2024-05-08T18:50:32.036371+0000","last_became_peered":"2024-05-08T18:50:32.036371+0000","last_unstale":"2024-05-08T18:54:00.016762+0000","last_undegraded":"2024-05-08T18:54:00.016762+0000","last_fullsized":"2024-05-08T18:54:00.016762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-08T18:54:00.016634+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-08T18:54:00.016634+0000","last_clean_scrub_stamp":"2024-05-08T18:54:00.016634+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:58:07.475619+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:52.036087+0000","last_change":"2024-05-08T18:53:52.036087+0000","last_active":"2024-05-08T18:53:52.036087+0000","last_peered":"2024-05-08T18:53:52.036087+0000","last_clean":"2024-05-08T18:53:52.036087+0000","last_became_active":"2024-05-08T18:50:34.048434+0000","last_became_peered":"2024-05-08T18:50:34.048434+0000","last_unstale":"2024-05-08T18:53:52.036087+0000","last_undegraded":"2024-05-08T18:53:52.036087+0000","last_fullsized":"2024-05-08T18:53:52.036087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:52.035926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:52.035926+0000","last_clean_scrub_stamp":"2024-05-08T18:53:52.035926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:09.492022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:42.006706+0000","last_change":"2024-05-08T18:54:42.006750+0000","last_active":"2024-05-08T18:54:42.006706+0000","last_peered":"2024-05-08T18:54:42.006706+0000","last_clean":"2024-05-08T18:54:42.006706+0000","last_became_active":"2024-05-08T18:50:36.047379+0000","last_became_peered":"2024-05-08T18:50:36.047379+0000","last_unstale":"2024-05-08T18:54:42.006706+0000","last_undegraded":"2024-05-08T18:54:42.006706+0000","last_fullsized":"2024-05-08T18:54:42.006706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:42.006566+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:42.006566+0000","last_clean_scrub_stamp":"2024-05-08T18:54:42.006566+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:51:59.612675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"27'6","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:19.140338+0000","last_change":"2024-05-08T18:54:19.140338+0000","last_active":"2024-05-08T18:54:19.140338+0000","last_peered":"2024-05-08T18:54:19.140338+0000","last_clean":"2024-05-08T18:54:19.140338+0000","last_became_active":"2024-05-08T18:50:28.022636+0000","last_became_peered":"2024-05-08T18:50:28.022636+0000","last_unstale":"2024-05-08T18:54:19.140338+0000","last_undegraded":"2024-05-08T18:54:19.140338+0000","last_fullsized":"2024-05-08T18:54:19.140338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:19.140160+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:19.140160+0000","last_clean_scrub_stamp":"2024-05-08T18:54:19.140160+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:58:19.922822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"25'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:22.954361+0000","last_change":"2024-05-08T18:54:22.954361+0000","last_active":"2024-05-08T18:54:22.954361+0000","last_peered":"2024-05-08T18:54:22.954361+0000","last_clean":"2024-05-08T18:54:22.954361+0000","last_became_active":"2024-05-08T18:50:26.030884+0000","last_became_peered":"2024-05-08T18:50:26.030884+0000","last_unstale":"2024-05-08T18:54:22.954361+0000","last_undegraded":"2024-05-08T18:54:22.954361+0000","last_fullsized":"2024-05-08T18:54:22.954361+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:22.954247+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:22.954247+0000","last_clean_scrub_stamp":"2024-05-08T18:54:22.954247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:34.259820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:02.929688+0000","last_change":"2024-05-08T18:54:02.929688+0000","last_active":"2024-05-08T18:54:02.929688+0000","last_peered":"2024-05-08T18:54:02.929688+0000","last_clean":"2024-05-08T18:54:02.929688+0000","last_became_active":"2024-05-08T18:50:30.030773+0000","last_became_peered":"2024-05-08T18:50:30.030773+0000","last_unstale":"2024-05-08T18:54:02.929688+0000","last_undegraded":"2024-05-08T18:54:02.929688+0000","last_fullsized":"2024-05-08T18:54:02.929688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:02.929533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:02.929533+0000","last_clean_scrub_stamp":"2024-05-08T18:54:02.929533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:48:24.910553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"27'47","reported_seq":120,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:01.044974+0000","last_change":"2024-05-08T18:54:01.044974+0000","last_active":"2024-05-08T18:54:01.044974+0000","last_peered":"2024-05-08T18:54:01.044974+0000","last_clean":"2024-05-08T18:54:01.044974+0000","last_became_active":"2024-05-08T18:50:32.032289+0000","last_became_peered":"2024-05-08T18:50:32.032289+0000","last_unstale":"2024-05-08T18:54:01.044974+0000","last_undegraded":"2024-05-08T18:54:01.044974+0000","last_fullsized":"2024-05-08T18:54:01.044974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'47","last_scrub_stamp":"2024-05-08T18:54:01.044854+0000","last_deep_scrub":"27'47","last_deep_scrub_stamp":"2024-05-08T18:54:01.044854+0000","last_clean_scrub_stamp":"2024-05-08T18:54:01.044854+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:01.160239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:45.050721+0000","last_change":"2024-05-08T18:53:45.050721+0000","last_active":"2024-05-08T18:53:45.050721+0000","last_peered":"2024-05-08T18:53:45.050721+0000","last_clean":"2024-05-08T18:53:45.050721+0000","last_became_active":"2024-05-08T18:50:34.042903+0000","last_became_peered":"2024-05-08T18:50:34.042903+0000","last_unstale":"2024-05-08T18:53:45.050721+0000","last_undegraded":"2024-05-08T18:53:45.050721+0000","last_fullsized":"2024-05-08T18:53:45.050721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:45.050602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:45.050602+0000","last_clean_scrub_stamp":"2024-05-08T18:53:45.050602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:47:02.506698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:36.049041+0000","last_change":"2024-05-08T18:54:36.049066+0000","last_active":"2024-05-08T18:54:36.049041+0000","last_peered":"2024-05-08T18:54:36.049041+0000","last_clean":"2024-05-08T18:54:36.049041+0000","last_became_active":"2024-05-08T18:50:36.055855+0000","last_became_peered":"2024-05-08T18:50:36.055855+0000","last_unstale":"2024-05-08T18:54:36.049041+0000","last_undegraded":"2024-05-08T18:54:36.049041+0000","last_fullsized":"2024-05-08T18:54:36.049041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:36.048948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:36.048948+0000","last_clean_scrub_stamp":"2024-05-08T18:54:36.048948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:42:02.455091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"27'12","reported_seq":65,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:21.089082+0000","last_change":"2024-05-08T18:54:21.089082+0000","last_active":"2024-05-08T18:54:21.089082+0000","last_peered":"2024-05-08T18:54:21.089082+0000","last_clean":"2024-05-08T18:54:21.089082+0000","last_became_active":"2024-05-08T18:50:28.034819+0000","last_became_peered":"2024-05-08T18:50:28.034819+0000","last_unstale":"2024-05-08T18:54:21.089082+0000","last_undegraded":"2024-05-08T18:54:21.089082+0000","last_fullsized":"2024-05-08T18:54:21.089082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-08T18:54:21.088960+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-08T18:54:21.088960+0000","last_clean_scrub_stamp":"2024-05-08T18:54:21.088960+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:41.111340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:28.703748+0000","last_change":"2024-05-08T18:54:28.703748+0000","last_active":"2024-05-08T18:54:28.703748+0000","last_peered":"2024-05-08T18:54:28.703748+0000","last_clean":"2024-05-08T18:54:28.703748+0000","last_became_active":"2024-05-08T18:50:26.029211+0000","last_became_peered":"2024-05-08T18:50:26.029211+0000","last_unstale":"2024-05-08T18:54:28.703748+0000","last_undegraded":"2024-05-08T18:54:28.703748+0000","last_fullsized":"2024-05-08T18:54:28.703748+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:28.703639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:28.703639+0000","last_clean_scrub_stamp":"2024-05-08T18:54:28.703639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:39.823439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:57.055135+0000","last_change":"2024-05-08T18:53:57.055135+0000","last_active":"2024-05-08T18:53:57.055135+0000","last_peered":"2024-05-08T18:53:57.055135+0000","last_clean":"2024-05-08T18:53:57.055135+0000","last_became_active":"2024-05-08T18:50:30.031588+0000","last_became_peered":"2024-05-08T18:50:30.031588+0000","last_unstale":"2024-05-08T18:53:57.055135+0000","last_undegraded":"2024-05-08T18:53:57.055135+0000","last_fullsized":"2024-05-08T18:53:57.055135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:57.054969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:57.054969+0000","last_clean_scrub_stamp":"2024-05-08T18:53:57.054969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:57:44.577983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"27'36","reported_seq":92,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:57.960966+0000","last_change":"2024-05-08T18:53:57.960966+0000","last_active":"2024-05-08T18:53:57.960966+0000","last_peered":"2024-05-08T18:53:57.960966+0000","last_clean":"2024-05-08T18:53:57.960966+0000","last_became_active":"2024-05-08T18:50:32.035181+0000","last_became_peered":"2024-05-08T18:50:32.035181+0000","last_unstale":"2024-05-08T18:53:57.960966+0000","last_undegraded":"2024-05-08T18:53:57.960966+0000","last_fullsized":"2024-05-08T18:53:57.960966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'36","last_scrub_stamp":"2024-05-08T18:53:57.960820+0000","last_deep_scrub":"27'36","last_deep_scrub_stamp":"2024-05-08T18:53:57.960820+0000","last_clean_scrub_stamp":"2024-05-08T18:53:57.960820+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:23.268890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:49.951177+0000","last_change":"2024-05-08T18:53:49.951177+0000","last_active":"2024-05-08T18:53:49.951177+0000","last_peered":"2024-05-08T18:53:49.951177+0000","last_clean":"2024-05-08T18:53:49.951177+0000","last_became_active":"2024-05-08T18:50:34.039668+0000","last_became_peered":"2024-05-08T18:50:34.039668+0000","last_unstale":"2024-05-08T18:53:49.951177+0000","last_undegraded":"2024-05-08T18:53:49.951177+0000","last_fullsized":"2024-05-08T18:53:49.951177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:49.951058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:49.951058+0000","last_clean_scrub_stamp":"2024-05-08T18:53:49.951058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:24:24.708273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:31.079781+0000","last_change":"2024-05-08T18:54:31.079781+0000","last_active":"2024-05-08T18:54:31.079781+0000","last_peered":"2024-05-08T18:54:31.079781+0000","last_clean":"2024-05-08T18:54:31.079781+0000","last_became_active":"2024-05-08T18:50:28.025862+0000","last_became_peered":"2024-05-08T18:50:28.025862+0000","last_unstale":"2024-05-08T18:54:31.079781+0000","last_undegraded":"2024-05-08T18:54:31.079781+0000","last_fullsized":"2024-05-08T18:54:31.079781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:31.079644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:31.079644+0000","last_clean_scrub_stamp":"2024-05-08T18:54:31.079644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:35.554801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:46.989856+0000","last_change":"2024-05-08T18:54:46.989856+0000","last_active":"2024-05-08T18:54:46.989856+0000","last_peered":"2024-05-08T18:54:46.989856+0000","last_clean":"2024-05-08T18:54:46.989856+0000","last_became_active":"2024-05-08T18:50:26.022874+0000","last_became_peered":"2024-05-08T18:50:26.022874+0000","last_unstale":"2024-05-08T18:54:46.989856+0000","last_undegraded":"2024-05-08T18:54:46.989856+0000","last_fullsized":"2024-05-08T18:54:46.989856+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:46.989745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:46.989745+0000","last_clean_scrub_stamp":"2024-05-08T18:54:46.989745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:06.061717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:08.022479+0000","last_change":"2024-05-08T18:54:08.022479+0000","last_active":"2024-05-08T18:54:08.022479+0000","last_peered":"2024-05-08T18:54:08.022479+0000","last_clean":"2024-05-08T18:54:08.022479+0000","last_became_active":"2024-05-08T18:50:30.029570+0000","last_became_peered":"2024-05-08T18:50:30.029570+0000","last_unstale":"2024-05-08T18:54:08.022479+0000","last_undegraded":"2024-05-08T18:54:08.022479+0000","last_fullsized":"2024-05-08T18:54:08.022479+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:08.022348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:08.022348+0000","last_clean_scrub_stamp":"2024-05-08T18:54:08.022348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:50:31.732172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"27'65","reported_seq":138,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.032557+0000","last_change":"2024-05-08T18:53:58.032598+0000","last_active":"2024-05-08T18:53:58.032557+0000","last_peered":"2024-05-08T18:53:58.032557+0000","last_clean":"2024-05-08T18:53:58.032557+0000","last_became_active":"2024-05-08T18:50:32.039293+0000","last_became_peered":"2024-05-08T18:50:32.039293+0000","last_unstale":"2024-05-08T18:53:58.032557+0000","last_undegraded":"2024-05-08T18:53:58.032557+0000","last_fullsized":"2024-05-08T18:53:58.032557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'65","last_scrub_stamp":"2024-05-08T18:53:58.032459+0000","last_deep_scrub":"27'65","last_deep_scrub_stamp":"2024-05-08T18:53:58.032459+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.032459+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:46.844977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:46.910687+0000","last_change":"2024-05-08T18:53:46.910709+0000","last_active":"2024-05-08T18:53:46.910687+0000","last_peered":"2024-05-08T18:53:46.910687+0000","last_clean":"2024-05-08T18:53:46.910687+0000","last_became_active":"2024-05-08T18:50:34.047111+0000","last_became_peered":"2024-05-08T18:50:34.047111+0000","last_unstale":"2024-05-08T18:53:46.910687+0000","last_undegraded":"2024-05-08T18:53:46.910687+0000","last_fullsized":"2024-05-08T18:53:46.910687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:46.910595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:46.910595+0000","last_clean_scrub_stamp":"2024-05-08T18:53:46.910595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:27.588782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"27'14","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:15.117146+0000","last_change":"2024-05-08T18:54:15.117146+0000","last_active":"2024-05-08T18:54:15.117146+0000","last_peered":"2024-05-08T18:54:15.117146+0000","last_clean":"2024-05-08T18:54:15.117146+0000","last_became_active":"2024-05-08T18:50:36.046834+0000","last_became_peered":"2024-05-08T18:50:36.046834+0000","last_unstale":"2024-05-08T18:54:15.117146+0000","last_undegraded":"2024-05-08T18:54:15.117146+0000","last_fullsized":"2024-05-08T18:54:15.117146+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-05-08T18:54:15.116980+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-05-08T18:54:15.116980+0000","last_clean_scrub_stamp":"2024-05-08T18:54:15.116980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:44.747454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'6","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:23.073696+0000","last_change":"2024-05-08T18:54:23.073696+0000","last_active":"2024-05-08T18:54:23.073696+0000","last_peered":"2024-05-08T18:54:23.073696+0000","last_clean":"2024-05-08T18:54:23.073696+0000","last_became_active":"2024-05-08T18:50:28.023049+0000","last_became_peered":"2024-05-08T18:50:28.023049+0000","last_unstale":"2024-05-08T18:54:23.073696+0000","last_undegraded":"2024-05-08T18:54:23.073696+0000","last_fullsized":"2024-05-08T18:54:23.073696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:23.073500+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:23.073500+0000","last_clean_scrub_stamp":"2024-05-08T18:54:23.073500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:09.762958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"27'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:26.777050+0000","last_change":"2024-05-08T18:54:26.777050+0000","last_active":"2024-05-08T18:54:26.777050+0000","last_peered":"2024-05-08T18:54:26.777050+0000","last_clean":"2024-05-08T18:54:26.777050+0000","last_became_active":"2024-05-08T18:50:26.029008+0000","last_became_peered":"2024-05-08T18:50:26.029008+0000","last_unstale":"2024-05-08T18:54:26.777050+0000","last_undegraded":"2024-05-08T18:54:26.777050+0000","last_fullsized":"2024-05-08T18:54:26.777050+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:26.776921+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:26.776921+0000","last_clean_scrub_stamp":"2024-05-08T18:54:26.776921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:29.496417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:05.886628+0000","last_change":"2024-05-08T18:54:05.886628+0000","last_active":"2024-05-08T18:54:05.886628+0000","last_peered":"2024-05-08T18:54:05.886628+0000","last_clean":"2024-05-08T18:54:05.886628+0000","last_became_active":"2024-05-08T18:50:30.026853+0000","last_became_peered":"2024-05-08T18:50:30.026853+0000","last_unstale":"2024-05-08T18:54:05.886628+0000","last_undegraded":"2024-05-08T18:54:05.886628+0000","last_fullsized":"2024-05-08T18:54:05.886628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:05.886508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:05.886508+0000","last_clean_scrub_stamp":"2024-05-08T18:54:05.886508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:58.280018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"27'45","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.018036+0000","last_change":"2024-05-08T18:53:58.018103+0000","last_active":"2024-05-08T18:53:58.018036+0000","last_peered":"2024-05-08T18:53:58.018036+0000","last_clean":"2024-05-08T18:53:58.018036+0000","last_became_active":"2024-05-08T18:50:32.041208+0000","last_became_peered":"2024-05-08T18:50:32.041208+0000","last_unstale":"2024-05-08T18:53:58.018036+0000","last_undegraded":"2024-05-08T18:53:58.018036+0000","last_fullsized":"2024-05-08T18:53:58.018036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'45","last_scrub_stamp":"2024-05-08T18:53:58.017901+0000","last_deep_scrub":"27'45","last_deep_scrub_stamp":"2024-05-08T18:53:58.017901+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.017901+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:24:08.011328+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:56.078504+0000","last_change":"2024-05-08T18:53:56.078528+0000","last_active":"2024-05-08T18:53:56.078504+0000","last_peered":"2024-05-08T18:53:56.078504+0000","last_clean":"2024-05-08T18:53:56.078504+0000","last_became_active":"2024-05-08T18:50:34.048749+0000","last_became_peered":"2024-05-08T18:50:34.048749+0000","last_unstale":"2024-05-08T18:53:56.078504+0000","last_undegraded":"2024-05-08T18:53:56.078504+0000","last_fullsized":"2024-05-08T18:53:56.078504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:56.078418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:56.078418+0000","last_clean_scrub_stamp":"2024-05-08T18:53:56.078418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:48:18.059438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:55:02.877478+0000","last_change":"2024-05-08T18:55:02.877478+0000","last_active":"2024-05-08T18:55:02.877478+0000","last_peered":"2024-05-08T18:55:02.877478+0000","last_clean":"2024-05-08T18:55:02.877478+0000","last_became_active":"2024-05-08T18:50:36.056960+0000","last_became_peered":"2024-05-08T18:50:36.056960+0000","last_unstale":"2024-05-08T18:55:02.877478+0000","last_undegraded":"2024-05-08T18:55:02.877478+0000","last_fullsized":"2024-05-08T18:55:02.877478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:55:02.877365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:55:02.877365+0000","last_clean_scrub_stamp":"2024-05-08T18:55:02.877365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:52:58.541728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"27'8","reported_seq":69,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:02.075651+0000","last_change":"2024-05-08T18:54:02.075677+0000","last_active":"2024-05-08T18:54:02.075651+0000","last_peered":"2024-05-08T18:54:02.075651+0000","last_clean":"2024-05-08T18:54:02.075651+0000","last_became_active":"2024-05-08T18:50:28.038364+0000","last_became_peered":"2024-05-08T18:50:28.038364+0000","last_unstale":"2024-05-08T18:54:02.075651+0000","last_undegraded":"2024-05-08T18:54:02.075651+0000","last_fullsized":"2024-05-08T18:54:02.075651+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:02.075564+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:02.075564+0000","last_clean_scrub_stamp":"2024-05-08T18:54:02.075564+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:05:34.353002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"27'4","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:30.667850+0000","last_change":"2024-05-08T18:54:30.667876+0000","last_active":"2024-05-08T18:54:30.667850+0000","last_peered":"2024-05-08T18:54:30.667850+0000","last_clean":"2024-05-08T18:54:30.667850+0000","last_became_active":"2024-05-08T18:50:26.012506+0000","last_became_peered":"2024-05-08T18:50:26.012506+0000","last_unstale":"2024-05-08T18:54:30.667850+0000","last_undegraded":"2024-05-08T18:54:30.667850+0000","last_fullsized":"2024-05-08T18:54:30.667850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:30.667727+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:30.667727+0000","last_clean_scrub_stamp":"2024-05-08T18:54:30.667727+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:32:45.041891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:06.873106+0000","last_change":"2024-05-08T18:54:06.873131+0000","last_active":"2024-05-08T18:54:06.873106+0000","last_peered":"2024-05-08T18:54:06.873106+0000","last_clean":"2024-05-08T18:54:06.873106+0000","last_became_active":"2024-05-08T18:50:30.026445+0000","last_became_peered":"2024-05-08T18:50:30.026445+0000","last_unstale":"2024-05-08T18:54:06.873106+0000","last_undegraded":"2024-05-08T18:54:06.873106+0000","last_fullsized":"2024-05-08T18:54:06.873106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:06.873001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:06.873001+0000","last_clean_scrub_stamp":"2024-05-08T18:54:06.873001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:55.685519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"27'39","reported_seq":96,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:57.045805+0000","last_change":"2024-05-08T18:53:57.045805+0000","last_active":"2024-05-08T18:53:57.045805+0000","last_peered":"2024-05-08T18:53:57.045805+0000","last_clean":"2024-05-08T18:53:57.045805+0000","last_became_active":"2024-05-08T18:50:32.040745+0000","last_became_peered":"2024-05-08T18:50:32.040745+0000","last_unstale":"2024-05-08T18:53:57.045805+0000","last_undegraded":"2024-05-08T18:53:57.045805+0000","last_fullsized":"2024-05-08T18:53:57.045805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'39","last_scrub_stamp":"2024-05-08T18:53:57.045641+0000","last_deep_scrub":"27'39","last_deep_scrub_stamp":"2024-05-08T18:53:57.045641+0000","last_clean_scrub_stamp":"2024-05-08T18:53:57.045641+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:49.439151+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:46.999290+0000","last_change":"2024-05-08T18:53:46.999290+0000","last_active":"2024-05-08T18:53:46.999290+0000","last_peered":"2024-05-08T18:53:46.999290+0000","last_clean":"2024-05-08T18:53:46.999290+0000","last_became_active":"2024-05-08T18:50:34.047508+0000","last_became_peered":"2024-05-08T18:50:34.047508+0000","last_unstale":"2024-05-08T18:53:46.999290+0000","last_undegraded":"2024-05-08T18:53:46.999290+0000","last_fullsized":"2024-05-08T18:53:46.999290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:46.999168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:46.999168+0000","last_clean_scrub_stamp":"2024-05-08T18:53:46.999168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:21:10.901638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"27'9","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:55:04.921051+0000","last_change":"2024-05-08T18:55:04.921051+0000","last_active":"2024-05-08T18:55:04.921051+0000","last_peered":"2024-05-08T18:55:04.921051+0000","last_clean":"2024-05-08T18:55:04.921051+0000","last_became_active":"2024-05-08T18:50:36.057863+0000","last_became_peered":"2024-05-08T18:50:36.057863+0000","last_unstale":"2024-05-08T18:55:04.921051+0000","last_undegraded":"2024-05-08T18:55:04.921051+0000","last_fullsized":"2024-05-08T18:55:04.921051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-08T18:55:04.920936+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-08T18:55:04.920936+0000","last_clean_scrub_stamp":"2024-05-08T18:55:04.920936+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:32:14.506288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"25'2","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:17.193780+0000","last_change":"2024-05-08T18:54:17.193805+0000","last_active":"2024-05-08T18:54:17.193780+0000","last_peered":"2024-05-08T18:54:17.193780+0000","last_clean":"2024-05-08T18:54:17.193780+0000","last_became_active":"2024-05-08T18:50:28.020441+0000","last_became_peered":"2024-05-08T18:50:28.020441+0000","last_unstale":"2024-05-08T18:54:17.193780+0000","last_undegraded":"2024-05-08T18:54:17.193780+0000","last_fullsized":"2024-05-08T18:54:17.193780+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:17.193655+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:17.193655+0000","last_clean_scrub_stamp":"2024-05-08T18:54:17.193655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:19.480048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"25'2","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:39.101144+0000","last_change":"2024-05-08T18:54:39.101198+0000","last_active":"2024-05-08T18:54:39.101144+0000","last_peered":"2024-05-08T18:54:39.101144+0000","last_clean":"2024-05-08T18:54:39.101144+0000","last_became_active":"2024-05-08T18:50:26.024274+0000","last_became_peered":"2024-05-08T18:50:26.024274+0000","last_unstale":"2024-05-08T18:54:39.101144+0000","last_undegraded":"2024-05-08T18:54:39.101144+0000","last_fullsized":"2024-05-08T18:54:39.101144+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:39.101020+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:39.101020+0000","last_clean_scrub_stamp":"2024-05-08T18:54:39.101020+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:40.877601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:01.042454+0000","last_change":"2024-05-08T18:54:01.042477+0000","last_active":"2024-05-08T18:54:01.042454+0000","last_peered":"2024-05-08T18:54:01.042454+0000","last_clean":"2024-05-08T18:54:01.042454+0000","last_became_active":"2024-05-08T18:50:30.028877+0000","last_became_peered":"2024-05-08T18:50:30.028877+0000","last_unstale":"2024-05-08T18:54:01.042454+0000","last_undegraded":"2024-05-08T18:54:01.042454+0000","last_fullsized":"2024-05-08T18:54:01.042454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:01.042364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:01.042364+0000","last_clean_scrub_stamp":"2024-05-08T18:54:01.042364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:34:56.888219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'15","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:17.120963+0000","last_change":"2024-05-08T18:54:17.120963+0000","last_active":"2024-05-08T18:54:17.120963+0000","last_peered":"2024-05-08T18:54:17.120963+0000","last_clean":"2024-05-08T18:54:17.120963+0000","last_became_active":"2024-05-08T18:50:32.041539+0000","last_became_peered":"2024-05-08T18:50:32.041539+0000","last_unstale":"2024-05-08T18:54:17.120963+0000","last_undegraded":"2024-05-08T18:54:17.120963+0000","last_fullsized":"2024-05-08T18:54:17.120963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-08T18:54:17.120821+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-08T18:54:17.120821+0000","last_clean_scrub_stamp":"2024-05-08T18:54:17.120821+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:31.398678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"27'285","reported_seq":419,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:47.959752+0000","last_change":"2024-05-08T18:53:47.959752+0000","last_active":"2024-05-08T18:53:47.959752+0000","last_peered":"2024-05-08T18:53:47.959752+0000","last_clean":"2024-05-08T18:53:47.959752+0000","last_became_active":"2024-05-08T18:50:34.048421+0000","last_became_peered":"2024-05-08T18:50:34.048421+0000","last_unstale":"2024-05-08T18:53:47.959752+0000","last_undegraded":"2024-05-08T18:53:47.959752+0000","last_fullsized":"2024-05-08T18:53:47.959752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'285","last_scrub_stamp":"2024-05-08T18:53:47.959631+0000","last_deep_scrub":"27'285","last_deep_scrub_stamp":"2024-05-08T18:53:47.959631+0000","last_clean_scrub_stamp":"2024-05-08T18:53:47.959631+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:52:13.795244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:32.125723+0000","last_change":"2024-05-08T18:54:32.125723+0000","last_active":"2024-05-08T18:54:32.125723+0000","last_peered":"2024-05-08T18:54:32.125723+0000","last_clean":"2024-05-08T18:54:32.125723+0000","last_became_active":"2024-05-08T18:50:36.055184+0000","last_became_peered":"2024-05-08T18:50:36.055184+0000","last_unstale":"2024-05-08T18:54:32.125723+0000","last_undegraded":"2024-05-08T18:54:32.125723+0000","last_fullsized":"2024-05-08T18:54:32.125723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-08T18:54:32.125611+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-08T18:54:32.125611+0000","last_clean_scrub_stamp":"2024-05-08T18:54:32.125611+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:30:20.547668+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"27'4","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:11.971785+0000","last_change":"2024-05-08T18:54:11.971848+0000","last_active":"2024-05-08T18:54:11.971785+0000","last_peered":"2024-05-08T18:54:11.971785+0000","last_clean":"2024-05-08T18:54:11.971785+0000","last_became_active":"2024-05-08T18:50:28.025313+0000","last_became_peered":"2024-05-08T18:50:28.025313+0000","last_unstale":"2024-05-08T18:54:11.971785+0000","last_undegraded":"2024-05-08T18:54:11.971785+0000","last_fullsized":"2024-05-08T18:54:11.971785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:11.971660+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:11.971660+0000","last_clean_scrub_stamp":"2024-05-08T18:54:11.971660+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:55.520240+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:24.786248+0000","last_change":"2024-05-08T18:54:24.786272+0000","last_active":"2024-05-08T18:54:24.786248+0000","last_peered":"2024-05-08T18:54:24.786248+0000","last_clean":"2024-05-08T18:54:24.786248+0000","last_became_active":"2024-05-08T18:50:26.030058+0000","last_became_peered":"2024-05-08T18:50:26.030058+0000","last_unstale":"2024-05-08T18:54:24.786248+0000","last_undegraded":"2024-05-08T18:54:24.786248+0000","last_fullsized":"2024-05-08T18:54:24.786248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:24.786142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:24.786142+0000","last_clean_scrub_stamp":"2024-05-08T18:54:24.786142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:07:14.186288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"27'2","reported_seq":230,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:03.029231+0000","last_change":"2024-05-08T18:54:03.029261+0000","last_active":"2024-05-08T18:54:03.029231+0000","last_peered":"2024-05-08T18:54:03.029231+0000","last_clean":"2024-05-08T18:54:03.029231+0000","last_became_active":"2024-05-08T18:50:30.024032+0000","last_became_peered":"2024-05-08T18:50:30.024032+0000","last_unstale":"2024-05-08T18:54:03.029231+0000","last_undegraded":"2024-05-08T18:54:03.029231+0000","last_fullsized":"2024-05-08T18:54:03.029231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:03.029144+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:03.029144+0000","last_clean_scrub_stamp":"2024-05-08T18:54:03.029144+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:03.144529+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"27'46","reported_seq":105,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:51.108258+0000","last_change":"2024-05-08T18:53:51.108258+0000","last_active":"2024-05-08T18:53:51.108258+0000","last_peered":"2024-05-08T18:53:51.108258+0000","last_clean":"2024-05-08T18:53:51.108258+0000","last_became_active":"2024-05-08T18:50:32.035792+0000","last_became_peered":"2024-05-08T18:50:32.035792+0000","last_unstale":"2024-05-08T18:53:51.108258+0000","last_undegraded":"2024-05-08T18:53:51.108258+0000","last_fullsized":"2024-05-08T18:53:51.108258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'46","last_scrub_stamp":"2024-05-08T18:53:51.108138+0000","last_deep_scrub":"27'46","last_deep_scrub_stamp":"2024-05-08T18:53:51.108138+0000","last_clean_scrub_stamp":"2024-05-08T18:53:51.108138+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:53:39.003860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:49.040915+0000","last_change":"2024-05-08T18:53:49.040955+0000","last_active":"2024-05-08T18:53:49.040915+0000","last_peered":"2024-05-08T18:53:49.040915+0000","last_clean":"2024-05-08T18:53:49.040915+0000","last_became_active":"2024-05-08T18:50:34.044586+0000","last_became_peered":"2024-05-08T18:50:34.044586+0000","last_unstale":"2024-05-08T18:53:49.040915+0000","last_undegraded":"2024-05-08T18:53:49.040915+0000","last_fullsized":"2024-05-08T18:53:49.040915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:49.040776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:49.040776+0000","last_clean_scrub_stamp":"2024-05-08T18:53:49.040776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:14.348846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"27'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:38.848199+0000","last_change":"2024-05-08T18:54:38.848225+0000","last_active":"2024-05-08T18:54:38.848199+0000","last_peered":"2024-05-08T18:54:38.848199+0000","last_clean":"2024-05-08T18:54:38.848199+0000","last_became_active":"2024-05-08T18:50:36.052885+0000","last_became_peered":"2024-05-08T18:50:36.052885+0000","last_unstale":"2024-05-08T18:54:38.848199+0000","last_undegraded":"2024-05-08T18:54:38.848199+0000","last_fullsized":"2024-05-08T18:54:38.848199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:38.848107+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:38.848107+0000","last_clean_scrub_stamp":"2024-05-08T18:54:38.848107+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:16.741373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"27'28","reported_seq":123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:13.997393+0000","last_change":"2024-05-08T18:54:13.997440+0000","last_active":"2024-05-08T18:54:13.997393+0000","last_peered":"2024-05-08T18:54:13.997393+0000","last_clean":"2024-05-08T18:54:13.997393+0000","last_became_active":"2024-05-08T18:50:28.025162+0000","last_became_peered":"2024-05-08T18:50:28.025162+0000","last_unstale":"2024-05-08T18:54:13.997393+0000","last_undegraded":"2024-05-08T18:54:13.997393+0000","last_fullsized":"2024-05-08T18:54:13.997393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'28","last_scrub_stamp":"2024-05-08T18:54:13.997287+0000","last_deep_scrub":"27'28","last_deep_scrub_stamp":"2024-05-08T18:54:13.997287+0000","last_clean_scrub_stamp":"2024-05-08T18:54:13.997287+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:28:05.524254+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":112,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:37.042975+0000","last_change":"2024-05-08T18:54:37.042998+0000","last_active":"2024-05-08T18:54:37.042975+0000","last_peered":"2024-05-08T18:54:37.042975+0000","last_clean":"2024-05-08T18:54:37.042975+0000","last_became_active":"2024-05-08T18:50:26.027067+0000","last_became_peered":"2024-05-08T18:50:26.027067+0000","last_unstale":"2024-05-08T18:54:37.042975+0000","last_undegraded":"2024-05-08T18:54:37.042975+0000","last_fullsized":"2024-05-08T18:54:37.042975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:37.042885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:37.042885+0000","last_clean_scrub_stamp":"2024-05-08T18:54:37.042885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:44.061790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:00.968059+0000","last_change":"2024-05-08T18:54:00.968081+0000","last_active":"2024-05-08T18:54:00.968059+0000","last_peered":"2024-05-08T18:54:00.968059+0000","last_clean":"2024-05-08T18:54:00.968059+0000","last_became_active":"2024-05-08T18:50:30.034616+0000","last_became_peered":"2024-05-08T18:50:30.034616+0000","last_unstale":"2024-05-08T18:54:00.968059+0000","last_undegraded":"2024-05-08T18:54:00.968059+0000","last_fullsized":"2024-05-08T18:54:00.968059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:00.967968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:00.967968+0000","last_clean_scrub_stamp":"2024-05-08T18:54:00.967968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:02:09.724587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"27'38","reported_seq":94,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:56.013305+0000","last_change":"2024-05-08T18:53:56.013305+0000","last_active":"2024-05-08T18:53:56.013305+0000","last_peered":"2024-05-08T18:53:56.013305+0000","last_clean":"2024-05-08T18:53:56.013305+0000","last_became_active":"2024-05-08T18:50:32.041806+0000","last_became_peered":"2024-05-08T18:50:32.041806+0000","last_unstale":"2024-05-08T18:53:56.013305+0000","last_undegraded":"2024-05-08T18:53:56.013305+0000","last_fullsized":"2024-05-08T18:53:56.013305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'38","last_scrub_stamp":"2024-05-08T18:53:56.013183+0000","last_deep_scrub":"27'38","last_deep_scrub_stamp":"2024-05-08T18:53:56.013183+0000","last_clean_scrub_stamp":"2024-05-08T18:53:56.013183+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:02.069580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:16.072290+0000","last_change":"2024-05-08T18:54:16.072313+0000","last_active":"2024-05-08T18:54:16.072290+0000","last_peered":"2024-05-08T18:54:16.072290+0000","last_clean":"2024-05-08T18:54:16.072290+0000","last_became_active":"2024-05-08T18:50:34.050445+0000","last_became_peered":"2024-05-08T18:50:34.050445+0000","last_unstale":"2024-05-08T18:54:16.072290+0000","last_undegraded":"2024-05-08T18:54:16.072290+0000","last_fullsized":"2024-05-08T18:54:16.072290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:16.072191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:16.072191+0000","last_clean_scrub_stamp":"2024-05-08T18:54:16.072191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:14.975396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:55:05.880411+0000","last_change":"2024-05-08T18:55:05.880437+0000","last_active":"2024-05-08T18:55:05.880411+0000","last_peered":"2024-05-08T18:55:05.880411+0000","last_clean":"2024-05-08T18:55:05.880411+0000","last_became_active":"2024-05-08T18:50:36.060318+0000","last_became_peered":"2024-05-08T18:50:36.060318+0000","last_unstale":"2024-05-08T18:55:05.880411+0000","last_undegraded":"2024-05-08T18:55:05.880411+0000","last_fullsized":"2024-05-08T18:55:05.880411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:55:05.880311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:55:05.880311+0000","last_clean_scrub_stamp":"2024-05-08T18:55:05.880311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:19:39.994425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"27'4","reported_seq":56,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:29.086012+0000","last_change":"2024-05-08T18:54:29.086012+0000","last_active":"2024-05-08T18:54:29.086012+0000","last_peered":"2024-05-08T18:54:29.086012+0000","last_clean":"2024-05-08T18:54:29.086012+0000","last_became_active":"2024-05-08T18:50:28.029624+0000","last_became_peered":"2024-05-08T18:50:28.029624+0000","last_unstale":"2024-05-08T18:54:29.086012+0000","last_undegraded":"2024-05-08T18:54:29.086012+0000","last_fullsized":"2024-05-08T18:54:29.086012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:29.085887+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:29.085887+0000","last_clean_scrub_stamp":"2024-05-08T18:54:29.085887+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:18.818093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"27'4","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:28.018012+0000","last_change":"2024-05-08T18:54:28.018067+0000","last_active":"2024-05-08T18:54:28.018012+0000","last_peered":"2024-05-08T18:54:28.018012+0000","last_clean":"2024-05-08T18:54:28.018012+0000","last_became_active":"2024-05-08T18:50:26.028615+0000","last_became_peered":"2024-05-08T18:50:26.028615+0000","last_unstale":"2024-05-08T18:54:28.018012+0000","last_undegraded":"2024-05-08T18:54:28.018012+0000","last_fullsized":"2024-05-08T18:54:28.018012+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:28.017906+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:28.017906+0000","last_clean_scrub_stamp":"2024-05-08T18:54:28.017906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:41:59.590604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.082277+0000","last_change":"2024-05-08T18:53:58.082277+0000","last_active":"2024-05-08T18:53:58.082277+0000","last_peered":"2024-05-08T18:53:58.082277+0000","last_clean":"2024-05-08T18:53:58.082277+0000","last_became_active":"2024-05-08T18:50:30.030295+0000","last_became_peered":"2024-05-08T18:50:30.030295+0000","last_unstale":"2024-05-08T18:53:58.082277+0000","last_undegraded":"2024-05-08T18:53:58.082277+0000","last_fullsized":"2024-05-08T18:53:58.082277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:58.082158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:58.082158+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.082158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:04.138554+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"27'30","reported_seq":83,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:52.080875+0000","last_change":"2024-05-08T18:53:52.080925+0000","last_active":"2024-05-08T18:53:52.080875+0000","last_peered":"2024-05-08T18:53:52.080875+0000","last_clean":"2024-05-08T18:53:52.080875+0000","last_became_active":"2024-05-08T18:50:32.040661+0000","last_became_peered":"2024-05-08T18:50:32.040661+0000","last_unstale":"2024-05-08T18:53:52.080875+0000","last_undegraded":"2024-05-08T18:53:52.080875+0000","last_fullsized":"2024-05-08T18:53:52.080875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'30","last_scrub_stamp":"2024-05-08T18:53:52.080762+0000","last_deep_scrub":"27'30","last_deep_scrub_stamp":"2024-05-08T18:53:52.080762+0000","last_clean_scrub_stamp":"2024-05-08T18:53:52.080762+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:08:00.849983+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:06.079512+0000","last_change":"2024-05-08T18:54:06.079537+0000","last_active":"2024-05-08T18:54:06.079512+0000","last_peered":"2024-05-08T18:54:06.079512+0000","last_clean":"2024-05-08T18:54:06.079512+0000","last_became_active":"2024-05-08T18:50:34.045040+0000","last_became_peered":"2024-05-08T18:50:34.045040+0000","last_unstale":"2024-05-08T18:54:06.079512+0000","last_undegraded":"2024-05-08T18:54:06.079512+0000","last_fullsized":"2024-05-08T18:54:06.079512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:06.079413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:06.079413+0000","last_clean_scrub_stamp":"2024-05-08T18:54:06.079413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:18.824227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:55:06.921705+0000","last_change":"2024-05-08T18:55:06.921747+0000","last_active":"2024-05-08T18:55:06.921705+0000","last_peered":"2024-05-08T18:55:06.921705+0000","last_clean":"2024-05-08T18:55:06.921705+0000","last_became_active":"2024-05-08T18:50:36.060382+0000","last_became_peered":"2024-05-08T18:50:36.060382+0000","last_unstale":"2024-05-08T18:55:06.921705+0000","last_undegraded":"2024-05-08T18:55:06.921705+0000","last_fullsized":"2024-05-08T18:55:06.921705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:55:06.921591+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:55:06.921591+0000","last_clean_scrub_stamp":"2024-05-08T18:55:06.921591+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:08:21.162995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"27'12","reported_seq":73,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:09.881161+0000","last_change":"2024-05-08T18:54:09.881161+0000","last_active":"2024-05-08T18:54:09.881161+0000","last_peered":"2024-05-08T18:54:09.881161+0000","last_clean":"2024-05-08T18:54:09.881161+0000","last_became_active":"2024-05-08T18:50:28.020421+0000","last_became_peered":"2024-05-08T18:50:28.020421+0000","last_unstale":"2024-05-08T18:54:09.881161+0000","last_undegraded":"2024-05-08T18:54:09.881161+0000","last_fullsized":"2024-05-08T18:54:09.881161+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-08T18:54:09.881030+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-08T18:54:09.881030+0000","last_clean_scrub_stamp":"2024-05-08T18:54:09.881030+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:04:09.996415+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"27'4","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:31.701515+0000","last_change":"2024-05-08T18:54:31.701515+0000","last_active":"2024-05-08T18:54:31.701515+0000","last_peered":"2024-05-08T18:54:31.701515+0000","last_clean":"2024-05-08T18:54:31.701515+0000","last_became_active":"2024-05-08T18:50:26.011299+0000","last_became_peered":"2024-05-08T18:50:26.011299+0000","last_unstale":"2024-05-08T18:54:31.701515+0000","last_undegraded":"2024-05-08T18:54:31.701515+0000","last_fullsized":"2024-05-08T18:54:31.701515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:31.701395+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:31.701395+0000","last_clean_scrub_stamp":"2024-05-08T18:54:31.701395+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:30.604600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"27'3","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:55.127480+0000","last_change":"2024-05-08T18:53:55.127480+0000","last_active":"2024-05-08T18:53:55.127480+0000","last_peered":"2024-05-08T18:53:55.127480+0000","last_clean":"2024-05-08T18:53:55.127480+0000","last_became_active":"2024-05-08T18:50:30.032578+0000","last_became_peered":"2024-05-08T18:50:30.032578+0000","last_unstale":"2024-05-08T18:53:55.127480+0000","last_undegraded":"2024-05-08T18:53:55.127480+0000","last_fullsized":"2024-05-08T18:53:55.127480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-08T18:53:55.127322+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-08T18:53:55.127322+0000","last_clean_scrub_stamp":"2024-05-08T18:53:55.127322+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:49:53.840153+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"27'42","reported_seq":99,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:13.094540+0000","last_change":"2024-05-08T18:54:13.094581+0000","last_active":"2024-05-08T18:54:13.094540+0000","last_peered":"2024-05-08T18:54:13.094540+0000","last_clean":"2024-05-08T18:54:13.094540+0000","last_became_active":"2024-05-08T18:50:32.042700+0000","last_became_peered":"2024-05-08T18:50:32.042700+0000","last_unstale":"2024-05-08T18:54:13.094540+0000","last_undegraded":"2024-05-08T18:54:13.094540+0000","last_fullsized":"2024-05-08T18:54:13.094540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'42","last_scrub_stamp":"2024-05-08T18:54:13.094441+0000","last_deep_scrub":"27'42","last_deep_scrub_stamp":"2024-05-08T18:54:13.094441+0000","last_clean_scrub_stamp":"2024-05-08T18:54:13.094441+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:24.214241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":49,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:48.036967+0000","last_change":"2024-05-08T18:53:48.036991+0000","last_active":"2024-05-08T18:53:48.036967+0000","last_peered":"2024-05-08T18:53:48.036967+0000","last_clean":"2024-05-08T18:53:48.036967+0000","last_became_active":"2024-05-08T18:50:34.044872+0000","last_became_peered":"2024-05-08T18:50:34.044872+0000","last_unstale":"2024-05-08T18:53:48.036967+0000","last_undegraded":"2024-05-08T18:53:48.036967+0000","last_fullsized":"2024-05-08T18:53:48.036967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:53:48.036872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:53:48.036872+0000","last_clean_scrub_stamp":"2024-05-08T18:53:48.036872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:44:38.478912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"27'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:24.131083+0000","last_change":"2024-05-08T18:54:24.131083+0000","last_active":"2024-05-08T18:54:24.131083+0000","last_peered":"2024-05-08T18:54:24.131083+0000","last_clean":"2024-05-08T18:54:24.131083+0000","last_became_active":"2024-05-08T18:50:36.055188+0000","last_became_peered":"2024-05-08T18:50:36.055188+0000","last_unstale":"2024-05-08T18:54:24.131083+0000","last_undegraded":"2024-05-08T18:54:24.131083+0000","last_fullsized":"2024-05-08T18:54:24.131083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:24.130900+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:24.130900+0000","last_clean_scrub_stamp":"2024-05-08T18:54:24.130900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:19:04.743662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"27'12","reported_seq":82,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:04.981908+0000","last_change":"2024-05-08T18:54:04.981908+0000","last_active":"2024-05-08T18:54:04.981908+0000","last_peered":"2024-05-08T18:54:04.981908+0000","last_clean":"2024-05-08T18:54:04.981908+0000","last_became_active":"2024-05-08T18:50:28.039290+0000","last_became_peered":"2024-05-08T18:50:28.039290+0000","last_unstale":"2024-05-08T18:54:04.981908+0000","last_undegraded":"2024-05-08T18:54:04.981908+0000","last_fullsized":"2024-05-08T18:54:04.981908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-08T18:54:04.981738+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-08T18:54:04.981738+0000","last_clean_scrub_stamp":"2024-05-08T18:54:04.981738+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:21:48.530318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"27'3","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:26.928401+0000","last_change":"2024-05-08T18:54:26.928401+0000","last_active":"2024-05-08T18:54:26.928401+0000","last_peered":"2024-05-08T18:54:26.928401+0000","last_clean":"2024-05-08T18:54:26.928401+0000","last_became_active":"2024-05-08T18:50:26.018713+0000","last_became_peered":"2024-05-08T18:50:26.018713+0000","last_unstale":"2024-05-08T18:54:26.928401+0000","last_undegraded":"2024-05-08T18:54:26.928401+0000","last_fullsized":"2024-05-08T18:54:26.928401+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-08T18:54:26.928285+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-08T18:54:26.928285+0000","last_clean_scrub_stamp":"2024-05-08T18:54:26.928285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:55.724493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"27'6","reported_seq":58,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:41.040093+0000","last_change":"2024-05-08T18:54:41.040093+0000","last_active":"2024-05-08T18:54:41.040093+0000","last_peered":"2024-05-08T18:54:41.040093+0000","last_clean":"2024-05-08T18:54:41.040093+0000","last_became_active":"2024-05-08T18:50:28.026292+0000","last_became_peered":"2024-05-08T18:50:28.026292+0000","last_unstale":"2024-05-08T18:54:41.040093+0000","last_undegraded":"2024-05-08T18:54:41.040093+0000","last_fullsized":"2024-05-08T18:54:41.040093+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:41.039929+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:41.039929+0000","last_clean_scrub_stamp":"2024-05-08T18:54:41.039929+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:43.220382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:35.034493+0000","last_change":"2024-05-08T18:54:35.034493+0000","last_active":"2024-05-08T18:54:35.034493+0000","last_peered":"2024-05-08T18:54:35.034493+0000","last_clean":"2024-05-08T18:54:35.034493+0000","last_became_active":"2024-05-08T18:50:26.012760+0000","last_became_peered":"2024-05-08T18:50:26.012760+0000","last_unstale":"2024-05-08T18:54:35.034493+0000","last_undegraded":"2024-05-08T18:54:35.034493+0000","last_fullsized":"2024-05-08T18:54:35.034493+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:35.034379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:35.034379+0000","last_clean_scrub_stamp":"2024-05-08T18:54:35.034379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:33:31.251876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'4","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:53:58.998059+0000","last_change":"2024-05-08T18:53:58.998059+0000","last_active":"2024-05-08T18:53:58.998059+0000","last_peered":"2024-05-08T18:53:58.998059+0000","last_clean":"2024-05-08T18:53:58.998059+0000","last_became_active":"2024-05-08T18:50:28.038785+0000","last_became_peered":"2024-05-08T18:50:28.038785+0000","last_unstale":"2024-05-08T18:53:58.998059+0000","last_undegraded":"2024-05-08T18:53:58.998059+0000","last_fullsized":"2024-05-08T18:53:58.998059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:53:58.997912+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:53:58.997912+0000","last_clean_scrub_stamp":"2024-05-08T18:53:58.997912+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:16:10.188121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"25'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:51.930223+0000","last_change":"2024-05-08T18:54:51.930282+0000","last_active":"2024-05-08T18:54:51.930223+0000","last_peered":"2024-05-08T18:54:51.930223+0000","last_clean":"2024-05-08T18:54:51.930223+0000","last_became_active":"2024-05-08T18:50:26.025958+0000","last_became_peered":"2024-05-08T18:50:26.025958+0000","last_unstale":"2024-05-08T18:54:51.930223+0000","last_undegraded":"2024-05-08T18:54:51.930223+0000","last_fullsized":"2024-05-08T18:54:51.930223+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:51.930085+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:51.930085+0000","last_clean_scrub_stamp":"2024-05-08T18:54:51.930085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:59:57.395628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"27'6","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:31.048707+0000","last_change":"2024-05-08T18:54:31.048707+0000","last_active":"2024-05-08T18:54:31.048707+0000","last_peered":"2024-05-08T18:54:31.048707+0000","last_clean":"2024-05-08T18:54:31.048707+0000","last_became_active":"2024-05-08T18:50:28.025866+0000","last_became_peered":"2024-05-08T18:50:28.025866+0000","last_unstale":"2024-05-08T18:54:31.048707+0000","last_undegraded":"2024-05-08T18:54:31.048707+0000","last_fullsized":"2024-05-08T18:54:31.048707+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:31.048578+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:31.048578+0000","last_clean_scrub_stamp":"2024-05-08T18:54:31.048578+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:45.326435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:32.065937+0000","last_change":"2024-05-08T18:54:32.065937+0000","last_active":"2024-05-08T18:54:32.065937+0000","last_peered":"2024-05-08T18:54:32.065937+0000","last_clean":"2024-05-08T18:54:32.065937+0000","last_became_active":"2024-05-08T18:50:26.025120+0000","last_became_peered":"2024-05-08T18:50:26.025120+0000","last_unstale":"2024-05-08T18:54:32.065937+0000","last_undegraded":"2024-05-08T18:54:32.065937+0000","last_fullsized":"2024-05-08T18:54:32.065937+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:32.065765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:32.065765+0000","last_clean_scrub_stamp":"2024-05-08T18:54:32.065765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:36.467184+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"27'8","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:27.030393+0000","last_change":"2024-05-08T18:54:27.030393+0000","last_active":"2024-05-08T18:54:27.030393+0000","last_peered":"2024-05-08T18:54:27.030393+0000","last_clean":"2024-05-08T18:54:27.030393+0000","last_became_active":"2024-05-08T18:50:28.025098+0000","last_became_peered":"2024-05-08T18:50:28.025098+0000","last_unstale":"2024-05-08T18:54:27.030393+0000","last_undegraded":"2024-05-08T18:54:27.030393+0000","last_fullsized":"2024-05-08T18:54:27.030393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:27.030232+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:27.030232+0000","last_clean_scrub_stamp":"2024-05-08T18:54:27.030232+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:44:38.150032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"27'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:37.058337+0000","last_change":"2024-05-08T18:54:37.058337+0000","last_active":"2024-05-08T18:54:37.058337+0000","last_peered":"2024-05-08T18:54:37.058337+0000","last_clean":"2024-05-08T18:54:37.058337+0000","last_became_active":"2024-05-08T18:50:26.014434+0000","last_became_peered":"2024-05-08T18:50:26.014434+0000","last_unstale":"2024-05-08T18:54:37.058337+0000","last_undegraded":"2024-05-08T18:54:37.058337+0000","last_fullsized":"2024-05-08T18:54:37.058337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:37.058211+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:37.058211+0000","last_clean_scrub_stamp":"2024-05-08T18:54:37.058211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:09:46.480736+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"27'10","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:10.981338+0000","last_change":"2024-05-08T18:54:10.981338+0000","last_active":"2024-05-08T18:54:10.981338+0000","last_peered":"2024-05-08T18:54:10.981338+0000","last_clean":"2024-05-08T18:54:10.981338+0000","last_became_active":"2024-05-08T18:50:28.037400+0000","last_became_peered":"2024-05-08T18:50:28.037400+0000","last_unstale":"2024-05-08T18:54:10.981338+0000","last_undegraded":"2024-05-08T18:54:10.981338+0000","last_fullsized":"2024-05-08T18:54:10.981338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T18:54:10.981224+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T18:54:10.981224+0000","last_clean_scrub_stamp":"2024-05-08T18:54:10.981224+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:30.981744+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"25'2","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:36.843406+0000","last_change":"2024-05-08T18:54:36.843406+0000","last_active":"2024-05-08T18:54:36.843406+0000","last_peered":"2024-05-08T18:54:36.843406+0000","last_clean":"2024-05-08T18:54:36.843406+0000","last_became_active":"2024-05-08T18:50:26.029047+0000","last_became_peered":"2024-05-08T18:50:26.029047+0000","last_unstale":"2024-05-08T18:54:36.843406+0000","last_undegraded":"2024-05-08T18:54:36.843406+0000","last_fullsized":"2024-05-08T18:54:36.843406+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-08T18:54:36.843271+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-08T18:54:36.843271+0000","last_clean_scrub_stamp":"2024-05-08T18:54:36.843271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:56.865651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"27'4","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:18.166245+0000","last_change":"2024-05-08T18:54:18.166245+0000","last_active":"2024-05-08T18:54:18.166245+0000","last_peered":"2024-05-08T18:54:18.166245+0000","last_clean":"2024-05-08T18:54:18.166245+0000","last_became_active":"2024-05-08T18:50:28.021140+0000","last_became_peered":"2024-05-08T18:50:28.021140+0000","last_unstale":"2024-05-08T18:54:18.166245+0000","last_undegraded":"2024-05-08T18:54:18.166245+0000","last_fullsized":"2024-05-08T18:54:18.166245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:18.166058+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:18.166058+0000","last_clean_scrub_stamp":"2024-05-08T18:54:18.166058+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:46.962267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:16.964506+0000","last_change":"2024-05-08T18:54:16.964506+0000","last_active":"2024-05-08T18:54:16.964506+0000","last_peered":"2024-05-08T18:54:16.964506+0000","last_clean":"2024-05-08T18:54:16.964506+0000","last_became_active":"2024-05-08T18:50:26.031680+0000","last_became_peered":"2024-05-08T18:50:26.031680+0000","last_unstale":"2024-05-08T18:54:16.964506+0000","last_undegraded":"2024-05-08T18:54:16.964506+0000","last_fullsized":"2024-05-08T18:54:16.964506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:16.964394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:16.964394+0000","last_clean_scrub_stamp":"2024-05-08T18:54:16.964394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:30.908518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"27'12","reported_seq":64,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:14.000877+0000","last_change":"2024-05-08T18:54:14.000877+0000","last_active":"2024-05-08T18:54:14.000877+0000","last_peered":"2024-05-08T18:54:14.000877+0000","last_clean":"2024-05-08T18:54:14.000877+0000","last_became_active":"2024-05-08T18:50:28.021588+0000","last_became_peered":"2024-05-08T18:50:28.021588+0000","last_unstale":"2024-05-08T18:54:14.000877+0000","last_undegraded":"2024-05-08T18:54:14.000877+0000","last_fullsized":"2024-05-08T18:54:14.000877+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-08T18:54:14.000720+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-08T18:54:14.000720+0000","last_clean_scrub_stamp":"2024-05-08T18:54:14.000720+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:24:23.994147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:36.076633+0000","last_change":"2024-05-08T18:54:36.076633+0000","last_active":"2024-05-08T18:54:36.076633+0000","last_peered":"2024-05-08T18:54:36.076633+0000","last_clean":"2024-05-08T18:54:36.076633+0000","last_became_active":"2024-05-08T18:50:26.014383+0000","last_became_peered":"2024-05-08T18:50:26.014383+0000","last_unstale":"2024-05-08T18:54:36.076633+0000","last_undegraded":"2024-05-08T18:54:36.076633+0000","last_fullsized":"2024-05-08T18:54:36.076633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:36.076512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:36.076512+0000","last_clean_scrub_stamp":"2024-05-08T18:54:36.076512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:09:35.442197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"27'6","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:37.878326+0000","last_change":"2024-05-08T18:54:37.878326+0000","last_active":"2024-05-08T18:54:37.878326+0000","last_peered":"2024-05-08T18:54:37.878326+0000","last_clean":"2024-05-08T18:54:37.878326+0000","last_became_active":"2024-05-08T18:50:28.032181+0000","last_became_peered":"2024-05-08T18:50:28.032181+0000","last_unstale":"2024-05-08T18:54:37.878326+0000","last_undegraded":"2024-05-08T18:54:37.878326+0000","last_fullsized":"2024-05-08T18:54:37.878326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:37.878213+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:37.878213+0000","last_clean_scrub_stamp":"2024-05-08T18:54:37.878213+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:19.061962+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"27'4","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:42.082664+0000","last_change":"2024-05-08T18:54:42.082664+0000","last_active":"2024-05-08T18:54:42.082664+0000","last_peered":"2024-05-08T18:54:42.082664+0000","last_clean":"2024-05-08T18:54:42.082664+0000","last_became_active":"2024-05-08T18:50:26.025473+0000","last_became_peered":"2024-05-08T18:50:26.025473+0000","last_unstale":"2024-05-08T18:54:42.082664+0000","last_undegraded":"2024-05-08T18:54:42.082664+0000","last_fullsized":"2024-05-08T18:54:42.082664+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:42.082508+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:42.082508+0000","last_clean_scrub_stamp":"2024-05-08T18:54:42.082508+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:52:31.609006+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"27'4","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:26.110825+0000","last_change":"2024-05-08T18:54:26.110825+0000","last_active":"2024-05-08T18:54:26.110825+0000","last_peered":"2024-05-08T18:54:26.110825+0000","last_clean":"2024-05-08T18:54:26.110825+0000","last_became_active":"2024-05-08T18:50:28.032462+0000","last_became_peered":"2024-05-08T18:50:28.032462+0000","last_unstale":"2024-05-08T18:54:26.110825+0000","last_undegraded":"2024-05-08T18:54:26.110825+0000","last_fullsized":"2024-05-08T18:54:26.110825+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:26.110638+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:26.110638+0000","last_clean_scrub_stamp":"2024-05-08T18:54:26.110638+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:35.721914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:38.067084+0000","last_change":"2024-05-08T18:54:38.067084+0000","last_active":"2024-05-08T18:54:38.067084+0000","last_peered":"2024-05-08T18:54:38.067084+0000","last_clean":"2024-05-08T18:54:38.067084+0000","last_became_active":"2024-05-08T18:50:26.019706+0000","last_became_peered":"2024-05-08T18:50:26.019706+0000","last_unstale":"2024-05-08T18:54:38.067084+0000","last_undegraded":"2024-05-08T18:54:38.067084+0000","last_fullsized":"2024-05-08T18:54:38.067084+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:38.066922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:38.066922+0000","last_clean_scrub_stamp":"2024-05-08T18:54:38.066922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:41:18.334160+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"27'2","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:14.148450+0000","last_change":"2024-05-08T18:54:14.148450+0000","last_active":"2024-05-08T18:54:14.148450+0000","last_peered":"2024-05-08T18:54:14.148450+0000","last_clean":"2024-05-08T18:54:14.148450+0000","last_became_active":"2024-05-08T18:50:28.031188+0000","last_became_peered":"2024-05-08T18:50:28.031188+0000","last_unstale":"2024-05-08T18:54:14.148450+0000","last_undegraded":"2024-05-08T18:54:14.148450+0000","last_fullsized":"2024-05-08T18:54:14.148450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:14.148328+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:14.148328+0000","last_clean_scrub_stamp":"2024-05-08T18:54:14.148328+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:43:04.976161+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:34.788291+0000","last_change":"2024-05-08T18:54:34.788291+0000","last_active":"2024-05-08T18:54:34.788291+0000","last_peered":"2024-05-08T18:54:34.788291+0000","last_clean":"2024-05-08T18:54:34.788291+0000","last_became_active":"2024-05-08T18:50:26.024808+0000","last_became_peered":"2024-05-08T18:50:26.024808+0000","last_unstale":"2024-05-08T18:54:34.788291+0000","last_undegraded":"2024-05-08T18:54:34.788291+0000","last_fullsized":"2024-05-08T18:54:34.788291+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:34.788178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:34.788178+0000","last_clean_scrub_stamp":"2024-05-08T18:54:34.788178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:23.242735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"27'6","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:15.931086+0000","last_change":"2024-05-08T18:54:15.931086+0000","last_active":"2024-05-08T18:54:15.931086+0000","last_peered":"2024-05-08T18:54:15.931086+0000","last_clean":"2024-05-08T18:54:15.931086+0000","last_became_active":"2024-05-08T18:50:28.022905+0000","last_became_peered":"2024-05-08T18:50:28.022905+0000","last_unstale":"2024-05-08T18:54:15.931086+0000","last_undegraded":"2024-05-08T18:54:15.931086+0000","last_fullsized":"2024-05-08T18:54:15.931086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:15.930946+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:15.930946+0000","last_clean_scrub_stamp":"2024-05-08T18:54:15.930946+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:23.850615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:33.742923+0000","last_change":"2024-05-08T18:54:33.742923+0000","last_active":"2024-05-08T18:54:33.742923+0000","last_peered":"2024-05-08T18:54:33.742923+0000","last_clean":"2024-05-08T18:54:33.742923+0000","last_became_active":"2024-05-08T18:50:26.024977+0000","last_became_peered":"2024-05-08T18:50:26.024977+0000","last_unstale":"2024-05-08T18:54:33.742923+0000","last_undegraded":"2024-05-08T18:54:33.742923+0000","last_fullsized":"2024-05-08T18:54:33.742923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:33.742808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:33.742808+0000","last_clean_scrub_stamp":"2024-05-08T18:54:33.742808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:57:38.144227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:13.006779+0000","last_change":"2024-05-08T18:54:13.006779+0000","last_active":"2024-05-08T18:54:13.006779+0000","last_peered":"2024-05-08T18:54:13.006779+0000","last_clean":"2024-05-08T18:54:13.006779+0000","last_became_active":"2024-05-08T18:50:28.037153+0000","last_became_peered":"2024-05-08T18:50:28.037153+0000","last_unstale":"2024-05-08T18:54:13.006779+0000","last_undegraded":"2024-05-08T18:54:13.006779+0000","last_fullsized":"2024-05-08T18:54:13.006779+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:13.006667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:13.006667+0000","last_clean_scrub_stamp":"2024-05-08T18:54:13.006667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:00.529680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:59.872452+0000","last_change":"2024-05-08T18:54:59.872479+0000","last_active":"2024-05-08T18:54:59.872452+0000","last_peered":"2024-05-08T18:54:59.872452+0000","last_clean":"2024-05-08T18:54:59.872452+0000","last_became_active":"2024-05-08T18:50:26.011982+0000","last_became_peered":"2024-05-08T18:50:26.011982+0000","last_unstale":"2024-05-08T18:54:59.872452+0000","last_undegraded":"2024-05-08T18:54:59.872452+0000","last_fullsized":"2024-05-08T18:54:59.872452+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:59.872358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:59.872358+0000","last_clean_scrub_stamp":"2024-05-08T18:54:59.872358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:38:58.077182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"27'8","reported_seq":71,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:25.737967+0000","last_change":"2024-05-08T18:54:25.737967+0000","last_active":"2024-05-08T18:54:25.737967+0000","last_peered":"2024-05-08T18:54:25.737967+0000","last_clean":"2024-05-08T18:54:25.737967+0000","last_became_active":"2024-05-08T18:50:28.028405+0000","last_became_peered":"2024-05-08T18:50:28.028405+0000","last_unstale":"2024-05-08T18:54:25.737967+0000","last_undegraded":"2024-05-08T18:54:25.737967+0000","last_fullsized":"2024-05-08T18:54:25.737967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:25.737811+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:25.737811+0000","last_clean_scrub_stamp":"2024-05-08T18:54:25.737811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:17:24.821299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"27'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:41.092864+0000","last_change":"2024-05-08T18:54:41.092864+0000","last_active":"2024-05-08T18:54:41.092864+0000","last_peered":"2024-05-08T18:54:41.092864+0000","last_clean":"2024-05-08T18:54:41.092864+0000","last_became_active":"2024-05-08T18:50:26.023658+0000","last_became_peered":"2024-05-08T18:50:26.023658+0000","last_unstale":"2024-05-08T18:54:41.092864+0000","last_undegraded":"2024-05-08T18:54:41.092864+0000","last_fullsized":"2024-05-08T18:54:41.092864+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:41.092756+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:41.092756+0000","last_clean_scrub_stamp":"2024-05-08T18:54:41.092756+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:24.283494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"25'4","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:25.145268+0000","last_change":"2024-05-08T18:54:25.145268+0000","last_active":"2024-05-08T18:54:25.145268+0000","last_peered":"2024-05-08T18:54:25.145268+0000","last_clean":"2024-05-08T18:54:25.145268+0000","last_became_active":"2024-05-08T18:50:28.032552+0000","last_became_peered":"2024-05-08T18:50:28.032552+0000","last_unstale":"2024-05-08T18:54:25.145268+0000","last_undegraded":"2024-05-08T18:54:25.145268+0000","last_fullsized":"2024-05-08T18:54:25.145268+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-08T18:54:25.145141+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-08T18:54:25.145141+0000","last_clean_scrub_stamp":"2024-05-08T18:54:25.145141+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:27:31.782772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:12.958343+0000","last_change":"2024-05-08T18:54:12.958343+0000","last_active":"2024-05-08T18:54:12.958343+0000","last_peered":"2024-05-08T18:54:12.958343+0000","last_clean":"2024-05-08T18:54:12.958343+0000","last_became_active":"2024-05-08T18:50:26.032385+0000","last_became_peered":"2024-05-08T18:50:26.032385+0000","last_unstale":"2024-05-08T18:54:12.958343+0000","last_undegraded":"2024-05-08T18:54:12.958343+0000","last_fullsized":"2024-05-08T18:54:12.958343+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:54:12.958227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:54:12.958227+0000","last_clean_scrub_stamp":"2024-05-08T18:54:12.958227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:22.832530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"27'6","reported_seq":67,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:19.850079+0000","last_change":"2024-05-08T18:54:19.850079+0000","last_active":"2024-05-08T18:54:19.850079+0000","last_peered":"2024-05-08T18:54:19.850079+0000","last_clean":"2024-05-08T18:54:19.850079+0000","last_became_active":"2024-05-08T18:50:28.023807+0000","last_became_peered":"2024-05-08T18:50:28.023807+0000","last_unstale":"2024-05-08T18:54:19.850079+0000","last_undegraded":"2024-05-08T18:54:19.850079+0000","last_fullsized":"2024-05-08T18:54:19.850079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:19.849922+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:19.849922+0000","last_clean_scrub_stamp":"2024-05-08T18:54:19.849922+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:48.646130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"27'2","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:44.082193+0000","last_change":"2024-05-08T18:54:44.082193+0000","last_active":"2024-05-08T18:54:44.082193+0000","last_peered":"2024-05-08T18:54:44.082193+0000","last_clean":"2024-05-08T18:54:44.082193+0000","last_became_active":"2024-05-08T18:50:26.025023+0000","last_became_peered":"2024-05-08T18:50:26.025023+0000","last_unstale":"2024-05-08T18:54:44.082193+0000","last_undegraded":"2024-05-08T18:54:44.082193+0000","last_fullsized":"2024-05-08T18:54:44.082193+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T18:54:44.082062+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T18:54:44.082062+0000","last_clean_scrub_stamp":"2024-05-08T18:54:44.082062+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:54:25.887815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'6","reported_seq":57,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:47.974865+0000","last_change":"2024-05-08T18:54:47.974865+0000","last_active":"2024-05-08T18:54:47.974865+0000","last_peered":"2024-05-08T18:54:47.974865+0000","last_clean":"2024-05-08T18:54:47.974865+0000","last_became_active":"2024-05-08T18:50:26.026333+0000","last_became_peered":"2024-05-08T18:50:26.026333+0000","last_unstale":"2024-05-08T18:54:47.974865+0000","last_undegraded":"2024-05-08T18:54:47.974865+0000","last_fullsized":"2024-05-08T18:54:47.974865+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-08T18:54:47.974728+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-08T18:54:47.974728+0000","last_clean_scrub_stamp":"2024-05-08T18:54:47.974728+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:42.230020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"25'4","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:25.063893+0000","last_change":"2024-05-08T18:54:25.063893+0000","last_active":"2024-05-08T18:54:25.063893+0000","last_peered":"2024-05-08T18:54:25.063893+0000","last_clean":"2024-05-08T18:54:25.063893+0000","last_became_active":"2024-05-08T18:50:28.024627+0000","last_became_peered":"2024-05-08T18:50:28.024627+0000","last_unstale":"2024-05-08T18:54:25.063893+0000","last_undegraded":"2024-05-08T18:54:25.063893+0000","last_fullsized":"2024-05-08T18:54:25.063893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-08T18:54:25.063768+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-08T18:54:25.063768+0000","last_clean_scrub_stamp":"2024-05-08T18:54:25.063768+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:47:34.140703+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"27'4","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:40.078087+0000","last_change":"2024-05-08T18:54:40.078087+0000","last_active":"2024-05-08T18:54:40.078087+0000","last_peered":"2024-05-08T18:54:40.078087+0000","last_clean":"2024-05-08T18:54:40.078087+0000","last_became_active":"2024-05-08T18:50:26.024839+0000","last_became_peered":"2024-05-08T18:50:26.024839+0000","last_unstale":"2024-05-08T18:54:40.078087+0000","last_undegraded":"2024-05-08T18:54:40.078087+0000","last_fullsized":"2024-05-08T18:54:40.078087+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T18:54:40.077968+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T18:54:40.077968+0000","last_clean_scrub_stamp":"2024-05-08T18:54:40.077968+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:49:49.689244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"27'8","reported_seq":66,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-08T18:54:09.980547+0000","last_change":"2024-05-08T18:54:09.980547+0000","last_active":"2024-05-08T18:54:09.980547+0000","last_peered":"2024-05-08T18:54:09.980547+0000","last_clean":"2024-05-08T18:54:09.980547+0000","last_became_active":"2024-05-08T18:50:28.038677+0000","last_became_peered":"2024-05-08T18:50:28.038677+0000","last_unstale":"2024-05-08T18:54:09.980547+0000","last_undegraded":"2024-05-08T18:54:09.980547+0000","last_fullsized":"2024-05-08T18:54:09.980547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T18:54:09.980433+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T18:54:09.980433+0000","last_clean_scrub_stamp":"2024-05-08T18:54:09.980433+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:06:23.924556+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1522,"ondisk_log_size":1522,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1601,"num_read_kb":1491,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705728,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39904,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331936,"statfs":{"total":96636764160,"available":96595902464,"internally_reserved":0,"allocated":417792,"data_stored":121043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705729,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36256,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335584,"statfs":{"total":96636764160,"available":96599638016,"internally_reserved":0,"allocated":942080,"data_stored":707921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705728,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36284,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335556,"statfs":{"total":96636764160,"available":96599609344,"internally_reserved":0,"allocated":970752,"data_stored":708927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705728,"num_pgs":135,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":380928,"data_stored":119875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:55:28.148 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-08T18:55:28.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.276+0000 7f87571fe640 1 Processor -- start 2024-05-08T18:55:28.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.276+0000 7f87571fe640 1 -- start start 2024-05-08T18:55:28.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.277+0000 7f87571fe640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f875012c5f0 0x7f875012c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:55:28.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.277+0000 7f87571fe640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f875012c1a0 con 0x7f8750128b70 2024-05-08T18:55:28.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.277+0000 7f87571fe640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 -- 0x7f875006f770 con 0x7f875012c5f0 2024-05-08T18:55:28.276 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.277+0000 7f8754f9a640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f875012c5f0 0x7f875012c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:55:28.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.277+0000 7f874ffff640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f8750128b70 0x7f8750128fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:42590/0 (socket says 172.21.15.42:42590) 2024-05-08T18:55:28.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.277+0000 7f874ffff640 1 -- 172.21.15.42:0/3736741398 learned_addr learned my addr 172.21.15.42:0/3736741398 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-05-08T18:55:28.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.277+0000 7f8754f9a640 1 -- 172.21.15.42:0/3736741398 >> v1:172.21.15.42:6789/0 conn(0x7f8750128b70 legacy=0x7f8750128fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:55:28.277 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.277+0000 7f8754f9a640 1 -- 172.21.15.42:0/3736741398 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f875008fc20 con 0x7f875012c5f0 2024-05-08T18:55:28.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.278+0000 7f8754f9a640 1 --2- 172.21.15.42:0/3736741398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f875012c5f0 0x7f875012c9d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f8740009720 tx=0x7f874002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520aba3bb467a273 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:55:28.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.278+0000 7f874f7fe640 1 -- 172.21.15.42:0/3736741398 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87400316d0 con 0x7f875012c5f0 2024-05-08T18:55:28.278 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.278+0000 7f874f7fe640 1 -- 172.21.15.42:0/3736741398 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8740037070 con 0x7f875012c5f0 2024-05-08T18:55:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.278+0000 7f874f7fe640 1 -- 172.21.15.42:0/3736741398 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87400319c0 con 0x7f875012c5f0 2024-05-08T18:55:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.279+0000 7f87571fe640 1 -- 172.21.15.42:0/3736741398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f875012c5f0 msgr2=0x7f875012c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:55:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.279+0000 7f87571fe640 1 --2- 172.21.15.42:0/3736741398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f875012c5f0 0x7f875012c9d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f8740009720 tx=0x7f874002b840 comp rx=0 tx=0).stop 2024-05-08T18:55:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.279+0000 7f87571fe640 1 -- 172.21.15.42:0/3736741398 shutdown_connections 2024-05-08T18:55:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.279+0000 7f87571fe640 1 --2- 172.21.15.42:0/3736741398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f875012c5f0 0x7f875012c9d0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:55:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.279+0000 7f87571fe640 1 -- 172.21.15.42:0/3736741398 >> 172.21.15.42:0/3736741398 conn(0x7f875009c5a0 msgr2=0x7f875009c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:55:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.279+0000 7f87571fe640 1 -- 172.21.15.42:0/3736741398 shutdown_connections 2024-05-08T18:55:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.279+0000 7f87571fe640 1 -- 172.21.15.42:0/3736741398 wait complete. 2024-05-08T18:55:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.280+0000 7f87571fe640 1 Processor -- start 2024-05-08T18:55:28.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.280+0000 7f87571fe640 1 -- start start 2024-05-08T18:55:28.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.280+0000 7f87571fe640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8750128b70 0x7f8750124c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:55:28.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.280+0000 7f87571fe640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 -- 0x7f875006fe20 con 0x7f8750128b70 2024-05-08T18:55:28.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.280+0000 7f8754f9a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8750128b70 0x7f8750124c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:55:28.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.280+0000 7f8754f9a640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8750128b70 0x7f8750124c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:37928/0 (socket says 172.21.15.42:37928) 2024-05-08T18:55:28.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.280+0000 7f8754f9a640 1 -- 172.21.15.42:0/2041110870 learned_addr learned my addr 172.21.15.42:0/2041110870 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-05-08T18:55:28.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.281+0000 7f8754f9a640 1 -- 172.21.15.42:0/2041110870 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8750070730 con 0x7f8750128b70 2024-05-08T18:55:28.281 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.281+0000 7f8754f9a640 1 --2- 172.21.15.42:0/2041110870 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8750128b70 0x7f8750124c40 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f8740034040 tx=0x7f87400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:55:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.281+0000 7f874d7fa640 1 -- 172.21.15.42:0/2041110870 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8740032770 con 0x7f8750128b70 2024-05-08T18:55:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.281+0000 7f874d7fa640 1 -- 172.21.15.42:0/2041110870 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8740032930 con 0x7f8750128b70 2024-05-08T18:55:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.281+0000 7f87571fe640 1 -- 172.21.15.42:0/2041110870 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87500714c0 con 0x7f8750128b70 2024-05-08T18:55:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.281+0000 7f874d7fa640 1 -- 172.21.15.42:0/2041110870 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8740032c50 con 0x7f8750128b70 2024-05-08T18:55:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.281+0000 7f87571fe640 1 -- 172.21.15.42:0/2041110870 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8750125180 con 0x7f8750128b70 2024-05-08T18:55:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.282+0000 7f874d7fa640 1 -- 172.21.15.42:0/2041110870 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) ==== 49411+0+0 (secure 0 0 0) 0x7f874004c060 con 0x7f8750128b70 2024-05-08T18:55:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.282+0000 7f87571fe640 1 -- 172.21.15.42:0/2041110870 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8750064010 con 0x7f8750128b70 2024-05-08T18:55:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.282+0000 7f874d7fa640 1 --2- 172.21.15.42:0/2041110870 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f873003d2e0 0x7f873003f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:55:28.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.282+0000 7f874d7fa640 1 -- 172.21.15.42:0/2041110870 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5967+0+0 (secure 0 0 0) 0x7f874002f050 con 0x7f8750128b70 2024-05-08T18:55:28.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.283+0000 7f874ffff640 1 --2- 172.21.15.42:0/2041110870 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f873003d2e0 0x7f873003f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:55:28.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.283+0000 7f874ffff640 1 --2- 172.21.15.42:0/2041110870 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f873003d2e0 0x7f873003f7a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8738007fd0 tx=0x7f8738007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:55:28.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.287+0000 7f874d7fa640 1 -- 172.21.15.42:0/2041110870 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190715 (secure 0 0 0) 0x7f8740040070 con 0x7f8750128b70 2024-05-08T18:55:28.475 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.476+0000 7f87571fe640 1 -- 172.21.15.42:0/2041110870 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f87500008d0 con 0x7f8750128b70 2024-05-08T18:55:28.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.478+0000 7f874d7fa640 1 -- 172.21.15.42:0/2041110870 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f8740006870 con 0x7f8750128b70 2024-05-08T18:55:28.477 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.479+0000 7f874d7fa640 1 -- 172.21.15.42:0/2041110870 <== mon.0 v2:172.21.15.42:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f87400370c0 con 0x7f8750128b70 2024-05-08T18:55:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.480+0000 7f87571fe640 1 -- 172.21.15.42:0/2041110870 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f873003d2e0 msgr2=0x7f873003f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:55:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.480+0000 7f87571fe640 1 --2- 172.21.15.42:0/2041110870 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f873003d2e0 0x7f873003f7a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8738007fd0 tx=0x7f8738007ac0 comp rx=0 tx=0).stop 2024-05-08T18:55:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.480+0000 7f87571fe640 1 -- 172.21.15.42:0/2041110870 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8750128b70 msgr2=0x7f8750124c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:55:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.480+0000 7f87571fe640 1 --2- 172.21.15.42:0/2041110870 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8750128b70 0x7f8750124c40 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f8740034040 tx=0x7f87400046c0 comp rx=0 tx=0).stop 2024-05-08T18:55:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.480+0000 7f87571fe640 1 -- 172.21.15.42:0/2041110870 shutdown_connections 2024-05-08T18:55:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.480+0000 7f87571fe640 1 --2- 172.21.15.42:0/2041110870 >> [v2:172.21.15.132:6824/2104266563,v1:172.21.15.132:6825/2104266563] conn(0x7f873003d2e0 0x7f873003f7a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:55:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.480+0000 7f87571fe640 1 --2- 172.21.15.42:0/2041110870 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8750128b70 0x7f8750124c40 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:55:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.480+0000 7f87571fe640 1 -- 172.21.15.42:0/2041110870 >> 172.21.15.42:0/2041110870 conn(0x7f875009c5a0 msgr2=0x7f8750126a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:55:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.481+0000 7f87571fe640 1 -- 172.21.15.42:0/2041110870 shutdown_connections 2024-05-08T18:55:28.480 INFO:teuthology.orchestra.run.smithi042.stderr:2024-05-08T18:55:28.481+0000 7f87571fe640 1 -- 172.21.15.42:0/2041110870 wait complete. 2024-05-08T18:55:28.490 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-08T18:55:28.490 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-08T18:55:28.491 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-08T18:55:28.491 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:55:28.537 INFO:tasks.ceph.osd.0:Stopped 2024-05-08T18:55:28.537 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-08T18:55:28.538 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:55:28.580 INFO:tasks.ceph.osd.1:Stopped 2024-05-08T18:55:28.581 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-08T18:55:28.581 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:55:28.618 INFO:tasks.ceph.osd.2:Stopped 2024-05-08T18:55:28.619 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-08T18:55:28.619 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:55:28.695 INFO:tasks.ceph.osd.3:Stopped 2024-05-08T18:55:28.695 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-08T18:55:28.695 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-08T18:55:28.696 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:55:28.765 INFO:tasks.ceph.mgr.x:Stopped 2024-05-08T18:55:28.765 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-08T18:55:28.766 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-08T18:55:28.766 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:55:28.777 INFO:tasks.ceph.mon.a:Stopped 2024-05-08T18:55:28.777 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-08T18:55:28.777 DEBUG:teuthology.orchestra.run.smithi042:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-05-08T18:55:28.845 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi042.front.sepia.ceph.com 2024-05-08T18:55:28.846 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-08T18:55:29.054 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi132.front.sepia.ceph.com 2024-05-08T18:55:29.054 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-08T18:55:29.197 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi132.front.sepia.ceph.com 2024-05-08T18:55:29.198 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-08T18:55:29.255 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi132.front.sepia.ceph.com 2024-05-08T18:55:29.255 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-08T18:55:29.330 INFO:tasks.ceph:Archiving mon data... 2024-05-08T18:55:29.331 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697938/data/mon.a.tgz 2024-05-08T18:55:29.331 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-05-08T18:55:29.348 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.c5Wl0IDkMy 2024-05-08T18:55:29.349 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.c5Wl0IDkMy 2024-05-08T18:55:29.494 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.c5Wl0IDkMy 2024-05-08T18:55:29.579 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.c5Wl0IDkMy is 263KB 2024-05-08T18:55:29.673 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.c5Wl0IDkMy 2024-05-08T18:55:29.689 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-08T18:55:29.689 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T18:55:29.731 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T18:55:29.810 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-08T18:55:29.827 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-08T18:55:29.827 INFO:tasks.ceph:Archiving crash dumps... 2024-05-08T18:55:29.829 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/crash to /home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697938/remote/smithi042/crash 2024-05-08T18:55:29.830 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T18:55:29.875 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/crash to /home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697938/remote/smithi132/crash 2024-05-08T18:55:29.876 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T18:55:29.916 INFO:tasks.ceph:Compressing logs... 2024-05-08T18:55:29.917 DEBUG:teuthology.orchestra.run.smithi042:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T18:55:29.919 DEBUG:teuthology.orchestra.run.smithi132:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T18:55:29.941 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26393.log 2024-05-08T18:55:29.957 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30575.log 2024-05-08T18:55:29.957 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.tmp-client.admin.26393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30281.log 2024-05-08T18:55:29.957 INFO:teuthology.orchestra.run.smithi042.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26393.log.gz 2024-05-08T18:55:29.957 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-client.admin.30575.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.30365.log 2024-05-08T18:55:29.957 INFO:teuthology.orchestra.run.smithi042.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30575.log.gz 2024-05-08T18:55:29.957 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30323.log 2024-05-08T18:55:29.957 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30365.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.30281.log.gz 2024-05-08T18:55:29.958 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29846.log 2024-05-08T18:55:29.958 INFO:teuthology.orchestra.run.smithi042.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30365.log.gz 2024-05-08T18:55:29.958 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30323.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-08T18:55:29.958 INFO:teuthology.orchestra.run.smithi042.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30323.log.gz 2024-05-08T18:55:29.958 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29639.log 2024-05-08T18:55:29.958 INFO:teuthology.orchestra.run.smithi042.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29846.log.gz 2024-05-08T18:55:29.958 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28255.log 2024-05-08T18:55:29.958 INFO:teuthology.orchestra.run.smithi042.stderr:gzip/var/log/ceph/ceph-client.admin.29639.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.29699.log 2024-05-08T18:55:29.958 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.28255.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29639.log.gz 2024-05-08T18:55:29.958 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-08T18:55:29.958 INFO:teuthology.orchestra.run.smithi042.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.28255.log.gz 2024-05-08T18:55:29.958 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29329.log 2024-05-08T18:55:29.958 INFO:teuthology.orchestra.run.smithi042.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29699.log.gz 2024-05-08T18:55:29.959 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.audit.log: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-08T18:55:29.959 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30449.log 2024-05-08T18:55:29.959 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29287.log 2024-05-08T18:55:29.959 INFO:teuthology.orchestra.run.smithi042.stderr: 88.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-08T18:55:29.959 INFO:teuthology.orchestra.run.smithi042.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29329.log.gz 2024-05-08T18:55:29.959 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30407.log 2024-05-08T18:55:29.959 INFO:teuthology.orchestra.run.smithi042.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30449.log.gz 2024-05-08T18:55:29.959 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29429.log 2024-05-08T18:55:29.959 INFO:teuthology.orchestra.run.smithi042.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.29287.log.gz 2024-05-08T18:55:29.959 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30017.log 2024-05-08T18:55:29.959 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29697.log/var/log/ceph/ceph-client.admin.29429.log: 2024-05-08T18:55:29.959 INFO:teuthology.orchestra.run.smithi042.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30407.log.gz 2024-05-08T18:55:29.959 INFO:teuthology.orchestra.run.smithi042.stderr: 85.9%/var/log/ceph/ceph-client.admin.30017.log: -- replaced with /var/log/ceph/ceph-client.admin.29429.log.gz 2024-05-08T18:55:29.959 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30867.log 2024-05-08T18:55:29.960 INFO:teuthology.orchestra.run.smithi042.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30017.log.gz 2024-05-08T18:55:29.960 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29807.log 2024-05-08T18:55:29.960 INFO:teuthology.orchestra.run.smithi042.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29697.log.gz 2024-05-08T18:55:29.960 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29528.log 2024-05-08T18:55:29.960 INFO:teuthology.orchestra.run.smithi042.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30867.log.gz 2024-05-08T18:55:29.960 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29529.log 2024-05-08T18:55:29.960 INFO:teuthology.orchestra.run.smithi042.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29807.log.gz 2024-05-08T18:55:29.960 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29531.log 2024-05-08T18:55:29.960 INFO:teuthology.orchestra.run.smithi042.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29528.log.gz 2024-05-08T18:55:29.960 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-08T18:55:29.960 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29529.log: /var/log/ceph/ceph-client.admin.29531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30113.log 2024-05-08T18:55:29.960 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29529.log.gz 2024-05-08T18:55:29.960 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.0.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.29531.log.gz 2024-05-08T18:55:29.960 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30827.log 2024-05-08T18:55:29.961 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29847.log 2024-05-08T18:55:29.961 INFO:teuthology.orchestra.run.smithi042.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30113.log.gz 2024-05-08T18:55:29.961 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30701.log 2024-05-08T18:55:29.961 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29847.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.30827.log.gz 2024-05-08T18:55:29.961 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30743.log 2024-05-08T18:55:29.961 INFO:teuthology.orchestra.run.smithi042.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.29847.log.gz 2024-05-08T18:55:29.961 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29187.log 2024-05-08T18:55:29.961 INFO:teuthology.orchestra.run.smithi042.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30701.log.gz 2024-05-08T18:55:29.961 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30743.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-08T18:55:29.961 INFO:teuthology.orchestra.run.smithi042.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30743.log.gz 2024-05-08T18:55:29.961 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30533.log 2024-05-08T18:55:29.961 INFO:teuthology.orchestra.run.smithi042.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29187.log.gz 2024-05-08T18:55:29.961 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29530.log 2024-05-08T18:55:29.962 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29698.log 2024-05-08T18:55:29.962 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29530.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.30533.log.gz 2024-05-08T18:55:29.962 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30059.log 2024-05-08T18:55:29.962 INFO:teuthology.orchestra.run.smithi042.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29530.log.gz 2024-05-08T18:55:29.962 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30155.log 2024-05-08T18:55:29.962 INFO:teuthology.orchestra.run.smithi042.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29698.log.gz 2024-05-08T18:55:29.962 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29245.log 2024-05-08T18:55:29.962 INFO:teuthology.orchestra.run.smithi042.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30059.log.gz 2024-05-08T18:55:29.962 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30659.log 2024-05-08T18:55:29.962 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30155.log: /var/log/ceph/ceph-client.admin.29245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30617.log 2024-05-08T18:55:29.962 INFO:teuthology.orchestra.run.smithi042.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30155.log.gz 2024-05-08T18:55:29.962 INFO:teuthology.orchestra.run.smithi042.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29245.log.gz 2024-05-08T18:55:29.962 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29387.log 2024-05-08T18:55:29.963 INFO:teuthology.orchestra.run.smithi042.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30659.log.gz 2024-05-08T18:55:29.963 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30197.log 2024-05-08T18:55:29.963 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30617.log: /var/log/ceph/ceph-client.admin.29387.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30617.log.gz 2024-05-08T18:55:29.963 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30491.log 2024-05-08T18:55:29.963 INFO:teuthology.orchestra.run.smithi042.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29387.log.gz 2024-05-08T18:55:29.963 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29975.log 2024-05-08T18:55:29.963 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30197.log: /var/log/ceph/ceph-client.admin.30491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29869.log 2024-05-08T18:55:29.963 INFO:teuthology.orchestra.run.smithi042.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.30197.log.gz 2024-05-08T18:55:29.963 INFO:teuthology.orchestra.run.smithi042.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30491.log.gz 2024-05-08T18:55:29.963 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30785.log 2024-05-08T18:55:29.963 INFO:teuthology.orchestra.run.smithi042.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.29975.log.gz 2024-05-08T18:55:29.963 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.29869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30239.log 2024-05-08T18:55:29.963 INFO:teuthology.orchestra.run.smithi042.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29869.log.gz 2024-05-08T18:55:29.964 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28215.log 2024-05-08T18:55:29.964 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.30785.log: /var/log/ceph/ceph-client.admin.30239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28097.log 2024-05-08T18:55:29.964 INFO:teuthology.orchestra.run.smithi042.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30785.log.gz 2024-05-08T18:55:29.964 INFO:teuthology.orchestra.run.smithi042.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30239.log.gz 2024-05-08T18:55:29.964 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.28215.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.28215.log.gz 2024-05-08T18:55:29.964 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.28097.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.28097.log.gz 2024-05-08T18:55:29.991 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76993.log 2024-05-08T18:55:29.992 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41298.log 2024-05-08T18:55:29.993 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.76993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80018.log 2024-05-08T18:55:29.993 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.41298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59448.log 2024-05-08T18:55:29.993 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.80018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40693.log 2024-05-08T18:55:29.995 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.59448.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76993.log.gz 2024-05-08T18:55:29.996 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78203.log 2024-05-08T18:55:29.996 INFO:teuthology.orchestra.run.smithi132.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.41298.log.gz 2024-05-08T18:55:29.996 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43113.log 2024-05-08T18:55:29.996 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.40693.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.80018.log.gz 2024-05-08T18:55:29.996 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.78203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74573.log 2024-05-08T18:55:29.996 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.43113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71548.log 2024-05-08T18:55:29.996 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.74573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37069.log 2024-05-08T18:55:29.996 INFO:teuthology.orchestra.run.smithi132.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.78203.log.gz/var/log/ceph/ceph-client.0.71548.log: 2024-05-08T18:55:29.996 INFO:teuthology.orchestra.run.smithi132.stderr: 91.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77598.log 2024-05-08T18:55:29.996 INFO:teuthology.orchestra.run.smithi132.stderr: -- replaced with /var/log/ceph/ceph-client.0.59448.log.gz 2024-05-08T18:55:29.996 INFO:teuthology.orchestra.run.smithi132.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.40693.log.gz 2024-05-08T18:55:29.996 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41903.log 2024-05-08T18:55:29.996 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.37069.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.43113.log.gz 2024-05-08T18:55:29.997 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87853.log 2024-05-08T18:55:30.015 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.77598.log: /var/log/ceph/ceph-client.0.41903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66103.log 2024-05-08T18:55:30.015 INFO:teuthology.orchestra.run.smithi132.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.74573.log.gz 2024-05-08T18:55:30.015 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.87853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60658.log 2024-05-08T18:55:30.015 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.66103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52188.log 2024-05-08T18:55:30.015 INFO:teuthology.orchestra.run.smithi132.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.37069.log.gz 2024-05-08T18:55:30.015 INFO:teuthology.orchestra.run.smithi132.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77598.log.gz 91.3% -- replaced with /var/log/ceph/ceph-client.0.41903.log.gz 2024-05-08T18:55:30.015 INFO:teuthology.orchestra.run.smithi132.stderr: 2024-05-08T18:55:30.016 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.60658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52793.log 2024-05-08T18:55:30.016 INFO:teuthology.orchestra.run.smithi132.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.71548.log.gz 2024-05-08T18:55:30.016 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.52188.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.87853.log.gz 2024-05-08T18:55:30.016 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75783.log 2024-05-08T18:55:30.016 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63078.log 2024-05-08T18:55:30.016 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.52793.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.66103.log.gz 2024-05-08T18:55:30.016 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.75783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69733.log 2024-05-08T18:55:30.016 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.63078.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.52188.log.gz 2024-05-08T18:55:30.016 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50978.log 2024-05-08T18:55:30.016 INFO:teuthology.orchestra.run.smithi132.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.60658.log.gz 2024-05-08T18:55:30.016 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-08T18:55:30.016 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.69733.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.52793.log.gz 2024-05-08T18:55:30.016 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.50978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65498.log 2024-05-08T18:55:30.016 INFO:teuthology.orchestra.run.smithi132.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.75783.log.gz 2024-05-08T18:55:30.017 INFO:teuthology.orchestra.run.smithi132.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.63078.log.gz 2024-05-08T18:55:30.017 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68523.log 2024-05-08T18:55:30.017 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.65498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54003.log 2024-05-08T18:55:30.017 INFO:teuthology.orchestra.run.smithi132.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.50978.log.gz 2024-05-08T18:55:30.017 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.68523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49163.log 2024-05-08T18:55:30.017 INFO:teuthology.orchestra.run.smithi132.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.69733.log.gz 2024-05-08T18:55:30.017 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.54003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93903.log 2024-05-08T18:55:30.017 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.49163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35859.log 2024-05-08T18:55:30.017 INFO:teuthology.orchestra.run.smithi132.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.65498.log.gz 2024-05-08T18:55:30.017 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.93903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75178.log 2024-05-08T18:55:30.017 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.35859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86649.log 2024-05-08T18:55:30.017 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.75178.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.54003.log.gz 2024-05-08T18:55:30.017 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92088.log 2024-05-08T18:55:30.017 INFO:teuthology.orchestra.run.smithi132.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.49163.log.gz 2024-05-08T18:55:30.018 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87248.log 2024-05-08T18:55:30.018 INFO:teuthology.orchestra.run.smithi132.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.93903.log.gz 2024-05-08T18:55:30.018 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.86649.log: /var/log/ceph/ceph-client.0.92088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30467.log 2024-05-08T18:55:30.018 INFO:teuthology.orchestra.run.smithi132.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.68523.log.gz 2024-05-08T18:55:30.018 INFO:teuthology.orchestra.run.smithi132.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.35859.log.gz 2024-05-08T18:55:30.018 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.87248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34946.log 2024-05-08T18:55:30.018 INFO:teuthology.orchestra.run.smithi132.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.75178.log.gz 2024-05-08T18:55:30.018 INFO:teuthology.orchestra.run.smithi132.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.86649.log.gz 2024-05-08T18:55:30.018 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-08T18:55:30.018 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.30467.log: /var/log/ceph/ceph-client.admin.34946.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.30467.log.gz 2024-05-08T18:55:30.018 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51583.log 2024-05-08T18:55:30.018 INFO:teuthology.orchestra.run.smithi132.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.92088.log.gz 2024-05-08T18:55:30.018 INFO:teuthology.orchestra.run.smithi132.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.34946.log.gz 2024-05-08T18:55:30.018 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45533.log 2024-05-08T18:55:30.019 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.51583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57028.log 2024-05-08T18:55:30.019 INFO:teuthology.orchestra.run.smithi132.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.87248.log.gz 2024-05-08T18:55:30.019 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.45533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49768.log 2024-05-08T18:55:30.019 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.57028.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-05-08T18:55:30.019 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.49768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35026.log 2024-05-08T18:55:30.019 INFO:teuthology.orchestra.run.smithi132.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.51583.log.gz 2024-05-08T18:55:30.019 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.45533.log.gz 2024-05-08T18:55:30.019 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86050.log 2024-05-08T18:55:30.019 INFO:teuthology.orchestra.run.smithi132.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.57028.log.gz 2024-05-08T18:55:30.019 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.35026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56423.log 2024-05-08T18:55:30.019 INFO:teuthology.orchestra.run.smithi132.stderr: 91.9% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-05-08T18:55:30.019 INFO:teuthology.orchestra.run.smithi132.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.49768.log.gz 2024-05-08T18:55:30.019 INFO:teuthology.orchestra.run.smithi132.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.35026.log.gz 2024-05-08T18:55:30.019 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.86050.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-05-08T18:55:30.019 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.56423.log: 90.4% -- replaced with /var/log/ceph/ceph-client.0.86050.log.gz 2024-05-08T18:55:30.020 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-08T18:55:30.020 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35066.log 2024-05-08T18:55:30.020 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91483.log 2024-05-08T18:55:30.020 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.35066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93298.log 2024-05-08T18:55:30.020 INFO:teuthology.orchestra.run.smithi132.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56423.log.gz 86.4% -- replaced with /var/log/ceph/ceph-client.admin.35066.log.gz 2024-05-08T18:55:30.020 INFO:teuthology.orchestra.run.smithi132.stderr: 2024-05-08T18:55:30.020 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.91483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57633.log 2024-05-08T18:55:30.020 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.93298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95770.log 2024-05-08T18:55:30.020 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.57633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89063.log 2024-05-08T18:55:30.020 INFO:teuthology.orchestra.run.smithi132.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.91483.log.gz 2024-05-08T18:55:30.020 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.95770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55818.log 2024-05-08T18:55:30.020 INFO:teuthology.orchestra.run.smithi132.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.93298.log.gz 2024-05-08T18:55:30.020 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.89063.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.57633.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.83648.log 2024-05-08T18:55:30.021 INFO:teuthology.orchestra.run.smithi132.stderr: 2024-05-08T18:55:30.021 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.55818.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.89063.log.gz 2024-05-08T18:55:30.021 INFO:teuthology.orchestra.run.smithi132.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55818.log.gz 2024-05-08T18:55:30.021 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73968.log 2024-05-08T18:55:30.021 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.83648.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-08T18:55:30.021 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.73968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80623.log 2024-05-08T18:55:30.031 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-mgr.x.log: 93.3% -- replaced with /var/log/ceph/ceph-client.0.95770.log.gz 2024-05-08T18:55:30.032 INFO:teuthology.orchestra.run.smithi132.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.83648.log.gz 2024-05-08T18:55:30.032 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84253.log 2024-05-08T18:55:30.032 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.80623.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.73968.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.66708.log 2024-05-08T18:55:30.032 INFO:teuthology.orchestra.run.smithi132.stderr: 2024-05-08T18:55:30.032 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36464.log 2024-05-08T18:55:30.032 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.84253.log: /var/log/ceph/ceph-client.0.66708.log: 90.5% -- replaced with /var/log/ceph/ceph-client.0.84253.log.gz 2024-05-08T18:55:30.032 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60053.log 2024-05-08T18:55:30.032 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.36464.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.80623.log.gz 2024-05-08T18:55:30.032 INFO:teuthology.orchestra.run.smithi132.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.66708.log.gz 2024-05-08T18:55:30.032 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38279.log 2024-05-08T18:55:30.032 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.60053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38884.log 2024-05-08T18:55:30.032 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.38279.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.36464.log.gz 2024-05-08T18:55:30.032 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84852.log 2024-05-08T18:55:30.033 INFO:teuthology.orchestra.run.smithi132.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.60053.log.gz 2024-05-08T18:55:30.033 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.38884.log: gzip -5 --verbose -- 91.5% /var/log/ceph/ceph-client.admin.30387.log 2024-05-08T18:55:30.033 INFO:teuthology.orchestra.run.smithi132.stderr: -- replaced with /var/log/ceph/ceph-client.0.38279.log.gz 2024-05-08T18:55:30.033 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.84852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67313.log 2024-05-08T18:55:30.033 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.30387.log: 90.5% -- replaced with /var/log/ceph/ceph-client.0.38884.log.gz 2024-05-08T18:55:30.033 INFO:teuthology.orchestra.run.smithi132.stderr: 84.7%gzip 91.5% -5 -- replaced with /var/log/ceph/ceph-client.0.84852.log.gz 2024-05-08T18:55:30.033 INFO:teuthology.orchestra.run.smithi132.stderr: --verbose -- /var/log/ceph/ceph-client.0.61263.log 2024-05-08T18:55:30.033 INFO:teuthology.orchestra.run.smithi132.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30387.log.gz 2024-05-08T18:55:30.033 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.0.67313.log: -- /var/log/ceph/ceph-client.0.46743.log 2024-05-08T18:55:30.033 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.61263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40088.log 2024-05-08T18:55:30.033 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.46743.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.67313.log.gz 2024-05-08T18:55:30.033 INFO:teuthology.orchestra.run.smithi132.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.61263.log.gz 2024-05-08T18:55:30.033 INFO:teuthology.orchestra.run.smithi132.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.46743.log.gz 2024-05-08T18:55:30.033 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67918.log 2024-05-08T18:55:30.034 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.40088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54608.log 2024-05-08T18:55:30.034 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.67918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83043.log 2024-05-08T18:55:30.034 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.54608.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40088.log.gz 2024-05-08T18:55:30.034 INFO:teuthology.orchestra.run.smithi132.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.67918.log.gz 2024-05-08T18:55:30.034 INFO:teuthology.orchestra.run.smithi132.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54608.log.gz 2024-05-08T18:55:30.034 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76388.log 2024-05-08T18:55:30.034 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.83043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39483.log 2024-05-08T18:55:30.034 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.76388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81833.log 2024-05-08T18:55:30.034 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.39483.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76388.log.gz 2024-05-08T18:55:30.046 INFO:teuthology.orchestra.run.smithi132.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.83043.log.gz 2024-05-08T18:55:30.046 INFO:teuthology.orchestra.run.smithi132.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.39483.log.gz 2024-05-08T18:55:30.046 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47953.log 2024-05-08T18:55:30.046 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.81833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94508.log 2024-05-08T18:55:30.047 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.47953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48558.log 2024-05-08T18:55:30.047 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.94508.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.81833.log.gz 2024-05-08T18:55:30.047 INFO:teuthology.orchestra.run.smithi132.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.47953.log.gz 2024-05-08T18:55:30.047 INFO:teuthology.orchestra.run.smithi132.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.94508.log.gz 2024-05-08T18:55:30.047 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81228.log 2024-05-08T18:55:30.047 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.48558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30347.log 2024-05-08T18:55:30.047 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.81228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58843.log 2024-05-08T18:55:30.047 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.30347.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.48558.log.gz 2024-05-08T18:55:30.047 INFO:teuthology.orchestra.run.smithi132.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30347.log.gz 2024-05-08T18:55:30.047 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73363.log 2024-05-08T18:55:30.047 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.58843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88458.log 2024-05-08T18:55:30.047 INFO:teuthology.orchestra.run.smithi132.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.81228.log.gz 2024-05-08T18:55:30.047 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.73363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37674.log 2024-05-08T18:55:30.047 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.88458.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.58843.log.gz 2024-05-08T18:55:30.048 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72153.log 2024-05-08T18:55:30.048 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.37674.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.88458.log.gz 2024-05-08T18:55:30.048 INFO:teuthology.orchestra.run.smithi132.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.73363.log.gz 2024-05-08T18:55:30.048 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53398.log 2024-05-08T18:55:30.048 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.72153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90273.log 2024-05-08T18:55:30.048 INFO:teuthology.orchestra.run.smithi132.stderr: 91.4%/var/log/ceph/ceph-client.0.53398.log: -- replaced with /var/log/ceph/ceph-client.0.37674.log.gz 2024-05-08T18:55:30.048 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34986.log 2024-05-08T18:55:30.048 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.90273.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.72153.log.gz 2024-05-08T18:55:30.048 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95113.log 2024-05-08T18:55:30.048 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.34986.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53398.log.gz 2024-05-08T18:55:30.048 INFO:teuthology.orchestra.run.smithi132.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.34986.log.gz 2024-05-08T18:55:30.048 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61868.log 2024-05-08T18:55:30.048 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44928.log 2024-05-08T18:55:30.048 INFO:teuthology.orchestra.run.smithi132.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.90273.log.gz 2024-05-08T18:55:30.049 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.95113.log: /var/log/ceph/ceph-client.0.61868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64893.log 2024-05-08T18:55:30.055 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.44928.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.95113.log.gz 2024-05-08T18:55:30.055 INFO:teuthology.orchestra.run.smithi132.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.61868.log.gz 2024-05-08T18:55:30.055 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78808.log 2024-05-08T18:55:30.055 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.64893.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.44928.log.gz 2024-05-08T18:55:30.056 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58238.log 2024-05-08T18:55:30.056 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72758.log 2024-05-08T18:55:30.056 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.78808.log: /var/log/ceph/ceph-client.0.58238.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.64893.log.gz 2024-05-08T18:55:30.056 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 91.3% -- replaced with /var/log/ceph/ceph-client.0.58238.log.gz 2024-05-08T18:55:30.056 INFO:teuthology.orchestra.run.smithi132.stderr: --verbose -- /var/log/ceph/ceph-client.0.90878.log 2024-05-08T18:55:30.056 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.72758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70338.log 2024-05-08T18:55:30.056 INFO:teuthology.orchestra.run.smithi132.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.78808.log.gz 2024-05-08T18:55:30.056 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.90878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55213.log 2024-05-08T18:55:30.056 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.70338.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.72758.log.gz 2024-05-08T18:55:30.056 INFO:teuthology.orchestra.run.smithi132.stderr: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82438.log 2024-05-08T18:55:30.056 INFO:teuthology.orchestra.run.smithi132.stderr: -- replaced with /var/log/ceph/ceph-client.0.90878.log.gz 2024-05-08T18:55:30.056 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.55213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79413.log 2024-05-08T18:55:30.056 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.82438.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.70338.log.gz 2024-05-08T18:55:30.056 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70943.log 2024-05-08T18:55:30.057 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.79413.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.55213.log.gz 2024-05-08T18:55:30.057 INFO:teuthology.orchestra.run.smithi132.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.82438.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.50373.log 2024-05-08T18:55:30.057 INFO:teuthology.orchestra.run.smithi132.stderr: 2024-05-08T18:55:30.057 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.70943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89668.log 2024-05-08T18:55:30.057 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.50373.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.79413.log.gz 2024-05-08T18:55:30.060 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85451.log 2024-05-08T18:55:30.061 INFO:teuthology.orchestra.run.smithi132.stderr: 91.0%/var/log/ceph/ceph-client.0.89668.log: -- replaced with /var/log/ceph/ceph-client.0.70943.log.gz 2024-05-08T18:55:30.061 INFO:teuthology.orchestra.run.smithi132.stderr:gzip 91.2% -5 --verbose -- /var/log/ceph/ceph-client.0.42508.log 2024-05-08T18:55:30.061 INFO:teuthology.orchestra.run.smithi132.stderr: -- replaced with /var/log/ceph/ceph-client.0.50373.log.gz 2024-05-08T18:55:30.061 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.85451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30427.log 2024-05-08T18:55:30.061 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.42508.log: 90.4% -- replaced with /var/log/ceph/ceph-client.0.85451.log.gz 2024-05-08T18:55:30.061 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44323.log 2024-05-08T18:55:30.061 INFO:teuthology.orchestra.run.smithi132.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.89668.log.gz 2024-05-08T18:55:30.061 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.30427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69128.log 2024-05-08T18:55:30.061 INFO:teuthology.orchestra.run.smithi132.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.30427.log.gz 2024-05-08T18:55:30.061 INFO:teuthology.orchestra.run.smithi132.stderr: 91.1%/var/log/ceph/ceph-client.0.44323.log: -- replaced with /var/log/ceph/ceph-client.0.42508.log.gz 2024-05-08T18:55:30.061 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63683.log 2024-05-08T18:55:30.061 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.69128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64288.log 2024-05-08T18:55:30.061 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.63683.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44323.log.gz 2024-05-08T18:55:30.065 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47348.log 2024-05-08T18:55:30.065 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.64288.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.63683.log.gz 2024-05-08T18:55:30.065 INFO:teuthology.orchestra.run.smithi132.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.69128.log.gz 2024-05-08T18:55:30.065 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62473.log 2024-05-08T18:55:30.065 INFO:teuthology.orchestra.run.smithi132.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-05-08T18:55:30.065 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.47348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46138.log 2024-05-08T18:55:30.065 INFO:teuthology.orchestra.run.smithi132.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.64288.log.gz 2024-05-08T18:55:30.065 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92693.log 2024-05-08T18:55:30.066 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.62473.log: /var/log/ceph/ceph-client.0.46138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43718.log 2024-05-08T18:55:30.066 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.92693.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.47348.log.gz 2024-05-08T18:55:30.066 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.0.43718.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.46138.log.gz 2024-05-08T18:55:30.066 INFO:teuthology.orchestra.run.smithi132.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.62473.log.gz 2024-05-08T18:55:30.066 INFO:teuthology.orchestra.run.smithi132.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.92693.log.gz 2024-05-08T18:55:30.066 INFO:teuthology.orchestra.run.smithi132.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.43718.log.gz 2024-05-08T18:55:30.076 INFO:teuthology.orchestra.run.smithi132.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-08T18:55:30.127 INFO:teuthology.orchestra.run.smithi042.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-08T18:55:30.805 INFO:teuthology.orchestra.run.smithi132.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-08T18:55:30.871 INFO:teuthology.orchestra.run.smithi042.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-08T18:55:30.873 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-05-08T18:55:30.873 INFO:teuthology.orchestra.run.smithi042.stderr:real 0m0.941s 2024-05-08T18:55:30.873 INFO:teuthology.orchestra.run.smithi042.stderr:user 0m1.092s 2024-05-08T18:55:30.873 INFO:teuthology.orchestra.run.smithi042.stderr:sys 0m0.070s 2024-05-08T18:55:30.948 INFO:teuthology.orchestra.run.smithi132.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-08T18:55:30.963 INFO:teuthology.orchestra.run.smithi132.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-08T18:55:30.965 INFO:teuthology.orchestra.run.smithi132.stderr: 2024-05-08T18:55:30.965 INFO:teuthology.orchestra.run.smithi132.stderr:real 0m0.984s 2024-05-08T18:55:30.965 INFO:teuthology.orchestra.run.smithi132.stderr:user 0m2.871s 2024-05-08T18:55:30.965 INFO:teuthology.orchestra.run.smithi132.stderr:sys 0m0.206s 2024-05-08T18:55:30.965 INFO:tasks.ceph:Archiving logs... 2024-05-08T18:55:30.965 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/log/ceph to /home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697938/remote/smithi042/log 2024-05-08T18:55:30.966 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T18:55:31.191 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/log/ceph to /home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697938/remote/smithi132/log 2024-05-08T18:55:31.192 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T18:55:31.720 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-08T18:55:31.731 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-08T18:55:31.731 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T18:55:31.734 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T18:55:31.804 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-08T18:55:31.813 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-08T18:55:31.813 DEBUG:teuthology.orchestra.run.smithi042:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T18:55:31.816 DEBUG:teuthology.orchestra.run.smithi132:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T18:55:31.830 INFO:teuthology.orchestra.run.smithi132.stderr:bash: line 1: ntpq: command not found 2024-05-08T18:55:31.830 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-05-08T18:55:31.834 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T18:55:31.834 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2024-05-08T18:55:31.834 INFO:teuthology.orchestra.run.smithi132.stdout:^* hv01.front.sepia.ceph.com 3 6 377 41 -1049us[-1036us] +/- 72ms 2024-05-08T18:55:31.834 INFO:teuthology.orchestra.run.smithi132.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 38 +1178us[+1178us] +/- 73ms 2024-05-08T18:55:31.834 INFO:teuthology.orchestra.run.smithi132.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 -76us[ -76us] +/- 92ms 2024-05-08T18:55:31.834 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T18:55:31.836 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T18:55:31.836 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-05-08T18:55:31.836 INFO:teuthology.orchestra.run.smithi042.stdout:^* hv01.front.sepia.ceph.com 3 6 377 37 -1054us[-1027us] +/- 72ms 2024-05-08T18:55:31.836 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 39 +1183us[+1209us] +/- 73ms 2024-05-08T18:55:31.836 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 -87us[ -60us] +/- 92ms 2024-05-08T18:55:31.836 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T18:55:31.836 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-08T18:55:31.846 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-08T18:55:31.846 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-08T18:55:31.857 DEBUG:teuthology.orchestra.run.smithi042:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T18:55:31.941 DEBUG:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T18:55:32.002 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T18:55:32.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:55:32.032 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T18:55:32.059 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:55:32.060 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-08T18:55:32.075 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-08T18:55:32.128 INFO:teuthology.task.internal:Duration was 746.827719 seconds 2024-05-08T18:55:32.128 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-08T18:55:32.163 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-08T18:55:32.164 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T18:55:32.166 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T18:55:32.204 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T18:55:32.207 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T18:55:32.504 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-08T18:55:32.504 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi042.front.sepia.ceph.com 2024-05-08T18:55:32.504 DEBUG:teuthology.orchestra.run.smithi042:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T18:55:32.569 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi132.front.sepia.ceph.com 2024-05-08T18:55:32.569 DEBUG:teuthology.orchestra.run.smithi132:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T18:55:32.594 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-08T18:55:32.595 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T18:55:32.611 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T18:55:32.661 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-08T18:55:32.661 DEBUG:teuthology.orchestra.run.smithi042:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T18:55:32.682 DEBUG:teuthology.orchestra.run.smithi132:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T18:55:32.796 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-08T18:55:32.807 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-08T18:55:32.808 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T18:55:32.834 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T18:55:32.859 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-08T18:55:32.870 DEBUG:teuthology.orchestra.run.smithi042:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:55:32.876 DEBUG:teuthology.orchestra.run.smithi132:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:55:32.898 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = core 2024-05-08T18:55:32.922 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = core 2024-05-08T18:55:32.959 DEBUG:teuthology.orchestra.run.smithi042:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:55:32.989 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:55:32.990 DEBUG:teuthology.orchestra.run.smithi132:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:55:33.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:55:33.014 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-08T18:55:33.024 INFO:teuthology.task.internal:Transferring archived files... 2024-05-08T18:55:33.025 DEBUG:teuthology.misc:Transferring archived files from smithi042:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697938/remote/smithi042 2024-05-08T18:55:33.025 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T18:55:33.063 DEBUG:teuthology.misc:Transferring archived files from smithi132:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/ivancich-2024-05-08_17:44:56-rgw-wip-upgrade-arrow-15-distro-default-smithi/7697938/remote/smithi132 2024-05-08T18:55:33.063 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T18:55:33.097 INFO:teuthology.task.internal:Removing archive directory... 2024-05-08T18:55:33.097 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T18:55:33.100 DEBUG:teuthology.orchestra.run.smithi132:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T18:55:33.146 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-08T18:55:33.161 INFO:teuthology.task.internal:Not uploading archives. 2024-05-08T18:55:33.161 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-08T18:55:33.176 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-08T18:55:33.176 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T18:55:33.179 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T18:55:33.191 INFO:teuthology.orchestra.run.smithi042.stdout: 265809 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 18:55 /home/ubuntu/cephtest 2024-05-08T18:55:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: 265891 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 18:55 /home/ubuntu/cephtest 2024-05-08T18:55:33.202 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-08T18:55:33.213 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-08T18:55:33.246 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}} duration: 746.8277187347412 flavor: default owner: scheduled_ivancich@teuthology success: true 2024-05-08T18:55:33.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T18:55:33.322 INFO:teuthology.run:pass